Apr 14 10:38:24 user nova-compute[71509]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code.
Apr 14 10:38:27 user nova-compute[71509]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=71509) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=71509) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=71509) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Apr 14 10:38:27 user nova-compute[71509]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.021s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:38:27 user nova-compute[71509]: INFO nova.virt.driver [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] Loading compute driver 'libvirt.LibvirtDriver'
Apr 14 10:38:27 user nova-compute[71509]: INFO nova.compute.provider_config [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] Acquiring lock "singleton_lock" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] Acquired lock "singleton_lock" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] Releasing lock "singleton_lock" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] Full set of CONF: {{(pid=71509) _wait_for_exit_or_signal /usr/local/lib/python3.10/dist-packages/oslo_service/service.py:362}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] ******************************************************************************** {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] Configuration options gathered from: {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] ================================================================================ {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] allow_resize_to_same_host      = True {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] arq_binding_timeout            = 300 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] backdoor_port                  = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] backdoor_socket                = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] block_device_allocate_retries  = 300 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] block_device_allocate_retries_interval = 5 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] cert                           = self.pem {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] compute_monitors               = [] {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] config_dir                     = [] {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] config_drive_format            = iso9660 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] config_source                  = [] {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] console_host                   = user {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] control_exchange               = nova {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] cpu_allocation_ratio           = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] daemon                         = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] debug                          = True {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] default_access_ip_network_name = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] default_availability_zone      = nova {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] default_ephemeral_format       = ext4 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] default_schedule_zone          = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] disk_allocation_ratio          = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] enable_new_services            = True {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] enabled_apis                   = ['osapi_compute'] {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] enabled_ssl_apis               = [] {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] flat_injected                  = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] force_config_drive             = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] force_raw_images               = True {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] graceful_shutdown_timeout      = 5 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] heal_instance_info_cache_interval = 60 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] host                           = user {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] instance_build_timeout         = 0 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] instance_delete_interval       = 300 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] instance_format                = [instance: %(uuid)s]  {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] instance_name_template         = instance-%08x {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] instance_usage_audit           = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] instance_usage_audit_period    = month {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] internal_service_availability_zone = internal {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] key                            = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] live_migration_retry_count     = 30 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] log_config_append              = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] log_dir                        = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] log_file                       = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] log_options                    = True {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] log_rotate_interval            = 1 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] log_rotate_interval_type       = days {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] log_rotation_type              = none {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] long_rpc_timeout               = 1800 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] max_concurrent_builds          = 10 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] max_concurrent_live_migrations = 1 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] max_concurrent_snapshots       = 5 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] max_local_block_devices        = 3 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] max_logfile_count              = 30 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] max_logfile_size_mb            = 200 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] maximum_instance_delete_attempts = 5 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] metadata_listen                = 0.0.0.0 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] metadata_listen_port           = 8775 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] metadata_workers               = 3 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] migrate_max_retries            = -1 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] mkisofs_cmd                    = genisoimage {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] my_ip                          = 10.0.0.210 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] network_allocate_retries       = 0 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] osapi_compute_listen_port      = 8774 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] osapi_compute_unique_server_name_scope =  {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] osapi_compute_workers          = 3 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] password_length                = 12 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] periodic_enable                = True {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] periodic_fuzzy_delay           = 60 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] pointer_model                  = ps2mouse {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] preallocate_images             = none {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] publish_errors                 = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] pybasedir                      = /opt/stack/nova {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] ram_allocation_ratio           = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] rate_limit_burst               = 0 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] rate_limit_except_level        = CRITICAL {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] rate_limit_interval            = 0 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] reboot_timeout                 = 0 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] reclaim_instance_interval      = 0 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] record                         = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] reimage_timeout_per_gb         = 20 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] report_interval                = 10 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] rescue_timeout                 = 0 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] reserved_host_cpus             = 0 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] reserved_host_disk_mb          = 0 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] reserved_host_memory_mb        = 512 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] reserved_huge_pages            = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] resize_confirm_window          = 0 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] resize_fs_using_block_device   = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] resume_guests_state_on_host_boot = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] rpc_response_timeout           = 60 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] run_external_periodic_tasks    = True {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] running_deleted_instance_action = reap {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] running_deleted_instance_poll_interval = 1800 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] running_deleted_instance_timeout = 0 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] scheduler_instance_sync_interval = 120 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] service_down_time              = 60 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] servicegroup_driver            = db {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] shelved_offload_time           = 0 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] shelved_poll_interval          = 3600 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] shutdown_timeout               = 0 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] source_is_ipv6                 = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] ssl_only                       = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] state_path                     = /opt/stack/data/nova {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] sync_power_state_interval      = 600 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] sync_power_state_pool_size     = 1000 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] syslog_log_facility            = LOG_USER {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] tempdir                        = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] timeout_nbd                    = 10 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] transport_url                  = **** {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] update_resources_interval      = 0 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] use_cow_images                 = True {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] use_eventlog                   = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] use_journal                    = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] use_json                       = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] use_rootwrap_daemon            = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] use_stderr                     = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] use_syslog                     = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] vcpu_pin_set                   = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] vif_plugging_is_fatal          = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] vif_plugging_timeout           = 0 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] virt_mkfs                      = [] {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] volume_usage_poll_interval     = 0 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] watch_log_file                 = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] web                            = /usr/share/spice-html5 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] oslo_concurrency.disable_process_locking = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] api.auth_strategy              = keystone {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] api.compute_link_prefix        = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] api.dhcp_domain                = novalocal {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] api.enable_instance_password   = True {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] api.glance_link_prefix         = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] api.instance_list_per_project_cells = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] api.list_records_by_skipping_down_cells = True {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] api.local_metadata_per_cell    = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] api.max_limit                  = 1000 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] api.metadata_cache_expiration  = 15 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] api.neutron_default_tenant_id  = default {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] api.use_forwarded_for          = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] api.use_neutron_default_nets   = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] api.vendordata_dynamic_targets = [] {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] api.vendordata_jsonfile_path   = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] cache.backend                  = dogpile.cache.memcached {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] cache.backend_argument         = **** {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] cache.config_prefix            = cache.oslo {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] cache.dead_timeout             = 60.0 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] cache.debug_cache_backend      = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] cache.enable_retry_client      = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] cache.enable_socket_keepalive  = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] cache.enabled                  = True {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] cache.expiration_time          = 600 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] cache.hashclient_retry_attempts = 2 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] cache.memcache_dead_retry      = 300 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] cache.memcache_password        =  {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] cache.memcache_pool_maxsize    = 10 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] cache.memcache_sasl_enabled    = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] cache.memcache_username        =  {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] cache.proxies                  = [] {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] cache.retry_attempts           = 2 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] cache.retry_delay              = 0.0 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] cache.socket_keepalive_count   = 1 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] cache.socket_keepalive_idle    = 1 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] cache.socket_keepalive_interval = 1 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] cache.tls_allowed_ciphers      = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] cache.tls_cafile               = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] cache.tls_certfile             = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] cache.tls_enabled              = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] cache.tls_keyfile              = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] cinder.auth_section            = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] cinder.auth_type               = password {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] cinder.cafile                  = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] cinder.certfile                = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] cinder.collect_timing          = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] cinder.cross_az_attach         = True {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] cinder.debug                   = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] cinder.endpoint_template       = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] cinder.http_retries            = 3 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] cinder.insecure                = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] cinder.keyfile                 = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] cinder.os_region_name          = RegionOne {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] cinder.split_loggers           = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] cinder.timeout                 = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] compute.cpu_dedicated_set      = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] compute.cpu_shared_set         = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] compute.image_type_exclude_list = [] {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] compute.max_concurrent_disk_ops = 0 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] compute.max_disk_devices_to_attach = -1 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] compute.resource_provider_association_refresh = 300 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] compute.shutdown_retry_interval = 10 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] conductor.workers              = 3 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] console.allowed_origins        = [] {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] console.ssl_ciphers            = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] console.ssl_minimum_version    = default {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] consoleauth.token_ttl          = 600 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] cyborg.cafile                  = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] cyborg.certfile                = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] cyborg.collect_timing          = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] cyborg.connect_retries         = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] cyborg.connect_retry_delay     = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] cyborg.endpoint_override       = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] cyborg.insecure                = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] cyborg.keyfile                 = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] cyborg.max_version             = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] cyborg.min_version             = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] cyborg.region_name             = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] cyborg.service_name            = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] cyborg.service_type            = accelerator {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] cyborg.split_loggers           = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] cyborg.status_code_retries     = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] cyborg.status_code_retry_delay = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] cyborg.timeout                 = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] cyborg.version                 = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] database.backend               = sqlalchemy {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] database.connection            = **** {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] database.connection_debug      = 0 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] database.connection_parameters =  {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] database.connection_recycle_time = 3600 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] database.connection_trace      = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] database.db_inc_retry_interval = True {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] database.db_max_retries        = 20 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] database.db_max_retry_interval = 10 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] database.db_retry_interval     = 1 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] database.max_overflow          = 50 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] database.max_pool_size         = 5 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] database.max_retries           = 10 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] database.mysql_enable_ndb      = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] database.mysql_wsrep_sync_wait = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] database.pool_timeout          = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] database.retry_interval        = 10 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] database.slave_connection      = **** {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] database.sqlite_synchronous    = True {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] api_database.backend           = sqlalchemy {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] api_database.connection        = **** {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] api_database.connection_debug  = 0 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] api_database.connection_parameters =  {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] api_database.connection_recycle_time = 3600 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] api_database.connection_trace  = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] api_database.db_inc_retry_interval = True {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] api_database.db_max_retries    = 20 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] api_database.db_max_retry_interval = 10 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] api_database.db_retry_interval = 1 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] api_database.max_overflow      = 50 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] api_database.max_pool_size     = 5 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] api_database.max_retries       = 10 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] api_database.mysql_enable_ndb  = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] api_database.pool_timeout      = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] api_database.retry_interval    = 10 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] api_database.slave_connection  = **** {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] api_database.sqlite_synchronous = True {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] devices.enabled_mdev_types     = [] {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] ephemeral_storage_encryption.enabled = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] glance.api_servers             = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] glance.cafile                  = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] glance.certfile                = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] glance.collect_timing          = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] glance.connect_retries         = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] glance.connect_retry_delay     = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] glance.debug                   = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] glance.default_trusted_certificate_ids = [] {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] glance.enable_certificate_validation = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] glance.enable_rbd_download     = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] glance.endpoint_override       = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] glance.insecure                = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] glance.keyfile                 = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] glance.max_version             = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] glance.min_version             = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] glance.num_retries             = 3 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] glance.rbd_ceph_conf           =  {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] glance.rbd_connect_timeout     = 5 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] glance.rbd_pool                =  {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] glance.rbd_user                =  {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] glance.region_name             = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] glance.service_name            = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] glance.service_type            = image {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] glance.split_loggers           = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] glance.status_code_retries     = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] glance.status_code_retry_delay = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] glance.timeout                 = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] glance.verify_glance_signatures = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] glance.version                 = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] guestfs.debug                  = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] hyperv.config_drive_cdrom      = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] hyperv.config_drive_inject_password = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] hyperv.enable_instance_metrics_collection = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] hyperv.enable_remotefx         = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] hyperv.instances_path_share    =  {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] hyperv.iscsi_initiator_list    = [] {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] hyperv.limit_cpu_features      = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] hyperv.power_state_check_timeframe = 60 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] hyperv.use_multipath_io        = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] hyperv.volume_attach_retry_count = 10 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] hyperv.vswitch_name            = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] mks.enabled                    = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] image_cache.manager_interval   = 2400 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] image_cache.precache_concurrency = 1 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] image_cache.remove_unused_base_images = True {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] image_cache.subdirectory_name  = _base {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] ironic.api_max_retries         = 60 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] ironic.api_retry_interval      = 2 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] ironic.auth_section            = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] ironic.auth_type               = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] ironic.cafile                  = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] ironic.certfile                = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] ironic.collect_timing          = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] ironic.connect_retries         = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] ironic.connect_retry_delay     = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] ironic.endpoint_override       = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] ironic.insecure                = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] ironic.keyfile                 = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] ironic.max_version             = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] ironic.min_version             = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] ironic.partition_key           = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] ironic.peer_list               = [] {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] ironic.region_name             = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] ironic.serial_console_state_timeout = 10 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] ironic.service_name            = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] ironic.service_type            = baremetal {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] ironic.split_loggers           = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] ironic.status_code_retries     = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] ironic.status_code_retry_delay = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] ironic.timeout                 = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] ironic.version                 = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] key_manager.fixed_key          = **** {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] barbican.barbican_api_version  = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] barbican.barbican_endpoint     = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] barbican.barbican_endpoint_type = public {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] barbican.barbican_region_name  = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] barbican.cafile                = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] barbican.certfile              = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] barbican.collect_timing        = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] barbican.insecure              = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] barbican.keyfile               = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] barbican.number_of_retries     = 60 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] barbican.retry_delay           = 1 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] barbican.send_service_user_token = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] barbican.split_loggers         = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] barbican.timeout               = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] barbican.verify_ssl            = True {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] barbican.verify_ssl_path       = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] barbican_service_user.auth_section = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] barbican_service_user.auth_type = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] barbican_service_user.cafile   = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] barbican_service_user.certfile = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] barbican_service_user.collect_timing = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] barbican_service_user.insecure = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] barbican_service_user.keyfile  = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] barbican_service_user.split_loggers = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] barbican_service_user.timeout  = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] vault.approle_role_id          = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] vault.approle_secret_id        = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] vault.cafile                   = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] vault.certfile                 = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] vault.collect_timing           = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] vault.insecure                 = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] vault.keyfile                  = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] vault.kv_mountpoint            = secret {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] vault.kv_version               = 2 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] vault.namespace                = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] vault.root_token_id            = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] vault.split_loggers            = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] vault.ssl_ca_crt_file          = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] vault.timeout                  = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] vault.use_ssl                  = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] keystone.cafile                = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] keystone.certfile              = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] keystone.collect_timing        = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] keystone.connect_retries       = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] keystone.connect_retry_delay   = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] keystone.endpoint_override     = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] keystone.insecure              = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] keystone.keyfile               = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] keystone.max_version           = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] keystone.min_version           = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] keystone.region_name           = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] keystone.service_name          = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] keystone.service_type          = identity {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] keystone.split_loggers         = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] keystone.status_code_retries   = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] keystone.status_code_retry_delay = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] keystone.timeout               = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] keystone.version               = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] libvirt.connection_uri         =  {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] libvirt.cpu_mode               = custom {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: WARNING oslo_config.cfg [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] libvirt.cpu_power_governor_high = performance {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] libvirt.cpu_power_governor_low = powersave {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] libvirt.cpu_power_management   = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] libvirt.device_detach_attempts = 8 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] libvirt.device_detach_timeout  = 20 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] libvirt.disk_cachemodes        = [] {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] libvirt.disk_prefix            = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] libvirt.enabled_perf_events    = [] {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] libvirt.file_backed_memory     = 0 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] libvirt.gid_maps               = [] {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] libvirt.hw_disk_discard        = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] libvirt.hw_machine_type        = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] libvirt.images_rbd_glance_store_name =  {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] libvirt.images_rbd_pool        = rbd {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] libvirt.images_type            = default {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] libvirt.images_volume_group    = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] libvirt.inject_key             = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] libvirt.inject_partition       = -2 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] libvirt.inject_password        = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] libvirt.iscsi_iface            = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] libvirt.iser_use_multipath     = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] libvirt.live_migration_bandwidth = 0 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] libvirt.live_migration_downtime = 500 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] libvirt.live_migration_inbound_addr = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] libvirt.live_migration_permit_post_copy = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] libvirt.live_migration_scheme  = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] libvirt.live_migration_timeout_action = abort {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] libvirt.live_migration_tunnelled = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: WARNING oslo_config.cfg [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Apr 14 10:38:27 user nova-compute[71509]: live_migration_uri is deprecated for removal in favor of two other options that
Apr 14 10:38:27 user nova-compute[71509]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Apr 14 10:38:27 user nova-compute[71509]: and ``live_migration_inbound_addr`` respectively.
Apr 14 10:38:27 user nova-compute[71509]: ).  Its value may be silently ignored in the future.
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] libvirt.live_migration_with_native_tls = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] libvirt.max_queues             = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] libvirt.nfs_mount_options      = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] libvirt.num_memory_encrypted_guests = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] libvirt.num_pcie_ports         = 0 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] libvirt.pmem_namespaces        = [] {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] libvirt.quobyte_client_cfg     = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] libvirt.rbd_secret_uuid        = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] libvirt.rbd_user               = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] libvirt.remote_filesystem_transport = ssh {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] libvirt.rescue_image_id        = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] libvirt.rescue_kernel_id       = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] libvirt.rescue_ramdisk_id      = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] libvirt.rx_queue_size          = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] libvirt.smbfs_mount_options    =  {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] libvirt.snapshot_compression   = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] libvirt.snapshot_image_format  = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] libvirt.sparse_logical_volumes = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] libvirt.swtpm_enabled          = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] libvirt.swtpm_group            = tss {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] libvirt.swtpm_user             = tss {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] libvirt.sysinfo_serial         = unique {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] libvirt.tx_queue_size          = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] libvirt.uid_maps               = [] {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] libvirt.use_virtio_for_bridges = True {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] libvirt.virt_type              = kvm {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] libvirt.volume_clear           = zero {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] libvirt.volume_clear_size      = 0 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] libvirt.volume_use_multipath   = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] libvirt.vzstorage_cache_path   = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] libvirt.vzstorage_mount_user   = stack {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] neutron.auth_section           = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] neutron.auth_type              = password {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] neutron.cafile                 = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] neutron.certfile               = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] neutron.collect_timing         = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] neutron.connect_retries        = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] neutron.connect_retry_delay    = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] neutron.default_floating_pool  = public {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] neutron.endpoint_override      = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] neutron.extension_sync_interval = 600 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] neutron.http_retries           = 3 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] neutron.insecure               = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] neutron.keyfile                = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] neutron.max_version            = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] neutron.min_version            = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] neutron.ovs_bridge             = br-int {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] neutron.physnets               = [] {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] neutron.region_name            = RegionOne {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] neutron.service_metadata_proxy = True {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] neutron.service_name           = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] neutron.service_type           = network {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] neutron.split_loggers          = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] neutron.status_code_retries    = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] neutron.status_code_retry_delay = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] neutron.timeout                = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] neutron.version                = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] notifications.bdms_in_notifications = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] notifications.default_level    = INFO {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] notifications.notification_format = unversioned {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] notifications.notify_on_state_change = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] pci.alias                      = [] {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] pci.device_spec                = [] {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] pci.report_in_placement        = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] placement.auth_section         = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] placement.auth_type            = password {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] placement.cafile               = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] placement.certfile             = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] placement.collect_timing       = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] placement.connect_retries      = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] placement.connect_retry_delay  = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] placement.default_domain_id    = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] placement.default_domain_name  = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] placement.domain_id            = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] placement.domain_name          = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] placement.endpoint_override    = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] placement.insecure             = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] placement.keyfile              = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] placement.max_version          = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] placement.min_version          = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] placement.password             = **** {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] placement.project_domain_id    = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] placement.project_domain_name  = Default {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] placement.project_id           = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] placement.project_name         = service {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] placement.region_name          = RegionOne {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] placement.service_name         = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] placement.service_type         = placement {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] placement.split_loggers        = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] placement.status_code_retries  = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] placement.status_code_retry_delay = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] placement.system_scope         = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] placement.timeout              = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] placement.trust_id             = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] placement.user_domain_id       = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] placement.user_domain_name     = Default {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] placement.user_id              = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] placement.username             = placement {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] placement.version              = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] quota.cores                    = 20 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] quota.count_usage_from_placement = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] quota.injected_file_content_bytes = 10240 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] quota.injected_file_path_length = 255 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] quota.injected_files           = 5 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] quota.instances                = 10 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] quota.key_pairs                = 100 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] quota.metadata_items           = 128 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] quota.ram                      = 51200 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] quota.recheck_quota            = True {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] quota.server_group_members     = 10 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] quota.server_groups            = 10 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] rdp.enabled                    = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] scheduler.image_metadata_prefilter = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] scheduler.max_attempts         = 3 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] scheduler.max_placement_results = 1000 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] scheduler.query_placement_for_availability_zone = True {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] scheduler.query_placement_for_image_type_support = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] scheduler.workers              = 3 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] filter_scheduler.host_subset_size = 1 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] filter_scheduler.isolated_hosts = [] {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] filter_scheduler.isolated_images = [] {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] filter_scheduler.pci_in_placement = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] filter_scheduler.track_instance_changes = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] metrics.required               = True {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] metrics.weight_multiplier      = 1.0 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] metrics.weight_setting         = [] {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] serial_console.enabled         = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] serial_console.port_range      = 10000:20000 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] serial_console.serialproxy_port = 6083 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] service_user.auth_section      = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] service_user.auth_type         = password {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] service_user.cafile            = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] service_user.certfile          = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] service_user.collect_timing    = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] service_user.insecure          = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] service_user.keyfile           = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] service_user.send_service_user_token = True {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] service_user.split_loggers     = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] service_user.timeout           = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] spice.agent_enabled            = True {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] spice.enabled                  = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] spice.html5proxy_port          = 6082 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] spice.image_compression        = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] spice.jpeg_compression         = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] spice.playback_compression     = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] spice.server_listen            = 127.0.0.1 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] spice.streaming_mode           = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] spice.zlib_compression         = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] upgrade_levels.baseapi         = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] upgrade_levels.cert            = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] upgrade_levels.compute         = auto {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] upgrade_levels.conductor       = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] upgrade_levels.scheduler       = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] vendordata_dynamic_auth.auth_section = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] vendordata_dynamic_auth.auth_type = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] vendordata_dynamic_auth.cafile = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] vendordata_dynamic_auth.certfile = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] vendordata_dynamic_auth.insecure = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] vendordata_dynamic_auth.keyfile = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] vendordata_dynamic_auth.timeout = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] vmware.api_retry_count         = 10 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] vmware.ca_file                 = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] vmware.cache_prefix            = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] vmware.cluster_name            = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] vmware.connection_pool_size    = 10 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] vmware.console_delay_seconds   = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] vmware.datastore_regex         = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] vmware.host_ip                 = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] vmware.host_password           = **** {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] vmware.host_port               = 443 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] vmware.host_username           = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] vmware.insecure                = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] vmware.integration_bridge      = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] vmware.maximum_objects         = 100 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] vmware.pbm_default_policy      = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] vmware.pbm_enabled             = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] vmware.pbm_wsdl_location       = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] vmware.serial_port_proxy_uri   = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] vmware.serial_port_service_uri = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] vmware.task_poll_interval      = 0.5 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] vmware.use_linked_clone        = True {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] vmware.vnc_keymap              = en-us {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] vmware.vnc_port                = 5900 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] vmware.vnc_port_total          = 10000 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] vnc.auth_schemes               = ['none'] {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] vnc.enabled                    = True {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] vnc.novncproxy_port            = 6080 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] vnc.server_listen              = 0.0.0.0 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] vnc.vencrypt_ca_certs          = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] vnc.vencrypt_client_cert       = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] vnc.vencrypt_client_key        = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] workarounds.disable_rootwrap   = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] workarounds.enable_numa_live_migration = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] workarounds.libvirt_disable_apic = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] wsgi.client_socket_timeout     = 900 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] wsgi.default_pool_size         = 1000 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] wsgi.keep_alive                = True {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] wsgi.max_header_line           = 16384 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] wsgi.ssl_ca_file               = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] wsgi.ssl_cert_file             = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] wsgi.ssl_key_file              = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] wsgi.tcp_keepidle              = 600 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] zvm.ca_file                    = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] zvm.cloud_connector_url        = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] zvm.reachable_timeout          = 300 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] oslo_policy.enforce_new_defaults = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] oslo_policy.enforce_scope      = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] oslo_policy.policy_default_rule = default {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] oslo_policy.policy_file        = policy.yaml {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] profiler.connection_string     = messaging:// {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] profiler.enabled               = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] profiler.es_doc_type           = notification {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] profiler.es_scroll_size        = 10000 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] profiler.es_scroll_time        = 2m {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] profiler.filter_error_trace    = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] profiler.hmac_keys             = SECRET_KEY {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] profiler.sentinel_service_name = mymaster {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] profiler.socket_timeout        = 0.1 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] profiler.trace_sqlalchemy      = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] remote_debug.host              = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] remote_debug.port              = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:27 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:28 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:28 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:28 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:28 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:28 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:28 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:28 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:28 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:28 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:28 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:28 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:28 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:28 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:28 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:28 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:28 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:28 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:28 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:28 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:28 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] oslo_messaging_rabbit.ssl      = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:28 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:28 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:28 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:28 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:28 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:28 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:28 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] oslo_messaging_notifications.retry = -1 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:28 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:28 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] oslo_messaging_notifications.transport_url = **** {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:28 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] oslo_limit.auth_section        = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:28 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] oslo_limit.auth_type           = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:28 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] oslo_limit.cafile              = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:28 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] oslo_limit.certfile            = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:28 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] oslo_limit.collect_timing      = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:28 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] oslo_limit.connect_retries     = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:28 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] oslo_limit.connect_retry_delay = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:28 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] oslo_limit.endpoint_id         = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:28 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] oslo_limit.endpoint_override   = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:28 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] oslo_limit.insecure            = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:28 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] oslo_limit.keyfile             = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:28 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] oslo_limit.max_version         = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:28 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] oslo_limit.min_version         = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:28 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] oslo_limit.region_name         = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:28 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] oslo_limit.service_name        = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:28 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] oslo_limit.service_type        = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:28 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] oslo_limit.split_loggers       = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:28 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] oslo_limit.status_code_retries = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:28 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] oslo_limit.status_code_retry_delay = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:28 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] oslo_limit.timeout             = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:28 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] oslo_limit.valid_interfaces    = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:28 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] oslo_limit.version             = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:28 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] oslo_reports.file_event_handler = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:28 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:28 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] oslo_reports.log_dir           = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:28 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:28 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:28 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:28 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:28 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:28 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:28 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:28 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] vif_plug_ovs_privileged.group  = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:28 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:28 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:28 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:28 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] vif_plug_ovs_privileged.user   = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:28 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] os_vif_linux_bridge.flat_interface = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:28 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:28 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:28 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:28 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:28 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:28 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:28 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:28 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] os_vif_ovs.isolate_vif         = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:28 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:28 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:28 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:28 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:28 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] os_vif_ovs.per_port_bridge     = False {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:28 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] os_brick.lock_path             = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:28 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] privsep_osbrick.capabilities   = [21] {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:28 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] privsep_osbrick.group          = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:28 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] privsep_osbrick.helper_command = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:28 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:28 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:28 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] privsep_osbrick.user           = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:28 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:28 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] nova_sys_admin.group           = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:28 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] nova_sys_admin.helper_command  = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:28 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:28 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:28 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] nova_sys_admin.user            = None {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Apr 14 10:38:28 user nova-compute[71509]: DEBUG oslo_service.service [None req-e6e2f896-6536-4403-ae63-0e735d95a2f5 None None] ******************************************************************************** {{(pid=71509) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}}
Apr 14 10:38:28 user nova-compute[71509]: INFO nova.service [-] Starting compute node (version 0.0.0)
Apr 14 10:38:28 user nova-compute[71509]: DEBUG nova.virt.libvirt.host [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Starting native event thread {{(pid=71509) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Apr 14 10:38:28 user nova-compute[71509]: DEBUG nova.virt.libvirt.host [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Starting green dispatch thread {{(pid=71509) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Apr 14 10:38:28 user nova-compute[71509]: DEBUG nova.virt.libvirt.host [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Starting connection event dispatch thread {{(pid=71509) initialize /opt/stack/nova/nova/virt/libvirt/host.py:620}}
Apr 14 10:38:28 user nova-compute[71509]: DEBUG nova.virt.libvirt.host [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Connecting to libvirt: qemu:///system {{(pid=71509) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Apr 14 10:38:28 user nova-compute[71509]: DEBUG nova.virt.libvirt.host [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f0c367ca680> {{(pid=71509) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:509}}
Apr 14 10:38:28 user nova-compute[71509]: DEBUG nova.virt.libvirt.host [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f0c367ca680> {{(pid=71509) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:530}}
Apr 14 10:38:28 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Connection event '1' reason 'None'
Apr 14 10:38:28 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Apr 14 10:38:28 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.mount [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Initialising _HostMountState generation 0 {{(pid=71509) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Apr 14 10:38:35 user nova-compute[71509]: INFO nova.virt.libvirt.host [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Libvirt host capabilities <capabilities>
Apr 14 10:38:35 user nova-compute[71509]:   <host>
Apr 14 10:38:35 user nova-compute[71509]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Apr 14 10:38:35 user nova-compute[71509]:     <cpu>
Apr 14 10:38:35 user nova-compute[71509]:       <arch>x86_64</arch>
Apr 14 10:38:35 user nova-compute[71509]:       <model>IvyBridge-IBRS</model>
Apr 14 10:38:35 user nova-compute[71509]:       <vendor>Intel</vendor>
Apr 14 10:38:35 user nova-compute[71509]:       <microcode version='1070'/>
Apr 14 10:38:35 user nova-compute[71509]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Apr 14 10:38:35 user nova-compute[71509]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature name='ss'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature name='vmx'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature name='pcid'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature name='osxsave'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature name='hypervisor'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature name='arat'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature name='tsc_adjust'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature name='md-clear'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature name='stibp'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature name='arch-capabilities'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature name='ssbd'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature name='invtsc'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature name='rsba'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature name='skip-l1dfl-vmentry'/>
Apr 14 10:38:35 user nova-compute[71509]:       <pages unit='KiB' size='4'/>
Apr 14 10:38:35 user nova-compute[71509]:       <pages unit='KiB' size='2048'/>
Apr 14 10:38:35 user nova-compute[71509]:     </cpu>
Apr 14 10:38:35 user nova-compute[71509]:     <power_management>
Apr 14 10:38:35 user nova-compute[71509]:       <suspend_mem/>
Apr 14 10:38:35 user nova-compute[71509]:       <suspend_disk/>
Apr 14 10:38:35 user nova-compute[71509]:       <suspend_hybrid/>
Apr 14 10:38:35 user nova-compute[71509]:     </power_management>
Apr 14 10:38:35 user nova-compute[71509]:     <iommu support='no'/>
Apr 14 10:38:35 user nova-compute[71509]:     <migration_features>
Apr 14 10:38:35 user nova-compute[71509]:       <live/>
Apr 14 10:38:35 user nova-compute[71509]:       <uri_transports>
Apr 14 10:38:35 user nova-compute[71509]:         <uri_transport>tcp</uri_transport>
Apr 14 10:38:35 user nova-compute[71509]:         <uri_transport>rdma</uri_transport>
Apr 14 10:38:35 user nova-compute[71509]:       </uri_transports>
Apr 14 10:38:35 user nova-compute[71509]:     </migration_features>
Apr 14 10:38:35 user nova-compute[71509]:     <topology>
Apr 14 10:38:35 user nova-compute[71509]:       <cells num='2'>
Apr 14 10:38:35 user nova-compute[71509]:         <cell id='0'>
Apr 14 10:38:35 user nova-compute[71509]:           <memory unit='KiB'>8152920</memory>
Apr 14 10:38:35 user nova-compute[71509]:           <pages unit='KiB' size='4'>2038230</pages>
Apr 14 10:38:35 user nova-compute[71509]:           <pages unit='KiB' size='2048'>0</pages>
Apr 14 10:38:35 user nova-compute[71509]:           <distances>
Apr 14 10:38:35 user nova-compute[71509]:             <sibling id='0' value='10'/>
Apr 14 10:38:35 user nova-compute[71509]:             <sibling id='1' value='20'/>
Apr 14 10:38:35 user nova-compute[71509]:           </distances>
Apr 14 10:38:35 user nova-compute[71509]:           <cpus num='6'>
Apr 14 10:38:35 user nova-compute[71509]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Apr 14 10:38:35 user nova-compute[71509]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Apr 14 10:38:35 user nova-compute[71509]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Apr 14 10:38:35 user nova-compute[71509]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Apr 14 10:38:35 user nova-compute[71509]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Apr 14 10:38:35 user nova-compute[71509]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Apr 14 10:38:35 user nova-compute[71509]:           </cpus>
Apr 14 10:38:35 user nova-compute[71509]:         </cell>
Apr 14 10:38:35 user nova-compute[71509]:         <cell id='1'>
Apr 14 10:38:35 user nova-compute[71509]:           <memory unit='KiB'>8255068</memory>
Apr 14 10:38:35 user nova-compute[71509]:           <pages unit='KiB' size='4'>2063767</pages>
Apr 14 10:38:35 user nova-compute[71509]:           <pages unit='KiB' size='2048'>0</pages>
Apr 14 10:38:35 user nova-compute[71509]:           <distances>
Apr 14 10:38:35 user nova-compute[71509]:             <sibling id='0' value='20'/>
Apr 14 10:38:35 user nova-compute[71509]:             <sibling id='1' value='10'/>
Apr 14 10:38:35 user nova-compute[71509]:           </distances>
Apr 14 10:38:35 user nova-compute[71509]:           <cpus num='6'>
Apr 14 10:38:35 user nova-compute[71509]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Apr 14 10:38:35 user nova-compute[71509]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Apr 14 10:38:35 user nova-compute[71509]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Apr 14 10:38:35 user nova-compute[71509]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Apr 14 10:38:35 user nova-compute[71509]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Apr 14 10:38:35 user nova-compute[71509]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Apr 14 10:38:35 user nova-compute[71509]:           </cpus>
Apr 14 10:38:35 user nova-compute[71509]:         </cell>
Apr 14 10:38:35 user nova-compute[71509]:       </cells>
Apr 14 10:38:35 user nova-compute[71509]:     </topology>
Apr 14 10:38:35 user nova-compute[71509]:     <cache>
Apr 14 10:38:35 user nova-compute[71509]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Apr 14 10:38:35 user nova-compute[71509]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Apr 14 10:38:35 user nova-compute[71509]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Apr 14 10:38:35 user nova-compute[71509]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Apr 14 10:38:35 user nova-compute[71509]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Apr 14 10:38:35 user nova-compute[71509]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Apr 14 10:38:35 user nova-compute[71509]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Apr 14 10:38:35 user nova-compute[71509]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Apr 14 10:38:35 user nova-compute[71509]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Apr 14 10:38:35 user nova-compute[71509]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Apr 14 10:38:35 user nova-compute[71509]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Apr 14 10:38:35 user nova-compute[71509]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Apr 14 10:38:35 user nova-compute[71509]:     </cache>
Apr 14 10:38:35 user nova-compute[71509]:     <secmodel>
Apr 14 10:38:35 user nova-compute[71509]:       <model>apparmor</model>
Apr 14 10:38:35 user nova-compute[71509]:       <doi>0</doi>
Apr 14 10:38:35 user nova-compute[71509]:     </secmodel>
Apr 14 10:38:35 user nova-compute[71509]:     <secmodel>
Apr 14 10:38:35 user nova-compute[71509]:       <model>dac</model>
Apr 14 10:38:35 user nova-compute[71509]:       <doi>0</doi>
Apr 14 10:38:35 user nova-compute[71509]:       <baselabel type='kvm'>+64055:+108</baselabel>
Apr 14 10:38:35 user nova-compute[71509]:       <baselabel type='qemu'>+64055:+108</baselabel>
Apr 14 10:38:35 user nova-compute[71509]:     </secmodel>
Apr 14 10:38:35 user nova-compute[71509]:   </host>
Apr 14 10:38:35 user nova-compute[71509]:   <guest>
Apr 14 10:38:35 user nova-compute[71509]:     <os_type>hvm</os_type>
Apr 14 10:38:35 user nova-compute[71509]:     <arch name='alpha'>
Apr 14 10:38:35 user nova-compute[71509]:       <wordsize>64</wordsize>
Apr 14 10:38:35 user nova-compute[71509]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='4'>clipper</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <domain type='qemu'/>
Apr 14 10:38:35 user nova-compute[71509]:     </arch>
Apr 14 10:38:35 user nova-compute[71509]:     <features>
Apr 14 10:38:35 user nova-compute[71509]:       <cpuselection/>
Apr 14 10:38:35 user nova-compute[71509]:       <deviceboot/>
Apr 14 10:38:35 user nova-compute[71509]:       <disksnapshot default='on' toggle='no'/>
Apr 14 10:38:35 user nova-compute[71509]:     </features>
Apr 14 10:38:35 user nova-compute[71509]:   </guest>
Apr 14 10:38:35 user nova-compute[71509]:   <guest>
Apr 14 10:38:35 user nova-compute[71509]:     <os_type>hvm</os_type>
Apr 14 10:38:35 user nova-compute[71509]:     <arch name='armv6l'>
Apr 14 10:38:35 user nova-compute[71509]:       <wordsize>32</wordsize>
Apr 14 10:38:35 user nova-compute[71509]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>integratorcp</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='2'>ast2600-evb</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>borzoi</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>spitz</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>virt-2.7</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='2'>nuri</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>romulus-bmc</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='512'>virt-3.0</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='512'>virt-5.0</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='2'>npcm750-evb</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>virt-2.10</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='2'>rainier-bmc</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>mps3-an547</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='2'>musca-b1</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>versatileab</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>kzm</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>virt-2.8</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='2'>musca-a</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='512'>virt-3.1</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='512'>virt-5.1</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='2'>smdkc210</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>sx1</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>virt-2.11</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>imx25-pdk</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>virt-2.9</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='4'>orangepi-pc</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>z2</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='512'>virt-5.2</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>tosa</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>mps2-an500</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>virt-2.12</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='2'>mps2-an521</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='4'>sabrelite</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>mps2-an511</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>canon-a1100</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>realview-eb</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>emcraft-sf2</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>realview-pb-a8</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='512'>virt-4.0</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>raspi1ap</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>palmetto-bmc</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>sx1-v1</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>n810</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>g220a-bmc</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>n800</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='2'>tacoma-bmc</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='512'>virt-4.1</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='2'>quanta-gsj</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>versatilepb</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>terrier</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>mainstone</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='512'>virt-4.2</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='2'>mps3-an524</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='2'>kudo-bmc</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='4'>vexpress-a9</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='4'>midway</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>musicpal</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>lm3s811evb</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>lm3s6965evb</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>microbit</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>mps2-an505</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>mps2-an385</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='512'>virt-6.0</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>cubieboard</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>verdex</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>netduino2</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>mps2-an386</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='512'>virt-6.1</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='4'>raspi2b</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='4'>vexpress-a15</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='2'>fuji-bmc</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='512'>virt-6.2</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>cheetah</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>virt-2.6</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>ast2500-evb</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='4'>highbank</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>akita</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>connex</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>netduinoplus2</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>collie</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>raspi0</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <domain type='qemu'/>
Apr 14 10:38:35 user nova-compute[71509]:     </arch>
Apr 14 10:38:35 user nova-compute[71509]:     <features>
Apr 14 10:38:35 user nova-compute[71509]:       <cpuselection/>
Apr 14 10:38:35 user nova-compute[71509]:       <deviceboot/>
Apr 14 10:38:35 user nova-compute[71509]:       <disksnapshot default='on' toggle='no'/>
Apr 14 10:38:35 user nova-compute[71509]:     </features>
Apr 14 10:38:35 user nova-compute[71509]:   </guest>
Apr 14 10:38:35 user nova-compute[71509]:   <guest>
Apr 14 10:38:35 user nova-compute[71509]:     <os_type>hvm</os_type>
Apr 14 10:38:35 user nova-compute[71509]:     <arch name='armv7l'>
Apr 14 10:38:35 user nova-compute[71509]:       <wordsize>32</wordsize>
Apr 14 10:38:35 user nova-compute[71509]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>integratorcp</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='2'>ast2600-evb</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>borzoi</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>spitz</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>virt-2.7</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='2'>nuri</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>romulus-bmc</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='512'>virt-3.0</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='512'>virt-5.0</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='2'>npcm750-evb</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>virt-2.10</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='2'>rainier-bmc</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>mps3-an547</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='2'>musca-b1</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>versatileab</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>kzm</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>virt-2.8</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='2'>musca-a</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='512'>virt-3.1</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='512'>virt-5.1</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='2'>smdkc210</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>sx1</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>virt-2.11</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>imx25-pdk</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>virt-2.9</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='4'>orangepi-pc</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>z2</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='512'>virt-5.2</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>tosa</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>mps2-an500</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>virt-2.12</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='2'>mps2-an521</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='4'>sabrelite</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>mps2-an511</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>canon-a1100</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>realview-eb</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>emcraft-sf2</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>realview-pb-a8</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='512'>virt-4.0</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>raspi1ap</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>palmetto-bmc</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>sx1-v1</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>n810</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>g220a-bmc</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>n800</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='2'>tacoma-bmc</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='512'>virt-4.1</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='2'>quanta-gsj</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>versatilepb</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>terrier</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>mainstone</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='512'>virt-4.2</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='2'>mps3-an524</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='2'>kudo-bmc</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='4'>vexpress-a9</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='4'>midway</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>musicpal</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>lm3s811evb</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>lm3s6965evb</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>microbit</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>mps2-an505</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>mps2-an385</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='512'>virt-6.0</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>cubieboard</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>verdex</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>netduino2</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>mps2-an386</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='512'>virt-6.1</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='4'>raspi2b</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='4'>vexpress-a15</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='2'>fuji-bmc</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='512'>virt-6.2</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>cheetah</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>virt-2.6</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>ast2500-evb</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='4'>highbank</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>akita</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>connex</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>netduinoplus2</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>collie</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>raspi0</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <domain type='qemu'/>
Apr 14 10:38:35 user nova-compute[71509]:     </arch>
Apr 14 10:38:35 user nova-compute[71509]:     <features>
Apr 14 10:38:35 user nova-compute[71509]:       <cpuselection/>
Apr 14 10:38:35 user nova-compute[71509]:       <deviceboot/>
Apr 14 10:38:35 user nova-compute[71509]:       <disksnapshot default='on' toggle='no'/>
Apr 14 10:38:35 user nova-compute[71509]:     </features>
Apr 14 10:38:35 user nova-compute[71509]:   </guest>
Apr 14 10:38:35 user nova-compute[71509]:   <guest>
Apr 14 10:38:35 user nova-compute[71509]:     <os_type>hvm</os_type>
Apr 14 10:38:35 user nova-compute[71509]:     <arch name='aarch64'>
Apr 14 10:38:35 user nova-compute[71509]:       <wordsize>64</wordsize>
Apr 14 10:38:35 user nova-compute[71509]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>integratorcp</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='2'>ast2600-evb</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>borzoi</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>spitz</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>virt-2.7</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='2'>nuri</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>romulus-bmc</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='512'>virt-3.0</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='512'>virt-5.0</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='2'>npcm750-evb</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>virt-2.10</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='2'>rainier-bmc</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>mps3-an547</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>virt-2.8</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='2'>musca-b1</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>versatileab</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>kzm</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='2'>musca-a</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='512'>virt-3.1</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='512'>virt-5.1</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='2'>smdkc210</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>sx1</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>virt-2.11</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>imx25-pdk</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>virt-2.9</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='4'>orangepi-pc</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>z2</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='512'>virt-5.2</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>tosa</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>mps2-an500</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>virt-2.12</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='2'>mps2-an521</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='4'>sabrelite</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>mps2-an511</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>canon-a1100</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>realview-eb</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>emcraft-sf2</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>realview-pb-a8</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='512'>sbsa-ref</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='512'>virt-4.0</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>raspi1ap</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>palmetto-bmc</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>sx1-v1</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>n810</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>g220a-bmc</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>n800</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='2'>tacoma-bmc</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='512'>virt-4.1</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='2'>quanta-gsj</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>versatilepb</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>terrier</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>mainstone</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='512'>virt-4.2</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='2'>mps3-an524</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='2'>kudo-bmc</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='4'>vexpress-a9</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='4'>midway</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>musicpal</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>lm3s811evb</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>lm3s6965evb</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>microbit</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>mps2-an505</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>mps2-an385</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='512'>virt-6.0</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='4'>raspi3ap</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>cubieboard</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>verdex</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>netduino2</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>mps2-an386</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='512'>virt-6.1</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='4'>raspi3b</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='4'>raspi2b</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='4'>vexpress-a15</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='2'>fuji-bmc</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='512'>virt-6.2</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>cheetah</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>virt-2.6</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>ast2500-evb</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='4'>highbank</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>akita</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>connex</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>netduinoplus2</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>collie</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>raspi0</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <domain type='qemu'/>
Apr 14 10:38:35 user nova-compute[71509]:     </arch>
Apr 14 10:38:35 user nova-compute[71509]:     <features>
Apr 14 10:38:35 user nova-compute[71509]:       <acpi default='on' toggle='yes'/>
Apr 14 10:38:35 user nova-compute[71509]:       <cpuselection/>
Apr 14 10:38:35 user nova-compute[71509]:       <deviceboot/>
Apr 14 10:38:35 user nova-compute[71509]:       <disksnapshot default='on' toggle='no'/>
Apr 14 10:38:35 user nova-compute[71509]:     </features>
Apr 14 10:38:35 user nova-compute[71509]:   </guest>
Apr 14 10:38:35 user nova-compute[71509]:   <guest>
Apr 14 10:38:35 user nova-compute[71509]:     <os_type>hvm</os_type>
Apr 14 10:38:35 user nova-compute[71509]:     <arch name='cris'>
Apr 14 10:38:35 user nova-compute[71509]:       <wordsize>32</wordsize>
Apr 14 10:38:35 user nova-compute[71509]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>axis-dev88</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <domain type='qemu'/>
Apr 14 10:38:35 user nova-compute[71509]:     </arch>
Apr 14 10:38:35 user nova-compute[71509]:     <features>
Apr 14 10:38:35 user nova-compute[71509]:       <cpuselection/>
Apr 14 10:38:35 user nova-compute[71509]:       <deviceboot/>
Apr 14 10:38:35 user nova-compute[71509]:       <disksnapshot default='on' toggle='no'/>
Apr 14 10:38:35 user nova-compute[71509]:     </features>
Apr 14 10:38:35 user nova-compute[71509]:   </guest>
Apr 14 10:38:35 user nova-compute[71509]:   <guest>
Apr 14 10:38:35 user nova-compute[71509]:     <os_type>hvm</os_type>
Apr 14 10:38:35 user nova-compute[71509]:     <arch name='i686'>
Apr 14 10:38:35 user nova-compute[71509]:       <wordsize>32</wordsize>
Apr 14 10:38:35 user nova-compute[71509]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='288'>pc-q35-artful</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>x-remote</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>isapc</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='288'>pc-q35-disco</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='288'>pc-q35-impish</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='288'>pc-q35-focal</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='288'>microvm</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <domain type='qemu'/>
Apr 14 10:38:35 user nova-compute[71509]:       <domain type='kvm'/>
Apr 14 10:38:35 user nova-compute[71509]:     </arch>
Apr 14 10:38:35 user nova-compute[71509]:     <features>
Apr 14 10:38:35 user nova-compute[71509]:       <pae/>
Apr 14 10:38:35 user nova-compute[71509]:       <nonpae/>
Apr 14 10:38:35 user nova-compute[71509]:       <acpi default='on' toggle='yes'/>
Apr 14 10:38:35 user nova-compute[71509]:       <apic default='on' toggle='no'/>
Apr 14 10:38:35 user nova-compute[71509]:       <cpuselection/>
Apr 14 10:38:35 user nova-compute[71509]:       <deviceboot/>
Apr 14 10:38:35 user nova-compute[71509]:       <disksnapshot default='on' toggle='no'/>
Apr 14 10:38:35 user nova-compute[71509]:     </features>
Apr 14 10:38:35 user nova-compute[71509]:   </guest>
Apr 14 10:38:35 user nova-compute[71509]:   <guest>
Apr 14 10:38:35 user nova-compute[71509]:     <os_type>hvm</os_type>
Apr 14 10:38:35 user nova-compute[71509]:     <arch name='m68k'>
Apr 14 10:38:35 user nova-compute[71509]:       <wordsize>32</wordsize>
Apr 14 10:38:35 user nova-compute[71509]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>mcf5208evb</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>an5206</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>virt-6.0</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>q800</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>virt-6.2</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>next-cube</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>virt-6.1</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <domain type='qemu'/>
Apr 14 10:38:35 user nova-compute[71509]:     </arch>
Apr 14 10:38:35 user nova-compute[71509]:     <features>
Apr 14 10:38:35 user nova-compute[71509]:       <cpuselection/>
Apr 14 10:38:35 user nova-compute[71509]:       <deviceboot/>
Apr 14 10:38:35 user nova-compute[71509]:       <disksnapshot default='on' toggle='no'/>
Apr 14 10:38:35 user nova-compute[71509]:     </features>
Apr 14 10:38:35 user nova-compute[71509]:   </guest>
Apr 14 10:38:35 user nova-compute[71509]:   <guest>
Apr 14 10:38:35 user nova-compute[71509]:     <os_type>hvm</os_type>
Apr 14 10:38:35 user nova-compute[71509]:     <arch name='microblaze'>
Apr 14 10:38:35 user nova-compute[71509]:       <wordsize>32</wordsize>
Apr 14 10:38:35 user nova-compute[71509]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>petalogix-ml605</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <domain type='qemu'/>
Apr 14 10:38:35 user nova-compute[71509]:     </arch>
Apr 14 10:38:35 user nova-compute[71509]:     <features>
Apr 14 10:38:35 user nova-compute[71509]:       <cpuselection/>
Apr 14 10:38:35 user nova-compute[71509]:       <deviceboot/>
Apr 14 10:38:35 user nova-compute[71509]:       <disksnapshot default='on' toggle='no'/>
Apr 14 10:38:35 user nova-compute[71509]:     </features>
Apr 14 10:38:35 user nova-compute[71509]:   </guest>
Apr 14 10:38:35 user nova-compute[71509]:   <guest>
Apr 14 10:38:35 user nova-compute[71509]:     <os_type>hvm</os_type>
Apr 14 10:38:35 user nova-compute[71509]:     <arch name='microblazeel'>
Apr 14 10:38:35 user nova-compute[71509]:       <wordsize>32</wordsize>
Apr 14 10:38:35 user nova-compute[71509]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>petalogix-ml605</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <domain type='qemu'/>
Apr 14 10:38:35 user nova-compute[71509]:     </arch>
Apr 14 10:38:35 user nova-compute[71509]:     <features>
Apr 14 10:38:35 user nova-compute[71509]:       <cpuselection/>
Apr 14 10:38:35 user nova-compute[71509]:       <deviceboot/>
Apr 14 10:38:35 user nova-compute[71509]:       <disksnapshot default='on' toggle='no'/>
Apr 14 10:38:35 user nova-compute[71509]:     </features>
Apr 14 10:38:35 user nova-compute[71509]:   </guest>
Apr 14 10:38:35 user nova-compute[71509]:   <guest>
Apr 14 10:38:35 user nova-compute[71509]:     <os_type>hvm</os_type>
Apr 14 10:38:35 user nova-compute[71509]:     <arch name='mips'>
Apr 14 10:38:35 user nova-compute[71509]:       <wordsize>32</wordsize>
Apr 14 10:38:35 user nova-compute[71509]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='16'>malta</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>mipssim</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <domain type='qemu'/>
Apr 14 10:38:35 user nova-compute[71509]:     </arch>
Apr 14 10:38:35 user nova-compute[71509]:     <features>
Apr 14 10:38:35 user nova-compute[71509]:       <cpuselection/>
Apr 14 10:38:35 user nova-compute[71509]:       <deviceboot/>
Apr 14 10:38:35 user nova-compute[71509]:       <disksnapshot default='on' toggle='no'/>
Apr 14 10:38:35 user nova-compute[71509]:     </features>
Apr 14 10:38:35 user nova-compute[71509]:   </guest>
Apr 14 10:38:35 user nova-compute[71509]:   <guest>
Apr 14 10:38:35 user nova-compute[71509]:     <os_type>hvm</os_type>
Apr 14 10:38:35 user nova-compute[71509]:     <arch name='mipsel'>
Apr 14 10:38:35 user nova-compute[71509]:       <wordsize>32</wordsize>
Apr 14 10:38:35 user nova-compute[71509]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='16'>malta</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>mipssim</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <domain type='qemu'/>
Apr 14 10:38:35 user nova-compute[71509]:     </arch>
Apr 14 10:38:35 user nova-compute[71509]:     <features>
Apr 14 10:38:35 user nova-compute[71509]:       <cpuselection/>
Apr 14 10:38:35 user nova-compute[71509]:       <deviceboot/>
Apr 14 10:38:35 user nova-compute[71509]:       <disksnapshot default='on' toggle='no'/>
Apr 14 10:38:35 user nova-compute[71509]:     </features>
Apr 14 10:38:35 user nova-compute[71509]:   </guest>
Apr 14 10:38:35 user nova-compute[71509]:   <guest>
Apr 14 10:38:35 user nova-compute[71509]:     <os_type>hvm</os_type>
Apr 14 10:38:35 user nova-compute[71509]:     <arch name='mips64'>
Apr 14 10:38:35 user nova-compute[71509]:       <wordsize>64</wordsize>
Apr 14 10:38:35 user nova-compute[71509]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='16'>malta</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>mipssim</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>pica61</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>magnum</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <domain type='qemu'/>
Apr 14 10:38:35 user nova-compute[71509]:     </arch>
Apr 14 10:38:35 user nova-compute[71509]:     <features>
Apr 14 10:38:35 user nova-compute[71509]:       <cpuselection/>
Apr 14 10:38:35 user nova-compute[71509]:       <deviceboot/>
Apr 14 10:38:35 user nova-compute[71509]:       <disksnapshot default='on' toggle='no'/>
Apr 14 10:38:35 user nova-compute[71509]:     </features>
Apr 14 10:38:35 user nova-compute[71509]:   </guest>
Apr 14 10:38:35 user nova-compute[71509]:   <guest>
Apr 14 10:38:35 user nova-compute[71509]:     <os_type>hvm</os_type>
Apr 14 10:38:35 user nova-compute[71509]:     <arch name='mips64el'>
Apr 14 10:38:35 user nova-compute[71509]:       <wordsize>64</wordsize>
Apr 14 10:38:35 user nova-compute[71509]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='16'>malta</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='16'>loongson3-virt</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>mipssim</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>pica61</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>magnum</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='16'>boston</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>fuloong2e</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <domain type='qemu'/>
Apr 14 10:38:35 user nova-compute[71509]:     </arch>
Apr 14 10:38:35 user nova-compute[71509]:     <features>
Apr 14 10:38:35 user nova-compute[71509]:       <cpuselection/>
Apr 14 10:38:35 user nova-compute[71509]:       <deviceboot/>
Apr 14 10:38:35 user nova-compute[71509]:       <disksnapshot default='on' toggle='no'/>
Apr 14 10:38:35 user nova-compute[71509]:     </features>
Apr 14 10:38:35 user nova-compute[71509]:   </guest>
Apr 14 10:38:35 user nova-compute[71509]:   <guest>
Apr 14 10:38:35 user nova-compute[71509]:     <os_type>hvm</os_type>
Apr 14 10:38:35 user nova-compute[71509]:     <arch name='ppc'>
Apr 14 10:38:35 user nova-compute[71509]:       <wordsize>32</wordsize>
Apr 14 10:38:35 user nova-compute[71509]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>g3beige</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>virtex-ml507</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>mac99</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='32'>ppce500</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>pegasos2</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>sam460ex</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>bamboo</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>40p</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>ref405ep</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='15'>mpc8544ds</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>taihu</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <domain type='qemu'/>
Apr 14 10:38:35 user nova-compute[71509]:     </arch>
Apr 14 10:38:35 user nova-compute[71509]:     <features>
Apr 14 10:38:35 user nova-compute[71509]:       <cpuselection/>
Apr 14 10:38:35 user nova-compute[71509]:       <deviceboot/>
Apr 14 10:38:35 user nova-compute[71509]:       <disksnapshot default='on' toggle='no'/>
Apr 14 10:38:35 user nova-compute[71509]:     </features>
Apr 14 10:38:35 user nova-compute[71509]:   </guest>
Apr 14 10:38:35 user nova-compute[71509]:   <guest>
Apr 14 10:38:35 user nova-compute[71509]:     <os_type>hvm</os_type>
Apr 14 10:38:35 user nova-compute[71509]:     <arch name='ppc64'>
Apr 14 10:38:35 user nova-compute[71509]:       <wordsize>64</wordsize>
Apr 14 10:38:35 user nova-compute[71509]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='2048'>powernv9</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>taihu</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='15'>mpc8544ds</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='2048'>powernv10</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='32'>ppce500</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>40p</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>pegasos2</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>bamboo</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>g3beige</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>virtex-ml507</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>mac99</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>sam460ex</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>ref405ep</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='2048'>powernv8</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <domain type='qemu'/>
Apr 14 10:38:35 user nova-compute[71509]:     </arch>
Apr 14 10:38:35 user nova-compute[71509]:     <features>
Apr 14 10:38:35 user nova-compute[71509]:       <cpuselection/>
Apr 14 10:38:35 user nova-compute[71509]:       <deviceboot/>
Apr 14 10:38:35 user nova-compute[71509]:       <disksnapshot default='on' toggle='no'/>
Apr 14 10:38:35 user nova-compute[71509]:     </features>
Apr 14 10:38:35 user nova-compute[71509]:   </guest>
Apr 14 10:38:35 user nova-compute[71509]:   <guest>
Apr 14 10:38:35 user nova-compute[71509]:     <os_type>hvm</os_type>
Apr 14 10:38:35 user nova-compute[71509]:     <arch name='ppc64le'>
Apr 14 10:38:35 user nova-compute[71509]:       <wordsize>64</wordsize>
Apr 14 10:38:35 user nova-compute[71509]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='2048'>powernv9</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>taihu</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='15'>mpc8544ds</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='2048'>powernv10</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='32'>ppce500</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>40p</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>pegasos2</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>bamboo</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>g3beige</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>virtex-ml507</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>mac99</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>sam460ex</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>ref405ep</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='2048'>powernv8</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <domain type='qemu'/>
Apr 14 10:38:35 user nova-compute[71509]:     </arch>
Apr 14 10:38:35 user nova-compute[71509]:     <features>
Apr 14 10:38:35 user nova-compute[71509]:       <cpuselection/>
Apr 14 10:38:35 user nova-compute[71509]:       <deviceboot/>
Apr 14 10:38:35 user nova-compute[71509]:       <disksnapshot default='on' toggle='no'/>
Apr 14 10:38:35 user nova-compute[71509]:     </features>
Apr 14 10:38:35 user nova-compute[71509]:   </guest>
Apr 14 10:38:35 user nova-compute[71509]:   <guest>
Apr 14 10:38:35 user nova-compute[71509]:     <os_type>hvm</os_type>
Apr 14 10:38:35 user nova-compute[71509]:     <arch name='riscv32'>
Apr 14 10:38:35 user nova-compute[71509]:       <wordsize>32</wordsize>
Apr 14 10:38:35 user nova-compute[71509]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='8'>spike</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>opentitan</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='5'>sifive_u</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>sifive_e</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='8'>virt</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <domain type='qemu'/>
Apr 14 10:38:35 user nova-compute[71509]:     </arch>
Apr 14 10:38:35 user nova-compute[71509]:     <features>
Apr 14 10:38:35 user nova-compute[71509]:       <cpuselection/>
Apr 14 10:38:35 user nova-compute[71509]:       <deviceboot/>
Apr 14 10:38:35 user nova-compute[71509]:       <disksnapshot default='on' toggle='no'/>
Apr 14 10:38:35 user nova-compute[71509]:     </features>
Apr 14 10:38:35 user nova-compute[71509]:   </guest>
Apr 14 10:38:35 user nova-compute[71509]:   <guest>
Apr 14 10:38:35 user nova-compute[71509]:     <os_type>hvm</os_type>
Apr 14 10:38:35 user nova-compute[71509]:     <arch name='riscv64'>
Apr 14 10:38:35 user nova-compute[71509]:       <wordsize>64</wordsize>
Apr 14 10:38:35 user nova-compute[71509]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='8'>spike</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='5'>sifive_u</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>shakti_c</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>sifive_e</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='8'>virt</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <domain type='qemu'/>
Apr 14 10:38:35 user nova-compute[71509]:     </arch>
Apr 14 10:38:35 user nova-compute[71509]:     <features>
Apr 14 10:38:35 user nova-compute[71509]:       <cpuselection/>
Apr 14 10:38:35 user nova-compute[71509]:       <deviceboot/>
Apr 14 10:38:35 user nova-compute[71509]:       <disksnapshot default='on' toggle='no'/>
Apr 14 10:38:35 user nova-compute[71509]:     </features>
Apr 14 10:38:35 user nova-compute[71509]:   </guest>
Apr 14 10:38:35 user nova-compute[71509]:   <guest>
Apr 14 10:38:35 user nova-compute[71509]:     <os_type>hvm</os_type>
Apr 14 10:38:35 user nova-compute[71509]:     <arch name='s390x'>
Apr 14 10:38:35 user nova-compute[71509]:       <wordsize>64</wordsize>
Apr 14 10:38:35 user nova-compute[71509]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <domain type='qemu'/>
Apr 14 10:38:35 user nova-compute[71509]:     </arch>
Apr 14 10:38:35 user nova-compute[71509]:     <features>
Apr 14 10:38:35 user nova-compute[71509]:       <cpuselection/>
Apr 14 10:38:35 user nova-compute[71509]:       <deviceboot/>
Apr 14 10:38:35 user nova-compute[71509]:       <disksnapshot default='on' toggle='no'/>
Apr 14 10:38:35 user nova-compute[71509]:     </features>
Apr 14 10:38:35 user nova-compute[71509]:   </guest>
Apr 14 10:38:35 user nova-compute[71509]:   <guest>
Apr 14 10:38:35 user nova-compute[71509]:     <os_type>hvm</os_type>
Apr 14 10:38:35 user nova-compute[71509]:     <arch name='sh4'>
Apr 14 10:38:35 user nova-compute[71509]:       <wordsize>32</wordsize>
Apr 14 10:38:35 user nova-compute[71509]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>shix</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>r2d</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <domain type='qemu'/>
Apr 14 10:38:35 user nova-compute[71509]:     </arch>
Apr 14 10:38:35 user nova-compute[71509]:     <features>
Apr 14 10:38:35 user nova-compute[71509]:       <cpuselection/>
Apr 14 10:38:35 user nova-compute[71509]:       <deviceboot/>
Apr 14 10:38:35 user nova-compute[71509]:       <disksnapshot default='on' toggle='no'/>
Apr 14 10:38:35 user nova-compute[71509]:     </features>
Apr 14 10:38:35 user nova-compute[71509]:   </guest>
Apr 14 10:38:35 user nova-compute[71509]:   <guest>
Apr 14 10:38:35 user nova-compute[71509]:     <os_type>hvm</os_type>
Apr 14 10:38:35 user nova-compute[71509]:     <arch name='sh4eb'>
Apr 14 10:38:35 user nova-compute[71509]:       <wordsize>64</wordsize>
Apr 14 10:38:35 user nova-compute[71509]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>shix</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>r2d</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <domain type='qemu'/>
Apr 14 10:38:35 user nova-compute[71509]:     </arch>
Apr 14 10:38:35 user nova-compute[71509]:     <features>
Apr 14 10:38:35 user nova-compute[71509]:       <cpuselection/>
Apr 14 10:38:35 user nova-compute[71509]:       <deviceboot/>
Apr 14 10:38:35 user nova-compute[71509]:       <disksnapshot default='on' toggle='no'/>
Apr 14 10:38:35 user nova-compute[71509]:     </features>
Apr 14 10:38:35 user nova-compute[71509]:   </guest>
Apr 14 10:38:35 user nova-compute[71509]:   <guest>
Apr 14 10:38:35 user nova-compute[71509]:     <os_type>hvm</os_type>
Apr 14 10:38:35 user nova-compute[71509]:     <arch name='sparc'>
Apr 14 10:38:35 user nova-compute[71509]:       <wordsize>32</wordsize>
Apr 14 10:38:35 user nova-compute[71509]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>SS-5</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='4'>SS-20</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>LX</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>SPARCClassic</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>leon3_generic</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>SPARCbook</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>SS-4</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='4'>SS-600MP</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='4'>SS-10</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>Voyager</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <domain type='qemu'/>
Apr 14 10:38:35 user nova-compute[71509]:     </arch>
Apr 14 10:38:35 user nova-compute[71509]:     <features>
Apr 14 10:38:35 user nova-compute[71509]:       <cpuselection/>
Apr 14 10:38:35 user nova-compute[71509]:       <deviceboot/>
Apr 14 10:38:35 user nova-compute[71509]:       <disksnapshot default='on' toggle='no'/>
Apr 14 10:38:35 user nova-compute[71509]:     </features>
Apr 14 10:38:35 user nova-compute[71509]:   </guest>
Apr 14 10:38:35 user nova-compute[71509]:   <guest>
Apr 14 10:38:35 user nova-compute[71509]:     <os_type>hvm</os_type>
Apr 14 10:38:35 user nova-compute[71509]:     <arch name='sparc64'>
Apr 14 10:38:35 user nova-compute[71509]:       <wordsize>64</wordsize>
Apr 14 10:38:35 user nova-compute[71509]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>sun4u</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>niagara</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>sun4v</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <domain type='qemu'/>
Apr 14 10:38:35 user nova-compute[71509]:     </arch>
Apr 14 10:38:35 user nova-compute[71509]:     <features>
Apr 14 10:38:35 user nova-compute[71509]:       <cpuselection/>
Apr 14 10:38:35 user nova-compute[71509]:       <deviceboot/>
Apr 14 10:38:35 user nova-compute[71509]:       <disksnapshot default='on' toggle='no'/>
Apr 14 10:38:35 user nova-compute[71509]:     </features>
Apr 14 10:38:35 user nova-compute[71509]:   </guest>
Apr 14 10:38:35 user nova-compute[71509]:   <guest>
Apr 14 10:38:35 user nova-compute[71509]:     <os_type>hvm</os_type>
Apr 14 10:38:35 user nova-compute[71509]:     <arch name='x86_64'>
Apr 14 10:38:35 user nova-compute[71509]:       <wordsize>64</wordsize>
Apr 14 10:38:35 user nova-compute[71509]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='288'>pc-q35-artful</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>x-remote</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='1'>isapc</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='288'>pc-q35-disco</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='288'>pc-q35-impish</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='288'>pc-q35-focal</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='288'>microvm</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <domain type='qemu'/>
Apr 14 10:38:35 user nova-compute[71509]:       <domain type='kvm'/>
Apr 14 10:38:35 user nova-compute[71509]:     </arch>
Apr 14 10:38:35 user nova-compute[71509]:     <features>
Apr 14 10:38:35 user nova-compute[71509]:       <acpi default='on' toggle='yes'/>
Apr 14 10:38:35 user nova-compute[71509]:       <apic default='on' toggle='no'/>
Apr 14 10:38:35 user nova-compute[71509]:       <cpuselection/>
Apr 14 10:38:35 user nova-compute[71509]:       <deviceboot/>
Apr 14 10:38:35 user nova-compute[71509]:       <disksnapshot default='on' toggle='no'/>
Apr 14 10:38:35 user nova-compute[71509]:     </features>
Apr 14 10:38:35 user nova-compute[71509]:   </guest>
Apr 14 10:38:35 user nova-compute[71509]:   <guest>
Apr 14 10:38:35 user nova-compute[71509]:     <os_type>hvm</os_type>
Apr 14 10:38:35 user nova-compute[71509]:     <arch name='xtensa'>
Apr 14 10:38:35 user nova-compute[71509]:       <wordsize>32</wordsize>
Apr 14 10:38:35 user nova-compute[71509]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='4'>sim</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='32'>kc705</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='32'>ml605</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='32'>ml605-nommu</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='32'>virt</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='32'>lx60-nommu</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='32'>lx200</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='32'>lx200-nommu</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='32'>lx60</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='32'>kc705-nommu</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <domain type='qemu'/>
Apr 14 10:38:35 user nova-compute[71509]:     </arch>
Apr 14 10:38:35 user nova-compute[71509]:     <features>
Apr 14 10:38:35 user nova-compute[71509]:       <cpuselection/>
Apr 14 10:38:35 user nova-compute[71509]:       <deviceboot/>
Apr 14 10:38:35 user nova-compute[71509]:       <disksnapshot default='on' toggle='no'/>
Apr 14 10:38:35 user nova-compute[71509]:     </features>
Apr 14 10:38:35 user nova-compute[71509]:   </guest>
Apr 14 10:38:35 user nova-compute[71509]:   <guest>
Apr 14 10:38:35 user nova-compute[71509]:     <os_type>hvm</os_type>
Apr 14 10:38:35 user nova-compute[71509]:     <arch name='xtensaeb'>
Apr 14 10:38:35 user nova-compute[71509]:       <wordsize>32</wordsize>
Apr 14 10:38:35 user nova-compute[71509]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='4'>sim</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='32'>kc705</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='32'>ml605</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='32'>ml605-nommu</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='32'>virt</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='32'>lx60-nommu</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='32'>lx200</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='32'>lx200-nommu</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='32'>lx60</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <machine maxCpus='32'>kc705-nommu</machine>
Apr 14 10:38:35 user nova-compute[71509]:       <domain type='qemu'/>
Apr 14 10:38:35 user nova-compute[71509]:     </arch>
Apr 14 10:38:35 user nova-compute[71509]:     <features>
Apr 14 10:38:35 user nova-compute[71509]:       <cpuselection/>
Apr 14 10:38:35 user nova-compute[71509]:       <deviceboot/>
Apr 14 10:38:35 user nova-compute[71509]:       <disksnapshot default='on' toggle='no'/>
Apr 14 10:38:35 user nova-compute[71509]:     </features>
Apr 14 10:38:35 user nova-compute[71509]:   </guest>
Apr 14 10:38:35 user nova-compute[71509]: </capabilities>
Apr 14 10:38:35 user nova-compute[71509]: 
Apr 14 10:38:35 user nova-compute[71509]: DEBUG nova.virt.libvirt.host [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=71509) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 10:38:35 user nova-compute[71509]: DEBUG nova.virt.libvirt.host [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=71509) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 10:38:35 user nova-compute[71509]: DEBUG nova.virt.libvirt.host [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=71509) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 10:38:35 user nova-compute[71509]: DEBUG nova.virt.libvirt.host [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=71509) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 10:38:35 user nova-compute[71509]: DEBUG nova.virt.libvirt.host [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=71509) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 10:38:35 user nova-compute[71509]: DEBUG nova.virt.libvirt.host [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=71509) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 10:38:35 user nova-compute[71509]: DEBUG nova.virt.libvirt.host [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=71509) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 10:38:35 user nova-compute[71509]: DEBUG nova.virt.libvirt.host [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=71509) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 10:38:35 user nova-compute[71509]: DEBUG nova.virt.libvirt.host [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=71509) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 10:38:35 user nova-compute[71509]: DEBUG nova.virt.libvirt.host [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Getting domain capabilities for cris via machine types: {None} {{(pid=71509) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 10:38:35 user nova-compute[71509]: DEBUG nova.virt.libvirt.host [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=71509) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 10:38:35 user nova-compute[71509]: DEBUG nova.virt.libvirt.host [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Getting domain capabilities for i686 via machine types: {'ubuntu', 'pc', 'q35', 'ubuntu-q35'} {{(pid=71509) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 10:38:35 user nova-compute[71509]: DEBUG nova.virt.libvirt.host [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Apr 14 10:38:35 user nova-compute[71509]: <domainCapabilities>
Apr 14 10:38:35 user nova-compute[71509]:   <path>/usr/bin/qemu-system-i386</path>
Apr 14 10:38:35 user nova-compute[71509]:   <domain>kvm</domain>
Apr 14 10:38:35 user nova-compute[71509]:   <machine>pc-i440fx-jammy</machine>
Apr 14 10:38:35 user nova-compute[71509]:   <arch>i686</arch>
Apr 14 10:38:35 user nova-compute[71509]:   <vcpu max='255'/>
Apr 14 10:38:35 user nova-compute[71509]:   <iothreads supported='yes'/>
Apr 14 10:38:35 user nova-compute[71509]:   <os supported='yes'>
Apr 14 10:38:35 user nova-compute[71509]:     <enum name='firmware'/>
Apr 14 10:38:35 user nova-compute[71509]:     <loader supported='yes'>
Apr 14 10:38:35 user nova-compute[71509]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Apr 14 10:38:35 user nova-compute[71509]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Apr 14 10:38:35 user nova-compute[71509]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Apr 14 10:38:35 user nova-compute[71509]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Apr 14 10:38:35 user nova-compute[71509]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='type'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>rom</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>pflash</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='readonly'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>yes</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>no</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='secure'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>no</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:     </loader>
Apr 14 10:38:35 user nova-compute[71509]:   </os>
Apr 14 10:38:35 user nova-compute[71509]:   <cpu>
Apr 14 10:38:35 user nova-compute[71509]:     <mode name='host-passthrough' supported='yes'>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='hostPassthroughMigratable'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>off</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:     </mode>
Apr 14 10:38:35 user nova-compute[71509]:     <mode name='maximum' supported='yes'>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='maximumMigratable'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>on</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>off</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:     </mode>
Apr 14 10:38:35 user nova-compute[71509]:     <mode name='host-model' supported='yes'>
Apr 14 10:38:35 user nova-compute[71509]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 14 10:38:35 user nova-compute[71509]:       <vendor>Intel</vendor>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='require' name='ss'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='require' name='vmx'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='require' name='pcid'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='require' name='hypervisor'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='require' name='arat'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='require' name='tsc_adjust'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='require' name='umip'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='require' name='md-clear'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='require' name='stibp'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='require' name='arch-capabilities'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='require' name='ssbd'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='require' name='ibpb'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='require' name='ibrs'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='require' name='amd-stibp'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='require' name='amd-ssbd'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='disable' name='erms'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='disable' name='xsaveopt'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='disable' name='lm'/>
Apr 14 10:38:35 user nova-compute[71509]:     </mode>
Apr 14 10:38:35 user nova-compute[71509]:     <mode name='custom' supported='yes'>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>qemu64</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='yes'>qemu32</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>phenom</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='yes'>pentium3</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='yes'>pentium2</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='yes'>pentium</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>n270</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>kvm64</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='yes'>kvm32</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='yes'>coreduo</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>core2duo</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>athlon</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Westmere-IBRS</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Westmere</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Snowridge</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Skylake-Server</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Skylake-Client</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>SandyBridge</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Penryn</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Opteron_G5</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Opteron_G4</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Opteron_G3</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Opteron_G2</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Opteron_G1</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Nehalem-IBRS</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Nehalem</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>IvyBridge</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Icelake-Server</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Haswell-noTSX</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Haswell-IBRS</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Haswell</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>EPYC-Rome</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>EPYC-Milan</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>EPYC-IBPB</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>EPYC</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Dhyana</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Cooperlake</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Conroe</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Cascadelake-Server</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Broadwell-noTSX</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Broadwell-IBRS</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Broadwell</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='yes'>486</model>
Apr 14 10:38:35 user nova-compute[71509]:     </mode>
Apr 14 10:38:35 user nova-compute[71509]:   </cpu>
Apr 14 10:38:35 user nova-compute[71509]:   <memoryBacking supported='yes'>
Apr 14 10:38:35 user nova-compute[71509]:     <enum name='sourceType'>
Apr 14 10:38:35 user nova-compute[71509]:       <value>file</value>
Apr 14 10:38:35 user nova-compute[71509]:       <value>anonymous</value>
Apr 14 10:38:35 user nova-compute[71509]:       <value>memfd</value>
Apr 14 10:38:35 user nova-compute[71509]:     </enum>
Apr 14 10:38:35 user nova-compute[71509]:   </memoryBacking>
Apr 14 10:38:35 user nova-compute[71509]:   <devices>
Apr 14 10:38:35 user nova-compute[71509]:     <disk supported='yes'>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='diskDevice'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>disk</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>cdrom</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>floppy</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>lun</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='bus'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>ide</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>fdc</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>scsi</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>virtio</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>usb</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>sata</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='model'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>virtio</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>virtio-transitional</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>virtio-non-transitional</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:     </disk>
Apr 14 10:38:35 user nova-compute[71509]:     <graphics supported='yes'>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='type'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>sdl</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>vnc</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>spice</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>egl-headless</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:     </graphics>
Apr 14 10:38:35 user nova-compute[71509]:     <video supported='yes'>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='modelType'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>vga</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>cirrus</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>vmvga</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>qxl</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>virtio</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>none</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>bochs</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>ramfb</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:     </video>
Apr 14 10:38:35 user nova-compute[71509]:     <hostdev supported='yes'>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='mode'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>subsystem</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='startupPolicy'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>default</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>mandatory</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>requisite</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>optional</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='subsysType'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>usb</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>pci</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>scsi</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='capsType'/>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='pciBackend'/>
Apr 14 10:38:35 user nova-compute[71509]:     </hostdev>
Apr 14 10:38:35 user nova-compute[71509]:     <rng supported='yes'>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='model'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>virtio</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>virtio-transitional</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>virtio-non-transitional</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='backendModel'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>random</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>egd</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>builtin</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:     </rng>
Apr 14 10:38:35 user nova-compute[71509]:     <filesystem supported='yes'>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='driverType'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>path</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>handle</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>virtiofs</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:     </filesystem>
Apr 14 10:38:35 user nova-compute[71509]:     <tpm supported='yes'>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='model'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>tpm-tis</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>tpm-crb</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='backendModel'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>passthrough</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>emulator</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:     </tpm>
Apr 14 10:38:35 user nova-compute[71509]:   </devices>
Apr 14 10:38:35 user nova-compute[71509]:   <features>
Apr 14 10:38:35 user nova-compute[71509]:     <gic supported='no'/>
Apr 14 10:38:35 user nova-compute[71509]:     <vmcoreinfo supported='yes'/>
Apr 14 10:38:35 user nova-compute[71509]:     <genid supported='yes'/>
Apr 14 10:38:35 user nova-compute[71509]:     <backingStoreInput supported='yes'/>
Apr 14 10:38:35 user nova-compute[71509]:     <backup supported='yes'/>
Apr 14 10:38:35 user nova-compute[71509]:     <sev supported='no'/>
Apr 14 10:38:35 user nova-compute[71509]:   </features>
Apr 14 10:38:35 user nova-compute[71509]: </domainCapabilities>
Apr 14 10:38:35 user nova-compute[71509]:  {{(pid=71509) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 14 10:38:35 user nova-compute[71509]: DEBUG nova.virt.libvirt.host [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Apr 14 10:38:35 user nova-compute[71509]: <domainCapabilities>
Apr 14 10:38:35 user nova-compute[71509]:   <path>/usr/bin/qemu-system-i386</path>
Apr 14 10:38:35 user nova-compute[71509]:   <domain>kvm</domain>
Apr 14 10:38:35 user nova-compute[71509]:   <machine>pc-i440fx-6.2</machine>
Apr 14 10:38:35 user nova-compute[71509]:   <arch>i686</arch>
Apr 14 10:38:35 user nova-compute[71509]:   <vcpu max='255'/>
Apr 14 10:38:35 user nova-compute[71509]:   <iothreads supported='yes'/>
Apr 14 10:38:35 user nova-compute[71509]:   <os supported='yes'>
Apr 14 10:38:35 user nova-compute[71509]:     <enum name='firmware'/>
Apr 14 10:38:35 user nova-compute[71509]:     <loader supported='yes'>
Apr 14 10:38:35 user nova-compute[71509]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Apr 14 10:38:35 user nova-compute[71509]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Apr 14 10:38:35 user nova-compute[71509]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Apr 14 10:38:35 user nova-compute[71509]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Apr 14 10:38:35 user nova-compute[71509]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='type'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>rom</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>pflash</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='readonly'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>yes</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>no</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='secure'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>no</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:     </loader>
Apr 14 10:38:35 user nova-compute[71509]:   </os>
Apr 14 10:38:35 user nova-compute[71509]:   <cpu>
Apr 14 10:38:35 user nova-compute[71509]:     <mode name='host-passthrough' supported='yes'>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='hostPassthroughMigratable'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>off</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:     </mode>
Apr 14 10:38:35 user nova-compute[71509]:     <mode name='maximum' supported='yes'>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='maximumMigratable'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>on</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>off</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:     </mode>
Apr 14 10:38:35 user nova-compute[71509]:     <mode name='host-model' supported='yes'>
Apr 14 10:38:35 user nova-compute[71509]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 14 10:38:35 user nova-compute[71509]:       <vendor>Intel</vendor>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='require' name='ss'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='require' name='vmx'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='require' name='pcid'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='require' name='hypervisor'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='require' name='arat'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='require' name='tsc_adjust'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='require' name='umip'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='require' name='md-clear'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='require' name='stibp'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='require' name='arch-capabilities'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='require' name='ssbd'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='require' name='ibpb'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='require' name='ibrs'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='require' name='amd-stibp'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='require' name='amd-ssbd'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='disable' name='erms'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='disable' name='xsaveopt'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='disable' name='lm'/>
Apr 14 10:38:35 user nova-compute[71509]:     </mode>
Apr 14 10:38:35 user nova-compute[71509]:     <mode name='custom' supported='yes'>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>qemu64</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='yes'>qemu32</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>phenom</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='yes'>pentium3</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='yes'>pentium2</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='yes'>pentium</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>n270</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>kvm64</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='yes'>kvm32</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='yes'>coreduo</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>core2duo</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>athlon</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Westmere-IBRS</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Westmere</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Snowridge</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Skylake-Server</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Skylake-Client</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>SandyBridge</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Penryn</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Opteron_G5</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Opteron_G4</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Opteron_G3</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Opteron_G2</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Opteron_G1</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Nehalem-IBRS</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Nehalem</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>IvyBridge</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Icelake-Server</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Haswell-noTSX</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Haswell-IBRS</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Haswell</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>EPYC-Rome</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>EPYC-Milan</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>EPYC-IBPB</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>EPYC</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Dhyana</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Cooperlake</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Conroe</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Cascadelake-Server</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Broadwell-noTSX</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Broadwell-IBRS</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Broadwell</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='yes'>486</model>
Apr 14 10:38:35 user nova-compute[71509]:     </mode>
Apr 14 10:38:35 user nova-compute[71509]:   </cpu>
Apr 14 10:38:35 user nova-compute[71509]:   <memoryBacking supported='yes'>
Apr 14 10:38:35 user nova-compute[71509]:     <enum name='sourceType'>
Apr 14 10:38:35 user nova-compute[71509]:       <value>file</value>
Apr 14 10:38:35 user nova-compute[71509]:       <value>anonymous</value>
Apr 14 10:38:35 user nova-compute[71509]:       <value>memfd</value>
Apr 14 10:38:35 user nova-compute[71509]:     </enum>
Apr 14 10:38:35 user nova-compute[71509]:   </memoryBacking>
Apr 14 10:38:35 user nova-compute[71509]:   <devices>
Apr 14 10:38:35 user nova-compute[71509]:     <disk supported='yes'>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='diskDevice'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>disk</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>cdrom</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>floppy</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>lun</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='bus'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>ide</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>fdc</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>scsi</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>virtio</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>usb</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>sata</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='model'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>virtio</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>virtio-transitional</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>virtio-non-transitional</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:     </disk>
Apr 14 10:38:35 user nova-compute[71509]:     <graphics supported='yes'>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='type'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>sdl</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>vnc</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>spice</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>egl-headless</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:     </graphics>
Apr 14 10:38:35 user nova-compute[71509]:     <video supported='yes'>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='modelType'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>vga</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>cirrus</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>vmvga</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>qxl</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>virtio</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>none</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>bochs</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>ramfb</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:     </video>
Apr 14 10:38:35 user nova-compute[71509]:     <hostdev supported='yes'>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='mode'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>subsystem</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='startupPolicy'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>default</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>mandatory</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>requisite</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>optional</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='subsysType'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>usb</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>pci</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>scsi</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='capsType'/>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='pciBackend'/>
Apr 14 10:38:35 user nova-compute[71509]:     </hostdev>
Apr 14 10:38:35 user nova-compute[71509]:     <rng supported='yes'>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='model'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>virtio</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>virtio-transitional</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>virtio-non-transitional</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='backendModel'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>random</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>egd</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>builtin</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:     </rng>
Apr 14 10:38:35 user nova-compute[71509]:     <filesystem supported='yes'>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='driverType'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>path</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>handle</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>virtiofs</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:     </filesystem>
Apr 14 10:38:35 user nova-compute[71509]:     <tpm supported='yes'>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='model'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>tpm-tis</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>tpm-crb</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='backendModel'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>passthrough</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>emulator</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:     </tpm>
Apr 14 10:38:35 user nova-compute[71509]:   </devices>
Apr 14 10:38:35 user nova-compute[71509]:   <features>
Apr 14 10:38:35 user nova-compute[71509]:     <gic supported='no'/>
Apr 14 10:38:35 user nova-compute[71509]:     <vmcoreinfo supported='yes'/>
Apr 14 10:38:35 user nova-compute[71509]:     <genid supported='yes'/>
Apr 14 10:38:35 user nova-compute[71509]:     <backingStoreInput supported='yes'/>
Apr 14 10:38:35 user nova-compute[71509]:     <backup supported='yes'/>
Apr 14 10:38:35 user nova-compute[71509]:     <sev supported='no'/>
Apr 14 10:38:35 user nova-compute[71509]:   </features>
Apr 14 10:38:35 user nova-compute[71509]: </domainCapabilities>
Apr 14 10:38:35 user nova-compute[71509]:  {{(pid=71509) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 14 10:38:35 user nova-compute[71509]: DEBUG nova.virt.libvirt.host [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Apr 14 10:38:35 user nova-compute[71509]: <domainCapabilities>
Apr 14 10:38:35 user nova-compute[71509]:   <path>/usr/bin/qemu-system-i386</path>
Apr 14 10:38:35 user nova-compute[71509]:   <domain>kvm</domain>
Apr 14 10:38:35 user nova-compute[71509]:   <machine>pc-q35-6.2</machine>
Apr 14 10:38:35 user nova-compute[71509]:   <arch>i686</arch>
Apr 14 10:38:35 user nova-compute[71509]:   <vcpu max='288'/>
Apr 14 10:38:35 user nova-compute[71509]:   <iothreads supported='yes'/>
Apr 14 10:38:35 user nova-compute[71509]:   <os supported='yes'>
Apr 14 10:38:35 user nova-compute[71509]:     <enum name='firmware'/>
Apr 14 10:38:35 user nova-compute[71509]:     <loader supported='yes'>
Apr 14 10:38:35 user nova-compute[71509]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Apr 14 10:38:35 user nova-compute[71509]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Apr 14 10:38:35 user nova-compute[71509]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Apr 14 10:38:35 user nova-compute[71509]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Apr 14 10:38:35 user nova-compute[71509]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='type'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>rom</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>pflash</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='readonly'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>yes</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>no</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='secure'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>no</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:     </loader>
Apr 14 10:38:35 user nova-compute[71509]:   </os>
Apr 14 10:38:35 user nova-compute[71509]:   <cpu>
Apr 14 10:38:35 user nova-compute[71509]:     <mode name='host-passthrough' supported='yes'>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='hostPassthroughMigratable'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>off</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:     </mode>
Apr 14 10:38:35 user nova-compute[71509]:     <mode name='maximum' supported='yes'>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='maximumMigratable'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>on</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>off</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:     </mode>
Apr 14 10:38:35 user nova-compute[71509]:     <mode name='host-model' supported='yes'>
Apr 14 10:38:35 user nova-compute[71509]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 14 10:38:35 user nova-compute[71509]:       <vendor>Intel</vendor>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='require' name='ss'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='require' name='vmx'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='require' name='pcid'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='require' name='hypervisor'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='require' name='arat'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='require' name='tsc_adjust'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='require' name='umip'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='require' name='md-clear'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='require' name='stibp'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='require' name='arch-capabilities'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='require' name='ssbd'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='require' name='ibpb'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='require' name='ibrs'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='require' name='amd-stibp'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='require' name='amd-ssbd'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='disable' name='erms'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='disable' name='xsaveopt'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='disable' name='lm'/>
Apr 14 10:38:35 user nova-compute[71509]:     </mode>
Apr 14 10:38:35 user nova-compute[71509]:     <mode name='custom' supported='yes'>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>qemu64</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='yes'>qemu32</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>phenom</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='yes'>pentium3</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='yes'>pentium2</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='yes'>pentium</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>n270</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>kvm64</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='yes'>kvm32</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='yes'>coreduo</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>core2duo</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>athlon</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Westmere-IBRS</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Westmere</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Snowridge</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Skylake-Server</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Skylake-Client</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>SandyBridge</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Penryn</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Opteron_G5</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Opteron_G4</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Opteron_G3</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Opteron_G2</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Opteron_G1</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Nehalem-IBRS</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Nehalem</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>IvyBridge</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Icelake-Server</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Haswell-noTSX</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Haswell-IBRS</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Haswell</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>EPYC-Rome</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>EPYC-Milan</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>EPYC-IBPB</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>EPYC</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Dhyana</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Cooperlake</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Conroe</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Cascadelake-Server</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Broadwell-noTSX</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Broadwell-IBRS</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Broadwell</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='yes'>486</model>
Apr 14 10:38:35 user nova-compute[71509]:     </mode>
Apr 14 10:38:35 user nova-compute[71509]:   </cpu>
Apr 14 10:38:35 user nova-compute[71509]:   <memoryBacking supported='yes'>
Apr 14 10:38:35 user nova-compute[71509]:     <enum name='sourceType'>
Apr 14 10:38:35 user nova-compute[71509]:       <value>file</value>
Apr 14 10:38:35 user nova-compute[71509]:       <value>anonymous</value>
Apr 14 10:38:35 user nova-compute[71509]:       <value>memfd</value>
Apr 14 10:38:35 user nova-compute[71509]:     </enum>
Apr 14 10:38:35 user nova-compute[71509]:   </memoryBacking>
Apr 14 10:38:35 user nova-compute[71509]:   <devices>
Apr 14 10:38:35 user nova-compute[71509]:     <disk supported='yes'>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='diskDevice'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>disk</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>cdrom</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>floppy</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>lun</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='bus'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>fdc</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>scsi</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>virtio</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>usb</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>sata</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='model'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>virtio</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>virtio-transitional</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>virtio-non-transitional</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:     </disk>
Apr 14 10:38:35 user nova-compute[71509]:     <graphics supported='yes'>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='type'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>sdl</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>vnc</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>spice</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>egl-headless</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:     </graphics>
Apr 14 10:38:35 user nova-compute[71509]:     <video supported='yes'>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='modelType'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>vga</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>cirrus</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>vmvga</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>qxl</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>virtio</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>none</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>bochs</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>ramfb</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:     </video>
Apr 14 10:38:35 user nova-compute[71509]:     <hostdev supported='yes'>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='mode'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>subsystem</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='startupPolicy'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>default</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>mandatory</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>requisite</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>optional</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='subsysType'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>usb</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>pci</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>scsi</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='capsType'/>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='pciBackend'/>
Apr 14 10:38:35 user nova-compute[71509]:     </hostdev>
Apr 14 10:38:35 user nova-compute[71509]:     <rng supported='yes'>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='model'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>virtio</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>virtio-transitional</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>virtio-non-transitional</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='backendModel'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>random</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>egd</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>builtin</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:     </rng>
Apr 14 10:38:35 user nova-compute[71509]:     <filesystem supported='yes'>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='driverType'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>path</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>handle</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>virtiofs</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:     </filesystem>
Apr 14 10:38:35 user nova-compute[71509]:     <tpm supported='yes'>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='model'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>tpm-tis</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>tpm-crb</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='backendModel'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>passthrough</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>emulator</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:     </tpm>
Apr 14 10:38:35 user nova-compute[71509]:   </devices>
Apr 14 10:38:35 user nova-compute[71509]:   <features>
Apr 14 10:38:35 user nova-compute[71509]:     <gic supported='no'/>
Apr 14 10:38:35 user nova-compute[71509]:     <vmcoreinfo supported='yes'/>
Apr 14 10:38:35 user nova-compute[71509]:     <genid supported='yes'/>
Apr 14 10:38:35 user nova-compute[71509]:     <backingStoreInput supported='yes'/>
Apr 14 10:38:35 user nova-compute[71509]:     <backup supported='yes'/>
Apr 14 10:38:35 user nova-compute[71509]:     <sev supported='no'/>
Apr 14 10:38:35 user nova-compute[71509]:   </features>
Apr 14 10:38:35 user nova-compute[71509]: </domainCapabilities>
Apr 14 10:38:35 user nova-compute[71509]:  {{(pid=71509) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 14 10:38:35 user nova-compute[71509]: DEBUG nova.virt.libvirt.host [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Apr 14 10:38:35 user nova-compute[71509]: <domainCapabilities>
Apr 14 10:38:35 user nova-compute[71509]:   <path>/usr/bin/qemu-system-i386</path>
Apr 14 10:38:35 user nova-compute[71509]:   <domain>kvm</domain>
Apr 14 10:38:35 user nova-compute[71509]:   <machine>pc-q35-jammy</machine>
Apr 14 10:38:35 user nova-compute[71509]:   <arch>i686</arch>
Apr 14 10:38:35 user nova-compute[71509]:   <vcpu max='288'/>
Apr 14 10:38:35 user nova-compute[71509]:   <iothreads supported='yes'/>
Apr 14 10:38:35 user nova-compute[71509]:   <os supported='yes'>
Apr 14 10:38:35 user nova-compute[71509]:     <enum name='firmware'/>
Apr 14 10:38:35 user nova-compute[71509]:     <loader supported='yes'>
Apr 14 10:38:35 user nova-compute[71509]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Apr 14 10:38:35 user nova-compute[71509]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Apr 14 10:38:35 user nova-compute[71509]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Apr 14 10:38:35 user nova-compute[71509]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Apr 14 10:38:35 user nova-compute[71509]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='type'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>rom</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>pflash</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='readonly'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>yes</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>no</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='secure'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>no</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:     </loader>
Apr 14 10:38:35 user nova-compute[71509]:   </os>
Apr 14 10:38:35 user nova-compute[71509]:   <cpu>
Apr 14 10:38:35 user nova-compute[71509]:     <mode name='host-passthrough' supported='yes'>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='hostPassthroughMigratable'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>off</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:     </mode>
Apr 14 10:38:35 user nova-compute[71509]:     <mode name='maximum' supported='yes'>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='maximumMigratable'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>on</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>off</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:     </mode>
Apr 14 10:38:35 user nova-compute[71509]:     <mode name='host-model' supported='yes'>
Apr 14 10:38:35 user nova-compute[71509]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 14 10:38:35 user nova-compute[71509]:       <vendor>Intel</vendor>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='require' name='ss'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='require' name='vmx'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='require' name='pcid'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='require' name='hypervisor'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='require' name='arat'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='require' name='tsc_adjust'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='require' name='umip'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='require' name='md-clear'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='require' name='stibp'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='require' name='arch-capabilities'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='require' name='ssbd'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='require' name='ibpb'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='require' name='ibrs'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='require' name='amd-stibp'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='require' name='amd-ssbd'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='disable' name='erms'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='disable' name='xsaveopt'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='disable' name='lm'/>
Apr 14 10:38:35 user nova-compute[71509]:     </mode>
Apr 14 10:38:35 user nova-compute[71509]:     <mode name='custom' supported='yes'>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>qemu64</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='yes'>qemu32</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>phenom</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='yes'>pentium3</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='yes'>pentium2</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='yes'>pentium</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>n270</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>kvm64</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='yes'>kvm32</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='yes'>coreduo</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>core2duo</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>athlon</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Westmere-IBRS</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Westmere</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Snowridge</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Skylake-Server</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Skylake-Client</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>SandyBridge</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Penryn</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Opteron_G5</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Opteron_G4</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Opteron_G3</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Opteron_G2</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Opteron_G1</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Nehalem-IBRS</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Nehalem</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>IvyBridge</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Icelake-Server</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Haswell-noTSX</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Haswell-IBRS</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Haswell</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>EPYC-Rome</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>EPYC-Milan</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>EPYC-IBPB</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>EPYC</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Dhyana</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Cooperlake</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Conroe</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Cascadelake-Server</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Broadwell-noTSX</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Broadwell-IBRS</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Broadwell</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='yes'>486</model>
Apr 14 10:38:35 user nova-compute[71509]:     </mode>
Apr 14 10:38:35 user nova-compute[71509]:   </cpu>
Apr 14 10:38:35 user nova-compute[71509]:   <memoryBacking supported='yes'>
Apr 14 10:38:35 user nova-compute[71509]:     <enum name='sourceType'>
Apr 14 10:38:35 user nova-compute[71509]:       <value>file</value>
Apr 14 10:38:35 user nova-compute[71509]:       <value>anonymous</value>
Apr 14 10:38:35 user nova-compute[71509]:       <value>memfd</value>
Apr 14 10:38:35 user nova-compute[71509]:     </enum>
Apr 14 10:38:35 user nova-compute[71509]:   </memoryBacking>
Apr 14 10:38:35 user nova-compute[71509]:   <devices>
Apr 14 10:38:35 user nova-compute[71509]:     <disk supported='yes'>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='diskDevice'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>disk</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>cdrom</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>floppy</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>lun</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='bus'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>fdc</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>scsi</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>virtio</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>usb</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>sata</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='model'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>virtio</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>virtio-transitional</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>virtio-non-transitional</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:     </disk>
Apr 14 10:38:35 user nova-compute[71509]:     <graphics supported='yes'>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='type'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>sdl</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>vnc</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>spice</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>egl-headless</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:     </graphics>
Apr 14 10:38:35 user nova-compute[71509]:     <video supported='yes'>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='modelType'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>vga</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>cirrus</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>vmvga</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>qxl</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>virtio</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>none</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>bochs</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>ramfb</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:     </video>
Apr 14 10:38:35 user nova-compute[71509]:     <hostdev supported='yes'>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='mode'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>subsystem</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='startupPolicy'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>default</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>mandatory</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>requisite</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>optional</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='subsysType'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>usb</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>pci</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>scsi</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='capsType'/>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='pciBackend'/>
Apr 14 10:38:35 user nova-compute[71509]:     </hostdev>
Apr 14 10:38:35 user nova-compute[71509]:     <rng supported='yes'>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='model'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>virtio</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>virtio-transitional</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>virtio-non-transitional</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='backendModel'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>random</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>egd</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>builtin</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:     </rng>
Apr 14 10:38:35 user nova-compute[71509]:     <filesystem supported='yes'>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='driverType'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>path</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>handle</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>virtiofs</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:     </filesystem>
Apr 14 10:38:35 user nova-compute[71509]:     <tpm supported='yes'>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='model'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>tpm-tis</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>tpm-crb</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='backendModel'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>passthrough</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>emulator</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:     </tpm>
Apr 14 10:38:35 user nova-compute[71509]:   </devices>
Apr 14 10:38:35 user nova-compute[71509]:   <features>
Apr 14 10:38:35 user nova-compute[71509]:     <gic supported='no'/>
Apr 14 10:38:35 user nova-compute[71509]:     <vmcoreinfo supported='yes'/>
Apr 14 10:38:35 user nova-compute[71509]:     <genid supported='yes'/>
Apr 14 10:38:35 user nova-compute[71509]:     <backingStoreInput supported='yes'/>
Apr 14 10:38:35 user nova-compute[71509]:     <backup supported='yes'/>
Apr 14 10:38:35 user nova-compute[71509]:     <sev supported='no'/>
Apr 14 10:38:35 user nova-compute[71509]:   </features>
Apr 14 10:38:35 user nova-compute[71509]: </domainCapabilities>
Apr 14 10:38:35 user nova-compute[71509]:  {{(pid=71509) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 14 10:38:35 user nova-compute[71509]: DEBUG nova.virt.libvirt.host [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=71509) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 10:38:35 user nova-compute[71509]: DEBUG nova.virt.libvirt.host [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=71509) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 10:38:35 user nova-compute[71509]: DEBUG nova.virt.libvirt.host [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=71509) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 10:38:35 user nova-compute[71509]: DEBUG nova.virt.libvirt.host [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=71509) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 10:38:35 user nova-compute[71509]: DEBUG nova.virt.libvirt.host [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=71509) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 10:38:35 user nova-compute[71509]: DEBUG nova.virt.libvirt.host [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=71509) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 10:38:35 user nova-compute[71509]: DEBUG nova.virt.libvirt.host [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=71509) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 10:38:35 user nova-compute[71509]: DEBUG nova.virt.libvirt.host [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Getting domain capabilities for mips via machine types: {None} {{(pid=71509) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 10:38:35 user nova-compute[71509]: DEBUG nova.virt.libvirt.host [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=71509) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 10:38:35 user nova-compute[71509]: DEBUG nova.virt.libvirt.host [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=71509) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 10:38:35 user nova-compute[71509]: DEBUG nova.virt.libvirt.host [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=71509) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 10:38:35 user nova-compute[71509]: DEBUG nova.virt.libvirt.host [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=71509) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 10:38:35 user nova-compute[71509]: DEBUG nova.virt.libvirt.host [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=71509) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 10:38:35 user nova-compute[71509]: DEBUG nova.virt.libvirt.host [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=71509) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 10:38:35 user nova-compute[71509]: DEBUG nova.virt.libvirt.host [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=71509) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 10:38:35 user nova-compute[71509]: DEBUG nova.virt.libvirt.host [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=71509) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 10:38:35 user nova-compute[71509]: DEBUG nova.virt.libvirt.host [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=71509) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 10:38:35 user nova-compute[71509]: DEBUG nova.virt.libvirt.host [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Getting domain capabilities for ppc64 via machine types: {'pseries', None, 'powernv'} {{(pid=71509) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 10:38:35 user nova-compute[71509]: DEBUG nova.virt.libvirt.host [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=71509) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 10:38:35 user nova-compute[71509]: DEBUG nova.virt.libvirt.host [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=71509) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 10:38:35 user nova-compute[71509]: DEBUG nova.virt.libvirt.host [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=71509) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 10:38:35 user nova-compute[71509]: DEBUG nova.virt.libvirt.host [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=71509) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 10:38:35 user nova-compute[71509]: DEBUG nova.virt.libvirt.host [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=71509) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 10:38:35 user nova-compute[71509]: DEBUG nova.virt.libvirt.host [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=71509) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 10:38:35 user nova-compute[71509]: DEBUG nova.virt.libvirt.host [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=71509) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 10:38:35 user nova-compute[71509]: DEBUG nova.virt.libvirt.host [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=71509) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 10:38:35 user nova-compute[71509]: DEBUG nova.virt.libvirt.host [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=71509) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 10:38:35 user nova-compute[71509]: DEBUG nova.virt.libvirt.host [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=71509) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 10:38:35 user nova-compute[71509]: DEBUG nova.virt.libvirt.host [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=71509) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 10:38:35 user nova-compute[71509]: DEBUG nova.virt.libvirt.host [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=71509) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 10:38:35 user nova-compute[71509]: DEBUG nova.virt.libvirt.host [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=71509) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 10:38:35 user nova-compute[71509]: DEBUG nova.virt.libvirt.host [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=71509) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 10:38:35 user nova-compute[71509]: DEBUG nova.virt.libvirt.host [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=71509) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 10:38:35 user nova-compute[71509]: DEBUG nova.virt.libvirt.host [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=71509) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 10:38:35 user nova-compute[71509]: DEBUG nova.virt.libvirt.host [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=71509) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 10:38:35 user nova-compute[71509]: DEBUG nova.virt.libvirt.host [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=71509) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 10:38:35 user nova-compute[71509]: DEBUG nova.virt.libvirt.host [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=71509) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 10:38:35 user nova-compute[71509]: DEBUG nova.virt.libvirt.host [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=71509) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 10:38:35 user nova-compute[71509]: DEBUG nova.virt.libvirt.host [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu', 'pc', 'q35', 'ubuntu-q35'} {{(pid=71509) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 10:38:35 user nova-compute[71509]: DEBUG nova.virt.libvirt.host [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Apr 14 10:38:35 user nova-compute[71509]: <domainCapabilities>
Apr 14 10:38:35 user nova-compute[71509]:   <path>/usr/bin/qemu-system-x86_64</path>
Apr 14 10:38:35 user nova-compute[71509]:   <domain>kvm</domain>
Apr 14 10:38:35 user nova-compute[71509]:   <machine>pc-i440fx-jammy</machine>
Apr 14 10:38:35 user nova-compute[71509]:   <arch>x86_64</arch>
Apr 14 10:38:35 user nova-compute[71509]:   <vcpu max='255'/>
Apr 14 10:38:35 user nova-compute[71509]:   <iothreads supported='yes'/>
Apr 14 10:38:35 user nova-compute[71509]:   <os supported='yes'>
Apr 14 10:38:35 user nova-compute[71509]:     <enum name='firmware'>
Apr 14 10:38:35 user nova-compute[71509]:       <value>efi</value>
Apr 14 10:38:35 user nova-compute[71509]:     </enum>
Apr 14 10:38:35 user nova-compute[71509]:     <loader supported='yes'>
Apr 14 10:38:35 user nova-compute[71509]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='type'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>rom</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>pflash</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='readonly'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>yes</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>no</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='secure'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>no</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:     </loader>
Apr 14 10:38:35 user nova-compute[71509]:   </os>
Apr 14 10:38:35 user nova-compute[71509]:   <cpu>
Apr 14 10:38:35 user nova-compute[71509]:     <mode name='host-passthrough' supported='yes'>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='hostPassthroughMigratable'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>on</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>off</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:     </mode>
Apr 14 10:38:35 user nova-compute[71509]:     <mode name='maximum' supported='yes'>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='maximumMigratable'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>on</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>off</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:     </mode>
Apr 14 10:38:35 user nova-compute[71509]:     <mode name='host-model' supported='yes'>
Apr 14 10:38:35 user nova-compute[71509]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 14 10:38:35 user nova-compute[71509]:       <vendor>Intel</vendor>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='require' name='ss'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='require' name='vmx'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='require' name='pcid'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='require' name='hypervisor'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='require' name='arat'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='require' name='tsc_adjust'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='require' name='umip'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='require' name='md-clear'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='require' name='stibp'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='require' name='arch-capabilities'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='require' name='ssbd'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='require' name='invtsc'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='require' name='ibpb'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='require' name='ibrs'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='require' name='amd-stibp'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='require' name='amd-ssbd'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='require' name='rsba'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='require' name='pschange-mc-no'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='disable' name='erms'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='disable' name='xsaveopt'/>
Apr 14 10:38:35 user nova-compute[71509]:     </mode>
Apr 14 10:38:35 user nova-compute[71509]:     <mode name='custom' supported='yes'>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>qemu64</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='yes'>qemu32</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>phenom</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='yes'>pentium3</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='yes'>pentium2</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='yes'>pentium</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>n270</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='yes'>kvm64</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='yes'>kvm32</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='yes'>coreduo</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='yes'>core2duo</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>athlon</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='yes'>Westmere-IBRS</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='yes'>Westmere</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Snowridge</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Skylake-Server</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Skylake-Client</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>SandyBridge</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='yes'>Penryn</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Opteron_G5</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Opteron_G4</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Opteron_G3</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Opteron_G2</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='yes'>Opteron_G1</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='yes'>Nehalem-IBRS</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='yes'>Nehalem</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>IvyBridge</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Icelake-Server</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Haswell-noTSX</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Haswell-IBRS</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Haswell</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>EPYC-Rome</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>EPYC-Milan</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>EPYC-IBPB</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>EPYC</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Dhyana</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Cooperlake</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='yes'>Conroe</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Cascadelake-Server</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Broadwell-noTSX</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Broadwell-IBRS</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Broadwell</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='yes'>486</model>
Apr 14 10:38:35 user nova-compute[71509]:     </mode>
Apr 14 10:38:35 user nova-compute[71509]:   </cpu>
Apr 14 10:38:35 user nova-compute[71509]:   <memoryBacking supported='yes'>
Apr 14 10:38:35 user nova-compute[71509]:     <enum name='sourceType'>
Apr 14 10:38:35 user nova-compute[71509]:       <value>file</value>
Apr 14 10:38:35 user nova-compute[71509]:       <value>anonymous</value>
Apr 14 10:38:35 user nova-compute[71509]:       <value>memfd</value>
Apr 14 10:38:35 user nova-compute[71509]:     </enum>
Apr 14 10:38:35 user nova-compute[71509]:   </memoryBacking>
Apr 14 10:38:35 user nova-compute[71509]:   <devices>
Apr 14 10:38:35 user nova-compute[71509]:     <disk supported='yes'>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='diskDevice'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>disk</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>cdrom</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>floppy</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>lun</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='bus'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>ide</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>fdc</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>scsi</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>virtio</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>usb</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>sata</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='model'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>virtio</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>virtio-transitional</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>virtio-non-transitional</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:     </disk>
Apr 14 10:38:35 user nova-compute[71509]:     <graphics supported='yes'>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='type'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>sdl</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>vnc</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>spice</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>egl-headless</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:     </graphics>
Apr 14 10:38:35 user nova-compute[71509]:     <video supported='yes'>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='modelType'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>vga</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>cirrus</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>vmvga</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>qxl</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>virtio</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>none</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>bochs</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>ramfb</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:     </video>
Apr 14 10:38:35 user nova-compute[71509]:     <hostdev supported='yes'>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='mode'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>subsystem</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='startupPolicy'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>default</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>mandatory</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>requisite</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>optional</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='subsysType'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>usb</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>pci</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>scsi</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='capsType'/>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='pciBackend'/>
Apr 14 10:38:35 user nova-compute[71509]:     </hostdev>
Apr 14 10:38:35 user nova-compute[71509]:     <rng supported='yes'>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='model'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>virtio</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>virtio-transitional</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>virtio-non-transitional</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='backendModel'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>random</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>egd</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>builtin</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:     </rng>
Apr 14 10:38:35 user nova-compute[71509]:     <filesystem supported='yes'>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='driverType'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>path</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>handle</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>virtiofs</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:     </filesystem>
Apr 14 10:38:35 user nova-compute[71509]:     <tpm supported='yes'>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='model'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>tpm-tis</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>tpm-crb</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='backendModel'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>passthrough</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>emulator</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:     </tpm>
Apr 14 10:38:35 user nova-compute[71509]:   </devices>
Apr 14 10:38:35 user nova-compute[71509]:   <features>
Apr 14 10:38:35 user nova-compute[71509]:     <gic supported='no'/>
Apr 14 10:38:35 user nova-compute[71509]:     <vmcoreinfo supported='yes'/>
Apr 14 10:38:35 user nova-compute[71509]:     <genid supported='yes'/>
Apr 14 10:38:35 user nova-compute[71509]:     <backingStoreInput supported='yes'/>
Apr 14 10:38:35 user nova-compute[71509]:     <backup supported='yes'/>
Apr 14 10:38:35 user nova-compute[71509]:     <sev supported='no'/>
Apr 14 10:38:35 user nova-compute[71509]:   </features>
Apr 14 10:38:35 user nova-compute[71509]: </domainCapabilities>
Apr 14 10:38:35 user nova-compute[71509]:  {{(pid=71509) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 14 10:38:35 user nova-compute[71509]: DEBUG nova.virt.libvirt.host [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Apr 14 10:38:35 user nova-compute[71509]: <domainCapabilities>
Apr 14 10:38:35 user nova-compute[71509]:   <path>/usr/bin/qemu-system-x86_64</path>
Apr 14 10:38:35 user nova-compute[71509]:   <domain>kvm</domain>
Apr 14 10:38:35 user nova-compute[71509]:   <machine>pc-i440fx-6.2</machine>
Apr 14 10:38:35 user nova-compute[71509]:   <arch>x86_64</arch>
Apr 14 10:38:35 user nova-compute[71509]:   <vcpu max='255'/>
Apr 14 10:38:35 user nova-compute[71509]:   <iothreads supported='yes'/>
Apr 14 10:38:35 user nova-compute[71509]:   <os supported='yes'>
Apr 14 10:38:35 user nova-compute[71509]:     <enum name='firmware'>
Apr 14 10:38:35 user nova-compute[71509]:       <value>efi</value>
Apr 14 10:38:35 user nova-compute[71509]:     </enum>
Apr 14 10:38:35 user nova-compute[71509]:     <loader supported='yes'>
Apr 14 10:38:35 user nova-compute[71509]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='type'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>rom</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>pflash</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='readonly'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>yes</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>no</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='secure'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>no</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:     </loader>
Apr 14 10:38:35 user nova-compute[71509]:   </os>
Apr 14 10:38:35 user nova-compute[71509]:   <cpu>
Apr 14 10:38:35 user nova-compute[71509]:     <mode name='host-passthrough' supported='yes'>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='hostPassthroughMigratable'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>on</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>off</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:     </mode>
Apr 14 10:38:35 user nova-compute[71509]:     <mode name='maximum' supported='yes'>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='maximumMigratable'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>on</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>off</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:     </mode>
Apr 14 10:38:35 user nova-compute[71509]:     <mode name='host-model' supported='yes'>
Apr 14 10:38:35 user nova-compute[71509]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 14 10:38:35 user nova-compute[71509]:       <vendor>Intel</vendor>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='require' name='ss'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='require' name='vmx'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='require' name='pcid'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='require' name='hypervisor'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='require' name='arat'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='require' name='tsc_adjust'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='require' name='umip'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='require' name='md-clear'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='require' name='stibp'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='require' name='arch-capabilities'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='require' name='ssbd'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='require' name='invtsc'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='require' name='ibpb'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='require' name='ibrs'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='require' name='amd-stibp'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='require' name='amd-ssbd'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='require' name='rsba'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='require' name='pschange-mc-no'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='disable' name='erms'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='disable' name='xsaveopt'/>
Apr 14 10:38:35 user nova-compute[71509]:     </mode>
Apr 14 10:38:35 user nova-compute[71509]:     <mode name='custom' supported='yes'>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>qemu64</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='yes'>qemu32</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>phenom</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='yes'>pentium3</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='yes'>pentium2</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='yes'>pentium</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>n270</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='yes'>kvm64</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='yes'>kvm32</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='yes'>coreduo</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='yes'>core2duo</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>athlon</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='yes'>Westmere-IBRS</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='yes'>Westmere</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Snowridge</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Skylake-Server</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Skylake-Client</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>SandyBridge</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='yes'>Penryn</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Opteron_G5</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Opteron_G4</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Opteron_G3</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Opteron_G2</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='yes'>Opteron_G1</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='yes'>Nehalem-IBRS</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='yes'>Nehalem</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>IvyBridge</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Icelake-Server</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Haswell-noTSX</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Haswell-IBRS</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Haswell</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>EPYC-Rome</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>EPYC-Milan</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>EPYC-IBPB</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>EPYC</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Dhyana</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Cooperlake</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='yes'>Conroe</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Cascadelake-Server</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Broadwell-noTSX</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Broadwell-IBRS</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Broadwell</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='yes'>486</model>
Apr 14 10:38:35 user nova-compute[71509]:     </mode>
Apr 14 10:38:35 user nova-compute[71509]:   </cpu>
Apr 14 10:38:35 user nova-compute[71509]:   <memoryBacking supported='yes'>
Apr 14 10:38:35 user nova-compute[71509]:     <enum name='sourceType'>
Apr 14 10:38:35 user nova-compute[71509]:       <value>file</value>
Apr 14 10:38:35 user nova-compute[71509]:       <value>anonymous</value>
Apr 14 10:38:35 user nova-compute[71509]:       <value>memfd</value>
Apr 14 10:38:35 user nova-compute[71509]:     </enum>
Apr 14 10:38:35 user nova-compute[71509]:   </memoryBacking>
Apr 14 10:38:35 user nova-compute[71509]:   <devices>
Apr 14 10:38:35 user nova-compute[71509]:     <disk supported='yes'>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='diskDevice'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>disk</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>cdrom</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>floppy</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>lun</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='bus'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>ide</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>fdc</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>scsi</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>virtio</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>usb</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>sata</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='model'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>virtio</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>virtio-transitional</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>virtio-non-transitional</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:     </disk>
Apr 14 10:38:35 user nova-compute[71509]:     <graphics supported='yes'>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='type'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>sdl</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>vnc</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>spice</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>egl-headless</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:     </graphics>
Apr 14 10:38:35 user nova-compute[71509]:     <video supported='yes'>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='modelType'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>vga</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>cirrus</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>vmvga</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>qxl</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>virtio</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>none</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>bochs</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>ramfb</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:     </video>
Apr 14 10:38:35 user nova-compute[71509]:     <hostdev supported='yes'>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='mode'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>subsystem</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='startupPolicy'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>default</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>mandatory</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>requisite</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>optional</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='subsysType'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>usb</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>pci</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>scsi</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='capsType'/>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='pciBackend'/>
Apr 14 10:38:35 user nova-compute[71509]:     </hostdev>
Apr 14 10:38:35 user nova-compute[71509]:     <rng supported='yes'>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='model'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>virtio</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>virtio-transitional</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>virtio-non-transitional</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='backendModel'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>random</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>egd</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>builtin</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:     </rng>
Apr 14 10:38:35 user nova-compute[71509]:     <filesystem supported='yes'>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='driverType'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>path</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>handle</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>virtiofs</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:     </filesystem>
Apr 14 10:38:35 user nova-compute[71509]:     <tpm supported='yes'>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='model'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>tpm-tis</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>tpm-crb</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='backendModel'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>passthrough</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>emulator</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:     </tpm>
Apr 14 10:38:35 user nova-compute[71509]:   </devices>
Apr 14 10:38:35 user nova-compute[71509]:   <features>
Apr 14 10:38:35 user nova-compute[71509]:     <gic supported='no'/>
Apr 14 10:38:35 user nova-compute[71509]:     <vmcoreinfo supported='yes'/>
Apr 14 10:38:35 user nova-compute[71509]:     <genid supported='yes'/>
Apr 14 10:38:35 user nova-compute[71509]:     <backingStoreInput supported='yes'/>
Apr 14 10:38:35 user nova-compute[71509]:     <backup supported='yes'/>
Apr 14 10:38:35 user nova-compute[71509]:     <sev supported='no'/>
Apr 14 10:38:35 user nova-compute[71509]:   </features>
Apr 14 10:38:35 user nova-compute[71509]: </domainCapabilities>
Apr 14 10:38:35 user nova-compute[71509]:  {{(pid=71509) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 14 10:38:35 user nova-compute[71509]: DEBUG nova.virt.libvirt.host [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Apr 14 10:38:35 user nova-compute[71509]: <domainCapabilities>
Apr 14 10:38:35 user nova-compute[71509]:   <path>/usr/bin/qemu-system-x86_64</path>
Apr 14 10:38:35 user nova-compute[71509]:   <domain>kvm</domain>
Apr 14 10:38:35 user nova-compute[71509]:   <machine>pc-q35-6.2</machine>
Apr 14 10:38:35 user nova-compute[71509]:   <arch>x86_64</arch>
Apr 14 10:38:35 user nova-compute[71509]:   <vcpu max='288'/>
Apr 14 10:38:35 user nova-compute[71509]:   <iothreads supported='yes'/>
Apr 14 10:38:35 user nova-compute[71509]:   <os supported='yes'>
Apr 14 10:38:35 user nova-compute[71509]:     <enum name='firmware'>
Apr 14 10:38:35 user nova-compute[71509]:       <value>efi</value>
Apr 14 10:38:35 user nova-compute[71509]:     </enum>
Apr 14 10:38:35 user nova-compute[71509]:     <loader supported='yes'>
Apr 14 10:38:35 user nova-compute[71509]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Apr 14 10:38:35 user nova-compute[71509]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Apr 14 10:38:35 user nova-compute[71509]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='type'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>rom</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>pflash</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='readonly'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>yes</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>no</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='secure'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>yes</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>no</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:     </loader>
Apr 14 10:38:35 user nova-compute[71509]:   </os>
Apr 14 10:38:35 user nova-compute[71509]:   <cpu>
Apr 14 10:38:35 user nova-compute[71509]:     <mode name='host-passthrough' supported='yes'>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='hostPassthroughMigratable'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>on</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>off</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:     </mode>
Apr 14 10:38:35 user nova-compute[71509]:     <mode name='maximum' supported='yes'>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='maximumMigratable'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>on</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>off</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:     </mode>
Apr 14 10:38:35 user nova-compute[71509]:     <mode name='host-model' supported='yes'>
Apr 14 10:38:35 user nova-compute[71509]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 14 10:38:35 user nova-compute[71509]:       <vendor>Intel</vendor>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='require' name='ss'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='require' name='vmx'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='require' name='pcid'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='require' name='hypervisor'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='require' name='arat'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='require' name='tsc_adjust'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='require' name='umip'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='require' name='md-clear'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='require' name='stibp'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='require' name='arch-capabilities'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='require' name='ssbd'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='require' name='invtsc'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='require' name='ibpb'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='require' name='ibrs'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='require' name='amd-stibp'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='require' name='amd-ssbd'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='require' name='rsba'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='require' name='pschange-mc-no'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='disable' name='erms'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='disable' name='xsaveopt'/>
Apr 14 10:38:35 user nova-compute[71509]:     </mode>
Apr 14 10:38:35 user nova-compute[71509]:     <mode name='custom' supported='yes'>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>qemu64</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='yes'>qemu32</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>phenom</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='yes'>pentium3</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='yes'>pentium2</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='yes'>pentium</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>n270</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='yes'>kvm64</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='yes'>kvm32</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='yes'>coreduo</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='yes'>core2duo</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>athlon</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='yes'>Westmere-IBRS</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='yes'>Westmere</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Snowridge</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Skylake-Server</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Skylake-Client</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>SandyBridge</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='yes'>Penryn</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Opteron_G5</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Opteron_G4</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Opteron_G3</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Opteron_G2</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='yes'>Opteron_G1</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='yes'>Nehalem-IBRS</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='yes'>Nehalem</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>IvyBridge</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Icelake-Server</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Haswell-noTSX</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Haswell-IBRS</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Haswell</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>EPYC-Rome</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>EPYC-Milan</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>EPYC-IBPB</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>EPYC</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Dhyana</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Cooperlake</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='yes'>Conroe</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Cascadelake-Server</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Broadwell-noTSX</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Broadwell-IBRS</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Broadwell</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='yes'>486</model>
Apr 14 10:38:35 user nova-compute[71509]:     </mode>
Apr 14 10:38:35 user nova-compute[71509]:   </cpu>
Apr 14 10:38:35 user nova-compute[71509]:   <memoryBacking supported='yes'>
Apr 14 10:38:35 user nova-compute[71509]:     <enum name='sourceType'>
Apr 14 10:38:35 user nova-compute[71509]:       <value>file</value>
Apr 14 10:38:35 user nova-compute[71509]:       <value>anonymous</value>
Apr 14 10:38:35 user nova-compute[71509]:       <value>memfd</value>
Apr 14 10:38:35 user nova-compute[71509]:     </enum>
Apr 14 10:38:35 user nova-compute[71509]:   </memoryBacking>
Apr 14 10:38:35 user nova-compute[71509]:   <devices>
Apr 14 10:38:35 user nova-compute[71509]:     <disk supported='yes'>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='diskDevice'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>disk</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>cdrom</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>floppy</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>lun</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='bus'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>fdc</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>scsi</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>virtio</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>usb</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>sata</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='model'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>virtio</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>virtio-transitional</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>virtio-non-transitional</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:     </disk>
Apr 14 10:38:35 user nova-compute[71509]:     <graphics supported='yes'>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='type'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>sdl</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>vnc</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>spice</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>egl-headless</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:     </graphics>
Apr 14 10:38:35 user nova-compute[71509]:     <video supported='yes'>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='modelType'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>vga</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>cirrus</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>vmvga</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>qxl</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>virtio</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>none</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>bochs</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>ramfb</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:     </video>
Apr 14 10:38:35 user nova-compute[71509]:     <hostdev supported='yes'>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='mode'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>subsystem</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='startupPolicy'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>default</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>mandatory</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>requisite</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>optional</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='subsysType'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>usb</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>pci</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>scsi</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='capsType'/>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='pciBackend'/>
Apr 14 10:38:35 user nova-compute[71509]:     </hostdev>
Apr 14 10:38:35 user nova-compute[71509]:     <rng supported='yes'>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='model'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>virtio</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>virtio-transitional</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>virtio-non-transitional</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='backendModel'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>random</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>egd</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>builtin</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:     </rng>
Apr 14 10:38:35 user nova-compute[71509]:     <filesystem supported='yes'>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='driverType'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>path</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>handle</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>virtiofs</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:     </filesystem>
Apr 14 10:38:35 user nova-compute[71509]:     <tpm supported='yes'>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='model'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>tpm-tis</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>tpm-crb</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='backendModel'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>passthrough</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>emulator</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:     </tpm>
Apr 14 10:38:35 user nova-compute[71509]:   </devices>
Apr 14 10:38:35 user nova-compute[71509]:   <features>
Apr 14 10:38:35 user nova-compute[71509]:     <gic supported='no'/>
Apr 14 10:38:35 user nova-compute[71509]:     <vmcoreinfo supported='yes'/>
Apr 14 10:38:35 user nova-compute[71509]:     <genid supported='yes'/>
Apr 14 10:38:35 user nova-compute[71509]:     <backingStoreInput supported='yes'/>
Apr 14 10:38:35 user nova-compute[71509]:     <backup supported='yes'/>
Apr 14 10:38:35 user nova-compute[71509]:     <sev supported='no'/>
Apr 14 10:38:35 user nova-compute[71509]:   </features>
Apr 14 10:38:35 user nova-compute[71509]: </domainCapabilities>
Apr 14 10:38:35 user nova-compute[71509]:  {{(pid=71509) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 14 10:38:35 user nova-compute[71509]: DEBUG nova.virt.libvirt.host [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Apr 14 10:38:35 user nova-compute[71509]: <domainCapabilities>
Apr 14 10:38:35 user nova-compute[71509]:   <path>/usr/bin/qemu-system-x86_64</path>
Apr 14 10:38:35 user nova-compute[71509]:   <domain>kvm</domain>
Apr 14 10:38:35 user nova-compute[71509]:   <machine>pc-q35-jammy</machine>
Apr 14 10:38:35 user nova-compute[71509]:   <arch>x86_64</arch>
Apr 14 10:38:35 user nova-compute[71509]:   <vcpu max='288'/>
Apr 14 10:38:35 user nova-compute[71509]:   <iothreads supported='yes'/>
Apr 14 10:38:35 user nova-compute[71509]:   <os supported='yes'>
Apr 14 10:38:35 user nova-compute[71509]:     <enum name='firmware'>
Apr 14 10:38:35 user nova-compute[71509]:       <value>efi</value>
Apr 14 10:38:35 user nova-compute[71509]:     </enum>
Apr 14 10:38:35 user nova-compute[71509]:     <loader supported='yes'>
Apr 14 10:38:35 user nova-compute[71509]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Apr 14 10:38:35 user nova-compute[71509]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Apr 14 10:38:35 user nova-compute[71509]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='type'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>rom</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>pflash</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='readonly'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>yes</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>no</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='secure'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>yes</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>no</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:     </loader>
Apr 14 10:38:35 user nova-compute[71509]:   </os>
Apr 14 10:38:35 user nova-compute[71509]:   <cpu>
Apr 14 10:38:35 user nova-compute[71509]:     <mode name='host-passthrough' supported='yes'>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='hostPassthroughMigratable'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>on</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>off</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:     </mode>
Apr 14 10:38:35 user nova-compute[71509]:     <mode name='maximum' supported='yes'>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='maximumMigratable'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>on</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>off</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:     </mode>
Apr 14 10:38:35 user nova-compute[71509]:     <mode name='host-model' supported='yes'>
Apr 14 10:38:35 user nova-compute[71509]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Apr 14 10:38:35 user nova-compute[71509]:       <vendor>Intel</vendor>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='require' name='ss'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='require' name='vmx'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='require' name='pcid'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='require' name='hypervisor'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='require' name='arat'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='require' name='tsc_adjust'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='require' name='umip'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='require' name='md-clear'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='require' name='stibp'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='require' name='arch-capabilities'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='require' name='ssbd'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='require' name='invtsc'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='require' name='ibpb'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='require' name='ibrs'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='require' name='amd-stibp'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='require' name='amd-ssbd'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='require' name='rsba'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='require' name='pschange-mc-no'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='disable' name='erms'/>
Apr 14 10:38:35 user nova-compute[71509]:       <feature policy='disable' name='xsaveopt'/>
Apr 14 10:38:35 user nova-compute[71509]:     </mode>
Apr 14 10:38:35 user nova-compute[71509]:     <mode name='custom' supported='yes'>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>qemu64</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='yes'>qemu32</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>phenom</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='yes'>pentium3</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='yes'>pentium2</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='yes'>pentium</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>n270</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='yes'>kvm64</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='yes'>kvm32</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='yes'>coreduo</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='yes'>core2duo</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>athlon</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='yes'>Westmere-IBRS</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='yes'>Westmere</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Snowridge</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Skylake-Server-IBRS</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Skylake-Server</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Skylake-Client-IBRS</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Skylake-Client</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>SandyBridge-IBRS</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>SandyBridge</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='yes'>Penryn</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Opteron_G5</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Opteron_G4</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Opteron_G3</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Opteron_G2</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='yes'>Opteron_G1</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='yes'>Nehalem-IBRS</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='yes'>Nehalem</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>IvyBridge-IBRS</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>IvyBridge</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Icelake-Server-noTSX</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Icelake-Server</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Haswell-noTSX</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Haswell-IBRS</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Haswell</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>EPYC-Rome</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>EPYC-Milan</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>EPYC-IBPB</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>EPYC</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Dhyana</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Cooperlake</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='yes'>Conroe</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Cascadelake-Server</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Broadwell-noTSX</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Broadwell-IBRS</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='no'>Broadwell</model>
Apr 14 10:38:35 user nova-compute[71509]:       <model usable='yes'>486</model>
Apr 14 10:38:35 user nova-compute[71509]:     </mode>
Apr 14 10:38:35 user nova-compute[71509]:   </cpu>
Apr 14 10:38:35 user nova-compute[71509]:   <memoryBacking supported='yes'>
Apr 14 10:38:35 user nova-compute[71509]:     <enum name='sourceType'>
Apr 14 10:38:35 user nova-compute[71509]:       <value>file</value>
Apr 14 10:38:35 user nova-compute[71509]:       <value>anonymous</value>
Apr 14 10:38:35 user nova-compute[71509]:       <value>memfd</value>
Apr 14 10:38:35 user nova-compute[71509]:     </enum>
Apr 14 10:38:35 user nova-compute[71509]:   </memoryBacking>
Apr 14 10:38:35 user nova-compute[71509]:   <devices>
Apr 14 10:38:35 user nova-compute[71509]:     <disk supported='yes'>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='diskDevice'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>disk</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>cdrom</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>floppy</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>lun</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='bus'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>fdc</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>scsi</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>virtio</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>usb</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>sata</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='model'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>virtio</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>virtio-transitional</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>virtio-non-transitional</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:     </disk>
Apr 14 10:38:35 user nova-compute[71509]:     <graphics supported='yes'>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='type'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>sdl</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>vnc</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>spice</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>egl-headless</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:     </graphics>
Apr 14 10:38:35 user nova-compute[71509]:     <video supported='yes'>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='modelType'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>vga</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>cirrus</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>vmvga</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>qxl</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>virtio</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>none</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>bochs</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>ramfb</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:     </video>
Apr 14 10:38:35 user nova-compute[71509]:     <hostdev supported='yes'>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='mode'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>subsystem</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='startupPolicy'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>default</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>mandatory</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>requisite</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>optional</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='subsysType'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>usb</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>pci</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>scsi</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='capsType'/>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='pciBackend'/>
Apr 14 10:38:35 user nova-compute[71509]:     </hostdev>
Apr 14 10:38:35 user nova-compute[71509]:     <rng supported='yes'>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='model'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>virtio</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>virtio-transitional</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>virtio-non-transitional</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='backendModel'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>random</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>egd</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>builtin</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:     </rng>
Apr 14 10:38:35 user nova-compute[71509]:     <filesystem supported='yes'>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='driverType'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>path</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>handle</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>virtiofs</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:     </filesystem>
Apr 14 10:38:35 user nova-compute[71509]:     <tpm supported='yes'>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='model'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>tpm-tis</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>tpm-crb</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:       <enum name='backendModel'>
Apr 14 10:38:35 user nova-compute[71509]:         <value>passthrough</value>
Apr 14 10:38:35 user nova-compute[71509]:         <value>emulator</value>
Apr 14 10:38:35 user nova-compute[71509]:       </enum>
Apr 14 10:38:35 user nova-compute[71509]:     </tpm>
Apr 14 10:38:35 user nova-compute[71509]:   </devices>
Apr 14 10:38:35 user nova-compute[71509]:   <features>
Apr 14 10:38:35 user nova-compute[71509]:     <gic supported='no'/>
Apr 14 10:38:35 user nova-compute[71509]:     <vmcoreinfo supported='yes'/>
Apr 14 10:38:35 user nova-compute[71509]:     <genid supported='yes'/>
Apr 14 10:38:35 user nova-compute[71509]:     <backingStoreInput supported='yes'/>
Apr 14 10:38:35 user nova-compute[71509]:     <backup supported='yes'/>
Apr 14 10:38:35 user nova-compute[71509]:     <sev supported='no'/>
Apr 14 10:38:35 user nova-compute[71509]:   </features>
Apr 14 10:38:35 user nova-compute[71509]: </domainCapabilities>
Apr 14 10:38:35 user nova-compute[71509]:  {{(pid=71509) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Apr 14 10:38:35 user nova-compute[71509]: DEBUG nova.virt.libvirt.host [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=71509) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 10:38:35 user nova-compute[71509]: DEBUG nova.virt.libvirt.host [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=71509) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 10:38:35 user nova-compute[71509]: DEBUG nova.virt.libvirt.host [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=71509) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Apr 14 10:38:35 user nova-compute[71509]: DEBUG nova.virt.libvirt.host [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=71509) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Apr 14 10:38:35 user nova-compute[71509]: DEBUG nova.virt.libvirt.host [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Checking secure boot support for host arch (x86_64) {{(pid=71509) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1750}}
Apr 14 10:38:35 user nova-compute[71509]: DEBUG nova.virt.libvirt.host [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Checking secure boot support for host arch (x86_64) {{(pid=71509) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1750}}
Apr 14 10:38:35 user nova-compute[71509]: DEBUG nova.virt.libvirt.host [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Checking secure boot support for host arch (x86_64) {{(pid=71509) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1750}}
Apr 14 10:38:35 user nova-compute[71509]: DEBUG nova.virt.libvirt.host [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Checking secure boot support for host arch (x86_64) {{(pid=71509) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1750}}
Apr 14 10:38:35 user nova-compute[71509]: DEBUG nova.virt.libvirt.host [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Checking secure boot support for host arch (x86_64) {{(pid=71509) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1750}}
Apr 14 10:38:35 user nova-compute[71509]: INFO nova.virt.libvirt.host [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Secure Boot support detected
Apr 14 10:38:35 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] cpu compare xml: <cpu match="exact">
Apr 14 10:38:35 user nova-compute[71509]:   <model>Nehalem</model>
Apr 14 10:38:35 user nova-compute[71509]: </cpu>
Apr 14 10:38:35 user nova-compute[71509]:  {{(pid=71509) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:9996}}
Apr 14 10:38:35 user nova-compute[71509]: INFO nova.virt.node [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Generated node identity 52209f7e-594e-4cf4-9018-18636056cd6b
Apr 14 10:38:35 user nova-compute[71509]: INFO nova.virt.node [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Wrote node identity 52209f7e-594e-4cf4-9018-18636056cd6b to /opt/stack/data/nova/compute_id
Apr 14 10:38:35 user nova-compute[71509]: WARNING nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Compute nodes ['52209f7e-594e-4cf4-9018-18636056cd6b'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Apr 14 10:38:35 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Apr 14 10:38:35 user nova-compute[71509]: WARNING nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Apr 14 10:38:35 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:38:35 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:38:35 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:38:35 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Auditing locally available compute resources for user (node: user) {{(pid=71509) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 10:38:36 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:38:36 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:38:36 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Hypervisor/Node resource view: name=user free_ram=10825MB free_disk=27.00872802734375GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71509) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 10:38:36 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:38:36 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:38:36 user nova-compute[71509]: WARNING nova.compute.resource_tracker [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] No compute node record for user:52209f7e-594e-4cf4-9018-18636056cd6b: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 52209f7e-594e-4cf4-9018-18636056cd6b could not be found.
Apr 14 10:38:36 user nova-compute[71509]: INFO nova.compute.resource_tracker [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Compute node record created for user:user with uuid: 52209f7e-594e-4cf4-9018-18636056cd6b
Apr 14 10:38:36 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71509) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 10:38:36 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71509) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 10:38:36 user nova-compute[71509]: INFO nova.scheduler.client.report [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [req-4f21a290-60e9-4fab-9409-2be776c329fe] Created resource provider record via placement API for resource provider with UUID 52209f7e-594e-4cf4-9018-18636056cd6b and name user.
Apr 14 10:38:36 user nova-compute[71509]: DEBUG nova.virt.libvirt.host [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=71509) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1766}}
Apr 14 10:38:36 user nova-compute[71509]: INFO nova.virt.libvirt.host [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] kernel doesn't support AMD SEV
Apr 14 10:38:36 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Updating inventory in ProviderTree for provider 52209f7e-594e-4cf4-9018-18636056cd6b with inventory: {'MEMORY_MB': {'total': 16023, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 14 10:38:36 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71509) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 10:38:36 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Libvirt baseline CPU <cpu>
Apr 14 10:38:36 user nova-compute[71509]:   <arch>x86_64</arch>
Apr 14 10:38:36 user nova-compute[71509]:   <model>Nehalem</model>
Apr 14 10:38:36 user nova-compute[71509]:   <vendor>Intel</vendor>
Apr 14 10:38:36 user nova-compute[71509]:   <topology sockets="6" cores="1" threads="1"/>
Apr 14 10:38:36 user nova-compute[71509]: </cpu>
Apr 14 10:38:36 user nova-compute[71509]:  {{(pid=71509) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12486}}
Apr 14 10:38:36 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Updated inventory for provider 52209f7e-594e-4cf4-9018-18636056cd6b with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16023, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Apr 14 10:38:36 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Updating resource provider 52209f7e-594e-4cf4-9018-18636056cd6b generation from 0 to 1 during operation: update_inventory {{(pid=71509) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Apr 14 10:38:36 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Updating inventory in ProviderTree for provider 52209f7e-594e-4cf4-9018-18636056cd6b with inventory: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 14 10:38:36 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Updating resource provider 52209f7e-594e-4cf4-9018-18636056cd6b generation from 1 to 2 during operation: update_traits {{(pid=71509) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Apr 14 10:38:36 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Compute_service record updated for user:user {{(pid=71509) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 10:38:36 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.688s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:38:36 user nova-compute[71509]: DEBUG nova.service [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Creating RPC server for service compute {{(pid=71509) start /opt/stack/nova/nova/service.py:182}}
Apr 14 10:38:36 user nova-compute[71509]: DEBUG nova.service [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Join ServiceGroup membership for this service compute {{(pid=71509) start /opt/stack/nova/nova/service.py:199}}
Apr 14 10:38:36 user nova-compute[71509]: DEBUG nova.servicegroup.drivers.db [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=71509) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Apr 14 10:39:08 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._sync_power_states {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:39:08 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:39:27 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:39:27 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:39:27 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Starting heal instance info cache {{(pid=71509) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 10:39:27 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Rebuilding the list of instances to heal {{(pid=71509) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 10:39:27 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Didn't find any instances for network info cache update. {{(pid=71509) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 14 10:39:27 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:39:27 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:39:27 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:39:27 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:39:27 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:39:27 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:39:27 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71509) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 10:39:27 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:39:27 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:39:27 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:39:27 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:39:27 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Auditing locally available compute resources for user (node: user) {{(pid=71509) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 10:39:27 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:39:27 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:39:28 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Hypervisor/Node resource view: name=user free_ram=10180MB free_disk=26.805065155029297GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71509) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 10:39:28 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:39:28 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:39:28 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71509) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 10:39:28 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71509) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 10:39:28 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 10:39:28 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 10:39:28 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Compute_service record updated for user:user {{(pid=71509) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 10:39:28 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.110s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:40:28 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:40:28 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:40:28 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:40:28 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:40:28 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:40:28 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71509) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 10:40:28 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:40:28 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:40:28 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Starting heal instance info cache {{(pid=71509) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 10:40:28 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Rebuilding the list of instances to heal {{(pid=71509) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 10:40:28 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Didn't find any instances for network info cache update. {{(pid=71509) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 14 10:40:28 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:40:28 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:40:28 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:40:28 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:40:28 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:40:28 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:40:28 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Auditing locally available compute resources for user (node: user) {{(pid=71509) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 10:40:28 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:40:28 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:40:28 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Hypervisor/Node resource view: name=user free_ram=10186MB free_disk=26.852237701416016GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71509) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 10:40:28 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:40:28 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:40:28 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71509) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 10:40:28 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71509) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 10:40:28 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 10:40:28 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 10:40:28 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Compute_service record updated for user:user {{(pid=71509) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 10:40:28 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.120s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:41:27 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:41:27 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:41:27 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71509) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 10:41:28 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:41:28 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:41:28 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:41:28 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:41:29 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:41:30 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:41:30 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Starting heal instance info cache {{(pid=71509) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 10:41:30 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Rebuilding the list of instances to heal {{(pid=71509) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 10:41:30 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Didn't find any instances for network info cache update. {{(pid=71509) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 14 10:41:30 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:41:30 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:41:30 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:41:30 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:41:30 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Auditing locally available compute resources for user (node: user) {{(pid=71509) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 10:41:30 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:41:30 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:41:30 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Hypervisor/Node resource view: name=user free_ram=10209MB free_disk=26.62718963623047GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71509) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 10:41:30 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:41:30 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:41:30 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71509) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 10:41:30 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71509) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 10:41:30 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 10:41:30 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 10:41:30 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Compute_service record updated for user:user {{(pid=71509) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 10:41:30 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.142s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:42:27 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:42:27 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:42:27 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:42:27 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71509) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 10:42:28 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:42:28 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:42:28 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:42:29 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:42:30 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:42:30 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:42:30 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:42:30 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:42:30 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:42:30 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Auditing locally available compute resources for user (node: user) {{(pid=71509) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 10:42:30 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:42:30 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:42:30 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Hypervisor/Node resource view: name=user free_ram=9420MB free_disk=26.650012969970703GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71509) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 10:42:30 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:42:30 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:42:30 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71509) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 10:42:30 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71509) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 10:42:31 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 10:42:31 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 10:42:31 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Compute_service record updated for user:user {{(pid=71509) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 10:42:31 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.122s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:42:33 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:42:33 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Starting heal instance info cache {{(pid=71509) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 10:42:33 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Rebuilding the list of instances to heal {{(pid=71509) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 10:42:33 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Didn't find any instances for network info cache update. {{(pid=71509) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 14 10:42:40 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-bacb7aa1-84c2-4be6-9cbe-bd058fb68a99 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Acquiring lock "c90a9b99-0985-403b-b4d8-eaa8c2eed88a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:42:40 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-bacb7aa1-84c2-4be6-9cbe-bd058fb68a99 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Lock "c90a9b99-0985-403b-b4d8-eaa8c2eed88a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:42:40 user nova-compute[71509]: DEBUG nova.compute.manager [None req-bacb7aa1-84c2-4be6-9cbe-bd058fb68a99 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] [instance: c90a9b99-0985-403b-b4d8-eaa8c2eed88a] Starting instance... {{(pid=71509) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 10:42:40 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-bacb7aa1-84c2-4be6-9cbe-bd058fb68a99 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:42:40 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-bacb7aa1-84c2-4be6-9cbe-bd058fb68a99 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:42:40 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-bacb7aa1-84c2-4be6-9cbe-bd058fb68a99 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71509) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 10:42:40 user nova-compute[71509]: INFO nova.compute.claims [None req-bacb7aa1-84c2-4be6-9cbe-bd058fb68a99 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] [instance: c90a9b99-0985-403b-b4d8-eaa8c2eed88a] Claim successful on node user
Apr 14 10:42:41 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-bacb7aa1-84c2-4be6-9cbe-bd058fb68a99 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 10:42:41 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-bacb7aa1-84c2-4be6-9cbe-bd058fb68a99 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 10:42:41 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-bacb7aa1-84c2-4be6-9cbe-bd058fb68a99 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.528s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:42:41 user nova-compute[71509]: DEBUG nova.compute.manager [None req-bacb7aa1-84c2-4be6-9cbe-bd058fb68a99 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] [instance: c90a9b99-0985-403b-b4d8-eaa8c2eed88a] Start building networks asynchronously for instance. {{(pid=71509) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 10:42:41 user nova-compute[71509]: DEBUG nova.compute.manager [None req-bacb7aa1-84c2-4be6-9cbe-bd058fb68a99 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] [instance: c90a9b99-0985-403b-b4d8-eaa8c2eed88a] Allocating IP information in the background. {{(pid=71509) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 10:42:41 user nova-compute[71509]: DEBUG nova.network.neutron [None req-bacb7aa1-84c2-4be6-9cbe-bd058fb68a99 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] [instance: c90a9b99-0985-403b-b4d8-eaa8c2eed88a] allocate_for_instance() {{(pid=71509) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 10:42:41 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-bacb7aa1-84c2-4be6-9cbe-bd058fb68a99 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] [instance: c90a9b99-0985-403b-b4d8-eaa8c2eed88a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 10:42:41 user nova-compute[71509]: DEBUG nova.compute.manager [None req-bacb7aa1-84c2-4be6-9cbe-bd058fb68a99 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] [instance: c90a9b99-0985-403b-b4d8-eaa8c2eed88a] Start building block device mappings for instance. {{(pid=71509) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 10:42:41 user nova-compute[71509]: DEBUG nova.compute.manager [None req-bacb7aa1-84c2-4be6-9cbe-bd058fb68a99 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] [instance: c90a9b99-0985-403b-b4d8-eaa8c2eed88a] Start spawning the instance on the hypervisor. {{(pid=71509) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 10:42:41 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-bacb7aa1-84c2-4be6-9cbe-bd058fb68a99 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] [instance: c90a9b99-0985-403b-b4d8-eaa8c2eed88a] Creating instance directory {{(pid=71509) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 10:42:41 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-bacb7aa1-84c2-4be6-9cbe-bd058fb68a99 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] [instance: c90a9b99-0985-403b-b4d8-eaa8c2eed88a] Creating image(s)
Apr 14 10:42:41 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-bacb7aa1-84c2-4be6-9cbe-bd058fb68a99 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Acquiring lock "/opt/stack/data/nova/instances/c90a9b99-0985-403b-b4d8-eaa8c2eed88a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:42:41 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-bacb7aa1-84c2-4be6-9cbe-bd058fb68a99 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Lock "/opt/stack/data/nova/instances/c90a9b99-0985-403b-b4d8-eaa8c2eed88a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:42:41 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-bacb7aa1-84c2-4be6-9cbe-bd058fb68a99 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Lock "/opt/stack/data/nova/instances/c90a9b99-0985-403b-b4d8-eaa8c2eed88a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.028s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:42:41 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-bacb7aa1-84c2-4be6-9cbe-bd058fb68a99 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Acquiring lock "5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:42:41 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-bacb7aa1-84c2-4be6-9cbe-bd058fb68a99 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Lock "5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:42:41 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-bacb7aa1-84c2-4be6-9cbe-bd058fb68a99 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18.part --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:42:42 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-3be0cccc-6a13-42da-8130-2f4a679ec412 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Acquiring lock "97f20661-8b60-439e-b7af-2fc2013c5ade" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:42:42 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-3be0cccc-6a13-42da-8130-2f4a679ec412 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "97f20661-8b60-439e-b7af-2fc2013c5ade" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:42:42 user nova-compute[71509]: DEBUG nova.compute.manager [None req-3be0cccc-6a13-42da-8130-2f4a679ec412 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] Starting instance... {{(pid=71509) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 10:42:42 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-bacb7aa1-84c2-4be6-9cbe-bd058fb68a99 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18.part --force-share --output=json" returned: 0 in 0.173s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:42:42 user nova-compute[71509]: DEBUG nova.virt.images [None req-bacb7aa1-84c2-4be6-9cbe-bd058fb68a99 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] 048ec0ee-0465-448d-8b4c-f072acb101dc was qcow2, converting to raw {{(pid=71509) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 14 10:42:42 user nova-compute[71509]: DEBUG nova.privsep.utils [None req-bacb7aa1-84c2-4be6-9cbe-bd058fb68a99 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71509) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 10:42:42 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-bacb7aa1-84c2-4be6-9cbe-bd058fb68a99 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18.part /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18.converted {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:42:42 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-3be0cccc-6a13-42da-8130-2f4a679ec412 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:42:42 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-3be0cccc-6a13-42da-8130-2f4a679ec412 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:42:42 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-3be0cccc-6a13-42da-8130-2f4a679ec412 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71509) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 10:42:42 user nova-compute[71509]: INFO nova.compute.claims [None req-3be0cccc-6a13-42da-8130-2f4a679ec412 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] Claim successful on node user
Apr 14 10:42:42 user nova-compute[71509]: DEBUG nova.policy [None req-bacb7aa1-84c2-4be6-9cbe-bd058fb68a99 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0a9842a4c91c4d45b52da0b404fc27c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30856983340a435d8e92f138fdecaa35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71509) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 10:42:42 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-bacb7aa1-84c2-4be6-9cbe-bd058fb68a99 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18.part /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18.converted" returned: 0 in 0.186s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:42:42 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-bacb7aa1-84c2-4be6-9cbe-bd058fb68a99 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18.converted --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:42:42 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-bacb7aa1-84c2-4be6-9cbe-bd058fb68a99 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18.converted --force-share --output=json" returned: 0 in 0.155s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:42:42 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-bacb7aa1-84c2-4be6-9cbe-bd058fb68a99 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Lock "5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.871s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:42:42 user nova-compute[71509]: INFO oslo.privsep.daemon [None req-bacb7aa1-84c2-4be6-9cbe-bd058fb68a99 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpktrdw3a2/privsep.sock']
Apr 14 10:42:42 user sudo[80682]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpktrdw3a2/privsep.sock
Apr 14 10:42:42 user sudo[80682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Apr 14 10:42:42 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-3be0cccc-6a13-42da-8130-2f4a679ec412 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 10:42:42 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-3be0cccc-6a13-42da-8130-2f4a679ec412 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 10:42:42 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-3be0cccc-6a13-42da-8130-2f4a679ec412 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.426s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:42:42 user nova-compute[71509]: DEBUG nova.compute.manager [None req-3be0cccc-6a13-42da-8130-2f4a679ec412 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] Start building networks asynchronously for instance. {{(pid=71509) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 10:42:42 user nova-compute[71509]: DEBUG nova.compute.manager [None req-3be0cccc-6a13-42da-8130-2f4a679ec412 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] Allocating IP information in the background. {{(pid=71509) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 10:42:42 user nova-compute[71509]: DEBUG nova.network.neutron [None req-3be0cccc-6a13-42da-8130-2f4a679ec412 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] allocate_for_instance() {{(pid=71509) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 10:42:42 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-3be0cccc-6a13-42da-8130-2f4a679ec412 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 10:42:42 user nova-compute[71509]: DEBUG nova.compute.manager [None req-3be0cccc-6a13-42da-8130-2f4a679ec412 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] Start building block device mappings for instance. {{(pid=71509) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 10:42:42 user nova-compute[71509]: DEBUG nova.policy [None req-3be0cccc-6a13-42da-8130-2f4a679ec412 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e359578dcbb24755a216415053d415ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93e5dac50342d0b65ef09711401e99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71509) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 10:42:42 user nova-compute[71509]: DEBUG nova.compute.manager [None req-3be0cccc-6a13-42da-8130-2f4a679ec412 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] Start spawning the instance on the hypervisor. {{(pid=71509) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 10:42:42 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-3be0cccc-6a13-42da-8130-2f4a679ec412 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] Creating instance directory {{(pid=71509) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 10:42:42 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-3be0cccc-6a13-42da-8130-2f4a679ec412 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] Creating image(s)
Apr 14 10:42:42 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-3be0cccc-6a13-42da-8130-2f4a679ec412 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Acquiring lock "/opt/stack/data/nova/instances/97f20661-8b60-439e-b7af-2fc2013c5ade/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:42:42 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-3be0cccc-6a13-42da-8130-2f4a679ec412 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "/opt/stack/data/nova/instances/97f20661-8b60-439e-b7af-2fc2013c5ade/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:42:42 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-3be0cccc-6a13-42da-8130-2f4a679ec412 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "/opt/stack/data/nova/instances/97f20661-8b60-439e-b7af-2fc2013c5ade/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:42:43 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-14e4c3fe-17aa-4621-9843-837801d371a7 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Acquiring lock "97820f17-22d1-4ec3-9721-1edadccc794a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:42:43 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-14e4c3fe-17aa-4621-9843-837801d371a7 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "97820f17-22d1-4ec3-9721-1edadccc794a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:42:43 user nova-compute[71509]: DEBUG nova.compute.manager [None req-14e4c3fe-17aa-4621-9843-837801d371a7 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: 97820f17-22d1-4ec3-9721-1edadccc794a] Starting instance... {{(pid=71509) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 10:42:43 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-14e4c3fe-17aa-4621-9843-837801d371a7 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:42:43 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-14e4c3fe-17aa-4621-9843-837801d371a7 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:42:43 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-14e4c3fe-17aa-4621-9843-837801d371a7 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71509) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 10:42:43 user nova-compute[71509]: INFO nova.compute.claims [None req-14e4c3fe-17aa-4621-9843-837801d371a7 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: 97820f17-22d1-4ec3-9721-1edadccc794a] Claim successful on node user
Apr 14 10:42:43 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-14e4c3fe-17aa-4621-9843-837801d371a7 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 10:42:43 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-14e4c3fe-17aa-4621-9843-837801d371a7 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 10:42:43 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-14e4c3fe-17aa-4621-9843-837801d371a7 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.266s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:42:43 user nova-compute[71509]: DEBUG nova.compute.manager [None req-14e4c3fe-17aa-4621-9843-837801d371a7 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: 97820f17-22d1-4ec3-9721-1edadccc794a] Start building networks asynchronously for instance. {{(pid=71509) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 10:42:43 user nova-compute[71509]: DEBUG nova.compute.manager [None req-14e4c3fe-17aa-4621-9843-837801d371a7 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: 97820f17-22d1-4ec3-9721-1edadccc794a] Allocating IP information in the background. {{(pid=71509) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 10:42:43 user nova-compute[71509]: DEBUG nova.network.neutron [None req-14e4c3fe-17aa-4621-9843-837801d371a7 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: 97820f17-22d1-4ec3-9721-1edadccc794a] allocate_for_instance() {{(pid=71509) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 10:42:43 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-14e4c3fe-17aa-4621-9843-837801d371a7 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: 97820f17-22d1-4ec3-9721-1edadccc794a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 10:42:43 user nova-compute[71509]: DEBUG nova.compute.manager [None req-14e4c3fe-17aa-4621-9843-837801d371a7 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: 97820f17-22d1-4ec3-9721-1edadccc794a] Start building block device mappings for instance. {{(pid=71509) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 10:42:44 user nova-compute[71509]: DEBUG nova.compute.manager [None req-14e4c3fe-17aa-4621-9843-837801d371a7 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: 97820f17-22d1-4ec3-9721-1edadccc794a] Start spawning the instance on the hypervisor. {{(pid=71509) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 10:42:44 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-14e4c3fe-17aa-4621-9843-837801d371a7 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: 97820f17-22d1-4ec3-9721-1edadccc794a] Creating instance directory {{(pid=71509) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 10:42:44 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-14e4c3fe-17aa-4621-9843-837801d371a7 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: 97820f17-22d1-4ec3-9721-1edadccc794a] Creating image(s)
Apr 14 10:42:44 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-14e4c3fe-17aa-4621-9843-837801d371a7 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Acquiring lock "/opt/stack/data/nova/instances/97820f17-22d1-4ec3-9721-1edadccc794a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:42:44 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-14e4c3fe-17aa-4621-9843-837801d371a7 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "/opt/stack/data/nova/instances/97820f17-22d1-4ec3-9721-1edadccc794a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:42:44 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-14e4c3fe-17aa-4621-9843-837801d371a7 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "/opt/stack/data/nova/instances/97820f17-22d1-4ec3-9721-1edadccc794a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:42:44 user nova-compute[71509]: DEBUG nova.policy [None req-14e4c3fe-17aa-4621-9843-837801d371a7 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e359578dcbb24755a216415053d415ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93e5dac50342d0b65ef09711401e99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71509) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 10:42:44 user sudo[80682]: pam_unix(sudo:session): session closed for user root
Apr 14 10:42:44 user nova-compute[71509]: INFO oslo.privsep.daemon [None req-bacb7aa1-84c2-4be6-9cbe-bd058fb68a99 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Spawned new privsep daemon via rootwrap
Apr 14 10:42:44 user nova-compute[71509]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 14 10:42:44 user nova-compute[71509]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 14 10:42:44 user nova-compute[71509]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Apr 14 10:42:44 user nova-compute[71509]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 80690
Apr 14 10:42:44 user nova-compute[71509]: WARNING oslo_privsep.priv_context [None req-3be0cccc-6a13-42da-8130-2f4a679ec412 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] privsep daemon already running
Apr 14 10:42:44 user nova-compute[71509]: WARNING oslo_privsep.priv_context [None req-14e4c3fe-17aa-4621-9843-837801d371a7 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] privsep daemon already running
Apr 14 10:42:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-14e4c3fe-17aa-4621-9843-837801d371a7 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:42:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-bacb7aa1-84c2-4be6-9cbe-bd058fb68a99 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:42:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-3be0cccc-6a13-42da-8130-2f4a679ec412 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:42:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-14e4c3fe-17aa-4621-9843-837801d371a7 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json" returned: 0 in 0.168s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:42:44 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-14e4c3fe-17aa-4621-9843-837801d371a7 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Acquiring lock "5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:42:44 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-14e4c3fe-17aa-4621-9843-837801d371a7 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:42:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-14e4c3fe-17aa-4621-9843-837801d371a7 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:42:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-3be0cccc-6a13-42da-8130-2f4a679ec412 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json" returned: 0 in 0.152s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:42:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-bacb7aa1-84c2-4be6-9cbe-bd058fb68a99 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json" returned: 0 in 0.183s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:42:44 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-3be0cccc-6a13-42da-8130-2f4a679ec412 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Acquiring lock "5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:42:44 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-bacb7aa1-84c2-4be6-9cbe-bd058fb68a99 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Acquiring lock "5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:42:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-14e4c3fe-17aa-4621-9843-837801d371a7 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json" returned: 0 in 0.148s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:42:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-14e4c3fe-17aa-4621-9843-837801d371a7 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18,backing_fmt=raw /opt/stack/data/nova/instances/97820f17-22d1-4ec3-9721-1edadccc794a/disk 1073741824 {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:42:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-14e4c3fe-17aa-4621-9843-837801d371a7 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18,backing_fmt=raw /opt/stack/data/nova/instances/97820f17-22d1-4ec3-9721-1edadccc794a/disk 1073741824" returned: 0 in 0.056s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:42:44 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-14e4c3fe-17aa-4621-9843-837801d371a7 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.210s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:42:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-14e4c3fe-17aa-4621-9843-837801d371a7 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:42:44 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-3be0cccc-6a13-42da-8130-2f4a679ec412 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.201s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:42:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-3be0cccc-6a13-42da-8130-2f4a679ec412 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:42:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-14e4c3fe-17aa-4621-9843-837801d371a7 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json" returned: 0 in 0.168s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:42:44 user nova-compute[71509]: DEBUG nova.virt.disk.api [None req-14e4c3fe-17aa-4621-9843-837801d371a7 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Checking if we can resize image /opt/stack/data/nova/instances/97820f17-22d1-4ec3-9721-1edadccc794a/disk. size=1073741824 {{(pid=71509) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 10:42:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-14e4c3fe-17aa-4621-9843-837801d371a7 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97820f17-22d1-4ec3-9721-1edadccc794a/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:42:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-3be0cccc-6a13-42da-8130-2f4a679ec412 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json" returned: 0 in 0.173s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:42:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-3be0cccc-6a13-42da-8130-2f4a679ec412 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18,backing_fmt=raw /opt/stack/data/nova/instances/97f20661-8b60-439e-b7af-2fc2013c5ade/disk 1073741824 {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:42:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-3be0cccc-6a13-42da-8130-2f4a679ec412 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18,backing_fmt=raw /opt/stack/data/nova/instances/97f20661-8b60-439e-b7af-2fc2013c5ade/disk 1073741824" returned: 0 in 0.058s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:42:45 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-3be0cccc-6a13-42da-8130-2f4a679ec412 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:42:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-3be0cccc-6a13-42da-8130-2f4a679ec412 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:42:45 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-bacb7aa1-84c2-4be6-9cbe-bd058fb68a99 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Lock "5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.472s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:42:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-bacb7aa1-84c2-4be6-9cbe-bd058fb68a99 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:42:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-14e4c3fe-17aa-4621-9843-837801d371a7 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97820f17-22d1-4ec3-9721-1edadccc794a/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:42:45 user nova-compute[71509]: DEBUG nova.virt.disk.api [None req-14e4c3fe-17aa-4621-9843-837801d371a7 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Cannot resize image /opt/stack/data/nova/instances/97820f17-22d1-4ec3-9721-1edadccc794a/disk to a smaller size. {{(pid=71509) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 10:42:45 user nova-compute[71509]: DEBUG nova.objects.instance [None req-14e4c3fe-17aa-4621-9843-837801d371a7 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lazy-loading 'migration_context' on Instance uuid 97820f17-22d1-4ec3-9721-1edadccc794a {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:42:45 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-14e4c3fe-17aa-4621-9843-837801d371a7 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: 97820f17-22d1-4ec3-9721-1edadccc794a] Created local disks {{(pid=71509) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 10:42:45 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-14e4c3fe-17aa-4621-9843-837801d371a7 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: 97820f17-22d1-4ec3-9721-1edadccc794a] Ensure instance console log exists: /opt/stack/data/nova/instances/97820f17-22d1-4ec3-9721-1edadccc794a/console.log {{(pid=71509) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 10:42:45 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-14e4c3fe-17aa-4621-9843-837801d371a7 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:42:45 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-14e4c3fe-17aa-4621-9843-837801d371a7 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:42:45 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-14e4c3fe-17aa-4621-9843-837801d371a7 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:42:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-bacb7aa1-84c2-4be6-9cbe-bd058fb68a99 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json" returned: 0 in 0.124s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:42:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-bacb7aa1-84c2-4be6-9cbe-bd058fb68a99 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18,backing_fmt=raw /opt/stack/data/nova/instances/c90a9b99-0985-403b-b4d8-eaa8c2eed88a/disk 1073741824 {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:42:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-3be0cccc-6a13-42da-8130-2f4a679ec412 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json" returned: 0 in 0.185s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:42:45 user nova-compute[71509]: DEBUG nova.virt.disk.api [None req-3be0cccc-6a13-42da-8130-2f4a679ec412 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Checking if we can resize image /opt/stack/data/nova/instances/97f20661-8b60-439e-b7af-2fc2013c5ade/disk. size=1073741824 {{(pid=71509) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 10:42:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-3be0cccc-6a13-42da-8130-2f4a679ec412 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97f20661-8b60-439e-b7af-2fc2013c5ade/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:42:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-bacb7aa1-84c2-4be6-9cbe-bd058fb68a99 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18,backing_fmt=raw /opt/stack/data/nova/instances/c90a9b99-0985-403b-b4d8-eaa8c2eed88a/disk 1073741824" returned: 0 in 0.060s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:42:45 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-bacb7aa1-84c2-4be6-9cbe-bd058fb68a99 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Lock "5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.192s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:42:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-bacb7aa1-84c2-4be6-9cbe-bd058fb68a99 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:42:45 user nova-compute[71509]: DEBUG nova.network.neutron [None req-3be0cccc-6a13-42da-8130-2f4a679ec412 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] Successfully created port: 270b85b0-1832-4118-a8b0-ff784587b58a {{(pid=71509) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 10:42:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-3be0cccc-6a13-42da-8130-2f4a679ec412 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97f20661-8b60-439e-b7af-2fc2013c5ade/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:42:45 user nova-compute[71509]: DEBUG nova.virt.disk.api [None req-3be0cccc-6a13-42da-8130-2f4a679ec412 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Cannot resize image /opt/stack/data/nova/instances/97f20661-8b60-439e-b7af-2fc2013c5ade/disk to a smaller size. {{(pid=71509) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 10:42:45 user nova-compute[71509]: DEBUG nova.objects.instance [None req-3be0cccc-6a13-42da-8130-2f4a679ec412 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lazy-loading 'migration_context' on Instance uuid 97f20661-8b60-439e-b7af-2fc2013c5ade {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:42:45 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-3be0cccc-6a13-42da-8130-2f4a679ec412 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] Created local disks {{(pid=71509) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 10:42:45 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-3be0cccc-6a13-42da-8130-2f4a679ec412 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] Ensure instance console log exists: /opt/stack/data/nova/instances/97f20661-8b60-439e-b7af-2fc2013c5ade/console.log {{(pid=71509) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 10:42:45 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-3be0cccc-6a13-42da-8130-2f4a679ec412 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:42:45 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-3be0cccc-6a13-42da-8130-2f4a679ec412 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:42:45 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-3be0cccc-6a13-42da-8130-2f4a679ec412 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:42:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-bacb7aa1-84c2-4be6-9cbe-bd058fb68a99 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json" returned: 0 in 0.152s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:42:45 user nova-compute[71509]: DEBUG nova.virt.disk.api [None req-bacb7aa1-84c2-4be6-9cbe-bd058fb68a99 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c90a9b99-0985-403b-b4d8-eaa8c2eed88a/disk. size=1073741824 {{(pid=71509) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 10:42:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-bacb7aa1-84c2-4be6-9cbe-bd058fb68a99 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c90a9b99-0985-403b-b4d8-eaa8c2eed88a/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:42:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-bacb7aa1-84c2-4be6-9cbe-bd058fb68a99 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c90a9b99-0985-403b-b4d8-eaa8c2eed88a/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:42:45 user nova-compute[71509]: DEBUG nova.virt.disk.api [None req-bacb7aa1-84c2-4be6-9cbe-bd058fb68a99 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Cannot resize image /opt/stack/data/nova/instances/c90a9b99-0985-403b-b4d8-eaa8c2eed88a/disk to a smaller size. {{(pid=71509) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 10:42:45 user nova-compute[71509]: DEBUG nova.objects.instance [None req-bacb7aa1-84c2-4be6-9cbe-bd058fb68a99 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Lazy-loading 'migration_context' on Instance uuid c90a9b99-0985-403b-b4d8-eaa8c2eed88a {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:42:45 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-bacb7aa1-84c2-4be6-9cbe-bd058fb68a99 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] [instance: c90a9b99-0985-403b-b4d8-eaa8c2eed88a] Created local disks {{(pid=71509) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 10:42:45 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-bacb7aa1-84c2-4be6-9cbe-bd058fb68a99 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] [instance: c90a9b99-0985-403b-b4d8-eaa8c2eed88a] Ensure instance console log exists: /opt/stack/data/nova/instances/c90a9b99-0985-403b-b4d8-eaa8c2eed88a/console.log {{(pid=71509) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 10:42:45 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-bacb7aa1-84c2-4be6-9cbe-bd058fb68a99 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:42:45 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-bacb7aa1-84c2-4be6-9cbe-bd058fb68a99 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:42:45 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-bacb7aa1-84c2-4be6-9cbe-bd058fb68a99 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:42:46 user nova-compute[71509]: DEBUG nova.network.neutron [None req-bacb7aa1-84c2-4be6-9cbe-bd058fb68a99 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] [instance: c90a9b99-0985-403b-b4d8-eaa8c2eed88a] Successfully created port: 5bd8d359-958a-4b76-ac87-156c2a2adf35 {{(pid=71509) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 10:42:47 user nova-compute[71509]: DEBUG nova.network.neutron [None req-14e4c3fe-17aa-4621-9843-837801d371a7 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: 97820f17-22d1-4ec3-9721-1edadccc794a] Successfully created port: dea3830d-9f49-4d5e-953b-eec2ee969b02 {{(pid=71509) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 10:42:48 user nova-compute[71509]: DEBUG nova.network.neutron [None req-3be0cccc-6a13-42da-8130-2f4a679ec412 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] Successfully updated port: 270b85b0-1832-4118-a8b0-ff784587b58a {{(pid=71509) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 10:42:48 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-3be0cccc-6a13-42da-8130-2f4a679ec412 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Acquiring lock "refresh_cache-97f20661-8b60-439e-b7af-2fc2013c5ade" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:42:48 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-3be0cccc-6a13-42da-8130-2f4a679ec412 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Acquired lock "refresh_cache-97f20661-8b60-439e-b7af-2fc2013c5ade" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:42:48 user nova-compute[71509]: DEBUG nova.network.neutron [None req-3be0cccc-6a13-42da-8130-2f4a679ec412 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] Building network info cache for instance {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 10:42:48 user nova-compute[71509]: DEBUG nova.network.neutron [None req-3be0cccc-6a13-42da-8130-2f4a679ec412 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] Instance cache missing network info. {{(pid=71509) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 10:42:48 user nova-compute[71509]: DEBUG nova.compute.manager [req-304899f8-bc73-4897-9b07-2ce7dda54a68 req-f07312cc-0228-4bf2-b191-a93f5d6dbe43 service nova] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] Received event network-changed-270b85b0-1832-4118-a8b0-ff784587b58a {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:42:48 user nova-compute[71509]: DEBUG nova.compute.manager [req-304899f8-bc73-4897-9b07-2ce7dda54a68 req-f07312cc-0228-4bf2-b191-a93f5d6dbe43 service nova] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] Refreshing instance network info cache due to event network-changed-270b85b0-1832-4118-a8b0-ff784587b58a. {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 10:42:48 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-304899f8-bc73-4897-9b07-2ce7dda54a68 req-f07312cc-0228-4bf2-b191-a93f5d6dbe43 service nova] Acquiring lock "refresh_cache-97f20661-8b60-439e-b7af-2fc2013c5ade" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:42:49 user nova-compute[71509]: DEBUG nova.network.neutron [None req-3be0cccc-6a13-42da-8130-2f4a679ec412 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] Updating instance_info_cache with network_info: [{"id": "270b85b0-1832-4118-a8b0-ff784587b58a", "address": "fa:16:3e:75:ba:ae", "network": {"id": "22eb5f87-be4d-447d-bafe-25e0284ea3ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-787804772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf93e5dac50342d0b65ef09711401e99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap270b85b0-18", "ovs_interfaceid": "270b85b0-1832-4118-a8b0-ff784587b58a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:42:49 user nova-compute[71509]: DEBUG nova.network.neutron [None req-14e4c3fe-17aa-4621-9843-837801d371a7 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: 97820f17-22d1-4ec3-9721-1edadccc794a] Successfully updated port: dea3830d-9f49-4d5e-953b-eec2ee969b02 {{(pid=71509) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 10:42:49 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-3be0cccc-6a13-42da-8130-2f4a679ec412 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Releasing lock "refresh_cache-97f20661-8b60-439e-b7af-2fc2013c5ade" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:42:49 user nova-compute[71509]: DEBUG nova.compute.manager [None req-3be0cccc-6a13-42da-8130-2f4a679ec412 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] Instance network_info: |[{"id": "270b85b0-1832-4118-a8b0-ff784587b58a", "address": "fa:16:3e:75:ba:ae", "network": {"id": "22eb5f87-be4d-447d-bafe-25e0284ea3ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-787804772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf93e5dac50342d0b65ef09711401e99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap270b85b0-18", "ovs_interfaceid": "270b85b0-1832-4118-a8b0-ff784587b58a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71509) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 10:42:49 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-304899f8-bc73-4897-9b07-2ce7dda54a68 req-f07312cc-0228-4bf2-b191-a93f5d6dbe43 service nova] Acquired lock "refresh_cache-97f20661-8b60-439e-b7af-2fc2013c5ade" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:42:49 user nova-compute[71509]: DEBUG nova.network.neutron [req-304899f8-bc73-4897-9b07-2ce7dda54a68 req-f07312cc-0228-4bf2-b191-a93f5d6dbe43 service nova] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] Refreshing network info cache for port 270b85b0-1832-4118-a8b0-ff784587b58a {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 10:42:49 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-3be0cccc-6a13-42da-8130-2f4a679ec412 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] Start _get_guest_xml network_info=[{"id": "270b85b0-1832-4118-a8b0-ff784587b58a", "address": "fa:16:3e:75:ba:ae", "network": {"id": "22eb5f87-be4d-447d-bafe-25e0284ea3ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-787804772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf93e5dac50342d0b65ef09711401e99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap270b85b0-18", "ovs_interfaceid": "270b85b0-1832-4118-a8b0-ff784587b58a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T10:38:55Z,direct_url=<?>,disk_format='qcow2',id=048ec0ee-0465-448d-8b4c-f072acb101dc,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='9742d6ad20cf48d9bab0fdbcc9491db9',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T10:38:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '048ec0ee-0465-448d-8b4c-f072acb101dc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71509) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 10:42:49 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-14e4c3fe-17aa-4621-9843-837801d371a7 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Acquiring lock "refresh_cache-97820f17-22d1-4ec3-9721-1edadccc794a" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:42:49 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-14e4c3fe-17aa-4621-9843-837801d371a7 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Acquired lock "refresh_cache-97820f17-22d1-4ec3-9721-1edadccc794a" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:42:49 user nova-compute[71509]: DEBUG nova.network.neutron [None req-14e4c3fe-17aa-4621-9843-837801d371a7 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: 97820f17-22d1-4ec3-9721-1edadccc794a] Building network info cache for instance {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 10:42:49 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-3be0cccc-6a13-42da-8130-2f4a679ec412 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:42:49 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-3be0cccc-6a13-42da-8130-2f4a679ec412 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:42:49 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-3be0cccc-6a13-42da-8130-2f4a679ec412 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71509) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 10:42:49 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-3be0cccc-6a13-42da-8130-2f4a679ec412 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T10:40:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T10:38:55Z,direct_url=<?>,disk_format='qcow2',id=048ec0ee-0465-448d-8b4c-f072acb101dc,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='9742d6ad20cf48d9bab0fdbcc9491db9',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T10:38:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 10:42:49 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-3be0cccc-6a13-42da-8130-2f4a679ec412 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Flavor limits 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 10:42:49 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-3be0cccc-6a13-42da-8130-2f4a679ec412 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Image limits 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 10:42:49 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-3be0cccc-6a13-42da-8130-2f4a679ec412 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Flavor pref 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 10:42:49 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-3be0cccc-6a13-42da-8130-2f4a679ec412 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Image pref 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 10:42:49 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-3be0cccc-6a13-42da-8130-2f4a679ec412 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 10:42:49 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-3be0cccc-6a13-42da-8130-2f4a679ec412 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 10:42:49 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-3be0cccc-6a13-42da-8130-2f4a679ec412 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71509) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 10:42:49 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-3be0cccc-6a13-42da-8130-2f4a679ec412 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Got 1 possible topologies {{(pid=71509) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 10:42:49 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-3be0cccc-6a13-42da-8130-2f4a679ec412 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 10:42:49 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-3be0cccc-6a13-42da-8130-2f4a679ec412 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 10:42:49 user nova-compute[71509]: DEBUG nova.privsep.utils [None req-3be0cccc-6a13-42da-8130-2f4a679ec412 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71509) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 10:42:49 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-3be0cccc-6a13-42da-8130-2f4a679ec412 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T10:42:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1197292957',display_name='tempest-ServerRescueNegativeTestJSON-server-1197292957',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1197292957',id=2,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bf93e5dac50342d0b65ef09711401e99',ramdisk_id='',reservation_id='r-0zxo4k30',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-563868574',owner_user_name='tempest-ServerRescueNegativeTestJSON-563868574-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T10:42:43Z,user_data=None,user_id='e359578dcbb24755a216415053d415ef',uuid=97f20661-8b60-439e-b7af-2fc2013c5ade,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "270b85b0-1832-4118-a8b0-ff784587b58a", "address": "fa:16:3e:75:ba:ae", "network": {"id": "22eb5f87-be4d-447d-bafe-25e0284ea3ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-787804772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf93e5dac50342d0b65ef09711401e99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap270b85b0-18", "ovs_interfaceid": "270b85b0-1832-4118-a8b0-ff784587b58a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71509) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 10:42:49 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-3be0cccc-6a13-42da-8130-2f4a679ec412 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Converting VIF {"id": "270b85b0-1832-4118-a8b0-ff784587b58a", "address": "fa:16:3e:75:ba:ae", "network": {"id": "22eb5f87-be4d-447d-bafe-25e0284ea3ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-787804772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf93e5dac50342d0b65ef09711401e99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap270b85b0-18", "ovs_interfaceid": "270b85b0-1832-4118-a8b0-ff784587b58a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:42:49 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-3be0cccc-6a13-42da-8130-2f4a679ec412 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:ba:ae,bridge_name='br-int',has_traffic_filtering=True,id=270b85b0-1832-4118-a8b0-ff784587b58a,network=Network(22eb5f87-be4d-447d-bafe-25e0284ea3ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap270b85b0-18') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:42:49 user nova-compute[71509]: DEBUG nova.objects.instance [None req-3be0cccc-6a13-42da-8130-2f4a679ec412 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lazy-loading 'pci_devices' on Instance uuid 97f20661-8b60-439e-b7af-2fc2013c5ade {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:42:49 user nova-compute[71509]: DEBUG nova.network.neutron [None req-bacb7aa1-84c2-4be6-9cbe-bd058fb68a99 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] [instance: c90a9b99-0985-403b-b4d8-eaa8c2eed88a] Successfully updated port: 5bd8d359-958a-4b76-ac87-156c2a2adf35 {{(pid=71509) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 10:42:49 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-3be0cccc-6a13-42da-8130-2f4a679ec412 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] End _get_guest_xml xml=<domain type="kvm">
Apr 14 10:42:49 user nova-compute[71509]:   <uuid>97f20661-8b60-439e-b7af-2fc2013c5ade</uuid>
Apr 14 10:42:49 user nova-compute[71509]:   <name>instance-00000002</name>
Apr 14 10:42:49 user nova-compute[71509]:   <memory>131072</memory>
Apr 14 10:42:49 user nova-compute[71509]:   <vcpu>1</vcpu>
Apr 14 10:42:49 user nova-compute[71509]:   <metadata>
Apr 14 10:42:49 user nova-compute[71509]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 10:42:49 user nova-compute[71509]:       <nova:package version="0.0.0"/>
Apr 14 10:42:49 user nova-compute[71509]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1197292957</nova:name>
Apr 14 10:42:49 user nova-compute[71509]:       <nova:creationTime>2023-04-14 10:42:49</nova:creationTime>
Apr 14 10:42:49 user nova-compute[71509]:       <nova:flavor name="m1.nano">
Apr 14 10:42:49 user nova-compute[71509]:         <nova:memory>128</nova:memory>
Apr 14 10:42:49 user nova-compute[71509]:         <nova:disk>1</nova:disk>
Apr 14 10:42:49 user nova-compute[71509]:         <nova:swap>0</nova:swap>
Apr 14 10:42:49 user nova-compute[71509]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 10:42:49 user nova-compute[71509]:         <nova:vcpus>1</nova:vcpus>
Apr 14 10:42:49 user nova-compute[71509]:       </nova:flavor>
Apr 14 10:42:49 user nova-compute[71509]:       <nova:owner>
Apr 14 10:42:49 user nova-compute[71509]:         <nova:user uuid="e359578dcbb24755a216415053d415ef">tempest-ServerRescueNegativeTestJSON-563868574-project-member</nova:user>
Apr 14 10:42:49 user nova-compute[71509]:         <nova:project uuid="bf93e5dac50342d0b65ef09711401e99">tempest-ServerRescueNegativeTestJSON-563868574</nova:project>
Apr 14 10:42:49 user nova-compute[71509]:       </nova:owner>
Apr 14 10:42:49 user nova-compute[71509]:       <nova:root type="image" uuid="048ec0ee-0465-448d-8b4c-f072acb101dc"/>
Apr 14 10:42:49 user nova-compute[71509]:       <nova:ports>
Apr 14 10:42:49 user nova-compute[71509]:         <nova:port uuid="270b85b0-1832-4118-a8b0-ff784587b58a">
Apr 14 10:42:49 user nova-compute[71509]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 14 10:42:49 user nova-compute[71509]:         </nova:port>
Apr 14 10:42:49 user nova-compute[71509]:       </nova:ports>
Apr 14 10:42:49 user nova-compute[71509]:     </nova:instance>
Apr 14 10:42:49 user nova-compute[71509]:   </metadata>
Apr 14 10:42:49 user nova-compute[71509]:   <sysinfo type="smbios">
Apr 14 10:42:49 user nova-compute[71509]:     <system>
Apr 14 10:42:49 user nova-compute[71509]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 10:42:49 user nova-compute[71509]:       <entry name="product">OpenStack Nova</entry>
Apr 14 10:42:49 user nova-compute[71509]:       <entry name="version">0.0.0</entry>
Apr 14 10:42:49 user nova-compute[71509]:       <entry name="serial">97f20661-8b60-439e-b7af-2fc2013c5ade</entry>
Apr 14 10:42:49 user nova-compute[71509]:       <entry name="uuid">97f20661-8b60-439e-b7af-2fc2013c5ade</entry>
Apr 14 10:42:49 user nova-compute[71509]:       <entry name="family">Virtual Machine</entry>
Apr 14 10:42:49 user nova-compute[71509]:     </system>
Apr 14 10:42:49 user nova-compute[71509]:   </sysinfo>
Apr 14 10:42:49 user nova-compute[71509]:   <os>
Apr 14 10:42:49 user nova-compute[71509]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 10:42:49 user nova-compute[71509]:     <boot dev="hd"/>
Apr 14 10:42:49 user nova-compute[71509]:     <smbios mode="sysinfo"/>
Apr 14 10:42:49 user nova-compute[71509]:   </os>
Apr 14 10:42:49 user nova-compute[71509]:   <features>
Apr 14 10:42:49 user nova-compute[71509]:     <acpi/>
Apr 14 10:42:49 user nova-compute[71509]:     <apic/>
Apr 14 10:42:49 user nova-compute[71509]:     <vmcoreinfo/>
Apr 14 10:42:49 user nova-compute[71509]:   </features>
Apr 14 10:42:49 user nova-compute[71509]:   <clock offset="utc">
Apr 14 10:42:49 user nova-compute[71509]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 10:42:49 user nova-compute[71509]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 10:42:49 user nova-compute[71509]:     <timer name="hpet" present="no"/>
Apr 14 10:42:49 user nova-compute[71509]:   </clock>
Apr 14 10:42:49 user nova-compute[71509]:   <cpu mode="custom" match="exact">
Apr 14 10:42:49 user nova-compute[71509]:     <model>Nehalem</model>
Apr 14 10:42:49 user nova-compute[71509]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 10:42:49 user nova-compute[71509]:   </cpu>
Apr 14 10:42:49 user nova-compute[71509]:   <devices>
Apr 14 10:42:49 user nova-compute[71509]:     <disk type="file" device="disk">
Apr 14 10:42:49 user nova-compute[71509]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 10:42:49 user nova-compute[71509]:       <source file="/opt/stack/data/nova/instances/97f20661-8b60-439e-b7af-2fc2013c5ade/disk"/>
Apr 14 10:42:49 user nova-compute[71509]:       <target dev="vda" bus="virtio"/>
Apr 14 10:42:49 user nova-compute[71509]:     </disk>
Apr 14 10:42:49 user nova-compute[71509]:     <interface type="ethernet">
Apr 14 10:42:49 user nova-compute[71509]:       <mac address="fa:16:3e:75:ba:ae"/>
Apr 14 10:42:49 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 10:42:49 user nova-compute[71509]:       <mtu size="1442"/>
Apr 14 10:42:49 user nova-compute[71509]:       <target dev="tap270b85b0-18"/>
Apr 14 10:42:49 user nova-compute[71509]:     </interface>
Apr 14 10:42:49 user nova-compute[71509]:     <serial type="pty">
Apr 14 10:42:49 user nova-compute[71509]:       <log file="/opt/stack/data/nova/instances/97f20661-8b60-439e-b7af-2fc2013c5ade/console.log" append="off"/>
Apr 14 10:42:49 user nova-compute[71509]:     </serial>
Apr 14 10:42:49 user nova-compute[71509]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 10:42:49 user nova-compute[71509]:     <video>
Apr 14 10:42:49 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 10:42:49 user nova-compute[71509]:     </video>
Apr 14 10:42:49 user nova-compute[71509]:     <rng model="virtio">
Apr 14 10:42:49 user nova-compute[71509]:       <backend model="random">/dev/urandom</backend>
Apr 14 10:42:49 user nova-compute[71509]:     </rng>
Apr 14 10:42:49 user nova-compute[71509]:     <controller type="usb" index="0" model="none"/>
Apr 14 10:42:49 user nova-compute[71509]:     <memballoon model="virtio">
Apr 14 10:42:49 user nova-compute[71509]:       <stats period="10"/>
Apr 14 10:42:49 user nova-compute[71509]:     </memballoon>
Apr 14 10:42:49 user nova-compute[71509]:   </devices>
Apr 14 10:42:49 user nova-compute[71509]: </domain>
Apr 14 10:42:49 user nova-compute[71509]:  {{(pid=71509) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 10:42:49 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-3be0cccc-6a13-42da-8130-2f4a679ec412 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T10:42:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1197292957',display_name='tempest-ServerRescueNegativeTestJSON-server-1197292957',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1197292957',id=2,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bf93e5dac50342d0b65ef09711401e99',ramdisk_id='',reservation_id='r-0zxo4k30',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-563868574',owner_user_name='tempest-ServerRescueNegativeTestJSON-563868574-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T10:42:43Z,user_data=None,user_id='e359578dcbb24755a216415053d415ef',uuid=97f20661-8b60-439e-b7af-2fc2013c5ade,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "270b85b0-1832-4118-a8b0-ff784587b58a", "address": "fa:16:3e:75:ba:ae", "network": {"id": "22eb5f87-be4d-447d-bafe-25e0284ea3ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-787804772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf93e5dac50342d0b65ef09711401e99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap270b85b0-18", "ovs_interfaceid": "270b85b0-1832-4118-a8b0-ff784587b58a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 10:42:49 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-3be0cccc-6a13-42da-8130-2f4a679ec412 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Converting VIF {"id": "270b85b0-1832-4118-a8b0-ff784587b58a", "address": "fa:16:3e:75:ba:ae", "network": {"id": "22eb5f87-be4d-447d-bafe-25e0284ea3ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-787804772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf93e5dac50342d0b65ef09711401e99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap270b85b0-18", "ovs_interfaceid": "270b85b0-1832-4118-a8b0-ff784587b58a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:42:49 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-3be0cccc-6a13-42da-8130-2f4a679ec412 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:ba:ae,bridge_name='br-int',has_traffic_filtering=True,id=270b85b0-1832-4118-a8b0-ff784587b58a,network=Network(22eb5f87-be4d-447d-bafe-25e0284ea3ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap270b85b0-18') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:42:49 user nova-compute[71509]: DEBUG os_vif [None req-3be0cccc-6a13-42da-8130-2f4a679ec412 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:ba:ae,bridge_name='br-int',has_traffic_filtering=True,id=270b85b0-1832-4118-a8b0-ff784587b58a,network=Network(22eb5f87-be4d-447d-bafe-25e0284ea3ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap270b85b0-18') {{(pid=71509) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 10:42:49 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl [None req-3be0cccc-6a13-42da-8130-2f4a679ec412 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Created schema index Interface.name {{(pid=71509) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 14 10:42:49 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl [None req-3be0cccc-6a13-42da-8130-2f4a679ec412 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Created schema index Port.name {{(pid=71509) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 14 10:42:49 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl [None req-3be0cccc-6a13-42da-8130-2f4a679ec412 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Created schema index Bridge.name {{(pid=71509) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Apr 14 10:42:49 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-3be0cccc-6a13-42da-8130-2f4a679ec412 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=71509) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 10:42:49 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-3be0cccc-6a13-42da-8130-2f4a679ec412 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [POLLOUT] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:42:49 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-3be0cccc-6a13-42da-8130-2f4a679ec412 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71509) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 10:42:49 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-3be0cccc-6a13-42da-8130-2f4a679ec412 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:42:49 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-3be0cccc-6a13-42da-8130-2f4a679ec412 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:42:49 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-3be0cccc-6a13-42da-8130-2f4a679ec412 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:42:49 user nova-compute[71509]: DEBUG nova.network.neutron [None req-14e4c3fe-17aa-4621-9843-837801d371a7 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: 97820f17-22d1-4ec3-9721-1edadccc794a] Instance cache missing network info. {{(pid=71509) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 10:42:49 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:42:49 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:42:49 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 10:42:49 user nova-compute[71509]: INFO oslo.privsep.daemon [None req-3be0cccc-6a13-42da-8130-2f4a679ec412 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpr2rz_t69/privsep.sock']
Apr 14 10:42:49 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-bacb7aa1-84c2-4be6-9cbe-bd058fb68a99 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Acquiring lock "refresh_cache-c90a9b99-0985-403b-b4d8-eaa8c2eed88a" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:42:49 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-bacb7aa1-84c2-4be6-9cbe-bd058fb68a99 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Acquired lock "refresh_cache-c90a9b99-0985-403b-b4d8-eaa8c2eed88a" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:42:49 user nova-compute[71509]: DEBUG nova.network.neutron [None req-bacb7aa1-84c2-4be6-9cbe-bd058fb68a99 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] [instance: c90a9b99-0985-403b-b4d8-eaa8c2eed88a] Building network info cache for instance {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 10:42:49 user nova-compute[71509]: DEBUG nova.compute.manager [req-b2d7d32d-8c09-44ce-957a-5c7922cf9e0f req-6a37201b-e84e-4c73-b76e-71859b58dc42 service nova] [instance: c90a9b99-0985-403b-b4d8-eaa8c2eed88a] Received event network-changed-5bd8d359-958a-4b76-ac87-156c2a2adf35 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:42:49 user nova-compute[71509]: DEBUG nova.compute.manager [req-b2d7d32d-8c09-44ce-957a-5c7922cf9e0f req-6a37201b-e84e-4c73-b76e-71859b58dc42 service nova] [instance: c90a9b99-0985-403b-b4d8-eaa8c2eed88a] Refreshing instance network info cache due to event network-changed-5bd8d359-958a-4b76-ac87-156c2a2adf35. {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 10:42:49 user sudo[80745]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpr2rz_t69/privsep.sock
Apr 14 10:42:49 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-b2d7d32d-8c09-44ce-957a-5c7922cf9e0f req-6a37201b-e84e-4c73-b76e-71859b58dc42 service nova] Acquiring lock "refresh_cache-c90a9b99-0985-403b-b4d8-eaa8c2eed88a" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:42:49 user sudo[80745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Apr 14 10:42:49 user nova-compute[71509]: DEBUG nova.network.neutron [None req-bacb7aa1-84c2-4be6-9cbe-bd058fb68a99 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] [instance: c90a9b99-0985-403b-b4d8-eaa8c2eed88a] Instance cache missing network info. {{(pid=71509) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 10:42:50 user nova-compute[71509]: DEBUG nova.network.neutron [req-304899f8-bc73-4897-9b07-2ce7dda54a68 req-f07312cc-0228-4bf2-b191-a93f5d6dbe43 service nova] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] Updated VIF entry in instance network info cache for port 270b85b0-1832-4118-a8b0-ff784587b58a. {{(pid=71509) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 10:42:50 user nova-compute[71509]: DEBUG nova.network.neutron [req-304899f8-bc73-4897-9b07-2ce7dda54a68 req-f07312cc-0228-4bf2-b191-a93f5d6dbe43 service nova] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] Updating instance_info_cache with network_info: [{"id": "270b85b0-1832-4118-a8b0-ff784587b58a", "address": "fa:16:3e:75:ba:ae", "network": {"id": "22eb5f87-be4d-447d-bafe-25e0284ea3ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-787804772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf93e5dac50342d0b65ef09711401e99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap270b85b0-18", "ovs_interfaceid": "270b85b0-1832-4118-a8b0-ff784587b58a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:42:50 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-304899f8-bc73-4897-9b07-2ce7dda54a68 req-f07312cc-0228-4bf2-b191-a93f5d6dbe43 service nova] Releasing lock "refresh_cache-97f20661-8b60-439e-b7af-2fc2013c5ade" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:42:50 user nova-compute[71509]: DEBUG nova.network.neutron [None req-bacb7aa1-84c2-4be6-9cbe-bd058fb68a99 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] [instance: c90a9b99-0985-403b-b4d8-eaa8c2eed88a] Updating instance_info_cache with network_info: [{"id": "5bd8d359-958a-4b76-ac87-156c2a2adf35", "address": "fa:16:3e:80:f6:9f", "network": {"id": "8034a3f8-0149-4d7b-b457-350a881baafe", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1634360617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30856983340a435d8e92f138fdecaa35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bd8d359-95", "ovs_interfaceid": "5bd8d359-958a-4b76-ac87-156c2a2adf35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:42:50 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-bacb7aa1-84c2-4be6-9cbe-bd058fb68a99 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Releasing lock "refresh_cache-c90a9b99-0985-403b-b4d8-eaa8c2eed88a" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:42:50 user nova-compute[71509]: DEBUG nova.compute.manager [None req-bacb7aa1-84c2-4be6-9cbe-bd058fb68a99 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] [instance: c90a9b99-0985-403b-b4d8-eaa8c2eed88a] Instance network_info: |[{"id": "5bd8d359-958a-4b76-ac87-156c2a2adf35", "address": "fa:16:3e:80:f6:9f", "network": {"id": "8034a3f8-0149-4d7b-b457-350a881baafe", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1634360617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30856983340a435d8e92f138fdecaa35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bd8d359-95", "ovs_interfaceid": "5bd8d359-958a-4b76-ac87-156c2a2adf35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71509) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 10:42:50 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-b2d7d32d-8c09-44ce-957a-5c7922cf9e0f req-6a37201b-e84e-4c73-b76e-71859b58dc42 service nova] Acquired lock "refresh_cache-c90a9b99-0985-403b-b4d8-eaa8c2eed88a" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:42:50 user nova-compute[71509]: DEBUG nova.network.neutron [req-b2d7d32d-8c09-44ce-957a-5c7922cf9e0f req-6a37201b-e84e-4c73-b76e-71859b58dc42 service nova] [instance: c90a9b99-0985-403b-b4d8-eaa8c2eed88a] Refreshing network info cache for port 5bd8d359-958a-4b76-ac87-156c2a2adf35 {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 10:42:50 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-bacb7aa1-84c2-4be6-9cbe-bd058fb68a99 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] [instance: c90a9b99-0985-403b-b4d8-eaa8c2eed88a] Start _get_guest_xml network_info=[{"id": "5bd8d359-958a-4b76-ac87-156c2a2adf35", "address": "fa:16:3e:80:f6:9f", "network": {"id": "8034a3f8-0149-4d7b-b457-350a881baafe", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1634360617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30856983340a435d8e92f138fdecaa35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bd8d359-95", "ovs_interfaceid": "5bd8d359-958a-4b76-ac87-156c2a2adf35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T10:38:55Z,direct_url=<?>,disk_format='qcow2',id=048ec0ee-0465-448d-8b4c-f072acb101dc,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='9742d6ad20cf48d9bab0fdbcc9491db9',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T10:38:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '048ec0ee-0465-448d-8b4c-f072acb101dc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71509) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 10:42:50 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-bacb7aa1-84c2-4be6-9cbe-bd058fb68a99 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:42:50 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-bacb7aa1-84c2-4be6-9cbe-bd058fb68a99 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:42:50 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-bacb7aa1-84c2-4be6-9cbe-bd058fb68a99 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71509) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 10:42:50 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-bacb7aa1-84c2-4be6-9cbe-bd058fb68a99 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T10:40:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T10:38:55Z,direct_url=<?>,disk_format='qcow2',id=048ec0ee-0465-448d-8b4c-f072acb101dc,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='9742d6ad20cf48d9bab0fdbcc9491db9',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T10:38:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 10:42:50 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-bacb7aa1-84c2-4be6-9cbe-bd058fb68a99 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Flavor limits 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 10:42:50 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-bacb7aa1-84c2-4be6-9cbe-bd058fb68a99 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Image limits 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 10:42:50 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-bacb7aa1-84c2-4be6-9cbe-bd058fb68a99 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Flavor pref 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 10:42:50 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-bacb7aa1-84c2-4be6-9cbe-bd058fb68a99 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Image pref 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 10:42:50 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-bacb7aa1-84c2-4be6-9cbe-bd058fb68a99 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 10:42:50 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-bacb7aa1-84c2-4be6-9cbe-bd058fb68a99 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 10:42:50 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-bacb7aa1-84c2-4be6-9cbe-bd058fb68a99 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71509) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 10:42:50 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-bacb7aa1-84c2-4be6-9cbe-bd058fb68a99 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Got 1 possible topologies {{(pid=71509) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 10:42:50 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-bacb7aa1-84c2-4be6-9cbe-bd058fb68a99 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 10:42:50 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-bacb7aa1-84c2-4be6-9cbe-bd058fb68a99 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 10:42:50 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-bacb7aa1-84c2-4be6-9cbe-bd058fb68a99 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T10:42:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1726126636',display_name='tempest-DeleteServersTestJSON-server-1726126636',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1726126636',id=1,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='30856983340a435d8e92f138fdecaa35',ramdisk_id='',reservation_id='r-pt60gqu6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1788928325',owner_user_name='tempest-DeleteServersTestJSON-1788928325-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T10:42:42Z,user_data=None,user_id='0a9842a4c91c4d45b52da0b404fc27c2',uuid=c90a9b99-0985-403b-b4d8-eaa8c2eed88a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5bd8d359-958a-4b76-ac87-156c2a2adf35", "address": "fa:16:3e:80:f6:9f", "network": {"id": "8034a3f8-0149-4d7b-b457-350a881baafe", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1634360617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30856983340a435d8e92f138fdecaa35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bd8d359-95", "ovs_interfaceid": "5bd8d359-958a-4b76-ac87-156c2a2adf35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71509) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 10:42:50 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-bacb7aa1-84c2-4be6-9cbe-bd058fb68a99 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Converting VIF {"id": "5bd8d359-958a-4b76-ac87-156c2a2adf35", "address": "fa:16:3e:80:f6:9f", "network": {"id": "8034a3f8-0149-4d7b-b457-350a881baafe", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1634360617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30856983340a435d8e92f138fdecaa35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bd8d359-95", "ovs_interfaceid": "5bd8d359-958a-4b76-ac87-156c2a2adf35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:42:50 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-bacb7aa1-84c2-4be6-9cbe-bd058fb68a99 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:f6:9f,bridge_name='br-int',has_traffic_filtering=True,id=5bd8d359-958a-4b76-ac87-156c2a2adf35,network=Network(8034a3f8-0149-4d7b-b457-350a881baafe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bd8d359-95') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:42:50 user nova-compute[71509]: DEBUG nova.objects.instance [None req-bacb7aa1-84c2-4be6-9cbe-bd058fb68a99 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Lazy-loading 'pci_devices' on Instance uuid c90a9b99-0985-403b-b4d8-eaa8c2eed88a {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:42:50 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-bacb7aa1-84c2-4be6-9cbe-bd058fb68a99 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] [instance: c90a9b99-0985-403b-b4d8-eaa8c2eed88a] End _get_guest_xml xml=<domain type="kvm">
Apr 14 10:42:50 user nova-compute[71509]:   <uuid>c90a9b99-0985-403b-b4d8-eaa8c2eed88a</uuid>
Apr 14 10:42:50 user nova-compute[71509]:   <name>instance-00000001</name>
Apr 14 10:42:50 user nova-compute[71509]:   <memory>131072</memory>
Apr 14 10:42:50 user nova-compute[71509]:   <vcpu>1</vcpu>
Apr 14 10:42:50 user nova-compute[71509]:   <metadata>
Apr 14 10:42:50 user nova-compute[71509]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 10:42:50 user nova-compute[71509]:       <nova:package version="0.0.0"/>
Apr 14 10:42:50 user nova-compute[71509]:       <nova:name>tempest-DeleteServersTestJSON-server-1726126636</nova:name>
Apr 14 10:42:50 user nova-compute[71509]:       <nova:creationTime>2023-04-14 10:42:50</nova:creationTime>
Apr 14 10:42:50 user nova-compute[71509]:       <nova:flavor name="m1.nano">
Apr 14 10:42:50 user nova-compute[71509]:         <nova:memory>128</nova:memory>
Apr 14 10:42:50 user nova-compute[71509]:         <nova:disk>1</nova:disk>
Apr 14 10:42:50 user nova-compute[71509]:         <nova:swap>0</nova:swap>
Apr 14 10:42:50 user nova-compute[71509]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 10:42:50 user nova-compute[71509]:         <nova:vcpus>1</nova:vcpus>
Apr 14 10:42:50 user nova-compute[71509]:       </nova:flavor>
Apr 14 10:42:50 user nova-compute[71509]:       <nova:owner>
Apr 14 10:42:50 user nova-compute[71509]:         <nova:user uuid="0a9842a4c91c4d45b52da0b404fc27c2">tempest-DeleteServersTestJSON-1788928325-project-member</nova:user>
Apr 14 10:42:50 user nova-compute[71509]:         <nova:project uuid="30856983340a435d8e92f138fdecaa35">tempest-DeleteServersTestJSON-1788928325</nova:project>
Apr 14 10:42:50 user nova-compute[71509]:       </nova:owner>
Apr 14 10:42:50 user nova-compute[71509]:       <nova:root type="image" uuid="048ec0ee-0465-448d-8b4c-f072acb101dc"/>
Apr 14 10:42:50 user nova-compute[71509]:       <nova:ports>
Apr 14 10:42:50 user nova-compute[71509]:         <nova:port uuid="5bd8d359-958a-4b76-ac87-156c2a2adf35">
Apr 14 10:42:50 user nova-compute[71509]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 14 10:42:50 user nova-compute[71509]:         </nova:port>
Apr 14 10:42:50 user nova-compute[71509]:       </nova:ports>
Apr 14 10:42:50 user nova-compute[71509]:     </nova:instance>
Apr 14 10:42:50 user nova-compute[71509]:   </metadata>
Apr 14 10:42:50 user nova-compute[71509]:   <sysinfo type="smbios">
Apr 14 10:42:50 user nova-compute[71509]:     <system>
Apr 14 10:42:50 user nova-compute[71509]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 10:42:50 user nova-compute[71509]:       <entry name="product">OpenStack Nova</entry>
Apr 14 10:42:50 user nova-compute[71509]:       <entry name="version">0.0.0</entry>
Apr 14 10:42:50 user nova-compute[71509]:       <entry name="serial">c90a9b99-0985-403b-b4d8-eaa8c2eed88a</entry>
Apr 14 10:42:50 user nova-compute[71509]:       <entry name="uuid">c90a9b99-0985-403b-b4d8-eaa8c2eed88a</entry>
Apr 14 10:42:50 user nova-compute[71509]:       <entry name="family">Virtual Machine</entry>
Apr 14 10:42:50 user nova-compute[71509]:     </system>
Apr 14 10:42:50 user nova-compute[71509]:   </sysinfo>
Apr 14 10:42:50 user nova-compute[71509]:   <os>
Apr 14 10:42:50 user nova-compute[71509]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 10:42:50 user nova-compute[71509]:     <boot dev="hd"/>
Apr 14 10:42:50 user nova-compute[71509]:     <smbios mode="sysinfo"/>
Apr 14 10:42:50 user nova-compute[71509]:   </os>
Apr 14 10:42:50 user nova-compute[71509]:   <features>
Apr 14 10:42:50 user nova-compute[71509]:     <acpi/>
Apr 14 10:42:50 user nova-compute[71509]:     <apic/>
Apr 14 10:42:50 user nova-compute[71509]:     <vmcoreinfo/>
Apr 14 10:42:50 user nova-compute[71509]:   </features>
Apr 14 10:42:50 user nova-compute[71509]:   <clock offset="utc">
Apr 14 10:42:50 user nova-compute[71509]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 10:42:50 user nova-compute[71509]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 10:42:50 user nova-compute[71509]:     <timer name="hpet" present="no"/>
Apr 14 10:42:50 user nova-compute[71509]:   </clock>
Apr 14 10:42:50 user nova-compute[71509]:   <cpu mode="custom" match="exact">
Apr 14 10:42:50 user nova-compute[71509]:     <model>Nehalem</model>
Apr 14 10:42:50 user nova-compute[71509]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 10:42:50 user nova-compute[71509]:   </cpu>
Apr 14 10:42:50 user nova-compute[71509]:   <devices>
Apr 14 10:42:50 user nova-compute[71509]:     <disk type="file" device="disk">
Apr 14 10:42:50 user nova-compute[71509]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 10:42:50 user nova-compute[71509]:       <source file="/opt/stack/data/nova/instances/c90a9b99-0985-403b-b4d8-eaa8c2eed88a/disk"/>
Apr 14 10:42:50 user nova-compute[71509]:       <target dev="vda" bus="virtio"/>
Apr 14 10:42:50 user nova-compute[71509]:     </disk>
Apr 14 10:42:50 user nova-compute[71509]:     <interface type="ethernet">
Apr 14 10:42:50 user nova-compute[71509]:       <mac address="fa:16:3e:80:f6:9f"/>
Apr 14 10:42:50 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 10:42:50 user nova-compute[71509]:       <mtu size="1442"/>
Apr 14 10:42:50 user nova-compute[71509]:       <target dev="tap5bd8d359-95"/>
Apr 14 10:42:50 user nova-compute[71509]:     </interface>
Apr 14 10:42:50 user nova-compute[71509]:     <serial type="pty">
Apr 14 10:42:50 user nova-compute[71509]:       <log file="/opt/stack/data/nova/instances/c90a9b99-0985-403b-b4d8-eaa8c2eed88a/console.log" append="off"/>
Apr 14 10:42:50 user nova-compute[71509]:     </serial>
Apr 14 10:42:50 user nova-compute[71509]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 10:42:50 user nova-compute[71509]:     <video>
Apr 14 10:42:50 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 10:42:50 user nova-compute[71509]:     </video>
Apr 14 10:42:50 user nova-compute[71509]:     <rng model="virtio">
Apr 14 10:42:50 user nova-compute[71509]:       <backend model="random">/dev/urandom</backend>
Apr 14 10:42:50 user nova-compute[71509]:     </rng>
Apr 14 10:42:50 user nova-compute[71509]:     <controller type="usb" index="0" model="none"/>
Apr 14 10:42:50 user nova-compute[71509]:     <memballoon model="virtio">
Apr 14 10:42:50 user nova-compute[71509]:       <stats period="10"/>
Apr 14 10:42:50 user nova-compute[71509]:     </memballoon>
Apr 14 10:42:50 user nova-compute[71509]:   </devices>
Apr 14 10:42:50 user nova-compute[71509]: </domain>
Apr 14 10:42:50 user nova-compute[71509]:  {{(pid=71509) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 10:42:50 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-bacb7aa1-84c2-4be6-9cbe-bd058fb68a99 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T10:42:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1726126636',display_name='tempest-DeleteServersTestJSON-server-1726126636',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1726126636',id=1,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='30856983340a435d8e92f138fdecaa35',ramdisk_id='',reservation_id='r-pt60gqu6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1788928325',owner_user_name='tempest-DeleteServersTestJSON-1788928325-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T10:42:42Z,user_data=None,user_id='0a9842a4c91c4d45b52da0b404fc27c2',uuid=c90a9b99-0985-403b-b4d8-eaa8c2eed88a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5bd8d359-958a-4b76-ac87-156c2a2adf35", "address": "fa:16:3e:80:f6:9f", "network": {"id": "8034a3f8-0149-4d7b-b457-350a881baafe", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1634360617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30856983340a435d8e92f138fdecaa35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bd8d359-95", "ovs_interfaceid": "5bd8d359-958a-4b76-ac87-156c2a2adf35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 10:42:50 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-bacb7aa1-84c2-4be6-9cbe-bd058fb68a99 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Converting VIF {"id": "5bd8d359-958a-4b76-ac87-156c2a2adf35", "address": "fa:16:3e:80:f6:9f", "network": {"id": "8034a3f8-0149-4d7b-b457-350a881baafe", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1634360617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30856983340a435d8e92f138fdecaa35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bd8d359-95", "ovs_interfaceid": "5bd8d359-958a-4b76-ac87-156c2a2adf35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:42:50 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-bacb7aa1-84c2-4be6-9cbe-bd058fb68a99 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:f6:9f,bridge_name='br-int',has_traffic_filtering=True,id=5bd8d359-958a-4b76-ac87-156c2a2adf35,network=Network(8034a3f8-0149-4d7b-b457-350a881baafe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bd8d359-95') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:42:50 user nova-compute[71509]: DEBUG os_vif [None req-bacb7aa1-84c2-4be6-9cbe-bd058fb68a99 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:f6:9f,bridge_name='br-int',has_traffic_filtering=True,id=5bd8d359-958a-4b76-ac87-156c2a2adf35,network=Network(8034a3f8-0149-4d7b-b457-350a881baafe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bd8d359-95') {{(pid=71509) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 10:42:50 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:42:50 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:42:50 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 10:42:50 user nova-compute[71509]: DEBUG nova.compute.manager [req-1699522a-9329-4f4b-b6ba-c980c6a42bb1 req-aa719403-1320-4aad-b80f-b403f8b09142 service nova] [instance: 97820f17-22d1-4ec3-9721-1edadccc794a] Received event network-changed-dea3830d-9f49-4d5e-953b-eec2ee969b02 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:42:50 user nova-compute[71509]: DEBUG nova.compute.manager [req-1699522a-9329-4f4b-b6ba-c980c6a42bb1 req-aa719403-1320-4aad-b80f-b403f8b09142 service nova] [instance: 97820f17-22d1-4ec3-9721-1edadccc794a] Refreshing instance network info cache due to event network-changed-dea3830d-9f49-4d5e-953b-eec2ee969b02. {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 10:42:50 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-1699522a-9329-4f4b-b6ba-c980c6a42bb1 req-aa719403-1320-4aad-b80f-b403f8b09142 service nova] Acquiring lock "refresh_cache-97820f17-22d1-4ec3-9721-1edadccc794a" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:42:50 user nova-compute[71509]: DEBUG nova.network.neutron [req-b2d7d32d-8c09-44ce-957a-5c7922cf9e0f req-6a37201b-e84e-4c73-b76e-71859b58dc42 service nova] [instance: c90a9b99-0985-403b-b4d8-eaa8c2eed88a] Updated VIF entry in instance network info cache for port 5bd8d359-958a-4b76-ac87-156c2a2adf35. {{(pid=71509) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 10:42:50 user nova-compute[71509]: DEBUG nova.network.neutron [req-b2d7d32d-8c09-44ce-957a-5c7922cf9e0f req-6a37201b-e84e-4c73-b76e-71859b58dc42 service nova] [instance: c90a9b99-0985-403b-b4d8-eaa8c2eed88a] Updating instance_info_cache with network_info: [{"id": "5bd8d359-958a-4b76-ac87-156c2a2adf35", "address": "fa:16:3e:80:f6:9f", "network": {"id": "8034a3f8-0149-4d7b-b457-350a881baafe", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1634360617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30856983340a435d8e92f138fdecaa35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bd8d359-95", "ovs_interfaceid": "5bd8d359-958a-4b76-ac87-156c2a2adf35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:42:50 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-b2d7d32d-8c09-44ce-957a-5c7922cf9e0f req-6a37201b-e84e-4c73-b76e-71859b58dc42 service nova] Releasing lock "refresh_cache-c90a9b99-0985-403b-b4d8-eaa8c2eed88a" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:42:50 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1aced80d-dd6f-4096-8915-3a33bab89a2f tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "b4abb549-8f36-40c5-971f-8accbb14ff86" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:42:50 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1aced80d-dd6f-4096-8915-3a33bab89a2f tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "b4abb549-8f36-40c5-971f-8accbb14ff86" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:42:50 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1aced80d-dd6f-4096-8915-3a33bab89a2f tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Starting instance... {{(pid=71509) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 10:42:50 user nova-compute[71509]: DEBUG nova.network.neutron [None req-14e4c3fe-17aa-4621-9843-837801d371a7 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: 97820f17-22d1-4ec3-9721-1edadccc794a] Updating instance_info_cache with network_info: [{"id": "dea3830d-9f49-4d5e-953b-eec2ee969b02", "address": "fa:16:3e:77:58:9a", "network": {"id": "22eb5f87-be4d-447d-bafe-25e0284ea3ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-787804772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf93e5dac50342d0b65ef09711401e99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdea3830d-9f", "ovs_interfaceid": "dea3830d-9f49-4d5e-953b-eec2ee969b02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:42:50 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-14e4c3fe-17aa-4621-9843-837801d371a7 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Releasing lock "refresh_cache-97820f17-22d1-4ec3-9721-1edadccc794a" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:42:50 user nova-compute[71509]: DEBUG nova.compute.manager [None req-14e4c3fe-17aa-4621-9843-837801d371a7 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: 97820f17-22d1-4ec3-9721-1edadccc794a] Instance network_info: |[{"id": "dea3830d-9f49-4d5e-953b-eec2ee969b02", "address": "fa:16:3e:77:58:9a", "network": {"id": "22eb5f87-be4d-447d-bafe-25e0284ea3ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-787804772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf93e5dac50342d0b65ef09711401e99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdea3830d-9f", "ovs_interfaceid": "dea3830d-9f49-4d5e-953b-eec2ee969b02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71509) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 10:42:50 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-1699522a-9329-4f4b-b6ba-c980c6a42bb1 req-aa719403-1320-4aad-b80f-b403f8b09142 service nova] Acquired lock "refresh_cache-97820f17-22d1-4ec3-9721-1edadccc794a" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:42:50 user nova-compute[71509]: DEBUG nova.network.neutron [req-1699522a-9329-4f4b-b6ba-c980c6a42bb1 req-aa719403-1320-4aad-b80f-b403f8b09142 service nova] [instance: 97820f17-22d1-4ec3-9721-1edadccc794a] Refreshing network info cache for port dea3830d-9f49-4d5e-953b-eec2ee969b02 {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 10:42:50 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-14e4c3fe-17aa-4621-9843-837801d371a7 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: 97820f17-22d1-4ec3-9721-1edadccc794a] Start _get_guest_xml network_info=[{"id": "dea3830d-9f49-4d5e-953b-eec2ee969b02", "address": "fa:16:3e:77:58:9a", "network": {"id": "22eb5f87-be4d-447d-bafe-25e0284ea3ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-787804772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf93e5dac50342d0b65ef09711401e99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdea3830d-9f", "ovs_interfaceid": "dea3830d-9f49-4d5e-953b-eec2ee969b02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T10:38:55Z,direct_url=<?>,disk_format='qcow2',id=048ec0ee-0465-448d-8b4c-f072acb101dc,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='9742d6ad20cf48d9bab0fdbcc9491db9',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T10:38:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '048ec0ee-0465-448d-8b4c-f072acb101dc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71509) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 10:42:50 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-14e4c3fe-17aa-4621-9843-837801d371a7 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:42:50 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-14e4c3fe-17aa-4621-9843-837801d371a7 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:42:50 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-14e4c3fe-17aa-4621-9843-837801d371a7 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71509) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 10:42:50 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-14e4c3fe-17aa-4621-9843-837801d371a7 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T10:40:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T10:38:55Z,direct_url=<?>,disk_format='qcow2',id=048ec0ee-0465-448d-8b4c-f072acb101dc,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='9742d6ad20cf48d9bab0fdbcc9491db9',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T10:38:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 10:42:50 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-14e4c3fe-17aa-4621-9843-837801d371a7 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Flavor limits 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 10:42:50 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-14e4c3fe-17aa-4621-9843-837801d371a7 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Image limits 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 10:42:50 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-14e4c3fe-17aa-4621-9843-837801d371a7 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Flavor pref 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 10:42:50 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-14e4c3fe-17aa-4621-9843-837801d371a7 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Image pref 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 10:42:50 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-14e4c3fe-17aa-4621-9843-837801d371a7 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 10:42:50 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-14e4c3fe-17aa-4621-9843-837801d371a7 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 10:42:50 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-14e4c3fe-17aa-4621-9843-837801d371a7 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71509) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 10:42:50 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-14e4c3fe-17aa-4621-9843-837801d371a7 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Got 1 possible topologies {{(pid=71509) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 10:42:50 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-14e4c3fe-17aa-4621-9843-837801d371a7 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 10:42:50 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-14e4c3fe-17aa-4621-9843-837801d371a7 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 10:42:51 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-14e4c3fe-17aa-4621-9843-837801d371a7 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T10:42:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-97128358',display_name='tempest-ServerRescueNegativeTestJSON-server-97128358',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-97128358',id=3,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bf93e5dac50342d0b65ef09711401e99',ramdisk_id='',reservation_id='r-1drc6j5k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-563868574',owner_user_name='tempest-ServerRescueNegativeTestJSON-563868574-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T10:42:44Z,user_data=None,user_id='e359578dcbb24755a216415053d415ef',uuid=97820f17-22d1-4ec3-9721-1edadccc794a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dea3830d-9f49-4d5e-953b-eec2ee969b02", "address": "fa:16:3e:77:58:9a", "network": {"id": "22eb5f87-be4d-447d-bafe-25e0284ea3ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-787804772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf93e5dac50342d0b65ef09711401e99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdea3830d-9f", "ovs_interfaceid": "dea3830d-9f49-4d5e-953b-eec2ee969b02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71509) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 10:42:51 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-14e4c3fe-17aa-4621-9843-837801d371a7 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Converting VIF {"id": "dea3830d-9f49-4d5e-953b-eec2ee969b02", "address": "fa:16:3e:77:58:9a", "network": {"id": "22eb5f87-be4d-447d-bafe-25e0284ea3ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-787804772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf93e5dac50342d0b65ef09711401e99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdea3830d-9f", "ovs_interfaceid": "dea3830d-9f49-4d5e-953b-eec2ee969b02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:42:51 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-14e4c3fe-17aa-4621-9843-837801d371a7 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:58:9a,bridge_name='br-int',has_traffic_filtering=True,id=dea3830d-9f49-4d5e-953b-eec2ee969b02,network=Network(22eb5f87-be4d-447d-bafe-25e0284ea3ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdea3830d-9f') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:42:51 user nova-compute[71509]: DEBUG nova.objects.instance [None req-14e4c3fe-17aa-4621-9843-837801d371a7 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lazy-loading 'pci_devices' on Instance uuid 97820f17-22d1-4ec3-9721-1edadccc794a {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:42:51 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-14e4c3fe-17aa-4621-9843-837801d371a7 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: 97820f17-22d1-4ec3-9721-1edadccc794a] End _get_guest_xml xml=<domain type="kvm">
Apr 14 10:42:51 user nova-compute[71509]:   <uuid>97820f17-22d1-4ec3-9721-1edadccc794a</uuid>
Apr 14 10:42:51 user nova-compute[71509]:   <name>instance-00000003</name>
Apr 14 10:42:51 user nova-compute[71509]:   <memory>131072</memory>
Apr 14 10:42:51 user nova-compute[71509]:   <vcpu>1</vcpu>
Apr 14 10:42:51 user nova-compute[71509]:   <metadata>
Apr 14 10:42:51 user nova-compute[71509]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 10:42:51 user nova-compute[71509]:       <nova:package version="0.0.0"/>
Apr 14 10:42:51 user nova-compute[71509]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-97128358</nova:name>
Apr 14 10:42:51 user nova-compute[71509]:       <nova:creationTime>2023-04-14 10:42:50</nova:creationTime>
Apr 14 10:42:51 user nova-compute[71509]:       <nova:flavor name="m1.nano">
Apr 14 10:42:51 user nova-compute[71509]:         <nova:memory>128</nova:memory>
Apr 14 10:42:51 user nova-compute[71509]:         <nova:disk>1</nova:disk>
Apr 14 10:42:51 user nova-compute[71509]:         <nova:swap>0</nova:swap>
Apr 14 10:42:51 user nova-compute[71509]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 10:42:51 user nova-compute[71509]:         <nova:vcpus>1</nova:vcpus>
Apr 14 10:42:51 user nova-compute[71509]:       </nova:flavor>
Apr 14 10:42:51 user nova-compute[71509]:       <nova:owner>
Apr 14 10:42:51 user nova-compute[71509]:         <nova:user uuid="e359578dcbb24755a216415053d415ef">tempest-ServerRescueNegativeTestJSON-563868574-project-member</nova:user>
Apr 14 10:42:51 user nova-compute[71509]:         <nova:project uuid="bf93e5dac50342d0b65ef09711401e99">tempest-ServerRescueNegativeTestJSON-563868574</nova:project>
Apr 14 10:42:51 user nova-compute[71509]:       </nova:owner>
Apr 14 10:42:51 user nova-compute[71509]:       <nova:root type="image" uuid="048ec0ee-0465-448d-8b4c-f072acb101dc"/>
Apr 14 10:42:51 user nova-compute[71509]:       <nova:ports>
Apr 14 10:42:51 user nova-compute[71509]:         <nova:port uuid="dea3830d-9f49-4d5e-953b-eec2ee969b02">
Apr 14 10:42:51 user nova-compute[71509]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 14 10:42:51 user nova-compute[71509]:         </nova:port>
Apr 14 10:42:51 user nova-compute[71509]:       </nova:ports>
Apr 14 10:42:51 user nova-compute[71509]:     </nova:instance>
Apr 14 10:42:51 user nova-compute[71509]:   </metadata>
Apr 14 10:42:51 user nova-compute[71509]:   <sysinfo type="smbios">
Apr 14 10:42:51 user nova-compute[71509]:     <system>
Apr 14 10:42:51 user nova-compute[71509]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 10:42:51 user nova-compute[71509]:       <entry name="product">OpenStack Nova</entry>
Apr 14 10:42:51 user nova-compute[71509]:       <entry name="version">0.0.0</entry>
Apr 14 10:42:51 user nova-compute[71509]:       <entry name="serial">97820f17-22d1-4ec3-9721-1edadccc794a</entry>
Apr 14 10:42:51 user nova-compute[71509]:       <entry name="uuid">97820f17-22d1-4ec3-9721-1edadccc794a</entry>
Apr 14 10:42:51 user nova-compute[71509]:       <entry name="family">Virtual Machine</entry>
Apr 14 10:42:51 user nova-compute[71509]:     </system>
Apr 14 10:42:51 user nova-compute[71509]:   </sysinfo>
Apr 14 10:42:51 user nova-compute[71509]:   <os>
Apr 14 10:42:51 user nova-compute[71509]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 10:42:51 user nova-compute[71509]:     <boot dev="hd"/>
Apr 14 10:42:51 user nova-compute[71509]:     <smbios mode="sysinfo"/>
Apr 14 10:42:51 user nova-compute[71509]:   </os>
Apr 14 10:42:51 user nova-compute[71509]:   <features>
Apr 14 10:42:51 user nova-compute[71509]:     <acpi/>
Apr 14 10:42:51 user nova-compute[71509]:     <apic/>
Apr 14 10:42:51 user nova-compute[71509]:     <vmcoreinfo/>
Apr 14 10:42:51 user nova-compute[71509]:   </features>
Apr 14 10:42:51 user nova-compute[71509]:   <clock offset="utc">
Apr 14 10:42:51 user nova-compute[71509]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 10:42:51 user nova-compute[71509]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 10:42:51 user nova-compute[71509]:     <timer name="hpet" present="no"/>
Apr 14 10:42:51 user nova-compute[71509]:   </clock>
Apr 14 10:42:51 user nova-compute[71509]:   <cpu mode="custom" match="exact">
Apr 14 10:42:51 user nova-compute[71509]:     <model>Nehalem</model>
Apr 14 10:42:51 user nova-compute[71509]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 10:42:51 user nova-compute[71509]:   </cpu>
Apr 14 10:42:51 user nova-compute[71509]:   <devices>
Apr 14 10:42:51 user nova-compute[71509]:     <disk type="file" device="disk">
Apr 14 10:42:51 user nova-compute[71509]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 10:42:51 user nova-compute[71509]:       <source file="/opt/stack/data/nova/instances/97820f17-22d1-4ec3-9721-1edadccc794a/disk"/>
Apr 14 10:42:51 user nova-compute[71509]:       <target dev="vda" bus="virtio"/>
Apr 14 10:42:51 user nova-compute[71509]:     </disk>
Apr 14 10:42:51 user nova-compute[71509]:     <interface type="ethernet">
Apr 14 10:42:51 user nova-compute[71509]:       <mac address="fa:16:3e:77:58:9a"/>
Apr 14 10:42:51 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 10:42:51 user nova-compute[71509]:       <mtu size="1442"/>
Apr 14 10:42:51 user nova-compute[71509]:       <target dev="tapdea3830d-9f"/>
Apr 14 10:42:51 user nova-compute[71509]:     </interface>
Apr 14 10:42:51 user nova-compute[71509]:     <serial type="pty">
Apr 14 10:42:51 user nova-compute[71509]:       <log file="/opt/stack/data/nova/instances/97820f17-22d1-4ec3-9721-1edadccc794a/console.log" append="off"/>
Apr 14 10:42:51 user nova-compute[71509]:     </serial>
Apr 14 10:42:51 user nova-compute[71509]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 10:42:51 user nova-compute[71509]:     <video>
Apr 14 10:42:51 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 10:42:51 user nova-compute[71509]:     </video>
Apr 14 10:42:51 user nova-compute[71509]:     <rng model="virtio">
Apr 14 10:42:51 user nova-compute[71509]:       <backend model="random">/dev/urandom</backend>
Apr 14 10:42:51 user nova-compute[71509]:     </rng>
Apr 14 10:42:51 user nova-compute[71509]:     <controller type="usb" index="0" model="none"/>
Apr 14 10:42:51 user nova-compute[71509]:     <memballoon model="virtio">
Apr 14 10:42:51 user nova-compute[71509]:       <stats period="10"/>
Apr 14 10:42:51 user nova-compute[71509]:     </memballoon>
Apr 14 10:42:51 user nova-compute[71509]:   </devices>
Apr 14 10:42:51 user nova-compute[71509]: </domain>
Apr 14 10:42:51 user nova-compute[71509]:  {{(pid=71509) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 10:42:51 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-14e4c3fe-17aa-4621-9843-837801d371a7 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T10:42:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-97128358',display_name='tempest-ServerRescueNegativeTestJSON-server-97128358',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-97128358',id=3,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bf93e5dac50342d0b65ef09711401e99',ramdisk_id='',reservation_id='r-1drc6j5k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-563868574',owner_user_name='tempest-ServerRescueNegativeTestJSON-563868574-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T10:42:44Z,user_data=None,user_id='e359578dcbb24755a216415053d415ef',uuid=97820f17-22d1-4ec3-9721-1edadccc794a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dea3830d-9f49-4d5e-953b-eec2ee969b02", "address": "fa:16:3e:77:58:9a", "network": {"id": "22eb5f87-be4d-447d-bafe-25e0284ea3ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-787804772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf93e5dac50342d0b65ef09711401e99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdea3830d-9f", "ovs_interfaceid": "dea3830d-9f49-4d5e-953b-eec2ee969b02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 10:42:51 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-14e4c3fe-17aa-4621-9843-837801d371a7 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Converting VIF {"id": "dea3830d-9f49-4d5e-953b-eec2ee969b02", "address": "fa:16:3e:77:58:9a", "network": {"id": "22eb5f87-be4d-447d-bafe-25e0284ea3ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-787804772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf93e5dac50342d0b65ef09711401e99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdea3830d-9f", "ovs_interfaceid": "dea3830d-9f49-4d5e-953b-eec2ee969b02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:42:51 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-14e4c3fe-17aa-4621-9843-837801d371a7 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:58:9a,bridge_name='br-int',has_traffic_filtering=True,id=dea3830d-9f49-4d5e-953b-eec2ee969b02,network=Network(22eb5f87-be4d-447d-bafe-25e0284ea3ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdea3830d-9f') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:42:51 user nova-compute[71509]: DEBUG os_vif [None req-14e4c3fe-17aa-4621-9843-837801d371a7 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:58:9a,bridge_name='br-int',has_traffic_filtering=True,id=dea3830d-9f49-4d5e-953b-eec2ee969b02,network=Network(22eb5f87-be4d-447d-bafe-25e0284ea3ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdea3830d-9f') {{(pid=71509) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 10:42:51 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:42:51 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:42:51 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 10:42:51 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1aced80d-dd6f-4096-8915-3a33bab89a2f tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:42:51 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1aced80d-dd6f-4096-8915-3a33bab89a2f tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:42:51 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-1aced80d-dd6f-4096-8915-3a33bab89a2f tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71509) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 10:42:51 user nova-compute[71509]: INFO nova.compute.claims [None req-1aced80d-dd6f-4096-8915-3a33bab89a2f tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Claim successful on node user
Apr 14 10:42:51 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-1aced80d-dd6f-4096-8915-3a33bab89a2f tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 10:42:51 user nova-compute[71509]: INFO oslo.privsep.daemon [None req-3be0cccc-6a13-42da-8130-2f4a679ec412 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Spawned new privsep daemon via rootwrap
Apr 14 10:42:51 user nova-compute[71509]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 14 10:42:51 user nova-compute[71509]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 14 10:42:51 user nova-compute[71509]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Apr 14 10:42:51 user nova-compute[71509]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 80750
Apr 14 10:42:51 user nova-compute[71509]: WARNING oslo_privsep.priv_context [None req-bacb7aa1-84c2-4be6-9cbe-bd058fb68a99 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] privsep daemon already running
Apr 14 10:42:51 user nova-compute[71509]: WARNING oslo_privsep.priv_context [None req-14e4c3fe-17aa-4621-9843-837801d371a7 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] privsep daemon already running
Apr 14 10:42:51 user sudo[80745]: pam_unix(sudo:session): session closed for user root
Apr 14 10:42:51 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-1aced80d-dd6f-4096-8915-3a33bab89a2f tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 10:42:51 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1aced80d-dd6f-4096-8915-3a33bab89a2f tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.483s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:42:51 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1aced80d-dd6f-4096-8915-3a33bab89a2f tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Start building networks asynchronously for instance. {{(pid=71509) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 10:42:51 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1aced80d-dd6f-4096-8915-3a33bab89a2f tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Allocating IP information in the background. {{(pid=71509) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 10:42:51 user nova-compute[71509]: DEBUG nova.network.neutron [None req-1aced80d-dd6f-4096-8915-3a33bab89a2f tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] allocate_for_instance() {{(pid=71509) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 10:42:51 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-1aced80d-dd6f-4096-8915-3a33bab89a2f tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 10:42:51 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1aced80d-dd6f-4096-8915-3a33bab89a2f tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Start building block device mappings for instance. {{(pid=71509) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 10:42:51 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1aced80d-dd6f-4096-8915-3a33bab89a2f tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Start spawning the instance on the hypervisor. {{(pid=71509) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 10:42:51 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-1aced80d-dd6f-4096-8915-3a33bab89a2f tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Creating instance directory {{(pid=71509) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 10:42:51 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-1aced80d-dd6f-4096-8915-3a33bab89a2f tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Creating image(s)
Apr 14 10:42:51 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1aced80d-dd6f-4096-8915-3a33bab89a2f tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "/opt/stack/data/nova/instances/b4abb549-8f36-40c5-971f-8accbb14ff86/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:42:51 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1aced80d-dd6f-4096-8915-3a33bab89a2f tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "/opt/stack/data/nova/instances/b4abb549-8f36-40c5-971f-8accbb14ff86/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:42:51 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1aced80d-dd6f-4096-8915-3a33bab89a2f tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "/opt/stack/data/nova/instances/b4abb549-8f36-40c5-971f-8accbb14ff86/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:42:51 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1aced80d-dd6f-4096-8915-3a33bab89a2f tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:42:51 user nova-compute[71509]: DEBUG nova.policy [None req-1aced80d-dd6f-4096-8915-3a33bab89a2f tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5873a358bf544691b12cd2979f5e36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea2cb4dfa5b4a52b658efd8f5aefb36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71509) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 10:42:51 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:42:51 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5bd8d359-95, may_exist=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:42:51 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5bd8d359-95, col_values=(('external_ids', {'iface-id': '5bd8d359-958a-4b76-ac87-156c2a2adf35', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:80:f6:9f', 'vm-uuid': 'c90a9b99-0985-403b-b4d8-eaa8c2eed88a'}),)) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:42:51 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:42:51 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 10:42:51 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1aced80d-dd6f-4096-8915-3a33bab89a2f tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json" returned: 0 in 0.158s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:42:51 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1aced80d-dd6f-4096-8915-3a33bab89a2f tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:42:51 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1aced80d-dd6f-4096-8915-3a33bab89a2f tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:42:51 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1aced80d-dd6f-4096-8915-3a33bab89a2f tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:42:52 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:42:52 user nova-compute[71509]: INFO os_vif [None req-bacb7aa1-84c2-4be6-9cbe-bd058fb68a99 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:f6:9f,bridge_name='br-int',has_traffic_filtering=True,id=5bd8d359-958a-4b76-ac87-156c2a2adf35,network=Network(8034a3f8-0149-4d7b-b457-350a881baafe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bd8d359-95')
Apr 14 10:42:52 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:42:52 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdea3830d-9f, may_exist=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:42:52 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdea3830d-9f, col_values=(('external_ids', {'iface-id': 'dea3830d-9f49-4d5e-953b-eec2ee969b02', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:77:58:9a', 'vm-uuid': '97820f17-22d1-4ec3-9721-1edadccc794a'}),)) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:42:52 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:42:52 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 10:42:52 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:42:52 user nova-compute[71509]: INFO os_vif [None req-14e4c3fe-17aa-4621-9843-837801d371a7 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:58:9a,bridge_name='br-int',has_traffic_filtering=True,id=dea3830d-9f49-4d5e-953b-eec2ee969b02,network=Network(22eb5f87-be4d-447d-bafe-25e0284ea3ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdea3830d-9f')
Apr 14 10:42:52 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:42:52 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap270b85b0-18, may_exist=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:42:52 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap270b85b0-18, col_values=(('external_ids', {'iface-id': '270b85b0-1832-4118-a8b0-ff784587b58a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:75:ba:ae', 'vm-uuid': '97f20661-8b60-439e-b7af-2fc2013c5ade'}),)) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:42:52 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:42:52 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 10:42:52 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:42:52 user nova-compute[71509]: INFO os_vif [None req-3be0cccc-6a13-42da-8130-2f4a679ec412 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:ba:ae,bridge_name='br-int',has_traffic_filtering=True,id=270b85b0-1832-4118-a8b0-ff784587b58a,network=Network(22eb5f87-be4d-447d-bafe-25e0284ea3ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap270b85b0-18')
Apr 14 10:42:52 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1aced80d-dd6f-4096-8915-3a33bab89a2f tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json" returned: 0 in 0.159s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:42:52 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1aced80d-dd6f-4096-8915-3a33bab89a2f tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18,backing_fmt=raw /opt/stack/data/nova/instances/b4abb549-8f36-40c5-971f-8accbb14ff86/disk 1073741824 {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:42:52 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1aced80d-dd6f-4096-8915-3a33bab89a2f tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18,backing_fmt=raw /opt/stack/data/nova/instances/b4abb549-8f36-40c5-971f-8accbb14ff86/disk 1073741824" returned: 0 in 0.064s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:42:52 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1aced80d-dd6f-4096-8915-3a33bab89a2f tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.228s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:42:52 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1aced80d-dd6f-4096-8915-3a33bab89a2f tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:42:52 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:42:52 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-bacb7aa1-84c2-4be6-9cbe-bd058fb68a99 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] No BDM found with device name vda, not building metadata. {{(pid=71509) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 10:42:52 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-bacb7aa1-84c2-4be6-9cbe-bd058fb68a99 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] No VIF found with MAC fa:16:3e:80:f6:9f, not building metadata {{(pid=71509) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 10:42:52 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-14e4c3fe-17aa-4621-9843-837801d371a7 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] No BDM found with device name vda, not building metadata. {{(pid=71509) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 10:42:52 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-14e4c3fe-17aa-4621-9843-837801d371a7 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] No VIF found with MAC fa:16:3e:77:58:9a, not building metadata {{(pid=71509) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 10:42:52 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-3be0cccc-6a13-42da-8130-2f4a679ec412 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] No BDM found with device name vda, not building metadata. {{(pid=71509) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 10:42:52 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-3be0cccc-6a13-42da-8130-2f4a679ec412 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] No VIF found with MAC fa:16:3e:75:ba:ae, not building metadata {{(pid=71509) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 10:42:52 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1aced80d-dd6f-4096-8915-3a33bab89a2f tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json" returned: 0 in 0.139s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:42:52 user nova-compute[71509]: DEBUG nova.virt.disk.api [None req-1aced80d-dd6f-4096-8915-3a33bab89a2f tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b4abb549-8f36-40c5-971f-8accbb14ff86/disk. size=1073741824 {{(pid=71509) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 10:42:52 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1aced80d-dd6f-4096-8915-3a33bab89a2f tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4abb549-8f36-40c5-971f-8accbb14ff86/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:42:52 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:42:52 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1aced80d-dd6f-4096-8915-3a33bab89a2f tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4abb549-8f36-40c5-971f-8accbb14ff86/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:42:52 user nova-compute[71509]: DEBUG nova.virt.disk.api [None req-1aced80d-dd6f-4096-8915-3a33bab89a2f tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Cannot resize image /opt/stack/data/nova/instances/b4abb549-8f36-40c5-971f-8accbb14ff86/disk to a smaller size. {{(pid=71509) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 10:42:52 user nova-compute[71509]: DEBUG nova.objects.instance [None req-1aced80d-dd6f-4096-8915-3a33bab89a2f tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lazy-loading 'migration_context' on Instance uuid b4abb549-8f36-40c5-971f-8accbb14ff86 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:42:52 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-1aced80d-dd6f-4096-8915-3a33bab89a2f tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Created local disks {{(pid=71509) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 10:42:52 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-1aced80d-dd6f-4096-8915-3a33bab89a2f tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Ensure instance console log exists: /opt/stack/data/nova/instances/b4abb549-8f36-40c5-971f-8accbb14ff86/console.log {{(pid=71509) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 10:42:52 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1aced80d-dd6f-4096-8915-3a33bab89a2f tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:42:52 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1aced80d-dd6f-4096-8915-3a33bab89a2f tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:42:52 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1aced80d-dd6f-4096-8915-3a33bab89a2f tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:42:52 user nova-compute[71509]: DEBUG nova.network.neutron [req-1699522a-9329-4f4b-b6ba-c980c6a42bb1 req-aa719403-1320-4aad-b80f-b403f8b09142 service nova] [instance: 97820f17-22d1-4ec3-9721-1edadccc794a] Updated VIF entry in instance network info cache for port dea3830d-9f49-4d5e-953b-eec2ee969b02. {{(pid=71509) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 10:42:52 user nova-compute[71509]: DEBUG nova.network.neutron [req-1699522a-9329-4f4b-b6ba-c980c6a42bb1 req-aa719403-1320-4aad-b80f-b403f8b09142 service nova] [instance: 97820f17-22d1-4ec3-9721-1edadccc794a] Updating instance_info_cache with network_info: [{"id": "dea3830d-9f49-4d5e-953b-eec2ee969b02", "address": "fa:16:3e:77:58:9a", "network": {"id": "22eb5f87-be4d-447d-bafe-25e0284ea3ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-787804772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf93e5dac50342d0b65ef09711401e99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdea3830d-9f", "ovs_interfaceid": "dea3830d-9f49-4d5e-953b-eec2ee969b02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:42:53 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-1699522a-9329-4f4b-b6ba-c980c6a42bb1 req-aa719403-1320-4aad-b80f-b403f8b09142 service nova] Releasing lock "refresh_cache-97820f17-22d1-4ec3-9721-1edadccc794a" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:42:53 user nova-compute[71509]: DEBUG nova.network.neutron [None req-1aced80d-dd6f-4096-8915-3a33bab89a2f tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Successfully created port: 608a2408-02df-474f-9006-260c8c97def1 {{(pid=71509) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 10:42:53 user nova-compute[71509]: DEBUG nova.network.neutron [None req-1aced80d-dd6f-4096-8915-3a33bab89a2f tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Successfully updated port: 608a2408-02df-474f-9006-260c8c97def1 {{(pid=71509) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 10:42:53 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1aced80d-dd6f-4096-8915-3a33bab89a2f tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "refresh_cache-b4abb549-8f36-40c5-971f-8accbb14ff86" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:42:53 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1aced80d-dd6f-4096-8915-3a33bab89a2f tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquired lock "refresh_cache-b4abb549-8f36-40c5-971f-8accbb14ff86" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:42:53 user nova-compute[71509]: DEBUG nova.network.neutron [None req-1aced80d-dd6f-4096-8915-3a33bab89a2f tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Building network info cache for instance {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 10:42:53 user nova-compute[71509]: DEBUG nova.compute.manager [req-67cb2089-75ce-4be7-b47b-c0adb0dc357c req-9dead13e-da4f-43c1-85b2-755bce71465d service nova] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Received event network-changed-608a2408-02df-474f-9006-260c8c97def1 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:42:53 user nova-compute[71509]: DEBUG nova.compute.manager [req-67cb2089-75ce-4be7-b47b-c0adb0dc357c req-9dead13e-da4f-43c1-85b2-755bce71465d service nova] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Refreshing instance network info cache due to event network-changed-608a2408-02df-474f-9006-260c8c97def1. {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 10:42:53 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-67cb2089-75ce-4be7-b47b-c0adb0dc357c req-9dead13e-da4f-43c1-85b2-755bce71465d service nova] Acquiring lock "refresh_cache-b4abb549-8f36-40c5-971f-8accbb14ff86" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:42:53 user nova-compute[71509]: DEBUG nova.network.neutron [None req-1aced80d-dd6f-4096-8915-3a33bab89a2f tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Instance cache missing network info. {{(pid=71509) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 10:42:54 user nova-compute[71509]: DEBUG nova.network.neutron [None req-1aced80d-dd6f-4096-8915-3a33bab89a2f tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Updating instance_info_cache with network_info: [{"id": "608a2408-02df-474f-9006-260c8c97def1", "address": "fa:16:3e:e4:f7:87", "network": {"id": "18a91434-637b-4c19-a97b-736b32c1ea5a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1824162811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea2cb4dfa5b4a52b658efd8f5aefb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap608a2408-02", "ovs_interfaceid": "608a2408-02df-474f-9006-260c8c97def1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:42:54 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1aced80d-dd6f-4096-8915-3a33bab89a2f tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Releasing lock "refresh_cache-b4abb549-8f36-40c5-971f-8accbb14ff86" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:42:54 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1aced80d-dd6f-4096-8915-3a33bab89a2f tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Instance network_info: |[{"id": "608a2408-02df-474f-9006-260c8c97def1", "address": "fa:16:3e:e4:f7:87", "network": {"id": "18a91434-637b-4c19-a97b-736b32c1ea5a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1824162811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea2cb4dfa5b4a52b658efd8f5aefb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap608a2408-02", "ovs_interfaceid": "608a2408-02df-474f-9006-260c8c97def1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71509) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 10:42:54 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-67cb2089-75ce-4be7-b47b-c0adb0dc357c req-9dead13e-da4f-43c1-85b2-755bce71465d service nova] Acquired lock "refresh_cache-b4abb549-8f36-40c5-971f-8accbb14ff86" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:42:54 user nova-compute[71509]: DEBUG nova.network.neutron [req-67cb2089-75ce-4be7-b47b-c0adb0dc357c req-9dead13e-da4f-43c1-85b2-755bce71465d service nova] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Refreshing network info cache for port 608a2408-02df-474f-9006-260c8c97def1 {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 10:42:54 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-1aced80d-dd6f-4096-8915-3a33bab89a2f tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Start _get_guest_xml network_info=[{"id": "608a2408-02df-474f-9006-260c8c97def1", "address": "fa:16:3e:e4:f7:87", "network": {"id": "18a91434-637b-4c19-a97b-736b32c1ea5a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1824162811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea2cb4dfa5b4a52b658efd8f5aefb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap608a2408-02", "ovs_interfaceid": "608a2408-02df-474f-9006-260c8c97def1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T10:38:55Z,direct_url=<?>,disk_format='qcow2',id=048ec0ee-0465-448d-8b4c-f072acb101dc,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='9742d6ad20cf48d9bab0fdbcc9491db9',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T10:38:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '048ec0ee-0465-448d-8b4c-f072acb101dc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71509) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 10:42:54 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-1aced80d-dd6f-4096-8915-3a33bab89a2f tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:42:54 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-1aced80d-dd6f-4096-8915-3a33bab89a2f tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:42:54 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-1aced80d-dd6f-4096-8915-3a33bab89a2f tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71509) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 10:42:54 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-1aced80d-dd6f-4096-8915-3a33bab89a2f tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T10:40:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T10:38:55Z,direct_url=<?>,disk_format='qcow2',id=048ec0ee-0465-448d-8b4c-f072acb101dc,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='9742d6ad20cf48d9bab0fdbcc9491db9',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T10:38:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 10:42:54 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-1aced80d-dd6f-4096-8915-3a33bab89a2f tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Flavor limits 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 10:42:54 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-1aced80d-dd6f-4096-8915-3a33bab89a2f tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Image limits 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 10:42:54 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-1aced80d-dd6f-4096-8915-3a33bab89a2f tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Flavor pref 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 10:42:54 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-1aced80d-dd6f-4096-8915-3a33bab89a2f tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Image pref 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 10:42:54 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-1aced80d-dd6f-4096-8915-3a33bab89a2f tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 10:42:54 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-1aced80d-dd6f-4096-8915-3a33bab89a2f tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 10:42:54 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-1aced80d-dd6f-4096-8915-3a33bab89a2f tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71509) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 10:42:54 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-1aced80d-dd6f-4096-8915-3a33bab89a2f tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Got 1 possible topologies {{(pid=71509) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 10:42:54 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-1aced80d-dd6f-4096-8915-3a33bab89a2f tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 10:42:54 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-1aced80d-dd6f-4096-8915-3a33bab89a2f tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 10:42:54 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-1aced80d-dd6f-4096-8915-3a33bab89a2f tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T10:42:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-375061147',display_name='tempest-ServerActionsTestJSON-server-375061147',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-375061147',id=4,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNt/FyD1XXsxB5kJC+SJ1dgkjoXXHkL+KX0Cr5HvI72xTIz+DAtuVRPHeIpMNLt39mbbZ9KAoCJibRQza0Qbd8j8EEoV7QHombhWz2Mdusr+gJ2OYTqrrRzVbjIHACTFWw==',key_name='tempest-keypair-1544270235',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ea2cb4dfa5b4a52b658efd8f5aefb36',ramdisk_id='',reservation_id='r-2qmryidz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-1923052090',owner_user_name='tempest-ServerActionsTestJSON-1923052090-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T10:42:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5873a358bf544691b12cd2979f5e36dc',uuid=b4abb549-8f36-40c5-971f-8accbb14ff86,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "608a2408-02df-474f-9006-260c8c97def1", "address": "fa:16:3e:e4:f7:87", "network": {"id": "18a91434-637b-4c19-a97b-736b32c1ea5a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1824162811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea2cb4dfa5b4a52b658efd8f5aefb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap608a2408-02", "ovs_interfaceid": "608a2408-02df-474f-9006-260c8c97def1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71509) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 10:42:54 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-1aced80d-dd6f-4096-8915-3a33bab89a2f tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Converting VIF {"id": "608a2408-02df-474f-9006-260c8c97def1", "address": "fa:16:3e:e4:f7:87", "network": {"id": "18a91434-637b-4c19-a97b-736b32c1ea5a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1824162811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea2cb4dfa5b4a52b658efd8f5aefb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap608a2408-02", "ovs_interfaceid": "608a2408-02df-474f-9006-260c8c97def1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:42:54 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-1aced80d-dd6f-4096-8915-3a33bab89a2f tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:f7:87,bridge_name='br-int',has_traffic_filtering=True,id=608a2408-02df-474f-9006-260c8c97def1,network=Network(18a91434-637b-4c19-a97b-736b32c1ea5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap608a2408-02') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:42:54 user nova-compute[71509]: DEBUG nova.objects.instance [None req-1aced80d-dd6f-4096-8915-3a33bab89a2f tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lazy-loading 'pci_devices' on Instance uuid b4abb549-8f36-40c5-971f-8accbb14ff86 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:42:54 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-1aced80d-dd6f-4096-8915-3a33bab89a2f tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] End _get_guest_xml xml=<domain type="kvm">
Apr 14 10:42:54 user nova-compute[71509]:   <uuid>b4abb549-8f36-40c5-971f-8accbb14ff86</uuid>
Apr 14 10:42:54 user nova-compute[71509]:   <name>instance-00000004</name>
Apr 14 10:42:54 user nova-compute[71509]:   <memory>131072</memory>
Apr 14 10:42:54 user nova-compute[71509]:   <vcpu>1</vcpu>
Apr 14 10:42:54 user nova-compute[71509]:   <metadata>
Apr 14 10:42:54 user nova-compute[71509]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 10:42:54 user nova-compute[71509]:       <nova:package version="0.0.0"/>
Apr 14 10:42:54 user nova-compute[71509]:       <nova:name>tempest-ServerActionsTestJSON-server-375061147</nova:name>
Apr 14 10:42:54 user nova-compute[71509]:       <nova:creationTime>2023-04-14 10:42:54</nova:creationTime>
Apr 14 10:42:54 user nova-compute[71509]:       <nova:flavor name="m1.nano">
Apr 14 10:42:54 user nova-compute[71509]:         <nova:memory>128</nova:memory>
Apr 14 10:42:54 user nova-compute[71509]:         <nova:disk>1</nova:disk>
Apr 14 10:42:54 user nova-compute[71509]:         <nova:swap>0</nova:swap>
Apr 14 10:42:54 user nova-compute[71509]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 10:42:54 user nova-compute[71509]:         <nova:vcpus>1</nova:vcpus>
Apr 14 10:42:54 user nova-compute[71509]:       </nova:flavor>
Apr 14 10:42:54 user nova-compute[71509]:       <nova:owner>
Apr 14 10:42:54 user nova-compute[71509]:         <nova:user uuid="5873a358bf544691b12cd2979f5e36dc">tempest-ServerActionsTestJSON-1923052090-project-member</nova:user>
Apr 14 10:42:54 user nova-compute[71509]:         <nova:project uuid="3ea2cb4dfa5b4a52b658efd8f5aefb36">tempest-ServerActionsTestJSON-1923052090</nova:project>
Apr 14 10:42:54 user nova-compute[71509]:       </nova:owner>
Apr 14 10:42:54 user nova-compute[71509]:       <nova:root type="image" uuid="048ec0ee-0465-448d-8b4c-f072acb101dc"/>
Apr 14 10:42:54 user nova-compute[71509]:       <nova:ports>
Apr 14 10:42:54 user nova-compute[71509]:         <nova:port uuid="608a2408-02df-474f-9006-260c8c97def1">
Apr 14 10:42:54 user nova-compute[71509]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 14 10:42:54 user nova-compute[71509]:         </nova:port>
Apr 14 10:42:54 user nova-compute[71509]:       </nova:ports>
Apr 14 10:42:54 user nova-compute[71509]:     </nova:instance>
Apr 14 10:42:54 user nova-compute[71509]:   </metadata>
Apr 14 10:42:54 user nova-compute[71509]:   <sysinfo type="smbios">
Apr 14 10:42:54 user nova-compute[71509]:     <system>
Apr 14 10:42:54 user nova-compute[71509]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 10:42:54 user nova-compute[71509]:       <entry name="product">OpenStack Nova</entry>
Apr 14 10:42:54 user nova-compute[71509]:       <entry name="version">0.0.0</entry>
Apr 14 10:42:54 user nova-compute[71509]:       <entry name="serial">b4abb549-8f36-40c5-971f-8accbb14ff86</entry>
Apr 14 10:42:54 user nova-compute[71509]:       <entry name="uuid">b4abb549-8f36-40c5-971f-8accbb14ff86</entry>
Apr 14 10:42:54 user nova-compute[71509]:       <entry name="family">Virtual Machine</entry>
Apr 14 10:42:54 user nova-compute[71509]:     </system>
Apr 14 10:42:54 user nova-compute[71509]:   </sysinfo>
Apr 14 10:42:54 user nova-compute[71509]:   <os>
Apr 14 10:42:54 user nova-compute[71509]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 10:42:54 user nova-compute[71509]:     <boot dev="hd"/>
Apr 14 10:42:54 user nova-compute[71509]:     <smbios mode="sysinfo"/>
Apr 14 10:42:54 user nova-compute[71509]:   </os>
Apr 14 10:42:54 user nova-compute[71509]:   <features>
Apr 14 10:42:54 user nova-compute[71509]:     <acpi/>
Apr 14 10:42:54 user nova-compute[71509]:     <apic/>
Apr 14 10:42:54 user nova-compute[71509]:     <vmcoreinfo/>
Apr 14 10:42:54 user nova-compute[71509]:   </features>
Apr 14 10:42:54 user nova-compute[71509]:   <clock offset="utc">
Apr 14 10:42:54 user nova-compute[71509]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 10:42:54 user nova-compute[71509]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 10:42:54 user nova-compute[71509]:     <timer name="hpet" present="no"/>
Apr 14 10:42:54 user nova-compute[71509]:   </clock>
Apr 14 10:42:54 user nova-compute[71509]:   <cpu mode="custom" match="exact">
Apr 14 10:42:54 user nova-compute[71509]:     <model>Nehalem</model>
Apr 14 10:42:54 user nova-compute[71509]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 10:42:54 user nova-compute[71509]:   </cpu>
Apr 14 10:42:54 user nova-compute[71509]:   <devices>
Apr 14 10:42:54 user nova-compute[71509]:     <disk type="file" device="disk">
Apr 14 10:42:54 user nova-compute[71509]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 10:42:54 user nova-compute[71509]:       <source file="/opt/stack/data/nova/instances/b4abb549-8f36-40c5-971f-8accbb14ff86/disk"/>
Apr 14 10:42:54 user nova-compute[71509]:       <target dev="vda" bus="virtio"/>
Apr 14 10:42:54 user nova-compute[71509]:     </disk>
Apr 14 10:42:54 user nova-compute[71509]:     <interface type="ethernet">
Apr 14 10:42:54 user nova-compute[71509]:       <mac address="fa:16:3e:e4:f7:87"/>
Apr 14 10:42:54 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 10:42:54 user nova-compute[71509]:       <mtu size="1442"/>
Apr 14 10:42:54 user nova-compute[71509]:       <target dev="tap608a2408-02"/>
Apr 14 10:42:54 user nova-compute[71509]:     </interface>
Apr 14 10:42:54 user nova-compute[71509]:     <serial type="pty">
Apr 14 10:42:54 user nova-compute[71509]:       <log file="/opt/stack/data/nova/instances/b4abb549-8f36-40c5-971f-8accbb14ff86/console.log" append="off"/>
Apr 14 10:42:54 user nova-compute[71509]:     </serial>
Apr 14 10:42:54 user nova-compute[71509]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 10:42:54 user nova-compute[71509]:     <video>
Apr 14 10:42:54 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 10:42:54 user nova-compute[71509]:     </video>
Apr 14 10:42:54 user nova-compute[71509]:     <rng model="virtio">
Apr 14 10:42:54 user nova-compute[71509]:       <backend model="random">/dev/urandom</backend>
Apr 14 10:42:54 user nova-compute[71509]:     </rng>
Apr 14 10:42:54 user nova-compute[71509]:     <controller type="usb" index="0" model="none"/>
Apr 14 10:42:54 user nova-compute[71509]:     <memballoon model="virtio">
Apr 14 10:42:54 user nova-compute[71509]:       <stats period="10"/>
Apr 14 10:42:54 user nova-compute[71509]:     </memballoon>
Apr 14 10:42:54 user nova-compute[71509]:   </devices>
Apr 14 10:42:54 user nova-compute[71509]: </domain>
Apr 14 10:42:54 user nova-compute[71509]:  {{(pid=71509) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 10:42:54 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-1aced80d-dd6f-4096-8915-3a33bab89a2f tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T10:42:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-375061147',display_name='tempest-ServerActionsTestJSON-server-375061147',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-375061147',id=4,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNt/FyD1XXsxB5kJC+SJ1dgkjoXXHkL+KX0Cr5HvI72xTIz+DAtuVRPHeIpMNLt39mbbZ9KAoCJibRQza0Qbd8j8EEoV7QHombhWz2Mdusr+gJ2OYTqrrRzVbjIHACTFWw==',key_name='tempest-keypair-1544270235',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ea2cb4dfa5b4a52b658efd8f5aefb36',ramdisk_id='',reservation_id='r-2qmryidz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-1923052090',owner_user_name='tempest-ServerActionsTestJSON-1923052090-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T10:42:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5873a358bf544691b12cd2979f5e36dc',uuid=b4abb549-8f36-40c5-971f-8accbb14ff86,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "608a2408-02df-474f-9006-260c8c97def1", "address": "fa:16:3e:e4:f7:87", "network": {"id": "18a91434-637b-4c19-a97b-736b32c1ea5a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1824162811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea2cb4dfa5b4a52b658efd8f5aefb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap608a2408-02", "ovs_interfaceid": "608a2408-02df-474f-9006-260c8c97def1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 10:42:54 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-1aced80d-dd6f-4096-8915-3a33bab89a2f tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Converting VIF {"id": "608a2408-02df-474f-9006-260c8c97def1", "address": "fa:16:3e:e4:f7:87", "network": {"id": "18a91434-637b-4c19-a97b-736b32c1ea5a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1824162811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea2cb4dfa5b4a52b658efd8f5aefb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap608a2408-02", "ovs_interfaceid": "608a2408-02df-474f-9006-260c8c97def1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:42:54 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-1aced80d-dd6f-4096-8915-3a33bab89a2f tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:f7:87,bridge_name='br-int',has_traffic_filtering=True,id=608a2408-02df-474f-9006-260c8c97def1,network=Network(18a91434-637b-4c19-a97b-736b32c1ea5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap608a2408-02') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:42:54 user nova-compute[71509]: DEBUG os_vif [None req-1aced80d-dd6f-4096-8915-3a33bab89a2f tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:f7:87,bridge_name='br-int',has_traffic_filtering=True,id=608a2408-02df-474f-9006-260c8c97def1,network=Network(18a91434-637b-4c19-a97b-736b32c1ea5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap608a2408-02') {{(pid=71509) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 10:42:54 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:42:54 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:42:54 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 10:42:54 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:42:54 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap608a2408-02, may_exist=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:42:54 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap608a2408-02, col_values=(('external_ids', {'iface-id': '608a2408-02df-474f-9006-260c8c97def1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e4:f7:87', 'vm-uuid': 'b4abb549-8f36-40c5-971f-8accbb14ff86'}),)) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:42:54 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:42:54 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 10:42:54 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:42:54 user nova-compute[71509]: INFO os_vif [None req-1aced80d-dd6f-4096-8915-3a33bab89a2f tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:f7:87,bridge_name='br-int',has_traffic_filtering=True,id=608a2408-02df-474f-9006-260c8c97def1,network=Network(18a91434-637b-4c19-a97b-736b32c1ea5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap608a2408-02')
Apr 14 10:42:54 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-1aced80d-dd6f-4096-8915-3a33bab89a2f tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] No BDM found with device name vda, not building metadata. {{(pid=71509) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 10:42:54 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-1aced80d-dd6f-4096-8915-3a33bab89a2f tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] No VIF found with MAC fa:16:3e:e4:f7:87, not building metadata {{(pid=71509) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 10:42:55 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:42:55 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:42:55 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:42:55 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:42:56 user nova-compute[71509]: DEBUG nova.network.neutron [req-67cb2089-75ce-4be7-b47b-c0adb0dc357c req-9dead13e-da4f-43c1-85b2-755bce71465d service nova] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Updated VIF entry in instance network info cache for port 608a2408-02df-474f-9006-260c8c97def1. {{(pid=71509) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 10:42:56 user nova-compute[71509]: DEBUG nova.network.neutron [req-67cb2089-75ce-4be7-b47b-c0adb0dc357c req-9dead13e-da4f-43c1-85b2-755bce71465d service nova] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Updating instance_info_cache with network_info: [{"id": "608a2408-02df-474f-9006-260c8c97def1", "address": "fa:16:3e:e4:f7:87", "network": {"id": "18a91434-637b-4c19-a97b-736b32c1ea5a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1824162811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea2cb4dfa5b4a52b658efd8f5aefb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap608a2408-02", "ovs_interfaceid": "608a2408-02df-474f-9006-260c8c97def1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:42:56 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-67cb2089-75ce-4be7-b47b-c0adb0dc357c req-9dead13e-da4f-43c1-85b2-755bce71465d service nova] Releasing lock "refresh_cache-b4abb549-8f36-40c5-971f-8accbb14ff86" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:42:56 user nova-compute[71509]: DEBUG nova.compute.manager [req-8aa5f623-e5d5-4ebe-bb9d-921a52240c46 req-c91351a1-d901-4c2c-965f-773cbc27914f service nova] [instance: 97820f17-22d1-4ec3-9721-1edadccc794a] Received event network-vif-plugged-dea3830d-9f49-4d5e-953b-eec2ee969b02 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:42:56 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-8aa5f623-e5d5-4ebe-bb9d-921a52240c46 req-c91351a1-d901-4c2c-965f-773cbc27914f service nova] Acquiring lock "97820f17-22d1-4ec3-9721-1edadccc794a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:42:56 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-8aa5f623-e5d5-4ebe-bb9d-921a52240c46 req-c91351a1-d901-4c2c-965f-773cbc27914f service nova] Lock "97820f17-22d1-4ec3-9721-1edadccc794a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:42:56 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-8aa5f623-e5d5-4ebe-bb9d-921a52240c46 req-c91351a1-d901-4c2c-965f-773cbc27914f service nova] Lock "97820f17-22d1-4ec3-9721-1edadccc794a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:42:56 user nova-compute[71509]: DEBUG nova.compute.manager [req-8aa5f623-e5d5-4ebe-bb9d-921a52240c46 req-c91351a1-d901-4c2c-965f-773cbc27914f service nova] [instance: 97820f17-22d1-4ec3-9721-1edadccc794a] No waiting events found dispatching network-vif-plugged-dea3830d-9f49-4d5e-953b-eec2ee969b02 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:42:56 user nova-compute[71509]: WARNING nova.compute.manager [req-8aa5f623-e5d5-4ebe-bb9d-921a52240c46 req-c91351a1-d901-4c2c-965f-773cbc27914f service nova] [instance: 97820f17-22d1-4ec3-9721-1edadccc794a] Received unexpected event network-vif-plugged-dea3830d-9f49-4d5e-953b-eec2ee969b02 for instance with vm_state building and task_state spawning.
Apr 14 10:42:57 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-fece179e-5af1-40f5-b3e4-e1a228c260a5 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Acquiring lock "0e6c800c-9b35-4e35-969e-c40367056dce" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:42:57 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-fece179e-5af1-40f5-b3e4-e1a228c260a5 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Lock "0e6c800c-9b35-4e35-969e-c40367056dce" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:42:57 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:42:57 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:42:57 user nova-compute[71509]: DEBUG nova.compute.manager [None req-fece179e-5af1-40f5-b3e4-e1a228c260a5 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Starting instance... {{(pid=71509) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 10:42:57 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:42:57 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:42:57 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-fece179e-5af1-40f5-b3e4-e1a228c260a5 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:42:57 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-fece179e-5af1-40f5-b3e4-e1a228c260a5 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:42:57 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-fece179e-5af1-40f5-b3e4-e1a228c260a5 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71509) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 10:42:57 user nova-compute[71509]: INFO nova.compute.claims [None req-fece179e-5af1-40f5-b3e4-e1a228c260a5 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Claim successful on node user
Apr 14 10:42:57 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:42:57 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:42:57 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:42:57 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:42:57 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:42:57 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-fece179e-5af1-40f5-b3e4-e1a228c260a5 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 10:42:57 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-fece179e-5af1-40f5-b3e4-e1a228c260a5 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 10:42:57 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-fece179e-5af1-40f5-b3e4-e1a228c260a5 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.451s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:42:57 user nova-compute[71509]: DEBUG nova.compute.manager [None req-fece179e-5af1-40f5-b3e4-e1a228c260a5 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Start building networks asynchronously for instance. {{(pid=71509) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 10:42:58 user nova-compute[71509]: DEBUG nova.compute.manager [None req-fece179e-5af1-40f5-b3e4-e1a228c260a5 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Allocating IP information in the background. {{(pid=71509) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 10:42:58 user nova-compute[71509]: DEBUG nova.network.neutron [None req-fece179e-5af1-40f5-b3e4-e1a228c260a5 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] allocate_for_instance() {{(pid=71509) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 10:42:58 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-fece179e-5af1-40f5-b3e4-e1a228c260a5 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 10:42:58 user nova-compute[71509]: DEBUG nova.compute.manager [None req-fece179e-5af1-40f5-b3e4-e1a228c260a5 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Start building block device mappings for instance. {{(pid=71509) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 10:42:58 user nova-compute[71509]: DEBUG nova.compute.manager [None req-fece179e-5af1-40f5-b3e4-e1a228c260a5 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Start spawning the instance on the hypervisor. {{(pid=71509) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 10:42:58 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-fece179e-5af1-40f5-b3e4-e1a228c260a5 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Creating instance directory {{(pid=71509) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 10:42:58 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-fece179e-5af1-40f5-b3e4-e1a228c260a5 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Creating image(s)
Apr 14 10:42:58 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-fece179e-5af1-40f5-b3e4-e1a228c260a5 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Acquiring lock "/opt/stack/data/nova/instances/0e6c800c-9b35-4e35-969e-c40367056dce/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:42:58 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-fece179e-5af1-40f5-b3e4-e1a228c260a5 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Lock "/opt/stack/data/nova/instances/0e6c800c-9b35-4e35-969e-c40367056dce/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:42:58 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-fece179e-5af1-40f5-b3e4-e1a228c260a5 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Lock "/opt/stack/data/nova/instances/0e6c800c-9b35-4e35-969e-c40367056dce/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:42:58 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-fece179e-5af1-40f5-b3e4-e1a228c260a5 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:42:58 user nova-compute[71509]: DEBUG nova.policy [None req-fece179e-5af1-40f5-b3e4-e1a228c260a5 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7212c3fe50ef465c99a0eefec4cbd753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '482809b9148e408b84b156802a21a225', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71509) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 10:42:58 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-fece179e-5af1-40f5-b3e4-e1a228c260a5 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json" returned: 0 in 0.167s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:42:58 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-fece179e-5af1-40f5-b3e4-e1a228c260a5 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Acquiring lock "5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:42:58 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-fece179e-5af1-40f5-b3e4-e1a228c260a5 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Lock "5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:42:58 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-fece179e-5af1-40f5-b3e4-e1a228c260a5 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:42:58 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-fece179e-5af1-40f5-b3e4-e1a228c260a5 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json" returned: 0 in 0.219s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:42:58 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-fece179e-5af1-40f5-b3e4-e1a228c260a5 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18,backing_fmt=raw /opt/stack/data/nova/instances/0e6c800c-9b35-4e35-969e-c40367056dce/disk 1073741824 {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:42:58 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-fece179e-5af1-40f5-b3e4-e1a228c260a5 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18,backing_fmt=raw /opt/stack/data/nova/instances/0e6c800c-9b35-4e35-969e-c40367056dce/disk 1073741824" returned: 0 in 0.054s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:42:58 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-fece179e-5af1-40f5-b3e4-e1a228c260a5 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Lock "5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.279s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:42:58 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-fece179e-5af1-40f5-b3e4-e1a228c260a5 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:42:58 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-fece179e-5af1-40f5-b3e4-e1a228c260a5 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json" returned: 0 in 0.152s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:42:58 user nova-compute[71509]: DEBUG nova.virt.disk.api [None req-fece179e-5af1-40f5-b3e4-e1a228c260a5 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0e6c800c-9b35-4e35-969e-c40367056dce/disk. size=1073741824 {{(pid=71509) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 10:42:58 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-fece179e-5af1-40f5-b3e4-e1a228c260a5 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e6c800c-9b35-4e35-969e-c40367056dce/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:42:58 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:42:58 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:42:58 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:42:58 user nova-compute[71509]: DEBUG nova.compute.manager [req-9b29b29c-e9ca-4e10-a308-69e3be01fa7d req-2bba7b2e-693e-45b1-b7b9-fa7fc45da120 service nova] [instance: 97820f17-22d1-4ec3-9721-1edadccc794a] Received event network-vif-plugged-dea3830d-9f49-4d5e-953b-eec2ee969b02 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:42:58 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-9b29b29c-e9ca-4e10-a308-69e3be01fa7d req-2bba7b2e-693e-45b1-b7b9-fa7fc45da120 service nova] Acquiring lock "97820f17-22d1-4ec3-9721-1edadccc794a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:42:58 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-9b29b29c-e9ca-4e10-a308-69e3be01fa7d req-2bba7b2e-693e-45b1-b7b9-fa7fc45da120 service nova] Lock "97820f17-22d1-4ec3-9721-1edadccc794a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:42:58 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-9b29b29c-e9ca-4e10-a308-69e3be01fa7d req-2bba7b2e-693e-45b1-b7b9-fa7fc45da120 service nova] Lock "97820f17-22d1-4ec3-9721-1edadccc794a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:42:58 user nova-compute[71509]: DEBUG nova.compute.manager [req-9b29b29c-e9ca-4e10-a308-69e3be01fa7d req-2bba7b2e-693e-45b1-b7b9-fa7fc45da120 service nova] [instance: 97820f17-22d1-4ec3-9721-1edadccc794a] No waiting events found dispatching network-vif-plugged-dea3830d-9f49-4d5e-953b-eec2ee969b02 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:42:58 user nova-compute[71509]: WARNING nova.compute.manager [req-9b29b29c-e9ca-4e10-a308-69e3be01fa7d req-2bba7b2e-693e-45b1-b7b9-fa7fc45da120 service nova] [instance: 97820f17-22d1-4ec3-9721-1edadccc794a] Received unexpected event network-vif-plugged-dea3830d-9f49-4d5e-953b-eec2ee969b02 for instance with vm_state building and task_state spawning.
Apr 14 10:42:58 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-fece179e-5af1-40f5-b3e4-e1a228c260a5 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e6c800c-9b35-4e35-969e-c40367056dce/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:42:58 user nova-compute[71509]: DEBUG nova.virt.disk.api [None req-fece179e-5af1-40f5-b3e4-e1a228c260a5 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Cannot resize image /opt/stack/data/nova/instances/0e6c800c-9b35-4e35-969e-c40367056dce/disk to a smaller size. {{(pid=71509) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 10:42:58 user nova-compute[71509]: DEBUG nova.objects.instance [None req-fece179e-5af1-40f5-b3e4-e1a228c260a5 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Lazy-loading 'migration_context' on Instance uuid 0e6c800c-9b35-4e35-969e-c40367056dce {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:42:59 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-fece179e-5af1-40f5-b3e4-e1a228c260a5 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Created local disks {{(pid=71509) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 10:42:59 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-fece179e-5af1-40f5-b3e4-e1a228c260a5 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Ensure instance console log exists: /opt/stack/data/nova/instances/0e6c800c-9b35-4e35-969e-c40367056dce/console.log {{(pid=71509) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 10:42:59 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-fece179e-5af1-40f5-b3e4-e1a228c260a5 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:42:59 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-fece179e-5af1-40f5-b3e4-e1a228c260a5 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:42:59 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-fece179e-5af1-40f5-b3e4-e1a228c260a5 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:42:59 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:42:59 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:43:00 user nova-compute[71509]: DEBUG nova.compute.manager [req-6d793bcd-eb3f-4241-8c87-03bf2d5d3eb5 req-d36224ad-4f04-42c2-805d-315054373e92 service nova] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Received event network-vif-plugged-608a2408-02df-474f-9006-260c8c97def1 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:43:00 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-6d793bcd-eb3f-4241-8c87-03bf2d5d3eb5 req-d36224ad-4f04-42c2-805d-315054373e92 service nova] Acquiring lock "b4abb549-8f36-40c5-971f-8accbb14ff86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:43:00 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-6d793bcd-eb3f-4241-8c87-03bf2d5d3eb5 req-d36224ad-4f04-42c2-805d-315054373e92 service nova] Lock "b4abb549-8f36-40c5-971f-8accbb14ff86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:43:00 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-6d793bcd-eb3f-4241-8c87-03bf2d5d3eb5 req-d36224ad-4f04-42c2-805d-315054373e92 service nova] Lock "b4abb549-8f36-40c5-971f-8accbb14ff86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:43:00 user nova-compute[71509]: DEBUG nova.compute.manager [req-6d793bcd-eb3f-4241-8c87-03bf2d5d3eb5 req-d36224ad-4f04-42c2-805d-315054373e92 service nova] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] No waiting events found dispatching network-vif-plugged-608a2408-02df-474f-9006-260c8c97def1 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:43:00 user nova-compute[71509]: WARNING nova.compute.manager [req-6d793bcd-eb3f-4241-8c87-03bf2d5d3eb5 req-d36224ad-4f04-42c2-805d-315054373e92 service nova] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Received unexpected event network-vif-plugged-608a2408-02df-474f-9006-260c8c97def1 for instance with vm_state building and task_state spawning.
Apr 14 10:43:00 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681468980.187172, 97820f17-22d1-4ec3-9721-1edadccc794a => Resumed> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 10:43:00 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 97820f17-22d1-4ec3-9721-1edadccc794a] VM Resumed (Lifecycle Event)
Apr 14 10:43:00 user nova-compute[71509]: DEBUG nova.compute.manager [None req-14e4c3fe-17aa-4621-9843-837801d371a7 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: 97820f17-22d1-4ec3-9721-1edadccc794a] Instance event wait completed in 0 seconds for  {{(pid=71509) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 10:43:00 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-14e4c3fe-17aa-4621-9843-837801d371a7 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: 97820f17-22d1-4ec3-9721-1edadccc794a] Guest created on hypervisor {{(pid=71509) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 10:43:00 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: 97820f17-22d1-4ec3-9721-1edadccc794a] Instance spawned successfully.
Apr 14 10:43:00 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-14e4c3fe-17aa-4621-9843-837801d371a7 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: 97820f17-22d1-4ec3-9721-1edadccc794a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 10:43:00 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 97820f17-22d1-4ec3-9721-1edadccc794a] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:43:00 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-14e4c3fe-17aa-4621-9843-837801d371a7 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: 97820f17-22d1-4ec3-9721-1edadccc794a] Found default for hw_cdrom_bus of ide {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:43:00 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-14e4c3fe-17aa-4621-9843-837801d371a7 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: 97820f17-22d1-4ec3-9721-1edadccc794a] Found default for hw_disk_bus of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:43:00 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-14e4c3fe-17aa-4621-9843-837801d371a7 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: 97820f17-22d1-4ec3-9721-1edadccc794a] Found default for hw_input_bus of None {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:43:00 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-14e4c3fe-17aa-4621-9843-837801d371a7 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: 97820f17-22d1-4ec3-9721-1edadccc794a] Found default for hw_pointer_model of None {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:43:00 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-14e4c3fe-17aa-4621-9843-837801d371a7 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: 97820f17-22d1-4ec3-9721-1edadccc794a] Found default for hw_video_model of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:43:00 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-14e4c3fe-17aa-4621-9843-837801d371a7 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: 97820f17-22d1-4ec3-9721-1edadccc794a] Found default for hw_vif_model of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:43:00 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 97820f17-22d1-4ec3-9721-1edadccc794a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 10:43:00 user nova-compute[71509]: DEBUG nova.network.neutron [None req-fece179e-5af1-40f5-b3e4-e1a228c260a5 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Successfully created port: 49978689-84ce-4422-add9-9bb12f628c37 {{(pid=71509) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 10:43:00 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 97820f17-22d1-4ec3-9721-1edadccc794a] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 10:43:00 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681468980.1948893, 97820f17-22d1-4ec3-9721-1edadccc794a => Started> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 10:43:00 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 97820f17-22d1-4ec3-9721-1edadccc794a] VM Started (Lifecycle Event)
Apr 14 10:43:00 user nova-compute[71509]: DEBUG nova.compute.manager [None req-3be0cccc-6a13-42da-8130-2f4a679ec412 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] Instance event wait completed in 0 seconds for  {{(pid=71509) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 10:43:00 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-3be0cccc-6a13-42da-8130-2f4a679ec412 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] Guest created on hypervisor {{(pid=71509) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 10:43:00 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] Instance spawned successfully.
Apr 14 10:43:00 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-3be0cccc-6a13-42da-8130-2f4a679ec412 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 10:43:00 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 97820f17-22d1-4ec3-9721-1edadccc794a] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:43:00 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-3be0cccc-6a13-42da-8130-2f4a679ec412 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] Found default for hw_cdrom_bus of ide {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:43:00 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-3be0cccc-6a13-42da-8130-2f4a679ec412 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] Found default for hw_disk_bus of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:43:00 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-3be0cccc-6a13-42da-8130-2f4a679ec412 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] Found default for hw_input_bus of None {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:43:00 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-3be0cccc-6a13-42da-8130-2f4a679ec412 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] Found default for hw_pointer_model of None {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:43:00 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-3be0cccc-6a13-42da-8130-2f4a679ec412 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] Found default for hw_video_model of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:43:00 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-3be0cccc-6a13-42da-8130-2f4a679ec412 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] Found default for hw_vif_model of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:43:00 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 97820f17-22d1-4ec3-9721-1edadccc794a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 10:43:00 user nova-compute[71509]: INFO nova.compute.manager [None req-14e4c3fe-17aa-4621-9843-837801d371a7 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: 97820f17-22d1-4ec3-9721-1edadccc794a] Took 16.46 seconds to spawn the instance on the hypervisor.
Apr 14 10:43:00 user nova-compute[71509]: DEBUG nova.compute.manager [None req-14e4c3fe-17aa-4621-9843-837801d371a7 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: 97820f17-22d1-4ec3-9721-1edadccc794a] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:43:00 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 97820f17-22d1-4ec3-9721-1edadccc794a] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 10:43:00 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681468980.3422577, 97f20661-8b60-439e-b7af-2fc2013c5ade => Resumed> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 10:43:00 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] VM Resumed (Lifecycle Event)
Apr 14 10:43:00 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:43:00 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:43:00 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 10:43:00 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 10:43:00 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681468980.342537, 97f20661-8b60-439e-b7af-2fc2013c5ade => Started> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 10:43:00 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] VM Started (Lifecycle Event)
Apr 14 10:43:00 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:43:00 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 10:43:01 user nova-compute[71509]: INFO nova.compute.manager [None req-14e4c3fe-17aa-4621-9843-837801d371a7 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: 97820f17-22d1-4ec3-9721-1edadccc794a] Took 17.48 seconds to build instance.
Apr 14 10:43:01 user nova-compute[71509]: INFO nova.compute.manager [None req-3be0cccc-6a13-42da-8130-2f4a679ec412 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] Took 18.02 seconds to spawn the instance on the hypervisor.
Apr 14 10:43:01 user nova-compute[71509]: DEBUG nova.compute.manager [None req-3be0cccc-6a13-42da-8130-2f4a679ec412 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:43:01 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 10:43:01 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-14e4c3fe-17aa-4621-9843-837801d371a7 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "97820f17-22d1-4ec3-9721-1edadccc794a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.683s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:43:01 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681468981.1120558, c90a9b99-0985-403b-b4d8-eaa8c2eed88a => Resumed> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 10:43:01 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: c90a9b99-0985-403b-b4d8-eaa8c2eed88a] VM Resumed (Lifecycle Event)
Apr 14 10:43:01 user nova-compute[71509]: DEBUG nova.compute.manager [None req-bacb7aa1-84c2-4be6-9cbe-bd058fb68a99 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] [instance: c90a9b99-0985-403b-b4d8-eaa8c2eed88a] Instance event wait completed in 0 seconds for  {{(pid=71509) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 10:43:01 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-bacb7aa1-84c2-4be6-9cbe-bd058fb68a99 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] [instance: c90a9b99-0985-403b-b4d8-eaa8c2eed88a] Guest created on hypervisor {{(pid=71509) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 10:43:01 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: c90a9b99-0985-403b-b4d8-eaa8c2eed88a] Instance spawned successfully.
Apr 14 10:43:01 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-bacb7aa1-84c2-4be6-9cbe-bd058fb68a99 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] [instance: c90a9b99-0985-403b-b4d8-eaa8c2eed88a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 10:43:01 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: c90a9b99-0985-403b-b4d8-eaa8c2eed88a] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:43:01 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-bacb7aa1-84c2-4be6-9cbe-bd058fb68a99 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] [instance: c90a9b99-0985-403b-b4d8-eaa8c2eed88a] Found default for hw_cdrom_bus of ide {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:43:01 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-bacb7aa1-84c2-4be6-9cbe-bd058fb68a99 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] [instance: c90a9b99-0985-403b-b4d8-eaa8c2eed88a] Found default for hw_disk_bus of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:43:01 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-bacb7aa1-84c2-4be6-9cbe-bd058fb68a99 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] [instance: c90a9b99-0985-403b-b4d8-eaa8c2eed88a] Found default for hw_input_bus of None {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:43:01 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-bacb7aa1-84c2-4be6-9cbe-bd058fb68a99 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] [instance: c90a9b99-0985-403b-b4d8-eaa8c2eed88a] Found default for hw_pointer_model of None {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:43:01 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-bacb7aa1-84c2-4be6-9cbe-bd058fb68a99 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] [instance: c90a9b99-0985-403b-b4d8-eaa8c2eed88a] Found default for hw_video_model of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:43:01 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-bacb7aa1-84c2-4be6-9cbe-bd058fb68a99 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] [instance: c90a9b99-0985-403b-b4d8-eaa8c2eed88a] Found default for hw_vif_model of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:43:01 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: c90a9b99-0985-403b-b4d8-eaa8c2eed88a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 10:43:01 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: c90a9b99-0985-403b-b4d8-eaa8c2eed88a] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 10:43:01 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681468981.1165938, c90a9b99-0985-403b-b4d8-eaa8c2eed88a => Started> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 10:43:01 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: c90a9b99-0985-403b-b4d8-eaa8c2eed88a] VM Started (Lifecycle Event)
Apr 14 10:43:01 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: c90a9b99-0985-403b-b4d8-eaa8c2eed88a] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:43:01 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: c90a9b99-0985-403b-b4d8-eaa8c2eed88a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 10:43:01 user nova-compute[71509]: INFO nova.compute.manager [None req-3be0cccc-6a13-42da-8130-2f4a679ec412 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] Took 19.20 seconds to build instance.
Apr 14 10:43:01 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-3be0cccc-6a13-42da-8130-2f4a679ec412 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "97f20661-8b60-439e-b7af-2fc2013c5ade" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.341s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:43:01 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: c90a9b99-0985-403b-b4d8-eaa8c2eed88a] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 10:43:01 user nova-compute[71509]: INFO nova.compute.manager [None req-bacb7aa1-84c2-4be6-9cbe-bd058fb68a99 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] [instance: c90a9b99-0985-403b-b4d8-eaa8c2eed88a] Took 19.82 seconds to spawn the instance on the hypervisor.
Apr 14 10:43:01 user nova-compute[71509]: DEBUG nova.compute.manager [None req-bacb7aa1-84c2-4be6-9cbe-bd058fb68a99 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] [instance: c90a9b99-0985-403b-b4d8-eaa8c2eed88a] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:43:01 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681468981.4749076, b4abb549-8f36-40c5-971f-8accbb14ff86 => Resumed> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 10:43:01 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] VM Resumed (Lifecycle Event)
Apr 14 10:43:01 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1aced80d-dd6f-4096-8915-3a33bab89a2f tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Instance event wait completed in 0 seconds for  {{(pid=71509) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 10:43:01 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-1aced80d-dd6f-4096-8915-3a33bab89a2f tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Guest created on hypervisor {{(pid=71509) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 10:43:01 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Instance spawned successfully.
Apr 14 10:43:01 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-1aced80d-dd6f-4096-8915-3a33bab89a2f tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 10:43:01 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:43:01 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 10:43:01 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-1aced80d-dd6f-4096-8915-3a33bab89a2f tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Found default for hw_cdrom_bus of ide {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:43:01 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-1aced80d-dd6f-4096-8915-3a33bab89a2f tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Found default for hw_disk_bus of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:43:01 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-1aced80d-dd6f-4096-8915-3a33bab89a2f tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Found default for hw_input_bus of None {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:43:01 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-1aced80d-dd6f-4096-8915-3a33bab89a2f tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Found default for hw_pointer_model of None {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:43:01 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-1aced80d-dd6f-4096-8915-3a33bab89a2f tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Found default for hw_video_model of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:43:01 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-1aced80d-dd6f-4096-8915-3a33bab89a2f tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Found default for hw_vif_model of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:43:01 user nova-compute[71509]: INFO nova.compute.manager [None req-bacb7aa1-84c2-4be6-9cbe-bd058fb68a99 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] [instance: c90a9b99-0985-403b-b4d8-eaa8c2eed88a] Took 21.15 seconds to build instance.
Apr 14 10:43:01 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 10:43:01 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681468981.479669, b4abb549-8f36-40c5-971f-8accbb14ff86 => Started> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 10:43:01 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] VM Started (Lifecycle Event)
Apr 14 10:43:01 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-bacb7aa1-84c2-4be6-9cbe-bd058fb68a99 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Lock "c90a9b99-0985-403b-b4d8-eaa8c2eed88a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.359s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:43:01 user nova-compute[71509]: DEBUG nova.compute.manager [req-ac456397-f77c-49ae-aaea-f3cedf633e4c req-325407b6-3e29-4ea6-b178-5d11dd4d3c8a service nova] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] Received event network-vif-plugged-270b85b0-1832-4118-a8b0-ff784587b58a {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:43:01 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-ac456397-f77c-49ae-aaea-f3cedf633e4c req-325407b6-3e29-4ea6-b178-5d11dd4d3c8a service nova] Acquiring lock "97f20661-8b60-439e-b7af-2fc2013c5ade-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:43:01 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-ac456397-f77c-49ae-aaea-f3cedf633e4c req-325407b6-3e29-4ea6-b178-5d11dd4d3c8a service nova] Lock "97f20661-8b60-439e-b7af-2fc2013c5ade-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:43:01 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-ac456397-f77c-49ae-aaea-f3cedf633e4c req-325407b6-3e29-4ea6-b178-5d11dd4d3c8a service nova] Lock "97f20661-8b60-439e-b7af-2fc2013c5ade-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:43:01 user nova-compute[71509]: DEBUG nova.compute.manager [req-ac456397-f77c-49ae-aaea-f3cedf633e4c req-325407b6-3e29-4ea6-b178-5d11dd4d3c8a service nova] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] No waiting events found dispatching network-vif-plugged-270b85b0-1832-4118-a8b0-ff784587b58a {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:43:01 user nova-compute[71509]: WARNING nova.compute.manager [req-ac456397-f77c-49ae-aaea-f3cedf633e4c req-325407b6-3e29-4ea6-b178-5d11dd4d3c8a service nova] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] Received unexpected event network-vif-plugged-270b85b0-1832-4118-a8b0-ff784587b58a for instance with vm_state active and task_state None.
Apr 14 10:43:01 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:43:01 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 10:43:01 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 10:43:02 user nova-compute[71509]: INFO nova.compute.manager [None req-1aced80d-dd6f-4096-8915-3a33bab89a2f tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Took 10.19 seconds to spawn the instance on the hypervisor.
Apr 14 10:43:02 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1aced80d-dd6f-4096-8915-3a33bab89a2f tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:43:02 user nova-compute[71509]: DEBUG nova.compute.manager [req-6ba1c4da-f804-4366-952c-9f9074a3aa60 req-495263a6-d7ed-4c34-b409-2abfbeae3d73 service nova] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Received event network-vif-plugged-608a2408-02df-474f-9006-260c8c97def1 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:43:02 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-6ba1c4da-f804-4366-952c-9f9074a3aa60 req-495263a6-d7ed-4c34-b409-2abfbeae3d73 service nova] Acquiring lock "b4abb549-8f36-40c5-971f-8accbb14ff86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:43:02 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-6ba1c4da-f804-4366-952c-9f9074a3aa60 req-495263a6-d7ed-4c34-b409-2abfbeae3d73 service nova] Lock "b4abb549-8f36-40c5-971f-8accbb14ff86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:43:02 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-6ba1c4da-f804-4366-952c-9f9074a3aa60 req-495263a6-d7ed-4c34-b409-2abfbeae3d73 service nova] Lock "b4abb549-8f36-40c5-971f-8accbb14ff86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:43:02 user nova-compute[71509]: DEBUG nova.compute.manager [req-6ba1c4da-f804-4366-952c-9f9074a3aa60 req-495263a6-d7ed-4c34-b409-2abfbeae3d73 service nova] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] No waiting events found dispatching network-vif-plugged-608a2408-02df-474f-9006-260c8c97def1 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:43:02 user nova-compute[71509]: WARNING nova.compute.manager [req-6ba1c4da-f804-4366-952c-9f9074a3aa60 req-495263a6-d7ed-4c34-b409-2abfbeae3d73 service nova] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Received unexpected event network-vif-plugged-608a2408-02df-474f-9006-260c8c97def1 for instance with vm_state building and task_state spawning.
Apr 14 10:43:02 user nova-compute[71509]: INFO nova.compute.manager [None req-1aced80d-dd6f-4096-8915-3a33bab89a2f tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Took 11.16 seconds to build instance.
Apr 14 10:43:02 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1aced80d-dd6f-4096-8915-3a33bab89a2f tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "b4abb549-8f36-40c5-971f-8accbb14ff86" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.402s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:43:02 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:43:02 user nova-compute[71509]: DEBUG nova.network.neutron [None req-fece179e-5af1-40f5-b3e4-e1a228c260a5 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Successfully updated port: 49978689-84ce-4422-add9-9bb12f628c37 {{(pid=71509) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 10:43:02 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-fece179e-5af1-40f5-b3e4-e1a228c260a5 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Acquiring lock "refresh_cache-0e6c800c-9b35-4e35-969e-c40367056dce" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:43:02 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-fece179e-5af1-40f5-b3e4-e1a228c260a5 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Acquired lock "refresh_cache-0e6c800c-9b35-4e35-969e-c40367056dce" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:43:02 user nova-compute[71509]: DEBUG nova.network.neutron [None req-fece179e-5af1-40f5-b3e4-e1a228c260a5 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Building network info cache for instance {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 10:43:02 user nova-compute[71509]: DEBUG nova.compute.manager [req-52ea002a-fea9-442d-8b07-7a9f7910cdbc req-ca9dad8a-35a4-479f-9dbf-905530e5bfd4 service nova] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Received event network-changed-49978689-84ce-4422-add9-9bb12f628c37 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:43:02 user nova-compute[71509]: DEBUG nova.compute.manager [req-52ea002a-fea9-442d-8b07-7a9f7910cdbc req-ca9dad8a-35a4-479f-9dbf-905530e5bfd4 service nova] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Refreshing instance network info cache due to event network-changed-49978689-84ce-4422-add9-9bb12f628c37. {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 10:43:02 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-52ea002a-fea9-442d-8b07-7a9f7910cdbc req-ca9dad8a-35a4-479f-9dbf-905530e5bfd4 service nova] Acquiring lock "refresh_cache-0e6c800c-9b35-4e35-969e-c40367056dce" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:43:02 user nova-compute[71509]: DEBUG nova.network.neutron [None req-fece179e-5af1-40f5-b3e4-e1a228c260a5 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Instance cache missing network info. {{(pid=71509) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 10:43:03 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:43:03 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:43:03 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:43:03 user nova-compute[71509]: DEBUG nova.network.neutron [None req-fece179e-5af1-40f5-b3e4-e1a228c260a5 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Updating instance_info_cache with network_info: [{"id": "49978689-84ce-4422-add9-9bb12f628c37", "address": "fa:16:3e:a6:47:fc", "network": {"id": "9040ebc7-4d6b-4fd2-8543-f22ca3fb249c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2098664740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "482809b9148e408b84b156802a21a225", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49978689-84", "ovs_interfaceid": "49978689-84ce-4422-add9-9bb12f628c37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:43:03 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-fece179e-5af1-40f5-b3e4-e1a228c260a5 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Releasing lock "refresh_cache-0e6c800c-9b35-4e35-969e-c40367056dce" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:43:03 user nova-compute[71509]: DEBUG nova.compute.manager [None req-fece179e-5af1-40f5-b3e4-e1a228c260a5 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Instance network_info: |[{"id": "49978689-84ce-4422-add9-9bb12f628c37", "address": "fa:16:3e:a6:47:fc", "network": {"id": "9040ebc7-4d6b-4fd2-8543-f22ca3fb249c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2098664740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "482809b9148e408b84b156802a21a225", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49978689-84", "ovs_interfaceid": "49978689-84ce-4422-add9-9bb12f628c37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71509) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 10:43:03 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:43:03 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-52ea002a-fea9-442d-8b07-7a9f7910cdbc req-ca9dad8a-35a4-479f-9dbf-905530e5bfd4 service nova] Acquired lock "refresh_cache-0e6c800c-9b35-4e35-969e-c40367056dce" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:43:03 user nova-compute[71509]: DEBUG nova.network.neutron [req-52ea002a-fea9-442d-8b07-7a9f7910cdbc req-ca9dad8a-35a4-479f-9dbf-905530e5bfd4 service nova] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Refreshing network info cache for port 49978689-84ce-4422-add9-9bb12f628c37 {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 10:43:03 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-fece179e-5af1-40f5-b3e4-e1a228c260a5 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Start _get_guest_xml network_info=[{"id": "49978689-84ce-4422-add9-9bb12f628c37", "address": "fa:16:3e:a6:47:fc", "network": {"id": "9040ebc7-4d6b-4fd2-8543-f22ca3fb249c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2098664740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "482809b9148e408b84b156802a21a225", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49978689-84", "ovs_interfaceid": "49978689-84ce-4422-add9-9bb12f628c37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T10:38:55Z,direct_url=<?>,disk_format='qcow2',id=048ec0ee-0465-448d-8b4c-f072acb101dc,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='9742d6ad20cf48d9bab0fdbcc9491db9',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T10:38:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '048ec0ee-0465-448d-8b4c-f072acb101dc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71509) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 10:43:03 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-fece179e-5af1-40f5-b3e4-e1a228c260a5 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:43:03 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-fece179e-5af1-40f5-b3e4-e1a228c260a5 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:43:03 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-fece179e-5af1-40f5-b3e4-e1a228c260a5 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71509) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 10:43:03 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-fece179e-5af1-40f5-b3e4-e1a228c260a5 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T10:40:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T10:38:55Z,direct_url=<?>,disk_format='qcow2',id=048ec0ee-0465-448d-8b4c-f072acb101dc,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='9742d6ad20cf48d9bab0fdbcc9491db9',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T10:38:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 10:43:03 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-fece179e-5af1-40f5-b3e4-e1a228c260a5 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Flavor limits 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 10:43:03 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-fece179e-5af1-40f5-b3e4-e1a228c260a5 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Image limits 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 10:43:03 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-fece179e-5af1-40f5-b3e4-e1a228c260a5 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Flavor pref 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 10:43:03 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-fece179e-5af1-40f5-b3e4-e1a228c260a5 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Image pref 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 10:43:03 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-fece179e-5af1-40f5-b3e4-e1a228c260a5 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 10:43:03 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-fece179e-5af1-40f5-b3e4-e1a228c260a5 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 10:43:03 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-fece179e-5af1-40f5-b3e4-e1a228c260a5 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71509) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 10:43:03 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-fece179e-5af1-40f5-b3e4-e1a228c260a5 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Got 1 possible topologies {{(pid=71509) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 10:43:03 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-fece179e-5af1-40f5-b3e4-e1a228c260a5 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 10:43:03 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-fece179e-5af1-40f5-b3e4-e1a228c260a5 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 10:43:04 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-fece179e-5af1-40f5-b3e4-e1a228c260a5 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T10:42:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-715949836',display_name='tempest-ServerStableDeviceRescueTest-server-715949836',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-715949836',id=5,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJw5z6VaHRNlxDN06wTJu5Wi0bke1xDu+QHMTsTYS+v80iCfFQaOubP6JBaY/P1b1NeL45VzvxaEoBY4znewTkoI5fdIZ/AucgMjWw1BB8Bl59D4DxJIt+KUZTUDjHw3Lg==',key_name='tempest-keypair-882808316',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='482809b9148e408b84b156802a21a225',ramdisk_id='',reservation_id='r-ipx61qut',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1396047341',owner_user_name='tempest-ServerStableDeviceRescueTest-1396047341-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T10:42:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7212c3fe50ef465c99a0eefec4cbd753',uuid=0e6c800c-9b35-4e35-969e-c40367056dce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "49978689-84ce-4422-add9-9bb12f628c37", "address": "fa:16:3e:a6:47:fc", "network": {"id": "9040ebc7-4d6b-4fd2-8543-f22ca3fb249c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2098664740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "482809b9148e408b84b156802a21a225", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49978689-84", "ovs_interfaceid": "49978689-84ce-4422-add9-9bb12f628c37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71509) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 10:43:04 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-fece179e-5af1-40f5-b3e4-e1a228c260a5 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Converting VIF {"id": "49978689-84ce-4422-add9-9bb12f628c37", "address": "fa:16:3e:a6:47:fc", "network": {"id": "9040ebc7-4d6b-4fd2-8543-f22ca3fb249c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2098664740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "482809b9148e408b84b156802a21a225", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49978689-84", "ovs_interfaceid": "49978689-84ce-4422-add9-9bb12f628c37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:43:04 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-fece179e-5af1-40f5-b3e4-e1a228c260a5 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:47:fc,bridge_name='br-int',has_traffic_filtering=True,id=49978689-84ce-4422-add9-9bb12f628c37,network=Network(9040ebc7-4d6b-4fd2-8543-f22ca3fb249c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49978689-84') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:43:04 user nova-compute[71509]: DEBUG nova.objects.instance [None req-fece179e-5af1-40f5-b3e4-e1a228c260a5 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Lazy-loading 'pci_devices' on Instance uuid 0e6c800c-9b35-4e35-969e-c40367056dce {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:43:04 user nova-compute[71509]: DEBUG nova.compute.manager [req-dce8b1fa-71c7-4186-9da8-97d775ba82fd req-5068056c-979e-4ad3-954e-bdd13add03eb service nova] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] Received event network-vif-plugged-270b85b0-1832-4118-a8b0-ff784587b58a {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:43:04 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-dce8b1fa-71c7-4186-9da8-97d775ba82fd req-5068056c-979e-4ad3-954e-bdd13add03eb service nova] Acquiring lock "97f20661-8b60-439e-b7af-2fc2013c5ade-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:43:04 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-dce8b1fa-71c7-4186-9da8-97d775ba82fd req-5068056c-979e-4ad3-954e-bdd13add03eb service nova] Lock "97f20661-8b60-439e-b7af-2fc2013c5ade-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:43:04 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-dce8b1fa-71c7-4186-9da8-97d775ba82fd req-5068056c-979e-4ad3-954e-bdd13add03eb service nova] Lock "97f20661-8b60-439e-b7af-2fc2013c5ade-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:43:04 user nova-compute[71509]: DEBUG nova.compute.manager [req-dce8b1fa-71c7-4186-9da8-97d775ba82fd req-5068056c-979e-4ad3-954e-bdd13add03eb service nova] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] No waiting events found dispatching network-vif-plugged-270b85b0-1832-4118-a8b0-ff784587b58a {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:43:04 user nova-compute[71509]: WARNING nova.compute.manager [req-dce8b1fa-71c7-4186-9da8-97d775ba82fd req-5068056c-979e-4ad3-954e-bdd13add03eb service nova] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] Received unexpected event network-vif-plugged-270b85b0-1832-4118-a8b0-ff784587b58a for instance with vm_state active and task_state None.
Apr 14 10:43:04 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-fece179e-5af1-40f5-b3e4-e1a228c260a5 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] End _get_guest_xml xml=<domain type="kvm">
Apr 14 10:43:04 user nova-compute[71509]:   <uuid>0e6c800c-9b35-4e35-969e-c40367056dce</uuid>
Apr 14 10:43:04 user nova-compute[71509]:   <name>instance-00000005</name>
Apr 14 10:43:04 user nova-compute[71509]:   <memory>131072</memory>
Apr 14 10:43:04 user nova-compute[71509]:   <vcpu>1</vcpu>
Apr 14 10:43:04 user nova-compute[71509]:   <metadata>
Apr 14 10:43:04 user nova-compute[71509]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 10:43:04 user nova-compute[71509]:       <nova:package version="0.0.0"/>
Apr 14 10:43:04 user nova-compute[71509]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-715949836</nova:name>
Apr 14 10:43:04 user nova-compute[71509]:       <nova:creationTime>2023-04-14 10:43:03</nova:creationTime>
Apr 14 10:43:04 user nova-compute[71509]:       <nova:flavor name="m1.nano">
Apr 14 10:43:04 user nova-compute[71509]:         <nova:memory>128</nova:memory>
Apr 14 10:43:04 user nova-compute[71509]:         <nova:disk>1</nova:disk>
Apr 14 10:43:04 user nova-compute[71509]:         <nova:swap>0</nova:swap>
Apr 14 10:43:04 user nova-compute[71509]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 10:43:04 user nova-compute[71509]:         <nova:vcpus>1</nova:vcpus>
Apr 14 10:43:04 user nova-compute[71509]:       </nova:flavor>
Apr 14 10:43:04 user nova-compute[71509]:       <nova:owner>
Apr 14 10:43:04 user nova-compute[71509]:         <nova:user uuid="7212c3fe50ef465c99a0eefec4cbd753">tempest-ServerStableDeviceRescueTest-1396047341-project-member</nova:user>
Apr 14 10:43:04 user nova-compute[71509]:         <nova:project uuid="482809b9148e408b84b156802a21a225">tempest-ServerStableDeviceRescueTest-1396047341</nova:project>
Apr 14 10:43:04 user nova-compute[71509]:       </nova:owner>
Apr 14 10:43:04 user nova-compute[71509]:       <nova:root type="image" uuid="048ec0ee-0465-448d-8b4c-f072acb101dc"/>
Apr 14 10:43:04 user nova-compute[71509]:       <nova:ports>
Apr 14 10:43:04 user nova-compute[71509]:         <nova:port uuid="49978689-84ce-4422-add9-9bb12f628c37">
Apr 14 10:43:04 user nova-compute[71509]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 14 10:43:04 user nova-compute[71509]:         </nova:port>
Apr 14 10:43:04 user nova-compute[71509]:       </nova:ports>
Apr 14 10:43:04 user nova-compute[71509]:     </nova:instance>
Apr 14 10:43:04 user nova-compute[71509]:   </metadata>
Apr 14 10:43:04 user nova-compute[71509]:   <sysinfo type="smbios">
Apr 14 10:43:04 user nova-compute[71509]:     <system>
Apr 14 10:43:04 user nova-compute[71509]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 10:43:04 user nova-compute[71509]:       <entry name="product">OpenStack Nova</entry>
Apr 14 10:43:04 user nova-compute[71509]:       <entry name="version">0.0.0</entry>
Apr 14 10:43:04 user nova-compute[71509]:       <entry name="serial">0e6c800c-9b35-4e35-969e-c40367056dce</entry>
Apr 14 10:43:04 user nova-compute[71509]:       <entry name="uuid">0e6c800c-9b35-4e35-969e-c40367056dce</entry>
Apr 14 10:43:04 user nova-compute[71509]:       <entry name="family">Virtual Machine</entry>
Apr 14 10:43:04 user nova-compute[71509]:     </system>
Apr 14 10:43:04 user nova-compute[71509]:   </sysinfo>
Apr 14 10:43:04 user nova-compute[71509]:   <os>
Apr 14 10:43:04 user nova-compute[71509]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 10:43:04 user nova-compute[71509]:     <boot dev="hd"/>
Apr 14 10:43:04 user nova-compute[71509]:     <smbios mode="sysinfo"/>
Apr 14 10:43:04 user nova-compute[71509]:   </os>
Apr 14 10:43:04 user nova-compute[71509]:   <features>
Apr 14 10:43:04 user nova-compute[71509]:     <acpi/>
Apr 14 10:43:04 user nova-compute[71509]:     <apic/>
Apr 14 10:43:04 user nova-compute[71509]:     <vmcoreinfo/>
Apr 14 10:43:04 user nova-compute[71509]:   </features>
Apr 14 10:43:04 user nova-compute[71509]:   <clock offset="utc">
Apr 14 10:43:04 user nova-compute[71509]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 10:43:04 user nova-compute[71509]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 10:43:04 user nova-compute[71509]:     <timer name="hpet" present="no"/>
Apr 14 10:43:04 user nova-compute[71509]:   </clock>
Apr 14 10:43:04 user nova-compute[71509]:   <cpu mode="custom" match="exact">
Apr 14 10:43:04 user nova-compute[71509]:     <model>Nehalem</model>
Apr 14 10:43:04 user nova-compute[71509]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 10:43:04 user nova-compute[71509]:   </cpu>
Apr 14 10:43:04 user nova-compute[71509]:   <devices>
Apr 14 10:43:04 user nova-compute[71509]:     <disk type="file" device="disk">
Apr 14 10:43:04 user nova-compute[71509]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 10:43:04 user nova-compute[71509]:       <source file="/opt/stack/data/nova/instances/0e6c800c-9b35-4e35-969e-c40367056dce/disk"/>
Apr 14 10:43:04 user nova-compute[71509]:       <target dev="vda" bus="virtio"/>
Apr 14 10:43:04 user nova-compute[71509]:     </disk>
Apr 14 10:43:04 user nova-compute[71509]:     <interface type="ethernet">
Apr 14 10:43:04 user nova-compute[71509]:       <mac address="fa:16:3e:a6:47:fc"/>
Apr 14 10:43:04 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 10:43:04 user nova-compute[71509]:       <mtu size="1442"/>
Apr 14 10:43:04 user nova-compute[71509]:       <target dev="tap49978689-84"/>
Apr 14 10:43:04 user nova-compute[71509]:     </interface>
Apr 14 10:43:04 user nova-compute[71509]:     <serial type="pty">
Apr 14 10:43:04 user nova-compute[71509]:       <log file="/opt/stack/data/nova/instances/0e6c800c-9b35-4e35-969e-c40367056dce/console.log" append="off"/>
Apr 14 10:43:04 user nova-compute[71509]:     </serial>
Apr 14 10:43:04 user nova-compute[71509]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 10:43:04 user nova-compute[71509]:     <video>
Apr 14 10:43:04 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 10:43:04 user nova-compute[71509]:     </video>
Apr 14 10:43:04 user nova-compute[71509]:     <rng model="virtio">
Apr 14 10:43:04 user nova-compute[71509]:       <backend model="random">/dev/urandom</backend>
Apr 14 10:43:04 user nova-compute[71509]:     </rng>
Apr 14 10:43:04 user nova-compute[71509]:     <controller type="usb" index="0" model="none"/>
Apr 14 10:43:04 user nova-compute[71509]:     <memballoon model="virtio">
Apr 14 10:43:04 user nova-compute[71509]:       <stats period="10"/>
Apr 14 10:43:04 user nova-compute[71509]:     </memballoon>
Apr 14 10:43:04 user nova-compute[71509]:   </devices>
Apr 14 10:43:04 user nova-compute[71509]: </domain>
Apr 14 10:43:04 user nova-compute[71509]:  {{(pid=71509) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 10:43:04 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-fece179e-5af1-40f5-b3e4-e1a228c260a5 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T10:42:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-715949836',display_name='tempest-ServerStableDeviceRescueTest-server-715949836',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-715949836',id=5,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJw5z6VaHRNlxDN06wTJu5Wi0bke1xDu+QHMTsTYS+v80iCfFQaOubP6JBaY/P1b1NeL45VzvxaEoBY4znewTkoI5fdIZ/AucgMjWw1BB8Bl59D4DxJIt+KUZTUDjHw3Lg==',key_name='tempest-keypair-882808316',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='482809b9148e408b84b156802a21a225',ramdisk_id='',reservation_id='r-ipx61qut',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1396047341',owner_user_name='tempest-ServerStableDeviceRescueTest-1396047341-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T10:42:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7212c3fe50ef465c99a0eefec4cbd753',uuid=0e6c800c-9b35-4e35-969e-c40367056dce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "49978689-84ce-4422-add9-9bb12f628c37", "address": "fa:16:3e:a6:47:fc", "network": {"id": "9040ebc7-4d6b-4fd2-8543-f22ca3fb249c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2098664740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "482809b9148e408b84b156802a21a225", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49978689-84", "ovs_interfaceid": "49978689-84ce-4422-add9-9bb12f628c37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 10:43:04 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-fece179e-5af1-40f5-b3e4-e1a228c260a5 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Converting VIF {"id": "49978689-84ce-4422-add9-9bb12f628c37", "address": "fa:16:3e:a6:47:fc", "network": {"id": "9040ebc7-4d6b-4fd2-8543-f22ca3fb249c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2098664740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "482809b9148e408b84b156802a21a225", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49978689-84", "ovs_interfaceid": "49978689-84ce-4422-add9-9bb12f628c37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:43:04 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-fece179e-5af1-40f5-b3e4-e1a228c260a5 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:47:fc,bridge_name='br-int',has_traffic_filtering=True,id=49978689-84ce-4422-add9-9bb12f628c37,network=Network(9040ebc7-4d6b-4fd2-8543-f22ca3fb249c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49978689-84') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:43:04 user nova-compute[71509]: DEBUG os_vif [None req-fece179e-5af1-40f5-b3e4-e1a228c260a5 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:47:fc,bridge_name='br-int',has_traffic_filtering=True,id=49978689-84ce-4422-add9-9bb12f628c37,network=Network(9040ebc7-4d6b-4fd2-8543-f22ca3fb249c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49978689-84') {{(pid=71509) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 10:43:04 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:43:04 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:43:04 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 10:43:04 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:43:04 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap49978689-84, may_exist=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:43:04 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap49978689-84, col_values=(('external_ids', {'iface-id': '49978689-84ce-4422-add9-9bb12f628c37', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a6:47:fc', 'vm-uuid': '0e6c800c-9b35-4e35-969e-c40367056dce'}),)) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:43:04 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:43:04 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 10:43:04 user nova-compute[71509]: INFO os_vif [None req-fece179e-5af1-40f5-b3e4-e1a228c260a5 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:47:fc,bridge_name='br-int',has_traffic_filtering=True,id=49978689-84ce-4422-add9-9bb12f628c37,network=Network(9040ebc7-4d6b-4fd2-8543-f22ca3fb249c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49978689-84')
Apr 14 10:43:04 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-fece179e-5af1-40f5-b3e4-e1a228c260a5 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] No BDM found with device name vda, not building metadata. {{(pid=71509) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 10:43:04 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-fece179e-5af1-40f5-b3e4-e1a228c260a5 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] No VIF found with MAC fa:16:3e:a6:47:fc, not building metadata {{(pid=71509) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 10:43:04 user nova-compute[71509]: DEBUG nova.network.neutron [req-52ea002a-fea9-442d-8b07-7a9f7910cdbc req-ca9dad8a-35a4-479f-9dbf-905530e5bfd4 service nova] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Updated VIF entry in instance network info cache for port 49978689-84ce-4422-add9-9bb12f628c37. {{(pid=71509) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 10:43:04 user nova-compute[71509]: DEBUG nova.network.neutron [req-52ea002a-fea9-442d-8b07-7a9f7910cdbc req-ca9dad8a-35a4-479f-9dbf-905530e5bfd4 service nova] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Updating instance_info_cache with network_info: [{"id": "49978689-84ce-4422-add9-9bb12f628c37", "address": "fa:16:3e:a6:47:fc", "network": {"id": "9040ebc7-4d6b-4fd2-8543-f22ca3fb249c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2098664740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "482809b9148e408b84b156802a21a225", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49978689-84", "ovs_interfaceid": "49978689-84ce-4422-add9-9bb12f628c37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:43:04 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-52ea002a-fea9-442d-8b07-7a9f7910cdbc req-ca9dad8a-35a4-479f-9dbf-905530e5bfd4 service nova] Releasing lock "refresh_cache-0e6c800c-9b35-4e35-969e-c40367056dce" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:43:04 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:43:04 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:43:05 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:43:05 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:43:05 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:43:05 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:43:05 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:43:06 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:43:06 user nova-compute[71509]: DEBUG nova.compute.manager [req-72ada868-d1b9-4781-b6db-7683f9cbb03f req-07a7d72b-6c66-4e3e-abfa-f309cb5e4c8b service nova] [instance: c90a9b99-0985-403b-b4d8-eaa8c2eed88a] Received event network-vif-plugged-5bd8d359-958a-4b76-ac87-156c2a2adf35 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:43:06 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-72ada868-d1b9-4781-b6db-7683f9cbb03f req-07a7d72b-6c66-4e3e-abfa-f309cb5e4c8b service nova] Acquiring lock "c90a9b99-0985-403b-b4d8-eaa8c2eed88a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:43:06 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-72ada868-d1b9-4781-b6db-7683f9cbb03f req-07a7d72b-6c66-4e3e-abfa-f309cb5e4c8b service nova] Lock "c90a9b99-0985-403b-b4d8-eaa8c2eed88a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:43:06 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-72ada868-d1b9-4781-b6db-7683f9cbb03f req-07a7d72b-6c66-4e3e-abfa-f309cb5e4c8b service nova] Lock "c90a9b99-0985-403b-b4d8-eaa8c2eed88a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:43:06 user nova-compute[71509]: DEBUG nova.compute.manager [req-72ada868-d1b9-4781-b6db-7683f9cbb03f req-07a7d72b-6c66-4e3e-abfa-f309cb5e4c8b service nova] [instance: c90a9b99-0985-403b-b4d8-eaa8c2eed88a] No waiting events found dispatching network-vif-plugged-5bd8d359-958a-4b76-ac87-156c2a2adf35 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:43:06 user nova-compute[71509]: WARNING nova.compute.manager [req-72ada868-d1b9-4781-b6db-7683f9cbb03f req-07a7d72b-6c66-4e3e-abfa-f309cb5e4c8b service nova] [instance: c90a9b99-0985-403b-b4d8-eaa8c2eed88a] Received unexpected event network-vif-plugged-5bd8d359-958a-4b76-ac87-156c2a2adf35 for instance with vm_state active and task_state None.
Apr 14 10:43:06 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:43:07 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:43:07 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:43:07 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:43:07 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:43:07 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:43:07 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:43:07 user nova-compute[71509]: DEBUG nova.compute.manager [req-aa4378c7-e296-41cf-845b-4f7fb028f415 req-9d6e836b-099b-4948-bde4-82ac822c09f2 service nova] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Received event network-vif-plugged-49978689-84ce-4422-add9-9bb12f628c37 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:43:07 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-aa4378c7-e296-41cf-845b-4f7fb028f415 req-9d6e836b-099b-4948-bde4-82ac822c09f2 service nova] Acquiring lock "0e6c800c-9b35-4e35-969e-c40367056dce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:43:07 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-aa4378c7-e296-41cf-845b-4f7fb028f415 req-9d6e836b-099b-4948-bde4-82ac822c09f2 service nova] Lock "0e6c800c-9b35-4e35-969e-c40367056dce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:43:07 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-aa4378c7-e296-41cf-845b-4f7fb028f415 req-9d6e836b-099b-4948-bde4-82ac822c09f2 service nova] Lock "0e6c800c-9b35-4e35-969e-c40367056dce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:43:07 user nova-compute[71509]: DEBUG nova.compute.manager [req-aa4378c7-e296-41cf-845b-4f7fb028f415 req-9d6e836b-099b-4948-bde4-82ac822c09f2 service nova] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] No waiting events found dispatching network-vif-plugged-49978689-84ce-4422-add9-9bb12f628c37 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:43:07 user nova-compute[71509]: WARNING nova.compute.manager [req-aa4378c7-e296-41cf-845b-4f7fb028f415 req-9d6e836b-099b-4948-bde4-82ac822c09f2 service nova] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Received unexpected event network-vif-plugged-49978689-84ce-4422-add9-9bb12f628c37 for instance with vm_state building and task_state spawning.
Apr 14 10:43:08 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:43:08 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:43:08 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:43:08 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:43:08 user nova-compute[71509]: DEBUG nova.compute.manager [req-f20442f2-d9b0-400b-ac2c-e0b15f1c434e req-3aa5003a-eb35-482b-a916-9fea3592ebac service nova] [instance: c90a9b99-0985-403b-b4d8-eaa8c2eed88a] Received event network-vif-plugged-5bd8d359-958a-4b76-ac87-156c2a2adf35 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:43:08 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-f20442f2-d9b0-400b-ac2c-e0b15f1c434e req-3aa5003a-eb35-482b-a916-9fea3592ebac service nova] Acquiring lock "c90a9b99-0985-403b-b4d8-eaa8c2eed88a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:43:08 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-f20442f2-d9b0-400b-ac2c-e0b15f1c434e req-3aa5003a-eb35-482b-a916-9fea3592ebac service nova] Lock "c90a9b99-0985-403b-b4d8-eaa8c2eed88a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:43:08 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-f20442f2-d9b0-400b-ac2c-e0b15f1c434e req-3aa5003a-eb35-482b-a916-9fea3592ebac service nova] Lock "c90a9b99-0985-403b-b4d8-eaa8c2eed88a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:43:08 user nova-compute[71509]: DEBUG nova.compute.manager [req-f20442f2-d9b0-400b-ac2c-e0b15f1c434e req-3aa5003a-eb35-482b-a916-9fea3592ebac service nova] [instance: c90a9b99-0985-403b-b4d8-eaa8c2eed88a] No waiting events found dispatching network-vif-plugged-5bd8d359-958a-4b76-ac87-156c2a2adf35 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:43:08 user nova-compute[71509]: WARNING nova.compute.manager [req-f20442f2-d9b0-400b-ac2c-e0b15f1c434e req-3aa5003a-eb35-482b-a916-9fea3592ebac service nova] [instance: c90a9b99-0985-403b-b4d8-eaa8c2eed88a] Received unexpected event network-vif-plugged-5bd8d359-958a-4b76-ac87-156c2a2adf35 for instance with vm_state active and task_state None.
Apr 14 10:43:09 user nova-compute[71509]: DEBUG nova.compute.manager [None req-fece179e-5af1-40f5-b3e4-e1a228c260a5 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Instance event wait completed in 0 seconds for  {{(pid=71509) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 10:43:09 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-fece179e-5af1-40f5-b3e4-e1a228c260a5 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Guest created on hypervisor {{(pid=71509) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 10:43:09 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681468989.250444, 0e6c800c-9b35-4e35-969e-c40367056dce => Resumed> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 10:43:09 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] VM Resumed (Lifecycle Event)
Apr 14 10:43:09 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Instance spawned successfully.
Apr 14 10:43:09 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-fece179e-5af1-40f5-b3e4-e1a228c260a5 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 10:43:09 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:43:09 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:43:09 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:43:09 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 10:43:09 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-fece179e-5af1-40f5-b3e4-e1a228c260a5 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Found default for hw_cdrom_bus of ide {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:43:09 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-fece179e-5af1-40f5-b3e4-e1a228c260a5 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Found default for hw_disk_bus of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:43:09 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-fece179e-5af1-40f5-b3e4-e1a228c260a5 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Found default for hw_input_bus of None {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:43:09 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-fece179e-5af1-40f5-b3e4-e1a228c260a5 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Found default for hw_pointer_model of None {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:43:09 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-fece179e-5af1-40f5-b3e4-e1a228c260a5 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Found default for hw_video_model of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:43:09 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-fece179e-5af1-40f5-b3e4-e1a228c260a5 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Found default for hw_vif_model of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:43:09 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 10:43:09 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681468989.253432, 0e6c800c-9b35-4e35-969e-c40367056dce => Started> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 10:43:09 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] VM Started (Lifecycle Event)
Apr 14 10:43:09 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:43:09 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 10:43:09 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 10:43:09 user nova-compute[71509]: INFO nova.compute.manager [None req-fece179e-5af1-40f5-b3e4-e1a228c260a5 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Took 11.28 seconds to spawn the instance on the hypervisor.
Apr 14 10:43:09 user nova-compute[71509]: DEBUG nova.compute.manager [None req-fece179e-5af1-40f5-b3e4-e1a228c260a5 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:43:09 user nova-compute[71509]: INFO nova.compute.manager [None req-fece179e-5af1-40f5-b3e4-e1a228c260a5 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Took 12.14 seconds to build instance.
Apr 14 10:43:09 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-fece179e-5af1-40f5-b3e4-e1a228c260a5 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Lock "0e6c800c-9b35-4e35-969e-c40367056dce" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.298s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:43:09 user nova-compute[71509]: DEBUG nova.compute.manager [req-0a3eb9ee-ba96-40d6-acdb-ebe6e5bdd282 req-b8bb7481-4d39-4fe9-9f6f-91f8a5f1caf9 service nova] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Received event network-vif-plugged-49978689-84ce-4422-add9-9bb12f628c37 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:43:09 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-0a3eb9ee-ba96-40d6-acdb-ebe6e5bdd282 req-b8bb7481-4d39-4fe9-9f6f-91f8a5f1caf9 service nova] Acquiring lock "0e6c800c-9b35-4e35-969e-c40367056dce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:43:09 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-0a3eb9ee-ba96-40d6-acdb-ebe6e5bdd282 req-b8bb7481-4d39-4fe9-9f6f-91f8a5f1caf9 service nova] Lock "0e6c800c-9b35-4e35-969e-c40367056dce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:43:09 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-0a3eb9ee-ba96-40d6-acdb-ebe6e5bdd282 req-b8bb7481-4d39-4fe9-9f6f-91f8a5f1caf9 service nova] Lock "0e6c800c-9b35-4e35-969e-c40367056dce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:43:09 user nova-compute[71509]: DEBUG nova.compute.manager [req-0a3eb9ee-ba96-40d6-acdb-ebe6e5bdd282 req-b8bb7481-4d39-4fe9-9f6f-91f8a5f1caf9 service nova] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] No waiting events found dispatching network-vif-plugged-49978689-84ce-4422-add9-9bb12f628c37 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:43:09 user nova-compute[71509]: WARNING nova.compute.manager [req-0a3eb9ee-ba96-40d6-acdb-ebe6e5bdd282 req-b8bb7481-4d39-4fe9-9f6f-91f8a5f1caf9 service nova] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Received unexpected event network-vif-plugged-49978689-84ce-4422-add9-9bb12f628c37 for instance with vm_state active and task_state None.
Apr 14 10:43:09 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:43:12 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:43:14 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:43:14 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-98754c0f-aaf1-405c-9be2-6b1f3f380b55 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Acquiring lock "ec16b4bc-5385-4eea-856f-710d52d0261d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:43:14 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-98754c0f-aaf1-405c-9be2-6b1f3f380b55 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Lock "ec16b4bc-5385-4eea-856f-710d52d0261d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:43:14 user nova-compute[71509]: DEBUG nova.compute.manager [None req-98754c0f-aaf1-405c-9be2-6b1f3f380b55 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] [instance: ec16b4bc-5385-4eea-856f-710d52d0261d] Starting instance... {{(pid=71509) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 10:43:14 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-98754c0f-aaf1-405c-9be2-6b1f3f380b55 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:43:14 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-98754c0f-aaf1-405c-9be2-6b1f3f380b55 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.004s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:43:15 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-98754c0f-aaf1-405c-9be2-6b1f3f380b55 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71509) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 10:43:15 user nova-compute[71509]: INFO nova.compute.claims [None req-98754c0f-aaf1-405c-9be2-6b1f3f380b55 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] [instance: ec16b4bc-5385-4eea-856f-710d52d0261d] Claim successful on node user
Apr 14 10:43:15 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-98754c0f-aaf1-405c-9be2-6b1f3f380b55 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 10:43:15 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-98754c0f-aaf1-405c-9be2-6b1f3f380b55 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 10:43:15 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-98754c0f-aaf1-405c-9be2-6b1f3f380b55 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.959s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:43:15 user nova-compute[71509]: DEBUG nova.compute.manager [None req-98754c0f-aaf1-405c-9be2-6b1f3f380b55 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] [instance: ec16b4bc-5385-4eea-856f-710d52d0261d] Start building networks asynchronously for instance. {{(pid=71509) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 10:43:16 user nova-compute[71509]: DEBUG nova.compute.manager [None req-98754c0f-aaf1-405c-9be2-6b1f3f380b55 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] [instance: ec16b4bc-5385-4eea-856f-710d52d0261d] Allocating IP information in the background. {{(pid=71509) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 10:43:16 user nova-compute[71509]: DEBUG nova.network.neutron [None req-98754c0f-aaf1-405c-9be2-6b1f3f380b55 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] [instance: ec16b4bc-5385-4eea-856f-710d52d0261d] allocate_for_instance() {{(pid=71509) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 10:43:16 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-98754c0f-aaf1-405c-9be2-6b1f3f380b55 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] [instance: ec16b4bc-5385-4eea-856f-710d52d0261d] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Apr 14 10:43:16 user nova-compute[71509]: DEBUG nova.compute.manager [None req-98754c0f-aaf1-405c-9be2-6b1f3f380b55 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] [instance: ec16b4bc-5385-4eea-856f-710d52d0261d] Start building block device mappings for instance. {{(pid=71509) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 10:43:16 user nova-compute[71509]: DEBUG nova.policy [None req-98754c0f-aaf1-405c-9be2-6b1f3f380b55 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '806d72cf0d0f4de3a4b9f0466a8e094d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77068eae4fa9459fbe81026615d0c16d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71509) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 10:43:16 user nova-compute[71509]: DEBUG nova.compute.manager [None req-98754c0f-aaf1-405c-9be2-6b1f3f380b55 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] [instance: ec16b4bc-5385-4eea-856f-710d52d0261d] Start spawning the instance on the hypervisor. {{(pid=71509) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 10:43:16 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-98754c0f-aaf1-405c-9be2-6b1f3f380b55 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] [instance: ec16b4bc-5385-4eea-856f-710d52d0261d] Creating instance directory {{(pid=71509) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 10:43:16 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-98754c0f-aaf1-405c-9be2-6b1f3f380b55 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] [instance: ec16b4bc-5385-4eea-856f-710d52d0261d] Creating image(s)
Apr 14 10:43:16 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-98754c0f-aaf1-405c-9be2-6b1f3f380b55 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Acquiring lock "/opt/stack/data/nova/instances/ec16b4bc-5385-4eea-856f-710d52d0261d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:43:16 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-98754c0f-aaf1-405c-9be2-6b1f3f380b55 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Lock "/opt/stack/data/nova/instances/ec16b4bc-5385-4eea-856f-710d52d0261d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:43:16 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-98754c0f-aaf1-405c-9be2-6b1f3f380b55 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Lock "/opt/stack/data/nova/instances/ec16b4bc-5385-4eea-856f-710d52d0261d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:43:16 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-98754c0f-aaf1-405c-9be2-6b1f3f380b55 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Acquiring lock "bceeabb407b636b03ab3d5a839a6c88119d61c6f" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:43:16 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-98754c0f-aaf1-405c-9be2-6b1f3f380b55 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Lock "bceeabb407b636b03ab3d5a839a6c88119d61c6f" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:43:16 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-98754c0f-aaf1-405c-9be2-6b1f3f380b55 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bceeabb407b636b03ab3d5a839a6c88119d61c6f.part --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:43:16 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-98754c0f-aaf1-405c-9be2-6b1f3f380b55 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bceeabb407b636b03ab3d5a839a6c88119d61c6f.part --force-share --output=json" returned: 0 in 0.166s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:43:16 user nova-compute[71509]: DEBUG nova.virt.images [None req-98754c0f-aaf1-405c-9be2-6b1f3f380b55 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] ed0c452a-8d78-4384-a7fd-42b906083cfb was qcow2, converting to raw {{(pid=71509) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 14 10:43:16 user nova-compute[71509]: DEBUG nova.privsep.utils [None req-98754c0f-aaf1-405c-9be2-6b1f3f380b55 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71509) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 10:43:16 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-98754c0f-aaf1-405c-9be2-6b1f3f380b55 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/bceeabb407b636b03ab3d5a839a6c88119d61c6f.part /opt/stack/data/nova/instances/_base/bceeabb407b636b03ab3d5a839a6c88119d61c6f.converted {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:43:17 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-98754c0f-aaf1-405c-9be2-6b1f3f380b55 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/bceeabb407b636b03ab3d5a839a6c88119d61c6f.part /opt/stack/data/nova/instances/_base/bceeabb407b636b03ab3d5a839a6c88119d61c6f.converted" returned: 0 in 0.266s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:43:17 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-98754c0f-aaf1-405c-9be2-6b1f3f380b55 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bceeabb407b636b03ab3d5a839a6c88119d61c6f.converted --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:43:17 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:43:17 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-98754c0f-aaf1-405c-9be2-6b1f3f380b55 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bceeabb407b636b03ab3d5a839a6c88119d61c6f.converted --force-share --output=json" returned: 0 in 0.357s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:43:17 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-98754c0f-aaf1-405c-9be2-6b1f3f380b55 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Lock "bceeabb407b636b03ab3d5a839a6c88119d61c6f" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.305s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:43:17 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-98754c0f-aaf1-405c-9be2-6b1f3f380b55 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bceeabb407b636b03ab3d5a839a6c88119d61c6f --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:43:17 user nova-compute[71509]: DEBUG nova.network.neutron [None req-98754c0f-aaf1-405c-9be2-6b1f3f380b55 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] [instance: ec16b4bc-5385-4eea-856f-710d52d0261d] Successfully created port: 2ee28d01-fbb2-4cf6-adcd-342fdabc8458 {{(pid=71509) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 10:43:17 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-98754c0f-aaf1-405c-9be2-6b1f3f380b55 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bceeabb407b636b03ab3d5a839a6c88119d61c6f --force-share --output=json" returned: 0 in 0.201s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:43:17 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-98754c0f-aaf1-405c-9be2-6b1f3f380b55 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Acquiring lock "bceeabb407b636b03ab3d5a839a6c88119d61c6f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:43:17 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-98754c0f-aaf1-405c-9be2-6b1f3f380b55 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Lock "bceeabb407b636b03ab3d5a839a6c88119d61c6f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:43:17 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-98754c0f-aaf1-405c-9be2-6b1f3f380b55 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bceeabb407b636b03ab3d5a839a6c88119d61c6f --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:43:18 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-98754c0f-aaf1-405c-9be2-6b1f3f380b55 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bceeabb407b636b03ab3d5a839a6c88119d61c6f --force-share --output=json" returned: 0 in 0.174s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:43:18 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-98754c0f-aaf1-405c-9be2-6b1f3f380b55 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bceeabb407b636b03ab3d5a839a6c88119d61c6f,backing_fmt=raw /opt/stack/data/nova/instances/ec16b4bc-5385-4eea-856f-710d52d0261d/disk 1073741824 {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:43:18 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-98754c0f-aaf1-405c-9be2-6b1f3f380b55 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bceeabb407b636b03ab3d5a839a6c88119d61c6f,backing_fmt=raw /opt/stack/data/nova/instances/ec16b4bc-5385-4eea-856f-710d52d0261d/disk 1073741824" returned: 0 in 0.090s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:43:18 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-98754c0f-aaf1-405c-9be2-6b1f3f380b55 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Lock "bceeabb407b636b03ab3d5a839a6c88119d61c6f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.273s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:43:18 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-98754c0f-aaf1-405c-9be2-6b1f3f380b55 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bceeabb407b636b03ab3d5a839a6c88119d61c6f --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:43:18 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-98754c0f-aaf1-405c-9be2-6b1f3f380b55 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bceeabb407b636b03ab3d5a839a6c88119d61c6f --force-share --output=json" returned: 0 in 0.237s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:43:18 user nova-compute[71509]: DEBUG nova.virt.disk.api [None req-98754c0f-aaf1-405c-9be2-6b1f3f380b55 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ec16b4bc-5385-4eea-856f-710d52d0261d/disk. size=1073741824 {{(pid=71509) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 10:43:18 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-98754c0f-aaf1-405c-9be2-6b1f3f380b55 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec16b4bc-5385-4eea-856f-710d52d0261d/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:43:18 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-98754c0f-aaf1-405c-9be2-6b1f3f380b55 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec16b4bc-5385-4eea-856f-710d52d0261d/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:43:18 user nova-compute[71509]: DEBUG nova.virt.disk.api [None req-98754c0f-aaf1-405c-9be2-6b1f3f380b55 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Cannot resize image /opt/stack/data/nova/instances/ec16b4bc-5385-4eea-856f-710d52d0261d/disk to a smaller size. {{(pid=71509) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 10:43:18 user nova-compute[71509]: DEBUG nova.objects.instance [None req-98754c0f-aaf1-405c-9be2-6b1f3f380b55 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Lazy-loading 'migration_context' on Instance uuid ec16b4bc-5385-4eea-856f-710d52d0261d {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:43:18 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-98754c0f-aaf1-405c-9be2-6b1f3f380b55 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] [instance: ec16b4bc-5385-4eea-856f-710d52d0261d] Created local disks {{(pid=71509) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 10:43:18 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-98754c0f-aaf1-405c-9be2-6b1f3f380b55 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] [instance: ec16b4bc-5385-4eea-856f-710d52d0261d] Ensure instance console log exists: /opt/stack/data/nova/instances/ec16b4bc-5385-4eea-856f-710d52d0261d/console.log {{(pid=71509) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 10:43:18 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-98754c0f-aaf1-405c-9be2-6b1f3f380b55 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:43:18 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-98754c0f-aaf1-405c-9be2-6b1f3f380b55 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:43:18 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-98754c0f-aaf1-405c-9be2-6b1f3f380b55 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:43:18 user nova-compute[71509]: DEBUG nova.network.neutron [None req-98754c0f-aaf1-405c-9be2-6b1f3f380b55 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] [instance: ec16b4bc-5385-4eea-856f-710d52d0261d] Successfully updated port: 2ee28d01-fbb2-4cf6-adcd-342fdabc8458 {{(pid=71509) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 10:43:18 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-98754c0f-aaf1-405c-9be2-6b1f3f380b55 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Acquiring lock "refresh_cache-ec16b4bc-5385-4eea-856f-710d52d0261d" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:43:18 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-98754c0f-aaf1-405c-9be2-6b1f3f380b55 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Acquired lock "refresh_cache-ec16b4bc-5385-4eea-856f-710d52d0261d" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:43:18 user nova-compute[71509]: DEBUG nova.network.neutron [None req-98754c0f-aaf1-405c-9be2-6b1f3f380b55 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] [instance: ec16b4bc-5385-4eea-856f-710d52d0261d] Building network info cache for instance {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 10:43:18 user nova-compute[71509]: DEBUG nova.compute.manager [req-6887f3f8-0c57-4477-a1cb-5c21ec5d46de req-f2fce6e9-4451-4de0-a251-5cadf3595784 service nova] [instance: ec16b4bc-5385-4eea-856f-710d52d0261d] Received event network-changed-2ee28d01-fbb2-4cf6-adcd-342fdabc8458 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:43:18 user nova-compute[71509]: DEBUG nova.compute.manager [req-6887f3f8-0c57-4477-a1cb-5c21ec5d46de req-f2fce6e9-4451-4de0-a251-5cadf3595784 service nova] [instance: ec16b4bc-5385-4eea-856f-710d52d0261d] Refreshing instance network info cache due to event network-changed-2ee28d01-fbb2-4cf6-adcd-342fdabc8458. {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 10:43:18 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-6887f3f8-0c57-4477-a1cb-5c21ec5d46de req-f2fce6e9-4451-4de0-a251-5cadf3595784 service nova] Acquiring lock "refresh_cache-ec16b4bc-5385-4eea-856f-710d52d0261d" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:43:18 user nova-compute[71509]: DEBUG nova.network.neutron [None req-98754c0f-aaf1-405c-9be2-6b1f3f380b55 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] [instance: ec16b4bc-5385-4eea-856f-710d52d0261d] Instance cache missing network info. {{(pid=71509) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 10:43:19 user nova-compute[71509]: DEBUG nova.network.neutron [None req-98754c0f-aaf1-405c-9be2-6b1f3f380b55 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] [instance: ec16b4bc-5385-4eea-856f-710d52d0261d] Updating instance_info_cache with network_info: [{"id": "2ee28d01-fbb2-4cf6-adcd-342fdabc8458", "address": "fa:16:3e:9a:29:80", "network": {"id": "79481373-f78f-46b0-bda0-5e66dea2fd31", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1244430846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77068eae4fa9459fbe81026615d0c16d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ee28d01-fb", "ovs_interfaceid": "2ee28d01-fbb2-4cf6-adcd-342fdabc8458", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:43:19 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:43:19 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-98754c0f-aaf1-405c-9be2-6b1f3f380b55 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Releasing lock "refresh_cache-ec16b4bc-5385-4eea-856f-710d52d0261d" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:43:19 user nova-compute[71509]: DEBUG nova.compute.manager [None req-98754c0f-aaf1-405c-9be2-6b1f3f380b55 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] [instance: ec16b4bc-5385-4eea-856f-710d52d0261d] Instance network_info: |[{"id": "2ee28d01-fbb2-4cf6-adcd-342fdabc8458", "address": "fa:16:3e:9a:29:80", "network": {"id": "79481373-f78f-46b0-bda0-5e66dea2fd31", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1244430846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77068eae4fa9459fbe81026615d0c16d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ee28d01-fb", "ovs_interfaceid": "2ee28d01-fbb2-4cf6-adcd-342fdabc8458", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71509) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 10:43:19 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-6887f3f8-0c57-4477-a1cb-5c21ec5d46de req-f2fce6e9-4451-4de0-a251-5cadf3595784 service nova] Acquired lock "refresh_cache-ec16b4bc-5385-4eea-856f-710d52d0261d" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:43:19 user nova-compute[71509]: DEBUG nova.network.neutron [req-6887f3f8-0c57-4477-a1cb-5c21ec5d46de req-f2fce6e9-4451-4de0-a251-5cadf3595784 service nova] [instance: ec16b4bc-5385-4eea-856f-710d52d0261d] Refreshing network info cache for port 2ee28d01-fbb2-4cf6-adcd-342fdabc8458 {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 10:43:19 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-98754c0f-aaf1-405c-9be2-6b1f3f380b55 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] [instance: ec16b4bc-5385-4eea-856f-710d52d0261d] Start _get_guest_xml network_info=[{"id": "2ee28d01-fbb2-4cf6-adcd-342fdabc8458", "address": "fa:16:3e:9a:29:80", "network": {"id": "79481373-f78f-46b0-bda0-5e66dea2fd31", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1244430846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77068eae4fa9459fbe81026615d0c16d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ee28d01-fb", "ovs_interfaceid": "2ee28d01-fbb2-4cf6-adcd-342fdabc8458", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T10:43:06Z,direct_url=<?>,disk_format='qcow2',id=ed0c452a-8d78-4384-a7fd-42b906083cfb,min_disk=0,min_ram=0,name='',owner='0274c5fccb1641d6aeb36035fe8756d3',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T10:43:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'guest_format': None, 'size': 0, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/sda', 'disk_bus': 'scsi', 'image_id': 'ed0c452a-8d78-4384-a7fd-42b906083cfb'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71509) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 10:43:19 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-98754c0f-aaf1-405c-9be2-6b1f3f380b55 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:43:19 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-98754c0f-aaf1-405c-9be2-6b1f3f380b55 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:43:19 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-98754c0f-aaf1-405c-9be2-6b1f3f380b55 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71509) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 10:43:19 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-98754c0f-aaf1-405c-9be2-6b1f3f380b55 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T10:40:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T10:43:06Z,direct_url=<?>,disk_format='qcow2',id=ed0c452a-8d78-4384-a7fd-42b906083cfb,min_disk=0,min_ram=0,name='',owner='0274c5fccb1641d6aeb36035fe8756d3',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T10:43:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 10:43:19 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-98754c0f-aaf1-405c-9be2-6b1f3f380b55 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Flavor limits 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 10:43:19 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-98754c0f-aaf1-405c-9be2-6b1f3f380b55 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Image limits 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 10:43:19 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-98754c0f-aaf1-405c-9be2-6b1f3f380b55 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Flavor pref 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 10:43:19 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-98754c0f-aaf1-405c-9be2-6b1f3f380b55 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Image pref 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 10:43:19 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-98754c0f-aaf1-405c-9be2-6b1f3f380b55 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 10:43:19 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-98754c0f-aaf1-405c-9be2-6b1f3f380b55 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 10:43:19 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-98754c0f-aaf1-405c-9be2-6b1f3f380b55 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71509) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 10:43:19 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-98754c0f-aaf1-405c-9be2-6b1f3f380b55 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Got 1 possible topologies {{(pid=71509) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 10:43:19 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-98754c0f-aaf1-405c-9be2-6b1f3f380b55 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 10:43:19 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-98754c0f-aaf1-405c-9be2-6b1f3f380b55 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 10:43:19 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-98754c0f-aaf1-405c-9be2-6b1f3f380b55 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T10:43:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1939318021',display_name='tempest-AttachSCSIVolumeTestJSON-server-1939318021',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1939318021',id=6,image_ref='ed0c452a-8d78-4384-a7fd-42b906083cfb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLJOFZ8W37hnq+kD091gcZmfKt0DbPWyNzwj7yK+k5JHq+c+tzsMxH1HPOh1pMpymrDK+TpdkALjgZfKfob4LIzOz/KHG73qeijcsRYqyklipL4lvgFNZ8j26eWO1fqqtg==',key_name='tempest-keypair-1306588747',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='77068eae4fa9459fbe81026615d0c16d',ramdisk_id='',reservation_id='r-mhedquh2',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ed0c452a-8d78-4384-a7fd-42b906083cfb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1881116553',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1881116553-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T10:43:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='806d72cf0d0f4de3a4b9f0466a8e094d',uuid=ec16b4bc-5385-4eea-856f-710d52d0261d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2ee28d01-fbb2-4cf6-adcd-342fdabc8458", "address": "fa:16:3e:9a:29:80", "network": {"id": "79481373-f78f-46b0-bda0-5e66dea2fd31", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1244430846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77068eae4fa9459fbe81026615d0c16d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ee28d01-fb", "ovs_interfaceid": "2ee28d01-fbb2-4cf6-adcd-342fdabc8458", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71509) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 10:43:19 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-98754c0f-aaf1-405c-9be2-6b1f3f380b55 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Converting VIF {"id": "2ee28d01-fbb2-4cf6-adcd-342fdabc8458", "address": "fa:16:3e:9a:29:80", "network": {"id": "79481373-f78f-46b0-bda0-5e66dea2fd31", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1244430846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77068eae4fa9459fbe81026615d0c16d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ee28d01-fb", "ovs_interfaceid": "2ee28d01-fbb2-4cf6-adcd-342fdabc8458", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:43:19 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-98754c0f-aaf1-405c-9be2-6b1f3f380b55 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:29:80,bridge_name='br-int',has_traffic_filtering=True,id=2ee28d01-fbb2-4cf6-adcd-342fdabc8458,network=Network(79481373-f78f-46b0-bda0-5e66dea2fd31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ee28d01-fb') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:43:19 user nova-compute[71509]: DEBUG nova.objects.instance [None req-98754c0f-aaf1-405c-9be2-6b1f3f380b55 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Lazy-loading 'pci_devices' on Instance uuid ec16b4bc-5385-4eea-856f-710d52d0261d {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:43:19 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-98754c0f-aaf1-405c-9be2-6b1f3f380b55 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] [instance: ec16b4bc-5385-4eea-856f-710d52d0261d] End _get_guest_xml xml=<domain type="kvm">
Apr 14 10:43:19 user nova-compute[71509]:   <uuid>ec16b4bc-5385-4eea-856f-710d52d0261d</uuid>
Apr 14 10:43:19 user nova-compute[71509]:   <name>instance-00000006</name>
Apr 14 10:43:19 user nova-compute[71509]:   <memory>131072</memory>
Apr 14 10:43:19 user nova-compute[71509]:   <vcpu>1</vcpu>
Apr 14 10:43:19 user nova-compute[71509]:   <metadata>
Apr 14 10:43:19 user nova-compute[71509]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 10:43:19 user nova-compute[71509]:       <nova:package version="0.0.0"/>
Apr 14 10:43:19 user nova-compute[71509]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1939318021</nova:name>
Apr 14 10:43:19 user nova-compute[71509]:       <nova:creationTime>2023-04-14 10:43:19</nova:creationTime>
Apr 14 10:43:19 user nova-compute[71509]:       <nova:flavor name="m1.nano">
Apr 14 10:43:19 user nova-compute[71509]:         <nova:memory>128</nova:memory>
Apr 14 10:43:19 user nova-compute[71509]:         <nova:disk>1</nova:disk>
Apr 14 10:43:19 user nova-compute[71509]:         <nova:swap>0</nova:swap>
Apr 14 10:43:19 user nova-compute[71509]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 10:43:19 user nova-compute[71509]:         <nova:vcpus>1</nova:vcpus>
Apr 14 10:43:19 user nova-compute[71509]:       </nova:flavor>
Apr 14 10:43:19 user nova-compute[71509]:       <nova:owner>
Apr 14 10:43:19 user nova-compute[71509]:         <nova:user uuid="806d72cf0d0f4de3a4b9f0466a8e094d">tempest-AttachSCSIVolumeTestJSON-1881116553-project-member</nova:user>
Apr 14 10:43:19 user nova-compute[71509]:         <nova:project uuid="77068eae4fa9459fbe81026615d0c16d">tempest-AttachSCSIVolumeTestJSON-1881116553</nova:project>
Apr 14 10:43:19 user nova-compute[71509]:       </nova:owner>
Apr 14 10:43:19 user nova-compute[71509]:       <nova:root type="image" uuid="ed0c452a-8d78-4384-a7fd-42b906083cfb"/>
Apr 14 10:43:19 user nova-compute[71509]:       <nova:ports>
Apr 14 10:43:19 user nova-compute[71509]:         <nova:port uuid="2ee28d01-fbb2-4cf6-adcd-342fdabc8458">
Apr 14 10:43:19 user nova-compute[71509]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 14 10:43:19 user nova-compute[71509]:         </nova:port>
Apr 14 10:43:19 user nova-compute[71509]:       </nova:ports>
Apr 14 10:43:19 user nova-compute[71509]:     </nova:instance>
Apr 14 10:43:19 user nova-compute[71509]:   </metadata>
Apr 14 10:43:19 user nova-compute[71509]:   <sysinfo type="smbios">
Apr 14 10:43:19 user nova-compute[71509]:     <system>
Apr 14 10:43:19 user nova-compute[71509]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 10:43:19 user nova-compute[71509]:       <entry name="product">OpenStack Nova</entry>
Apr 14 10:43:19 user nova-compute[71509]:       <entry name="version">0.0.0</entry>
Apr 14 10:43:19 user nova-compute[71509]:       <entry name="serial">ec16b4bc-5385-4eea-856f-710d52d0261d</entry>
Apr 14 10:43:19 user nova-compute[71509]:       <entry name="uuid">ec16b4bc-5385-4eea-856f-710d52d0261d</entry>
Apr 14 10:43:19 user nova-compute[71509]:       <entry name="family">Virtual Machine</entry>
Apr 14 10:43:19 user nova-compute[71509]:     </system>
Apr 14 10:43:19 user nova-compute[71509]:   </sysinfo>
Apr 14 10:43:19 user nova-compute[71509]:   <os>
Apr 14 10:43:19 user nova-compute[71509]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 10:43:19 user nova-compute[71509]:     <boot dev="hd"/>
Apr 14 10:43:19 user nova-compute[71509]:     <smbios mode="sysinfo"/>
Apr 14 10:43:19 user nova-compute[71509]:   </os>
Apr 14 10:43:19 user nova-compute[71509]:   <features>
Apr 14 10:43:19 user nova-compute[71509]:     <acpi/>
Apr 14 10:43:19 user nova-compute[71509]:     <apic/>
Apr 14 10:43:19 user nova-compute[71509]:     <vmcoreinfo/>
Apr 14 10:43:19 user nova-compute[71509]:   </features>
Apr 14 10:43:19 user nova-compute[71509]:   <clock offset="utc">
Apr 14 10:43:19 user nova-compute[71509]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 10:43:19 user nova-compute[71509]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 10:43:19 user nova-compute[71509]:     <timer name="hpet" present="no"/>
Apr 14 10:43:19 user nova-compute[71509]:   </clock>
Apr 14 10:43:19 user nova-compute[71509]:   <cpu mode="custom" match="exact">
Apr 14 10:43:19 user nova-compute[71509]:     <model>Nehalem</model>
Apr 14 10:43:19 user nova-compute[71509]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 10:43:19 user nova-compute[71509]:   </cpu>
Apr 14 10:43:19 user nova-compute[71509]:   <devices>
Apr 14 10:43:19 user nova-compute[71509]:     <disk type="file" device="disk">
Apr 14 10:43:19 user nova-compute[71509]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 10:43:19 user nova-compute[71509]:       <source file="/opt/stack/data/nova/instances/ec16b4bc-5385-4eea-856f-710d52d0261d/disk"/>
Apr 14 10:43:19 user nova-compute[71509]:       <target dev="sda" bus="scsi"/>
Apr 14 10:43:19 user nova-compute[71509]:       <address type="drive" controller="0" unit="0"/>
Apr 14 10:43:19 user nova-compute[71509]:     </disk>
Apr 14 10:43:19 user nova-compute[71509]:     <disk type="file" device="cdrom">
Apr 14 10:43:19 user nova-compute[71509]:       <driver name="qemu" type="raw" cache="none"/>
Apr 14 10:43:19 user nova-compute[71509]:       <source file="/opt/stack/data/nova/instances/ec16b4bc-5385-4eea-856f-710d52d0261d/disk.config"/>
Apr 14 10:43:19 user nova-compute[71509]:       <target dev="sdb" bus="scsi"/>
Apr 14 10:43:19 user nova-compute[71509]:       <address type="drive" controller="0" unit="1"/>
Apr 14 10:43:19 user nova-compute[71509]:     </disk>
Apr 14 10:43:19 user nova-compute[71509]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Apr 14 10:43:19 user nova-compute[71509]:     <interface type="ethernet">
Apr 14 10:43:19 user nova-compute[71509]:       <mac address="fa:16:3e:9a:29:80"/>
Apr 14 10:43:19 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 10:43:19 user nova-compute[71509]:       <mtu size="1442"/>
Apr 14 10:43:19 user nova-compute[71509]:       <target dev="tap2ee28d01-fb"/>
Apr 14 10:43:19 user nova-compute[71509]:     </interface>
Apr 14 10:43:19 user nova-compute[71509]:     <serial type="pty">
Apr 14 10:43:19 user nova-compute[71509]:       <log file="/opt/stack/data/nova/instances/ec16b4bc-5385-4eea-856f-710d52d0261d/console.log" append="off"/>
Apr 14 10:43:19 user nova-compute[71509]:     </serial>
Apr 14 10:43:19 user nova-compute[71509]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 10:43:19 user nova-compute[71509]:     <video>
Apr 14 10:43:19 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 10:43:19 user nova-compute[71509]:     </video>
Apr 14 10:43:19 user nova-compute[71509]:     <rng model="virtio">
Apr 14 10:43:19 user nova-compute[71509]:       <backend model="random">/dev/urandom</backend>
Apr 14 10:43:19 user nova-compute[71509]:     </rng>
Apr 14 10:43:19 user nova-compute[71509]:     <controller type="usb" index="0" model="none"/>
Apr 14 10:43:19 user nova-compute[71509]:     <memballoon model="virtio">
Apr 14 10:43:19 user nova-compute[71509]:       <stats period="10"/>
Apr 14 10:43:19 user nova-compute[71509]:     </memballoon>
Apr 14 10:43:19 user nova-compute[71509]:   </devices>
Apr 14 10:43:19 user nova-compute[71509]: </domain>
Apr 14 10:43:19 user nova-compute[71509]:  {{(pid=71509) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 10:43:19 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-98754c0f-aaf1-405c-9be2-6b1f3f380b55 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T10:43:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1939318021',display_name='tempest-AttachSCSIVolumeTestJSON-server-1939318021',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1939318021',id=6,image_ref='ed0c452a-8d78-4384-a7fd-42b906083cfb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLJOFZ8W37hnq+kD091gcZmfKt0DbPWyNzwj7yK+k5JHq+c+tzsMxH1HPOh1pMpymrDK+TpdkALjgZfKfob4LIzOz/KHG73qeijcsRYqyklipL4lvgFNZ8j26eWO1fqqtg==',key_name='tempest-keypair-1306588747',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='77068eae4fa9459fbe81026615d0c16d',ramdisk_id='',reservation_id='r-mhedquh2',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ed0c452a-8d78-4384-a7fd-42b906083cfb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1881116553',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1881116553-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T10:43:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='806d72cf0d0f4de3a4b9f0466a8e094d',uuid=ec16b4bc-5385-4eea-856f-710d52d0261d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2ee28d01-fbb2-4cf6-adcd-342fdabc8458", "address": "fa:16:3e:9a:29:80", "network": {"id": "79481373-f78f-46b0-bda0-5e66dea2fd31", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1244430846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77068eae4fa9459fbe81026615d0c16d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ee28d01-fb", "ovs_interfaceid": "2ee28d01-fbb2-4cf6-adcd-342fdabc8458", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 10:43:19 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-98754c0f-aaf1-405c-9be2-6b1f3f380b55 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Converting VIF {"id": "2ee28d01-fbb2-4cf6-adcd-342fdabc8458", "address": "fa:16:3e:9a:29:80", "network": {"id": "79481373-f78f-46b0-bda0-5e66dea2fd31", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1244430846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77068eae4fa9459fbe81026615d0c16d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ee28d01-fb", "ovs_interfaceid": "2ee28d01-fbb2-4cf6-adcd-342fdabc8458", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:43:19 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-98754c0f-aaf1-405c-9be2-6b1f3f380b55 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:29:80,bridge_name='br-int',has_traffic_filtering=True,id=2ee28d01-fbb2-4cf6-adcd-342fdabc8458,network=Network(79481373-f78f-46b0-bda0-5e66dea2fd31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ee28d01-fb') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:43:19 user nova-compute[71509]: DEBUG os_vif [None req-98754c0f-aaf1-405c-9be2-6b1f3f380b55 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:29:80,bridge_name='br-int',has_traffic_filtering=True,id=2ee28d01-fbb2-4cf6-adcd-342fdabc8458,network=Network(79481373-f78f-46b0-bda0-5e66dea2fd31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ee28d01-fb') {{(pid=71509) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 10:43:19 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:43:19 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:43:19 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 10:43:19 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:43:19 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2ee28d01-fb, may_exist=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:43:19 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2ee28d01-fb, col_values=(('external_ids', {'iface-id': '2ee28d01-fbb2-4cf6-adcd-342fdabc8458', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9a:29:80', 'vm-uuid': 'ec16b4bc-5385-4eea-856f-710d52d0261d'}),)) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:43:19 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:43:19 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 10:43:19 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:43:19 user nova-compute[71509]: INFO os_vif [None req-98754c0f-aaf1-405c-9be2-6b1f3f380b55 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:29:80,bridge_name='br-int',has_traffic_filtering=True,id=2ee28d01-fbb2-4cf6-adcd-342fdabc8458,network=Network(79481373-f78f-46b0-bda0-5e66dea2fd31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ee28d01-fb')
Apr 14 10:43:19 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:43:19 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-98754c0f-aaf1-405c-9be2-6b1f3f380b55 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] No BDM found with device name sda, not building metadata. {{(pid=71509) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 10:43:19 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-98754c0f-aaf1-405c-9be2-6b1f3f380b55 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] No BDM found with device name sdb, not building metadata. {{(pid=71509) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 10:43:19 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-98754c0f-aaf1-405c-9be2-6b1f3f380b55 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] No VIF found with MAC fa:16:3e:9a:29:80, not building metadata {{(pid=71509) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 10:43:19 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-98754c0f-aaf1-405c-9be2-6b1f3f380b55 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] [instance: ec16b4bc-5385-4eea-856f-710d52d0261d] Using config drive
Apr 14 10:43:19 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-98754c0f-aaf1-405c-9be2-6b1f3f380b55 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] [instance: ec16b4bc-5385-4eea-856f-710d52d0261d] Creating config drive at /opt/stack/data/nova/instances/ec16b4bc-5385-4eea-856f-710d52d0261d/disk.config
Apr 14 10:43:19 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-98754c0f-aaf1-405c-9be2-6b1f3f380b55 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/ec16b4bc-5385-4eea-856f-710d52d0261d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpaitq3u1v {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:43:19 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-98754c0f-aaf1-405c-9be2-6b1f3f380b55 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/ec16b4bc-5385-4eea-856f-710d52d0261d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpaitq3u1v" returned: 0 in 0.065s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:43:20 user nova-compute[71509]: DEBUG nova.network.neutron [req-6887f3f8-0c57-4477-a1cb-5c21ec5d46de req-f2fce6e9-4451-4de0-a251-5cadf3595784 service nova] [instance: ec16b4bc-5385-4eea-856f-710d52d0261d] Updated VIF entry in instance network info cache for port 2ee28d01-fbb2-4cf6-adcd-342fdabc8458. {{(pid=71509) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 10:43:20 user nova-compute[71509]: DEBUG nova.network.neutron [req-6887f3f8-0c57-4477-a1cb-5c21ec5d46de req-f2fce6e9-4451-4de0-a251-5cadf3595784 service nova] [instance: ec16b4bc-5385-4eea-856f-710d52d0261d] Updating instance_info_cache with network_info: [{"id": "2ee28d01-fbb2-4cf6-adcd-342fdabc8458", "address": "fa:16:3e:9a:29:80", "network": {"id": "79481373-f78f-46b0-bda0-5e66dea2fd31", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1244430846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77068eae4fa9459fbe81026615d0c16d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ee28d01-fb", "ovs_interfaceid": "2ee28d01-fbb2-4cf6-adcd-342fdabc8458", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:43:20 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-6887f3f8-0c57-4477-a1cb-5c21ec5d46de req-f2fce6e9-4451-4de0-a251-5cadf3595784 service nova] Releasing lock "refresh_cache-ec16b4bc-5385-4eea-856f-710d52d0261d" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:43:21 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:43:21 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:43:21 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:43:21 user nova-compute[71509]: DEBUG nova.compute.manager [req-aebe8fb3-8f14-46c0-b04f-be5a0eb78365 req-b8cd23fc-635d-4850-a22f-fee94050ea27 service nova] [instance: ec16b4bc-5385-4eea-856f-710d52d0261d] Received event network-vif-plugged-2ee28d01-fbb2-4cf6-adcd-342fdabc8458 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:43:21 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-aebe8fb3-8f14-46c0-b04f-be5a0eb78365 req-b8cd23fc-635d-4850-a22f-fee94050ea27 service nova] Acquiring lock "ec16b4bc-5385-4eea-856f-710d52d0261d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:43:21 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-aebe8fb3-8f14-46c0-b04f-be5a0eb78365 req-b8cd23fc-635d-4850-a22f-fee94050ea27 service nova] Lock "ec16b4bc-5385-4eea-856f-710d52d0261d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:43:21 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-aebe8fb3-8f14-46c0-b04f-be5a0eb78365 req-b8cd23fc-635d-4850-a22f-fee94050ea27 service nova] Lock "ec16b4bc-5385-4eea-856f-710d52d0261d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:43:21 user nova-compute[71509]: DEBUG nova.compute.manager [req-aebe8fb3-8f14-46c0-b04f-be5a0eb78365 req-b8cd23fc-635d-4850-a22f-fee94050ea27 service nova] [instance: ec16b4bc-5385-4eea-856f-710d52d0261d] No waiting events found dispatching network-vif-plugged-2ee28d01-fbb2-4cf6-adcd-342fdabc8458 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:43:21 user nova-compute[71509]: WARNING nova.compute.manager [req-aebe8fb3-8f14-46c0-b04f-be5a0eb78365 req-b8cd23fc-635d-4850-a22f-fee94050ea27 service nova] [instance: ec16b4bc-5385-4eea-856f-710d52d0261d] Received unexpected event network-vif-plugged-2ee28d01-fbb2-4cf6-adcd-342fdabc8458 for instance with vm_state building and task_state spawning.
Apr 14 10:43:21 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:43:21 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:43:22 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:43:22 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-d19988b0-f4cc-4801-8fd4-bb563577fcea tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Acquiring lock "d6f539d8-4144-467b-ac69-44011c5b3564" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:43:22 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-d19988b0-f4cc-4801-8fd4-bb563577fcea tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Lock "d6f539d8-4144-467b-ac69-44011c5b3564" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:43:22 user nova-compute[71509]: DEBUG nova.compute.manager [None req-d19988b0-f4cc-4801-8fd4-bb563577fcea tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] [instance: d6f539d8-4144-467b-ac69-44011c5b3564] Starting instance... {{(pid=71509) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 10:43:22 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-d19988b0-f4cc-4801-8fd4-bb563577fcea tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:43:22 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-d19988b0-f4cc-4801-8fd4-bb563577fcea tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:43:22 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-d19988b0-f4cc-4801-8fd4-bb563577fcea tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71509) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 10:43:22 user nova-compute[71509]: INFO nova.compute.claims [None req-d19988b0-f4cc-4801-8fd4-bb563577fcea tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] [instance: d6f539d8-4144-467b-ac69-44011c5b3564] Claim successful on node user
Apr 14 10:43:22 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:43:22 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-11c4e05a-6941-451e-a5f8-d4c4e6cfefa9 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Acquiring lock "31f6ad8c-40d3-4b6e-af07-4848fafc431d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:43:22 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-11c4e05a-6941-451e-a5f8-d4c4e6cfefa9 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Lock "31f6ad8c-40d3-4b6e-af07-4848fafc431d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:43:22 user nova-compute[71509]: DEBUG nova.compute.manager [None req-11c4e05a-6941-451e-a5f8-d4c4e6cfefa9 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] [instance: 31f6ad8c-40d3-4b6e-af07-4848fafc431d] Starting instance... {{(pid=71509) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 10:43:22 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:43:22 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-11c4e05a-6941-451e-a5f8-d4c4e6cfefa9 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:43:22 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-d19988b0-f4cc-4801-8fd4-bb563577fcea tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 10:43:22 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-d19988b0-f4cc-4801-8fd4-bb563577fcea tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 10:43:22 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-d19988b0-f4cc-4801-8fd4-bb563577fcea tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.721s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:43:22 user nova-compute[71509]: DEBUG nova.compute.manager [None req-d19988b0-f4cc-4801-8fd4-bb563577fcea tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] [instance: d6f539d8-4144-467b-ac69-44011c5b3564] Start building networks asynchronously for instance. {{(pid=71509) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 10:43:22 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-11c4e05a-6941-451e-a5f8-d4c4e6cfefa9 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.142s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:43:22 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-11c4e05a-6941-451e-a5f8-d4c4e6cfefa9 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71509) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 10:43:22 user nova-compute[71509]: INFO nova.compute.claims [None req-11c4e05a-6941-451e-a5f8-d4c4e6cfefa9 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] [instance: 31f6ad8c-40d3-4b6e-af07-4848fafc431d] Claim successful on node user
Apr 14 10:43:23 user nova-compute[71509]: DEBUG nova.compute.manager [None req-d19988b0-f4cc-4801-8fd4-bb563577fcea tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] [instance: d6f539d8-4144-467b-ac69-44011c5b3564] Allocating IP information in the background. {{(pid=71509) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 10:43:23 user nova-compute[71509]: DEBUG nova.network.neutron [None req-d19988b0-f4cc-4801-8fd4-bb563577fcea tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] [instance: d6f539d8-4144-467b-ac69-44011c5b3564] allocate_for_instance() {{(pid=71509) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 10:43:23 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-d19988b0-f4cc-4801-8fd4-bb563577fcea tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] [instance: d6f539d8-4144-467b-ac69-44011c5b3564] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 10:43:23 user nova-compute[71509]: DEBUG nova.compute.manager [None req-d19988b0-f4cc-4801-8fd4-bb563577fcea tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] [instance: d6f539d8-4144-467b-ac69-44011c5b3564] Start building block device mappings for instance. {{(pid=71509) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 10:43:23 user nova-compute[71509]: DEBUG nova.policy [None req-d19988b0-f4cc-4801-8fd4-bb563577fcea tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e15c150540fa4d9c825a9ac81d674308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64094cc814374da59456a39ef9cd8cd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71509) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 10:43:23 user nova-compute[71509]: DEBUG nova.compute.manager [None req-d19988b0-f4cc-4801-8fd4-bb563577fcea tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] [instance: d6f539d8-4144-467b-ac69-44011c5b3564] Start spawning the instance on the hypervisor. {{(pid=71509) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 10:43:23 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-d19988b0-f4cc-4801-8fd4-bb563577fcea tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] [instance: d6f539d8-4144-467b-ac69-44011c5b3564] Creating instance directory {{(pid=71509) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 10:43:23 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-d19988b0-f4cc-4801-8fd4-bb563577fcea tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] [instance: d6f539d8-4144-467b-ac69-44011c5b3564] Creating image(s)
Apr 14 10:43:23 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-d19988b0-f4cc-4801-8fd4-bb563577fcea tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Acquiring lock "/opt/stack/data/nova/instances/d6f539d8-4144-467b-ac69-44011c5b3564/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:43:23 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-d19988b0-f4cc-4801-8fd4-bb563577fcea tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Lock "/opt/stack/data/nova/instances/d6f539d8-4144-467b-ac69-44011c5b3564/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:43:23 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-d19988b0-f4cc-4801-8fd4-bb563577fcea tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Lock "/opt/stack/data/nova/instances/d6f539d8-4144-467b-ac69-44011c5b3564/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:43:23 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-d19988b0-f4cc-4801-8fd4-bb563577fcea tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:43:23 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-11c4e05a-6941-451e-a5f8-d4c4e6cfefa9 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 10:43:23 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-d19988b0-f4cc-4801-8fd4-bb563577fcea tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json" returned: 0 in 0.178s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:43:23 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-d19988b0-f4cc-4801-8fd4-bb563577fcea tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Acquiring lock "5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:43:23 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-d19988b0-f4cc-4801-8fd4-bb563577fcea tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Lock "5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:43:23 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-d19988b0-f4cc-4801-8fd4-bb563577fcea tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:43:23 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-11c4e05a-6941-451e-a5f8-d4c4e6cfefa9 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 10:43:23 user nova-compute[71509]: DEBUG nova.compute.manager [req-75764197-0c8b-46bb-8fe0-44ec04143382 req-7d859391-3c4e-4e0d-b63b-e22befeb7793 service nova] [instance: ec16b4bc-5385-4eea-856f-710d52d0261d] Received event network-vif-plugged-2ee28d01-fbb2-4cf6-adcd-342fdabc8458 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:43:23 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-75764197-0c8b-46bb-8fe0-44ec04143382 req-7d859391-3c4e-4e0d-b63b-e22befeb7793 service nova] Acquiring lock "ec16b4bc-5385-4eea-856f-710d52d0261d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:43:23 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-75764197-0c8b-46bb-8fe0-44ec04143382 req-7d859391-3c4e-4e0d-b63b-e22befeb7793 service nova] Lock "ec16b4bc-5385-4eea-856f-710d52d0261d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:43:23 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-75764197-0c8b-46bb-8fe0-44ec04143382 req-7d859391-3c4e-4e0d-b63b-e22befeb7793 service nova] Lock "ec16b4bc-5385-4eea-856f-710d52d0261d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:43:23 user nova-compute[71509]: DEBUG nova.compute.manager [req-75764197-0c8b-46bb-8fe0-44ec04143382 req-7d859391-3c4e-4e0d-b63b-e22befeb7793 service nova] [instance: ec16b4bc-5385-4eea-856f-710d52d0261d] No waiting events found dispatching network-vif-plugged-2ee28d01-fbb2-4cf6-adcd-342fdabc8458 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:43:23 user nova-compute[71509]: WARNING nova.compute.manager [req-75764197-0c8b-46bb-8fe0-44ec04143382 req-7d859391-3c4e-4e0d-b63b-e22befeb7793 service nova] [instance: ec16b4bc-5385-4eea-856f-710d52d0261d] Received unexpected event network-vif-plugged-2ee28d01-fbb2-4cf6-adcd-342fdabc8458 for instance with vm_state building and task_state spawning.
Apr 14 10:43:23 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-11c4e05a-6941-451e-a5f8-d4c4e6cfefa9 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.725s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:43:23 user nova-compute[71509]: DEBUG nova.compute.manager [None req-11c4e05a-6941-451e-a5f8-d4c4e6cfefa9 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] [instance: 31f6ad8c-40d3-4b6e-af07-4848fafc431d] Start building networks asynchronously for instance. {{(pid=71509) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 10:43:23 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-d19988b0-f4cc-4801-8fd4-bb563577fcea tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json" returned: 0 in 0.250s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:43:23 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-d19988b0-f4cc-4801-8fd4-bb563577fcea tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18,backing_fmt=raw /opt/stack/data/nova/instances/d6f539d8-4144-467b-ac69-44011c5b3564/disk 1073741824 {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:43:23 user nova-compute[71509]: DEBUG nova.compute.manager [None req-11c4e05a-6941-451e-a5f8-d4c4e6cfefa9 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] [instance: 31f6ad8c-40d3-4b6e-af07-4848fafc431d] Allocating IP information in the background. {{(pid=71509) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 10:43:23 user nova-compute[71509]: DEBUG nova.network.neutron [None req-11c4e05a-6941-451e-a5f8-d4c4e6cfefa9 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] [instance: 31f6ad8c-40d3-4b6e-af07-4848fafc431d] allocate_for_instance() {{(pid=71509) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 10:43:23 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-d19988b0-f4cc-4801-8fd4-bb563577fcea tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18,backing_fmt=raw /opt/stack/data/nova/instances/d6f539d8-4144-467b-ac69-44011c5b3564/disk 1073741824" returned: 0 in 0.064s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:43:23 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-d19988b0-f4cc-4801-8fd4-bb563577fcea tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Lock "5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.318s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:43:23 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-d19988b0-f4cc-4801-8fd4-bb563577fcea tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:43:23 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-11c4e05a-6941-451e-a5f8-d4c4e6cfefa9 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] [instance: 31f6ad8c-40d3-4b6e-af07-4848fafc431d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 10:43:23 user nova-compute[71509]: DEBUG nova.compute.manager [None req-11c4e05a-6941-451e-a5f8-d4c4e6cfefa9 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] [instance: 31f6ad8c-40d3-4b6e-af07-4848fafc431d] Start building block device mappings for instance. {{(pid=71509) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 10:43:23 user nova-compute[71509]: DEBUG nova.compute.manager [None req-98754c0f-aaf1-405c-9be2-6b1f3f380b55 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] [instance: ec16b4bc-5385-4eea-856f-710d52d0261d] Instance event wait completed in 0 seconds for  {{(pid=71509) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 10:43:23 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-98754c0f-aaf1-405c-9be2-6b1f3f380b55 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] [instance: ec16b4bc-5385-4eea-856f-710d52d0261d] Guest created on hypervisor {{(pid=71509) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 10:43:23 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681469003.8832946, ec16b4bc-5385-4eea-856f-710d52d0261d => Resumed> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 10:43:23 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: ec16b4bc-5385-4eea-856f-710d52d0261d] VM Resumed (Lifecycle Event)
Apr 14 10:43:23 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: ec16b4bc-5385-4eea-856f-710d52d0261d] Instance spawned successfully.
Apr 14 10:43:23 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-98754c0f-aaf1-405c-9be2-6b1f3f380b55 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] [instance: ec16b4bc-5385-4eea-856f-710d52d0261d] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 10:43:23 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-98754c0f-aaf1-405c-9be2-6b1f3f380b55 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] [instance: ec16b4bc-5385-4eea-856f-710d52d0261d] Found default for hw_input_bus of None {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:43:23 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-98754c0f-aaf1-405c-9be2-6b1f3f380b55 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] [instance: ec16b4bc-5385-4eea-856f-710d52d0261d] Found default for hw_pointer_model of None {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:43:23 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-98754c0f-aaf1-405c-9be2-6b1f3f380b55 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] [instance: ec16b4bc-5385-4eea-856f-710d52d0261d] Found default for hw_video_model of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:43:23 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-98754c0f-aaf1-405c-9be2-6b1f3f380b55 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] [instance: ec16b4bc-5385-4eea-856f-710d52d0261d] Found default for hw_vif_model of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:43:23 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: ec16b4bc-5385-4eea-856f-710d52d0261d] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:43:23 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: ec16b4bc-5385-4eea-856f-710d52d0261d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 10:43:23 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-d19988b0-f4cc-4801-8fd4-bb563577fcea tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json" returned: 0 in 0.167s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:43:23 user nova-compute[71509]: DEBUG nova.virt.disk.api [None req-d19988b0-f4cc-4801-8fd4-bb563577fcea tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d6f539d8-4144-467b-ac69-44011c5b3564/disk. size=1073741824 {{(pid=71509) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 10:43:23 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-d19988b0-f4cc-4801-8fd4-bb563577fcea tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6f539d8-4144-467b-ac69-44011c5b3564/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:43:24 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: ec16b4bc-5385-4eea-856f-710d52d0261d] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 10:43:24 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681469003.885154, ec16b4bc-5385-4eea-856f-710d52d0261d => Started> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 10:43:24 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: ec16b4bc-5385-4eea-856f-710d52d0261d] VM Started (Lifecycle Event)
Apr 14 10:43:24 user nova-compute[71509]: DEBUG nova.policy [None req-11c4e05a-6941-451e-a5f8-d4c4e6cfefa9 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c7ce31180e5946d4a027ae6ac9d136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8cdf0a5d7f49a9897167eb79dbfc39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71509) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 10:43:24 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: ec16b4bc-5385-4eea-856f-710d52d0261d] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:43:24 user nova-compute[71509]: INFO nova.compute.manager [None req-98754c0f-aaf1-405c-9be2-6b1f3f380b55 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] [instance: ec16b4bc-5385-4eea-856f-710d52d0261d] Took 7.78 seconds to spawn the instance on the hypervisor.
Apr 14 10:43:24 user nova-compute[71509]: DEBUG nova.compute.manager [None req-98754c0f-aaf1-405c-9be2-6b1f3f380b55 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] [instance: ec16b4bc-5385-4eea-856f-710d52d0261d] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:43:24 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: ec16b4bc-5385-4eea-856f-710d52d0261d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 10:43:24 user nova-compute[71509]: DEBUG nova.compute.manager [None req-11c4e05a-6941-451e-a5f8-d4c4e6cfefa9 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] [instance: 31f6ad8c-40d3-4b6e-af07-4848fafc431d] Start spawning the instance on the hypervisor. {{(pid=71509) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 10:43:24 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-11c4e05a-6941-451e-a5f8-d4c4e6cfefa9 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] [instance: 31f6ad8c-40d3-4b6e-af07-4848fafc431d] Creating instance directory {{(pid=71509) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 10:43:24 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-11c4e05a-6941-451e-a5f8-d4c4e6cfefa9 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] [instance: 31f6ad8c-40d3-4b6e-af07-4848fafc431d] Creating image(s)
Apr 14 10:43:24 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-11c4e05a-6941-451e-a5f8-d4c4e6cfefa9 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Acquiring lock "/opt/stack/data/nova/instances/31f6ad8c-40d3-4b6e-af07-4848fafc431d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:43:24 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-11c4e05a-6941-451e-a5f8-d4c4e6cfefa9 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Lock "/opt/stack/data/nova/instances/31f6ad8c-40d3-4b6e-af07-4848fafc431d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:43:24 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-11c4e05a-6941-451e-a5f8-d4c4e6cfefa9 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Lock "/opt/stack/data/nova/instances/31f6ad8c-40d3-4b6e-af07-4848fafc431d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:43:24 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-11c4e05a-6941-451e-a5f8-d4c4e6cfefa9 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:43:24 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: ec16b4bc-5385-4eea-856f-710d52d0261d] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 10:43:24 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-d19988b0-f4cc-4801-8fd4-bb563577fcea tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6f539d8-4144-467b-ac69-44011c5b3564/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:43:24 user nova-compute[71509]: DEBUG nova.virt.disk.api [None req-d19988b0-f4cc-4801-8fd4-bb563577fcea tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Cannot resize image /opt/stack/data/nova/instances/d6f539d8-4144-467b-ac69-44011c5b3564/disk to a smaller size. {{(pid=71509) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 10:43:24 user nova-compute[71509]: DEBUG nova.objects.instance [None req-d19988b0-f4cc-4801-8fd4-bb563577fcea tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Lazy-loading 'migration_context' on Instance uuid d6f539d8-4144-467b-ac69-44011c5b3564 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:43:24 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-d19988b0-f4cc-4801-8fd4-bb563577fcea tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] [instance: d6f539d8-4144-467b-ac69-44011c5b3564] Created local disks {{(pid=71509) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 10:43:24 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-d19988b0-f4cc-4801-8fd4-bb563577fcea tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] [instance: d6f539d8-4144-467b-ac69-44011c5b3564] Ensure instance console log exists: /opt/stack/data/nova/instances/d6f539d8-4144-467b-ac69-44011c5b3564/console.log {{(pid=71509) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 10:43:24 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-d19988b0-f4cc-4801-8fd4-bb563577fcea tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:43:24 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-d19988b0-f4cc-4801-8fd4-bb563577fcea tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:43:24 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-d19988b0-f4cc-4801-8fd4-bb563577fcea tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:43:24 user nova-compute[71509]: INFO nova.compute.manager [None req-98754c0f-aaf1-405c-9be2-6b1f3f380b55 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] [instance: ec16b4bc-5385-4eea-856f-710d52d0261d] Took 9.29 seconds to build instance.
Apr 14 10:43:24 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-98754c0f-aaf1-405c-9be2-6b1f3f380b55 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Lock "ec16b4bc-5385-4eea-856f-710d52d0261d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.454s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:43:24 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-11c4e05a-6941-451e-a5f8-d4c4e6cfefa9 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json" returned: 0 in 0.166s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:43:24 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-11c4e05a-6941-451e-a5f8-d4c4e6cfefa9 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Acquiring lock "5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:43:24 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-11c4e05a-6941-451e-a5f8-d4c4e6cfefa9 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Lock "5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:43:24 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-11c4e05a-6941-451e-a5f8-d4c4e6cfefa9 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:43:24 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:43:24 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-11c4e05a-6941-451e-a5f8-d4c4e6cfefa9 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json" returned: 0 in 0.153s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:43:24 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-11c4e05a-6941-451e-a5f8-d4c4e6cfefa9 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18,backing_fmt=raw /opt/stack/data/nova/instances/31f6ad8c-40d3-4b6e-af07-4848fafc431d/disk 1073741824 {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:43:24 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-11c4e05a-6941-451e-a5f8-d4c4e6cfefa9 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18,backing_fmt=raw /opt/stack/data/nova/instances/31f6ad8c-40d3-4b6e-af07-4848fafc431d/disk 1073741824" returned: 0 in 0.089s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:43:24 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-11c4e05a-6941-451e-a5f8-d4c4e6cfefa9 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Lock "5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:43:24 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-11c4e05a-6941-451e-a5f8-d4c4e6cfefa9 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:43:24 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-11c4e05a-6941-451e-a5f8-d4c4e6cfefa9 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json" returned: 0 in 0.223s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:43:24 user nova-compute[71509]: DEBUG nova.virt.disk.api [None req-11c4e05a-6941-451e-a5f8-d4c4e6cfefa9 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Checking if we can resize image /opt/stack/data/nova/instances/31f6ad8c-40d3-4b6e-af07-4848fafc431d/disk. size=1073741824 {{(pid=71509) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 10:43:24 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-11c4e05a-6941-451e-a5f8-d4c4e6cfefa9 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31f6ad8c-40d3-4b6e-af07-4848fafc431d/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:43:24 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-11c4e05a-6941-451e-a5f8-d4c4e6cfefa9 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31f6ad8c-40d3-4b6e-af07-4848fafc431d/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:43:24 user nova-compute[71509]: DEBUG nova.virt.disk.api [None req-11c4e05a-6941-451e-a5f8-d4c4e6cfefa9 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Cannot resize image /opt/stack/data/nova/instances/31f6ad8c-40d3-4b6e-af07-4848fafc431d/disk to a smaller size. {{(pid=71509) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 10:43:24 user nova-compute[71509]: DEBUG nova.objects.instance [None req-11c4e05a-6941-451e-a5f8-d4c4e6cfefa9 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Lazy-loading 'migration_context' on Instance uuid 31f6ad8c-40d3-4b6e-af07-4848fafc431d {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:43:24 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-11c4e05a-6941-451e-a5f8-d4c4e6cfefa9 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] [instance: 31f6ad8c-40d3-4b6e-af07-4848fafc431d] Created local disks {{(pid=71509) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 10:43:24 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-11c4e05a-6941-451e-a5f8-d4c4e6cfefa9 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] [instance: 31f6ad8c-40d3-4b6e-af07-4848fafc431d] Ensure instance console log exists: /opt/stack/data/nova/instances/31f6ad8c-40d3-4b6e-af07-4848fafc431d/console.log {{(pid=71509) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 10:43:24 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-11c4e05a-6941-451e-a5f8-d4c4e6cfefa9 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:43:24 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-11c4e05a-6941-451e-a5f8-d4c4e6cfefa9 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:43:24 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-11c4e05a-6941-451e-a5f8-d4c4e6cfefa9 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:43:25 user nova-compute[71509]: DEBUG nova.network.neutron [None req-d19988b0-f4cc-4801-8fd4-bb563577fcea tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] [instance: d6f539d8-4144-467b-ac69-44011c5b3564] Successfully created port: d9ddcc5e-7cd1-4470-a3a3-4c2332f72b10 {{(pid=71509) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 10:43:25 user nova-compute[71509]: DEBUG nova.network.neutron [None req-11c4e05a-6941-451e-a5f8-d4c4e6cfefa9 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] [instance: 31f6ad8c-40d3-4b6e-af07-4848fafc431d] Successfully created port: edef0af3-01e9-4008-9017-119519f73981 {{(pid=71509) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 10:43:26 user nova-compute[71509]: DEBUG nova.network.neutron [None req-d19988b0-f4cc-4801-8fd4-bb563577fcea tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] [instance: d6f539d8-4144-467b-ac69-44011c5b3564] Successfully updated port: d9ddcc5e-7cd1-4470-a3a3-4c2332f72b10 {{(pid=71509) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 10:43:26 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-d19988b0-f4cc-4801-8fd4-bb563577fcea tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Acquiring lock "refresh_cache-d6f539d8-4144-467b-ac69-44011c5b3564" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:43:26 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-d19988b0-f4cc-4801-8fd4-bb563577fcea tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Acquired lock "refresh_cache-d6f539d8-4144-467b-ac69-44011c5b3564" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:43:26 user nova-compute[71509]: DEBUG nova.network.neutron [None req-d19988b0-f4cc-4801-8fd4-bb563577fcea tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] [instance: d6f539d8-4144-467b-ac69-44011c5b3564] Building network info cache for instance {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 10:43:26 user nova-compute[71509]: DEBUG nova.compute.manager [req-817a5a20-f8b2-4519-89c9-14be386dd733 req-d81b008c-5a0c-413c-99ae-5518dcfa700a service nova] [instance: d6f539d8-4144-467b-ac69-44011c5b3564] Received event network-changed-d9ddcc5e-7cd1-4470-a3a3-4c2332f72b10 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:43:26 user nova-compute[71509]: DEBUG nova.compute.manager [req-817a5a20-f8b2-4519-89c9-14be386dd733 req-d81b008c-5a0c-413c-99ae-5518dcfa700a service nova] [instance: d6f539d8-4144-467b-ac69-44011c5b3564] Refreshing instance network info cache due to event network-changed-d9ddcc5e-7cd1-4470-a3a3-4c2332f72b10. {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 10:43:26 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-817a5a20-f8b2-4519-89c9-14be386dd733 req-d81b008c-5a0c-413c-99ae-5518dcfa700a service nova] Acquiring lock "refresh_cache-d6f539d8-4144-467b-ac69-44011c5b3564" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:43:26 user nova-compute[71509]: DEBUG nova.network.neutron [None req-d19988b0-f4cc-4801-8fd4-bb563577fcea tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] [instance: d6f539d8-4144-467b-ac69-44011c5b3564] Instance cache missing network info. {{(pid=71509) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 10:43:26 user nova-compute[71509]: DEBUG nova.network.neutron [None req-11c4e05a-6941-451e-a5f8-d4c4e6cfefa9 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] [instance: 31f6ad8c-40d3-4b6e-af07-4848fafc431d] Successfully updated port: edef0af3-01e9-4008-9017-119519f73981 {{(pid=71509) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 10:43:26 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-11c4e05a-6941-451e-a5f8-d4c4e6cfefa9 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Acquiring lock "refresh_cache-31f6ad8c-40d3-4b6e-af07-4848fafc431d" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:43:26 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-11c4e05a-6941-451e-a5f8-d4c4e6cfefa9 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Acquired lock "refresh_cache-31f6ad8c-40d3-4b6e-af07-4848fafc431d" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:43:26 user nova-compute[71509]: DEBUG nova.network.neutron [None req-11c4e05a-6941-451e-a5f8-d4c4e6cfefa9 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] [instance: 31f6ad8c-40d3-4b6e-af07-4848fafc431d] Building network info cache for instance {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 10:43:27 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:43:27 user nova-compute[71509]: DEBUG nova.compute.manager [req-18d9ac0e-1fb2-4752-977a-e783aed67527 req-4c31d249-935d-4ec0-8ee8-7072cb0644c5 service nova] [instance: 31f6ad8c-40d3-4b6e-af07-4848fafc431d] Received event network-changed-edef0af3-01e9-4008-9017-119519f73981 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:43:27 user nova-compute[71509]: DEBUG nova.compute.manager [req-18d9ac0e-1fb2-4752-977a-e783aed67527 req-4c31d249-935d-4ec0-8ee8-7072cb0644c5 service nova] [instance: 31f6ad8c-40d3-4b6e-af07-4848fafc431d] Refreshing instance network info cache due to event network-changed-edef0af3-01e9-4008-9017-119519f73981. {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 10:43:27 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-18d9ac0e-1fb2-4752-977a-e783aed67527 req-4c31d249-935d-4ec0-8ee8-7072cb0644c5 service nova] Acquiring lock "refresh_cache-31f6ad8c-40d3-4b6e-af07-4848fafc431d" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:43:27 user nova-compute[71509]: DEBUG nova.network.neutron [None req-11c4e05a-6941-451e-a5f8-d4c4e6cfefa9 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] [instance: 31f6ad8c-40d3-4b6e-af07-4848fafc431d] Instance cache missing network info. {{(pid=71509) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 10:43:27 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:43:27 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:43:27 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71509) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 10:43:27 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:43:27 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:43:27 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Cleaning up deleted instances {{(pid=71509) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 14 10:43:27 user nova-compute[71509]: DEBUG nova.network.neutron [None req-11c4e05a-6941-451e-a5f8-d4c4e6cfefa9 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] [instance: 31f6ad8c-40d3-4b6e-af07-4848fafc431d] Updating instance_info_cache with network_info: [{"id": "edef0af3-01e9-4008-9017-119519f73981", "address": "fa:16:3e:2a:16:ab", "network": {"id": "d0f56839-45f6-4d90-9a69-0a5d300e3c53", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-962046654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe8cdf0a5d7f49a9897167eb79dbfc39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedef0af3-01", "ovs_interfaceid": "edef0af3-01e9-4008-9017-119519f73981", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:43:27 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] There are 0 instances to clean {{(pid=71509) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 14 10:43:27 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:43:27 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71509) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 14 10:43:27 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-11c4e05a-6941-451e-a5f8-d4c4e6cfefa9 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Releasing lock "refresh_cache-31f6ad8c-40d3-4b6e-af07-4848fafc431d" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:43:27 user nova-compute[71509]: DEBUG nova.compute.manager [None req-11c4e05a-6941-451e-a5f8-d4c4e6cfefa9 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] [instance: 31f6ad8c-40d3-4b6e-af07-4848fafc431d] Instance network_info: |[{"id": "edef0af3-01e9-4008-9017-119519f73981", "address": "fa:16:3e:2a:16:ab", "network": {"id": "d0f56839-45f6-4d90-9a69-0a5d300e3c53", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-962046654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe8cdf0a5d7f49a9897167eb79dbfc39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedef0af3-01", "ovs_interfaceid": "edef0af3-01e9-4008-9017-119519f73981", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71509) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 10:43:27 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-18d9ac0e-1fb2-4752-977a-e783aed67527 req-4c31d249-935d-4ec0-8ee8-7072cb0644c5 service nova] Acquired lock "refresh_cache-31f6ad8c-40d3-4b6e-af07-4848fafc431d" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:43:27 user nova-compute[71509]: DEBUG nova.network.neutron [req-18d9ac0e-1fb2-4752-977a-e783aed67527 req-4c31d249-935d-4ec0-8ee8-7072cb0644c5 service nova] [instance: 31f6ad8c-40d3-4b6e-af07-4848fafc431d] Refreshing network info cache for port edef0af3-01e9-4008-9017-119519f73981 {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 10:43:27 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-11c4e05a-6941-451e-a5f8-d4c4e6cfefa9 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] [instance: 31f6ad8c-40d3-4b6e-af07-4848fafc431d] Start _get_guest_xml network_info=[{"id": "edef0af3-01e9-4008-9017-119519f73981", "address": "fa:16:3e:2a:16:ab", "network": {"id": "d0f56839-45f6-4d90-9a69-0a5d300e3c53", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-962046654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe8cdf0a5d7f49a9897167eb79dbfc39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedef0af3-01", "ovs_interfaceid": "edef0af3-01e9-4008-9017-119519f73981", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T10:38:55Z,direct_url=<?>,disk_format='qcow2',id=048ec0ee-0465-448d-8b4c-f072acb101dc,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='9742d6ad20cf48d9bab0fdbcc9491db9',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T10:38:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '048ec0ee-0465-448d-8b4c-f072acb101dc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71509) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 10:43:27 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:43:27 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-11c4e05a-6941-451e-a5f8-d4c4e6cfefa9 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:43:27 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-11c4e05a-6941-451e-a5f8-d4c4e6cfefa9 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:43:27 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-11c4e05a-6941-451e-a5f8-d4c4e6cfefa9 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71509) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 10:43:27 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-11c4e05a-6941-451e-a5f8-d4c4e6cfefa9 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T10:40:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T10:38:55Z,direct_url=<?>,disk_format='qcow2',id=048ec0ee-0465-448d-8b4c-f072acb101dc,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='9742d6ad20cf48d9bab0fdbcc9491db9',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T10:38:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 10:43:27 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-11c4e05a-6941-451e-a5f8-d4c4e6cfefa9 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Flavor limits 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 10:43:27 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-11c4e05a-6941-451e-a5f8-d4c4e6cfefa9 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Image limits 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 10:43:27 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-11c4e05a-6941-451e-a5f8-d4c4e6cfefa9 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Flavor pref 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 10:43:27 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-11c4e05a-6941-451e-a5f8-d4c4e6cfefa9 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Image pref 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 10:43:27 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-11c4e05a-6941-451e-a5f8-d4c4e6cfefa9 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 10:43:27 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-11c4e05a-6941-451e-a5f8-d4c4e6cfefa9 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 10:43:27 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-11c4e05a-6941-451e-a5f8-d4c4e6cfefa9 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71509) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 10:43:27 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-11c4e05a-6941-451e-a5f8-d4c4e6cfefa9 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Got 1 possible topologies {{(pid=71509) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 10:43:27 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-11c4e05a-6941-451e-a5f8-d4c4e6cfefa9 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 10:43:27 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-11c4e05a-6941-451e-a5f8-d4c4e6cfefa9 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 10:43:27 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-11c4e05a-6941-451e-a5f8-d4c4e6cfefa9 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T10:43:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1767995033',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1767995033',id=8,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAg92rKWvJLt4w+A2kLtzcKlRZllCdVCDpTieGdgT9uh8Ad5t/MvIIcaNE/YQBHARvcYgshBiRX60EUhdlUvUMSVKsG5MBNdYdax1bLq6yx8+hLej82SZYaOv31/N253aw==',key_name='tempest-keypair-1362955333',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fe8cdf0a5d7f49a9897167eb79dbfc39',ramdisk_id='',reservation_id='r-7roeogsj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1745854352',owner_user_name='tempest-TaggedAttachmentsTest-1745854352-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T10:43:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c7ce31180e5946d4a027ae6ac9d136fa',uuid=31f6ad8c-40d3-4b6e-af07-4848fafc431d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "edef0af3-01e9-4008-9017-119519f73981", "address": "fa:16:3e:2a:16:ab", "network": {"id": "d0f56839-45f6-4d90-9a69-0a5d300e3c53", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-962046654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe8cdf0a5d7f49a9897167eb79dbfc39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedef0af3-01", "ovs_interfaceid": "edef0af3-01e9-4008-9017-119519f73981", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71509) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 10:43:27 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-11c4e05a-6941-451e-a5f8-d4c4e6cfefa9 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Converting VIF {"id": "edef0af3-01e9-4008-9017-119519f73981", "address": "fa:16:3e:2a:16:ab", "network": {"id": "d0f56839-45f6-4d90-9a69-0a5d300e3c53", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-962046654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe8cdf0a5d7f49a9897167eb79dbfc39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedef0af3-01", "ovs_interfaceid": "edef0af3-01e9-4008-9017-119519f73981", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:43:27 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-11c4e05a-6941-451e-a5f8-d4c4e6cfefa9 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:16:ab,bridge_name='br-int',has_traffic_filtering=True,id=edef0af3-01e9-4008-9017-119519f73981,network=Network(d0f56839-45f6-4d90-9a69-0a5d300e3c53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedef0af3-01') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:43:27 user nova-compute[71509]: DEBUG nova.objects.instance [None req-11c4e05a-6941-451e-a5f8-d4c4e6cfefa9 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Lazy-loading 'pci_devices' on Instance uuid 31f6ad8c-40d3-4b6e-af07-4848fafc431d {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:43:27 user nova-compute[71509]: DEBUG nova.network.neutron [None req-d19988b0-f4cc-4801-8fd4-bb563577fcea tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] [instance: d6f539d8-4144-467b-ac69-44011c5b3564] Updating instance_info_cache with network_info: [{"id": "d9ddcc5e-7cd1-4470-a3a3-4c2332f72b10", "address": "fa:16:3e:33:37:3e", "network": {"id": "18e10605-b5d7-4446-9cb7-34a989b33763", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1073535411-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64094cc814374da59456a39ef9cd8cd2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9ddcc5e-7c", "ovs_interfaceid": "d9ddcc5e-7cd1-4470-a3a3-4c2332f72b10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:43:27 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-11c4e05a-6941-451e-a5f8-d4c4e6cfefa9 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] [instance: 31f6ad8c-40d3-4b6e-af07-4848fafc431d] End _get_guest_xml xml=<domain type="kvm">
Apr 14 10:43:27 user nova-compute[71509]:   <uuid>31f6ad8c-40d3-4b6e-af07-4848fafc431d</uuid>
Apr 14 10:43:27 user nova-compute[71509]:   <name>instance-00000008</name>
Apr 14 10:43:27 user nova-compute[71509]:   <memory>131072</memory>
Apr 14 10:43:27 user nova-compute[71509]:   <vcpu>1</vcpu>
Apr 14 10:43:27 user nova-compute[71509]:   <metadata>
Apr 14 10:43:27 user nova-compute[71509]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 10:43:27 user nova-compute[71509]:       <nova:package version="0.0.0"/>
Apr 14 10:43:27 user nova-compute[71509]:       <nova:name>tempest-device-tagging-server-1767995033</nova:name>
Apr 14 10:43:27 user nova-compute[71509]:       <nova:creationTime>2023-04-14 10:43:27</nova:creationTime>
Apr 14 10:43:27 user nova-compute[71509]:       <nova:flavor name="m1.nano">
Apr 14 10:43:27 user nova-compute[71509]:         <nova:memory>128</nova:memory>
Apr 14 10:43:27 user nova-compute[71509]:         <nova:disk>1</nova:disk>
Apr 14 10:43:27 user nova-compute[71509]:         <nova:swap>0</nova:swap>
Apr 14 10:43:27 user nova-compute[71509]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 10:43:27 user nova-compute[71509]:         <nova:vcpus>1</nova:vcpus>
Apr 14 10:43:27 user nova-compute[71509]:       </nova:flavor>
Apr 14 10:43:27 user nova-compute[71509]:       <nova:owner>
Apr 14 10:43:27 user nova-compute[71509]:         <nova:user uuid="c7ce31180e5946d4a027ae6ac9d136fa">tempest-TaggedAttachmentsTest-1745854352-project-member</nova:user>
Apr 14 10:43:27 user nova-compute[71509]:         <nova:project uuid="fe8cdf0a5d7f49a9897167eb79dbfc39">tempest-TaggedAttachmentsTest-1745854352</nova:project>
Apr 14 10:43:27 user nova-compute[71509]:       </nova:owner>
Apr 14 10:43:27 user nova-compute[71509]:       <nova:root type="image" uuid="048ec0ee-0465-448d-8b4c-f072acb101dc"/>
Apr 14 10:43:27 user nova-compute[71509]:       <nova:ports>
Apr 14 10:43:27 user nova-compute[71509]:         <nova:port uuid="edef0af3-01e9-4008-9017-119519f73981">
Apr 14 10:43:27 user nova-compute[71509]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 14 10:43:27 user nova-compute[71509]:         </nova:port>
Apr 14 10:43:27 user nova-compute[71509]:       </nova:ports>
Apr 14 10:43:27 user nova-compute[71509]:     </nova:instance>
Apr 14 10:43:27 user nova-compute[71509]:   </metadata>
Apr 14 10:43:27 user nova-compute[71509]:   <sysinfo type="smbios">
Apr 14 10:43:27 user nova-compute[71509]:     <system>
Apr 14 10:43:27 user nova-compute[71509]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 10:43:27 user nova-compute[71509]:       <entry name="product">OpenStack Nova</entry>
Apr 14 10:43:27 user nova-compute[71509]:       <entry name="version">0.0.0</entry>
Apr 14 10:43:27 user nova-compute[71509]:       <entry name="serial">31f6ad8c-40d3-4b6e-af07-4848fafc431d</entry>
Apr 14 10:43:27 user nova-compute[71509]:       <entry name="uuid">31f6ad8c-40d3-4b6e-af07-4848fafc431d</entry>
Apr 14 10:43:27 user nova-compute[71509]:       <entry name="family">Virtual Machine</entry>
Apr 14 10:43:27 user nova-compute[71509]:     </system>
Apr 14 10:43:27 user nova-compute[71509]:   </sysinfo>
Apr 14 10:43:27 user nova-compute[71509]:   <os>
Apr 14 10:43:27 user nova-compute[71509]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 10:43:27 user nova-compute[71509]:     <boot dev="hd"/>
Apr 14 10:43:27 user nova-compute[71509]:     <smbios mode="sysinfo"/>
Apr 14 10:43:27 user nova-compute[71509]:   </os>
Apr 14 10:43:27 user nova-compute[71509]:   <features>
Apr 14 10:43:27 user nova-compute[71509]:     <acpi/>
Apr 14 10:43:27 user nova-compute[71509]:     <apic/>
Apr 14 10:43:27 user nova-compute[71509]:     <vmcoreinfo/>
Apr 14 10:43:27 user nova-compute[71509]:   </features>
Apr 14 10:43:27 user nova-compute[71509]:   <clock offset="utc">
Apr 14 10:43:27 user nova-compute[71509]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 10:43:27 user nova-compute[71509]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 10:43:27 user nova-compute[71509]:     <timer name="hpet" present="no"/>
Apr 14 10:43:27 user nova-compute[71509]:   </clock>
Apr 14 10:43:27 user nova-compute[71509]:   <cpu mode="custom" match="exact">
Apr 14 10:43:27 user nova-compute[71509]:     <model>Nehalem</model>
Apr 14 10:43:27 user nova-compute[71509]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 10:43:27 user nova-compute[71509]:   </cpu>
Apr 14 10:43:27 user nova-compute[71509]:   <devices>
Apr 14 10:43:27 user nova-compute[71509]:     <disk type="file" device="disk">
Apr 14 10:43:27 user nova-compute[71509]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 10:43:27 user nova-compute[71509]:       <source file="/opt/stack/data/nova/instances/31f6ad8c-40d3-4b6e-af07-4848fafc431d/disk"/>
Apr 14 10:43:27 user nova-compute[71509]:       <target dev="vda" bus="virtio"/>
Apr 14 10:43:27 user nova-compute[71509]:     </disk>
Apr 14 10:43:27 user nova-compute[71509]:     <disk type="file" device="cdrom">
Apr 14 10:43:27 user nova-compute[71509]:       <driver name="qemu" type="raw" cache="none"/>
Apr 14 10:43:27 user nova-compute[71509]:       <source file="/opt/stack/data/nova/instances/31f6ad8c-40d3-4b6e-af07-4848fafc431d/disk.config"/>
Apr 14 10:43:27 user nova-compute[71509]:       <target dev="hda" bus="ide"/>
Apr 14 10:43:27 user nova-compute[71509]:     </disk>
Apr 14 10:43:27 user nova-compute[71509]:     <interface type="ethernet">
Apr 14 10:43:27 user nova-compute[71509]:       <mac address="fa:16:3e:2a:16:ab"/>
Apr 14 10:43:27 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 10:43:27 user nova-compute[71509]:       <mtu size="1442"/>
Apr 14 10:43:27 user nova-compute[71509]:       <target dev="tapedef0af3-01"/>
Apr 14 10:43:27 user nova-compute[71509]:     </interface>
Apr 14 10:43:27 user nova-compute[71509]:     <serial type="pty">
Apr 14 10:43:27 user nova-compute[71509]:       <log file="/opt/stack/data/nova/instances/31f6ad8c-40d3-4b6e-af07-4848fafc431d/console.log" append="off"/>
Apr 14 10:43:27 user nova-compute[71509]:     </serial>
Apr 14 10:43:27 user nova-compute[71509]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 10:43:27 user nova-compute[71509]:     <video>
Apr 14 10:43:27 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 10:43:27 user nova-compute[71509]:     </video>
Apr 14 10:43:27 user nova-compute[71509]:     <rng model="virtio">
Apr 14 10:43:27 user nova-compute[71509]:       <backend model="random">/dev/urandom</backend>
Apr 14 10:43:27 user nova-compute[71509]:     </rng>
Apr 14 10:43:27 user nova-compute[71509]:     <controller type="usb" index="0" model="none"/>
Apr 14 10:43:27 user nova-compute[71509]:     <memballoon model="virtio">
Apr 14 10:43:27 user nova-compute[71509]:       <stats period="10"/>
Apr 14 10:43:27 user nova-compute[71509]:     </memballoon>
Apr 14 10:43:27 user nova-compute[71509]:   </devices>
Apr 14 10:43:27 user nova-compute[71509]: </domain>
Apr 14 10:43:27 user nova-compute[71509]:  {{(pid=71509) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 10:43:27 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-11c4e05a-6941-451e-a5f8-d4c4e6cfefa9 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T10:43:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1767995033',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1767995033',id=8,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAg92rKWvJLt4w+A2kLtzcKlRZllCdVCDpTieGdgT9uh8Ad5t/MvIIcaNE/YQBHARvcYgshBiRX60EUhdlUvUMSVKsG5MBNdYdax1bLq6yx8+hLej82SZYaOv31/N253aw==',key_name='tempest-keypair-1362955333',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fe8cdf0a5d7f49a9897167eb79dbfc39',ramdisk_id='',reservation_id='r-7roeogsj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1745854352',owner_user_name='tempest-TaggedAttachmentsTest-1745854352-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T10:43:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c7ce31180e5946d4a027ae6ac9d136fa',uuid=31f6ad8c-40d3-4b6e-af07-4848fafc431d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "edef0af3-01e9-4008-9017-119519f73981", "address": "fa:16:3e:2a:16:ab", "network": {"id": "d0f56839-45f6-4d90-9a69-0a5d300e3c53", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-962046654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe8cdf0a5d7f49a9897167eb79dbfc39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedef0af3-01", "ovs_interfaceid": "edef0af3-01e9-4008-9017-119519f73981", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 10:43:27 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-11c4e05a-6941-451e-a5f8-d4c4e6cfefa9 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Converting VIF {"id": "edef0af3-01e9-4008-9017-119519f73981", "address": "fa:16:3e:2a:16:ab", "network": {"id": "d0f56839-45f6-4d90-9a69-0a5d300e3c53", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-962046654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe8cdf0a5d7f49a9897167eb79dbfc39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedef0af3-01", "ovs_interfaceid": "edef0af3-01e9-4008-9017-119519f73981", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:43:27 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-11c4e05a-6941-451e-a5f8-d4c4e6cfefa9 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:16:ab,bridge_name='br-int',has_traffic_filtering=True,id=edef0af3-01e9-4008-9017-119519f73981,network=Network(d0f56839-45f6-4d90-9a69-0a5d300e3c53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedef0af3-01') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:43:27 user nova-compute[71509]: DEBUG os_vif [None req-11c4e05a-6941-451e-a5f8-d4c4e6cfefa9 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:16:ab,bridge_name='br-int',has_traffic_filtering=True,id=edef0af3-01e9-4008-9017-119519f73981,network=Network(d0f56839-45f6-4d90-9a69-0a5d300e3c53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedef0af3-01') {{(pid=71509) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 10:43:27 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:43:27 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:43:27 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 10:43:27 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-d19988b0-f4cc-4801-8fd4-bb563577fcea tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Releasing lock "refresh_cache-d6f539d8-4144-467b-ac69-44011c5b3564" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:43:27 user nova-compute[71509]: DEBUG nova.compute.manager [None req-d19988b0-f4cc-4801-8fd4-bb563577fcea tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] [instance: d6f539d8-4144-467b-ac69-44011c5b3564] Instance network_info: |[{"id": "d9ddcc5e-7cd1-4470-a3a3-4c2332f72b10", "address": "fa:16:3e:33:37:3e", "network": {"id": "18e10605-b5d7-4446-9cb7-34a989b33763", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1073535411-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64094cc814374da59456a39ef9cd8cd2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9ddcc5e-7c", "ovs_interfaceid": "d9ddcc5e-7cd1-4470-a3a3-4c2332f72b10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71509) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 10:43:27 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-817a5a20-f8b2-4519-89c9-14be386dd733 req-d81b008c-5a0c-413c-99ae-5518dcfa700a service nova] Acquired lock "refresh_cache-d6f539d8-4144-467b-ac69-44011c5b3564" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:43:27 user nova-compute[71509]: DEBUG nova.network.neutron [req-817a5a20-f8b2-4519-89c9-14be386dd733 req-d81b008c-5a0c-413c-99ae-5518dcfa700a service nova] [instance: d6f539d8-4144-467b-ac69-44011c5b3564] Refreshing network info cache for port d9ddcc5e-7cd1-4470-a3a3-4c2332f72b10 {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 10:43:27 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-d19988b0-f4cc-4801-8fd4-bb563577fcea tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] [instance: d6f539d8-4144-467b-ac69-44011c5b3564] Start _get_guest_xml network_info=[{"id": "d9ddcc5e-7cd1-4470-a3a3-4c2332f72b10", "address": "fa:16:3e:33:37:3e", "network": {"id": "18e10605-b5d7-4446-9cb7-34a989b33763", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1073535411-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64094cc814374da59456a39ef9cd8cd2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9ddcc5e-7c", "ovs_interfaceid": "d9ddcc5e-7cd1-4470-a3a3-4c2332f72b10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T10:38:55Z,direct_url=<?>,disk_format='qcow2',id=048ec0ee-0465-448d-8b4c-f072acb101dc,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='9742d6ad20cf48d9bab0fdbcc9491db9',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T10:38:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '048ec0ee-0465-448d-8b4c-f072acb101dc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71509) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 10:43:27 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:43:27 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapedef0af3-01, may_exist=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:43:27 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapedef0af3-01, col_values=(('external_ids', {'iface-id': 'edef0af3-01e9-4008-9017-119519f73981', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2a:16:ab', 'vm-uuid': '31f6ad8c-40d3-4b6e-af07-4848fafc431d'}),)) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:43:27 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:43:27 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:43:27 user nova-compute[71509]: INFO os_vif [None req-11c4e05a-6941-451e-a5f8-d4c4e6cfefa9 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:16:ab,bridge_name='br-int',has_traffic_filtering=True,id=edef0af3-01e9-4008-9017-119519f73981,network=Network(d0f56839-45f6-4d90-9a69-0a5d300e3c53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedef0af3-01')
Apr 14 10:43:27 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-d19988b0-f4cc-4801-8fd4-bb563577fcea tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:43:27 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-d19988b0-f4cc-4801-8fd4-bb563577fcea tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:43:27 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-d19988b0-f4cc-4801-8fd4-bb563577fcea tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71509) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 10:43:27 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-d19988b0-f4cc-4801-8fd4-bb563577fcea tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T10:40:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T10:38:55Z,direct_url=<?>,disk_format='qcow2',id=048ec0ee-0465-448d-8b4c-f072acb101dc,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='9742d6ad20cf48d9bab0fdbcc9491db9',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T10:38:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 10:43:27 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-d19988b0-f4cc-4801-8fd4-bb563577fcea tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Flavor limits 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 10:43:27 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-d19988b0-f4cc-4801-8fd4-bb563577fcea tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Image limits 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 10:43:27 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-d19988b0-f4cc-4801-8fd4-bb563577fcea tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Flavor pref 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 10:43:27 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-d19988b0-f4cc-4801-8fd4-bb563577fcea tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Image pref 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 10:43:27 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-d19988b0-f4cc-4801-8fd4-bb563577fcea tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 10:43:27 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-d19988b0-f4cc-4801-8fd4-bb563577fcea tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 10:43:27 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-d19988b0-f4cc-4801-8fd4-bb563577fcea tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71509) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 10:43:27 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-d19988b0-f4cc-4801-8fd4-bb563577fcea tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Got 1 possible topologies {{(pid=71509) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 10:43:27 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-d19988b0-f4cc-4801-8fd4-bb563577fcea tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 10:43:27 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-d19988b0-f4cc-4801-8fd4-bb563577fcea tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 10:43:27 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-d19988b0-f4cc-4801-8fd4-bb563577fcea tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T10:43:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-200701793',display_name='tempest-TestVolumeSwap-server-200701793',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumeswap-server-200701793',id=7,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFdp8DvIWzTdfQlZzBSWMm9TWVpW4Azm62lnWvgtwkAByNAiB4NOgWADUm4IuHKDHgDw6vr4SDZiH+/UlF++dOtHWNBkJxFq/sQk6UhVQojd3P/v2dpPDWmyAw5MBNgqfg==',key_name='tempest-keypair-1731536774',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='64094cc814374da59456a39ef9cd8cd2',ramdisk_id='',reservation_id='r-k1zsu4t1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-2101147705',owner_user_name='tempest-TestVolumeSwap-2101147705-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T10:43:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e15c150540fa4d9c825a9ac81d674308',uuid=d6f539d8-4144-467b-ac69-44011c5b3564,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d9ddcc5e-7cd1-4470-a3a3-4c2332f72b10", "address": "fa:16:3e:33:37:3e", "network": {"id": "18e10605-b5d7-4446-9cb7-34a989b33763", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1073535411-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64094cc814374da59456a39ef9cd8cd2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9ddcc5e-7c", "ovs_interfaceid": "d9ddcc5e-7cd1-4470-a3a3-4c2332f72b10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71509) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 10:43:27 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-d19988b0-f4cc-4801-8fd4-bb563577fcea tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Converting VIF {"id": "d9ddcc5e-7cd1-4470-a3a3-4c2332f72b10", "address": "fa:16:3e:33:37:3e", "network": {"id": "18e10605-b5d7-4446-9cb7-34a989b33763", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1073535411-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64094cc814374da59456a39ef9cd8cd2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9ddcc5e-7c", "ovs_interfaceid": "d9ddcc5e-7cd1-4470-a3a3-4c2332f72b10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:43:27 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-d19988b0-f4cc-4801-8fd4-bb563577fcea tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:37:3e,bridge_name='br-int',has_traffic_filtering=True,id=d9ddcc5e-7cd1-4470-a3a3-4c2332f72b10,network=Network(18e10605-b5d7-4446-9cb7-34a989b33763),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9ddcc5e-7c') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:43:27 user nova-compute[71509]: DEBUG nova.objects.instance [None req-d19988b0-f4cc-4801-8fd4-bb563577fcea tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Lazy-loading 'pci_devices' on Instance uuid d6f539d8-4144-467b-ac69-44011c5b3564 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:43:27 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-d19988b0-f4cc-4801-8fd4-bb563577fcea tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] [instance: d6f539d8-4144-467b-ac69-44011c5b3564] End _get_guest_xml xml=<domain type="kvm">
Apr 14 10:43:27 user nova-compute[71509]:   <uuid>d6f539d8-4144-467b-ac69-44011c5b3564</uuid>
Apr 14 10:43:27 user nova-compute[71509]:   <name>instance-00000007</name>
Apr 14 10:43:27 user nova-compute[71509]:   <memory>131072</memory>
Apr 14 10:43:27 user nova-compute[71509]:   <vcpu>1</vcpu>
Apr 14 10:43:27 user nova-compute[71509]:   <metadata>
Apr 14 10:43:27 user nova-compute[71509]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 10:43:27 user nova-compute[71509]:       <nova:package version="0.0.0"/>
Apr 14 10:43:27 user nova-compute[71509]:       <nova:name>tempest-TestVolumeSwap-server-200701793</nova:name>
Apr 14 10:43:27 user nova-compute[71509]:       <nova:creationTime>2023-04-14 10:43:27</nova:creationTime>
Apr 14 10:43:27 user nova-compute[71509]:       <nova:flavor name="m1.nano">
Apr 14 10:43:27 user nova-compute[71509]:         <nova:memory>128</nova:memory>
Apr 14 10:43:27 user nova-compute[71509]:         <nova:disk>1</nova:disk>
Apr 14 10:43:27 user nova-compute[71509]:         <nova:swap>0</nova:swap>
Apr 14 10:43:27 user nova-compute[71509]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 10:43:27 user nova-compute[71509]:         <nova:vcpus>1</nova:vcpus>
Apr 14 10:43:27 user nova-compute[71509]:       </nova:flavor>
Apr 14 10:43:27 user nova-compute[71509]:       <nova:owner>
Apr 14 10:43:27 user nova-compute[71509]:         <nova:user uuid="e15c150540fa4d9c825a9ac81d674308">tempest-TestVolumeSwap-2101147705-project-member</nova:user>
Apr 14 10:43:27 user nova-compute[71509]:         <nova:project uuid="64094cc814374da59456a39ef9cd8cd2">tempest-TestVolumeSwap-2101147705</nova:project>
Apr 14 10:43:27 user nova-compute[71509]:       </nova:owner>
Apr 14 10:43:27 user nova-compute[71509]:       <nova:root type="image" uuid="048ec0ee-0465-448d-8b4c-f072acb101dc"/>
Apr 14 10:43:27 user nova-compute[71509]:       <nova:ports>
Apr 14 10:43:27 user nova-compute[71509]:         <nova:port uuid="d9ddcc5e-7cd1-4470-a3a3-4c2332f72b10">
Apr 14 10:43:27 user nova-compute[71509]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 14 10:43:27 user nova-compute[71509]:         </nova:port>
Apr 14 10:43:27 user nova-compute[71509]:       </nova:ports>
Apr 14 10:43:27 user nova-compute[71509]:     </nova:instance>
Apr 14 10:43:27 user nova-compute[71509]:   </metadata>
Apr 14 10:43:27 user nova-compute[71509]:   <sysinfo type="smbios">
Apr 14 10:43:27 user nova-compute[71509]:     <system>
Apr 14 10:43:27 user nova-compute[71509]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 10:43:27 user nova-compute[71509]:       <entry name="product">OpenStack Nova</entry>
Apr 14 10:43:27 user nova-compute[71509]:       <entry name="version">0.0.0</entry>
Apr 14 10:43:27 user nova-compute[71509]:       <entry name="serial">d6f539d8-4144-467b-ac69-44011c5b3564</entry>
Apr 14 10:43:27 user nova-compute[71509]:       <entry name="uuid">d6f539d8-4144-467b-ac69-44011c5b3564</entry>
Apr 14 10:43:27 user nova-compute[71509]:       <entry name="family">Virtual Machine</entry>
Apr 14 10:43:27 user nova-compute[71509]:     </system>
Apr 14 10:43:27 user nova-compute[71509]:   </sysinfo>
Apr 14 10:43:27 user nova-compute[71509]:   <os>
Apr 14 10:43:27 user nova-compute[71509]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 10:43:27 user nova-compute[71509]:     <boot dev="hd"/>
Apr 14 10:43:27 user nova-compute[71509]:     <smbios mode="sysinfo"/>
Apr 14 10:43:27 user nova-compute[71509]:   </os>
Apr 14 10:43:27 user nova-compute[71509]:   <features>
Apr 14 10:43:27 user nova-compute[71509]:     <acpi/>
Apr 14 10:43:27 user nova-compute[71509]:     <apic/>
Apr 14 10:43:27 user nova-compute[71509]:     <vmcoreinfo/>
Apr 14 10:43:27 user nova-compute[71509]:   </features>
Apr 14 10:43:27 user nova-compute[71509]:   <clock offset="utc">
Apr 14 10:43:27 user nova-compute[71509]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 10:43:27 user nova-compute[71509]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 10:43:27 user nova-compute[71509]:     <timer name="hpet" present="no"/>
Apr 14 10:43:27 user nova-compute[71509]:   </clock>
Apr 14 10:43:27 user nova-compute[71509]:   <cpu mode="custom" match="exact">
Apr 14 10:43:27 user nova-compute[71509]:     <model>Nehalem</model>
Apr 14 10:43:27 user nova-compute[71509]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 10:43:27 user nova-compute[71509]:   </cpu>
Apr 14 10:43:27 user nova-compute[71509]:   <devices>
Apr 14 10:43:27 user nova-compute[71509]:     <disk type="file" device="disk">
Apr 14 10:43:27 user nova-compute[71509]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 10:43:27 user nova-compute[71509]:       <source file="/opt/stack/data/nova/instances/d6f539d8-4144-467b-ac69-44011c5b3564/disk"/>
Apr 14 10:43:27 user nova-compute[71509]:       <target dev="vda" bus="virtio"/>
Apr 14 10:43:27 user nova-compute[71509]:     </disk>
Apr 14 10:43:27 user nova-compute[71509]:     <interface type="ethernet">
Apr 14 10:43:27 user nova-compute[71509]:       <mac address="fa:16:3e:33:37:3e"/>
Apr 14 10:43:27 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 10:43:27 user nova-compute[71509]:       <mtu size="1442"/>
Apr 14 10:43:27 user nova-compute[71509]:       <target dev="tapd9ddcc5e-7c"/>
Apr 14 10:43:27 user nova-compute[71509]:     </interface>
Apr 14 10:43:27 user nova-compute[71509]:     <serial type="pty">
Apr 14 10:43:27 user nova-compute[71509]:       <log file="/opt/stack/data/nova/instances/d6f539d8-4144-467b-ac69-44011c5b3564/console.log" append="off"/>
Apr 14 10:43:27 user nova-compute[71509]:     </serial>
Apr 14 10:43:27 user nova-compute[71509]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 10:43:27 user nova-compute[71509]:     <video>
Apr 14 10:43:27 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 10:43:27 user nova-compute[71509]:     </video>
Apr 14 10:43:27 user nova-compute[71509]:     <rng model="virtio">
Apr 14 10:43:27 user nova-compute[71509]:       <backend model="random">/dev/urandom</backend>
Apr 14 10:43:27 user nova-compute[71509]:     </rng>
Apr 14 10:43:27 user nova-compute[71509]:     <controller type="usb" index="0" model="none"/>
Apr 14 10:43:27 user nova-compute[71509]:     <memballoon model="virtio">
Apr 14 10:43:27 user nova-compute[71509]:       <stats period="10"/>
Apr 14 10:43:27 user nova-compute[71509]:     </memballoon>
Apr 14 10:43:27 user nova-compute[71509]:   </devices>
Apr 14 10:43:27 user nova-compute[71509]: </domain>
Apr 14 10:43:27 user nova-compute[71509]:  {{(pid=71509) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 10:43:27 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-d19988b0-f4cc-4801-8fd4-bb563577fcea tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T10:43:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-200701793',display_name='tempest-TestVolumeSwap-server-200701793',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumeswap-server-200701793',id=7,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFdp8DvIWzTdfQlZzBSWMm9TWVpW4Azm62lnWvgtwkAByNAiB4NOgWADUm4IuHKDHgDw6vr4SDZiH+/UlF++dOtHWNBkJxFq/sQk6UhVQojd3P/v2dpPDWmyAw5MBNgqfg==',key_name='tempest-keypair-1731536774',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='64094cc814374da59456a39ef9cd8cd2',ramdisk_id='',reservation_id='r-k1zsu4t1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-2101147705',owner_user_name='tempest-TestVolumeSwap-2101147705-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T10:43:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e15c150540fa4d9c825a9ac81d674308',uuid=d6f539d8-4144-467b-ac69-44011c5b3564,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d9ddcc5e-7cd1-4470-a3a3-4c2332f72b10", "address": "fa:16:3e:33:37:3e", "network": {"id": "18e10605-b5d7-4446-9cb7-34a989b33763", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1073535411-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64094cc814374da59456a39ef9cd8cd2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9ddcc5e-7c", "ovs_interfaceid": "d9ddcc5e-7cd1-4470-a3a3-4c2332f72b10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 10:43:27 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-d19988b0-f4cc-4801-8fd4-bb563577fcea tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Converting VIF {"id": "d9ddcc5e-7cd1-4470-a3a3-4c2332f72b10", "address": "fa:16:3e:33:37:3e", "network": {"id": "18e10605-b5d7-4446-9cb7-34a989b33763", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1073535411-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64094cc814374da59456a39ef9cd8cd2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9ddcc5e-7c", "ovs_interfaceid": "d9ddcc5e-7cd1-4470-a3a3-4c2332f72b10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:43:27 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-d19988b0-f4cc-4801-8fd4-bb563577fcea tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:37:3e,bridge_name='br-int',has_traffic_filtering=True,id=d9ddcc5e-7cd1-4470-a3a3-4c2332f72b10,network=Network(18e10605-b5d7-4446-9cb7-34a989b33763),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9ddcc5e-7c') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:43:27 user nova-compute[71509]: DEBUG os_vif [None req-d19988b0-f4cc-4801-8fd4-bb563577fcea tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:37:3e,bridge_name='br-int',has_traffic_filtering=True,id=d9ddcc5e-7cd1-4470-a3a3-4c2332f72b10,network=Network(18e10605-b5d7-4446-9cb7-34a989b33763),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9ddcc5e-7c') {{(pid=71509) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 10:43:27 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:43:27 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:43:27 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 10:43:27 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:43:27 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd9ddcc5e-7c, may_exist=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:43:27 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd9ddcc5e-7c, col_values=(('external_ids', {'iface-id': 'd9ddcc5e-7cd1-4470-a3a3-4c2332f72b10', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:33:37:3e', 'vm-uuid': 'd6f539d8-4144-467b-ac69-44011c5b3564'}),)) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:43:27 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:43:27 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 10:43:27 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:43:27 user nova-compute[71509]: INFO os_vif [None req-d19988b0-f4cc-4801-8fd4-bb563577fcea tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:37:3e,bridge_name='br-int',has_traffic_filtering=True,id=d9ddcc5e-7cd1-4470-a3a3-4c2332f72b10,network=Network(18e10605-b5d7-4446-9cb7-34a989b33763),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9ddcc5e-7c')
Apr 14 10:43:27 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-11c4e05a-6941-451e-a5f8-d4c4e6cfefa9 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] No BDM found with device name vda, not building metadata. {{(pid=71509) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 10:43:27 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-11c4e05a-6941-451e-a5f8-d4c4e6cfefa9 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] No BDM found with device name hda, not building metadata. {{(pid=71509) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 10:43:27 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-11c4e05a-6941-451e-a5f8-d4c4e6cfefa9 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] No VIF found with MAC fa:16:3e:2a:16:ab, not building metadata {{(pid=71509) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 10:43:27 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-11c4e05a-6941-451e-a5f8-d4c4e6cfefa9 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] [instance: 31f6ad8c-40d3-4b6e-af07-4848fafc431d] Using config drive
Apr 14 10:43:27 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-d19988b0-f4cc-4801-8fd4-bb563577fcea tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] No BDM found with device name vda, not building metadata. {{(pid=71509) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 10:43:27 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-d19988b0-f4cc-4801-8fd4-bb563577fcea tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] No VIF found with MAC fa:16:3e:33:37:3e, not building metadata {{(pid=71509) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 10:43:28 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-11c4e05a-6941-451e-a5f8-d4c4e6cfefa9 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] [instance: 31f6ad8c-40d3-4b6e-af07-4848fafc431d] Creating config drive at /opt/stack/data/nova/instances/31f6ad8c-40d3-4b6e-af07-4848fafc431d/disk.config
Apr 14 10:43:28 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-11c4e05a-6941-451e-a5f8-d4c4e6cfefa9 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/31f6ad8c-40d3-4b6e-af07-4848fafc431d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp_l4inw2x {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:43:28 user nova-compute[71509]: DEBUG nova.network.neutron [req-18d9ac0e-1fb2-4752-977a-e783aed67527 req-4c31d249-935d-4ec0-8ee8-7072cb0644c5 service nova] [instance: 31f6ad8c-40d3-4b6e-af07-4848fafc431d] Updated VIF entry in instance network info cache for port edef0af3-01e9-4008-9017-119519f73981. {{(pid=71509) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 10:43:28 user nova-compute[71509]: DEBUG nova.network.neutron [req-18d9ac0e-1fb2-4752-977a-e783aed67527 req-4c31d249-935d-4ec0-8ee8-7072cb0644c5 service nova] [instance: 31f6ad8c-40d3-4b6e-af07-4848fafc431d] Updating instance_info_cache with network_info: [{"id": "edef0af3-01e9-4008-9017-119519f73981", "address": "fa:16:3e:2a:16:ab", "network": {"id": "d0f56839-45f6-4d90-9a69-0a5d300e3c53", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-962046654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe8cdf0a5d7f49a9897167eb79dbfc39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedef0af3-01", "ovs_interfaceid": "edef0af3-01e9-4008-9017-119519f73981", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:43:28 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-11c4e05a-6941-451e-a5f8-d4c4e6cfefa9 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/31f6ad8c-40d3-4b6e-af07-4848fafc431d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp_l4inw2x" returned: 0 in 0.059s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:43:28 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-18d9ac0e-1fb2-4752-977a-e783aed67527 req-4c31d249-935d-4ec0-8ee8-7072cb0644c5 service nova] Releasing lock "refresh_cache-31f6ad8c-40d3-4b6e-af07-4848fafc431d" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:43:28 user nova-compute[71509]: DEBUG nova.network.neutron [req-817a5a20-f8b2-4519-89c9-14be386dd733 req-d81b008c-5a0c-413c-99ae-5518dcfa700a service nova] [instance: d6f539d8-4144-467b-ac69-44011c5b3564] Updated VIF entry in instance network info cache for port d9ddcc5e-7cd1-4470-a3a3-4c2332f72b10. {{(pid=71509) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 10:43:28 user nova-compute[71509]: DEBUG nova.network.neutron [req-817a5a20-f8b2-4519-89c9-14be386dd733 req-d81b008c-5a0c-413c-99ae-5518dcfa700a service nova] [instance: d6f539d8-4144-467b-ac69-44011c5b3564] Updating instance_info_cache with network_info: [{"id": "d9ddcc5e-7cd1-4470-a3a3-4c2332f72b10", "address": "fa:16:3e:33:37:3e", "network": {"id": "18e10605-b5d7-4446-9cb7-34a989b33763", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1073535411-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64094cc814374da59456a39ef9cd8cd2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9ddcc5e-7c", "ovs_interfaceid": "d9ddcc5e-7cd1-4470-a3a3-4c2332f72b10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:43:28 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-817a5a20-f8b2-4519-89c9-14be386dd733 req-d81b008c-5a0c-413c-99ae-5518dcfa700a service nova] Releasing lock "refresh_cache-d6f539d8-4144-467b-ac69-44011c5b3564" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:43:28 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:43:28 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:43:29 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:43:30 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:43:30 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:43:30 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:43:30 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:43:30 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:43:30 user nova-compute[71509]: DEBUG nova.compute.manager [req-8aec832c-9a22-46cc-ba11-b6a678bfbee0 req-b0f48ca6-be87-470c-b8ff-a57900c492de service nova] [instance: d6f539d8-4144-467b-ac69-44011c5b3564] Received event network-vif-plugged-d9ddcc5e-7cd1-4470-a3a3-4c2332f72b10 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:43:30 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-8aec832c-9a22-46cc-ba11-b6a678bfbee0 req-b0f48ca6-be87-470c-b8ff-a57900c492de service nova] Acquiring lock "d6f539d8-4144-467b-ac69-44011c5b3564-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:43:30 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-8aec832c-9a22-46cc-ba11-b6a678bfbee0 req-b0f48ca6-be87-470c-b8ff-a57900c492de service nova] Lock "d6f539d8-4144-467b-ac69-44011c5b3564-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:43:30 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-8aec832c-9a22-46cc-ba11-b6a678bfbee0 req-b0f48ca6-be87-470c-b8ff-a57900c492de service nova] Lock "d6f539d8-4144-467b-ac69-44011c5b3564-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:43:30 user nova-compute[71509]: DEBUG nova.compute.manager [req-8aec832c-9a22-46cc-ba11-b6a678bfbee0 req-b0f48ca6-be87-470c-b8ff-a57900c492de service nova] [instance: d6f539d8-4144-467b-ac69-44011c5b3564] No waiting events found dispatching network-vif-plugged-d9ddcc5e-7cd1-4470-a3a3-4c2332f72b10 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:43:30 user nova-compute[71509]: WARNING nova.compute.manager [req-8aec832c-9a22-46cc-ba11-b6a678bfbee0 req-b0f48ca6-be87-470c-b8ff-a57900c492de service nova] [instance: d6f539d8-4144-467b-ac69-44011c5b3564] Received unexpected event network-vif-plugged-d9ddcc5e-7cd1-4470-a3a3-4c2332f72b10 for instance with vm_state building and task_state spawning.
Apr 14 10:43:30 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:43:30 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:43:30 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:43:31 user nova-compute[71509]: DEBUG nova.compute.manager [req-44bfe1d5-52f7-42cc-9424-050a8f9bb049 req-ca57e38a-64bc-41c7-9979-d0ffdcf1a797 service nova] [instance: 31f6ad8c-40d3-4b6e-af07-4848fafc431d] Received event network-vif-plugged-edef0af3-01e9-4008-9017-119519f73981 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:43:31 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-44bfe1d5-52f7-42cc-9424-050a8f9bb049 req-ca57e38a-64bc-41c7-9979-d0ffdcf1a797 service nova] Acquiring lock "31f6ad8c-40d3-4b6e-af07-4848fafc431d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:43:31 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-44bfe1d5-52f7-42cc-9424-050a8f9bb049 req-ca57e38a-64bc-41c7-9979-d0ffdcf1a797 service nova] Lock "31f6ad8c-40d3-4b6e-af07-4848fafc431d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:43:31 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-44bfe1d5-52f7-42cc-9424-050a8f9bb049 req-ca57e38a-64bc-41c7-9979-d0ffdcf1a797 service nova] Lock "31f6ad8c-40d3-4b6e-af07-4848fafc431d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:43:31 user nova-compute[71509]: DEBUG nova.compute.manager [req-44bfe1d5-52f7-42cc-9424-050a8f9bb049 req-ca57e38a-64bc-41c7-9979-d0ffdcf1a797 service nova] [instance: 31f6ad8c-40d3-4b6e-af07-4848fafc431d] No waiting events found dispatching network-vif-plugged-edef0af3-01e9-4008-9017-119519f73981 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:43:31 user nova-compute[71509]: WARNING nova.compute.manager [req-44bfe1d5-52f7-42cc-9424-050a8f9bb049 req-ca57e38a-64bc-41c7-9979-d0ffdcf1a797 service nova] [instance: 31f6ad8c-40d3-4b6e-af07-4848fafc431d] Received unexpected event network-vif-plugged-edef0af3-01e9-4008-9017-119519f73981 for instance with vm_state building and task_state spawning.
Apr 14 10:43:31 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:43:31 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:43:31 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:43:31 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:43:31 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:43:31 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:43:32 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:43:32 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:43:32 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:43:32 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:43:32 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:43:32 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:43:32 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Auditing locally available compute resources for user (node: user) {{(pid=71509) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 10:43:32 user nova-compute[71509]: DEBUG nova.compute.manager [req-8f21ee98-6033-4616-b139-8442140832fb req-cece726a-f9f6-4d19-9c22-38001533f9f9 service nova] [instance: d6f539d8-4144-467b-ac69-44011c5b3564] Received event network-vif-plugged-d9ddcc5e-7cd1-4470-a3a3-4c2332f72b10 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:43:32 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-8f21ee98-6033-4616-b139-8442140832fb req-cece726a-f9f6-4d19-9c22-38001533f9f9 service nova] Acquiring lock "d6f539d8-4144-467b-ac69-44011c5b3564-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:43:32 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-8f21ee98-6033-4616-b139-8442140832fb req-cece726a-f9f6-4d19-9c22-38001533f9f9 service nova] Lock "d6f539d8-4144-467b-ac69-44011c5b3564-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:43:32 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-8f21ee98-6033-4616-b139-8442140832fb req-cece726a-f9f6-4d19-9c22-38001533f9f9 service nova] Lock "d6f539d8-4144-467b-ac69-44011c5b3564-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:43:32 user nova-compute[71509]: DEBUG nova.compute.manager [req-8f21ee98-6033-4616-b139-8442140832fb req-cece726a-f9f6-4d19-9c22-38001533f9f9 service nova] [instance: d6f539d8-4144-467b-ac69-44011c5b3564] No waiting events found dispatching network-vif-plugged-d9ddcc5e-7cd1-4470-a3a3-4c2332f72b10 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:43:32 user nova-compute[71509]: WARNING nova.compute.manager [req-8f21ee98-6033-4616-b139-8442140832fb req-cece726a-f9f6-4d19-9c22-38001533f9f9 service nova] [instance: d6f539d8-4144-467b-ac69-44011c5b3564] Received unexpected event network-vif-plugged-d9ddcc5e-7cd1-4470-a3a3-4c2332f72b10 for instance with vm_state building and task_state spawning.
Apr 14 10:43:32 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:43:32 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97820f17-22d1-4ec3-9721-1edadccc794a/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:43:33 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97820f17-22d1-4ec3-9721-1edadccc794a/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:43:33 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97820f17-22d1-4ec3-9721-1edadccc794a/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:43:33 user nova-compute[71509]: DEBUG nova.compute.manager [req-15f69858-437f-45c0-a37e-984b2a652189 req-cbba216c-7b80-444c-b378-13a3c5cb3478 service nova] [instance: 31f6ad8c-40d3-4b6e-af07-4848fafc431d] Received event network-vif-plugged-edef0af3-01e9-4008-9017-119519f73981 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:43:33 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-15f69858-437f-45c0-a37e-984b2a652189 req-cbba216c-7b80-444c-b378-13a3c5cb3478 service nova] Acquiring lock "31f6ad8c-40d3-4b6e-af07-4848fafc431d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:43:33 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-15f69858-437f-45c0-a37e-984b2a652189 req-cbba216c-7b80-444c-b378-13a3c5cb3478 service nova] Lock "31f6ad8c-40d3-4b6e-af07-4848fafc431d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:43:33 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-15f69858-437f-45c0-a37e-984b2a652189 req-cbba216c-7b80-444c-b378-13a3c5cb3478 service nova] Lock "31f6ad8c-40d3-4b6e-af07-4848fafc431d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:43:33 user nova-compute[71509]: DEBUG nova.compute.manager [req-15f69858-437f-45c0-a37e-984b2a652189 req-cbba216c-7b80-444c-b378-13a3c5cb3478 service nova] [instance: 31f6ad8c-40d3-4b6e-af07-4848fafc431d] No waiting events found dispatching network-vif-plugged-edef0af3-01e9-4008-9017-119519f73981 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:43:33 user nova-compute[71509]: WARNING nova.compute.manager [req-15f69858-437f-45c0-a37e-984b2a652189 req-cbba216c-7b80-444c-b378-13a3c5cb3478 service nova] [instance: 31f6ad8c-40d3-4b6e-af07-4848fafc431d] Received unexpected event network-vif-plugged-edef0af3-01e9-4008-9017-119519f73981 for instance with vm_state building and task_state spawning.
Apr 14 10:43:33 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97820f17-22d1-4ec3-9721-1edadccc794a/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:43:33 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4abb549-8f36-40c5-971f-8accbb14ff86/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:43:33 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4abb549-8f36-40c5-971f-8accbb14ff86/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:43:33 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4abb549-8f36-40c5-971f-8accbb14ff86/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:43:33 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4abb549-8f36-40c5-971f-8accbb14ff86/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:43:33 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6f539d8-4144-467b-ac69-44011c5b3564/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:43:33 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681469013.8013113, d6f539d8-4144-467b-ac69-44011c5b3564 => Resumed> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 10:43:33 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: d6f539d8-4144-467b-ac69-44011c5b3564] VM Resumed (Lifecycle Event)
Apr 14 10:43:33 user nova-compute[71509]: DEBUG nova.compute.manager [None req-d19988b0-f4cc-4801-8fd4-bb563577fcea tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] [instance: d6f539d8-4144-467b-ac69-44011c5b3564] Instance event wait completed in 0 seconds for  {{(pid=71509) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 10:43:33 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-d19988b0-f4cc-4801-8fd4-bb563577fcea tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] [instance: d6f539d8-4144-467b-ac69-44011c5b3564] Guest created on hypervisor {{(pid=71509) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 10:43:33 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6f539d8-4144-467b-ac69-44011c5b3564/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:43:33 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6f539d8-4144-467b-ac69-44011c5b3564/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:43:33 user nova-compute[71509]: DEBUG nova.compute.manager [None req-11c4e05a-6941-451e-a5f8-d4c4e6cfefa9 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] [instance: 31f6ad8c-40d3-4b6e-af07-4848fafc431d] Instance event wait completed in 0 seconds for  {{(pid=71509) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 10:43:33 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-11c4e05a-6941-451e-a5f8-d4c4e6cfefa9 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] [instance: 31f6ad8c-40d3-4b6e-af07-4848fafc431d] Guest created on hypervisor {{(pid=71509) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 10:43:33 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: d6f539d8-4144-467b-ac69-44011c5b3564] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:43:33 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: d6f539d8-4144-467b-ac69-44011c5b3564] Instance spawned successfully.
Apr 14 10:43:33 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-d19988b0-f4cc-4801-8fd4-bb563577fcea tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] [instance: d6f539d8-4144-467b-ac69-44011c5b3564] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 10:43:33 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: d6f539d8-4144-467b-ac69-44011c5b3564] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 10:43:33 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: 31f6ad8c-40d3-4b6e-af07-4848fafc431d] Instance spawned successfully.
Apr 14 10:43:33 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-11c4e05a-6941-451e-a5f8-d4c4e6cfefa9 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] [instance: 31f6ad8c-40d3-4b6e-af07-4848fafc431d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 10:43:33 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: d6f539d8-4144-467b-ac69-44011c5b3564] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 10:43:33 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681469013.8027816, d6f539d8-4144-467b-ac69-44011c5b3564 => Started> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 10:43:33 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: d6f539d8-4144-467b-ac69-44011c5b3564] VM Started (Lifecycle Event)
Apr 14 10:43:33 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-d19988b0-f4cc-4801-8fd4-bb563577fcea tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] [instance: d6f539d8-4144-467b-ac69-44011c5b3564] Found default for hw_cdrom_bus of ide {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:43:33 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-d19988b0-f4cc-4801-8fd4-bb563577fcea tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] [instance: d6f539d8-4144-467b-ac69-44011c5b3564] Found default for hw_disk_bus of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:43:33 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-d19988b0-f4cc-4801-8fd4-bb563577fcea tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] [instance: d6f539d8-4144-467b-ac69-44011c5b3564] Found default for hw_input_bus of None {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:43:33 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-d19988b0-f4cc-4801-8fd4-bb563577fcea tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] [instance: d6f539d8-4144-467b-ac69-44011c5b3564] Found default for hw_pointer_model of None {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:43:33 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-d19988b0-f4cc-4801-8fd4-bb563577fcea tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] [instance: d6f539d8-4144-467b-ac69-44011c5b3564] Found default for hw_video_model of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:43:33 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-d19988b0-f4cc-4801-8fd4-bb563577fcea tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] [instance: d6f539d8-4144-467b-ac69-44011c5b3564] Found default for hw_vif_model of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:43:33 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-11c4e05a-6941-451e-a5f8-d4c4e6cfefa9 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] [instance: 31f6ad8c-40d3-4b6e-af07-4848fafc431d] Found default for hw_cdrom_bus of ide {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:43:33 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-11c4e05a-6941-451e-a5f8-d4c4e6cfefa9 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] [instance: 31f6ad8c-40d3-4b6e-af07-4848fafc431d] Found default for hw_disk_bus of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:43:33 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-11c4e05a-6941-451e-a5f8-d4c4e6cfefa9 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] [instance: 31f6ad8c-40d3-4b6e-af07-4848fafc431d] Found default for hw_input_bus of None {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:43:33 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-11c4e05a-6941-451e-a5f8-d4c4e6cfefa9 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] [instance: 31f6ad8c-40d3-4b6e-af07-4848fafc431d] Found default for hw_pointer_model of None {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:43:33 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-11c4e05a-6941-451e-a5f8-d4c4e6cfefa9 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] [instance: 31f6ad8c-40d3-4b6e-af07-4848fafc431d] Found default for hw_video_model of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:43:33 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-11c4e05a-6941-451e-a5f8-d4c4e6cfefa9 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] [instance: 31f6ad8c-40d3-4b6e-af07-4848fafc431d] Found default for hw_vif_model of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:43:33 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: d6f539d8-4144-467b-ac69-44011c5b3564] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:43:34 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: d6f539d8-4144-467b-ac69-44011c5b3564] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 10:43:34 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6f539d8-4144-467b-ac69-44011c5b3564/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:43:34 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e6c800c-9b35-4e35-969e-c40367056dce/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:43:34 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: d6f539d8-4144-467b-ac69-44011c5b3564] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 10:43:34 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681469013.8758256, 31f6ad8c-40d3-4b6e-af07-4848fafc431d => Resumed> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 10:43:34 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 31f6ad8c-40d3-4b6e-af07-4848fafc431d] VM Resumed (Lifecycle Event)
Apr 14 10:43:34 user nova-compute[71509]: INFO nova.compute.manager [None req-d19988b0-f4cc-4801-8fd4-bb563577fcea tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] [instance: d6f539d8-4144-467b-ac69-44011c5b3564] Took 10.98 seconds to spawn the instance on the hypervisor.
Apr 14 10:43:34 user nova-compute[71509]: DEBUG nova.compute.manager [None req-d19988b0-f4cc-4801-8fd4-bb563577fcea tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] [instance: d6f539d8-4144-467b-ac69-44011c5b3564] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:43:34 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 31f6ad8c-40d3-4b6e-af07-4848fafc431d] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:43:34 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 31f6ad8c-40d3-4b6e-af07-4848fafc431d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 10:43:34 user nova-compute[71509]: INFO nova.compute.manager [None req-11c4e05a-6941-451e-a5f8-d4c4e6cfefa9 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] [instance: 31f6ad8c-40d3-4b6e-af07-4848fafc431d] Took 10.20 seconds to spawn the instance on the hypervisor.
Apr 14 10:43:34 user nova-compute[71509]: DEBUG nova.compute.manager [None req-11c4e05a-6941-451e-a5f8-d4c4e6cfefa9 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] [instance: 31f6ad8c-40d3-4b6e-af07-4848fafc431d] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:43:34 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e6c800c-9b35-4e35-969e-c40367056dce/disk --force-share --output=json" returned: 0 in 0.270s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:43:34 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e6c800c-9b35-4e35-969e-c40367056dce/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:43:34 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 31f6ad8c-40d3-4b6e-af07-4848fafc431d] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 10:43:34 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681469013.8763046, 31f6ad8c-40d3-4b6e-af07-4848fafc431d => Started> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 10:43:34 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 31f6ad8c-40d3-4b6e-af07-4848fafc431d] VM Started (Lifecycle Event)
Apr 14 10:43:34 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 31f6ad8c-40d3-4b6e-af07-4848fafc431d] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:43:34 user nova-compute[71509]: INFO nova.compute.manager [None req-d19988b0-f4cc-4801-8fd4-bb563577fcea tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] [instance: d6f539d8-4144-467b-ac69-44011c5b3564] Took 12.33 seconds to build instance.
Apr 14 10:43:34 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 31f6ad8c-40d3-4b6e-af07-4848fafc431d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 10:43:34 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 31f6ad8c-40d3-4b6e-af07-4848fafc431d] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 10:43:34 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-d19988b0-f4cc-4801-8fd4-bb563577fcea tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Lock "d6f539d8-4144-467b-ac69-44011c5b3564" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.523s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:43:34 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e6c800c-9b35-4e35-969e-c40367056dce/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:43:34 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97f20661-8b60-439e-b7af-2fc2013c5ade/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:43:34 user nova-compute[71509]: INFO nova.compute.manager [None req-11c4e05a-6941-451e-a5f8-d4c4e6cfefa9 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] [instance: 31f6ad8c-40d3-4b6e-af07-4848fafc431d] Took 11.92 seconds to build instance.
Apr 14 10:43:34 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-11c4e05a-6941-451e-a5f8-d4c4e6cfefa9 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Lock "31f6ad8c-40d3-4b6e-af07-4848fafc431d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.075s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:43:34 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97f20661-8b60-439e-b7af-2fc2013c5ade/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:43:34 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97f20661-8b60-439e-b7af-2fc2013c5ade/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:43:35 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97f20661-8b60-439e-b7af-2fc2013c5ade/disk --force-share --output=json" returned: 0 in 0.338s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:43:35 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec16b4bc-5385-4eea-856f-710d52d0261d/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:43:35 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec16b4bc-5385-4eea-856f-710d52d0261d/disk --force-share --output=json" returned: 0 in 0.363s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:43:35 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec16b4bc-5385-4eea-856f-710d52d0261d/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:43:35 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec16b4bc-5385-4eea-856f-710d52d0261d/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:43:35 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31f6ad8c-40d3-4b6e-af07-4848fafc431d/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:43:35 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31f6ad8c-40d3-4b6e-af07-4848fafc431d/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:43:35 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31f6ad8c-40d3-4b6e-af07-4848fafc431d/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:43:36 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31f6ad8c-40d3-4b6e-af07-4848fafc431d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:43:36 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c90a9b99-0985-403b-b4d8-eaa8c2eed88a/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:43:36 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c90a9b99-0985-403b-b4d8-eaa8c2eed88a/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:43:36 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c90a9b99-0985-403b-b4d8-eaa8c2eed88a/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:43:36 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c90a9b99-0985-403b-b4d8-eaa8c2eed88a/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:43:37 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:43:37 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:43:37 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:43:37 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Hypervisor/Node resource view: name=user free_ram=7799MB free_disk=26.437767028808594GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71509) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 10:43:37 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:43:37 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:43:38 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance c90a9b99-0985-403b-b4d8-eaa8c2eed88a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:43:38 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance b4abb549-8f36-40c5-971f-8accbb14ff86 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:43:38 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 0e6c800c-9b35-4e35-969e-c40367056dce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:43:38 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance d6f539d8-4144-467b-ac69-44011c5b3564 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:43:38 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance ec16b4bc-5385-4eea-856f-710d52d0261d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:43:38 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 97820f17-22d1-4ec3-9721-1edadccc794a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:43:38 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 97f20661-8b60-439e-b7af-2fc2013c5ade actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:43:38 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 31f6ad8c-40d3-4b6e-af07-4848fafc431d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:43:38 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=71509) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 10:43:38 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Final resource view: name=user phys_ram=16023MB used_ram=1536MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=71509) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 10:43:38 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Refreshing inventories for resource provider 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 14 10:43:38 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Updating ProviderTree inventory for provider 52209f7e-594e-4cf4-9018-18636056cd6b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 14 10:43:38 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Updating inventory in ProviderTree for provider 52209f7e-594e-4cf4-9018-18636056cd6b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 14 10:43:38 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Refreshing aggregate associations for resource provider 52209f7e-594e-4cf4-9018-18636056cd6b, aggregates: None {{(pid=71509) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 14 10:43:38 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Refreshing trait associations for resource provider 52209f7e-594e-4cf4-9018-18636056cd6b, traits: COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE42,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_SATA {{(pid=71509) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 14 10:43:38 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 10:43:38 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 10:43:38 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Compute_service record updated for user:user {{(pid=71509) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 10:43:38 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.162s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:43:39 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:43:39 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Starting heal instance info cache {{(pid=71509) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 10:43:39 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Rebuilding the list of instances to heal {{(pid=71509) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 10:43:40 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "refresh_cache-c90a9b99-0985-403b-b4d8-eaa8c2eed88a" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:43:40 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquired lock "refresh_cache-c90a9b99-0985-403b-b4d8-eaa8c2eed88a" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:43:40 user nova-compute[71509]: DEBUG nova.network.neutron [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] [instance: c90a9b99-0985-403b-b4d8-eaa8c2eed88a] Forcefully refreshing network info cache for instance {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 10:43:40 user nova-compute[71509]: DEBUG nova.objects.instance [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lazy-loading 'info_cache' on Instance uuid c90a9b99-0985-403b-b4d8-eaa8c2eed88a {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:43:41 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-90f10194-e12b-4161-91b5-14ccc5d317ea tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] Acquiring lock "c0e2af6d-3694-4166-a3d0-b5be1107c488" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:43:41 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-90f10194-e12b-4161-91b5-14ccc5d317ea tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] Lock "c0e2af6d-3694-4166-a3d0-b5be1107c488" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:43:41 user nova-compute[71509]: DEBUG nova.compute.manager [None req-90f10194-e12b-4161-91b5-14ccc5d317ea tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] [instance: c0e2af6d-3694-4166-a3d0-b5be1107c488] Starting instance... {{(pid=71509) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 10:43:41 user nova-compute[71509]: DEBUG nova.network.neutron [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] [instance: c90a9b99-0985-403b-b4d8-eaa8c2eed88a] Updating instance_info_cache with network_info: [{"id": "5bd8d359-958a-4b76-ac87-156c2a2adf35", "address": "fa:16:3e:80:f6:9f", "network": {"id": "8034a3f8-0149-4d7b-b457-350a881baafe", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1634360617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30856983340a435d8e92f138fdecaa35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bd8d359-95", "ovs_interfaceid": "5bd8d359-958a-4b76-ac87-156c2a2adf35", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:43:41 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Releasing lock "refresh_cache-c90a9b99-0985-403b-b4d8-eaa8c2eed88a" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:43:41 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] [instance: c90a9b99-0985-403b-b4d8-eaa8c2eed88a] Updated the network info_cache for instance {{(pid=71509) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 10:43:41 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-90f10194-e12b-4161-91b5-14ccc5d317ea tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:43:41 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-90f10194-e12b-4161-91b5-14ccc5d317ea tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:43:41 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-90f10194-e12b-4161-91b5-14ccc5d317ea tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71509) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 10:43:41 user nova-compute[71509]: INFO nova.compute.claims [None req-90f10194-e12b-4161-91b5-14ccc5d317ea tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] [instance: c0e2af6d-3694-4166-a3d0-b5be1107c488] Claim successful on node user
Apr 14 10:43:41 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-90f10194-e12b-4161-91b5-14ccc5d317ea tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 10:43:41 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-90f10194-e12b-4161-91b5-14ccc5d317ea tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 10:43:41 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-90f10194-e12b-4161-91b5-14ccc5d317ea tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.555s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:43:41 user nova-compute[71509]: DEBUG nova.compute.manager [None req-90f10194-e12b-4161-91b5-14ccc5d317ea tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] [instance: c0e2af6d-3694-4166-a3d0-b5be1107c488] Start building networks asynchronously for instance. {{(pid=71509) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 10:43:41 user nova-compute[71509]: DEBUG nova.compute.manager [None req-90f10194-e12b-4161-91b5-14ccc5d317ea tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] [instance: c0e2af6d-3694-4166-a3d0-b5be1107c488] Allocating IP information in the background. {{(pid=71509) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 10:43:41 user nova-compute[71509]: DEBUG nova.network.neutron [None req-90f10194-e12b-4161-91b5-14ccc5d317ea tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] [instance: c0e2af6d-3694-4166-a3d0-b5be1107c488] allocate_for_instance() {{(pid=71509) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 10:43:41 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-90f10194-e12b-4161-91b5-14ccc5d317ea tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] [instance: c0e2af6d-3694-4166-a3d0-b5be1107c488] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 10:43:41 user nova-compute[71509]: DEBUG nova.compute.manager [None req-90f10194-e12b-4161-91b5-14ccc5d317ea tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] [instance: c0e2af6d-3694-4166-a3d0-b5be1107c488] Start building block device mappings for instance. {{(pid=71509) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 10:43:42 user nova-compute[71509]: DEBUG nova.compute.manager [None req-90f10194-e12b-4161-91b5-14ccc5d317ea tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] [instance: c0e2af6d-3694-4166-a3d0-b5be1107c488] Start spawning the instance on the hypervisor. {{(pid=71509) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 10:43:42 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-90f10194-e12b-4161-91b5-14ccc5d317ea tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] [instance: c0e2af6d-3694-4166-a3d0-b5be1107c488] Creating instance directory {{(pid=71509) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 10:43:42 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-90f10194-e12b-4161-91b5-14ccc5d317ea tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] [instance: c0e2af6d-3694-4166-a3d0-b5be1107c488] Creating image(s)
Apr 14 10:43:42 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-90f10194-e12b-4161-91b5-14ccc5d317ea tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] Acquiring lock "/opt/stack/data/nova/instances/c0e2af6d-3694-4166-a3d0-b5be1107c488/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:43:42 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-90f10194-e12b-4161-91b5-14ccc5d317ea tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] Lock "/opt/stack/data/nova/instances/c0e2af6d-3694-4166-a3d0-b5be1107c488/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:43:42 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-90f10194-e12b-4161-91b5-14ccc5d317ea tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] Lock "/opt/stack/data/nova/instances/c0e2af6d-3694-4166-a3d0-b5be1107c488/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:43:42 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-90f10194-e12b-4161-91b5-14ccc5d317ea tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:43:42 user nova-compute[71509]: DEBUG nova.policy [None req-90f10194-e12b-4161-91b5-14ccc5d317ea tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '187b7b3152ef496cbd84a94232d5ada5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78792d5e25ef4c7aa31b0656dacdd9f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71509) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 10:43:42 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-90f10194-e12b-4161-91b5-14ccc5d317ea tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json" returned: 0 in 0.174s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:43:42 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-90f10194-e12b-4161-91b5-14ccc5d317ea tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] Acquiring lock "5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:43:42 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-90f10194-e12b-4161-91b5-14ccc5d317ea tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] Lock "5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:43:42 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-90f10194-e12b-4161-91b5-14ccc5d317ea tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:43:42 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:43:42 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-90f10194-e12b-4161-91b5-14ccc5d317ea tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json" returned: 0 in 0.198s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:43:42 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-90f10194-e12b-4161-91b5-14ccc5d317ea tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18,backing_fmt=raw /opt/stack/data/nova/instances/c0e2af6d-3694-4166-a3d0-b5be1107c488/disk 1073741824 {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:43:42 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-90f10194-e12b-4161-91b5-14ccc5d317ea tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18,backing_fmt=raw /opt/stack/data/nova/instances/c0e2af6d-3694-4166-a3d0-b5be1107c488/disk 1073741824" returned: 0 in 0.057s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:43:42 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-90f10194-e12b-4161-91b5-14ccc5d317ea tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] Lock "5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.262s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:43:42 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-90f10194-e12b-4161-91b5-14ccc5d317ea tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:43:42 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-90f10194-e12b-4161-91b5-14ccc5d317ea tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json" returned: 0 in 0.170s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:43:42 user nova-compute[71509]: DEBUG nova.virt.disk.api [None req-90f10194-e12b-4161-91b5-14ccc5d317ea tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c0e2af6d-3694-4166-a3d0-b5be1107c488/disk. size=1073741824 {{(pid=71509) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 10:43:42 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-90f10194-e12b-4161-91b5-14ccc5d317ea tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0e2af6d-3694-4166-a3d0-b5be1107c488/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:43:42 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:43:42 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-90f10194-e12b-4161-91b5-14ccc5d317ea tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0e2af6d-3694-4166-a3d0-b5be1107c488/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:43:42 user nova-compute[71509]: DEBUG nova.virt.disk.api [None req-90f10194-e12b-4161-91b5-14ccc5d317ea tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] Cannot resize image /opt/stack/data/nova/instances/c0e2af6d-3694-4166-a3d0-b5be1107c488/disk to a smaller size. {{(pid=71509) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 10:43:42 user nova-compute[71509]: DEBUG nova.objects.instance [None req-90f10194-e12b-4161-91b5-14ccc5d317ea tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] Lazy-loading 'migration_context' on Instance uuid c0e2af6d-3694-4166-a3d0-b5be1107c488 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:43:42 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-90f10194-e12b-4161-91b5-14ccc5d317ea tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] [instance: c0e2af6d-3694-4166-a3d0-b5be1107c488] Created local disks {{(pid=71509) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 10:43:42 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-90f10194-e12b-4161-91b5-14ccc5d317ea tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] [instance: c0e2af6d-3694-4166-a3d0-b5be1107c488] Ensure instance console log exists: /opt/stack/data/nova/instances/c0e2af6d-3694-4166-a3d0-b5be1107c488/console.log {{(pid=71509) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 10:43:42 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-90f10194-e12b-4161-91b5-14ccc5d317ea tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:43:42 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-90f10194-e12b-4161-91b5-14ccc5d317ea tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:43:42 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-90f10194-e12b-4161-91b5-14ccc5d317ea tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:43:43 user nova-compute[71509]: DEBUG nova.network.neutron [None req-90f10194-e12b-4161-91b5-14ccc5d317ea tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] [instance: c0e2af6d-3694-4166-a3d0-b5be1107c488] Successfully created port: ade20134-2589-42de-8b15-051228d8d647 {{(pid=71509) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 10:43:44 user nova-compute[71509]: DEBUG nova.network.neutron [None req-90f10194-e12b-4161-91b5-14ccc5d317ea tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] [instance: c0e2af6d-3694-4166-a3d0-b5be1107c488] Successfully updated port: ade20134-2589-42de-8b15-051228d8d647 {{(pid=71509) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 10:43:44 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-90f10194-e12b-4161-91b5-14ccc5d317ea tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] Acquiring lock "refresh_cache-c0e2af6d-3694-4166-a3d0-b5be1107c488" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:43:44 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-90f10194-e12b-4161-91b5-14ccc5d317ea tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] Acquired lock "refresh_cache-c0e2af6d-3694-4166-a3d0-b5be1107c488" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:43:44 user nova-compute[71509]: DEBUG nova.network.neutron [None req-90f10194-e12b-4161-91b5-14ccc5d317ea tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] [instance: c0e2af6d-3694-4166-a3d0-b5be1107c488] Building network info cache for instance {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 10:43:44 user nova-compute[71509]: DEBUG nova.compute.manager [req-d6c303cb-7a30-4093-a381-2dc1973a6417 req-a0c9b2fc-0010-45ba-9c1e-6393dc9d6816 service nova] [instance: c0e2af6d-3694-4166-a3d0-b5be1107c488] Received event network-changed-ade20134-2589-42de-8b15-051228d8d647 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:43:44 user nova-compute[71509]: DEBUG nova.compute.manager [req-d6c303cb-7a30-4093-a381-2dc1973a6417 req-a0c9b2fc-0010-45ba-9c1e-6393dc9d6816 service nova] [instance: c0e2af6d-3694-4166-a3d0-b5be1107c488] Refreshing instance network info cache due to event network-changed-ade20134-2589-42de-8b15-051228d8d647. {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 10:43:44 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-d6c303cb-7a30-4093-a381-2dc1973a6417 req-a0c9b2fc-0010-45ba-9c1e-6393dc9d6816 service nova] Acquiring lock "refresh_cache-c0e2af6d-3694-4166-a3d0-b5be1107c488" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:43:44 user nova-compute[71509]: DEBUG nova.network.neutron [None req-90f10194-e12b-4161-91b5-14ccc5d317ea tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] [instance: c0e2af6d-3694-4166-a3d0-b5be1107c488] Instance cache missing network info. {{(pid=71509) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 10:43:44 user nova-compute[71509]: DEBUG nova.network.neutron [None req-90f10194-e12b-4161-91b5-14ccc5d317ea tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] [instance: c0e2af6d-3694-4166-a3d0-b5be1107c488] Updating instance_info_cache with network_info: [{"id": "ade20134-2589-42de-8b15-051228d8d647", "address": "fa:16:3e:9d:46:10", "network": {"id": "4fe93bfa-3e42-42ca-adf6-3312a99e96b9", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "9742d6ad20cf48d9bab0fdbcc9491db9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapade20134-25", "ovs_interfaceid": "ade20134-2589-42de-8b15-051228d8d647", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:43:44 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-90f10194-e12b-4161-91b5-14ccc5d317ea tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] Releasing lock "refresh_cache-c0e2af6d-3694-4166-a3d0-b5be1107c488" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:43:44 user nova-compute[71509]: DEBUG nova.compute.manager [None req-90f10194-e12b-4161-91b5-14ccc5d317ea tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] [instance: c0e2af6d-3694-4166-a3d0-b5be1107c488] Instance network_info: |[{"id": "ade20134-2589-42de-8b15-051228d8d647", "address": "fa:16:3e:9d:46:10", "network": {"id": "4fe93bfa-3e42-42ca-adf6-3312a99e96b9", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "9742d6ad20cf48d9bab0fdbcc9491db9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapade20134-25", "ovs_interfaceid": "ade20134-2589-42de-8b15-051228d8d647", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71509) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 10:43:44 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-d6c303cb-7a30-4093-a381-2dc1973a6417 req-a0c9b2fc-0010-45ba-9c1e-6393dc9d6816 service nova] Acquired lock "refresh_cache-c0e2af6d-3694-4166-a3d0-b5be1107c488" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:43:44 user nova-compute[71509]: DEBUG nova.network.neutron [req-d6c303cb-7a30-4093-a381-2dc1973a6417 req-a0c9b2fc-0010-45ba-9c1e-6393dc9d6816 service nova] [instance: c0e2af6d-3694-4166-a3d0-b5be1107c488] Refreshing network info cache for port ade20134-2589-42de-8b15-051228d8d647 {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 10:43:44 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-90f10194-e12b-4161-91b5-14ccc5d317ea tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] [instance: c0e2af6d-3694-4166-a3d0-b5be1107c488] Start _get_guest_xml network_info=[{"id": "ade20134-2589-42de-8b15-051228d8d647", "address": "fa:16:3e:9d:46:10", "network": {"id": "4fe93bfa-3e42-42ca-adf6-3312a99e96b9", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "9742d6ad20cf48d9bab0fdbcc9491db9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapade20134-25", "ovs_interfaceid": "ade20134-2589-42de-8b15-051228d8d647", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T10:38:55Z,direct_url=<?>,disk_format='qcow2',id=048ec0ee-0465-448d-8b4c-f072acb101dc,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='9742d6ad20cf48d9bab0fdbcc9491db9',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T10:38:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '048ec0ee-0465-448d-8b4c-f072acb101dc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71509) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 10:43:44 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-90f10194-e12b-4161-91b5-14ccc5d317ea tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:43:44 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-90f10194-e12b-4161-91b5-14ccc5d317ea tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:43:44 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-90f10194-e12b-4161-91b5-14ccc5d317ea tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71509) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 10:43:44 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-90f10194-e12b-4161-91b5-14ccc5d317ea tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T10:40:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T10:38:55Z,direct_url=<?>,disk_format='qcow2',id=048ec0ee-0465-448d-8b4c-f072acb101dc,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='9742d6ad20cf48d9bab0fdbcc9491db9',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T10:38:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 10:43:44 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-90f10194-e12b-4161-91b5-14ccc5d317ea tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] Flavor limits 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 10:43:44 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-90f10194-e12b-4161-91b5-14ccc5d317ea tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] Image limits 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 10:43:44 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-90f10194-e12b-4161-91b5-14ccc5d317ea tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] Flavor pref 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 10:43:44 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-90f10194-e12b-4161-91b5-14ccc5d317ea tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] Image pref 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 10:43:44 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-90f10194-e12b-4161-91b5-14ccc5d317ea tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 10:43:44 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-90f10194-e12b-4161-91b5-14ccc5d317ea tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 10:43:44 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-90f10194-e12b-4161-91b5-14ccc5d317ea tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71509) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 10:43:44 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-90f10194-e12b-4161-91b5-14ccc5d317ea tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] Got 1 possible topologies {{(pid=71509) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 10:43:44 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-90f10194-e12b-4161-91b5-14ccc5d317ea tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 10:43:44 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-90f10194-e12b-4161-91b5-14ccc5d317ea tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 10:43:44 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-90f10194-e12b-4161-91b5-14ccc5d317ea tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T10:43:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-588900252',display_name='tempest-VolumesNegativeTest-instance-588900252',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-588900252',id=9,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='78792d5e25ef4c7aa31b0656dacdd9f4',ramdisk_id='',reservation_id='r-lazhq29r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1757520579',owner_user_name='tempest-VolumesNegativeTest-1757520579-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T10:43:42Z,user_data=None,user_id='187b7b3152ef496cbd84a94232d5ada5',uuid=c0e2af6d-3694-4166-a3d0-b5be1107c488,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ade20134-2589-42de-8b15-051228d8d647", "address": "fa:16:3e:9d:46:10", "network": {"id": "4fe93bfa-3e42-42ca-adf6-3312a99e96b9", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "9742d6ad20cf48d9bab0fdbcc9491db9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapade20134-25", "ovs_interfaceid": "ade20134-2589-42de-8b15-051228d8d647", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71509) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 10:43:44 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-90f10194-e12b-4161-91b5-14ccc5d317ea tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] Converting VIF {"id": "ade20134-2589-42de-8b15-051228d8d647", "address": "fa:16:3e:9d:46:10", "network": {"id": "4fe93bfa-3e42-42ca-adf6-3312a99e96b9", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "9742d6ad20cf48d9bab0fdbcc9491db9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapade20134-25", "ovs_interfaceid": "ade20134-2589-42de-8b15-051228d8d647", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:43:44 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-90f10194-e12b-4161-91b5-14ccc5d317ea tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:46:10,bridge_name='br-int',has_traffic_filtering=True,id=ade20134-2589-42de-8b15-051228d8d647,network=Network(4fe93bfa-3e42-42ca-adf6-3312a99e96b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapade20134-25') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:43:44 user nova-compute[71509]: DEBUG nova.objects.instance [None req-90f10194-e12b-4161-91b5-14ccc5d317ea tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] Lazy-loading 'pci_devices' on Instance uuid c0e2af6d-3694-4166-a3d0-b5be1107c488 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:43:44 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-90f10194-e12b-4161-91b5-14ccc5d317ea tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] [instance: c0e2af6d-3694-4166-a3d0-b5be1107c488] End _get_guest_xml xml=<domain type="kvm">
Apr 14 10:43:44 user nova-compute[71509]:   <uuid>c0e2af6d-3694-4166-a3d0-b5be1107c488</uuid>
Apr 14 10:43:44 user nova-compute[71509]:   <name>instance-00000009</name>
Apr 14 10:43:44 user nova-compute[71509]:   <memory>131072</memory>
Apr 14 10:43:44 user nova-compute[71509]:   <vcpu>1</vcpu>
Apr 14 10:43:44 user nova-compute[71509]:   <metadata>
Apr 14 10:43:44 user nova-compute[71509]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 10:43:44 user nova-compute[71509]:       <nova:package version="0.0.0"/>
Apr 14 10:43:44 user nova-compute[71509]:       <nova:name>tempest-VolumesNegativeTest-instance-588900252</nova:name>
Apr 14 10:43:44 user nova-compute[71509]:       <nova:creationTime>2023-04-14 10:43:44</nova:creationTime>
Apr 14 10:43:44 user nova-compute[71509]:       <nova:flavor name="m1.nano">
Apr 14 10:43:44 user nova-compute[71509]:         <nova:memory>128</nova:memory>
Apr 14 10:43:44 user nova-compute[71509]:         <nova:disk>1</nova:disk>
Apr 14 10:43:44 user nova-compute[71509]:         <nova:swap>0</nova:swap>
Apr 14 10:43:44 user nova-compute[71509]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 10:43:44 user nova-compute[71509]:         <nova:vcpus>1</nova:vcpus>
Apr 14 10:43:44 user nova-compute[71509]:       </nova:flavor>
Apr 14 10:43:44 user nova-compute[71509]:       <nova:owner>
Apr 14 10:43:44 user nova-compute[71509]:         <nova:user uuid="187b7b3152ef496cbd84a94232d5ada5">tempest-VolumesNegativeTest-1757520579-project-member</nova:user>
Apr 14 10:43:44 user nova-compute[71509]:         <nova:project uuid="78792d5e25ef4c7aa31b0656dacdd9f4">tempest-VolumesNegativeTest-1757520579</nova:project>
Apr 14 10:43:44 user nova-compute[71509]:       </nova:owner>
Apr 14 10:43:44 user nova-compute[71509]:       <nova:root type="image" uuid="048ec0ee-0465-448d-8b4c-f072acb101dc"/>
Apr 14 10:43:44 user nova-compute[71509]:       <nova:ports>
Apr 14 10:43:44 user nova-compute[71509]:         <nova:port uuid="ade20134-2589-42de-8b15-051228d8d647">
Apr 14 10:43:44 user nova-compute[71509]:           <nova:ip type="fixed" address="192.168.233.145" ipVersion="4"/>
Apr 14 10:43:44 user nova-compute[71509]:         </nova:port>
Apr 14 10:43:44 user nova-compute[71509]:       </nova:ports>
Apr 14 10:43:44 user nova-compute[71509]:     </nova:instance>
Apr 14 10:43:44 user nova-compute[71509]:   </metadata>
Apr 14 10:43:44 user nova-compute[71509]:   <sysinfo type="smbios">
Apr 14 10:43:44 user nova-compute[71509]:     <system>
Apr 14 10:43:44 user nova-compute[71509]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 10:43:44 user nova-compute[71509]:       <entry name="product">OpenStack Nova</entry>
Apr 14 10:43:44 user nova-compute[71509]:       <entry name="version">0.0.0</entry>
Apr 14 10:43:44 user nova-compute[71509]:       <entry name="serial">c0e2af6d-3694-4166-a3d0-b5be1107c488</entry>
Apr 14 10:43:44 user nova-compute[71509]:       <entry name="uuid">c0e2af6d-3694-4166-a3d0-b5be1107c488</entry>
Apr 14 10:43:44 user nova-compute[71509]:       <entry name="family">Virtual Machine</entry>
Apr 14 10:43:44 user nova-compute[71509]:     </system>
Apr 14 10:43:44 user nova-compute[71509]:   </sysinfo>
Apr 14 10:43:44 user nova-compute[71509]:   <os>
Apr 14 10:43:44 user nova-compute[71509]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 10:43:44 user nova-compute[71509]:     <boot dev="hd"/>
Apr 14 10:43:44 user nova-compute[71509]:     <smbios mode="sysinfo"/>
Apr 14 10:43:44 user nova-compute[71509]:   </os>
Apr 14 10:43:44 user nova-compute[71509]:   <features>
Apr 14 10:43:44 user nova-compute[71509]:     <acpi/>
Apr 14 10:43:44 user nova-compute[71509]:     <apic/>
Apr 14 10:43:44 user nova-compute[71509]:     <vmcoreinfo/>
Apr 14 10:43:44 user nova-compute[71509]:   </features>
Apr 14 10:43:44 user nova-compute[71509]:   <clock offset="utc">
Apr 14 10:43:44 user nova-compute[71509]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 10:43:44 user nova-compute[71509]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 10:43:44 user nova-compute[71509]:     <timer name="hpet" present="no"/>
Apr 14 10:43:44 user nova-compute[71509]:   </clock>
Apr 14 10:43:44 user nova-compute[71509]:   <cpu mode="custom" match="exact">
Apr 14 10:43:44 user nova-compute[71509]:     <model>Nehalem</model>
Apr 14 10:43:44 user nova-compute[71509]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 10:43:44 user nova-compute[71509]:   </cpu>
Apr 14 10:43:44 user nova-compute[71509]:   <devices>
Apr 14 10:43:44 user nova-compute[71509]:     <disk type="file" device="disk">
Apr 14 10:43:44 user nova-compute[71509]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 10:43:44 user nova-compute[71509]:       <source file="/opt/stack/data/nova/instances/c0e2af6d-3694-4166-a3d0-b5be1107c488/disk"/>
Apr 14 10:43:44 user nova-compute[71509]:       <target dev="vda" bus="virtio"/>
Apr 14 10:43:44 user nova-compute[71509]:     </disk>
Apr 14 10:43:44 user nova-compute[71509]:     <interface type="ethernet">
Apr 14 10:43:44 user nova-compute[71509]:       <mac address="fa:16:3e:9d:46:10"/>
Apr 14 10:43:44 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 10:43:44 user nova-compute[71509]:       <mtu size="1442"/>
Apr 14 10:43:44 user nova-compute[71509]:       <target dev="tapade20134-25"/>
Apr 14 10:43:44 user nova-compute[71509]:     </interface>
Apr 14 10:43:44 user nova-compute[71509]:     <serial type="pty">
Apr 14 10:43:44 user nova-compute[71509]:       <log file="/opt/stack/data/nova/instances/c0e2af6d-3694-4166-a3d0-b5be1107c488/console.log" append="off"/>
Apr 14 10:43:44 user nova-compute[71509]:     </serial>
Apr 14 10:43:44 user nova-compute[71509]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 10:43:44 user nova-compute[71509]:     <video>
Apr 14 10:43:44 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 10:43:44 user nova-compute[71509]:     </video>
Apr 14 10:43:44 user nova-compute[71509]:     <rng model="virtio">
Apr 14 10:43:44 user nova-compute[71509]:       <backend model="random">/dev/urandom</backend>
Apr 14 10:43:44 user nova-compute[71509]:     </rng>
Apr 14 10:43:44 user nova-compute[71509]:     <controller type="usb" index="0" model="none"/>
Apr 14 10:43:44 user nova-compute[71509]:     <memballoon model="virtio">
Apr 14 10:43:44 user nova-compute[71509]:       <stats period="10"/>
Apr 14 10:43:44 user nova-compute[71509]:     </memballoon>
Apr 14 10:43:44 user nova-compute[71509]:   </devices>
Apr 14 10:43:44 user nova-compute[71509]: </domain>
Apr 14 10:43:44 user nova-compute[71509]:  {{(pid=71509) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 10:43:44 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-90f10194-e12b-4161-91b5-14ccc5d317ea tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T10:43:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-588900252',display_name='tempest-VolumesNegativeTest-instance-588900252',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-588900252',id=9,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='78792d5e25ef4c7aa31b0656dacdd9f4',ramdisk_id='',reservation_id='r-lazhq29r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1757520579',owner_user_name='tempest-VolumesNegativeTest-1757520579-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T10:43:42Z,user_data=None,user_id='187b7b3152ef496cbd84a94232d5ada5',uuid=c0e2af6d-3694-4166-a3d0-b5be1107c488,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ade20134-2589-42de-8b15-051228d8d647", "address": "fa:16:3e:9d:46:10", "network": {"id": "4fe93bfa-3e42-42ca-adf6-3312a99e96b9", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "9742d6ad20cf48d9bab0fdbcc9491db9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapade20134-25", "ovs_interfaceid": "ade20134-2589-42de-8b15-051228d8d647", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 10:43:44 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-90f10194-e12b-4161-91b5-14ccc5d317ea tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] Converting VIF {"id": "ade20134-2589-42de-8b15-051228d8d647", "address": "fa:16:3e:9d:46:10", "network": {"id": "4fe93bfa-3e42-42ca-adf6-3312a99e96b9", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "9742d6ad20cf48d9bab0fdbcc9491db9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapade20134-25", "ovs_interfaceid": "ade20134-2589-42de-8b15-051228d8d647", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:43:44 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-90f10194-e12b-4161-91b5-14ccc5d317ea tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:46:10,bridge_name='br-int',has_traffic_filtering=True,id=ade20134-2589-42de-8b15-051228d8d647,network=Network(4fe93bfa-3e42-42ca-adf6-3312a99e96b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapade20134-25') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:43:44 user nova-compute[71509]: DEBUG os_vif [None req-90f10194-e12b-4161-91b5-14ccc5d317ea tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:46:10,bridge_name='br-int',has_traffic_filtering=True,id=ade20134-2589-42de-8b15-051228d8d647,network=Network(4fe93bfa-3e42-42ca-adf6-3312a99e96b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapade20134-25') {{(pid=71509) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 10:43:44 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:43:44 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:43:44 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 10:43:44 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:43:44 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapade20134-25, may_exist=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:43:44 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapade20134-25, col_values=(('external_ids', {'iface-id': 'ade20134-2589-42de-8b15-051228d8d647', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9d:46:10', 'vm-uuid': 'c0e2af6d-3694-4166-a3d0-b5be1107c488'}),)) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:43:44 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:43:45 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 10:43:45 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:43:45 user nova-compute[71509]: INFO os_vif [None req-90f10194-e12b-4161-91b5-14ccc5d317ea tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:46:10,bridge_name='br-int',has_traffic_filtering=True,id=ade20134-2589-42de-8b15-051228d8d647,network=Network(4fe93bfa-3e42-42ca-adf6-3312a99e96b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapade20134-25')
Apr 14 10:43:45 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-90f10194-e12b-4161-91b5-14ccc5d317ea tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] No BDM found with device name vda, not building metadata. {{(pid=71509) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 10:43:45 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-90f10194-e12b-4161-91b5-14ccc5d317ea tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] No VIF found with MAC fa:16:3e:9d:46:10, not building metadata {{(pid=71509) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 10:43:45 user nova-compute[71509]: DEBUG nova.network.neutron [req-d6c303cb-7a30-4093-a381-2dc1973a6417 req-a0c9b2fc-0010-45ba-9c1e-6393dc9d6816 service nova] [instance: c0e2af6d-3694-4166-a3d0-b5be1107c488] Updated VIF entry in instance network info cache for port ade20134-2589-42de-8b15-051228d8d647. {{(pid=71509) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 10:43:45 user nova-compute[71509]: DEBUG nova.network.neutron [req-d6c303cb-7a30-4093-a381-2dc1973a6417 req-a0c9b2fc-0010-45ba-9c1e-6393dc9d6816 service nova] [instance: c0e2af6d-3694-4166-a3d0-b5be1107c488] Updating instance_info_cache with network_info: [{"id": "ade20134-2589-42de-8b15-051228d8d647", "address": "fa:16:3e:9d:46:10", "network": {"id": "4fe93bfa-3e42-42ca-adf6-3312a99e96b9", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "9742d6ad20cf48d9bab0fdbcc9491db9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapade20134-25", "ovs_interfaceid": "ade20134-2589-42de-8b15-051228d8d647", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:43:45 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-d6c303cb-7a30-4093-a381-2dc1973a6417 req-a0c9b2fc-0010-45ba-9c1e-6393dc9d6816 service nova] Releasing lock "refresh_cache-c0e2af6d-3694-4166-a3d0-b5be1107c488" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:43:46 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Acquiring lock "39586d44-1d8e-4607-ab4d-c03a7d841606" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:43:46 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Lock "39586d44-1d8e-4607-ab4d-c03a7d841606" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:43:46 user nova-compute[71509]: DEBUG nova.compute.manager [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Starting instance... {{(pid=71509) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 10:43:46 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:43:46 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:43:46 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71509) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 10:43:46 user nova-compute[71509]: INFO nova.compute.claims [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Claim successful on node user
Apr 14 10:43:46 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:43:46 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:43:46 user nova-compute[71509]: DEBUG nova.compute.manager [req-33d53d2e-b1cf-4f3d-a0c4-270f3e21cf2e req-01385d20-31d5-45b5-b277-8ff75f4f6f41 service nova] [instance: c0e2af6d-3694-4166-a3d0-b5be1107c488] Received event network-vif-plugged-ade20134-2589-42de-8b15-051228d8d647 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:43:46 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-33d53d2e-b1cf-4f3d-a0c4-270f3e21cf2e req-01385d20-31d5-45b5-b277-8ff75f4f6f41 service nova] Acquiring lock "c0e2af6d-3694-4166-a3d0-b5be1107c488-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:43:46 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-33d53d2e-b1cf-4f3d-a0c4-270f3e21cf2e req-01385d20-31d5-45b5-b277-8ff75f4f6f41 service nova] Lock "c0e2af6d-3694-4166-a3d0-b5be1107c488-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:43:46 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-33d53d2e-b1cf-4f3d-a0c4-270f3e21cf2e req-01385d20-31d5-45b5-b277-8ff75f4f6f41 service nova] Lock "c0e2af6d-3694-4166-a3d0-b5be1107c488-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:43:46 user nova-compute[71509]: DEBUG nova.compute.manager [req-33d53d2e-b1cf-4f3d-a0c4-270f3e21cf2e req-01385d20-31d5-45b5-b277-8ff75f4f6f41 service nova] [instance: c0e2af6d-3694-4166-a3d0-b5be1107c488] No waiting events found dispatching network-vif-plugged-ade20134-2589-42de-8b15-051228d8d647 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:43:46 user nova-compute[71509]: WARNING nova.compute.manager [req-33d53d2e-b1cf-4f3d-a0c4-270f3e21cf2e req-01385d20-31d5-45b5-b277-8ff75f4f6f41 service nova] [instance: c0e2af6d-3694-4166-a3d0-b5be1107c488] Received unexpected event network-vif-plugged-ade20134-2589-42de-8b15-051228d8d647 for instance with vm_state building and task_state spawning.
Apr 14 10:43:46 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 10:43:47 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 10:43:47 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.656s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:43:47 user nova-compute[71509]: DEBUG nova.compute.manager [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Start building networks asynchronously for instance. {{(pid=71509) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 10:43:47 user nova-compute[71509]: DEBUG nova.compute.manager [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Allocating IP information in the background. {{(pid=71509) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 10:43:47 user nova-compute[71509]: DEBUG nova.network.neutron [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] allocate_for_instance() {{(pid=71509) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 10:43:47 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 10:43:47 user nova-compute[71509]: DEBUG nova.compute.manager [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Start building block device mappings for instance. {{(pid=71509) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 10:43:47 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:43:47 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:43:47 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:43:47 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:43:47 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:43:47 user nova-compute[71509]: DEBUG nova.policy [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '15c4ab86a8d244c4be5889b4ac47561a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340e1e1695464eb5ad8a8c881cf24611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71509) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 10:43:47 user nova-compute[71509]: INFO nova.virt.block_device [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Booting with volume 5647685a-aec6-4498-b1b4-372602a4c7ee at /dev/vda
Apr 14 10:43:47 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:43:47 user nova-compute[71509]: DEBUG os_brick.utils [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 10:43:47 user nova-compute[71509]: INFO oslo.privsep.daemon [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpxk5c1ikw/privsep.sock']
Apr 14 10:43:47 user sudo[82231]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpxk5c1ikw/privsep.sock
Apr 14 10:43:47 user sudo[82231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Apr 14 10:43:48 user nova-compute[71509]: DEBUG nova.network.neutron [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Successfully created port: 6099437e-5607-4a06-abcb-15d465c7ecf8 {{(pid=71509) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 10:43:49 user nova-compute[71509]: DEBUG nova.compute.manager [req-2d52fe88-9fe1-4154-96ac-531293e462d7 req-447d646a-6f6a-4b6e-96bf-a01b85581510 service nova] [instance: c0e2af6d-3694-4166-a3d0-b5be1107c488] Received event network-vif-plugged-ade20134-2589-42de-8b15-051228d8d647 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:43:49 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-2d52fe88-9fe1-4154-96ac-531293e462d7 req-447d646a-6f6a-4b6e-96bf-a01b85581510 service nova] Acquiring lock "c0e2af6d-3694-4166-a3d0-b5be1107c488-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:43:49 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-2d52fe88-9fe1-4154-96ac-531293e462d7 req-447d646a-6f6a-4b6e-96bf-a01b85581510 service nova] Lock "c0e2af6d-3694-4166-a3d0-b5be1107c488-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:43:49 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-2d52fe88-9fe1-4154-96ac-531293e462d7 req-447d646a-6f6a-4b6e-96bf-a01b85581510 service nova] Lock "c0e2af6d-3694-4166-a3d0-b5be1107c488-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:43:49 user nova-compute[71509]: DEBUG nova.compute.manager [req-2d52fe88-9fe1-4154-96ac-531293e462d7 req-447d646a-6f6a-4b6e-96bf-a01b85581510 service nova] [instance: c0e2af6d-3694-4166-a3d0-b5be1107c488] No waiting events found dispatching network-vif-plugged-ade20134-2589-42de-8b15-051228d8d647 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:43:49 user nova-compute[71509]: WARNING nova.compute.manager [req-2d52fe88-9fe1-4154-96ac-531293e462d7 req-447d646a-6f6a-4b6e-96bf-a01b85581510 service nova] [instance: c0e2af6d-3694-4166-a3d0-b5be1107c488] Received unexpected event network-vif-plugged-ade20134-2589-42de-8b15-051228d8d647 for instance with vm_state building and task_state spawning.
Apr 14 10:43:49 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681469029.0710459, c0e2af6d-3694-4166-a3d0-b5be1107c488 => Resumed> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 10:43:49 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: c0e2af6d-3694-4166-a3d0-b5be1107c488] VM Resumed (Lifecycle Event)
Apr 14 10:43:49 user nova-compute[71509]: DEBUG nova.compute.manager [None req-90f10194-e12b-4161-91b5-14ccc5d317ea tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] [instance: c0e2af6d-3694-4166-a3d0-b5be1107c488] Instance event wait completed in 0 seconds for  {{(pid=71509) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 10:43:49 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-90f10194-e12b-4161-91b5-14ccc5d317ea tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] [instance: c0e2af6d-3694-4166-a3d0-b5be1107c488] Guest created on hypervisor {{(pid=71509) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 10:43:49 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: c0e2af6d-3694-4166-a3d0-b5be1107c488] Instance spawned successfully.
Apr 14 10:43:49 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-90f10194-e12b-4161-91b5-14ccc5d317ea tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] [instance: c0e2af6d-3694-4166-a3d0-b5be1107c488] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 10:43:49 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: c0e2af6d-3694-4166-a3d0-b5be1107c488] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:43:49 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-90f10194-e12b-4161-91b5-14ccc5d317ea tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] [instance: c0e2af6d-3694-4166-a3d0-b5be1107c488] Found default for hw_cdrom_bus of ide {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:43:49 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-90f10194-e12b-4161-91b5-14ccc5d317ea tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] [instance: c0e2af6d-3694-4166-a3d0-b5be1107c488] Found default for hw_disk_bus of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:43:49 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-90f10194-e12b-4161-91b5-14ccc5d317ea tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] [instance: c0e2af6d-3694-4166-a3d0-b5be1107c488] Found default for hw_input_bus of None {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:43:49 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-90f10194-e12b-4161-91b5-14ccc5d317ea tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] [instance: c0e2af6d-3694-4166-a3d0-b5be1107c488] Found default for hw_pointer_model of None {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:43:49 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-90f10194-e12b-4161-91b5-14ccc5d317ea tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] [instance: c0e2af6d-3694-4166-a3d0-b5be1107c488] Found default for hw_video_model of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:43:49 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-90f10194-e12b-4161-91b5-14ccc5d317ea tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] [instance: c0e2af6d-3694-4166-a3d0-b5be1107c488] Found default for hw_vif_model of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:43:49 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: c0e2af6d-3694-4166-a3d0-b5be1107c488] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 10:43:49 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: c0e2af6d-3694-4166-a3d0-b5be1107c488] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 10:43:49 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681469029.0715206, c0e2af6d-3694-4166-a3d0-b5be1107c488 => Started> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 10:43:49 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: c0e2af6d-3694-4166-a3d0-b5be1107c488] VM Started (Lifecycle Event)
Apr 14 10:43:49 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: c0e2af6d-3694-4166-a3d0-b5be1107c488] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:43:49 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: c0e2af6d-3694-4166-a3d0-b5be1107c488] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 10:43:49 user nova-compute[71509]: INFO nova.compute.manager [None req-90f10194-e12b-4161-91b5-14ccc5d317ea tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] [instance: c0e2af6d-3694-4166-a3d0-b5be1107c488] Took 7.17 seconds to spawn the instance on the hypervisor.
Apr 14 10:43:49 user nova-compute[71509]: DEBUG nova.compute.manager [None req-90f10194-e12b-4161-91b5-14ccc5d317ea tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] [instance: c0e2af6d-3694-4166-a3d0-b5be1107c488] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:43:49 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: c0e2af6d-3694-4166-a3d0-b5be1107c488] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 10:43:49 user sudo[82231]: pam_unix(sudo:session): session closed for user root
Apr 14 10:43:49 user nova-compute[71509]: INFO oslo.privsep.daemon [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Spawned new privsep daemon via rootwrap
Apr 14 10:43:49 user nova-compute[71509]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 14 10:43:49 user nova-compute[71509]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 14 10:43:49 user nova-compute[71509]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Apr 14 10:43:49 user nova-compute[71509]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82281
Apr 14 10:43:49 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[e03be8d5-a2cb-4599-8da3-4761bff219c8]: (2,) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:43:49 user nova-compute[71509]: INFO nova.compute.manager [None req-90f10194-e12b-4161-91b5-14ccc5d317ea tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] [instance: c0e2af6d-3694-4166-a3d0-b5be1107c488] Took 8.20 seconds to build instance.
Apr 14 10:43:49 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-90f10194-e12b-4161-91b5-14ccc5d317ea tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] Lock "c0e2af6d-3694-4166-a3d0-b5be1107c488" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.360s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:43:49 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:43:49 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:43:49 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[05e416e5-fb5f-4017-b203-4a0b3ae9354e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50119df3c417\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:43:49 user nova-compute[71509]: WARNING os_brick.initiator.connectors.nvmeof [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Apr 14 10:43:49 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:43:49 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:43:49 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3dfb0e1-ee85-4913-ba1d-ec4d84ae55e2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:43:49 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:43:49 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:43:49 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[99df0204-fc4b-4890-8b58-b545e204dbb0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:43:49 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[77c25bf9-fa35-49fe-8a91-ac743788aa3f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:43:49 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Running cmd (subprocess): nvme version {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:43:49 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] 'nvme version' failed. Not Retrying. {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 10:43:49 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] nvme not present on system {{(pid=71509) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 10:43:49 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:43:49 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 10:43:49 user nova-compute[71509]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 10:43:49 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[1befa127-73a3-47d1-868e-dc64ba006bd9]: (4, '') {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:43:49 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71509) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 10:43:49 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71509) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 10:43:49 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] LIGHTOS: no hostnqn found. {{(pid=71509) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 10:43:49 user nova-compute[71509]: DEBUG os_brick.utils [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] <== get_connector_properties: return (2048ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50119df3c417', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 10:43:49 user nova-compute[71509]: DEBUG nova.virt.block_device [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Updating existing volume attachment record: d02c9678-3336-4956-849e-d8ad1efe3d2f {{(pid=71509) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 10:43:49 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:43:49 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:43:50 user nova-compute[71509]: DEBUG nova.network.neutron [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Successfully updated port: 6099437e-5607-4a06-abcb-15d465c7ecf8 {{(pid=71509) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 10:43:50 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Acquiring lock "refresh_cache-39586d44-1d8e-4607-ab4d-c03a7d841606" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:43:50 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Acquired lock "refresh_cache-39586d44-1d8e-4607-ab4d-c03a7d841606" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:43:50 user nova-compute[71509]: DEBUG nova.network.neutron [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Building network info cache for instance {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 10:43:50 user nova-compute[71509]: DEBUG nova.network.neutron [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Instance cache missing network info. {{(pid=71509) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 10:43:51 user nova-compute[71509]: DEBUG nova.compute.manager [req-aa8ca454-7dba-4b15-ad06-f70ac36d5968 req-3d4342ae-7b03-4c96-ae55-dd735e6790e6 service nova] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Received event network-changed-6099437e-5607-4a06-abcb-15d465c7ecf8 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:43:51 user nova-compute[71509]: DEBUG nova.compute.manager [req-aa8ca454-7dba-4b15-ad06-f70ac36d5968 req-3d4342ae-7b03-4c96-ae55-dd735e6790e6 service nova] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Refreshing instance network info cache due to event network-changed-6099437e-5607-4a06-abcb-15d465c7ecf8. {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 10:43:51 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-aa8ca454-7dba-4b15-ad06-f70ac36d5968 req-3d4342ae-7b03-4c96-ae55-dd735e6790e6 service nova] Acquiring lock "refresh_cache-39586d44-1d8e-4607-ab4d-c03a7d841606" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:43:51 user nova-compute[71509]: DEBUG nova.network.neutron [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Updating instance_info_cache with network_info: [{"id": "6099437e-5607-4a06-abcb-15d465c7ecf8", "address": "fa:16:3e:4b:6c:e7", "network": {"id": "69274626-4a94-46d8-be28-534a98fb6817", "bridge": "br-int", "label": "tempest-TestShelveInstance-480849665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "340e1e1695464eb5ad8a8c881cf24611", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6099437e-56", "ovs_interfaceid": "6099437e-5607-4a06-abcb-15d465c7ecf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:43:51 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Releasing lock "refresh_cache-39586d44-1d8e-4607-ab4d-c03a7d841606" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:43:51 user nova-compute[71509]: DEBUG nova.compute.manager [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Instance network_info: |[{"id": "6099437e-5607-4a06-abcb-15d465c7ecf8", "address": "fa:16:3e:4b:6c:e7", "network": {"id": "69274626-4a94-46d8-be28-534a98fb6817", "bridge": "br-int", "label": "tempest-TestShelveInstance-480849665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "340e1e1695464eb5ad8a8c881cf24611", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6099437e-56", "ovs_interfaceid": "6099437e-5607-4a06-abcb-15d465c7ecf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71509) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 10:43:51 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-aa8ca454-7dba-4b15-ad06-f70ac36d5968 req-3d4342ae-7b03-4c96-ae55-dd735e6790e6 service nova] Acquired lock "refresh_cache-39586d44-1d8e-4607-ab4d-c03a7d841606" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:43:51 user nova-compute[71509]: DEBUG nova.network.neutron [req-aa8ca454-7dba-4b15-ad06-f70ac36d5968 req-3d4342ae-7b03-4c96-ae55-dd735e6790e6 service nova] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Refreshing network info cache for port 6099437e-5607-4a06-abcb-15d465c7ecf8 {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 10:43:51 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Acquiring lock "a81da242-e8d8-4b41-b84a-e12d603823ca" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:43:51 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Lock "a81da242-e8d8-4b41-b84a-e12d603823ca" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:43:51 user nova-compute[71509]: DEBUG nova.compute.manager [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Starting instance... {{(pid=71509) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 10:43:51 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:43:51 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:43:51 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71509) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 10:43:51 user nova-compute[71509]: INFO nova.compute.claims [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Claim successful on node user
Apr 14 10:43:52 user nova-compute[71509]: DEBUG nova.network.neutron [req-aa8ca454-7dba-4b15-ad06-f70ac36d5968 req-3d4342ae-7b03-4c96-ae55-dd735e6790e6 service nova] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Updated VIF entry in instance network info cache for port 6099437e-5607-4a06-abcb-15d465c7ecf8. {{(pid=71509) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 10:43:52 user nova-compute[71509]: DEBUG nova.network.neutron [req-aa8ca454-7dba-4b15-ad06-f70ac36d5968 req-3d4342ae-7b03-4c96-ae55-dd735e6790e6 service nova] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Updating instance_info_cache with network_info: [{"id": "6099437e-5607-4a06-abcb-15d465c7ecf8", "address": "fa:16:3e:4b:6c:e7", "network": {"id": "69274626-4a94-46d8-be28-534a98fb6817", "bridge": "br-int", "label": "tempest-TestShelveInstance-480849665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "340e1e1695464eb5ad8a8c881cf24611", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6099437e-56", "ovs_interfaceid": "6099437e-5607-4a06-abcb-15d465c7ecf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:43:52 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-aa8ca454-7dba-4b15-ad06-f70ac36d5968 req-3d4342ae-7b03-4c96-ae55-dd735e6790e6 service nova] Releasing lock "refresh_cache-39586d44-1d8e-4607-ab4d-c03a7d841606" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:43:52 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 10:43:52 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 10:43:52 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:43:52 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.662s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:43:52 user nova-compute[71509]: DEBUG nova.compute.manager [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Start building networks asynchronously for instance. {{(pid=71509) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 10:43:52 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:43:52 user nova-compute[71509]: DEBUG nova.compute.manager [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Allocating IP information in the background. {{(pid=71509) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 10:43:52 user nova-compute[71509]: DEBUG nova.network.neutron [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] allocate_for_instance() {{(pid=71509) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 10:43:52 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 10:43:52 user nova-compute[71509]: DEBUG nova.compute.manager [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Start building block device mappings for instance. {{(pid=71509) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 10:43:52 user nova-compute[71509]: INFO nova.virt.block_device [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Booting with volume 2b354544-2f2e-40f1-bb9b-5f60c8497f18 at /dev/vda
Apr 14 10:43:52 user nova-compute[71509]: DEBUG os_brick.utils [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 10:43:52 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:43:52 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:43:52 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c1d8f50-c4f9-419d-8135-74eec07bac07]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50119df3c417\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:43:52 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:43:52 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:43:52 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[53ae74ae-2c5e-4fe2-9c12-d4f3de14dca5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:43:52 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:43:52 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:43:52 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[0614f126-8639-4295-aa9a-579851b5971b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:43:52 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae2d7e30-3f90-4b98-a346-7cf12be33bc0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:43:52 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Running cmd (subprocess): nvme version {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:43:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] 'nvme version' failed. Not Retrying. {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 10:43:53 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.nvmeof [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] nvme not present on system {{(pid=71509) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 10:43:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:43:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 10:43:53 user nova-compute[71509]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 10:43:53 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[89001832-e316-49b9-8b0c-62bef356a209]: (4, '') {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:43:53 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71509) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 10:43:53 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71509) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 10:43:53 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] LIGHTOS: no hostnqn found. {{(pid=71509) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 10:43:53 user nova-compute[71509]: DEBUG os_brick.utils [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] <== get_connector_properties: return (268ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50119df3c417', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 10:43:53 user nova-compute[71509]: DEBUG nova.virt.block_device [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Updating existing volume attachment record: 1befc557-42c9-4a7c-af08-6269aba9ba51 {{(pid=71509) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 10:43:53 user nova-compute[71509]: DEBUG nova.policy [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3579ac20f8094f5a9fbd036ed05cda23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f701119cef78433280cbddf2adf685db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71509) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 10:43:54 user nova-compute[71509]: DEBUG nova.network.neutron [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Successfully created port: 2b341364-55e1-439f-9a3b-2b2fb7ad33b7 {{(pid=71509) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 10:43:54 user nova-compute[71509]: DEBUG nova.compute.manager [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Start spawning the instance on the hypervisor. {{(pid=71509) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 10:43:54 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Creating instance directory {{(pid=71509) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 10:43:54 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Creating image(s)
Apr 14 10:43:54 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Did not create local disks {{(pid=71509) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 10:43:54 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Ensure instance console log exists: /opt/stack/data/nova/instances/39586d44-1d8e-4607-ab4d-c03a7d841606/console.log {{(pid=71509) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 10:43:54 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:43:54 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:43:54 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:43:54 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Start _get_guest_xml network_info=[{"id": "6099437e-5607-4a06-abcb-15d465c7ecf8", "address": "fa:16:3e:4b:6c:e7", "network": {"id": "69274626-4a94-46d8-be28-534a98fb6817", "bridge": "br-int", "label": "tempest-TestShelveInstance-480849665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "340e1e1695464eb5ad8a8c881cf24611", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6099437e-56", "ovs_interfaceid": "6099437e-5607-4a06-abcb-15d465c7ecf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'attachment_id': 'd02c9678-3336-4956-849e-d8ad1efe3d2f', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xzHUpiIh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '39586d44-1d8e-4607-ab4d-c03a7d841606', 'attached_at': '', 'detached_at': '', 'volume_id': '5647685a-aec6-4498-b1b4-372602a4c7ee', 'serial': '5647685a-aec6-4498-b1b4-372602a4c7ee'}, 'disk_bus': 'virtio', 'delete_on_termination': True, 'volume_type': None} {{(pid=71509) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 10:43:54 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:43:54 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:43:54 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71509) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 10:43:54 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T10:40:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 10:43:54 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Flavor limits 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 10:43:54 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Image limits 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 10:43:54 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Flavor pref 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 10:43:54 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Image pref 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 10:43:54 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 10:43:54 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 10:43:54 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71509) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 10:43:54 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Got 1 possible topologies {{(pid=71509) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 10:43:54 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 10:43:54 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 10:43:54 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:43:54 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:43:54 user nova-compute[71509]: DEBUG os_brick.initiator.connector [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Factory for ISCSI on None {{(pid=71509) factory /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connector.py:281}}
Apr 14 10:43:54 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.007s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:43:54 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Calling os-brick to attach iSCSI Volume {{(pid=71509) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 10:43:54 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0bf0749390>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xzHUpiIh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 10:43:54 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 10:43:54 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 10:43:54 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 10:43:54 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 10:43:54 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 10:43:54 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 10:43:54 user nova-compute[71509]: INFO os_brick.initiator.connectors.iscsi [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 10:43:54 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee -p 172.16.0.220:3260 {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:43:54 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:43:54 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0c361e9-0c2b-49cf-b338-0c4c3e8bee07]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:43:54 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 10:43:54 user nova-compute[71509]:  {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:43:54 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee -p 172.16.0.220:3260 --interface default --op new {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:43:54 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:43:54 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[380db806-af65-4189-99ed-2e2f7f1e4c9a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee] added\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:43:54 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee] added
Apr 14 10:43:54 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:43:54 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:43:54 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:43:54 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[75bf8f6f-60dd-4fe9-b0b7-0d61b59e803e]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:43:54 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:43:54 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:43:54 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:43:54 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[5637c8a4-0ab4-4073-8850-eb771a0ed9d6]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:43:54 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:43:54 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xzHUpiIh {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:43:54 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xzHUpiIh" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:43:54 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[de48570a-b808-40a2-9eda-423ad396b578]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:43:54 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xzHUpiIh'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:43:54 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:43:55 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:43:55 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:43:55 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[67b63116-dc0b-41f1-a118-5c67337c3ce6]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:43:55 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:43:55 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:43:55 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:43:55 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ecbf3d9-c8e1-47df-9424-16c809681af7]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:43:55 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 14 10:43:55 user nova-compute[71509]:  {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:43:55 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 14 10:43:55 user nova-compute[71509]:  {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 10:43:55 user nova-compute[71509]: WARNING os_brick.initiator.connectors.iscsi [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 14 10:43:55 user nova-compute[71509]: 
Apr 14 10:43:55 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee -p 172.16.0.220:3260 --login {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:43:55 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:43:55 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[991101dd-8ded-4d5c-8aa4-e9d7392ec396]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:43:55 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee, portal: 172.16.0.220,3260]
Apr 14 10:43:55 user nova-compute[71509]: Login to [iface: default, target: iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee, portal: 172.16.0.220,3260] successful.
Apr 14 10:43:55 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:43:55 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:43:55 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:43:55 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[c265f552-0bf9-4633-8fd0-05529e01ea8d]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:43:55 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:43:55 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:43:55 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:43:55 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe499f14-9f2e-4b58-bd73-16513f01bac6]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:43:55 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee (non-flash)
Apr 14 10:43:55 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:43:55 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee (non-flash)
Apr 14 10:43:55 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 10:43:55 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.306s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 10:43:55 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Connected to 172.16.0.220:3260 {{(pid=71509) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 10:43:55 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=71509) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 10:43:55 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71509) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 10:43:55 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:43:55 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.031s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:43:55 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9de0a77-3020-4227-9de4-aabca9c6a28f]: (4, ('- - 0', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:43:55 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71509) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 10:43:55 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xzHUpiIh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71509) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 10:43:55 user nova-compute[71509]: DEBUG nova.network.neutron [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Successfully created port: c46b5082-6634-4c7f-89c1-7e58a3cd8987 {{(pid=71509) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 10:43:55 user nova-compute[71509]: DEBUG nova.network.neutron [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Successfully created port: 8789c03e-397c-439a-8bc5-5d8ce5fc36ac {{(pid=71509) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 10:43:55 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Acquiring lock "d1516acc-354e-41f6-a639-61dea870b11e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:43:55 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Lock "d1516acc-354e-41f6-a639-61dea870b11e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:43:55 user nova-compute[71509]: DEBUG nova.compute.manager [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Starting instance... {{(pid=71509) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 10:43:56 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:43:56 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:43:56 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71509) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 10:43:56 user nova-compute[71509]: INFO nova.compute.claims [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Claim successful on node user
Apr 14 10:43:56 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.364s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 10:43:56 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] <== connect_volume: return (1367ms) {'type': 'block', 'scsi_wwn': '23661376633333532', 'path': '/dev/sdb'} {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 10:43:56 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23661376633333532', 'path': '/dev/sdb'} {{(pid=71509) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 10:43:56 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T10:43:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1022992671',display_name='tempest-TestShelveInstance-server-1022992671',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1022992671',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE3ZHmXOyTBTmz/eyfbYxzCGMRdCEyszErL9xPCKFdEiRsMyb95B0M7mgiLexh904XoCh1bLLkQyrJ5ED+7iDH16ePICxxSDKO7GY80QCmCqc5cAXakERyNUFb4hTkOeQA==',key_name='tempest-TestShelveInstance-261961953',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='340e1e1695464eb5ad8a8c881cf24611',ramdisk_id='',reservation_id='r-ejwha0rq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1930659141',owner_user_name='tempest-TestShelveInstance-1930659141-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T10:43:47Z,user_data=None,user_id='15c4ab86a8d244c4be5889b4ac47561a',uuid=39586d44-1d8e-4607-ab4d-c03a7d841606,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6099437e-5607-4a06-abcb-15d465c7ecf8", "address": "fa:16:3e:4b:6c:e7", "network": {"id": "69274626-4a94-46d8-be28-534a98fb6817", "bridge": "br-int", "label": "tempest-TestShelveInstance-480849665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "340e1e1695464eb5ad8a8c881cf24611", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6099437e-56", "ovs_interfaceid": "6099437e-5607-4a06-abcb-15d465c7ecf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71509) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 10:43:56 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Converting VIF {"id": "6099437e-5607-4a06-abcb-15d465c7ecf8", "address": "fa:16:3e:4b:6c:e7", "network": {"id": "69274626-4a94-46d8-be28-534a98fb6817", "bridge": "br-int", "label": "tempest-TestShelveInstance-480849665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "340e1e1695464eb5ad8a8c881cf24611", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6099437e-56", "ovs_interfaceid": "6099437e-5607-4a06-abcb-15d465c7ecf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:43:56 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:6c:e7,bridge_name='br-int',has_traffic_filtering=True,id=6099437e-5607-4a06-abcb-15d465c7ecf8,network=Network(69274626-4a94-46d8-be28-534a98fb6817),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6099437e-56') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:43:56 user nova-compute[71509]: DEBUG nova.objects.instance [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Lazy-loading 'pci_devices' on Instance uuid 39586d44-1d8e-4607-ab4d-c03a7d841606 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:43:56 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] End _get_guest_xml xml=<domain type="kvm">
Apr 14 10:43:56 user nova-compute[71509]:   <uuid>39586d44-1d8e-4607-ab4d-c03a7d841606</uuid>
Apr 14 10:43:56 user nova-compute[71509]:   <name>instance-0000000a</name>
Apr 14 10:43:56 user nova-compute[71509]:   <memory>131072</memory>
Apr 14 10:43:56 user nova-compute[71509]:   <vcpu>1</vcpu>
Apr 14 10:43:56 user nova-compute[71509]:   <metadata>
Apr 14 10:43:56 user nova-compute[71509]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 10:43:56 user nova-compute[71509]:       <nova:package version="0.0.0"/>
Apr 14 10:43:56 user nova-compute[71509]:       <nova:name>tempest-TestShelveInstance-server-1022992671</nova:name>
Apr 14 10:43:56 user nova-compute[71509]:       <nova:creationTime>2023-04-14 10:43:54</nova:creationTime>
Apr 14 10:43:56 user nova-compute[71509]:       <nova:flavor name="m1.nano">
Apr 14 10:43:56 user nova-compute[71509]:         <nova:memory>128</nova:memory>
Apr 14 10:43:56 user nova-compute[71509]:         <nova:disk>1</nova:disk>
Apr 14 10:43:56 user nova-compute[71509]:         <nova:swap>0</nova:swap>
Apr 14 10:43:56 user nova-compute[71509]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 10:43:56 user nova-compute[71509]:         <nova:vcpus>1</nova:vcpus>
Apr 14 10:43:56 user nova-compute[71509]:       </nova:flavor>
Apr 14 10:43:56 user nova-compute[71509]:       <nova:owner>
Apr 14 10:43:56 user nova-compute[71509]:         <nova:user uuid="15c4ab86a8d244c4be5889b4ac47561a">tempest-TestShelveInstance-1930659141-project-member</nova:user>
Apr 14 10:43:56 user nova-compute[71509]:         <nova:project uuid="340e1e1695464eb5ad8a8c881cf24611">tempest-TestShelveInstance-1930659141</nova:project>
Apr 14 10:43:56 user nova-compute[71509]:       </nova:owner>
Apr 14 10:43:56 user nova-compute[71509]:       <nova:ports>
Apr 14 10:43:56 user nova-compute[71509]:         <nova:port uuid="6099437e-5607-4a06-abcb-15d465c7ecf8">
Apr 14 10:43:56 user nova-compute[71509]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 14 10:43:56 user nova-compute[71509]:         </nova:port>
Apr 14 10:43:56 user nova-compute[71509]:       </nova:ports>
Apr 14 10:43:56 user nova-compute[71509]:     </nova:instance>
Apr 14 10:43:56 user nova-compute[71509]:   </metadata>
Apr 14 10:43:56 user nova-compute[71509]:   <sysinfo type="smbios">
Apr 14 10:43:56 user nova-compute[71509]:     <system>
Apr 14 10:43:56 user nova-compute[71509]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 10:43:56 user nova-compute[71509]:       <entry name="product">OpenStack Nova</entry>
Apr 14 10:43:56 user nova-compute[71509]:       <entry name="version">0.0.0</entry>
Apr 14 10:43:56 user nova-compute[71509]:       <entry name="serial">39586d44-1d8e-4607-ab4d-c03a7d841606</entry>
Apr 14 10:43:56 user nova-compute[71509]:       <entry name="uuid">39586d44-1d8e-4607-ab4d-c03a7d841606</entry>
Apr 14 10:43:56 user nova-compute[71509]:       <entry name="family">Virtual Machine</entry>
Apr 14 10:43:56 user nova-compute[71509]:     </system>
Apr 14 10:43:56 user nova-compute[71509]:   </sysinfo>
Apr 14 10:43:56 user nova-compute[71509]:   <os>
Apr 14 10:43:56 user nova-compute[71509]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 10:43:56 user nova-compute[71509]:     <boot dev="hd"/>
Apr 14 10:43:56 user nova-compute[71509]:     <smbios mode="sysinfo"/>
Apr 14 10:43:56 user nova-compute[71509]:   </os>
Apr 14 10:43:56 user nova-compute[71509]:   <features>
Apr 14 10:43:56 user nova-compute[71509]:     <acpi/>
Apr 14 10:43:56 user nova-compute[71509]:     <apic/>
Apr 14 10:43:56 user nova-compute[71509]:     <vmcoreinfo/>
Apr 14 10:43:56 user nova-compute[71509]:   </features>
Apr 14 10:43:56 user nova-compute[71509]:   <clock offset="utc">
Apr 14 10:43:56 user nova-compute[71509]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 10:43:56 user nova-compute[71509]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 10:43:56 user nova-compute[71509]:     <timer name="hpet" present="no"/>
Apr 14 10:43:56 user nova-compute[71509]:   </clock>
Apr 14 10:43:56 user nova-compute[71509]:   <cpu mode="custom" match="exact">
Apr 14 10:43:56 user nova-compute[71509]:     <model>Nehalem</model>
Apr 14 10:43:56 user nova-compute[71509]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 10:43:56 user nova-compute[71509]:   </cpu>
Apr 14 10:43:56 user nova-compute[71509]:   <devices>
Apr 14 10:43:56 user nova-compute[71509]:     <disk type="block" device="disk">
Apr 14 10:43:56 user nova-compute[71509]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 10:43:56 user nova-compute[71509]:       <source dev="/dev/sdb"/>
Apr 14 10:43:56 user nova-compute[71509]:       <target dev="vda" bus="virtio"/>
Apr 14 10:43:56 user nova-compute[71509]:       <serial>5647685a-aec6-4498-b1b4-372602a4c7ee</serial>
Apr 14 10:43:56 user nova-compute[71509]:     </disk>
Apr 14 10:43:56 user nova-compute[71509]:     <interface type="ethernet">
Apr 14 10:43:56 user nova-compute[71509]:       <mac address="fa:16:3e:4b:6c:e7"/>
Apr 14 10:43:56 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 10:43:56 user nova-compute[71509]:       <mtu size="1442"/>
Apr 14 10:43:56 user nova-compute[71509]:       <target dev="tap6099437e-56"/>
Apr 14 10:43:56 user nova-compute[71509]:     </interface>
Apr 14 10:43:56 user nova-compute[71509]:     <serial type="pty">
Apr 14 10:43:56 user nova-compute[71509]:       <log file="/opt/stack/data/nova/instances/39586d44-1d8e-4607-ab4d-c03a7d841606/console.log" append="off"/>
Apr 14 10:43:56 user nova-compute[71509]:     </serial>
Apr 14 10:43:56 user nova-compute[71509]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 10:43:56 user nova-compute[71509]:     <video>
Apr 14 10:43:56 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 10:43:56 user nova-compute[71509]:     </video>
Apr 14 10:43:56 user nova-compute[71509]:     <rng model="virtio">
Apr 14 10:43:56 user nova-compute[71509]:       <backend model="random">/dev/urandom</backend>
Apr 14 10:43:56 user nova-compute[71509]:     </rng>
Apr 14 10:43:56 user nova-compute[71509]:     <controller type="usb" index="0" model="none"/>
Apr 14 10:43:56 user nova-compute[71509]:     <memballoon model="virtio">
Apr 14 10:43:56 user nova-compute[71509]:       <stats period="10"/>
Apr 14 10:43:56 user nova-compute[71509]:     </memballoon>
Apr 14 10:43:56 user nova-compute[71509]:   </devices>
Apr 14 10:43:56 user nova-compute[71509]: </domain>
Apr 14 10:43:56 user nova-compute[71509]:  {{(pid=71509) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 10:43:56 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T10:43:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1022992671',display_name='tempest-TestShelveInstance-server-1022992671',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1022992671',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE3ZHmXOyTBTmz/eyfbYxzCGMRdCEyszErL9xPCKFdEiRsMyb95B0M7mgiLexh904XoCh1bLLkQyrJ5ED+7iDH16ePICxxSDKO7GY80QCmCqc5cAXakERyNUFb4hTkOeQA==',key_name='tempest-TestShelveInstance-261961953',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='340e1e1695464eb5ad8a8c881cf24611',ramdisk_id='',reservation_id='r-ejwha0rq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1930659141',owner_user_name='tempest-TestShelveInstance-1930659141-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T10:43:47Z,user_data=None,user_id='15c4ab86a8d244c4be5889b4ac47561a',uuid=39586d44-1d8e-4607-ab4d-c03a7d841606,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6099437e-5607-4a06-abcb-15d465c7ecf8", "address": "fa:16:3e:4b:6c:e7", "network": {"id": "69274626-4a94-46d8-be28-534a98fb6817", "bridge": "br-int", "label": "tempest-TestShelveInstance-480849665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "340e1e1695464eb5ad8a8c881cf24611", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6099437e-56", "ovs_interfaceid": "6099437e-5607-4a06-abcb-15d465c7ecf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 10:43:56 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Converting VIF {"id": "6099437e-5607-4a06-abcb-15d465c7ecf8", "address": "fa:16:3e:4b:6c:e7", "network": {"id": "69274626-4a94-46d8-be28-534a98fb6817", "bridge": "br-int", "label": "tempest-TestShelveInstance-480849665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "340e1e1695464eb5ad8a8c881cf24611", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6099437e-56", "ovs_interfaceid": "6099437e-5607-4a06-abcb-15d465c7ecf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:43:56 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:6c:e7,bridge_name='br-int',has_traffic_filtering=True,id=6099437e-5607-4a06-abcb-15d465c7ecf8,network=Network(69274626-4a94-46d8-be28-534a98fb6817),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6099437e-56') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:43:56 user nova-compute[71509]: DEBUG os_vif [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:6c:e7,bridge_name='br-int',has_traffic_filtering=True,id=6099437e-5607-4a06-abcb-15d465c7ecf8,network=Network(69274626-4a94-46d8-be28-534a98fb6817),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6099437e-56') {{(pid=71509) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 10:43:56 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:43:56 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:43:56 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 10:43:56 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:43:56 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6099437e-56, may_exist=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:43:56 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6099437e-56, col_values=(('external_ids', {'iface-id': '6099437e-5607-4a06-abcb-15d465c7ecf8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4b:6c:e7', 'vm-uuid': '39586d44-1d8e-4607-ab4d-c03a7d841606'}),)) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:43:56 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:43:56 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 10:43:56 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:43:56 user nova-compute[71509]: INFO os_vif [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:6c:e7,bridge_name='br-int',has_traffic_filtering=True,id=6099437e-5607-4a06-abcb-15d465c7ecf8,network=Network(69274626-4a94-46d8-be28-534a98fb6817),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6099437e-56')
Apr 14 10:43:56 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] No BDM found with device name vda, not building metadata. {{(pid=71509) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 10:43:56 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] No VIF found with MAC fa:16:3e:4b:6c:e7, not building metadata {{(pid=71509) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 10:43:56 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 10:43:56 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 10:43:56 user nova-compute[71509]: DEBUG nova.network.neutron [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Successfully created port: 84e561e8-01c6-4d50-ab37-bc64b5509e31 {{(pid=71509) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 10:43:56 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.674s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:43:56 user nova-compute[71509]: DEBUG nova.compute.manager [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Start building networks asynchronously for instance. {{(pid=71509) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 10:43:56 user nova-compute[71509]: DEBUG nova.compute.manager [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Allocating IP information in the background. {{(pid=71509) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 10:43:56 user nova-compute[71509]: DEBUG nova.network.neutron [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] [instance: d1516acc-354e-41f6-a639-61dea870b11e] allocate_for_instance() {{(pid=71509) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 10:43:56 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 10:43:56 user nova-compute[71509]: DEBUG nova.compute.manager [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Start building block device mappings for instance. {{(pid=71509) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 10:43:57 user nova-compute[71509]: INFO nova.virt.block_device [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Booting with volume 146f2d89-f831-40b0-a5cd-75a2761fb700 at /dev/vda
Apr 14 10:43:57 user nova-compute[71509]: DEBUG nova.policy [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1f6dac34303f4965babaee39bb363b5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e024f5a578e4543a02c6adc7d456f39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71509) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 10:43:57 user nova-compute[71509]: DEBUG os_brick.utils [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 10:43:57 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:43:57 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:43:57 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:43:57 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a909aee-d764-4782-93c1-bac78815643f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50119df3c417\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:43:57 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:43:57 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:43:57 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5da7fad-21f6-48c8-8280-6e5d0dc1781e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:43:57 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:43:57 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:43:57 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[319566e0-b206-4634-86e9-c2d7ad991d94]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:43:57 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[db64d772-7a4e-48d6-a04f-a56d6d90aa77]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:43:57 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Running cmd (subprocess): nvme version {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:43:57 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] 'nvme version' failed. Not Retrying. {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 10:43:57 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] nvme not present on system {{(pid=71509) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 10:43:57 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:43:57 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 10:43:57 user nova-compute[71509]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 10:43:57 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[b759e989-d847-4b8a-8ba2-52d4cf13bdb7]: (4, '') {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:43:57 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71509) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 10:43:57 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71509) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 10:43:57 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] LIGHTOS: no hostnqn found. {{(pid=71509) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 10:43:57 user nova-compute[71509]: DEBUG os_brick.utils [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50119df3c417', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 10:43:57 user nova-compute[71509]: DEBUG nova.virt.block_device [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Updating existing volume attachment record: 73d0dd3b-7d05-4335-95ff-e7dfe44a882d {{(pid=71509) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 10:43:57 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:43:57 user nova-compute[71509]: DEBUG nova.network.neutron [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Successfully created port: 717e6c20-676e-40f2-b4c1-47ca0f3e6f22 {{(pid=71509) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 10:43:57 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:43:57 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:43:57 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:43:58 user nova-compute[71509]: DEBUG nova.compute.manager [req-8fbb37c9-ecb8-4ef7-97ab-5bc8af71b8c6 req-aa9e9fc0-8412-435c-957c-84c5322c17ea service nova] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Received event network-vif-plugged-6099437e-5607-4a06-abcb-15d465c7ecf8 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:43:58 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-8fbb37c9-ecb8-4ef7-97ab-5bc8af71b8c6 req-aa9e9fc0-8412-435c-957c-84c5322c17ea service nova] Acquiring lock "39586d44-1d8e-4607-ab4d-c03a7d841606-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:43:58 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-8fbb37c9-ecb8-4ef7-97ab-5bc8af71b8c6 req-aa9e9fc0-8412-435c-957c-84c5322c17ea service nova] Lock "39586d44-1d8e-4607-ab4d-c03a7d841606-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:43:58 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-8fbb37c9-ecb8-4ef7-97ab-5bc8af71b8c6 req-aa9e9fc0-8412-435c-957c-84c5322c17ea service nova] Lock "39586d44-1d8e-4607-ab4d-c03a7d841606-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:43:58 user nova-compute[71509]: DEBUG nova.compute.manager [req-8fbb37c9-ecb8-4ef7-97ab-5bc8af71b8c6 req-aa9e9fc0-8412-435c-957c-84c5322c17ea service nova] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] No waiting events found dispatching network-vif-plugged-6099437e-5607-4a06-abcb-15d465c7ecf8 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:43:58 user nova-compute[71509]: WARNING nova.compute.manager [req-8fbb37c9-ecb8-4ef7-97ab-5bc8af71b8c6 req-aa9e9fc0-8412-435c-957c-84c5322c17ea service nova] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Received unexpected event network-vif-plugged-6099437e-5607-4a06-abcb-15d465c7ecf8 for instance with vm_state building and task_state spawning.
Apr 14 10:43:58 user nova-compute[71509]: INFO nova.virt.block_device [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Booting with volume 18ba60c5-2a70-402c-a557-69dd9c886768 at /dev/vdb
Apr 14 10:43:58 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:43:58 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:43:58 user nova-compute[71509]: DEBUG os_brick.utils [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 10:43:58 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:43:58 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:43:58 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[f34fd7aa-894b-4362-950f-738f7558c459]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50119df3c417\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:43:58 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:43:58 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:43:58 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[b96c4d1d-4eae-4982-bc49-64df17e5b64f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:43:58 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:43:58 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:43:58 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcd0677f-242a-472d-83e8-92c860845773]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:43:58 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ca29b54-7b32-4006-b1ac-f7e807b96852]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:43:58 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Running cmd (subprocess): nvme version {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:43:58 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] 'nvme version' failed. Not Retrying. {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 10:43:58 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.nvmeof [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] nvme not present on system {{(pid=71509) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 10:43:58 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:43:58 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 10:43:58 user nova-compute[71509]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 10:43:58 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[5001909e-eb9d-4916-b91b-65ffc737c4ba]: (4, '') {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:43:58 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71509) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 10:43:58 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71509) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 10:43:58 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] LIGHTOS: no hostnqn found. {{(pid=71509) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 10:43:58 user nova-compute[71509]: DEBUG os_brick.utils [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50119df3c417', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 10:43:58 user nova-compute[71509]: DEBUG nova.virt.block_device [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Updating existing volume attachment record: 5c09abfe-5887-4eea-9c17-e375df21d462 {{(pid=71509) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 10:43:58 user nova-compute[71509]: DEBUG nova.network.neutron [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Successfully created port: 2a2ef05a-2d58-4cdf-ab6c-35df823a68bc {{(pid=71509) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 10:43:59 user nova-compute[71509]: DEBUG nova.network.neutron [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Successfully updated port: 2b341364-55e1-439f-9a3b-2b2fb7ad33b7 {{(pid=71509) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 10:43:59 user nova-compute[71509]: DEBUG nova.compute.manager [req-0a6f4345-5b07-40d7-bab8-4806e1d2d0ba req-6cce97a9-6f0c-4c2f-8dc9-ef668e489a31 service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Received event network-changed-2b341364-55e1-439f-9a3b-2b2fb7ad33b7 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:43:59 user nova-compute[71509]: DEBUG nova.compute.manager [req-0a6f4345-5b07-40d7-bab8-4806e1d2d0ba req-6cce97a9-6f0c-4c2f-8dc9-ef668e489a31 service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Refreshing instance network info cache due to event network-changed-2b341364-55e1-439f-9a3b-2b2fb7ad33b7. {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 10:43:59 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-0a6f4345-5b07-40d7-bab8-4806e1d2d0ba req-6cce97a9-6f0c-4c2f-8dc9-ef668e489a31 service nova] Acquiring lock "refresh_cache-a81da242-e8d8-4b41-b84a-e12d603823ca" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:43:59 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-0a6f4345-5b07-40d7-bab8-4806e1d2d0ba req-6cce97a9-6f0c-4c2f-8dc9-ef668e489a31 service nova] Acquired lock "refresh_cache-a81da242-e8d8-4b41-b84a-e12d603823ca" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:43:59 user nova-compute[71509]: DEBUG nova.network.neutron [req-0a6f4345-5b07-40d7-bab8-4806e1d2d0ba req-6cce97a9-6f0c-4c2f-8dc9-ef668e489a31 service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Refreshing network info cache for port 2b341364-55e1-439f-9a3b-2b2fb7ad33b7 {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 10:43:59 user nova-compute[71509]: DEBUG nova.network.neutron [req-0a6f4345-5b07-40d7-bab8-4806e1d2d0ba req-6cce97a9-6f0c-4c2f-8dc9-ef668e489a31 service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Instance cache missing network info. {{(pid=71509) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 10:43:59 user nova-compute[71509]: DEBUG nova.network.neutron [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Successfully created port: 4d65e4a1-4cea-4636-8ad8-21065de3c747 {{(pid=71509) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 10:43:59 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:43:59 user nova-compute[71509]: DEBUG nova.network.neutron [req-0a6f4345-5b07-40d7-bab8-4806e1d2d0ba req-6cce97a9-6f0c-4c2f-8dc9-ef668e489a31 service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Updating instance_info_cache with network_info: [] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:43:59 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-0a6f4345-5b07-40d7-bab8-4806e1d2d0ba req-6cce97a9-6f0c-4c2f-8dc9-ef668e489a31 service nova] Releasing lock "refresh_cache-a81da242-e8d8-4b41-b84a-e12d603823ca" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:44:00 user nova-compute[71509]: DEBUG nova.network.neutron [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Successfully created port: d70f6f4d-f2bc-4d5e-9e98-a0daa1b35a0f {{(pid=71509) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 10:44:00 user nova-compute[71509]: DEBUG nova.compute.manager [req-444fdce6-cabc-417c-9106-f4ec04d95b51 req-610b479b-f65b-41fe-ac73-57f9285e21d0 service nova] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Received event network-vif-plugged-6099437e-5607-4a06-abcb-15d465c7ecf8 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:44:00 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-444fdce6-cabc-417c-9106-f4ec04d95b51 req-610b479b-f65b-41fe-ac73-57f9285e21d0 service nova] Acquiring lock "39586d44-1d8e-4607-ab4d-c03a7d841606-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:44:00 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-444fdce6-cabc-417c-9106-f4ec04d95b51 req-610b479b-f65b-41fe-ac73-57f9285e21d0 service nova] Lock "39586d44-1d8e-4607-ab4d-c03a7d841606-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:44:00 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-444fdce6-cabc-417c-9106-f4ec04d95b51 req-610b479b-f65b-41fe-ac73-57f9285e21d0 service nova] Lock "39586d44-1d8e-4607-ab4d-c03a7d841606-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:44:00 user nova-compute[71509]: DEBUG nova.compute.manager [req-444fdce6-cabc-417c-9106-f4ec04d95b51 req-610b479b-f65b-41fe-ac73-57f9285e21d0 service nova] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] No waiting events found dispatching network-vif-plugged-6099437e-5607-4a06-abcb-15d465c7ecf8 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:44:00 user nova-compute[71509]: WARNING nova.compute.manager [req-444fdce6-cabc-417c-9106-f4ec04d95b51 req-610b479b-f65b-41fe-ac73-57f9285e21d0 service nova] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Received unexpected event network-vif-plugged-6099437e-5607-4a06-abcb-15d465c7ecf8 for instance with vm_state building and task_state spawning.
Apr 14 10:44:00 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681469040.3687909, 39586d44-1d8e-4607-ab4d-c03a7d841606 => Resumed> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 10:44:00 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] VM Resumed (Lifecycle Event)
Apr 14 10:44:00 user nova-compute[71509]: DEBUG nova.compute.manager [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Instance event wait completed in 0 seconds for  {{(pid=71509) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 10:44:00 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Guest created on hypervisor {{(pid=71509) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 10:44:00 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:44:00 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Instance spawned successfully.
Apr 14 10:44:00 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 10:44:00 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 10:44:00 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 10:44:00 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681469040.379171, 39586d44-1d8e-4607-ab4d-c03a7d841606 => Started> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 10:44:00 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] VM Started (Lifecycle Event)
Apr 14 10:44:00 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Found default for hw_cdrom_bus of ide {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:44:00 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Found default for hw_disk_bus of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:44:00 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Found default for hw_input_bus of None {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:44:00 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Found default for hw_pointer_model of None {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:44:00 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Found default for hw_video_model of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:44:00 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Found default for hw_vif_model of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:44:00 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:44:00 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 10:44:00 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 10:44:00 user nova-compute[71509]: INFO nova.compute.manager [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Took 5.82 seconds to spawn the instance on the hypervisor.
Apr 14 10:44:00 user nova-compute[71509]: DEBUG nova.compute.manager [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:44:00 user nova-compute[71509]: INFO nova.compute.manager [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Took 14.32 seconds to build instance.
Apr 14 10:44:00 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-ab6fc22d-4d61-43f1-abf2-066ccb670d05 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Lock "39586d44-1d8e-4607-ab4d-c03a7d841606" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.444s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:44:01 user nova-compute[71509]: DEBUG nova.network.neutron [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Successfully created port: 328d2b64-7bc6-425a-b3a4-8cda754ffd56 {{(pid=71509) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 10:44:01 user nova-compute[71509]: DEBUG nova.network.neutron [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Successfully updated port: f3e8f62b-77e2-49d5-9fd9-b75f024a4ee7 {{(pid=71509) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 10:44:01 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:01 user nova-compute[71509]: DEBUG nova.compute.manager [req-06b65906-86d9-4045-ae7b-fe4bb61dcafc req-3b6b36c6-a720-4b96-b7b5-90b7bb7e7020 service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Received event network-changed-f3e8f62b-77e2-49d5-9fd9-b75f024a4ee7 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:44:01 user nova-compute[71509]: DEBUG nova.compute.manager [req-06b65906-86d9-4045-ae7b-fe4bb61dcafc req-3b6b36c6-a720-4b96-b7b5-90b7bb7e7020 service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Refreshing instance network info cache due to event network-changed-f3e8f62b-77e2-49d5-9fd9-b75f024a4ee7. {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 10:44:01 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-06b65906-86d9-4045-ae7b-fe4bb61dcafc req-3b6b36c6-a720-4b96-b7b5-90b7bb7e7020 service nova] Acquiring lock "refresh_cache-a81da242-e8d8-4b41-b84a-e12d603823ca" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:44:01 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-06b65906-86d9-4045-ae7b-fe4bb61dcafc req-3b6b36c6-a720-4b96-b7b5-90b7bb7e7020 service nova] Acquired lock "refresh_cache-a81da242-e8d8-4b41-b84a-e12d603823ca" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:44:01 user nova-compute[71509]: DEBUG nova.network.neutron [req-06b65906-86d9-4045-ae7b-fe4bb61dcafc req-3b6b36c6-a720-4b96-b7b5-90b7bb7e7020 service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Refreshing network info cache for port f3e8f62b-77e2-49d5-9fd9-b75f024a4ee7 {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 10:44:01 user nova-compute[71509]: DEBUG nova.network.neutron [req-06b65906-86d9-4045-ae7b-fe4bb61dcafc req-3b6b36c6-a720-4b96-b7b5-90b7bb7e7020 service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Instance cache missing network info. {{(pid=71509) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 10:44:01 user nova-compute[71509]: DEBUG nova.network.neutron [req-06b65906-86d9-4045-ae7b-fe4bb61dcafc req-3b6b36c6-a720-4b96-b7b5-90b7bb7e7020 service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Updating instance_info_cache with network_info: [] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:44:01 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-06b65906-86d9-4045-ae7b-fe4bb61dcafc req-3b6b36c6-a720-4b96-b7b5-90b7bb7e7020 service nova] Releasing lock "refresh_cache-a81da242-e8d8-4b41-b84a-e12d603823ca" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:44:02 user nova-compute[71509]: DEBUG nova.network.neutron [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Successfully created port: 6e295a29-0297-49c0-9298-7d3a41a07585 {{(pid=71509) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 10:44:02 user nova-compute[71509]: DEBUG nova.network.neutron [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Successfully updated port: d2d71e67-1807-43cf-8753-7bdd77de6317 {{(pid=71509) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 10:44:02 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:03 user nova-compute[71509]: DEBUG nova.network.neutron [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Successfully updated port: c46b5082-6634-4c7f-89c1-7e58a3cd8987 {{(pid=71509) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 10:44:03 user nova-compute[71509]: DEBUG nova.compute.manager [req-e65ad949-ec46-49d0-9317-2f85c91cd50a req-b3f2ff2b-221b-4da9-b918-7b3b123bc86f service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Received event network-changed-d2d71e67-1807-43cf-8753-7bdd77de6317 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:44:03 user nova-compute[71509]: DEBUG nova.compute.manager [req-e65ad949-ec46-49d0-9317-2f85c91cd50a req-b3f2ff2b-221b-4da9-b918-7b3b123bc86f service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Refreshing instance network info cache due to event network-changed-d2d71e67-1807-43cf-8753-7bdd77de6317. {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 10:44:03 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-e65ad949-ec46-49d0-9317-2f85c91cd50a req-b3f2ff2b-221b-4da9-b918-7b3b123bc86f service nova] Acquiring lock "refresh_cache-a81da242-e8d8-4b41-b84a-e12d603823ca" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:44:03 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-e65ad949-ec46-49d0-9317-2f85c91cd50a req-b3f2ff2b-221b-4da9-b918-7b3b123bc86f service nova] Acquired lock "refresh_cache-a81da242-e8d8-4b41-b84a-e12d603823ca" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:44:03 user nova-compute[71509]: DEBUG nova.network.neutron [req-e65ad949-ec46-49d0-9317-2f85c91cd50a req-b3f2ff2b-221b-4da9-b918-7b3b123bc86f service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Refreshing network info cache for port d2d71e67-1807-43cf-8753-7bdd77de6317 {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 10:44:03 user nova-compute[71509]: DEBUG nova.network.neutron [req-e65ad949-ec46-49d0-9317-2f85c91cd50a req-b3f2ff2b-221b-4da9-b918-7b3b123bc86f service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Instance cache missing network info. {{(pid=71509) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 10:44:03 user nova-compute[71509]: DEBUG nova.network.neutron [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Successfully updated port: 2a2ef05a-2d58-4cdf-ab6c-35df823a68bc {{(pid=71509) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 10:44:03 user nova-compute[71509]: DEBUG nova.compute.manager [req-b43585ac-4307-476c-b423-ea4de98d2abe req-aa1fe73d-741e-4c05-bfda-106367918d69 service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Received event network-changed-2a2ef05a-2d58-4cdf-ab6c-35df823a68bc {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:44:03 user nova-compute[71509]: DEBUG nova.compute.manager [req-b43585ac-4307-476c-b423-ea4de98d2abe req-aa1fe73d-741e-4c05-bfda-106367918d69 service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Refreshing instance network info cache due to event network-changed-2a2ef05a-2d58-4cdf-ab6c-35df823a68bc. {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 10:44:03 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-b43585ac-4307-476c-b423-ea4de98d2abe req-aa1fe73d-741e-4c05-bfda-106367918d69 service nova] Acquiring lock "refresh_cache-d1516acc-354e-41f6-a639-61dea870b11e" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:44:03 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-b43585ac-4307-476c-b423-ea4de98d2abe req-aa1fe73d-741e-4c05-bfda-106367918d69 service nova] Acquired lock "refresh_cache-d1516acc-354e-41f6-a639-61dea870b11e" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:44:03 user nova-compute[71509]: DEBUG nova.network.neutron [req-b43585ac-4307-476c-b423-ea4de98d2abe req-aa1fe73d-741e-4c05-bfda-106367918d69 service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Refreshing network info cache for port 2a2ef05a-2d58-4cdf-ab6c-35df823a68bc {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 10:44:03 user nova-compute[71509]: DEBUG nova.network.neutron [req-b43585ac-4307-476c-b423-ea4de98d2abe req-aa1fe73d-741e-4c05-bfda-106367918d69 service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Instance cache missing network info. {{(pid=71509) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 10:44:03 user nova-compute[71509]: INFO nova.virt.block_device [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Booting with volume a80b10a6-3148-4db6-842e-f343407b1171 at /dev/vdb
Apr 14 10:44:03 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-2e20a1e0-8c5b-48b6-9b30-f64db9276c01 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Acquiring lock "55178126-9766-4875-9122-39dcc87ce82c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:44:03 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-2e20a1e0-8c5b-48b6-9b30-f64db9276c01 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "55178126-9766-4875-9122-39dcc87ce82c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:44:03 user nova-compute[71509]: DEBUG nova.compute.manager [None req-2e20a1e0-8c5b-48b6-9b30-f64db9276c01 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] [instance: 55178126-9766-4875-9122-39dcc87ce82c] Starting instance... {{(pid=71509) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 10:44:03 user nova-compute[71509]: DEBUG nova.network.neutron [req-e65ad949-ec46-49d0-9317-2f85c91cd50a req-b3f2ff2b-221b-4da9-b918-7b3b123bc86f service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Updating instance_info_cache with network_info: [] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:44:03 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-e65ad949-ec46-49d0-9317-2f85c91cd50a req-b3f2ff2b-221b-4da9-b918-7b3b123bc86f service nova] Releasing lock "refresh_cache-a81da242-e8d8-4b41-b84a-e12d603823ca" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:44:03 user nova-compute[71509]: DEBUG nova.compute.manager [req-e65ad949-ec46-49d0-9317-2f85c91cd50a req-b3f2ff2b-221b-4da9-b918-7b3b123bc86f service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Received event network-changed-c46b5082-6634-4c7f-89c1-7e58a3cd8987 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:44:03 user nova-compute[71509]: DEBUG nova.compute.manager [req-e65ad949-ec46-49d0-9317-2f85c91cd50a req-b3f2ff2b-221b-4da9-b918-7b3b123bc86f service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Refreshing instance network info cache due to event network-changed-c46b5082-6634-4c7f-89c1-7e58a3cd8987. {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 10:44:03 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-e65ad949-ec46-49d0-9317-2f85c91cd50a req-b3f2ff2b-221b-4da9-b918-7b3b123bc86f service nova] Acquiring lock "refresh_cache-a81da242-e8d8-4b41-b84a-e12d603823ca" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:44:03 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-e65ad949-ec46-49d0-9317-2f85c91cd50a req-b3f2ff2b-221b-4da9-b918-7b3b123bc86f service nova] Acquired lock "refresh_cache-a81da242-e8d8-4b41-b84a-e12d603823ca" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:44:03 user nova-compute[71509]: DEBUG nova.network.neutron [req-e65ad949-ec46-49d0-9317-2f85c91cd50a req-b3f2ff2b-221b-4da9-b918-7b3b123bc86f service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Refreshing network info cache for port c46b5082-6634-4c7f-89c1-7e58a3cd8987 {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 10:44:03 user nova-compute[71509]: DEBUG os_brick.utils [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 10:44:03 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:03 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:44:03 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[06a2ed4e-c28f-484b-8347-beffe7015583]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50119df3c417\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:44:03 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:04 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:44:04 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ce04a2e-4260-4427-94f5-d48594429415]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:44:04 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:04 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-2e20a1e0-8c5b-48b6-9b30-f64db9276c01 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:44:04 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-2e20a1e0-8c5b-48b6-9b30-f64db9276c01 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:44:04 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-2e20a1e0-8c5b-48b6-9b30-f64db9276c01 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71509) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 10:44:04 user nova-compute[71509]: INFO nova.compute.claims [None req-2e20a1e0-8c5b-48b6-9b30-f64db9276c01 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] [instance: 55178126-9766-4875-9122-39dcc87ce82c] Claim successful on node user
Apr 14 10:44:04 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:44:04 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e2085ee-f76f-4059-893c-846f93d499f3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:44:04 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[649a567e-ea1f-430c-86aa-08ad0cb93071]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:44:04 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Running cmd (subprocess): nvme version {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:04 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] 'nvme version' failed. Not Retrying. {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 10:44:04 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] nvme not present on system {{(pid=71509) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 10:44:04 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:04 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 10:44:04 user nova-compute[71509]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 10:44:04 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ba150cc-4702-4b76-9aa2-873805ad5d9c]: (4, '') {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:44:04 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71509) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 10:44:04 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71509) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 10:44:04 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] LIGHTOS: no hostnqn found. {{(pid=71509) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 10:44:04 user nova-compute[71509]: DEBUG os_brick.utils [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] <== get_connector_properties: return (168ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50119df3c417', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 10:44:04 user nova-compute[71509]: DEBUG nova.virt.block_device [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Updating existing volume attachment record: 641929e9-b968-44ba-ad80-dc6e9d158459 {{(pid=71509) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 10:44:04 user nova-compute[71509]: DEBUG nova.network.neutron [req-e65ad949-ec46-49d0-9317-2f85c91cd50a req-b3f2ff2b-221b-4da9-b918-7b3b123bc86f service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Instance cache missing network info. {{(pid=71509) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 10:44:04 user nova-compute[71509]: DEBUG nova.network.neutron [req-b43585ac-4307-476c-b423-ea4de98d2abe req-aa1fe73d-741e-4c05-bfda-106367918d69 service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Updating instance_info_cache with network_info: [] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:44:04 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-b43585ac-4307-476c-b423-ea4de98d2abe req-aa1fe73d-741e-4c05-bfda-106367918d69 service nova] Releasing lock "refresh_cache-d1516acc-354e-41f6-a639-61dea870b11e" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:44:04 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-2e20a1e0-8c5b-48b6-9b30-f64db9276c01 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 10:44:04 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-2e20a1e0-8c5b-48b6-9b30-f64db9276c01 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 10:44:04 user nova-compute[71509]: INFO nova.virt.block_device [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Booting with volume 7653f786-98b3-4e3d-b593-3b9fec984d92 at /dev/vdc
Apr 14 10:44:04 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-2e20a1e0-8c5b-48b6-9b30-f64db9276c01 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.786s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:44:04 user nova-compute[71509]: DEBUG nova.compute.manager [None req-2e20a1e0-8c5b-48b6-9b30-f64db9276c01 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] [instance: 55178126-9766-4875-9122-39dcc87ce82c] Start building networks asynchronously for instance. {{(pid=71509) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 10:44:04 user nova-compute[71509]: DEBUG nova.compute.manager [None req-2e20a1e0-8c5b-48b6-9b30-f64db9276c01 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] [instance: 55178126-9766-4875-9122-39dcc87ce82c] Allocating IP information in the background. {{(pid=71509) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 10:44:04 user nova-compute[71509]: DEBUG nova.network.neutron [None req-2e20a1e0-8c5b-48b6-9b30-f64db9276c01 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] [instance: 55178126-9766-4875-9122-39dcc87ce82c] allocate_for_instance() {{(pid=71509) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 10:44:04 user nova-compute[71509]: DEBUG os_brick.utils [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 10:44:04 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-2e20a1e0-8c5b-48b6-9b30-f64db9276c01 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] [instance: 55178126-9766-4875-9122-39dcc87ce82c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 10:44:04 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:04 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:44:04 user nova-compute[71509]: DEBUG nova.compute.manager [None req-2e20a1e0-8c5b-48b6-9b30-f64db9276c01 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] [instance: 55178126-9766-4875-9122-39dcc87ce82c] Start building block device mappings for instance. {{(pid=71509) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 10:44:04 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3af091a-6de9-4376-8d04-c7fe23b43ec3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50119df3c417\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:44:04 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:04 user nova-compute[71509]: DEBUG nova.network.neutron [req-e65ad949-ec46-49d0-9317-2f85c91cd50a req-b3f2ff2b-221b-4da9-b918-7b3b123bc86f service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Updating instance_info_cache with network_info: [] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:44:04 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:44:04 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[c07047dc-5879-4556-bfe0-b8531e44d993]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:44:04 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:04 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-e65ad949-ec46-49d0-9317-2f85c91cd50a req-b3f2ff2b-221b-4da9-b918-7b3b123bc86f service nova] Releasing lock "refresh_cache-a81da242-e8d8-4b41-b84a-e12d603823ca" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:44:04 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:44:04 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[f459e1bc-a151-4800-aa85-642e24045cfb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:44:04 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[3008bf99-8277-4fdd-be95-d3d0d81c50a4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:44:04 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Running cmd (subprocess): nvme version {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:05 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] 'nvme version' failed. Not Retrying. {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 10:44:05 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.nvmeof [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] nvme not present on system {{(pid=71509) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 10:44:05 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:05 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 10:44:05 user nova-compute[71509]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 10:44:05 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[91a6058f-f084-4719-a3fd-926cfc39148f]: (4, '') {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:44:05 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71509) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 10:44:05 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71509) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 10:44:05 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] LIGHTOS: no hostnqn found. {{(pid=71509) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 10:44:05 user nova-compute[71509]: DEBUG os_brick.utils [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] <== get_connector_properties: return (173ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50119df3c417', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 10:44:05 user nova-compute[71509]: DEBUG nova.virt.block_device [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Updating existing volume attachment record: 61b6ca56-f78e-4005-a60d-ba60a97e4e62 {{(pid=71509) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 10:44:05 user nova-compute[71509]: DEBUG nova.network.neutron [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Successfully updated port: 8789c03e-397c-439a-8bc5-5d8ce5fc36ac {{(pid=71509) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 10:44:05 user nova-compute[71509]: DEBUG nova.policy [None req-2e20a1e0-8c5b-48b6-9b30-f64db9276c01 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '09ed4663d8984fe7b5d95616281bfbfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1696bf804b2e4d7f86162513015c8e52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71509) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 10:44:05 user nova-compute[71509]: DEBUG nova.compute.manager [None req-2e20a1e0-8c5b-48b6-9b30-f64db9276c01 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] [instance: 55178126-9766-4875-9122-39dcc87ce82c] Start spawning the instance on the hypervisor. {{(pid=71509) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 10:44:05 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-2e20a1e0-8c5b-48b6-9b30-f64db9276c01 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] [instance: 55178126-9766-4875-9122-39dcc87ce82c] Creating instance directory {{(pid=71509) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 10:44:05 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-2e20a1e0-8c5b-48b6-9b30-f64db9276c01 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] [instance: 55178126-9766-4875-9122-39dcc87ce82c] Creating image(s)
Apr 14 10:44:05 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-2e20a1e0-8c5b-48b6-9b30-f64db9276c01 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Acquiring lock "/opt/stack/data/nova/instances/55178126-9766-4875-9122-39dcc87ce82c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:44:05 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-2e20a1e0-8c5b-48b6-9b30-f64db9276c01 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "/opt/stack/data/nova/instances/55178126-9766-4875-9122-39dcc87ce82c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:44:05 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-2e20a1e0-8c5b-48b6-9b30-f64db9276c01 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "/opt/stack/data/nova/instances/55178126-9766-4875-9122-39dcc87ce82c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:44:05 user nova-compute[71509]: DEBUG nova.network.neutron [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Successfully updated port: 23214923-0217-4046-9a68-675f2ee8e42d {{(pid=71509) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 10:44:05 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-2e20a1e0-8c5b-48b6-9b30-f64db9276c01 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:05 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-2e20a1e0-8c5b-48b6-9b30-f64db9276c01 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json" returned: 0 in 0.158s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:44:05 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-2e20a1e0-8c5b-48b6-9b30-f64db9276c01 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Acquiring lock "5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:44:05 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-2e20a1e0-8c5b-48b6-9b30-f64db9276c01 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:44:05 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-2e20a1e0-8c5b-48b6-9b30-f64db9276c01 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:05 user nova-compute[71509]: DEBUG nova.compute.manager [req-451921fe-2cfe-4665-a3ed-b5de497f190b req-c96ca034-8f65-4d21-95bc-3c55c1bee5dc service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Received event network-changed-8789c03e-397c-439a-8bc5-5d8ce5fc36ac {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:44:05 user nova-compute[71509]: DEBUG nova.compute.manager [req-451921fe-2cfe-4665-a3ed-b5de497f190b req-c96ca034-8f65-4d21-95bc-3c55c1bee5dc service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Refreshing instance network info cache due to event network-changed-8789c03e-397c-439a-8bc5-5d8ce5fc36ac. {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 10:44:05 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-451921fe-2cfe-4665-a3ed-b5de497f190b req-c96ca034-8f65-4d21-95bc-3c55c1bee5dc service nova] Acquiring lock "refresh_cache-a81da242-e8d8-4b41-b84a-e12d603823ca" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:44:05 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-451921fe-2cfe-4665-a3ed-b5de497f190b req-c96ca034-8f65-4d21-95bc-3c55c1bee5dc service nova] Acquired lock "refresh_cache-a81da242-e8d8-4b41-b84a-e12d603823ca" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:44:05 user nova-compute[71509]: DEBUG nova.network.neutron [req-451921fe-2cfe-4665-a3ed-b5de497f190b req-c96ca034-8f65-4d21-95bc-3c55c1bee5dc service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Refreshing network info cache for port 8789c03e-397c-439a-8bc5-5d8ce5fc36ac {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 10:44:05 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-2e20a1e0-8c5b-48b6-9b30-f64db9276c01 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json" returned: 0 in 0.189s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:44:05 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-2e20a1e0-8c5b-48b6-9b30-f64db9276c01 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18,backing_fmt=raw /opt/stack/data/nova/instances/55178126-9766-4875-9122-39dcc87ce82c/disk 1073741824 {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:05 user nova-compute[71509]: DEBUG nova.network.neutron [req-451921fe-2cfe-4665-a3ed-b5de497f190b req-c96ca034-8f65-4d21-95bc-3c55c1bee5dc service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Instance cache missing network info. {{(pid=71509) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 10:44:05 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-2e20a1e0-8c5b-48b6-9b30-f64db9276c01 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18,backing_fmt=raw /opt/stack/data/nova/instances/55178126-9766-4875-9122-39dcc87ce82c/disk 1073741824" returned: 0 in 0.127s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:44:05 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-2e20a1e0-8c5b-48b6-9b30-f64db9276c01 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.321s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:44:05 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-2e20a1e0-8c5b-48b6-9b30-f64db9276c01 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:05 user nova-compute[71509]: DEBUG nova.compute.manager [req-6e4b5846-3e25-47d8-a6f3-8d2ea4a0596b req-0712ec75-f771-4138-9854-9ab2861e96b5 service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Received event network-changed-23214923-0217-4046-9a68-675f2ee8e42d {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:44:05 user nova-compute[71509]: DEBUG nova.compute.manager [req-6e4b5846-3e25-47d8-a6f3-8d2ea4a0596b req-0712ec75-f771-4138-9854-9ab2861e96b5 service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Refreshing instance network info cache due to event network-changed-23214923-0217-4046-9a68-675f2ee8e42d. {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 10:44:05 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-6e4b5846-3e25-47d8-a6f3-8d2ea4a0596b req-0712ec75-f771-4138-9854-9ab2861e96b5 service nova] Acquiring lock "refresh_cache-d1516acc-354e-41f6-a639-61dea870b11e" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:44:05 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-6e4b5846-3e25-47d8-a6f3-8d2ea4a0596b req-0712ec75-f771-4138-9854-9ab2861e96b5 service nova] Acquired lock "refresh_cache-d1516acc-354e-41f6-a639-61dea870b11e" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:44:05 user nova-compute[71509]: DEBUG nova.network.neutron [req-6e4b5846-3e25-47d8-a6f3-8d2ea4a0596b req-0712ec75-f771-4138-9854-9ab2861e96b5 service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Refreshing network info cache for port 23214923-0217-4046-9a68-675f2ee8e42d {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 10:44:05 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-2e20a1e0-8c5b-48b6-9b30-f64db9276c01 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json" returned: 0 in 0.167s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:44:05 user nova-compute[71509]: DEBUG nova.virt.disk.api [None req-2e20a1e0-8c5b-48b6-9b30-f64db9276c01 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Checking if we can resize image /opt/stack/data/nova/instances/55178126-9766-4875-9122-39dcc87ce82c/disk. size=1073741824 {{(pid=71509) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 10:44:05 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-2e20a1e0-8c5b-48b6-9b30-f64db9276c01 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55178126-9766-4875-9122-39dcc87ce82c/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:05 user nova-compute[71509]: DEBUG nova.network.neutron [req-6e4b5846-3e25-47d8-a6f3-8d2ea4a0596b req-0712ec75-f771-4138-9854-9ab2861e96b5 service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Instance cache missing network info. {{(pid=71509) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 10:44:06 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-2e20a1e0-8c5b-48b6-9b30-f64db9276c01 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55178126-9766-4875-9122-39dcc87ce82c/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:44:06 user nova-compute[71509]: DEBUG nova.virt.disk.api [None req-2e20a1e0-8c5b-48b6-9b30-f64db9276c01 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Cannot resize image /opt/stack/data/nova/instances/55178126-9766-4875-9122-39dcc87ce82c/disk to a smaller size. {{(pid=71509) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 10:44:06 user nova-compute[71509]: DEBUG nova.objects.instance [None req-2e20a1e0-8c5b-48b6-9b30-f64db9276c01 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lazy-loading 'migration_context' on Instance uuid 55178126-9766-4875-9122-39dcc87ce82c {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:44:06 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-2e20a1e0-8c5b-48b6-9b30-f64db9276c01 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] [instance: 55178126-9766-4875-9122-39dcc87ce82c] Created local disks {{(pid=71509) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 10:44:06 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-2e20a1e0-8c5b-48b6-9b30-f64db9276c01 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] [instance: 55178126-9766-4875-9122-39dcc87ce82c] Ensure instance console log exists: /opt/stack/data/nova/instances/55178126-9766-4875-9122-39dcc87ce82c/console.log {{(pid=71509) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 10:44:06 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-2e20a1e0-8c5b-48b6-9b30-f64db9276c01 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:44:06 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-2e20a1e0-8c5b-48b6-9b30-f64db9276c01 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:44:06 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-2e20a1e0-8c5b-48b6-9b30-f64db9276c01 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:44:06 user nova-compute[71509]: DEBUG nova.network.neutron [req-451921fe-2cfe-4665-a3ed-b5de497f190b req-c96ca034-8f65-4d21-95bc-3c55c1bee5dc service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Updating instance_info_cache with network_info: [] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:44:06 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-451921fe-2cfe-4665-a3ed-b5de497f190b req-c96ca034-8f65-4d21-95bc-3c55c1bee5dc service nova] Releasing lock "refresh_cache-a81da242-e8d8-4b41-b84a-e12d603823ca" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:44:06 user nova-compute[71509]: DEBUG nova.network.neutron [req-6e4b5846-3e25-47d8-a6f3-8d2ea4a0596b req-0712ec75-f771-4138-9854-9ab2861e96b5 service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Updating instance_info_cache with network_info: [] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:44:06 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:06 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-6e4b5846-3e25-47d8-a6f3-8d2ea4a0596b req-0712ec75-f771-4138-9854-9ab2861e96b5 service nova] Releasing lock "refresh_cache-d1516acc-354e-41f6-a639-61dea870b11e" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:44:06 user nova-compute[71509]: DEBUG nova.network.neutron [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Successfully updated port: 7f7db929-b2fd-4242-9d23-5d58a374f961 {{(pid=71509) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 10:44:06 user nova-compute[71509]: DEBUG nova.network.neutron [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Successfully updated port: 84e561e8-01c6-4d50-ab37-bc64b5509e31 {{(pid=71509) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 10:44:06 user nova-compute[71509]: DEBUG nova.network.neutron [None req-2e20a1e0-8c5b-48b6-9b30-f64db9276c01 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] [instance: 55178126-9766-4875-9122-39dcc87ce82c] Successfully created port: 578e84c9-8c30-41bb-b61d-8fdeaa0c3a3f {{(pid=71509) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 10:44:07 user nova-compute[71509]: DEBUG nova.network.neutron [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Successfully updated port: 4d65e4a1-4cea-4636-8ad8-21065de3c747 {{(pid=71509) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 10:44:07 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:07 user nova-compute[71509]: DEBUG nova.compute.manager [req-38f44efc-a270-4ce4-9e58-bea2077ab445 req-03a91652-7da4-4d20-9be6-e2bb9815af93 service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Received event network-changed-7f7db929-b2fd-4242-9d23-5d58a374f961 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:44:07 user nova-compute[71509]: DEBUG nova.compute.manager [req-38f44efc-a270-4ce4-9e58-bea2077ab445 req-03a91652-7da4-4d20-9be6-e2bb9815af93 service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Refreshing instance network info cache due to event network-changed-7f7db929-b2fd-4242-9d23-5d58a374f961. {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 10:44:07 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-38f44efc-a270-4ce4-9e58-bea2077ab445 req-03a91652-7da4-4d20-9be6-e2bb9815af93 service nova] Acquiring lock "refresh_cache-d1516acc-354e-41f6-a639-61dea870b11e" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:44:07 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-38f44efc-a270-4ce4-9e58-bea2077ab445 req-03a91652-7da4-4d20-9be6-e2bb9815af93 service nova] Acquired lock "refresh_cache-d1516acc-354e-41f6-a639-61dea870b11e" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:44:07 user nova-compute[71509]: DEBUG nova.network.neutron [req-38f44efc-a270-4ce4-9e58-bea2077ab445 req-03a91652-7da4-4d20-9be6-e2bb9815af93 service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Refreshing network info cache for port 7f7db929-b2fd-4242-9d23-5d58a374f961 {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 10:44:07 user nova-compute[71509]: DEBUG nova.network.neutron [req-38f44efc-a270-4ce4-9e58-bea2077ab445 req-03a91652-7da4-4d20-9be6-e2bb9815af93 service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Instance cache missing network info. {{(pid=71509) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 10:44:07 user nova-compute[71509]: DEBUG nova.compute.manager [req-5f22d346-d873-42a5-aa62-a737221d7c9c req-c847d33c-72a9-463d-9290-7b5d36c8c28f service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Received event network-changed-84e561e8-01c6-4d50-ab37-bc64b5509e31 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:44:07 user nova-compute[71509]: DEBUG nova.compute.manager [req-5f22d346-d873-42a5-aa62-a737221d7c9c req-c847d33c-72a9-463d-9290-7b5d36c8c28f service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Refreshing instance network info cache due to event network-changed-84e561e8-01c6-4d50-ab37-bc64b5509e31. {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 10:44:07 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-5f22d346-d873-42a5-aa62-a737221d7c9c req-c847d33c-72a9-463d-9290-7b5d36c8c28f service nova] Acquiring lock "refresh_cache-a81da242-e8d8-4b41-b84a-e12d603823ca" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:44:07 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-5f22d346-d873-42a5-aa62-a737221d7c9c req-c847d33c-72a9-463d-9290-7b5d36c8c28f service nova] Acquired lock "refresh_cache-a81da242-e8d8-4b41-b84a-e12d603823ca" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:44:07 user nova-compute[71509]: DEBUG nova.network.neutron [req-5f22d346-d873-42a5-aa62-a737221d7c9c req-c847d33c-72a9-463d-9290-7b5d36c8c28f service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Refreshing network info cache for port 84e561e8-01c6-4d50-ab37-bc64b5509e31 {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 10:44:07 user nova-compute[71509]: DEBUG nova.network.neutron [req-38f44efc-a270-4ce4-9e58-bea2077ab445 req-03a91652-7da4-4d20-9be6-e2bb9815af93 service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Updating instance_info_cache with network_info: [] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:44:07 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-38f44efc-a270-4ce4-9e58-bea2077ab445 req-03a91652-7da4-4d20-9be6-e2bb9815af93 service nova] Releasing lock "refresh_cache-d1516acc-354e-41f6-a639-61dea870b11e" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:44:07 user nova-compute[71509]: DEBUG nova.compute.manager [req-38f44efc-a270-4ce4-9e58-bea2077ab445 req-03a91652-7da4-4d20-9be6-e2bb9815af93 service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Received event network-changed-4d65e4a1-4cea-4636-8ad8-21065de3c747 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:44:07 user nova-compute[71509]: DEBUG nova.compute.manager [req-38f44efc-a270-4ce4-9e58-bea2077ab445 req-03a91652-7da4-4d20-9be6-e2bb9815af93 service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Refreshing instance network info cache due to event network-changed-4d65e4a1-4cea-4636-8ad8-21065de3c747. {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 10:44:07 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-38f44efc-a270-4ce4-9e58-bea2077ab445 req-03a91652-7da4-4d20-9be6-e2bb9815af93 service nova] Acquiring lock "refresh_cache-d1516acc-354e-41f6-a639-61dea870b11e" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:44:07 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-38f44efc-a270-4ce4-9e58-bea2077ab445 req-03a91652-7da4-4d20-9be6-e2bb9815af93 service nova] Acquired lock "refresh_cache-d1516acc-354e-41f6-a639-61dea870b11e" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:44:07 user nova-compute[71509]: DEBUG nova.network.neutron [req-38f44efc-a270-4ce4-9e58-bea2077ab445 req-03a91652-7da4-4d20-9be6-e2bb9815af93 service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Refreshing network info cache for port 4d65e4a1-4cea-4636-8ad8-21065de3c747 {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 10:44:07 user nova-compute[71509]: DEBUG nova.network.neutron [req-5f22d346-d873-42a5-aa62-a737221d7c9c req-c847d33c-72a9-463d-9290-7b5d36c8c28f service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Instance cache missing network info. {{(pid=71509) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 10:44:07 user nova-compute[71509]: DEBUG nova.network.neutron [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Successfully updated port: d70f6f4d-f2bc-4d5e-9e98-a0daa1b35a0f {{(pid=71509) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 10:44:07 user nova-compute[71509]: DEBUG nova.network.neutron [req-38f44efc-a270-4ce4-9e58-bea2077ab445 req-03a91652-7da4-4d20-9be6-e2bb9815af93 service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Instance cache missing network info. {{(pid=71509) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 10:44:08 user nova-compute[71509]: DEBUG nova.network.neutron [req-38f44efc-a270-4ce4-9e58-bea2077ab445 req-03a91652-7da4-4d20-9be6-e2bb9815af93 service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Updating instance_info_cache with network_info: [] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:44:08 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-38f44efc-a270-4ce4-9e58-bea2077ab445 req-03a91652-7da4-4d20-9be6-e2bb9815af93 service nova] Releasing lock "refresh_cache-d1516acc-354e-41f6-a639-61dea870b11e" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:44:08 user nova-compute[71509]: DEBUG nova.network.neutron [req-5f22d346-d873-42a5-aa62-a737221d7c9c req-c847d33c-72a9-463d-9290-7b5d36c8c28f service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Updating instance_info_cache with network_info: [] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:44:08 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-5f22d346-d873-42a5-aa62-a737221d7c9c req-c847d33c-72a9-463d-9290-7b5d36c8c28f service nova] Releasing lock "refresh_cache-a81da242-e8d8-4b41-b84a-e12d603823ca" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:44:08 user nova-compute[71509]: DEBUG nova.network.neutron [None req-2e20a1e0-8c5b-48b6-9b30-f64db9276c01 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] [instance: 55178126-9766-4875-9122-39dcc87ce82c] Successfully updated port: 578e84c9-8c30-41bb-b61d-8fdeaa0c3a3f {{(pid=71509) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 10:44:08 user nova-compute[71509]: DEBUG nova.network.neutron [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Successfully updated port: 717e6c20-676e-40f2-b4c1-47ca0f3e6f22 {{(pid=71509) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 10:44:08 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-2e20a1e0-8c5b-48b6-9b30-f64db9276c01 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Acquiring lock "refresh_cache-55178126-9766-4875-9122-39dcc87ce82c" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:44:08 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-2e20a1e0-8c5b-48b6-9b30-f64db9276c01 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Acquired lock "refresh_cache-55178126-9766-4875-9122-39dcc87ce82c" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:44:08 user nova-compute[71509]: DEBUG nova.network.neutron [None req-2e20a1e0-8c5b-48b6-9b30-f64db9276c01 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] [instance: 55178126-9766-4875-9122-39dcc87ce82c] Building network info cache for instance {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 10:44:08 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Acquiring lock "refresh_cache-a81da242-e8d8-4b41-b84a-e12d603823ca" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:44:08 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Acquired lock "refresh_cache-a81da242-e8d8-4b41-b84a-e12d603823ca" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:44:08 user nova-compute[71509]: DEBUG nova.network.neutron [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Building network info cache for instance {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 10:44:08 user nova-compute[71509]: DEBUG nova.network.neutron [None req-2e20a1e0-8c5b-48b6-9b30-f64db9276c01 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] [instance: 55178126-9766-4875-9122-39dcc87ce82c] Instance cache missing network info. {{(pid=71509) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 10:44:08 user nova-compute[71509]: DEBUG nova.network.neutron [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Instance cache missing network info. {{(pid=71509) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 10:44:08 user nova-compute[71509]: DEBUG nova.network.neutron [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Successfully updated port: 328d2b64-7bc6-425a-b3a4-8cda754ffd56 {{(pid=71509) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 10:44:09 user nova-compute[71509]: DEBUG nova.network.neutron [None req-2e20a1e0-8c5b-48b6-9b30-f64db9276c01 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] [instance: 55178126-9766-4875-9122-39dcc87ce82c] Updating instance_info_cache with network_info: [{"id": "578e84c9-8c30-41bb-b61d-8fdeaa0c3a3f", "address": "fa:16:3e:85:23:c1", "network": {"id": "cec30aec-4cbb-4cff-8aae-6ecdfe8dfdbd", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1777093386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1696bf804b2e4d7f86162513015c8e52", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap578e84c9-8c", "ovs_interfaceid": "578e84c9-8c30-41bb-b61d-8fdeaa0c3a3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:44:09 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-2e20a1e0-8c5b-48b6-9b30-f64db9276c01 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Releasing lock "refresh_cache-55178126-9766-4875-9122-39dcc87ce82c" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:44:09 user nova-compute[71509]: DEBUG nova.compute.manager [None req-2e20a1e0-8c5b-48b6-9b30-f64db9276c01 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] [instance: 55178126-9766-4875-9122-39dcc87ce82c] Instance network_info: |[{"id": "578e84c9-8c30-41bb-b61d-8fdeaa0c3a3f", "address": "fa:16:3e:85:23:c1", "network": {"id": "cec30aec-4cbb-4cff-8aae-6ecdfe8dfdbd", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1777093386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1696bf804b2e4d7f86162513015c8e52", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap578e84c9-8c", "ovs_interfaceid": "578e84c9-8c30-41bb-b61d-8fdeaa0c3a3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71509) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 10:44:09 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-2e20a1e0-8c5b-48b6-9b30-f64db9276c01 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] [instance: 55178126-9766-4875-9122-39dcc87ce82c] Start _get_guest_xml network_info=[{"id": "578e84c9-8c30-41bb-b61d-8fdeaa0c3a3f", "address": "fa:16:3e:85:23:c1", "network": {"id": "cec30aec-4cbb-4cff-8aae-6ecdfe8dfdbd", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1777093386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1696bf804b2e4d7f86162513015c8e52", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap578e84c9-8c", "ovs_interfaceid": "578e84c9-8c30-41bb-b61d-8fdeaa0c3a3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T10:38:55Z,direct_url=<?>,disk_format='qcow2',id=048ec0ee-0465-448d-8b4c-f072acb101dc,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='9742d6ad20cf48d9bab0fdbcc9491db9',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T10:38:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '048ec0ee-0465-448d-8b4c-f072acb101dc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71509) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 10:44:09 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-2e20a1e0-8c5b-48b6-9b30-f64db9276c01 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:44:09 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-2e20a1e0-8c5b-48b6-9b30-f64db9276c01 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:44:09 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-2e20a1e0-8c5b-48b6-9b30-f64db9276c01 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71509) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 10:44:09 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-2e20a1e0-8c5b-48b6-9b30-f64db9276c01 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T10:40:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T10:38:55Z,direct_url=<?>,disk_format='qcow2',id=048ec0ee-0465-448d-8b4c-f072acb101dc,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='9742d6ad20cf48d9bab0fdbcc9491db9',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T10:38:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 10:44:09 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-2e20a1e0-8c5b-48b6-9b30-f64db9276c01 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Flavor limits 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 10:44:09 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-2e20a1e0-8c5b-48b6-9b30-f64db9276c01 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Image limits 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 10:44:09 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-2e20a1e0-8c5b-48b6-9b30-f64db9276c01 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Flavor pref 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 10:44:09 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-2e20a1e0-8c5b-48b6-9b30-f64db9276c01 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Image pref 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 10:44:09 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-2e20a1e0-8c5b-48b6-9b30-f64db9276c01 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 10:44:09 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-2e20a1e0-8c5b-48b6-9b30-f64db9276c01 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 10:44:09 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-2e20a1e0-8c5b-48b6-9b30-f64db9276c01 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71509) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 10:44:09 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-2e20a1e0-8c5b-48b6-9b30-f64db9276c01 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Got 1 possible topologies {{(pid=71509) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 10:44:09 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-2e20a1e0-8c5b-48b6-9b30-f64db9276c01 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 10:44:09 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-2e20a1e0-8c5b-48b6-9b30-f64db9276c01 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 10:44:09 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-2e20a1e0-8c5b-48b6-9b30-f64db9276c01 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T10:44:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-36028895',display_name='tempest-SnapshotDataIntegrityTests-server-36028895',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-36028895',id=13,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPSZXoy0ZdK7cT5ThMrTCya3wT94LWqxCTxtoLlDfoPgpqTWYvxs++wU1EdRWtZGKR5gH7hqEFS1U5I74nJs0Y4cHLUyVecAGHi5EkH+m7SY22DQORJXW8M8RwAfpcYDAg==',key_name='tempest-SnapshotDataIntegrityTests-1664538954',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1696bf804b2e4d7f86162513015c8e52',ramdisk_id='',reservation_id='r-ht86tqdk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1747462102',owner_user_name='tempest-SnapshotDataIntegrityTests-1747462102-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T10:44:05Z,user_data=None,user_id='09ed4663d8984fe7b5d95616281bfbfc',uuid=55178126-9766-4875-9122-39dcc87ce82c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "578e84c9-8c30-41bb-b61d-8fdeaa0c3a3f", "address": "fa:16:3e:85:23:c1", "network": {"id": "cec30aec-4cbb-4cff-8aae-6ecdfe8dfdbd", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1777093386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1696bf804b2e4d7f86162513015c8e52", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap578e84c9-8c", "ovs_interfaceid": "578e84c9-8c30-41bb-b61d-8fdeaa0c3a3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71509) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 10:44:09 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-2e20a1e0-8c5b-48b6-9b30-f64db9276c01 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Converting VIF {"id": "578e84c9-8c30-41bb-b61d-8fdeaa0c3a3f", "address": "fa:16:3e:85:23:c1", "network": {"id": "cec30aec-4cbb-4cff-8aae-6ecdfe8dfdbd", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1777093386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1696bf804b2e4d7f86162513015c8e52", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap578e84c9-8c", "ovs_interfaceid": "578e84c9-8c30-41bb-b61d-8fdeaa0c3a3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:44:09 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-2e20a1e0-8c5b-48b6-9b30-f64db9276c01 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:23:c1,bridge_name='br-int',has_traffic_filtering=True,id=578e84c9-8c30-41bb-b61d-8fdeaa0c3a3f,network=Network(cec30aec-4cbb-4cff-8aae-6ecdfe8dfdbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap578e84c9-8c') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:44:09 user nova-compute[71509]: DEBUG nova.objects.instance [None req-2e20a1e0-8c5b-48b6-9b30-f64db9276c01 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lazy-loading 'pci_devices' on Instance uuid 55178126-9766-4875-9122-39dcc87ce82c {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:44:09 user nova-compute[71509]: DEBUG nova.compute.manager [req-545364cc-4eb5-4b95-905d-d8a6472666e4 req-182a3347-678c-467a-b500-23d39fc92e02 service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Received event network-changed-d70f6f4d-f2bc-4d5e-9e98-a0daa1b35a0f {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:44:09 user nova-compute[71509]: DEBUG nova.compute.manager [req-545364cc-4eb5-4b95-905d-d8a6472666e4 req-182a3347-678c-467a-b500-23d39fc92e02 service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Refreshing instance network info cache due to event network-changed-d70f6f4d-f2bc-4d5e-9e98-a0daa1b35a0f. {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 10:44:09 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-545364cc-4eb5-4b95-905d-d8a6472666e4 req-182a3347-678c-467a-b500-23d39fc92e02 service nova] Acquiring lock "refresh_cache-d1516acc-354e-41f6-a639-61dea870b11e" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:44:09 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-545364cc-4eb5-4b95-905d-d8a6472666e4 req-182a3347-678c-467a-b500-23d39fc92e02 service nova] Acquired lock "refresh_cache-d1516acc-354e-41f6-a639-61dea870b11e" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:44:09 user nova-compute[71509]: DEBUG nova.network.neutron [req-545364cc-4eb5-4b95-905d-d8a6472666e4 req-182a3347-678c-467a-b500-23d39fc92e02 service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Refreshing network info cache for port d70f6f4d-f2bc-4d5e-9e98-a0daa1b35a0f {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 10:44:09 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-2e20a1e0-8c5b-48b6-9b30-f64db9276c01 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] [instance: 55178126-9766-4875-9122-39dcc87ce82c] End _get_guest_xml xml=<domain type="kvm">
Apr 14 10:44:09 user nova-compute[71509]:   <uuid>55178126-9766-4875-9122-39dcc87ce82c</uuid>
Apr 14 10:44:09 user nova-compute[71509]:   <name>instance-0000000d</name>
Apr 14 10:44:09 user nova-compute[71509]:   <memory>131072</memory>
Apr 14 10:44:09 user nova-compute[71509]:   <vcpu>1</vcpu>
Apr 14 10:44:09 user nova-compute[71509]:   <metadata>
Apr 14 10:44:09 user nova-compute[71509]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 10:44:09 user nova-compute[71509]:       <nova:package version="0.0.0"/>
Apr 14 10:44:09 user nova-compute[71509]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-36028895</nova:name>
Apr 14 10:44:09 user nova-compute[71509]:       <nova:creationTime>2023-04-14 10:44:09</nova:creationTime>
Apr 14 10:44:09 user nova-compute[71509]:       <nova:flavor name="m1.nano">
Apr 14 10:44:09 user nova-compute[71509]:         <nova:memory>128</nova:memory>
Apr 14 10:44:09 user nova-compute[71509]:         <nova:disk>1</nova:disk>
Apr 14 10:44:09 user nova-compute[71509]:         <nova:swap>0</nova:swap>
Apr 14 10:44:09 user nova-compute[71509]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 10:44:09 user nova-compute[71509]:         <nova:vcpus>1</nova:vcpus>
Apr 14 10:44:09 user nova-compute[71509]:       </nova:flavor>
Apr 14 10:44:09 user nova-compute[71509]:       <nova:owner>
Apr 14 10:44:09 user nova-compute[71509]:         <nova:user uuid="09ed4663d8984fe7b5d95616281bfbfc">tempest-SnapshotDataIntegrityTests-1747462102-project-member</nova:user>
Apr 14 10:44:09 user nova-compute[71509]:         <nova:project uuid="1696bf804b2e4d7f86162513015c8e52">tempest-SnapshotDataIntegrityTests-1747462102</nova:project>
Apr 14 10:44:09 user nova-compute[71509]:       </nova:owner>
Apr 14 10:44:09 user nova-compute[71509]:       <nova:root type="image" uuid="048ec0ee-0465-448d-8b4c-f072acb101dc"/>
Apr 14 10:44:09 user nova-compute[71509]:       <nova:ports>
Apr 14 10:44:09 user nova-compute[71509]:         <nova:port uuid="578e84c9-8c30-41bb-b61d-8fdeaa0c3a3f">
Apr 14 10:44:09 user nova-compute[71509]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 14 10:44:09 user nova-compute[71509]:         </nova:port>
Apr 14 10:44:09 user nova-compute[71509]:       </nova:ports>
Apr 14 10:44:09 user nova-compute[71509]:     </nova:instance>
Apr 14 10:44:09 user nova-compute[71509]:   </metadata>
Apr 14 10:44:09 user nova-compute[71509]:   <sysinfo type="smbios">
Apr 14 10:44:09 user nova-compute[71509]:     <system>
Apr 14 10:44:09 user nova-compute[71509]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 10:44:09 user nova-compute[71509]:       <entry name="product">OpenStack Nova</entry>
Apr 14 10:44:09 user nova-compute[71509]:       <entry name="version">0.0.0</entry>
Apr 14 10:44:09 user nova-compute[71509]:       <entry name="serial">55178126-9766-4875-9122-39dcc87ce82c</entry>
Apr 14 10:44:09 user nova-compute[71509]:       <entry name="uuid">55178126-9766-4875-9122-39dcc87ce82c</entry>
Apr 14 10:44:09 user nova-compute[71509]:       <entry name="family">Virtual Machine</entry>
Apr 14 10:44:09 user nova-compute[71509]:     </system>
Apr 14 10:44:09 user nova-compute[71509]:   </sysinfo>
Apr 14 10:44:09 user nova-compute[71509]:   <os>
Apr 14 10:44:09 user nova-compute[71509]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 10:44:09 user nova-compute[71509]:     <boot dev="hd"/>
Apr 14 10:44:09 user nova-compute[71509]:     <smbios mode="sysinfo"/>
Apr 14 10:44:09 user nova-compute[71509]:   </os>
Apr 14 10:44:09 user nova-compute[71509]:   <features>
Apr 14 10:44:09 user nova-compute[71509]:     <acpi/>
Apr 14 10:44:09 user nova-compute[71509]:     <apic/>
Apr 14 10:44:09 user nova-compute[71509]:     <vmcoreinfo/>
Apr 14 10:44:09 user nova-compute[71509]:   </features>
Apr 14 10:44:09 user nova-compute[71509]:   <clock offset="utc">
Apr 14 10:44:09 user nova-compute[71509]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 10:44:09 user nova-compute[71509]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 10:44:09 user nova-compute[71509]:     <timer name="hpet" present="no"/>
Apr 14 10:44:09 user nova-compute[71509]:   </clock>
Apr 14 10:44:09 user nova-compute[71509]:   <cpu mode="custom" match="exact">
Apr 14 10:44:09 user nova-compute[71509]:     <model>Nehalem</model>
Apr 14 10:44:09 user nova-compute[71509]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 10:44:09 user nova-compute[71509]:   </cpu>
Apr 14 10:44:09 user nova-compute[71509]:   <devices>
Apr 14 10:44:09 user nova-compute[71509]:     <disk type="file" device="disk">
Apr 14 10:44:09 user nova-compute[71509]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 10:44:09 user nova-compute[71509]:       <source file="/opt/stack/data/nova/instances/55178126-9766-4875-9122-39dcc87ce82c/disk"/>
Apr 14 10:44:09 user nova-compute[71509]:       <target dev="vda" bus="virtio"/>
Apr 14 10:44:09 user nova-compute[71509]:     </disk>
Apr 14 10:44:09 user nova-compute[71509]:     <interface type="ethernet">
Apr 14 10:44:09 user nova-compute[71509]:       <mac address="fa:16:3e:85:23:c1"/>
Apr 14 10:44:09 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 10:44:09 user nova-compute[71509]:       <mtu size="1442"/>
Apr 14 10:44:09 user nova-compute[71509]:       <target dev="tap578e84c9-8c"/>
Apr 14 10:44:09 user nova-compute[71509]:     </interface>
Apr 14 10:44:09 user nova-compute[71509]:     <serial type="pty">
Apr 14 10:44:09 user nova-compute[71509]:       <log file="/opt/stack/data/nova/instances/55178126-9766-4875-9122-39dcc87ce82c/console.log" append="off"/>
Apr 14 10:44:09 user nova-compute[71509]:     </serial>
Apr 14 10:44:09 user nova-compute[71509]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 10:44:09 user nova-compute[71509]:     <video>
Apr 14 10:44:09 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 10:44:09 user nova-compute[71509]:     </video>
Apr 14 10:44:09 user nova-compute[71509]:     <rng model="virtio">
Apr 14 10:44:09 user nova-compute[71509]:       <backend model="random">/dev/urandom</backend>
Apr 14 10:44:09 user nova-compute[71509]:     </rng>
Apr 14 10:44:09 user nova-compute[71509]:     <controller type="usb" index="0" model="none"/>
Apr 14 10:44:09 user nova-compute[71509]:     <memballoon model="virtio">
Apr 14 10:44:09 user nova-compute[71509]:       <stats period="10"/>
Apr 14 10:44:09 user nova-compute[71509]:     </memballoon>
Apr 14 10:44:09 user nova-compute[71509]:   </devices>
Apr 14 10:44:09 user nova-compute[71509]: </domain>
Apr 14 10:44:09 user nova-compute[71509]:  {{(pid=71509) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 10:44:09 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-2e20a1e0-8c5b-48b6-9b30-f64db9276c01 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T10:44:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-36028895',display_name='tempest-SnapshotDataIntegrityTests-server-36028895',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-36028895',id=13,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPSZXoy0ZdK7cT5ThMrTCya3wT94LWqxCTxtoLlDfoPgpqTWYvxs++wU1EdRWtZGKR5gH7hqEFS1U5I74nJs0Y4cHLUyVecAGHi5EkH+m7SY22DQORJXW8M8RwAfpcYDAg==',key_name='tempest-SnapshotDataIntegrityTests-1664538954',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1696bf804b2e4d7f86162513015c8e52',ramdisk_id='',reservation_id='r-ht86tqdk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1747462102',owner_user_name='tempest-SnapshotDataIntegrityTests-1747462102-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T10:44:05Z,user_data=None,user_id='09ed4663d8984fe7b5d95616281bfbfc',uuid=55178126-9766-4875-9122-39dcc87ce82c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "578e84c9-8c30-41bb-b61d-8fdeaa0c3a3f", "address": "fa:16:3e:85:23:c1", "network": {"id": "cec30aec-4cbb-4cff-8aae-6ecdfe8dfdbd", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1777093386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1696bf804b2e4d7f86162513015c8e52", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap578e84c9-8c", "ovs_interfaceid": "578e84c9-8c30-41bb-b61d-8fdeaa0c3a3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 10:44:09 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-2e20a1e0-8c5b-48b6-9b30-f64db9276c01 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Converting VIF {"id": "578e84c9-8c30-41bb-b61d-8fdeaa0c3a3f", "address": "fa:16:3e:85:23:c1", "network": {"id": "cec30aec-4cbb-4cff-8aae-6ecdfe8dfdbd", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1777093386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1696bf804b2e4d7f86162513015c8e52", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap578e84c9-8c", "ovs_interfaceid": "578e84c9-8c30-41bb-b61d-8fdeaa0c3a3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:44:09 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-2e20a1e0-8c5b-48b6-9b30-f64db9276c01 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:23:c1,bridge_name='br-int',has_traffic_filtering=True,id=578e84c9-8c30-41bb-b61d-8fdeaa0c3a3f,network=Network(cec30aec-4cbb-4cff-8aae-6ecdfe8dfdbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap578e84c9-8c') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:44:09 user nova-compute[71509]: DEBUG os_vif [None req-2e20a1e0-8c5b-48b6-9b30-f64db9276c01 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:23:c1,bridge_name='br-int',has_traffic_filtering=True,id=578e84c9-8c30-41bb-b61d-8fdeaa0c3a3f,network=Network(cec30aec-4cbb-4cff-8aae-6ecdfe8dfdbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap578e84c9-8c') {{(pid=71509) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 10:44:09 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:09 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:44:09 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 10:44:09 user nova-compute[71509]: INFO nova.virt.block_device [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Booting with volume 0d1e04e5-b8c3-4127-b22f-5535d2d28e7e at /dev/vdc
Apr 14 10:44:09 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:09 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap578e84c9-8c, may_exist=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:44:09 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap578e84c9-8c, col_values=(('external_ids', {'iface-id': '578e84c9-8c30-41bb-b61d-8fdeaa0c3a3f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:85:23:c1', 'vm-uuid': '55178126-9766-4875-9122-39dcc87ce82c'}),)) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:44:09 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:09 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 10:44:09 user nova-compute[71509]: INFO os_vif [None req-2e20a1e0-8c5b-48b6-9b30-f64db9276c01 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:23:c1,bridge_name='br-int',has_traffic_filtering=True,id=578e84c9-8c30-41bb-b61d-8fdeaa0c3a3f,network=Network(cec30aec-4cbb-4cff-8aae-6ecdfe8dfdbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap578e84c9-8c')
Apr 14 10:44:09 user nova-compute[71509]: DEBUG nova.network.neutron [req-545364cc-4eb5-4b95-905d-d8a6472666e4 req-182a3347-678c-467a-b500-23d39fc92e02 service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Instance cache missing network info. {{(pid=71509) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 10:44:09 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-2e20a1e0-8c5b-48b6-9b30-f64db9276c01 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] No BDM found with device name vda, not building metadata. {{(pid=71509) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 10:44:09 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-2e20a1e0-8c5b-48b6-9b30-f64db9276c01 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] No VIF found with MAC fa:16:3e:85:23:c1, not building metadata {{(pid=71509) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 10:44:09 user nova-compute[71509]: DEBUG os_brick.utils [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 10:44:09 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:09 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:44:09 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[45a58044-dc87-4cd2-8eb7-fcf175dbbc32]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50119df3c417\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:44:09 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:09 user nova-compute[71509]: DEBUG nova.network.neutron [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Successfully updated port: 6e295a29-0297-49c0-9298-7d3a41a07585 {{(pid=71509) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 10:44:09 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:44:09 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[a50e62d8-9621-44c6-ad30-ff8c78ff2720]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:44:09 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Acquiring lock "refresh_cache-d1516acc-354e-41f6-a639-61dea870b11e" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:44:09 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:09 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:44:09 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[954a21e6-0c76-4137-9878-16ea965b07a6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:44:09 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[c43c783f-a693-4312-bb19-1c8e46c34211]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:44:09 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Running cmd (subprocess): nvme version {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:09 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] 'nvme version' failed. Not Retrying. {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 10:44:09 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] nvme not present on system {{(pid=71509) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 10:44:09 user nova-compute[71509]: DEBUG nova.compute.manager [req-861e0b26-4734-48f3-a2ad-048082668976 req-01f37eb1-a789-4d98-adf5-f292a27bf1a5 service nova] [instance: 55178126-9766-4875-9122-39dcc87ce82c] Received event network-changed-578e84c9-8c30-41bb-b61d-8fdeaa0c3a3f {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:44:09 user nova-compute[71509]: DEBUG nova.compute.manager [req-861e0b26-4734-48f3-a2ad-048082668976 req-01f37eb1-a789-4d98-adf5-f292a27bf1a5 service nova] [instance: 55178126-9766-4875-9122-39dcc87ce82c] Refreshing instance network info cache due to event network-changed-578e84c9-8c30-41bb-b61d-8fdeaa0c3a3f. {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 10:44:09 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-861e0b26-4734-48f3-a2ad-048082668976 req-01f37eb1-a789-4d98-adf5-f292a27bf1a5 service nova] Acquiring lock "refresh_cache-55178126-9766-4875-9122-39dcc87ce82c" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:44:09 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-861e0b26-4734-48f3-a2ad-048082668976 req-01f37eb1-a789-4d98-adf5-f292a27bf1a5 service nova] Acquired lock "refresh_cache-55178126-9766-4875-9122-39dcc87ce82c" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:44:09 user nova-compute[71509]: DEBUG nova.network.neutron [req-861e0b26-4734-48f3-a2ad-048082668976 req-01f37eb1-a789-4d98-adf5-f292a27bf1a5 service nova] [instance: 55178126-9766-4875-9122-39dcc87ce82c] Refreshing network info cache for port 578e84c9-8c30-41bb-b61d-8fdeaa0c3a3f {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 10:44:09 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:09 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 10:44:09 user nova-compute[71509]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 10:44:09 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a2be7ec-57b2-4173-8ee0-1f1d37de54d0]: (4, '') {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:44:09 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71509) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 10:44:09 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71509) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 10:44:09 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] LIGHTOS: no hostnqn found. {{(pid=71509) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 10:44:09 user nova-compute[71509]: DEBUG os_brick.utils [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] <== get_connector_properties: return (152ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50119df3c417', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 10:44:09 user nova-compute[71509]: DEBUG nova.virt.block_device [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Updating existing volume attachment record: 8048e24d-80f5-4ef8-9788-8d98c221f3d9 {{(pid=71509) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 10:44:10 user nova-compute[71509]: DEBUG nova.network.neutron [req-545364cc-4eb5-4b95-905d-d8a6472666e4 req-182a3347-678c-467a-b500-23d39fc92e02 service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Updating instance_info_cache with network_info: [] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:44:10 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-545364cc-4eb5-4b95-905d-d8a6472666e4 req-182a3347-678c-467a-b500-23d39fc92e02 service nova] Releasing lock "refresh_cache-d1516acc-354e-41f6-a639-61dea870b11e" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:44:10 user nova-compute[71509]: DEBUG nova.compute.manager [req-545364cc-4eb5-4b95-905d-d8a6472666e4 req-182a3347-678c-467a-b500-23d39fc92e02 service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Received event network-changed-328d2b64-7bc6-425a-b3a4-8cda754ffd56 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:44:10 user nova-compute[71509]: DEBUG nova.compute.manager [req-545364cc-4eb5-4b95-905d-d8a6472666e4 req-182a3347-678c-467a-b500-23d39fc92e02 service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Refreshing instance network info cache due to event network-changed-328d2b64-7bc6-425a-b3a4-8cda754ffd56. {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 10:44:10 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-545364cc-4eb5-4b95-905d-d8a6472666e4 req-182a3347-678c-467a-b500-23d39fc92e02 service nova] Acquiring lock "refresh_cache-d1516acc-354e-41f6-a639-61dea870b11e" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:44:10 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-545364cc-4eb5-4b95-905d-d8a6472666e4 req-182a3347-678c-467a-b500-23d39fc92e02 service nova] Acquired lock "refresh_cache-d1516acc-354e-41f6-a639-61dea870b11e" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:44:10 user nova-compute[71509]: DEBUG nova.network.neutron [req-545364cc-4eb5-4b95-905d-d8a6472666e4 req-182a3347-678c-467a-b500-23d39fc92e02 service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Refreshing network info cache for port 328d2b64-7bc6-425a-b3a4-8cda754ffd56 {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 10:44:10 user nova-compute[71509]: DEBUG nova.network.neutron [req-545364cc-4eb5-4b95-905d-d8a6472666e4 req-182a3347-678c-467a-b500-23d39fc92e02 service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Instance cache missing network info. {{(pid=71509) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 10:44:10 user nova-compute[71509]: DEBUG nova.network.neutron [req-861e0b26-4734-48f3-a2ad-048082668976 req-01f37eb1-a789-4d98-adf5-f292a27bf1a5 service nova] [instance: 55178126-9766-4875-9122-39dcc87ce82c] Updated VIF entry in instance network info cache for port 578e84c9-8c30-41bb-b61d-8fdeaa0c3a3f. {{(pid=71509) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 10:44:10 user nova-compute[71509]: DEBUG nova.network.neutron [req-861e0b26-4734-48f3-a2ad-048082668976 req-01f37eb1-a789-4d98-adf5-f292a27bf1a5 service nova] [instance: 55178126-9766-4875-9122-39dcc87ce82c] Updating instance_info_cache with network_info: [{"id": "578e84c9-8c30-41bb-b61d-8fdeaa0c3a3f", "address": "fa:16:3e:85:23:c1", "network": {"id": "cec30aec-4cbb-4cff-8aae-6ecdfe8dfdbd", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1777093386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1696bf804b2e4d7f86162513015c8e52", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap578e84c9-8c", "ovs_interfaceid": "578e84c9-8c30-41bb-b61d-8fdeaa0c3a3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:44:10 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-861e0b26-4734-48f3-a2ad-048082668976 req-01f37eb1-a789-4d98-adf5-f292a27bf1a5 service nova] Releasing lock "refresh_cache-55178126-9766-4875-9122-39dcc87ce82c" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:44:10 user nova-compute[71509]: DEBUG nova.compute.manager [req-861e0b26-4734-48f3-a2ad-048082668976 req-01f37eb1-a789-4d98-adf5-f292a27bf1a5 service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Received event network-changed-717e6c20-676e-40f2-b4c1-47ca0f3e6f22 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:44:10 user nova-compute[71509]: DEBUG nova.compute.manager [req-861e0b26-4734-48f3-a2ad-048082668976 req-01f37eb1-a789-4d98-adf5-f292a27bf1a5 service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Refreshing instance network info cache due to event network-changed-717e6c20-676e-40f2-b4c1-47ca0f3e6f22. {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 10:44:10 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-861e0b26-4734-48f3-a2ad-048082668976 req-01f37eb1-a789-4d98-adf5-f292a27bf1a5 service nova] Acquiring lock "refresh_cache-a81da242-e8d8-4b41-b84a-e12d603823ca" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:44:10 user nova-compute[71509]: DEBUG nova.network.neutron [req-545364cc-4eb5-4b95-905d-d8a6472666e4 req-182a3347-678c-467a-b500-23d39fc92e02 service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Updating instance_info_cache with network_info: [] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:44:10 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-545364cc-4eb5-4b95-905d-d8a6472666e4 req-182a3347-678c-467a-b500-23d39fc92e02 service nova] Releasing lock "refresh_cache-d1516acc-354e-41f6-a639-61dea870b11e" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:44:10 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Acquired lock "refresh_cache-d1516acc-354e-41f6-a639-61dea870b11e" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:44:10 user nova-compute[71509]: DEBUG nova.network.neutron [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Building network info cache for instance {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 10:44:10 user nova-compute[71509]: DEBUG nova.network.neutron [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Instance cache missing network info. {{(pid=71509) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 10:44:11 user nova-compute[71509]: DEBUG nova.compute.manager [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Start spawning the instance on the hypervisor. {{(pid=71509) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 10:44:11 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Creating instance directory {{(pid=71509) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 10:44:11 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Creating image(s)
Apr 14 10:44:11 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Did not create local disks {{(pid=71509) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 10:44:11 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Ensure instance console log exists: /opt/stack/data/nova/instances/a81da242-e8d8-4b41-b84a-e12d603823ca/console.log {{(pid=71509) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 10:44:11 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:44:11 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:44:11 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:44:11 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:11 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:11 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:11 user nova-compute[71509]: DEBUG nova.compute.manager [req-4e232eae-1d94-4107-bcc4-502b4e6e7105 req-f26e75ef-f41f-43b1-808b-7d36409e24aa service nova] [instance: 55178126-9766-4875-9122-39dcc87ce82c] Received event network-vif-plugged-578e84c9-8c30-41bb-b61d-8fdeaa0c3a3f {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:44:11 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-4e232eae-1d94-4107-bcc4-502b4e6e7105 req-f26e75ef-f41f-43b1-808b-7d36409e24aa service nova] Acquiring lock "55178126-9766-4875-9122-39dcc87ce82c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:44:11 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-4e232eae-1d94-4107-bcc4-502b4e6e7105 req-f26e75ef-f41f-43b1-808b-7d36409e24aa service nova] Lock "55178126-9766-4875-9122-39dcc87ce82c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:44:11 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-4e232eae-1d94-4107-bcc4-502b4e6e7105 req-f26e75ef-f41f-43b1-808b-7d36409e24aa service nova] Lock "55178126-9766-4875-9122-39dcc87ce82c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:44:11 user nova-compute[71509]: DEBUG nova.compute.manager [req-4e232eae-1d94-4107-bcc4-502b4e6e7105 req-f26e75ef-f41f-43b1-808b-7d36409e24aa service nova] [instance: 55178126-9766-4875-9122-39dcc87ce82c] No waiting events found dispatching network-vif-plugged-578e84c9-8c30-41bb-b61d-8fdeaa0c3a3f {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:44:11 user nova-compute[71509]: WARNING nova.compute.manager [req-4e232eae-1d94-4107-bcc4-502b4e6e7105 req-f26e75ef-f41f-43b1-808b-7d36409e24aa service nova] [instance: 55178126-9766-4875-9122-39dcc87ce82c] Received unexpected event network-vif-plugged-578e84c9-8c30-41bb-b61d-8fdeaa0c3a3f for instance with vm_state building and task_state spawning.
Apr 14 10:44:11 user nova-compute[71509]: DEBUG nova.compute.manager [req-14a0426d-5eee-47fe-8105-1e04031d30dc req-aa4e21af-b69a-402a-b983-4c2ea16871f7 service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Received event network-changed-6e295a29-0297-49c0-9298-7d3a41a07585 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:44:11 user nova-compute[71509]: DEBUG nova.compute.manager [req-14a0426d-5eee-47fe-8105-1e04031d30dc req-aa4e21af-b69a-402a-b983-4c2ea16871f7 service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Refreshing instance network info cache due to event network-changed-6e295a29-0297-49c0-9298-7d3a41a07585. {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 10:44:11 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-14a0426d-5eee-47fe-8105-1e04031d30dc req-aa4e21af-b69a-402a-b983-4c2ea16871f7 service nova] Acquiring lock "refresh_cache-d1516acc-354e-41f6-a639-61dea870b11e" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:44:12 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:12 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:12 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:13 user nova-compute[71509]: DEBUG nova.network.neutron [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Updating instance_info_cache with network_info: [{"id": "2b341364-55e1-439f-9a3b-2b2fb7ad33b7", "address": "fa:16:3e:3e:8d:2f", "network": {"id": "e6a6e8f5-448a-41d1-a833-6db7058c611c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-378111892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f701119cef78433280cbddf2adf685db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b341364-55", "ovs_interfaceid": "2b341364-55e1-439f-9a3b-2b2fb7ad33b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f3e8f62b-77e2-49d5-9fd9-b75f024a4ee7", "address": "fa:16:3e:87:fe:bc", "network": {"id": "a50bebb6-d4de-4875-9553-570535dace36", "bridge": "br-int", "label": "tempest-device-tagging-net1-1002288517", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.199", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f701119cef78433280cbddf2adf685db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3e8f62b-77", "ovs_interfaceid": "f3e8f62b-77e2-49d5-9fd9-b75f024a4ee7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d2d71e67-1807-43cf-8753-7bdd77de6317", "address": "fa:16:3e:4a:86:23", "network": {"id": "a50bebb6-d4de-4875-9553-570535dace36", "bridge": "br-int", "label": "tempest-device-tagging-net1-1002288517", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.110", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f701119cef78433280cbddf2adf685db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2d71e67-18", "ovs_interfaceid": "d2d71e67-1807-43cf-8753-7bdd77de6317", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c46b5082-6634-4c7f-89c1-7e58a3cd8987", "address": "fa:16:3e:5b:0c:b3", "network": {"id": "a50bebb6-d4de-4875-9553-570535dace36", "bridge": "br-int", "label": "tempest-device-tagging-net1-1002288517", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f701119cef78433280cbddf2adf685db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc46b5082-66", "ovs_interfaceid": "c46b5082-6634-4c7f-89c1-7e58a3cd8987", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8789c03e-397c-439a-8bc5-5d8ce5fc36ac", "address": "fa:16:3e:cf:67:ac", "network": {"id": "a50bebb6-d4de-4875-9553-570535dace36", "bridge": "br-int", "label": "tempest-device-tagging-net1-1002288517", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f701119cef78433280cbddf2adf685db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8789c03e-39", "ovs_interfaceid": "8789c03e-397c-439a-8bc5-5d8ce5fc36ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "84e561e8-01c6-4d50-ab37-bc64b5509e31", "address": "fa:16:3e:e1:97:d3", "network": {"id": "d6116fed-ce24-4ad4-9e8a-dfb2c1305e1c", "bridge": "br-int", "label": "tempest-device-tagging-net2-564175672", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f701119cef78433280cbddf2adf685db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84e561e8-01", "ovs_interfaceid": "84e561e8-01c6-4d50-ab37-bc64b5509e31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "717e6c20-676e-40f2-b4c1-47ca0f3e6f22", "address": "fa:16:3e:bf:a5:40", "network": {"id": "d6116fed-ce24-4ad4-9e8a-dfb2c1305e1c", "bridge": "br-int", "label": "tempest-device-tagging-net2-564175672", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f701119cef78433280cbddf2adf685db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap717e6c20-67", "ovs_interfaceid": "717e6c20-676e-40f2-b4c1-47ca0f3e6f22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:44:13 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Releasing lock "refresh_cache-a81da242-e8d8-4b41-b84a-e12d603823ca" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:44:13 user nova-compute[71509]: DEBUG nova.compute.manager [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Instance network_info: |[{"id": "2b341364-55e1-439f-9a3b-2b2fb7ad33b7", "address": "fa:16:3e:3e:8d:2f", "network": {"id": "e6a6e8f5-448a-41d1-a833-6db7058c611c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-378111892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f701119cef78433280cbddf2adf685db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b341364-55", "ovs_interfaceid": "2b341364-55e1-439f-9a3b-2b2fb7ad33b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f3e8f62b-77e2-49d5-9fd9-b75f024a4ee7", "address": "fa:16:3e:87:fe:bc", "network": {"id": "a50bebb6-d4de-4875-9553-570535dace36", "bridge": "br-int", "label": "tempest-device-tagging-net1-1002288517", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.199", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f701119cef78433280cbddf2adf685db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3e8f62b-77", "ovs_interfaceid": "f3e8f62b-77e2-49d5-9fd9-b75f024a4ee7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d2d71e67-1807-43cf-8753-7bdd77de6317", "address": "fa:16:3e:4a:86:23", "network": {"id": "a50bebb6-d4de-4875-9553-570535dace36", "bridge": "br-int", "label": "tempest-device-tagging-net1-1002288517", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.110", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f701119cef78433280cbddf2adf685db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2d71e67-18", "ovs_interfaceid": "d2d71e67-1807-43cf-8753-7bdd77de6317", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c46b5082-6634-4c7f-89c1-7e58a3cd8987", "address": "fa:16:3e:5b:0c:b3", "network": {"id": "a50bebb6-d4de-4875-9553-570535dace36", "bridge": "br-int", "label": "tempest-device-tagging-net1-1002288517", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f701119cef78433280cbddf2adf685db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc46b5082-66", "ovs_interfaceid": "c46b5082-6634-4c7f-89c1-7e58a3cd8987", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8789c03e-397c-439a-8bc5-5d8ce5fc36ac", "address": "fa:16:3e:cf:67:ac", "network": {"id": "a50bebb6-d4de-4875-9553-570535dace36", "bridge": "br-int", "label": "tempest-device-tagging-net1-1002288517", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f701119cef78433280cbddf2adf685db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8789c03e-39", "ovs_interfaceid": "8789c03e-397c-439a-8bc5-5d8ce5fc36ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "84e561e8-01c6-4d50-ab37-bc64b5509e31", "address": "fa:16:3e:e1:97:d3", "network": {"id": "d6116fed-ce24-4ad4-9e8a-dfb2c1305e1c", "bridge": "br-int", "label": "tempest-device-tagging-net2-564175672", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f701119cef78433280cbddf2adf685db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84e561e8-01", "ovs_interfaceid": "84e561e8-01c6-4d50-ab37-bc64b5509e31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "717e6c20-676e-40f2-b4c1-47ca0f3e6f22", "address": "fa:16:3e:bf:a5:40", "network": {"id": "d6116fed-ce24-4ad4-9e8a-dfb2c1305e1c", "bridge": "br-int", "label": "tempest-device-tagging-net2-564175672", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f701119cef78433280cbddf2adf685db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap717e6c20-67", "ovs_interfaceid": "717e6c20-676e-40f2-b4c1-47ca0f3e6f22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71509) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 10:44:13 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-861e0b26-4734-48f3-a2ad-048082668976 req-01f37eb1-a789-4d98-adf5-f292a27bf1a5 service nova] Acquired lock "refresh_cache-a81da242-e8d8-4b41-b84a-e12d603823ca" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:44:13 user nova-compute[71509]: DEBUG nova.network.neutron [req-861e0b26-4734-48f3-a2ad-048082668976 req-01f37eb1-a789-4d98-adf5-f292a27bf1a5 service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Refreshing network info cache for port 717e6c20-676e-40f2-b4c1-47ca0f3e6f22 {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 10:44:13 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Start _get_guest_xml network_info=[{"id": "2b341364-55e1-439f-9a3b-2b2fb7ad33b7", "address": "fa:16:3e:3e:8d:2f", "network": {"id": "e6a6e8f5-448a-41d1-a833-6db7058c611c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-378111892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f701119cef78433280cbddf2adf685db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b341364-55", "ovs_interfaceid": "2b341364-55e1-439f-9a3b-2b2fb7ad33b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f3e8f62b-77e2-49d5-9fd9-b75f024a4ee7", "address": "fa:16:3e:87:fe:bc", "network": {"id": "a50bebb6-d4de-4875-9553-570535dace36", "bridge": "br-int", "label": "tempest-device-tagging-net1-1002288517", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.199", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f701119cef78433280cbddf2adf685db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3e8f62b-77", "ovs_interfaceid": "f3e8f62b-77e2-49d5-9fd9-b75f024a4ee7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d2d71e67-1807-43cf-8753-7bdd77de6317", "address": "fa:16:3e:4a:86:23", "network": {"id": "a50bebb6-d4de-4875-9553-570535dace36", "bridge": "br-int", "label": "tempest-device-tagging-net1-1002288517", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.110", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f701119cef78433280cbddf2adf685db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2d71e67-18", "ovs_interfaceid": "d2d71e67-1807-43cf-8753-7bdd77de6317", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c46b5082-6634-4c7f-89c1-7e58a3cd8987", "address": "fa:16:3e:5b:0c:b3", "network": {"id": "a50bebb6-d4de-4875-9553-570535dace36", "bridge": "br-int", "label": "tempest-device-tagging-net1-1002288517", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f701119cef78433280cbddf2adf685db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc46b5082-66", "ovs_interfaceid": "c46b5082-6634-4c7f-89c1-7e58a3cd8987", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8789c03e-397c-439a-8bc5-5d8ce5fc36ac", "address": "fa:16:3e:cf:67:ac", "network": {"id": "a50bebb6-d4de-4875-9553-570535dace36", "bridge": "br-int", "label": "tempest-device-tagging-net1-1002288517", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f701119cef78433280cbddf2adf685db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8789c03e-39", "ovs_interfaceid": "8789c03e-397c-439a-8bc5-5d8ce5fc36ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "84e561e8-01c6-4d50-ab37-bc64b5509e31", "address": "fa:16:3e:e1:97:d3", "network": {"id": "d6116fed-ce24-4ad4-9e8a-dfb2c1305e1c", "bridge": "br-int", "label": "tempest-device-tagging-net2-564175672", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f701119cef78433280cbddf2adf685db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84e561e8-01", "ovs_interfaceid": "84e561e8-01c6-4d50-ab37-bc64b5509e31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "717e6c20-676e-40f2-b4c1-47ca0f3e6f22", "address": "fa:16:3e:bf:a5:40", "network": {"id": "d6116fed-ce24-4ad4-9e8a-dfb2c1305e1c", "bridge": "br-int", "label": "tempest-device-tagging-net2-564175672", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f701119cef78433280cbddf2adf685db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap717e6c20-67", "ovs_interfaceid": "717e6c20-676e-40f2-b4c1-47ca0f3e6f22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T10:38:55Z,direct_url=<?>,disk_format='qcow2',id=048ec0ee-0465-448d-8b4c-f072acb101dc,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='9742d6ad20cf48d9bab0fdbcc9491db9',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T10:38:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'attachment_id': '1befc557-42c9-4a7c-af08-6269aba9ba51', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HpOizdNI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a81da242-e8d8-4b41-b84a-e12d603823ca', 'attached_at': '', 'detached_at': '', 'volume_id': '2b354544-2f2e-40f1-bb9b-5f60c8497f18', 'serial': '2b354544-2f2e-40f1-bb9b-5f60c8497f18'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'volume_type': None}, {'guest_format': None, 'mount_device': '/dev/vdb', 'boot_index': 1, 'device_type': 'disk', 'attachment_id': '5c09abfe-5887-4eea-9c17-e375df21d462', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GIrHQbTF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a81da242-e8d8-4b41-b84a-e12d603823ca', 'attached_at': '', 'detached_at': '', 'volume_id': '18ba60c5-2a70-402c-a557-69dd9c886768', 'serial': '18ba60c5-2a70-402c-a557-69dd9c886768'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'volume_type': None}, {'guest_format': None, 'mount_device': '/dev/vdc', 'boot_index': 2, 'device_type': 'disk', 'attachment_id': '61b6ca56-f78e-4005-a60d-ba60a97e4e62', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fdbWvrhQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a81da242-e8d8-4b41-b84a-e12d603823ca', 'attached_at': '', 'detached_at': '', 'volume_id': '7653f786-98b3-4e3d-b593-3b9fec984d92', 'serial': '7653f786-98b3-4e3d-b593-3b9fec984d92'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'volume_type': None} {{(pid=71509) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 10:44:13 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:44:13 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:44:13 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71509) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 10:44:13 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T10:40:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T10:38:55Z,direct_url=<?>,disk_format='qcow2',id=048ec0ee-0465-448d-8b4c-f072acb101dc,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='9742d6ad20cf48d9bab0fdbcc9491db9',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T10:38:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 10:44:13 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Flavor limits 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 10:44:13 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Image limits 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 10:44:13 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Flavor pref 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 10:44:13 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Image pref 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 10:44:13 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 10:44:13 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 10:44:13 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71509) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 10:44:13 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Got 1 possible topologies {{(pid=71509) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 10:44:13 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 10:44:13 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 10:44:13 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Calling os-brick to attach iSCSI Volume {{(pid=71509) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 10:44:13 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0bf0749390>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HpOizdNI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 10:44:13 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 10:44:13 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 10:44:13 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 10:44:13 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 10:44:13 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 10:44:13 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 10:44:13 user nova-compute[71509]: INFO os_brick.initiator.connectors.iscsi [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 10:44:13 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18 -p 172.16.0.220:3260 {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:13 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:44:13 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdecdb80-3372-42bf-8a90-13565973d5db]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:44:13 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 10:44:13 user nova-compute[71509]:  {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:44:13 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18 -p 172.16.0.220:3260 --interface default --op new {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:13 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:44:13 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6cee6e2-f568-4076-8c02-f40c7e143267]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18] added\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:44:13 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18] added
Apr 14 10:44:13 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:44:13 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:13 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:44:13 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fecb5a5-5b0f-4aa2-ad7c-d4ad8ea17222]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:44:13 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:44:13 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:13 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:44:13 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ccc7913-ba16-4297-87e2-244e62bab7ff]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:44:13 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:44:13 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HpOizdNI {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:13 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HpOizdNI" returned: 0 in 0.020s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:44:13 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[e51831af-1def-49e9-b0be-abed86144f86]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:44:13 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HpOizdNI'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:44:13 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:13 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:44:13 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a0fdf82-bc7b-4963-ab0d-b982cfeca8b9]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:44:13 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:44:13 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:13 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:44:13 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f14a42e-2802-499a-b38f-2afe0ca17dee]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:44:13 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee (non-flash)
Apr 14 10:44:13 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:44:13 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee (non-flash)
Apr 14 10:44:13 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 10:44:13 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18 -p 172.16.0.220:3260 --login {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:13 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:44:13 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[be756a5a-bd0b-40c4-8047-c34b3a6359e9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:44:13 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18, portal: 172.16.0.220,3260]
Apr 14 10:44:13 user nova-compute[71509]: Login to [iface: default, target: iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18, portal: 172.16.0.220,3260] successful.
Apr 14 10:44:13 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:44:13 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:13 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:44:13 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[569751fb-b59a-4936-8400-049fbfb81e82]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:44:13 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:44:13 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:13 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:44:13 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d494a7b-4665-4e57-9677-4cb6d67c7dfb]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18 (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:44:13 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee (non-flash)
Apr 14 10:44:13 user nova-compute[71509]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18 (non-flash)
Apr 14 10:44:13 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:44:13 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee (non-flash)
Apr 14 10:44:13 user nova-compute[71509]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18 (non-flash)
Apr 14 10:44:13 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 10:44:13 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.332s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 10:44:13 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Connected to 172.16.0.220:3260 {{(pid=71509) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 10:44:13 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=71509) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 10:44:13 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71509) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 10:44:13 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:13 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.027s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:44:13 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[d16831ef-a2d8-4eb3-845a-dd424ebb7618]: (4, ('- - 0', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:44:13 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71509) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 10:44:13 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HpOizdNI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71509) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 10:44:13 user nova-compute[71509]: DEBUG nova.compute.manager [req-6af543d3-4862-4338-9f23-7205d8ea2715 req-00331fce-b0e9-435b-91d7-f797312a4c3c service nova] [instance: 55178126-9766-4875-9122-39dcc87ce82c] Received event network-vif-plugged-578e84c9-8c30-41bb-b61d-8fdeaa0c3a3f {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:44:13 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-6af543d3-4862-4338-9f23-7205d8ea2715 req-00331fce-b0e9-435b-91d7-f797312a4c3c service nova] Acquiring lock "55178126-9766-4875-9122-39dcc87ce82c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:44:13 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-6af543d3-4862-4338-9f23-7205d8ea2715 req-00331fce-b0e9-435b-91d7-f797312a4c3c service nova] Lock "55178126-9766-4875-9122-39dcc87ce82c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:44:13 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-6af543d3-4862-4338-9f23-7205d8ea2715 req-00331fce-b0e9-435b-91d7-f797312a4c3c service nova] Lock "55178126-9766-4875-9122-39dcc87ce82c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:44:13 user nova-compute[71509]: DEBUG nova.compute.manager [req-6af543d3-4862-4338-9f23-7205d8ea2715 req-00331fce-b0e9-435b-91d7-f797312a4c3c service nova] [instance: 55178126-9766-4875-9122-39dcc87ce82c] No waiting events found dispatching network-vif-plugged-578e84c9-8c30-41bb-b61d-8fdeaa0c3a3f {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:44:13 user nova-compute[71509]: WARNING nova.compute.manager [req-6af543d3-4862-4338-9f23-7205d8ea2715 req-00331fce-b0e9-435b-91d7-f797312a4c3c service nova] [instance: 55178126-9766-4875-9122-39dcc87ce82c] Received unexpected event network-vif-plugged-578e84c9-8c30-41bb-b61d-8fdeaa0c3a3f for instance with vm_state building and task_state spawning.
Apr 14 10:44:13 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681469053.9093783, 55178126-9766-4875-9122-39dcc87ce82c => Resumed> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 10:44:13 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 55178126-9766-4875-9122-39dcc87ce82c] VM Resumed (Lifecycle Event)
Apr 14 10:44:13 user nova-compute[71509]: DEBUG nova.compute.manager [None req-2e20a1e0-8c5b-48b6-9b30-f64db9276c01 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] [instance: 55178126-9766-4875-9122-39dcc87ce82c] Instance event wait completed in 0 seconds for  {{(pid=71509) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 10:44:13 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-2e20a1e0-8c5b-48b6-9b30-f64db9276c01 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] [instance: 55178126-9766-4875-9122-39dcc87ce82c] Guest created on hypervisor {{(pid=71509) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 10:44:13 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 55178126-9766-4875-9122-39dcc87ce82c] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:44:13 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: 55178126-9766-4875-9122-39dcc87ce82c] Instance spawned successfully.
Apr 14 10:44:13 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-2e20a1e0-8c5b-48b6-9b30-f64db9276c01 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] [instance: 55178126-9766-4875-9122-39dcc87ce82c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 10:44:13 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 55178126-9766-4875-9122-39dcc87ce82c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 10:44:13 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 55178126-9766-4875-9122-39dcc87ce82c] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 10:44:13 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681469053.9111981, 55178126-9766-4875-9122-39dcc87ce82c => Started> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 10:44:13 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 55178126-9766-4875-9122-39dcc87ce82c] VM Started (Lifecycle Event)
Apr 14 10:44:14 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-2e20a1e0-8c5b-48b6-9b30-f64db9276c01 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] [instance: 55178126-9766-4875-9122-39dcc87ce82c] Found default for hw_cdrom_bus of ide {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:44:14 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-2e20a1e0-8c5b-48b6-9b30-f64db9276c01 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] [instance: 55178126-9766-4875-9122-39dcc87ce82c] Found default for hw_disk_bus of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:44:14 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-2e20a1e0-8c5b-48b6-9b30-f64db9276c01 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] [instance: 55178126-9766-4875-9122-39dcc87ce82c] Found default for hw_input_bus of None {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:44:14 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-2e20a1e0-8c5b-48b6-9b30-f64db9276c01 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] [instance: 55178126-9766-4875-9122-39dcc87ce82c] Found default for hw_pointer_model of None {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:44:14 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-2e20a1e0-8c5b-48b6-9b30-f64db9276c01 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] [instance: 55178126-9766-4875-9122-39dcc87ce82c] Found default for hw_video_model of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:44:14 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-2e20a1e0-8c5b-48b6-9b30-f64db9276c01 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] [instance: 55178126-9766-4875-9122-39dcc87ce82c] Found default for hw_vif_model of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:44:14 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 55178126-9766-4875-9122-39dcc87ce82c] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:44:14 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 55178126-9766-4875-9122-39dcc87ce82c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 10:44:14 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 55178126-9766-4875-9122-39dcc87ce82c] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 10:44:14 user nova-compute[71509]: INFO nova.compute.manager [None req-2e20a1e0-8c5b-48b6-9b30-f64db9276c01 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] [instance: 55178126-9766-4875-9122-39dcc87ce82c] Took 8.92 seconds to spawn the instance on the hypervisor.
Apr 14 10:44:14 user nova-compute[71509]: DEBUG nova.compute.manager [None req-2e20a1e0-8c5b-48b6-9b30-f64db9276c01 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] [instance: 55178126-9766-4875-9122-39dcc87ce82c] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:44:14 user nova-compute[71509]: INFO nova.compute.manager [None req-2e20a1e0-8c5b-48b6-9b30-f64db9276c01 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] [instance: 55178126-9766-4875-9122-39dcc87ce82c] Took 10.21 seconds to build instance.
Apr 14 10:44:14 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-2e20a1e0-8c5b-48b6-9b30-f64db9276c01 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "55178126-9766-4875-9122-39dcc87ce82c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.330s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:44:14 user nova-compute[71509]: DEBUG nova.network.neutron [req-861e0b26-4734-48f3-a2ad-048082668976 req-01f37eb1-a789-4d98-adf5-f292a27bf1a5 service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Updated VIF entry in instance network info cache for port 717e6c20-676e-40f2-b4c1-47ca0f3e6f22. {{(pid=71509) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 10:44:14 user nova-compute[71509]: DEBUG nova.network.neutron [req-861e0b26-4734-48f3-a2ad-048082668976 req-01f37eb1-a789-4d98-adf5-f292a27bf1a5 service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Updating instance_info_cache with network_info: [{"id": "2b341364-55e1-439f-9a3b-2b2fb7ad33b7", "address": "fa:16:3e:3e:8d:2f", "network": {"id": "e6a6e8f5-448a-41d1-a833-6db7058c611c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-378111892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f701119cef78433280cbddf2adf685db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b341364-55", "ovs_interfaceid": "2b341364-55e1-439f-9a3b-2b2fb7ad33b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f3e8f62b-77e2-49d5-9fd9-b75f024a4ee7", "address": "fa:16:3e:87:fe:bc", "network": {"id": "a50bebb6-d4de-4875-9553-570535dace36", "bridge": "br-int", "label": "tempest-device-tagging-net1-1002288517", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.199", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f701119cef78433280cbddf2adf685db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3e8f62b-77", "ovs_interfaceid": "f3e8f62b-77e2-49d5-9fd9-b75f024a4ee7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d2d71e67-1807-43cf-8753-7bdd77de6317", "address": "fa:16:3e:4a:86:23", "network": {"id": "a50bebb6-d4de-4875-9553-570535dace36", "bridge": "br-int", "label": "tempest-device-tagging-net1-1002288517", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.110", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f701119cef78433280cbddf2adf685db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2d71e67-18", "ovs_interfaceid": "d2d71e67-1807-43cf-8753-7bdd77de6317", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c46b5082-6634-4c7f-89c1-7e58a3cd8987", "address": "fa:16:3e:5b:0c:b3", "network": {"id": "a50bebb6-d4de-4875-9553-570535dace36", "bridge": "br-int", "label": "tempest-device-tagging-net1-1002288517", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f701119cef78433280cbddf2adf685db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc46b5082-66", "ovs_interfaceid": "c46b5082-6634-4c7f-89c1-7e58a3cd8987", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8789c03e-397c-439a-8bc5-5d8ce5fc36ac", "address": "fa:16:3e:cf:67:ac", "network": {"id": "a50bebb6-d4de-4875-9553-570535dace36", "bridge": "br-int", "label": "tempest-device-tagging-net1-1002288517", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f701119cef78433280cbddf2adf685db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8789c03e-39", "ovs_interfaceid": "8789c03e-397c-439a-8bc5-5d8ce5fc36ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "84e561e8-01c6-4d50-ab37-bc64b5509e31", "address": "fa:16:3e:e1:97:d3", "network": {"id": "d6116fed-ce24-4ad4-9e8a-dfb2c1305e1c", "bridge": "br-int", "label": "tempest-device-tagging-net2-564175672", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f701119cef78433280cbddf2adf685db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84e561e8-01", "ovs_interfaceid": "84e561e8-01c6-4d50-ab37-bc64b5509e31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "717e6c20-676e-40f2-b4c1-47ca0f3e6f22", "address": "fa:16:3e:bf:a5:40", "network": {"id": "d6116fed-ce24-4ad4-9e8a-dfb2c1305e1c", "bridge": "br-int", "label": "tempest-device-tagging-net2-564175672", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f701119cef78433280cbddf2adf685db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap717e6c20-67", "ovs_interfaceid": "717e6c20-676e-40f2-b4c1-47ca0f3e6f22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:44:14 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-861e0b26-4734-48f3-a2ad-048082668976 req-01f37eb1-a789-4d98-adf5-f292a27bf1a5 service nova] Releasing lock "refresh_cache-a81da242-e8d8-4b41-b84a-e12d603823ca" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:44:14 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:14 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.377s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 10:44:14 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] <== connect_volume: return (1378ms) {'type': 'block', 'scsi_wwn': '26162613966323866', 'path': '/dev/sdc'} {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 10:44:14 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26162613966323866', 'path': '/dev/sdc'} {{(pid=71509) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 10:44:14 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Calling os-brick to attach iSCSI Volume {{(pid=71509) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 10:44:14 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0bf0749390>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GIrHQbTF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 10:44:14 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 10:44:14 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 10:44:14 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 10:44:14 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 10:44:14 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 10:44:14 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 10:44:14 user nova-compute[71509]: INFO os_brick.initiator.connectors.iscsi [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 10:44:14 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768 -p 172.16.0.220:3260 {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:14 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:44:14 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[476df9a7-474b-4a4f-93ee-8d520a61637f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:44:14 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 10:44:14 user nova-compute[71509]:  {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:44:14 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768 -p 172.16.0.220:3260 --interface default --op new {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:14 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:44:14 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2d64e52-67b2-4118-8e9e-52ff058c5c7e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768] added\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:44:14 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768] added
Apr 14 10:44:14 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:44:14 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:14 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:44:14 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[d80160af-9533-4bc2-9510-e1bab3868377]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:44:14 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:44:15 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:15 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:44:15 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[0837984e-c0b3-4679-a269-b144e6fe030d]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:44:15 user nova-compute[71509]: DEBUG nova.network.neutron [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Updating instance_info_cache with network_info: [{"id": "2a2ef05a-2d58-4cdf-ab6c-35df823a68bc", "address": "fa:16:3e:ad:4e:cf", "network": {"id": "3c95a463-71cf-446f-8214-5f52f2da54b7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-325252986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e024f5a578e4543a02c6adc7d456f39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a2ef05a-2d", "ovs_interfaceid": "2a2ef05a-2d58-4cdf-ab6c-35df823a68bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "23214923-0217-4046-9a68-675f2ee8e42d", "address": "fa:16:3e:8a:5a:1a", "network": {"id": "bb8c5688-db8f-47c0-a2b5-0a44d2f97461", "bridge": "br-int", "label": "tempest-device-tagging-net1-527368946", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e024f5a578e4543a02c6adc7d456f39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23214923-02", "ovs_interfaceid": "23214923-0217-4046-9a68-675f2ee8e42d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7f7db929-b2fd-4242-9d23-5d58a374f961", "address": "fa:16:3e:28:88:b4", "network": {"id": "bb8c5688-db8f-47c0-a2b5-0a44d2f97461", "bridge": "br-int", "label": "tempest-device-tagging-net1-527368946", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e024f5a578e4543a02c6adc7d456f39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f7db929-b2", "ovs_interfaceid": "7f7db929-b2fd-4242-9d23-5d58a374f961", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4d65e4a1-4cea-4636-8ad8-21065de3c747", "address": "fa:16:3e:c2:1b:8c", "network": {"id": "bb8c5688-db8f-47c0-a2b5-0a44d2f97461", "bridge": "br-int", "label": "tempest-device-tagging-net1-527368946", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e024f5a578e4543a02c6adc7d456f39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d65e4a1-4c", "ovs_interfaceid": "4d65e4a1-4cea-4636-8ad8-21065de3c747", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d70f6f4d-f2bc-4d5e-9e98-a0daa1b35a0f", "address": "fa:16:3e:64:ce:c5", "network": {"id": "bb8c5688-db8f-47c0-a2b5-0a44d2f97461", "bridge": "br-int", "label": "tempest-device-tagging-net1-527368946", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e024f5a578e4543a02c6adc7d456f39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd70f6f4d-f2", "ovs_interfaceid": "d70f6f4d-f2bc-4d5e-9e98-a0daa1b35a0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "328d2b64-7bc6-425a-b3a4-8cda754ffd56", "address": "fa:16:3e:a6:55:10", "network": {"id": "1c6521c7-7280-4952-b1bc-a3aa0918e27c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1095863542", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e024f5a578e4543a02c6adc7d456f39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap328d2b64-7b", "ovs_interfaceid": "328d2b64-7bc6-425a-b3a4-8cda754ffd56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6e295a29-0297-49c0-9298-7d3a41a07585", "address": "fa:16:3e:32:10:a4", "network": {"id": "1c6521c7-7280-4952-b1bc-a3aa0918e27c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1095863542", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e024f5a578e4543a02c6adc7d456f39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e295a29-02", "ovs_interfaceid": "6e295a29-0297-49c0-9298-7d3a41a07585", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:44:15 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:44:15 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GIrHQbTF {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:15 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Releasing lock "refresh_cache-d1516acc-354e-41f6-a639-61dea870b11e" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:44:15 user nova-compute[71509]: DEBUG nova.compute.manager [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Instance network_info: |[{"id": "2a2ef05a-2d58-4cdf-ab6c-35df823a68bc", "address": "fa:16:3e:ad:4e:cf", "network": {"id": "3c95a463-71cf-446f-8214-5f52f2da54b7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-325252986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e024f5a578e4543a02c6adc7d456f39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a2ef05a-2d", "ovs_interfaceid": "2a2ef05a-2d58-4cdf-ab6c-35df823a68bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "23214923-0217-4046-9a68-675f2ee8e42d", "address": "fa:16:3e:8a:5a:1a", "network": {"id": "bb8c5688-db8f-47c0-a2b5-0a44d2f97461", "bridge": "br-int", "label": "tempest-device-tagging-net1-527368946", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e024f5a578e4543a02c6adc7d456f39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23214923-02", "ovs_interfaceid": "23214923-0217-4046-9a68-675f2ee8e42d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7f7db929-b2fd-4242-9d23-5d58a374f961", "address": "fa:16:3e:28:88:b4", "network": {"id": "bb8c5688-db8f-47c0-a2b5-0a44d2f97461", "bridge": "br-int", "label": "tempest-device-tagging-net1-527368946", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e024f5a578e4543a02c6adc7d456f39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f7db929-b2", "ovs_interfaceid": "7f7db929-b2fd-4242-9d23-5d58a374f961", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4d65e4a1-4cea-4636-8ad8-21065de3c747", "address": "fa:16:3e:c2:1b:8c", "network": {"id": "bb8c5688-db8f-47c0-a2b5-0a44d2f97461", "bridge": "br-int", "label": "tempest-device-tagging-net1-527368946", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e024f5a578e4543a02c6adc7d456f39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d65e4a1-4c", "ovs_interfaceid": "4d65e4a1-4cea-4636-8ad8-21065de3c747", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d70f6f4d-f2bc-4d5e-9e98-a0daa1b35a0f", "address": "fa:16:3e:64:ce:c5", "network": {"id": "bb8c5688-db8f-47c0-a2b5-0a44d2f97461", "bridge": "br-int", "label": "tempest-device-tagging-net1-527368946", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e024f5a578e4543a02c6adc7d456f39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd70f6f4d-f2", "ovs_interfaceid": "d70f6f4d-f2bc-4d5e-9e98-a0daa1b35a0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "328d2b64-7bc6-425a-b3a4-8cda754ffd56", "address": "fa:16:3e:a6:55:10", "network": {"id": "1c6521c7-7280-4952-b1bc-a3aa0918e27c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1095863542", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e024f5a578e4543a02c6adc7d456f39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap328d2b64-7b", "ovs_interfaceid": "328d2b64-7bc6-425a-b3a4-8cda754ffd56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6e295a29-0297-49c0-9298-7d3a41a07585", "address": "fa:16:3e:32:10:a4", "network": {"id": "1c6521c7-7280-4952-b1bc-a3aa0918e27c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1095863542", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e024f5a578e4543a02c6adc7d456f39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e295a29-02", "ovs_interfaceid": "6e295a29-0297-49c0-9298-7d3a41a07585", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71509) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 10:44:15 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GIrHQbTF" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:44:15 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[626979df-4490-4d7a-816d-7411043c8e51]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:44:15 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-14a0426d-5eee-47fe-8105-1e04031d30dc req-aa4e21af-b69a-402a-b983-4c2ea16871f7 service nova] Acquired lock "refresh_cache-d1516acc-354e-41f6-a639-61dea870b11e" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:44:15 user nova-compute[71509]: DEBUG nova.network.neutron [req-14a0426d-5eee-47fe-8105-1e04031d30dc req-aa4e21af-b69a-402a-b983-4c2ea16871f7 service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Refreshing network info cache for port 6e295a29-0297-49c0-9298-7d3a41a07585 {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 10:44:15 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GIrHQbTF'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:44:15 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:15 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:44:15 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa80b2ab-88de-487a-9c4d-c76bf59d86e3]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:44:15 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:44:15 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:15 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:44:15 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4886ad5-4515-428e-80f1-5758f9f62ec9]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18 (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:44:15 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee (non-flash)
Apr 14 10:44:15 user nova-compute[71509]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18 (non-flash)
Apr 14 10:44:15 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:44:15 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee (non-flash)
Apr 14 10:44:15 user nova-compute[71509]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18 (non-flash)
Apr 14 10:44:15 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 10:44:15 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768 -p 172.16.0.220:3260 --login {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:15 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:44:15 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[8337ac81-2eb5-4274-b24c-b3537b2029a1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:44:15 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768, portal: 172.16.0.220,3260]
Apr 14 10:44:15 user nova-compute[71509]: Login to [iface: default, target: iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768, portal: 172.16.0.220,3260] successful.
Apr 14 10:44:15 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:44:15 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:15 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:44:15 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6adb988-a3a7-44de-a3fd-80065dffda1d]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:44:15 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:44:15 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:15 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:44:15 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[a13a87d0-f62c-4cd0-b2d6-7fd3d2dde0ac]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768 (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:44:15 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee (non-flash)
Apr 14 10:44:15 user nova-compute[71509]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18 (non-flash)
Apr 14 10:44:15 user nova-compute[71509]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768 (non-flash)
Apr 14 10:44:15 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:44:15 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee (non-flash)
Apr 14 10:44:15 user nova-compute[71509]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18 (non-flash)
Apr 14 10:44:15 user nova-compute[71509]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768 (non-flash)
Apr 14 10:44:15 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 10:44:15 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.679s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 10:44:15 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Connected to 172.16.0.220:3260 {{(pid=71509) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 10:44:15 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=71509) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 10:44:15 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71509) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 10:44:15 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:15 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:44:15 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[7be69d62-03a9-40dc-8f9a-91c10a1aa084]: (4, ('- - 0', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:44:15 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: None {{(pid=71509) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 10:44:15 user nova-compute[71509]: DEBUG nova.network.neutron [req-14a0426d-5eee-47fe-8105-1e04031d30dc req-aa4e21af-b69a-402a-b983-4c2ea16871f7 service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Updated VIF entry in instance network info cache for port 6e295a29-0297-49c0-9298-7d3a41a07585. {{(pid=71509) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 10:44:15 user nova-compute[71509]: DEBUG nova.network.neutron [req-14a0426d-5eee-47fe-8105-1e04031d30dc req-aa4e21af-b69a-402a-b983-4c2ea16871f7 service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Updating instance_info_cache with network_info: [{"id": "2a2ef05a-2d58-4cdf-ab6c-35df823a68bc", "address": "fa:16:3e:ad:4e:cf", "network": {"id": "3c95a463-71cf-446f-8214-5f52f2da54b7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-325252986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e024f5a578e4543a02c6adc7d456f39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a2ef05a-2d", "ovs_interfaceid": "2a2ef05a-2d58-4cdf-ab6c-35df823a68bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "23214923-0217-4046-9a68-675f2ee8e42d", "address": "fa:16:3e:8a:5a:1a", "network": {"id": "bb8c5688-db8f-47c0-a2b5-0a44d2f97461", "bridge": "br-int", "label": "tempest-device-tagging-net1-527368946", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e024f5a578e4543a02c6adc7d456f39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23214923-02", "ovs_interfaceid": "23214923-0217-4046-9a68-675f2ee8e42d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7f7db929-b2fd-4242-9d23-5d58a374f961", "address": "fa:16:3e:28:88:b4", "network": {"id": "bb8c5688-db8f-47c0-a2b5-0a44d2f97461", "bridge": "br-int", "label": "tempest-device-tagging-net1-527368946", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e024f5a578e4543a02c6adc7d456f39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f7db929-b2", "ovs_interfaceid": "7f7db929-b2fd-4242-9d23-5d58a374f961", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4d65e4a1-4cea-4636-8ad8-21065de3c747", "address": "fa:16:3e:c2:1b:8c", "network": {"id": "bb8c5688-db8f-47c0-a2b5-0a44d2f97461", "bridge": "br-int", "label": "tempest-device-tagging-net1-527368946", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e024f5a578e4543a02c6adc7d456f39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d65e4a1-4c", "ovs_interfaceid": "4d65e4a1-4cea-4636-8ad8-21065de3c747", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d70f6f4d-f2bc-4d5e-9e98-a0daa1b35a0f", "address": "fa:16:3e:64:ce:c5", "network": {"id": "bb8c5688-db8f-47c0-a2b5-0a44d2f97461", "bridge": "br-int", "label": "tempest-device-tagging-net1-527368946", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e024f5a578e4543a02c6adc7d456f39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd70f6f4d-f2", "ovs_interfaceid": "d70f6f4d-f2bc-4d5e-9e98-a0daa1b35a0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "328d2b64-7bc6-425a-b3a4-8cda754ffd56", "address": "fa:16:3e:a6:55:10", "network": {"id": "1c6521c7-7280-4952-b1bc-a3aa0918e27c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1095863542", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e024f5a578e4543a02c6adc7d456f39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap328d2b64-7b", "ovs_interfaceid": "328d2b64-7bc6-425a-b3a4-8cda754ffd56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6e295a29-0297-49c0-9298-7d3a41a07585", "address": "fa:16:3e:32:10:a4", "network": {"id": "1c6521c7-7280-4952-b1bc-a3aa0918e27c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1095863542", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e024f5a578e4543a02c6adc7d456f39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e295a29-02", "ovs_interfaceid": "6e295a29-0297-49c0-9298-7d3a41a07585", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:44:15 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-14a0426d-5eee-47fe-8105-1e04031d30dc req-aa4e21af-b69a-402a-b983-4c2ea16871f7 service nova] Releasing lock "refresh_cache-d1516acc-354e-41f6-a639-61dea870b11e" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:44:15 user nova-compute[71509]: DEBUG nova.compute.manager [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Start spawning the instance on the hypervisor. {{(pid=71509) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 10:44:15 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Creating instance directory {{(pid=71509) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 10:44:15 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Creating image(s)
Apr 14 10:44:15 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Did not create local disks {{(pid=71509) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 10:44:15 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Ensure instance console log exists: /opt/stack/data/nova/instances/d1516acc-354e-41f6-a639-61dea870b11e/console.log {{(pid=71509) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 10:44:15 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:44:15 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:44:15 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:44:15 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Start _get_guest_xml network_info=[{"id": "2a2ef05a-2d58-4cdf-ab6c-35df823a68bc", "address": "fa:16:3e:ad:4e:cf", "network": {"id": "3c95a463-71cf-446f-8214-5f52f2da54b7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-325252986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e024f5a578e4543a02c6adc7d456f39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a2ef05a-2d", "ovs_interfaceid": "2a2ef05a-2d58-4cdf-ab6c-35df823a68bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "23214923-0217-4046-9a68-675f2ee8e42d", "address": "fa:16:3e:8a:5a:1a", "network": {"id": "bb8c5688-db8f-47c0-a2b5-0a44d2f97461", "bridge": "br-int", "label": "tempest-device-tagging-net1-527368946", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e024f5a578e4543a02c6adc7d456f39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23214923-02", "ovs_interfaceid": "23214923-0217-4046-9a68-675f2ee8e42d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7f7db929-b2fd-4242-9d23-5d58a374f961", "address": "fa:16:3e:28:88:b4", "network": {"id": "bb8c5688-db8f-47c0-a2b5-0a44d2f97461", "bridge": "br-int", "label": "tempest-device-tagging-net1-527368946", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e024f5a578e4543a02c6adc7d456f39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f7db929-b2", "ovs_interfaceid": "7f7db929-b2fd-4242-9d23-5d58a374f961", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4d65e4a1-4cea-4636-8ad8-21065de3c747", "address": "fa:16:3e:c2:1b:8c", "network": {"id": "bb8c5688-db8f-47c0-a2b5-0a44d2f97461", "bridge": "br-int", "label": "tempest-device-tagging-net1-527368946", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e024f5a578e4543a02c6adc7d456f39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d65e4a1-4c", "ovs_interfaceid": "4d65e4a1-4cea-4636-8ad8-21065de3c747", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d70f6f4d-f2bc-4d5e-9e98-a0daa1b35a0f", "address": "fa:16:3e:64:ce:c5", "network": {"id": "bb8c5688-db8f-47c0-a2b5-0a44d2f97461", "bridge": "br-int", "label": "tempest-device-tagging-net1-527368946", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e024f5a578e4543a02c6adc7d456f39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd70f6f4d-f2", "ovs_interfaceid": "d70f6f4d-f2bc-4d5e-9e98-a0daa1b35a0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "328d2b64-7bc6-425a-b3a4-8cda754ffd56", "address": "fa:16:3e:a6:55:10", "network": {"id": "1c6521c7-7280-4952-b1bc-a3aa0918e27c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1095863542", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e024f5a578e4543a02c6adc7d456f39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap328d2b64-7b", "ovs_interfaceid": "328d2b64-7bc6-425a-b3a4-8cda754ffd56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6e295a29-0297-49c0-9298-7d3a41a07585", "address": "fa:16:3e:32:10:a4", "network": {"id": "1c6521c7-7280-4952-b1bc-a3aa0918e27c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1095863542", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e024f5a578e4543a02c6adc7d456f39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e295a29-02", "ovs_interfaceid": "6e295a29-0297-49c0-9298-7d3a41a07585", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T10:38:55Z,direct_url=<?>,disk_format='qcow2',id=048ec0ee-0465-448d-8b4c-f072acb101dc,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='9742d6ad20cf48d9bab0fdbcc9491db9',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T10:38:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'attachment_id': '73d0dd3b-7d05-4335-95ff-e7dfe44a882d', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OTvmgYce', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd1516acc-354e-41f6-a639-61dea870b11e', 'attached_at': '', 'detached_at': '', 'volume_id': '146f2d89-f831-40b0-a5cd-75a2761fb700', 'serial': '146f2d89-f831-40b0-a5cd-75a2761fb700'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'volume_type': None}, {'guest_format': None, 'mount_device': '/dev/vdb', 'boot_index': 1, 'device_type': 'disk', 'attachment_id': '641929e9-b968-44ba-ad80-dc6e9d158459', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sRGbgDXN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd1516acc-354e-41f6-a639-61dea870b11e', 'attached_at': '', 'detached_at': '', 'volume_id': 'a80b10a6-3148-4db6-842e-f343407b1171', 'serial': 'a80b10a6-3148-4db6-842e-f343407b1171'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'volume_type': None}, {'guest_format': None, 'mount_device': '/dev/vdc', 'boot_index': 2, 'device_type': 'disk', 'attachment_id': '8048e24d-80f5-4ef8-9788-8d98c221f3d9', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jasETYwQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd1516acc-354e-41f6-a639-61dea870b11e', 'attached_at': '', 'detached_at': '', 'volume_id': '0d1e04e5-b8c3-4127-b22f-5535d2d28e7e', 'serial': '0d1e04e5-b8c3-4127-b22f-5535d2d28e7e'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'volume_type': None} {{(pid=71509) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 10:44:15 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:44:15 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:44:15 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71509) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 10:44:15 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T10:40:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T10:38:55Z,direct_url=<?>,disk_format='qcow2',id=048ec0ee-0465-448d-8b4c-f072acb101dc,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='9742d6ad20cf48d9bab0fdbcc9491db9',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T10:38:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 10:44:15 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Flavor limits 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 10:44:15 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Image limits 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 10:44:15 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Flavor pref 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 10:44:15 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Image pref 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 10:44:15 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 10:44:15 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 10:44:15 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71509) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 10:44:15 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Got 1 possible topologies {{(pid=71509) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 10:44:15 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 10:44:15 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 10:44:15 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Calling os-brick to attach iSCSI Volume {{(pid=71509) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 10:44:15 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0bf0749390>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OTvmgYce', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 10:44:15 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 10:44:15 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 10:44:16 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71509) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 10:44:16 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GIrHQbTF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71509) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 10:44:16 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.709s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 10:44:16 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] <== connect_volume: return (1710ms) {'type': 'block', 'scsi_wwn': '23263636130386431', 'path': '/dev/sdd'} {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 10:44:16 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23263636130386431', 'path': '/dev/sdd'} {{(pid=71509) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 10:44:16 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.555s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 10:44:16 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 10:44:16 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 10:44:16 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 10:44:16 user nova-compute[71509]: INFO os_brick.initiator.connectors.iscsi [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 10:44:16 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700 -p 172.16.0.220:3260 {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:16 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:44:16 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad39f34b-f3ac-4139-87aa-0bbae0dee0ef]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:44:16 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 10:44:16 user nova-compute[71509]:  {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:44:16 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700 -p 172.16.0.220:3260 --interface default --op new {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:16 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Calling os-brick to attach iSCSI Volume {{(pid=71509) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 10:44:16 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0bf0749390>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fdbWvrhQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 10:44:16 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 10:44:16 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 10:44:16 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:44:16 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea5df864-dd4e-4cba-a43a-09bbc45bbd25]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700] added\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:44:16 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700] added
Apr 14 10:44:16 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:44:16 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:16 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:44:16 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[54d38b23-ca6d-4d49-bd51-c2dea085bb7e]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:44:16 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:44:16 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:16 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:44:16 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[db81b9be-b704-49f1-b717-c12583ac2d27]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:44:16 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:44:16 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OTvmgYce {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:16 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OTvmgYce" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:44:16 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1bd0c40-bf82-4c93-8012-45b506b4082f]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:44:16 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OTvmgYce'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:44:16 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:16 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:44:16 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab37b026-f6a2-4c95-ba17-b39aeb48dc40]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:44:16 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:44:16 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:16 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:44:16 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[bff1c976-9d31-47ef-974a-af4ed077a58f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768 (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:44:16 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee (non-flash)
Apr 14 10:44:16 user nova-compute[71509]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18 (non-flash)
Apr 14 10:44:16 user nova-compute[71509]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768 (non-flash)
Apr 14 10:44:16 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:44:16 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee (non-flash)
Apr 14 10:44:16 user nova-compute[71509]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18 (non-flash)
Apr 14 10:44:16 user nova-compute[71509]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768 (non-flash)
Apr 14 10:44:16 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 10:44:16 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700 -p 172.16.0.220:3260 --login {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:16 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:44:16 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[2249b6a1-2804-470f-a7c2-339ad7c8cd0a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:44:16 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700, portal: 172.16.0.220,3260]
Apr 14 10:44:16 user nova-compute[71509]: Login to [iface: default, target: iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700, portal: 172.16.0.220,3260] successful.
Apr 14 10:44:16 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:44:16 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:16 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:44:16 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc46037e-7b1e-4027-a804-c82284d3bd3e]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:44:16 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:44:16 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:16 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:44:16 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[79c9d127-8e5f-4b86-8343-9a71b34c6c45]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700 (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:44:16 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee (non-flash)
Apr 14 10:44:16 user nova-compute[71509]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18 (non-flash)
Apr 14 10:44:16 user nova-compute[71509]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768 (non-flash)
Apr 14 10:44:16 user nova-compute[71509]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700 (non-flash)
Apr 14 10:44:16 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:44:16 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee (non-flash)
Apr 14 10:44:16 user nova-compute[71509]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18 (non-flash)
Apr 14 10:44:16 user nova-compute[71509]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768 (non-flash)
Apr 14 10:44:16 user nova-compute[71509]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700 (non-flash)
Apr 14 10:44:16 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 10:44:16 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 10:44:16 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Connected to 172.16.0.220:3260 {{(pid=71509) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 10:44:16 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=71509) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 10:44:16 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71509) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 10:44:16 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:16 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:44:16 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[4faeec62-303b-41b0-bd55-596125349d8a]: (4, ('- - 0', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:44:16 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71509) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 10:44:16 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OTvmgYce', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71509) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 10:44:17 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:17 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.311s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 10:44:17 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] <== connect_volume: return (1866ms) {'type': 'block', 'scsi_wwn': '23162636432623630', 'path': '/dev/sde'} {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 10:44:17 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23162636432623630', 'path': '/dev/sde'} {{(pid=71509) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 10:44:17 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.282s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 10:44:17 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 10:44:17 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 10:44:17 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 10:44:17 user nova-compute[71509]: INFO os_brick.initiator.connectors.iscsi [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 10:44:17 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92 -p 172.16.0.220:3260 {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:17 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Calling os-brick to attach iSCSI Volume {{(pid=71509) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 10:44:17 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0bf0749390>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sRGbgDXN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 10:44:17 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 10:44:17 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 10:44:17 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:44:17 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[7960a1dd-ff85-4cfd-8081-7e1556c31d4a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:44:17 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 10:44:17 user nova-compute[71509]:  {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:44:17 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92 -p 172.16.0.220:3260 --interface default --op new {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:17 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:44:17 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[d346d4a5-e8a6-4d14-a664-d0fa49ce58d1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92] added\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:44:17 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92] added
Apr 14 10:44:17 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:44:17 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:17 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:44:17 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[f181ffda-2a65-4022-acd1-7874ec943195]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:44:17 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:44:17 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:17 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:44:17 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[c80da3af-38e0-4351-827f-5736c291b9c3]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:44:17 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:44:17 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fdbWvrhQ {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:17 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fdbWvrhQ" returned: 0 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:44:17 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c1024d4-efc4-47d1-a31c-f7a00a51c178]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:44:17 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fdbWvrhQ'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:44:17 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:17 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:44:17 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[f506a679-fd7e-41d4-aba9-2d7779b8fc0f]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:44:17 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:44:17 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:17 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:44:17 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba1b7386-46e1-4ca0-8408-efca294e348a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700 (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:44:17 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee (non-flash)
Apr 14 10:44:17 user nova-compute[71509]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18 (non-flash)
Apr 14 10:44:17 user nova-compute[71509]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768 (non-flash)
Apr 14 10:44:17 user nova-compute[71509]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700 (non-flash)
Apr 14 10:44:17 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:44:17 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee (non-flash)
Apr 14 10:44:17 user nova-compute[71509]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18 (non-flash)
Apr 14 10:44:17 user nova-compute[71509]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768 (non-flash)
Apr 14 10:44:17 user nova-compute[71509]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700 (non-flash)
Apr 14 10:44:17 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 10:44:17 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92 -p 172.16.0.220:3260 --login {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:18 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:44:18 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[28a648ad-31bf-4e52-bd18-d0fc51f05081]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:44:18 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92, portal: 172.16.0.220,3260]
Apr 14 10:44:18 user nova-compute[71509]: Login to [iface: default, target: iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92, portal: 172.16.0.220,3260] successful.
Apr 14 10:44:18 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:44:18 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:18 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:44:18 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[78c1e4c3-314a-4ddd-a980-1047ea54bcf3]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:44:18 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:44:18 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:18 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:44:18 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d29db2a-981a-45b0-96e4-655abfecd3c5]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92 (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:44:18 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee (non-flash)
Apr 14 10:44:18 user nova-compute[71509]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18 (non-flash)
Apr 14 10:44:18 user nova-compute[71509]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768 (non-flash)
Apr 14 10:44:18 user nova-compute[71509]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700 (non-flash)
Apr 14 10:44:18 user nova-compute[71509]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92 (non-flash)
Apr 14 10:44:18 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:44:18 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee (non-flash)
Apr 14 10:44:18 user nova-compute[71509]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18 (non-flash)
Apr 14 10:44:18 user nova-compute[71509]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768 (non-flash)
Apr 14 10:44:18 user nova-compute[71509]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700 (non-flash)
Apr 14 10:44:18 user nova-compute[71509]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92 (non-flash)
Apr 14 10:44:18 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 10:44:18 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.307s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 10:44:18 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Connected to 172.16.0.220:3260 {{(pid=71509) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 10:44:18 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=71509) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 10:44:18 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=71509) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 10:44:18 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:18 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:44:18 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcd0e870-53af-4dd7-b24e-7e9cb3560df7]: (4, ('- - 0', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:44:18 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71509) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 10:44:18 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fdbWvrhQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71509) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.341s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] <== connect_volume: return (2623ms) {'type': 'block', 'scsi_wwn': '26431303262306161', 'path': '/dev/sdf'} {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26431303262306161', 'path': '/dev/sdf'} {{(pid=71509) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.316s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 10:44:19 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 10:44:19 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 10:44:19 user nova-compute[71509]: INFO os_brick.initiator.connectors.iscsi [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 10:44:19 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171 -p 172.16.0.220:3260 {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4ce3e8a-4e0f-4b91-81d4-a9f263664b33]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 10:44:19 user nova-compute[71509]:  {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T10:43:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1778823491',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1778823491',id=11,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHQhgKrBsUiMtMBVjIBZKP9TZIRsKtCXglQ+b+qPpSHOKxGrJsHd4CAY6Od528O1Hb16vq8TAcsw6lyU3DudugT46dzAga1vtVSJBR0oeEIq/4xyY6zaQXucI88fNYMmeg==',key_name='tempest-keypair-190287482',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f701119cef78433280cbddf2adf685db',ramdisk_id='',reservation_id='r-wllxdslz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1078203530',owner_user_name='tempest-TaggedBootDevicesTest_v242-1078203530-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T10:43:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3579ac20f8094f5a9fbd036ed05cda23',uuid=a81da242-e8d8-4b41-b84a-e12d603823ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2b341364-55e1-439f-9a3b-2b2fb7ad33b7", "address": "fa:16:3e:3e:8d:2f", "network": {"id": "e6a6e8f5-448a-41d1-a833-6db7058c611c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-378111892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f701119cef78433280cbddf2adf685db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b341364-55", "ovs_interfaceid": "2b341364-55e1-439f-9a3b-2b2fb7ad33b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71509) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Converting VIF {"id": "2b341364-55e1-439f-9a3b-2b2fb7ad33b7", "address": "fa:16:3e:3e:8d:2f", "network": {"id": "e6a6e8f5-448a-41d1-a833-6db7058c611c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-378111892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f701119cef78433280cbddf2adf685db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b341364-55", "ovs_interfaceid": "2b341364-55e1-439f-9a3b-2b2fb7ad33b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:8d:2f,bridge_name='br-int',has_traffic_filtering=True,id=2b341364-55e1-439f-9a3b-2b2fb7ad33b7,network=Network(e6a6e8f5-448a-41d1-a833-6db7058c611c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b341364-55') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T10:43:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1778823491',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1778823491',id=11,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHQhgKrBsUiMtMBVjIBZKP9TZIRsKtCXglQ+b+qPpSHOKxGrJsHd4CAY6Od528O1Hb16vq8TAcsw6lyU3DudugT46dzAga1vtVSJBR0oeEIq/4xyY6zaQXucI88fNYMmeg==',key_name='tempest-keypair-190287482',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f701119cef78433280cbddf2adf685db',ramdisk_id='',reservation_id='r-wllxdslz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1078203530',owner_user_name='tempest-TaggedBootDevicesTest_v242-1078203530-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T10:43:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3579ac20f8094f5a9fbd036ed05cda23',uuid=a81da242-e8d8-4b41-b84a-e12d603823ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f3e8f62b-77e2-49d5-9fd9-b75f024a4ee7", "address": "fa:16:3e:87:fe:bc", "network": {"id": "a50bebb6-d4de-4875-9553-570535dace36", "bridge": "br-int", "label": "tempest-device-tagging-net1-1002288517", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.199", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f701119cef78433280cbddf2adf685db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3e8f62b-77", "ovs_interfaceid": "f3e8f62b-77e2-49d5-9fd9-b75f024a4ee7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71509) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Converting VIF {"id": "f3e8f62b-77e2-49d5-9fd9-b75f024a4ee7", "address": "fa:16:3e:87:fe:bc", "network": {"id": "a50bebb6-d4de-4875-9553-570535dace36", "bridge": "br-int", "label": "tempest-device-tagging-net1-1002288517", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.199", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f701119cef78433280cbddf2adf685db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3e8f62b-77", "ovs_interfaceid": "f3e8f62b-77e2-49d5-9fd9-b75f024a4ee7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:fe:bc,bridge_name='br-int',has_traffic_filtering=True,id=f3e8f62b-77e2-49d5-9fd9-b75f024a4ee7,network=Network(a50bebb6-d4de-4875-9553-570535dace36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf3e8f62b-77') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T10:43:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1778823491',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1778823491',id=11,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHQhgKrBsUiMtMBVjIBZKP9TZIRsKtCXglQ+b+qPpSHOKxGrJsHd4CAY6Od528O1Hb16vq8TAcsw6lyU3DudugT46dzAga1vtVSJBR0oeEIq/4xyY6zaQXucI88fNYMmeg==',key_name='tempest-keypair-190287482',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f701119cef78433280cbddf2adf685db',ramdisk_id='',reservation_id='r-wllxdslz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1078203530',owner_user_name='tempest-TaggedBootDevicesTest_v242-1078203530-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T10:43:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3579ac20f8094f5a9fbd036ed05cda23',uuid=a81da242-e8d8-4b41-b84a-e12d603823ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d2d71e67-1807-43cf-8753-7bdd77de6317", "address": "fa:16:3e:4a:86:23", "network": {"id": "a50bebb6-d4de-4875-9553-570535dace36", "bridge": "br-int", "label": "tempest-device-tagging-net1-1002288517", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.110", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f701119cef78433280cbddf2adf685db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2d71e67-18", "ovs_interfaceid": "d2d71e67-1807-43cf-8753-7bdd77de6317", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71509) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Converting VIF {"id": "d2d71e67-1807-43cf-8753-7bdd77de6317", "address": "fa:16:3e:4a:86:23", "network": {"id": "a50bebb6-d4de-4875-9553-570535dace36", "bridge": "br-int", "label": "tempest-device-tagging-net1-1002288517", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.110", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f701119cef78433280cbddf2adf685db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2d71e67-18", "ovs_interfaceid": "d2d71e67-1807-43cf-8753-7bdd77de6317", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:86:23,bridge_name='br-int',has_traffic_filtering=True,id=d2d71e67-1807-43cf-8753-7bdd77de6317,network=Network(a50bebb6-d4de-4875-9553-570535dace36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd2d71e67-18') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T10:43:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1778823491',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1778823491',id=11,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHQhgKrBsUiMtMBVjIBZKP9TZIRsKtCXglQ+b+qPpSHOKxGrJsHd4CAY6Od528O1Hb16vq8TAcsw6lyU3DudugT46dzAga1vtVSJBR0oeEIq/4xyY6zaQXucI88fNYMmeg==',key_name='tempest-keypair-190287482',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f701119cef78433280cbddf2adf685db',ramdisk_id='',reservation_id='r-wllxdslz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1078203530',owner_user_name='tempest-TaggedBootDevicesTest_v242-1078203530-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T10:43:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3579ac20f8094f5a9fbd036ed05cda23',uuid=a81da242-e8d8-4b41-b84a-e12d603823ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c46b5082-6634-4c7f-89c1-7e58a3cd8987", "address": "fa:16:3e:5b:0c:b3", "network": {"id": "a50bebb6-d4de-4875-9553-570535dace36", "bridge": "br-int", "label": "tempest-device-tagging-net1-1002288517", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f701119cef78433280cbddf2adf685db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc46b5082-66", "ovs_interfaceid": "c46b5082-6634-4c7f-89c1-7e58a3cd8987", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71509) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Converting VIF {"id": "c46b5082-6634-4c7f-89c1-7e58a3cd8987", "address": "fa:16:3e:5b:0c:b3", "network": {"id": "a50bebb6-d4de-4875-9553-570535dace36", "bridge": "br-int", "label": "tempest-device-tagging-net1-1002288517", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f701119cef78433280cbddf2adf685db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc46b5082-66", "ovs_interfaceid": "c46b5082-6634-4c7f-89c1-7e58a3cd8987", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:0c:b3,bridge_name='br-int',has_traffic_filtering=True,id=c46b5082-6634-4c7f-89c1-7e58a3cd8987,network=Network(a50bebb6-d4de-4875-9553-570535dace36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc46b5082-66') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T10:43:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1778823491',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1778823491',id=11,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHQhgKrBsUiMtMBVjIBZKP9TZIRsKtCXglQ+b+qPpSHOKxGrJsHd4CAY6Od528O1Hb16vq8TAcsw6lyU3DudugT46dzAga1vtVSJBR0oeEIq/4xyY6zaQXucI88fNYMmeg==',key_name='tempest-keypair-190287482',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f701119cef78433280cbddf2adf685db',ramdisk_id='',reservation_id='r-wllxdslz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1078203530',owner_user_name='tempest-TaggedBootDevicesTest_v242-1078203530-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T10:43:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3579ac20f8094f5a9fbd036ed05cda23',uuid=a81da242-e8d8-4b41-b84a-e12d603823ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8789c03e-397c-439a-8bc5-5d8ce5fc36ac", "address": "fa:16:3e:cf:67:ac", "network": {"id": "a50bebb6-d4de-4875-9553-570535dace36", "bridge": "br-int", "label": "tempest-device-tagging-net1-1002288517", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f701119cef78433280cbddf2adf685db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8789c03e-39", "ovs_interfaceid": "8789c03e-397c-439a-8bc5-5d8ce5fc36ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71509) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Converting VIF {"id": "8789c03e-397c-439a-8bc5-5d8ce5fc36ac", "address": "fa:16:3e:cf:67:ac", "network": {"id": "a50bebb6-d4de-4875-9553-570535dace36", "bridge": "br-int", "label": "tempest-device-tagging-net1-1002288517", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f701119cef78433280cbddf2adf685db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8789c03e-39", "ovs_interfaceid": "8789c03e-397c-439a-8bc5-5d8ce5fc36ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:67:ac,bridge_name='br-int',has_traffic_filtering=True,id=8789c03e-397c-439a-8bc5-5d8ce5fc36ac,network=Network(a50bebb6-d4de-4875-9553-570535dace36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8789c03e-39') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T10:43:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1778823491',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1778823491',id=11,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHQhgKrBsUiMtMBVjIBZKP9TZIRsKtCXglQ+b+qPpSHOKxGrJsHd4CAY6Od528O1Hb16vq8TAcsw6lyU3DudugT46dzAga1vtVSJBR0oeEIq/4xyY6zaQXucI88fNYMmeg==',key_name='tempest-keypair-190287482',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f701119cef78433280cbddf2adf685db',ramdisk_id='',reservation_id='r-wllxdslz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1078203530',owner_user_name='tempest-TaggedBootDevicesTest_v242-1078203530-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T10:43:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3579ac20f8094f5a9fbd036ed05cda23',uuid=a81da242-e8d8-4b41-b84a-e12d603823ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "84e561e8-01c6-4d50-ab37-bc64b5509e31", "address": "fa:16:3e:e1:97:d3", "network": {"id": "d6116fed-ce24-4ad4-9e8a-dfb2c1305e1c", "bridge": "br-int", "label": "tempest-device-tagging-net2-564175672", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f701119cef78433280cbddf2adf685db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84e561e8-01", "ovs_interfaceid": "84e561e8-01c6-4d50-ab37-bc64b5509e31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71509) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Converting VIF {"id": "84e561e8-01c6-4d50-ab37-bc64b5509e31", "address": "fa:16:3e:e1:97:d3", "network": {"id": "d6116fed-ce24-4ad4-9e8a-dfb2c1305e1c", "bridge": "br-int", "label": "tempest-device-tagging-net2-564175672", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f701119cef78433280cbddf2adf685db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84e561e8-01", "ovs_interfaceid": "84e561e8-01c6-4d50-ab37-bc64b5509e31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:97:d3,bridge_name='br-int',has_traffic_filtering=True,id=84e561e8-01c6-4d50-ab37-bc64b5509e31,network=Network(d6116fed-ce24-4ad4-9e8a-dfb2c1305e1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84e561e8-01') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T10:43:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1778823491',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1778823491',id=11,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHQhgKrBsUiMtMBVjIBZKP9TZIRsKtCXglQ+b+qPpSHOKxGrJsHd4CAY6Od528O1Hb16vq8TAcsw6lyU3DudugT46dzAga1vtVSJBR0oeEIq/4xyY6zaQXucI88fNYMmeg==',key_name='tempest-keypair-190287482',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f701119cef78433280cbddf2adf685db',ramdisk_id='',reservation_id='r-wllxdslz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1078203530',owner_user_name='tempest-TaggedBootDevicesTest_v242-1078203530-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T10:43:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3579ac20f8094f5a9fbd036ed05cda23',uuid=a81da242-e8d8-4b41-b84a-e12d603823ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "717e6c20-676e-40f2-b4c1-47ca0f3e6f22", "address": "fa:16:3e:bf:a5:40", "network": {"id": "d6116fed-ce24-4ad4-9e8a-dfb2c1305e1c", "bridge": "br-int", "label": "tempest-device-tagging-net2-564175672", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f701119cef78433280cbddf2adf685db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap717e6c20-67", "ovs_interfaceid": "717e6c20-676e-40f2-b4c1-47ca0f3e6f22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71509) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Converting VIF {"id": "717e6c20-676e-40f2-b4c1-47ca0f3e6f22", "address": "fa:16:3e:bf:a5:40", "network": {"id": "d6116fed-ce24-4ad4-9e8a-dfb2c1305e1c", "bridge": "br-int", "label": "tempest-device-tagging-net2-564175672", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f701119cef78433280cbddf2adf685db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap717e6c20-67", "ovs_interfaceid": "717e6c20-676e-40f2-b4c1-47ca0f3e6f22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:a5:40,bridge_name='br-int',has_traffic_filtering=True,id=717e6c20-676e-40f2-b4c1-47ca0f3e6f22,network=Network(d6116fed-ce24-4ad4-9e8a-dfb2c1305e1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap717e6c20-67') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG nova.objects.instance [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Lazy-loading 'pci_devices' on Instance uuid a81da242-e8d8-4b41-b84a-e12d603823ca {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171 -p 172.16.0.220:3260 --interface default --op new {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b204e82-43a7-4e6e-a4cb-f0eea2163963]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171] added\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171] added
Apr 14 10:44:19 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] End _get_guest_xml xml=<domain type="kvm">
Apr 14 10:44:19 user nova-compute[71509]:   <uuid>a81da242-e8d8-4b41-b84a-e12d603823ca</uuid>
Apr 14 10:44:19 user nova-compute[71509]:   <name>instance-0000000b</name>
Apr 14 10:44:19 user nova-compute[71509]:   <memory>131072</memory>
Apr 14 10:44:19 user nova-compute[71509]:   <vcpu>1</vcpu>
Apr 14 10:44:19 user nova-compute[71509]:   <metadata>
Apr 14 10:44:19 user nova-compute[71509]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 10:44:19 user nova-compute[71509]:       <nova:package version="0.0.0"/>
Apr 14 10:44:19 user nova-compute[71509]:       <nova:name>tempest-device-tagging-server-1778823491</nova:name>
Apr 14 10:44:19 user nova-compute[71509]:       <nova:creationTime>2023-04-14 10:44:13</nova:creationTime>
Apr 14 10:44:19 user nova-compute[71509]:       <nova:flavor name="m1.nano">
Apr 14 10:44:19 user nova-compute[71509]:         <nova:memory>128</nova:memory>
Apr 14 10:44:19 user nova-compute[71509]:         <nova:disk>1</nova:disk>
Apr 14 10:44:19 user nova-compute[71509]:         <nova:swap>0</nova:swap>
Apr 14 10:44:19 user nova-compute[71509]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 10:44:19 user nova-compute[71509]:         <nova:vcpus>1</nova:vcpus>
Apr 14 10:44:19 user nova-compute[71509]:       </nova:flavor>
Apr 14 10:44:19 user nova-compute[71509]:       <nova:owner>
Apr 14 10:44:19 user nova-compute[71509]:         <nova:user uuid="3579ac20f8094f5a9fbd036ed05cda23">tempest-TaggedBootDevicesTest_v242-1078203530-project-member</nova:user>
Apr 14 10:44:19 user nova-compute[71509]:         <nova:project uuid="f701119cef78433280cbddf2adf685db">tempest-TaggedBootDevicesTest_v242-1078203530</nova:project>
Apr 14 10:44:19 user nova-compute[71509]:       </nova:owner>
Apr 14 10:44:19 user nova-compute[71509]:       <nova:root type="image" uuid="048ec0ee-0465-448d-8b4c-f072acb101dc"/>
Apr 14 10:44:19 user nova-compute[71509]:       <nova:ports>
Apr 14 10:44:19 user nova-compute[71509]:         <nova:port uuid="2b341364-55e1-439f-9a3b-2b2fb7ad33b7">
Apr 14 10:44:19 user nova-compute[71509]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 14 10:44:19 user nova-compute[71509]:         </nova:port>
Apr 14 10:44:19 user nova-compute[71509]:         <nova:port uuid="f3e8f62b-77e2-49d5-9fd9-b75f024a4ee7">
Apr 14 10:44:19 user nova-compute[71509]:           <nova:ip type="fixed" address="10.1.1.199" ipVersion="4"/>
Apr 14 10:44:19 user nova-compute[71509]:         </nova:port>
Apr 14 10:44:19 user nova-compute[71509]:         <nova:port uuid="d2d71e67-1807-43cf-8753-7bdd77de6317">
Apr 14 10:44:19 user nova-compute[71509]:           <nova:ip type="fixed" address="10.1.1.110" ipVersion="4"/>
Apr 14 10:44:19 user nova-compute[71509]:         </nova:port>
Apr 14 10:44:19 user nova-compute[71509]:         <nova:port uuid="c46b5082-6634-4c7f-89c1-7e58a3cd8987">
Apr 14 10:44:19 user nova-compute[71509]:           <nova:ip type="fixed" address="10.1.1.66" ipVersion="4"/>
Apr 14 10:44:19 user nova-compute[71509]:         </nova:port>
Apr 14 10:44:19 user nova-compute[71509]:         <nova:port uuid="8789c03e-397c-439a-8bc5-5d8ce5fc36ac">
Apr 14 10:44:19 user nova-compute[71509]:           <nova:ip type="fixed" address="10.1.1.111" ipVersion="4"/>
Apr 14 10:44:19 user nova-compute[71509]:         </nova:port>
Apr 14 10:44:19 user nova-compute[71509]:         <nova:port uuid="84e561e8-01c6-4d50-ab37-bc64b5509e31">
Apr 14 10:44:19 user nova-compute[71509]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Apr 14 10:44:19 user nova-compute[71509]:         </nova:port>
Apr 14 10:44:19 user nova-compute[71509]:         <nova:port uuid="717e6c20-676e-40f2-b4c1-47ca0f3e6f22">
Apr 14 10:44:19 user nova-compute[71509]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Apr 14 10:44:19 user nova-compute[71509]:         </nova:port>
Apr 14 10:44:19 user nova-compute[71509]:       </nova:ports>
Apr 14 10:44:19 user nova-compute[71509]:     </nova:instance>
Apr 14 10:44:19 user nova-compute[71509]:   </metadata>
Apr 14 10:44:19 user nova-compute[71509]:   <sysinfo type="smbios">
Apr 14 10:44:19 user nova-compute[71509]:     <system>
Apr 14 10:44:19 user nova-compute[71509]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 10:44:19 user nova-compute[71509]:       <entry name="product">OpenStack Nova</entry>
Apr 14 10:44:19 user nova-compute[71509]:       <entry name="version">0.0.0</entry>
Apr 14 10:44:19 user nova-compute[71509]:       <entry name="serial">a81da242-e8d8-4b41-b84a-e12d603823ca</entry>
Apr 14 10:44:19 user nova-compute[71509]:       <entry name="uuid">a81da242-e8d8-4b41-b84a-e12d603823ca</entry>
Apr 14 10:44:19 user nova-compute[71509]:       <entry name="family">Virtual Machine</entry>
Apr 14 10:44:19 user nova-compute[71509]:     </system>
Apr 14 10:44:19 user nova-compute[71509]:   </sysinfo>
Apr 14 10:44:19 user nova-compute[71509]:   <os>
Apr 14 10:44:19 user nova-compute[71509]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 10:44:19 user nova-compute[71509]:     <boot dev="hd"/>
Apr 14 10:44:19 user nova-compute[71509]:     <smbios mode="sysinfo"/>
Apr 14 10:44:19 user nova-compute[71509]:   </os>
Apr 14 10:44:19 user nova-compute[71509]:   <features>
Apr 14 10:44:19 user nova-compute[71509]:     <acpi/>
Apr 14 10:44:19 user nova-compute[71509]:     <apic/>
Apr 14 10:44:19 user nova-compute[71509]:     <vmcoreinfo/>
Apr 14 10:44:19 user nova-compute[71509]:   </features>
Apr 14 10:44:19 user nova-compute[71509]:   <clock offset="utc">
Apr 14 10:44:19 user nova-compute[71509]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 10:44:19 user nova-compute[71509]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 10:44:19 user nova-compute[71509]:     <timer name="hpet" present="no"/>
Apr 14 10:44:19 user nova-compute[71509]:   </clock>
Apr 14 10:44:19 user nova-compute[71509]:   <cpu mode="custom" match="exact">
Apr 14 10:44:19 user nova-compute[71509]:     <model>Nehalem</model>
Apr 14 10:44:19 user nova-compute[71509]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 10:44:19 user nova-compute[71509]:   </cpu>
Apr 14 10:44:19 user nova-compute[71509]:   <devices>
Apr 14 10:44:19 user nova-compute[71509]:     <disk type="file" device="cdrom">
Apr 14 10:44:19 user nova-compute[71509]:       <driver name="qemu" type="raw" cache="none"/>
Apr 14 10:44:19 user nova-compute[71509]:       <source file="/opt/stack/data/nova/instances/a81da242-e8d8-4b41-b84a-e12d603823ca/disk.config"/>
Apr 14 10:44:19 user nova-compute[71509]:       <target dev="hda" bus="ide"/>
Apr 14 10:44:19 user nova-compute[71509]:     </disk>
Apr 14 10:44:19 user nova-compute[71509]:     <disk type="block" device="disk">
Apr 14 10:44:19 user nova-compute[71509]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 10:44:19 user nova-compute[71509]:       <source dev="/dev/sdc"/>
Apr 14 10:44:19 user nova-compute[71509]:       <target dev="vda" bus="virtio"/>
Apr 14 10:44:19 user nova-compute[71509]:       <serial>2b354544-2f2e-40f1-bb9b-5f60c8497f18</serial>
Apr 14 10:44:19 user nova-compute[71509]:     </disk>
Apr 14 10:44:19 user nova-compute[71509]:     <disk type="block" device="disk">
Apr 14 10:44:19 user nova-compute[71509]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 10:44:19 user nova-compute[71509]:       <source dev="/dev/sdd"/>
Apr 14 10:44:19 user nova-compute[71509]:       <target dev="vdb" bus="virtio"/>
Apr 14 10:44:19 user nova-compute[71509]:       <serial>18ba60c5-2a70-402c-a557-69dd9c886768</serial>
Apr 14 10:44:19 user nova-compute[71509]:     </disk>
Apr 14 10:44:19 user nova-compute[71509]:     <disk type="block" device="disk">
Apr 14 10:44:19 user nova-compute[71509]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 10:44:19 user nova-compute[71509]:       <source dev="/dev/sdf"/>
Apr 14 10:44:19 user nova-compute[71509]:       <target dev="vdc" bus="virtio"/>
Apr 14 10:44:19 user nova-compute[71509]:       <serial>7653f786-98b3-4e3d-b593-3b9fec984d92</serial>
Apr 14 10:44:19 user nova-compute[71509]:     </disk>
Apr 14 10:44:19 user nova-compute[71509]:     <interface type="ethernet">
Apr 14 10:44:19 user nova-compute[71509]:       <mac address="fa:16:3e:3e:8d:2f"/>
Apr 14 10:44:19 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 10:44:19 user nova-compute[71509]:       <mtu size="1442"/>
Apr 14 10:44:19 user nova-compute[71509]:       <target dev="tap2b341364-55"/>
Apr 14 10:44:19 user nova-compute[71509]:     </interface>
Apr 14 10:44:19 user nova-compute[71509]:     <interface type="ethernet">
Apr 14 10:44:19 user nova-compute[71509]:       <mac address="fa:16:3e:87:fe:bc"/>
Apr 14 10:44:19 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 10:44:19 user nova-compute[71509]:       <mtu size="1442"/>
Apr 14 10:44:19 user nova-compute[71509]:       <target dev="tapf3e8f62b-77"/>
Apr 14 10:44:19 user nova-compute[71509]:     </interface>
Apr 14 10:44:19 user nova-compute[71509]:     <interface type="ethernet">
Apr 14 10:44:19 user nova-compute[71509]:       <mac address="fa:16:3e:4a:86:23"/>
Apr 14 10:44:19 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 10:44:19 user nova-compute[71509]:       <mtu size="1442"/>
Apr 14 10:44:19 user nova-compute[71509]:       <target dev="tapd2d71e67-18"/>
Apr 14 10:44:19 user nova-compute[71509]:     </interface>
Apr 14 10:44:19 user nova-compute[71509]:     <interface type="ethernet">
Apr 14 10:44:19 user nova-compute[71509]:       <mac address="fa:16:3e:5b:0c:b3"/>
Apr 14 10:44:19 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 10:44:19 user nova-compute[71509]:       <mtu size="1442"/>
Apr 14 10:44:19 user nova-compute[71509]:       <target dev="tapc46b5082-66"/>
Apr 14 10:44:19 user nova-compute[71509]:     </interface>
Apr 14 10:44:19 user nova-compute[71509]:     <interface type="ethernet">
Apr 14 10:44:19 user nova-compute[71509]:       <mac address="fa:16:3e:cf:67:ac"/>
Apr 14 10:44:19 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 10:44:19 user nova-compute[71509]:       <mtu size="1442"/>
Apr 14 10:44:19 user nova-compute[71509]:       <target dev="tap8789c03e-39"/>
Apr 14 10:44:19 user nova-compute[71509]:     </interface>
Apr 14 10:44:19 user nova-compute[71509]:     <interface type="ethernet">
Apr 14 10:44:19 user nova-compute[71509]:       <mac address="fa:16:3e:e1:97:d3"/>
Apr 14 10:44:19 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 10:44:19 user nova-compute[71509]:       <mtu size="1442"/>
Apr 14 10:44:19 user nova-compute[71509]:       <target dev="tap84e561e8-01"/>
Apr 14 10:44:19 user nova-compute[71509]:     </interface>
Apr 14 10:44:19 user nova-compute[71509]:     <interface type="ethernet">
Apr 14 10:44:19 user nova-compute[71509]:       <mac address="fa:16:3e:bf:a5:40"/>
Apr 14 10:44:19 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 10:44:19 user nova-compute[71509]:       <mtu size="1442"/>
Apr 14 10:44:19 user nova-compute[71509]:       <target dev="tap717e6c20-67"/>
Apr 14 10:44:19 user nova-compute[71509]:     </interface>
Apr 14 10:44:19 user nova-compute[71509]:     <serial type="pty">
Apr 14 10:44:19 user nova-compute[71509]:       <log file="/opt/stack/data/nova/instances/a81da242-e8d8-4b41-b84a-e12d603823ca/console.log" append="off"/>
Apr 14 10:44:19 user nova-compute[71509]:     </serial>
Apr 14 10:44:19 user nova-compute[71509]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 10:44:19 user nova-compute[71509]:     <video>
Apr 14 10:44:19 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 10:44:19 user nova-compute[71509]:     </video>
Apr 14 10:44:19 user nova-compute[71509]:     <rng model="virtio">
Apr 14 10:44:19 user nova-compute[71509]:       <backend model="random">/dev/urandom</backend>
Apr 14 10:44:19 user nova-compute[71509]:     </rng>
Apr 14 10:44:19 user nova-compute[71509]:     <controller type="usb" index="0" model="none"/>
Apr 14 10:44:19 user nova-compute[71509]:     <memballoon model="virtio">
Apr 14 10:44:19 user nova-compute[71509]:       <stats period="10"/>
Apr 14 10:44:19 user nova-compute[71509]:     </memballoon>
Apr 14 10:44:19 user nova-compute[71509]:   </devices>
Apr 14 10:44:19 user nova-compute[71509]: </domain>
Apr 14 10:44:19 user nova-compute[71509]:  {{(pid=71509) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T10:43:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1778823491',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1778823491',id=11,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHQhgKrBsUiMtMBVjIBZKP9TZIRsKtCXglQ+b+qPpSHOKxGrJsHd4CAY6Od528O1Hb16vq8TAcsw6lyU3DudugT46dzAga1vtVSJBR0oeEIq/4xyY6zaQXucI88fNYMmeg==',key_name='tempest-keypair-190287482',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f701119cef78433280cbddf2adf685db',ramdisk_id='',reservation_id='r-wllxdslz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1078203530',owner_user_name='tempest-TaggedBootDevicesTest_v242-1078203530-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T10:43:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3579ac20f8094f5a9fbd036ed05cda23',uuid=a81da242-e8d8-4b41-b84a-e12d603823ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2b341364-55e1-439f-9a3b-2b2fb7ad33b7", "address": "fa:16:3e:3e:8d:2f", "network": {"id": "e6a6e8f5-448a-41d1-a833-6db7058c611c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-378111892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f701119cef78433280cbddf2adf685db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b341364-55", "ovs_interfaceid": "2b341364-55e1-439f-9a3b-2b2fb7ad33b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Converting VIF {"id": "2b341364-55e1-439f-9a3b-2b2fb7ad33b7", "address": "fa:16:3e:3e:8d:2f", "network": {"id": "e6a6e8f5-448a-41d1-a833-6db7058c611c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-378111892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f701119cef78433280cbddf2adf685db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b341364-55", "ovs_interfaceid": "2b341364-55e1-439f-9a3b-2b2fb7ad33b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:8d:2f,bridge_name='br-int',has_traffic_filtering=True,id=2b341364-55e1-439f-9a3b-2b2fb7ad33b7,network=Network(e6a6e8f5-448a-41d1-a833-6db7058c611c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b341364-55') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG os_vif [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:8d:2f,bridge_name='br-int',has_traffic_filtering=True,id=2b341364-55e1-439f-9a3b-2b2fb7ad33b7,network=Network(e6a6e8f5-448a-41d1-a833-6db7058c611c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b341364-55') {{(pid=71509) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8007140-2583-4baa-9697-5ef2f162dc6b]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2b341364-55, may_exist=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2b341364-55, col_values=(('external_ids', {'iface-id': '2b341364-55e1-439f-9a3b-2b2fb7ad33b7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3e:8d:2f', 'vm-uuid': 'a81da242-e8d8-4b41-b84a-e12d603823ca'}),)) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:19 user nova-compute[71509]: INFO os_vif [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:8d:2f,bridge_name='br-int',has_traffic_filtering=True,id=2b341364-55e1-439f-9a3b-2b2fb7ad33b7,network=Network(e6a6e8f5-448a-41d1-a833-6db7058c611c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b341364-55')
Apr 14 10:44:19 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T10:43:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1778823491',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1778823491',id=11,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHQhgKrBsUiMtMBVjIBZKP9TZIRsKtCXglQ+b+qPpSHOKxGrJsHd4CAY6Od528O1Hb16vq8TAcsw6lyU3DudugT46dzAga1vtVSJBR0oeEIq/4xyY6zaQXucI88fNYMmeg==',key_name='tempest-keypair-190287482',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f701119cef78433280cbddf2adf685db',ramdisk_id='',reservation_id='r-wllxdslz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1078203530',owner_user_name='tempest-TaggedBootDevicesTest_v242-1078203530-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T10:43:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3579ac20f8094f5a9fbd036ed05cda23',uuid=a81da242-e8d8-4b41-b84a-e12d603823ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f3e8f62b-77e2-49d5-9fd9-b75f024a4ee7", "address": "fa:16:3e:87:fe:bc", "network": {"id": "a50bebb6-d4de-4875-9553-570535dace36", "bridge": "br-int", "label": "tempest-device-tagging-net1-1002288517", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.199", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f701119cef78433280cbddf2adf685db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3e8f62b-77", "ovs_interfaceid": "f3e8f62b-77e2-49d5-9fd9-b75f024a4ee7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71509) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Converting VIF {"id": "f3e8f62b-77e2-49d5-9fd9-b75f024a4ee7", "address": "fa:16:3e:87:fe:bc", "network": {"id": "a50bebb6-d4de-4875-9553-570535dace36", "bridge": "br-int", "label": "tempest-device-tagging-net1-1002288517", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.199", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f701119cef78433280cbddf2adf685db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3e8f62b-77", "ovs_interfaceid": "f3e8f62b-77e2-49d5-9fd9-b75f024a4ee7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:fe:bc,bridge_name='br-int',has_traffic_filtering=True,id=f3e8f62b-77e2-49d5-9fd9-b75f024a4ee7,network=Network(a50bebb6-d4de-4875-9553-570535dace36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf3e8f62b-77') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG os_vif [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:fe:bc,bridge_name='br-int',has_traffic_filtering=True,id=f3e8f62b-77e2-49d5-9fd9-b75f024a4ee7,network=Network(a50bebb6-d4de-4875-9553-570535dace36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf3e8f62b-77') {{(pid=71509) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[921242b1-0b2d-492f-a8c8-76fc54117c56]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf3e8f62b-77, may_exist=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf3e8f62b-77, col_values=(('external_ids', {'iface-id': 'f3e8f62b-77e2-49d5-9fd9-b75f024a4ee7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:87:fe:bc', 'vm-uuid': 'a81da242-e8d8-4b41-b84a-e12d603823ca'}),)) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sRGbgDXN {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sRGbgDXN" returned: 0 in 0.020s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3f9405c-85cd-44f5-ad82-d47c8d0d5bbb]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sRGbgDXN'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:19 user nova-compute[71509]: INFO os_vif [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:fe:bc,bridge_name='br-int',has_traffic_filtering=True,id=f3e8f62b-77e2-49d5-9fd9-b75f024a4ee7,network=Network(a50bebb6-d4de-4875-9553-570535dace36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf3e8f62b-77')
Apr 14 10:44:19 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T10:43:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1778823491',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1778823491',id=11,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHQhgKrBsUiMtMBVjIBZKP9TZIRsKtCXglQ+b+qPpSHOKxGrJsHd4CAY6Od528O1Hb16vq8TAcsw6lyU3DudugT46dzAga1vtVSJBR0oeEIq/4xyY6zaQXucI88fNYMmeg==',key_name='tempest-keypair-190287482',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f701119cef78433280cbddf2adf685db',ramdisk_id='',reservation_id='r-wllxdslz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1078203530',owner_user_name='tempest-TaggedBootDevicesTest_v242-1078203530-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T10:43:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3579ac20f8094f5a9fbd036ed05cda23',uuid=a81da242-e8d8-4b41-b84a-e12d603823ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d2d71e67-1807-43cf-8753-7bdd77de6317", "address": "fa:16:3e:4a:86:23", "network": {"id": "a50bebb6-d4de-4875-9553-570535dace36", "bridge": "br-int", "label": "tempest-device-tagging-net1-1002288517", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.110", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f701119cef78433280cbddf2adf685db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2d71e67-18", "ovs_interfaceid": "d2d71e67-1807-43cf-8753-7bdd77de6317", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71509) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Converting VIF {"id": "d2d71e67-1807-43cf-8753-7bdd77de6317", "address": "fa:16:3e:4a:86:23", "network": {"id": "a50bebb6-d4de-4875-9553-570535dace36", "bridge": "br-int", "label": "tempest-device-tagging-net1-1002288517", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.110", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f701119cef78433280cbddf2adf685db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2d71e67-18", "ovs_interfaceid": "d2d71e67-1807-43cf-8753-7bdd77de6317", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:86:23,bridge_name='br-int',has_traffic_filtering=True,id=d2d71e67-1807-43cf-8753-7bdd77de6317,network=Network(a50bebb6-d4de-4875-9553-570535dace36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd2d71e67-18') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG os_vif [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:86:23,bridge_name='br-int',has_traffic_filtering=True,id=d2d71e67-1807-43cf-8753-7bdd77de6317,network=Network(a50bebb6-d4de-4875-9553-570535dace36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd2d71e67-18') {{(pid=71509) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd2d71e67-18, may_exist=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd2d71e67-18, col_values=(('external_ids', {'iface-id': 'd2d71e67-1807-43cf-8753-7bdd77de6317', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4a:86:23', 'vm-uuid': 'a81da242-e8d8-4b41-b84a-e12d603823ca'}),)) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[be8a38a8-2acb-4256-acd6-a2e8a6f0641b]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:19 user nova-compute[71509]: INFO os_vif [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:86:23,bridge_name='br-int',has_traffic_filtering=True,id=d2d71e67-1807-43cf-8753-7bdd77de6317,network=Network(a50bebb6-d4de-4875-9553-570535dace36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd2d71e67-18')
Apr 14 10:44:19 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T10:43:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1778823491',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1778823491',id=11,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHQhgKrBsUiMtMBVjIBZKP9TZIRsKtCXglQ+b+qPpSHOKxGrJsHd4CAY6Od528O1Hb16vq8TAcsw6lyU3DudugT46dzAga1vtVSJBR0oeEIq/4xyY6zaQXucI88fNYMmeg==',key_name='tempest-keypair-190287482',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f701119cef78433280cbddf2adf685db',ramdisk_id='',reservation_id='r-wllxdslz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1078203530',owner_user_name='tempest-TaggedBootDevicesTest_v242-1078203530-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T10:43:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3579ac20f8094f5a9fbd036ed05cda23',uuid=a81da242-e8d8-4b41-b84a-e12d603823ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c46b5082-6634-4c7f-89c1-7e58a3cd8987", "address": "fa:16:3e:5b:0c:b3", "network": {"id": "a50bebb6-d4de-4875-9553-570535dace36", "bridge": "br-int", "label": "tempest-device-tagging-net1-1002288517", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f701119cef78433280cbddf2adf685db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc46b5082-66", "ovs_interfaceid": "c46b5082-6634-4c7f-89c1-7e58a3cd8987", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Converting VIF {"id": "c46b5082-6634-4c7f-89c1-7e58a3cd8987", "address": "fa:16:3e:5b:0c:b3", "network": {"id": "a50bebb6-d4de-4875-9553-570535dace36", "bridge": "br-int", "label": "tempest-device-tagging-net1-1002288517", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f701119cef78433280cbddf2adf685db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc46b5082-66", "ovs_interfaceid": "c46b5082-6634-4c7f-89c1-7e58a3cd8987", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:0c:b3,bridge_name='br-int',has_traffic_filtering=True,id=c46b5082-6634-4c7f-89c1-7e58a3cd8987,network=Network(a50bebb6-d4de-4875-9553-570535dace36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc46b5082-66') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG os_vif [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:0c:b3,bridge_name='br-int',has_traffic_filtering=True,id=c46b5082-6634-4c7f-89c1-7e58a3cd8987,network=Network(a50bebb6-d4de-4875-9553-570535dace36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc46b5082-66') {{(pid=71509) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[d12a2a6d-3528-4584-81df-24518ba3b42c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92 (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee (non-flash)
Apr 14 10:44:19 user nova-compute[71509]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18 (non-flash)
Apr 14 10:44:19 user nova-compute[71509]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768 (non-flash)
Apr 14 10:44:19 user nova-compute[71509]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700 (non-flash)
Apr 14 10:44:19 user nova-compute[71509]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92 (non-flash)
Apr 14 10:44:19 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee (non-flash)
Apr 14 10:44:19 user nova-compute[71509]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18 (non-flash)
Apr 14 10:44:19 user nova-compute[71509]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768 (non-flash)
Apr 14 10:44:19 user nova-compute[71509]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700 (non-flash)
Apr 14 10:44:19 user nova-compute[71509]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92 (non-flash)
Apr 14 10:44:19 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171 -p 172.16.0.220:3260 --login {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc46b5082-66, may_exist=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc46b5082-66, col_values=(('external_ids', {'iface-id': 'c46b5082-6634-4c7f-89c1-7e58a3cd8987', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5b:0c:b3', 'vm-uuid': 'a81da242-e8d8-4b41-b84a-e12d603823ca'}),)) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:19 user nova-compute[71509]: INFO os_vif [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:0c:b3,bridge_name='br-int',has_traffic_filtering=True,id=c46b5082-6634-4c7f-89c1-7e58a3cd8987,network=Network(a50bebb6-d4de-4875-9553-570535dace36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc46b5082-66')
Apr 14 10:44:19 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T10:43:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1778823491',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1778823491',id=11,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHQhgKrBsUiMtMBVjIBZKP9TZIRsKtCXglQ+b+qPpSHOKxGrJsHd4CAY6Od528O1Hb16vq8TAcsw6lyU3DudugT46dzAga1vtVSJBR0oeEIq/4xyY6zaQXucI88fNYMmeg==',key_name='tempest-keypair-190287482',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f701119cef78433280cbddf2adf685db',ramdisk_id='',reservation_id='r-wllxdslz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1078203530',owner_user_name='tempest-TaggedBootDevicesTest_v242-1078203530-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T10:43:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3579ac20f8094f5a9fbd036ed05cda23',uuid=a81da242-e8d8-4b41-b84a-e12d603823ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8789c03e-397c-439a-8bc5-5d8ce5fc36ac", "address": "fa:16:3e:cf:67:ac", "network": {"id": "a50bebb6-d4de-4875-9553-570535dace36", "bridge": "br-int", "label": "tempest-device-tagging-net1-1002288517", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f701119cef78433280cbddf2adf685db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8789c03e-39", "ovs_interfaceid": "8789c03e-397c-439a-8bc5-5d8ce5fc36ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Converting VIF {"id": "8789c03e-397c-439a-8bc5-5d8ce5fc36ac", "address": "fa:16:3e:cf:67:ac", "network": {"id": "a50bebb6-d4de-4875-9553-570535dace36", "bridge": "br-int", "label": "tempest-device-tagging-net1-1002288517", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f701119cef78433280cbddf2adf685db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8789c03e-39", "ovs_interfaceid": "8789c03e-397c-439a-8bc5-5d8ce5fc36ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:67:ac,bridge_name='br-int',has_traffic_filtering=True,id=8789c03e-397c-439a-8bc5-5d8ce5fc36ac,network=Network(a50bebb6-d4de-4875-9553-570535dace36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8789c03e-39') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG os_vif [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:67:ac,bridge_name='br-int',has_traffic_filtering=True,id=8789c03e-397c-439a-8bc5-5d8ce5fc36ac,network=Network(a50bebb6-d4de-4875-9553-570535dace36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8789c03e-39') {{(pid=71509) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8789c03e-39, may_exist=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8789c03e-39, col_values=(('external_ids', {'iface-id': '8789c03e-397c-439a-8bc5-5d8ce5fc36ac', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cf:67:ac', 'vm-uuid': 'a81da242-e8d8-4b41-b84a-e12d603823ca'}),)) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[0206287e-6b18-4c89-a490-272df913a285]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171, portal: 172.16.0.220,3260]
Apr 14 10:44:19 user nova-compute[71509]: Login to [iface: default, target: iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171, portal: 172.16.0.220,3260] successful.
Apr 14 10:44:19 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9344f63-6b43-4e68-b1ad-071362f0c09c]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:19 user nova-compute[71509]: INFO os_vif [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:67:ac,bridge_name='br-int',has_traffic_filtering=True,id=8789c03e-397c-439a-8bc5-5d8ce5fc36ac,network=Network(a50bebb6-d4de-4875-9553-570535dace36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8789c03e-39')
Apr 14 10:44:19 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T10:43:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1778823491',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1778823491',id=11,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHQhgKrBsUiMtMBVjIBZKP9TZIRsKtCXglQ+b+qPpSHOKxGrJsHd4CAY6Od528O1Hb16vq8TAcsw6lyU3DudugT46dzAga1vtVSJBR0oeEIq/4xyY6zaQXucI88fNYMmeg==',key_name='tempest-keypair-190287482',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f701119cef78433280cbddf2adf685db',ramdisk_id='',reservation_id='r-wllxdslz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1078203530',owner_user_name='tempest-TaggedBootDevicesTest_v242-1078203530-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T10:43:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3579ac20f8094f5a9fbd036ed05cda23',uuid=a81da242-e8d8-4b41-b84a-e12d603823ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "84e561e8-01c6-4d50-ab37-bc64b5509e31", "address": "fa:16:3e:e1:97:d3", "network": {"id": "d6116fed-ce24-4ad4-9e8a-dfb2c1305e1c", "bridge": "br-int", "label": "tempest-device-tagging-net2-564175672", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f701119cef78433280cbddf2adf685db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84e561e8-01", "ovs_interfaceid": "84e561e8-01c6-4d50-ab37-bc64b5509e31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Converting VIF {"id": "84e561e8-01c6-4d50-ab37-bc64b5509e31", "address": "fa:16:3e:e1:97:d3", "network": {"id": "d6116fed-ce24-4ad4-9e8a-dfb2c1305e1c", "bridge": "br-int", "label": "tempest-device-tagging-net2-564175672", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f701119cef78433280cbddf2adf685db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84e561e8-01", "ovs_interfaceid": "84e561e8-01c6-4d50-ab37-bc64b5509e31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:97:d3,bridge_name='br-int',has_traffic_filtering=True,id=84e561e8-01c6-4d50-ab37-bc64b5509e31,network=Network(d6116fed-ce24-4ad4-9e8a-dfb2c1305e1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84e561e8-01') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG os_vif [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:97:d3,bridge_name='br-int',has_traffic_filtering=True,id=84e561e8-01c6-4d50-ab37-bc64b5509e31,network=Network(d6116fed-ce24-4ad4-9e8a-dfb2c1305e1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84e561e8-01') {{(pid=71509) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap84e561e8-01, may_exist=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap84e561e8-01, col_values=(('external_ids', {'iface-id': '84e561e8-01c6-4d50-ab37-bc64b5509e31', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e1:97:d3', 'vm-uuid': 'a81da242-e8d8-4b41-b84a-e12d603823ca'}),)) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7c1cdbf-b294-4d7b-8d73-914035c65094]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171 (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee (non-flash)
Apr 14 10:44:19 user nova-compute[71509]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18 (non-flash)
Apr 14 10:44:19 user nova-compute[71509]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768 (non-flash)
Apr 14 10:44:19 user nova-compute[71509]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700 (non-flash)
Apr 14 10:44:19 user nova-compute[71509]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92 (non-flash)
Apr 14 10:44:19 user nova-compute[71509]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171 (non-flash)
Apr 14 10:44:19 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee (non-flash)
Apr 14 10:44:19 user nova-compute[71509]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18 (non-flash)
Apr 14 10:44:19 user nova-compute[71509]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768 (non-flash)
Apr 14 10:44:19 user nova-compute[71509]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700 (non-flash)
Apr 14 10:44:19 user nova-compute[71509]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92 (non-flash)
Apr 14 10:44:19 user nova-compute[71509]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171 (non-flash)
Apr 14 10:44:19 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.322s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Connected to 172.16.0.220:3260 {{(pid=71509) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] HCTL ('38', '-', '-', 0) found on session 7 with lun 0 {{(pid=71509) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=71509) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:19 user nova-compute[71509]: INFO os_vif [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:97:d3,bridge_name='br-int',has_traffic_filtering=True,id=84e561e8-01c6-4d50-ab37-bc64b5509e31,network=Network(d6116fed-ce24-4ad4-9e8a-dfb2c1305e1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84e561e8-01')
Apr 14 10:44:19 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T10:43:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1778823491',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1778823491',id=11,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHQhgKrBsUiMtMBVjIBZKP9TZIRsKtCXglQ+b+qPpSHOKxGrJsHd4CAY6Od528O1Hb16vq8TAcsw6lyU3DudugT46dzAga1vtVSJBR0oeEIq/4xyY6zaQXucI88fNYMmeg==',key_name='tempest-keypair-190287482',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f701119cef78433280cbddf2adf685db',ramdisk_id='',reservation_id='r-wllxdslz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1078203530',owner_user_name='tempest-TaggedBootDevicesTest_v242-1078203530-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T10:43:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3579ac20f8094f5a9fbd036ed05cda23',uuid=a81da242-e8d8-4b41-b84a-e12d603823ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "717e6c20-676e-40f2-b4c1-47ca0f3e6f22", "address": "fa:16:3e:bf:a5:40", "network": {"id": "d6116fed-ce24-4ad4-9e8a-dfb2c1305e1c", "bridge": "br-int", "label": "tempest-device-tagging-net2-564175672", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f701119cef78433280cbddf2adf685db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap717e6c20-67", "ovs_interfaceid": "717e6c20-676e-40f2-b4c1-47ca0f3e6f22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Converting VIF {"id": "717e6c20-676e-40f2-b4c1-47ca0f3e6f22", "address": "fa:16:3e:bf:a5:40", "network": {"id": "d6116fed-ce24-4ad4-9e8a-dfb2c1305e1c", "bridge": "br-int", "label": "tempest-device-tagging-net2-564175672", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f701119cef78433280cbddf2adf685db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap717e6c20-67", "ovs_interfaceid": "717e6c20-676e-40f2-b4c1-47ca0f3e6f22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:a5:40,bridge_name='br-int',has_traffic_filtering=True,id=717e6c20-676e-40f2-b4c1-47ca0f3e6f22,network=Network(d6116fed-ce24-4ad4-9e8a-dfb2c1305e1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap717e6c20-67') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG os_vif [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:a5:40,bridge_name='br-int',has_traffic_filtering=True,id=717e6c20-676e-40f2-b4c1-47ca0f3e6f22,network=Network(d6116fed-ce24-4ad4-9e8a-dfb2c1305e1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap717e6c20-67') {{(pid=71509) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap717e6c20-67, may_exist=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap717e6c20-67, col_values=(('external_ids', {'iface-id': '717e6c20-676e-40f2-b4c1-47ca0f3e6f22', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bf:a5:40', 'vm-uuid': 'a81da242-e8d8-4b41-b84a-e12d603823ca'}),)) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.043s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dd04ba9-5b95-42ca-951a-3c9032b21e9a]: (4, ('- - 0', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Searching for a device in session 7 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=71509) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sRGbgDXN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71509) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:19 user nova-compute[71509]: INFO os_vif [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:a5:40,bridge_name='br-int',has_traffic_filtering=True,id=717e6c20-676e-40f2-b4c1-47ca0f3e6f22,network=Network(d6116fed-ce24-4ad4-9e8a-dfb2c1305e1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap717e6c20-67')
Apr 14 10:44:19 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] No BDM found with device name hda, not building metadata. {{(pid=71509) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71509) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] No VIF found with MAC fa:16:3e:3e:8d:2f, not building metadata {{(pid=71509) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] No VIF found with MAC fa:16:3e:cf:67:ac, not building metadata {{(pid=71509) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 10:44:19 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Using config drive
Apr 14 10:44:19 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Creating config drive at /opt/stack/data/nova/instances/a81da242-e8d8-4b41-b84a-e12d603823ca/disk.config
Apr 14 10:44:19 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/a81da242-e8d8-4b41-b84a-e12d603823ca/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpytdnlo6c {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:19 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/a81da242-e8d8-4b41-b84a-e12d603823ca/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpytdnlo6c" returned: 0 in 0.070s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:44:20 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.386s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 10:44:20 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] <== connect_volume: return (2703ms) {'type': 'block', 'scsi_wwn': '26435646162653430', 'path': '/dev/sdg'} {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 10:44:20 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26435646162653430', 'path': '/dev/sdg'} {{(pid=71509) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 10:44:20 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Calling os-brick to attach iSCSI Volume {{(pid=71509) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 10:44:20 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0bf0749390>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jasETYwQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 10:44:20 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 10:44:20 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 10:44:20 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 10:44:20 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 10:44:20 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 10:44:20 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 10:44:20 user nova-compute[71509]: INFO os_brick.initiator.connectors.iscsi [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 10:44:20 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e -p 172.16.0.220:3260 {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:20 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:44:20 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[682c2765-097b-45d6-a741-d3890980ea88]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:44:20 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 10:44:20 user nova-compute[71509]:  {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:44:20 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e -p 172.16.0.220:3260 --interface default --op new {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:20 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:44:20 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[afd53310-d97d-4c01-9164-1de897ad61d1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e] added\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:44:20 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e] added
Apr 14 10:44:20 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:44:20 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:20 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:44:20 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[9290b620-45b3-4124-b59d-b989723a8f9b]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:44:20 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:44:20 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:20 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:44:20 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[83b41abb-872f-432a-a654-0818ac0ca7e6]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:44:20 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:44:20 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jasETYwQ {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:20 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jasETYwQ" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:44:20 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[e11e63ed-b343-4ee4-9d7a-b355a43da8e2]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:44:20 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jasETYwQ'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:44:20 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:20 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:44:20 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b018990-a30d-4de7-828a-053e022b8077]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:44:20 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:44:20 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:20 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:44:20 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[af737296-8b18-4702-ac38-131d70143c2f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171 (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:44:20 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee (non-flash)
Apr 14 10:44:20 user nova-compute[71509]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18 (non-flash)
Apr 14 10:44:20 user nova-compute[71509]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768 (non-flash)
Apr 14 10:44:20 user nova-compute[71509]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700 (non-flash)
Apr 14 10:44:20 user nova-compute[71509]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92 (non-flash)
Apr 14 10:44:20 user nova-compute[71509]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171 (non-flash)
Apr 14 10:44:20 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:44:20 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee (non-flash)
Apr 14 10:44:20 user nova-compute[71509]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18 (non-flash)
Apr 14 10:44:20 user nova-compute[71509]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768 (non-flash)
Apr 14 10:44:20 user nova-compute[71509]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700 (non-flash)
Apr 14 10:44:20 user nova-compute[71509]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92 (non-flash)
Apr 14 10:44:20 user nova-compute[71509]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171 (non-flash)
Apr 14 10:44:20 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 10:44:20 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e -p 172.16.0.220:3260 --login {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:20 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:44:20 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfc9c0e2-248a-4121-823f-de24b6fcc1c0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:44:20 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e, portal: 172.16.0.220,3260]
Apr 14 10:44:20 user nova-compute[71509]: Login to [iface: default, target: iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e, portal: 172.16.0.220,3260] successful.
Apr 14 10:44:20 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:44:20 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:20 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:44:20 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c8d1ec0-9121-443f-826f-ebbd9893cca6]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:44:20 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:44:20 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:20 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:44:20 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[28fb906e-b999-4c50-a968-38c5bf06f341]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:44:20 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee (non-flash)
Apr 14 10:44:20 user nova-compute[71509]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18 (non-flash)
Apr 14 10:44:20 user nova-compute[71509]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768 (non-flash)
Apr 14 10:44:20 user nova-compute[71509]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700 (non-flash)
Apr 14 10:44:20 user nova-compute[71509]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92 (non-flash)
Apr 14 10:44:20 user nova-compute[71509]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171 (non-flash)
Apr 14 10:44:20 user nova-compute[71509]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e (non-flash)
Apr 14 10:44:20 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:44:20 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee (non-flash)
Apr 14 10:44:20 user nova-compute[71509]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18 (non-flash)
Apr 14 10:44:20 user nova-compute[71509]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768 (non-flash)
Apr 14 10:44:20 user nova-compute[71509]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700 (non-flash)
Apr 14 10:44:20 user nova-compute[71509]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92 (non-flash)
Apr 14 10:44:20 user nova-compute[71509]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171 (non-flash)
Apr 14 10:44:20 user nova-compute[71509]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e (non-flash)
Apr 14 10:44:20 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 10:44:20 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.300s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 10:44:20 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Connected to 172.16.0.220:3260 {{(pid=71509) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 10:44:20 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] HCTL ('39', '-', '-', 0) found on session 8 with lun 0 {{(pid=71509) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 10:44:20 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=71509) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 10:44:20 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:20 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.017s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:44:20 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5caa233-2e0c-40a2-9926-b777ab941a93]: (4, ('- - 0', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:44:20 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Searching for a device in session 8 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=71509) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 10:44:20 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jasETYwQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71509) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 10:44:21 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:21 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:21 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:21 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:21 user nova-compute[71509]: DEBUG nova.compute.manager [req-bc9f0f37-0ce0-44f9-bf39-8af96d2420e1 req-0011cbbe-dbfe-4b71-8295-0a7e1eb53e4c service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Received event network-vif-plugged-2b341364-55e1-439f-9a3b-2b2fb7ad33b7 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:44:21 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-bc9f0f37-0ce0-44f9-bf39-8af96d2420e1 req-0011cbbe-dbfe-4b71-8295-0a7e1eb53e4c service nova] Acquiring lock "a81da242-e8d8-4b41-b84a-e12d603823ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:44:21 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-bc9f0f37-0ce0-44f9-bf39-8af96d2420e1 req-0011cbbe-dbfe-4b71-8295-0a7e1eb53e4c service nova] Lock "a81da242-e8d8-4b41-b84a-e12d603823ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:44:21 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-bc9f0f37-0ce0-44f9-bf39-8af96d2420e1 req-0011cbbe-dbfe-4b71-8295-0a7e1eb53e4c service nova] Lock "a81da242-e8d8-4b41-b84a-e12d603823ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:44:21 user nova-compute[71509]: DEBUG nova.compute.manager [req-bc9f0f37-0ce0-44f9-bf39-8af96d2420e1 req-0011cbbe-dbfe-4b71-8295-0a7e1eb53e4c service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] No waiting events found dispatching network-vif-plugged-2b341364-55e1-439f-9a3b-2b2fb7ad33b7 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:44:21 user nova-compute[71509]: WARNING nova.compute.manager [req-bc9f0f37-0ce0-44f9-bf39-8af96d2420e1 req-0011cbbe-dbfe-4b71-8295-0a7e1eb53e4c service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Received unexpected event network-vif-plugged-2b341364-55e1-439f-9a3b-2b2fb7ad33b7 for instance with vm_state building and task_state spawning.
Apr 14 10:44:21 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:21 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:21 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:21 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:21 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.334s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 10:44:21 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] <== connect_volume: return (1336ms) {'type': 'block', 'scsi_wwn': '23563623737323135', 'path': '/dev/sdh'} {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 10:44:21 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23563623737323135', 'path': '/dev/sdh'} {{(pid=71509) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 10:44:21 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T10:43:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1636555058',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1636555058',id=12,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFiuA4lBJVtYfiy/p87uKYDDoanpcxZLwOKehEbraw8DqN/tSzDkhXnQCUYZYSydWf6HuXl2lM5q4KKhfjVIPIOpfWr+UnggY0Ln4rrMx5Z5ebIqfaJVvJquUpb7gfFk/w==',key_name='tempest-keypair-1957800049',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0e024f5a578e4543a02c6adc7d456f39',ramdisk_id='',reservation_id='r-rufirbfe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-656117710',owner_user_name='tempest-TaggedBootDevicesTest-656117710-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T10:43:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f6dac34303f4965babaee39bb363b5e',uuid=d1516acc-354e-41f6-a639-61dea870b11e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2a2ef05a-2d58-4cdf-ab6c-35df823a68bc", "address": "fa:16:3e:ad:4e:cf", "network": {"id": "3c95a463-71cf-446f-8214-5f52f2da54b7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-325252986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e024f5a578e4543a02c6adc7d456f39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a2ef05a-2d", "ovs_interfaceid": "2a2ef05a-2d58-4cdf-ab6c-35df823a68bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71509) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 10:44:21 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Converting VIF {"id": "2a2ef05a-2d58-4cdf-ab6c-35df823a68bc", "address": "fa:16:3e:ad:4e:cf", "network": {"id": "3c95a463-71cf-446f-8214-5f52f2da54b7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-325252986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e024f5a578e4543a02c6adc7d456f39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a2ef05a-2d", "ovs_interfaceid": "2a2ef05a-2d58-4cdf-ab6c-35df823a68bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:44:21 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:4e:cf,bridge_name='br-int',has_traffic_filtering=True,id=2a2ef05a-2d58-4cdf-ab6c-35df823a68bc,network=Network(3c95a463-71cf-446f-8214-5f52f2da54b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a2ef05a-2d') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:44:21 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T10:43:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1636555058',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1636555058',id=12,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFiuA4lBJVtYfiy/p87uKYDDoanpcxZLwOKehEbraw8DqN/tSzDkhXnQCUYZYSydWf6HuXl2lM5q4KKhfjVIPIOpfWr+UnggY0Ln4rrMx5Z5ebIqfaJVvJquUpb7gfFk/w==',key_name='tempest-keypair-1957800049',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0e024f5a578e4543a02c6adc7d456f39',ramdisk_id='',reservation_id='r-rufirbfe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-656117710',owner_user_name='tempest-TaggedBootDevicesTest-656117710-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T10:43:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f6dac34303f4965babaee39bb363b5e',uuid=d1516acc-354e-41f6-a639-61dea870b11e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "23214923-0217-4046-9a68-675f2ee8e42d", "address": "fa:16:3e:8a:5a:1a", "network": {"id": "bb8c5688-db8f-47c0-a2b5-0a44d2f97461", "bridge": "br-int", "label": "tempest-device-tagging-net1-527368946", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e024f5a578e4543a02c6adc7d456f39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23214923-02", "ovs_interfaceid": "23214923-0217-4046-9a68-675f2ee8e42d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71509) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 10:44:21 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Converting VIF {"id": "23214923-0217-4046-9a68-675f2ee8e42d", "address": "fa:16:3e:8a:5a:1a", "network": {"id": "bb8c5688-db8f-47c0-a2b5-0a44d2f97461", "bridge": "br-int", "label": "tempest-device-tagging-net1-527368946", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e024f5a578e4543a02c6adc7d456f39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23214923-02", "ovs_interfaceid": "23214923-0217-4046-9a68-675f2ee8e42d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:44:21 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:5a:1a,bridge_name='br-int',has_traffic_filtering=True,id=23214923-0217-4046-9a68-675f2ee8e42d,network=Network(bb8c5688-db8f-47c0-a2b5-0a44d2f97461),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap23214923-02') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:44:21 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T10:43:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1636555058',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1636555058',id=12,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFiuA4lBJVtYfiy/p87uKYDDoanpcxZLwOKehEbraw8DqN/tSzDkhXnQCUYZYSydWf6HuXl2lM5q4KKhfjVIPIOpfWr+UnggY0Ln4rrMx5Z5ebIqfaJVvJquUpb7gfFk/w==',key_name='tempest-keypair-1957800049',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0e024f5a578e4543a02c6adc7d456f39',ramdisk_id='',reservation_id='r-rufirbfe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-656117710',owner_user_name='tempest-TaggedBootDevicesTest-656117710-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T10:43:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f6dac34303f4965babaee39bb363b5e',uuid=d1516acc-354e-41f6-a639-61dea870b11e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7f7db929-b2fd-4242-9d23-5d58a374f961", "address": "fa:16:3e:28:88:b4", "network": {"id": "bb8c5688-db8f-47c0-a2b5-0a44d2f97461", "bridge": "br-int", "label": "tempest-device-tagging-net1-527368946", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e024f5a578e4543a02c6adc7d456f39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f7db929-b2", "ovs_interfaceid": "7f7db929-b2fd-4242-9d23-5d58a374f961", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71509) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 10:44:21 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Converting VIF {"id": "7f7db929-b2fd-4242-9d23-5d58a374f961", "address": "fa:16:3e:28:88:b4", "network": {"id": "bb8c5688-db8f-47c0-a2b5-0a44d2f97461", "bridge": "br-int", "label": "tempest-device-tagging-net1-527368946", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e024f5a578e4543a02c6adc7d456f39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f7db929-b2", "ovs_interfaceid": "7f7db929-b2fd-4242-9d23-5d58a374f961", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:44:21 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:88:b4,bridge_name='br-int',has_traffic_filtering=True,id=7f7db929-b2fd-4242-9d23-5d58a374f961,network=Network(bb8c5688-db8f-47c0-a2b5-0a44d2f97461),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7f7db929-b2') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:44:21 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T10:43:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1636555058',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1636555058',id=12,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFiuA4lBJVtYfiy/p87uKYDDoanpcxZLwOKehEbraw8DqN/tSzDkhXnQCUYZYSydWf6HuXl2lM5q4KKhfjVIPIOpfWr+UnggY0Ln4rrMx5Z5ebIqfaJVvJquUpb7gfFk/w==',key_name='tempest-keypair-1957800049',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0e024f5a578e4543a02c6adc7d456f39',ramdisk_id='',reservation_id='r-rufirbfe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-656117710',owner_user_name='tempest-TaggedBootDevicesTest-656117710-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T10:43:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f6dac34303f4965babaee39bb363b5e',uuid=d1516acc-354e-41f6-a639-61dea870b11e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4d65e4a1-4cea-4636-8ad8-21065de3c747", "address": "fa:16:3e:c2:1b:8c", "network": {"id": "bb8c5688-db8f-47c0-a2b5-0a44d2f97461", "bridge": "br-int", "label": "tempest-device-tagging-net1-527368946", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e024f5a578e4543a02c6adc7d456f39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d65e4a1-4c", "ovs_interfaceid": "4d65e4a1-4cea-4636-8ad8-21065de3c747", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71509) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 10:44:21 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Converting VIF {"id": "4d65e4a1-4cea-4636-8ad8-21065de3c747", "address": "fa:16:3e:c2:1b:8c", "network": {"id": "bb8c5688-db8f-47c0-a2b5-0a44d2f97461", "bridge": "br-int", "label": "tempest-device-tagging-net1-527368946", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e024f5a578e4543a02c6adc7d456f39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d65e4a1-4c", "ovs_interfaceid": "4d65e4a1-4cea-4636-8ad8-21065de3c747", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:44:21 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:1b:8c,bridge_name='br-int',has_traffic_filtering=True,id=4d65e4a1-4cea-4636-8ad8-21065de3c747,network=Network(bb8c5688-db8f-47c0-a2b5-0a44d2f97461),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d65e4a1-4c') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:44:21 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T10:43:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1636555058',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1636555058',id=12,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFiuA4lBJVtYfiy/p87uKYDDoanpcxZLwOKehEbraw8DqN/tSzDkhXnQCUYZYSydWf6HuXl2lM5q4KKhfjVIPIOpfWr+UnggY0Ln4rrMx5Z5ebIqfaJVvJquUpb7gfFk/w==',key_name='tempest-keypair-1957800049',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0e024f5a578e4543a02c6adc7d456f39',ramdisk_id='',reservation_id='r-rufirbfe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-656117710',owner_user_name='tempest-TaggedBootDevicesTest-656117710-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T10:43:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f6dac34303f4965babaee39bb363b5e',uuid=d1516acc-354e-41f6-a639-61dea870b11e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d70f6f4d-f2bc-4d5e-9e98-a0daa1b35a0f", "address": "fa:16:3e:64:ce:c5", "network": {"id": "bb8c5688-db8f-47c0-a2b5-0a44d2f97461", "bridge": "br-int", "label": "tempest-device-tagging-net1-527368946", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e024f5a578e4543a02c6adc7d456f39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd70f6f4d-f2", "ovs_interfaceid": "d70f6f4d-f2bc-4d5e-9e98-a0daa1b35a0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71509) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 10:44:21 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Converting VIF {"id": "d70f6f4d-f2bc-4d5e-9e98-a0daa1b35a0f", "address": "fa:16:3e:64:ce:c5", "network": {"id": "bb8c5688-db8f-47c0-a2b5-0a44d2f97461", "bridge": "br-int", "label": "tempest-device-tagging-net1-527368946", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e024f5a578e4543a02c6adc7d456f39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd70f6f4d-f2", "ovs_interfaceid": "d70f6f4d-f2bc-4d5e-9e98-a0daa1b35a0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:44:21 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:ce:c5,bridge_name='br-int',has_traffic_filtering=True,id=d70f6f4d-f2bc-4d5e-9e98-a0daa1b35a0f,network=Network(bb8c5688-db8f-47c0-a2b5-0a44d2f97461),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd70f6f4d-f2') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:44:21 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T10:43:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1636555058',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1636555058',id=12,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFiuA4lBJVtYfiy/p87uKYDDoanpcxZLwOKehEbraw8DqN/tSzDkhXnQCUYZYSydWf6HuXl2lM5q4KKhfjVIPIOpfWr+UnggY0Ln4rrMx5Z5ebIqfaJVvJquUpb7gfFk/w==',key_name='tempest-keypair-1957800049',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0e024f5a578e4543a02c6adc7d456f39',ramdisk_id='',reservation_id='r-rufirbfe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-656117710',owner_user_name='tempest-TaggedBootDevicesTest-656117710-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T10:43:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f6dac34303f4965babaee39bb363b5e',uuid=d1516acc-354e-41f6-a639-61dea870b11e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "328d2b64-7bc6-425a-b3a4-8cda754ffd56", "address": "fa:16:3e:a6:55:10", "network": {"id": "1c6521c7-7280-4952-b1bc-a3aa0918e27c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1095863542", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e024f5a578e4543a02c6adc7d456f39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap328d2b64-7b", "ovs_interfaceid": "328d2b64-7bc6-425a-b3a4-8cda754ffd56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71509) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 10:44:21 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Converting VIF {"id": "328d2b64-7bc6-425a-b3a4-8cda754ffd56", "address": "fa:16:3e:a6:55:10", "network": {"id": "1c6521c7-7280-4952-b1bc-a3aa0918e27c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1095863542", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e024f5a578e4543a02c6adc7d456f39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap328d2b64-7b", "ovs_interfaceid": "328d2b64-7bc6-425a-b3a4-8cda754ffd56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:44:21 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:55:10,bridge_name='br-int',has_traffic_filtering=True,id=328d2b64-7bc6-425a-b3a4-8cda754ffd56,network=Network(1c6521c7-7280-4952-b1bc-a3aa0918e27c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap328d2b64-7b') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:44:21 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T10:43:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1636555058',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1636555058',id=12,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFiuA4lBJVtYfiy/p87uKYDDoanpcxZLwOKehEbraw8DqN/tSzDkhXnQCUYZYSydWf6HuXl2lM5q4KKhfjVIPIOpfWr+UnggY0Ln4rrMx5Z5ebIqfaJVvJquUpb7gfFk/w==',key_name='tempest-keypair-1957800049',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0e024f5a578e4543a02c6adc7d456f39',ramdisk_id='',reservation_id='r-rufirbfe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-656117710',owner_user_name='tempest-TaggedBootDevicesTest-656117710-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T10:43:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f6dac34303f4965babaee39bb363b5e',uuid=d1516acc-354e-41f6-a639-61dea870b11e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6e295a29-0297-49c0-9298-7d3a41a07585", "address": "fa:16:3e:32:10:a4", "network": {"id": "1c6521c7-7280-4952-b1bc-a3aa0918e27c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1095863542", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e024f5a578e4543a02c6adc7d456f39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e295a29-02", "ovs_interfaceid": "6e295a29-0297-49c0-9298-7d3a41a07585", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71509) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 10:44:21 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Converting VIF {"id": "6e295a29-0297-49c0-9298-7d3a41a07585", "address": "fa:16:3e:32:10:a4", "network": {"id": "1c6521c7-7280-4952-b1bc-a3aa0918e27c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1095863542", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e024f5a578e4543a02c6adc7d456f39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e295a29-02", "ovs_interfaceid": "6e295a29-0297-49c0-9298-7d3a41a07585", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:44:21 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:10:a4,bridge_name='br-int',has_traffic_filtering=True,id=6e295a29-0297-49c0-9298-7d3a41a07585,network=Network(1c6521c7-7280-4952-b1bc-a3aa0918e27c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e295a29-02') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:44:21 user nova-compute[71509]: DEBUG nova.objects.instance [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Lazy-loading 'pci_devices' on Instance uuid d1516acc-354e-41f6-a639-61dea870b11e {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:44:21 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] [instance: d1516acc-354e-41f6-a639-61dea870b11e] End _get_guest_xml xml=<domain type="kvm">
Apr 14 10:44:21 user nova-compute[71509]:   <uuid>d1516acc-354e-41f6-a639-61dea870b11e</uuid>
Apr 14 10:44:21 user nova-compute[71509]:   <name>instance-0000000c</name>
Apr 14 10:44:21 user nova-compute[71509]:   <memory>131072</memory>
Apr 14 10:44:21 user nova-compute[71509]:   <vcpu>1</vcpu>
Apr 14 10:44:21 user nova-compute[71509]:   <metadata>
Apr 14 10:44:21 user nova-compute[71509]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 10:44:21 user nova-compute[71509]:       <nova:package version="0.0.0"/>
Apr 14 10:44:21 user nova-compute[71509]:       <nova:name>tempest-device-tagging-server-1636555058</nova:name>
Apr 14 10:44:21 user nova-compute[71509]:       <nova:creationTime>2023-04-14 10:44:15</nova:creationTime>
Apr 14 10:44:21 user nova-compute[71509]:       <nova:flavor name="m1.nano">
Apr 14 10:44:21 user nova-compute[71509]:         <nova:memory>128</nova:memory>
Apr 14 10:44:21 user nova-compute[71509]:         <nova:disk>1</nova:disk>
Apr 14 10:44:21 user nova-compute[71509]:         <nova:swap>0</nova:swap>
Apr 14 10:44:21 user nova-compute[71509]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 10:44:21 user nova-compute[71509]:         <nova:vcpus>1</nova:vcpus>
Apr 14 10:44:21 user nova-compute[71509]:       </nova:flavor>
Apr 14 10:44:21 user nova-compute[71509]:       <nova:owner>
Apr 14 10:44:21 user nova-compute[71509]:         <nova:user uuid="1f6dac34303f4965babaee39bb363b5e">tempest-TaggedBootDevicesTest-656117710-project-member</nova:user>
Apr 14 10:44:21 user nova-compute[71509]:         <nova:project uuid="0e024f5a578e4543a02c6adc7d456f39">tempest-TaggedBootDevicesTest-656117710</nova:project>
Apr 14 10:44:21 user nova-compute[71509]:       </nova:owner>
Apr 14 10:44:21 user nova-compute[71509]:       <nova:root type="image" uuid="048ec0ee-0465-448d-8b4c-f072acb101dc"/>
Apr 14 10:44:21 user nova-compute[71509]:       <nova:ports>
Apr 14 10:44:21 user nova-compute[71509]:         <nova:port uuid="2a2ef05a-2d58-4cdf-ab6c-35df823a68bc">
Apr 14 10:44:21 user nova-compute[71509]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 14 10:44:21 user nova-compute[71509]:         </nova:port>
Apr 14 10:44:21 user nova-compute[71509]:         <nova:port uuid="23214923-0217-4046-9a68-675f2ee8e42d">
Apr 14 10:44:21 user nova-compute[71509]:           <nova:ip type="fixed" address="10.1.1.48" ipVersion="4"/>
Apr 14 10:44:21 user nova-compute[71509]:         </nova:port>
Apr 14 10:44:21 user nova-compute[71509]:         <nova:port uuid="7f7db929-b2fd-4242-9d23-5d58a374f961">
Apr 14 10:44:21 user nova-compute[71509]:           <nova:ip type="fixed" address="10.1.1.56" ipVersion="4"/>
Apr 14 10:44:21 user nova-compute[71509]:         </nova:port>
Apr 14 10:44:21 user nova-compute[71509]:         <nova:port uuid="4d65e4a1-4cea-4636-8ad8-21065de3c747">
Apr 14 10:44:21 user nova-compute[71509]:           <nova:ip type="fixed" address="10.1.1.17" ipVersion="4"/>
Apr 14 10:44:21 user nova-compute[71509]:         </nova:port>
Apr 14 10:44:21 user nova-compute[71509]:         <nova:port uuid="d70f6f4d-f2bc-4d5e-9e98-a0daa1b35a0f">
Apr 14 10:44:21 user nova-compute[71509]:           <nova:ip type="fixed" address="10.1.1.163" ipVersion="4"/>
Apr 14 10:44:21 user nova-compute[71509]:         </nova:port>
Apr 14 10:44:21 user nova-compute[71509]:         <nova:port uuid="328d2b64-7bc6-425a-b3a4-8cda754ffd56">
Apr 14 10:44:21 user nova-compute[71509]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Apr 14 10:44:21 user nova-compute[71509]:         </nova:port>
Apr 14 10:44:21 user nova-compute[71509]:         <nova:port uuid="6e295a29-0297-49c0-9298-7d3a41a07585">
Apr 14 10:44:21 user nova-compute[71509]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Apr 14 10:44:21 user nova-compute[71509]:         </nova:port>
Apr 14 10:44:21 user nova-compute[71509]:       </nova:ports>
Apr 14 10:44:21 user nova-compute[71509]:     </nova:instance>
Apr 14 10:44:21 user nova-compute[71509]:   </metadata>
Apr 14 10:44:21 user nova-compute[71509]:   <sysinfo type="smbios">
Apr 14 10:44:21 user nova-compute[71509]:     <system>
Apr 14 10:44:21 user nova-compute[71509]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 10:44:21 user nova-compute[71509]:       <entry name="product">OpenStack Nova</entry>
Apr 14 10:44:21 user nova-compute[71509]:       <entry name="version">0.0.0</entry>
Apr 14 10:44:21 user nova-compute[71509]:       <entry name="serial">d1516acc-354e-41f6-a639-61dea870b11e</entry>
Apr 14 10:44:21 user nova-compute[71509]:       <entry name="uuid">d1516acc-354e-41f6-a639-61dea870b11e</entry>
Apr 14 10:44:21 user nova-compute[71509]:       <entry name="family">Virtual Machine</entry>
Apr 14 10:44:21 user nova-compute[71509]:     </system>
Apr 14 10:44:21 user nova-compute[71509]:   </sysinfo>
Apr 14 10:44:21 user nova-compute[71509]:   <os>
Apr 14 10:44:21 user nova-compute[71509]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 10:44:21 user nova-compute[71509]:     <boot dev="hd"/>
Apr 14 10:44:21 user nova-compute[71509]:     <smbios mode="sysinfo"/>
Apr 14 10:44:21 user nova-compute[71509]:   </os>
Apr 14 10:44:21 user nova-compute[71509]:   <features>
Apr 14 10:44:21 user nova-compute[71509]:     <acpi/>
Apr 14 10:44:21 user nova-compute[71509]:     <apic/>
Apr 14 10:44:21 user nova-compute[71509]:     <vmcoreinfo/>
Apr 14 10:44:21 user nova-compute[71509]:   </features>
Apr 14 10:44:21 user nova-compute[71509]:   <clock offset="utc">
Apr 14 10:44:21 user nova-compute[71509]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 10:44:21 user nova-compute[71509]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 10:44:21 user nova-compute[71509]:     <timer name="hpet" present="no"/>
Apr 14 10:44:21 user nova-compute[71509]:   </clock>
Apr 14 10:44:21 user nova-compute[71509]:   <cpu mode="custom" match="exact">
Apr 14 10:44:21 user nova-compute[71509]:     <model>Nehalem</model>
Apr 14 10:44:21 user nova-compute[71509]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 10:44:21 user nova-compute[71509]:   </cpu>
Apr 14 10:44:21 user nova-compute[71509]:   <devices>
Apr 14 10:44:21 user nova-compute[71509]:     <disk type="file" device="cdrom">
Apr 14 10:44:21 user nova-compute[71509]:       <driver name="qemu" type="raw" cache="none"/>
Apr 14 10:44:21 user nova-compute[71509]:       <source file="/opt/stack/data/nova/instances/d1516acc-354e-41f6-a639-61dea870b11e/disk.config"/>
Apr 14 10:44:21 user nova-compute[71509]:       <target dev="hda" bus="ide"/>
Apr 14 10:44:21 user nova-compute[71509]:     </disk>
Apr 14 10:44:21 user nova-compute[71509]:     <disk type="block" device="disk">
Apr 14 10:44:21 user nova-compute[71509]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 10:44:21 user nova-compute[71509]:       <source dev="/dev/sde"/>
Apr 14 10:44:21 user nova-compute[71509]:       <target dev="vda" bus="virtio"/>
Apr 14 10:44:21 user nova-compute[71509]:       <serial>146f2d89-f831-40b0-a5cd-75a2761fb700</serial>
Apr 14 10:44:21 user nova-compute[71509]:     </disk>
Apr 14 10:44:21 user nova-compute[71509]:     <disk type="block" device="disk">
Apr 14 10:44:21 user nova-compute[71509]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 10:44:21 user nova-compute[71509]:       <source dev="/dev/sdg"/>
Apr 14 10:44:21 user nova-compute[71509]:       <target dev="vdb" bus="virtio"/>
Apr 14 10:44:21 user nova-compute[71509]:       <serial>a80b10a6-3148-4db6-842e-f343407b1171</serial>
Apr 14 10:44:21 user nova-compute[71509]:     </disk>
Apr 14 10:44:21 user nova-compute[71509]:     <disk type="block" device="disk">
Apr 14 10:44:21 user nova-compute[71509]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 10:44:21 user nova-compute[71509]:       <source dev="/dev/sdh"/>
Apr 14 10:44:21 user nova-compute[71509]:       <target dev="vdc" bus="virtio"/>
Apr 14 10:44:21 user nova-compute[71509]:       <serial>0d1e04e5-b8c3-4127-b22f-5535d2d28e7e</serial>
Apr 14 10:44:21 user nova-compute[71509]:     </disk>
Apr 14 10:44:21 user nova-compute[71509]:     <interface type="ethernet">
Apr 14 10:44:21 user nova-compute[71509]:       <mac address="fa:16:3e:ad:4e:cf"/>
Apr 14 10:44:21 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 10:44:21 user nova-compute[71509]:       <mtu size="1442"/>
Apr 14 10:44:21 user nova-compute[71509]:       <target dev="tap2a2ef05a-2d"/>
Apr 14 10:44:21 user nova-compute[71509]:     </interface>
Apr 14 10:44:21 user nova-compute[71509]:     <interface type="ethernet">
Apr 14 10:44:21 user nova-compute[71509]:       <mac address="fa:16:3e:8a:5a:1a"/>
Apr 14 10:44:21 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 10:44:21 user nova-compute[71509]:       <mtu size="1442"/>
Apr 14 10:44:21 user nova-compute[71509]:       <target dev="tap23214923-02"/>
Apr 14 10:44:21 user nova-compute[71509]:     </interface>
Apr 14 10:44:21 user nova-compute[71509]:     <interface type="ethernet">
Apr 14 10:44:21 user nova-compute[71509]:       <mac address="fa:16:3e:28:88:b4"/>
Apr 14 10:44:21 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 10:44:21 user nova-compute[71509]:       <mtu size="1442"/>
Apr 14 10:44:21 user nova-compute[71509]:       <target dev="tap7f7db929-b2"/>
Apr 14 10:44:21 user nova-compute[71509]:     </interface>
Apr 14 10:44:21 user nova-compute[71509]:     <interface type="ethernet">
Apr 14 10:44:21 user nova-compute[71509]:       <mac address="fa:16:3e:c2:1b:8c"/>
Apr 14 10:44:21 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 10:44:21 user nova-compute[71509]:       <mtu size="1442"/>
Apr 14 10:44:21 user nova-compute[71509]:       <target dev="tap4d65e4a1-4c"/>
Apr 14 10:44:21 user nova-compute[71509]:     </interface>
Apr 14 10:44:21 user nova-compute[71509]:     <interface type="ethernet">
Apr 14 10:44:21 user nova-compute[71509]:       <mac address="fa:16:3e:64:ce:c5"/>
Apr 14 10:44:21 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 10:44:21 user nova-compute[71509]:       <mtu size="1442"/>
Apr 14 10:44:21 user nova-compute[71509]:       <target dev="tapd70f6f4d-f2"/>
Apr 14 10:44:21 user nova-compute[71509]:     </interface>
Apr 14 10:44:21 user nova-compute[71509]:     <interface type="ethernet">
Apr 14 10:44:21 user nova-compute[71509]:       <mac address="fa:16:3e:a6:55:10"/>
Apr 14 10:44:21 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 10:44:21 user nova-compute[71509]:       <mtu size="1442"/>
Apr 14 10:44:21 user nova-compute[71509]:       <target dev="tap328d2b64-7b"/>
Apr 14 10:44:21 user nova-compute[71509]:     </interface>
Apr 14 10:44:21 user nova-compute[71509]:     <interface type="ethernet">
Apr 14 10:44:21 user nova-compute[71509]:       <mac address="fa:16:3e:32:10:a4"/>
Apr 14 10:44:21 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 10:44:21 user nova-compute[71509]:       <mtu size="1442"/>
Apr 14 10:44:21 user nova-compute[71509]:       <target dev="tap6e295a29-02"/>
Apr 14 10:44:21 user nova-compute[71509]:     </interface>
Apr 14 10:44:21 user nova-compute[71509]:     <serial type="pty">
Apr 14 10:44:21 user nova-compute[71509]:       <log file="/opt/stack/data/nova/instances/d1516acc-354e-41f6-a639-61dea870b11e/console.log" append="off"/>
Apr 14 10:44:21 user nova-compute[71509]:     </serial>
Apr 14 10:44:21 user nova-compute[71509]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 10:44:21 user nova-compute[71509]:     <video>
Apr 14 10:44:21 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 10:44:21 user nova-compute[71509]:     </video>
Apr 14 10:44:21 user nova-compute[71509]:     <rng model="virtio">
Apr 14 10:44:21 user nova-compute[71509]:       <backend model="random">/dev/urandom</backend>
Apr 14 10:44:21 user nova-compute[71509]:     </rng>
Apr 14 10:44:21 user nova-compute[71509]:     <controller type="usb" index="0" model="none"/>
Apr 14 10:44:21 user nova-compute[71509]:     <memballoon model="virtio">
Apr 14 10:44:21 user nova-compute[71509]:       <stats period="10"/>
Apr 14 10:44:21 user nova-compute[71509]:     </memballoon>
Apr 14 10:44:21 user nova-compute[71509]:   </devices>
Apr 14 10:44:21 user nova-compute[71509]: </domain>
Apr 14 10:44:21 user nova-compute[71509]:  {{(pid=71509) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 10:44:21 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T10:43:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1636555058',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1636555058',id=12,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFiuA4lBJVtYfiy/p87uKYDDoanpcxZLwOKehEbraw8DqN/tSzDkhXnQCUYZYSydWf6HuXl2lM5q4KKhfjVIPIOpfWr+UnggY0Ln4rrMx5Z5ebIqfaJVvJquUpb7gfFk/w==',key_name='tempest-keypair-1957800049',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0e024f5a578e4543a02c6adc7d456f39',ramdisk_id='',reservation_id='r-rufirbfe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-656117710',owner_user_name='tempest-TaggedBootDevicesTest-656117710-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T10:43:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f6dac34303f4965babaee39bb363b5e',uuid=d1516acc-354e-41f6-a639-61dea870b11e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2a2ef05a-2d58-4cdf-ab6c-35df823a68bc", "address": "fa:16:3e:ad:4e:cf", "network": {"id": "3c95a463-71cf-446f-8214-5f52f2da54b7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-325252986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e024f5a578e4543a02c6adc7d456f39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a2ef05a-2d", "ovs_interfaceid": "2a2ef05a-2d58-4cdf-ab6c-35df823a68bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 10:44:21 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Converting VIF {"id": "2a2ef05a-2d58-4cdf-ab6c-35df823a68bc", "address": "fa:16:3e:ad:4e:cf", "network": {"id": "3c95a463-71cf-446f-8214-5f52f2da54b7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-325252986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e024f5a578e4543a02c6adc7d456f39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a2ef05a-2d", "ovs_interfaceid": "2a2ef05a-2d58-4cdf-ab6c-35df823a68bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:44:21 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:4e:cf,bridge_name='br-int',has_traffic_filtering=True,id=2a2ef05a-2d58-4cdf-ab6c-35df823a68bc,network=Network(3c95a463-71cf-446f-8214-5f52f2da54b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a2ef05a-2d') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:44:21 user nova-compute[71509]: DEBUG os_vif [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:4e:cf,bridge_name='br-int',has_traffic_filtering=True,id=2a2ef05a-2d58-4cdf-ab6c-35df823a68bc,network=Network(3c95a463-71cf-446f-8214-5f52f2da54b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a2ef05a-2d') {{(pid=71509) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 10:44:21 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:21 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:44:21 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 10:44:21 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:21 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2a2ef05a-2d, may_exist=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:44:21 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2a2ef05a-2d, col_values=(('external_ids', {'iface-id': '2a2ef05a-2d58-4cdf-ab6c-35df823a68bc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ad:4e:cf', 'vm-uuid': 'd1516acc-354e-41f6-a639-61dea870b11e'}),)) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:44:21 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:21 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 10:44:22 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:22 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:22 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:22 user nova-compute[71509]: INFO os_vif [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:4e:cf,bridge_name='br-int',has_traffic_filtering=True,id=2a2ef05a-2d58-4cdf-ab6c-35df823a68bc,network=Network(3c95a463-71cf-446f-8214-5f52f2da54b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a2ef05a-2d')
Apr 14 10:44:22 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T10:43:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1636555058',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1636555058',id=12,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFiuA4lBJVtYfiy/p87uKYDDoanpcxZLwOKehEbraw8DqN/tSzDkhXnQCUYZYSydWf6HuXl2lM5q4KKhfjVIPIOpfWr+UnggY0Ln4rrMx5Z5ebIqfaJVvJquUpb7gfFk/w==',key_name='tempest-keypair-1957800049',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0e024f5a578e4543a02c6adc7d456f39',ramdisk_id='',reservation_id='r-rufirbfe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-656117710',owner_user_name='tempest-TaggedBootDevicesTest-656117710-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T10:43:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f6dac34303f4965babaee39bb363b5e',uuid=d1516acc-354e-41f6-a639-61dea870b11e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "23214923-0217-4046-9a68-675f2ee8e42d", "address": "fa:16:3e:8a:5a:1a", "network": {"id": "bb8c5688-db8f-47c0-a2b5-0a44d2f97461", "bridge": "br-int", "label": "tempest-device-tagging-net1-527368946", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e024f5a578e4543a02c6adc7d456f39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23214923-02", "ovs_interfaceid": "23214923-0217-4046-9a68-675f2ee8e42d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71509) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 10:44:22 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Converting VIF {"id": "23214923-0217-4046-9a68-675f2ee8e42d", "address": "fa:16:3e:8a:5a:1a", "network": {"id": "bb8c5688-db8f-47c0-a2b5-0a44d2f97461", "bridge": "br-int", "label": "tempest-device-tagging-net1-527368946", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e024f5a578e4543a02c6adc7d456f39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23214923-02", "ovs_interfaceid": "23214923-0217-4046-9a68-675f2ee8e42d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:44:22 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:5a:1a,bridge_name='br-int',has_traffic_filtering=True,id=23214923-0217-4046-9a68-675f2ee8e42d,network=Network(bb8c5688-db8f-47c0-a2b5-0a44d2f97461),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap23214923-02') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:44:22 user nova-compute[71509]: DEBUG os_vif [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:5a:1a,bridge_name='br-int',has_traffic_filtering=True,id=23214923-0217-4046-9a68-675f2ee8e42d,network=Network(bb8c5688-db8f-47c0-a2b5-0a44d2f97461),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap23214923-02') {{(pid=71509) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 10:44:22 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:22 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:44:22 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 10:44:22 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:22 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap23214923-02, may_exist=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:44:22 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap23214923-02, col_values=(('external_ids', {'iface-id': '23214923-0217-4046-9a68-675f2ee8e42d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8a:5a:1a', 'vm-uuid': 'd1516acc-354e-41f6-a639-61dea870b11e'}),)) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:44:22 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:22 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 10:44:22 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:22 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:22 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:22 user nova-compute[71509]: INFO os_vif [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:5a:1a,bridge_name='br-int',has_traffic_filtering=True,id=23214923-0217-4046-9a68-675f2ee8e42d,network=Network(bb8c5688-db8f-47c0-a2b5-0a44d2f97461),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap23214923-02')
Apr 14 10:44:22 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T10:43:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1636555058',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1636555058',id=12,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFiuA4lBJVtYfiy/p87uKYDDoanpcxZLwOKehEbraw8DqN/tSzDkhXnQCUYZYSydWf6HuXl2lM5q4KKhfjVIPIOpfWr+UnggY0Ln4rrMx5Z5ebIqfaJVvJquUpb7gfFk/w==',key_name='tempest-keypair-1957800049',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0e024f5a578e4543a02c6adc7d456f39',ramdisk_id='',reservation_id='r-rufirbfe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-656117710',owner_user_name='tempest-TaggedBootDevicesTest-656117710-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T10:43:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f6dac34303f4965babaee39bb363b5e',uuid=d1516acc-354e-41f6-a639-61dea870b11e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7f7db929-b2fd-4242-9d23-5d58a374f961", "address": "fa:16:3e:28:88:b4", "network": {"id": "bb8c5688-db8f-47c0-a2b5-0a44d2f97461", "bridge": "br-int", "label": "tempest-device-tagging-net1-527368946", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e024f5a578e4543a02c6adc7d456f39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f7db929-b2", "ovs_interfaceid": "7f7db929-b2fd-4242-9d23-5d58a374f961", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71509) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 10:44:22 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Converting VIF {"id": "7f7db929-b2fd-4242-9d23-5d58a374f961", "address": "fa:16:3e:28:88:b4", "network": {"id": "bb8c5688-db8f-47c0-a2b5-0a44d2f97461", "bridge": "br-int", "label": "tempest-device-tagging-net1-527368946", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e024f5a578e4543a02c6adc7d456f39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f7db929-b2", "ovs_interfaceid": "7f7db929-b2fd-4242-9d23-5d58a374f961", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:44:22 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:88:b4,bridge_name='br-int',has_traffic_filtering=True,id=7f7db929-b2fd-4242-9d23-5d58a374f961,network=Network(bb8c5688-db8f-47c0-a2b5-0a44d2f97461),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7f7db929-b2') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:44:22 user nova-compute[71509]: DEBUG os_vif [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:88:b4,bridge_name='br-int',has_traffic_filtering=True,id=7f7db929-b2fd-4242-9d23-5d58a374f961,network=Network(bb8c5688-db8f-47c0-a2b5-0a44d2f97461),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7f7db929-b2') {{(pid=71509) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 10:44:22 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:22 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:44:22 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 10:44:22 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:22 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7f7db929-b2, may_exist=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:44:22 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7f7db929-b2, col_values=(('external_ids', {'iface-id': '7f7db929-b2fd-4242-9d23-5d58a374f961', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:28:88:b4', 'vm-uuid': 'd1516acc-354e-41f6-a639-61dea870b11e'}),)) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:44:22 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:22 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 10:44:22 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:22 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:22 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:22 user nova-compute[71509]: INFO os_vif [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:88:b4,bridge_name='br-int',has_traffic_filtering=True,id=7f7db929-b2fd-4242-9d23-5d58a374f961,network=Network(bb8c5688-db8f-47c0-a2b5-0a44d2f97461),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7f7db929-b2')
Apr 14 10:44:22 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T10:43:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1636555058',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1636555058',id=12,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFiuA4lBJVtYfiy/p87uKYDDoanpcxZLwOKehEbraw8DqN/tSzDkhXnQCUYZYSydWf6HuXl2lM5q4KKhfjVIPIOpfWr+UnggY0Ln4rrMx5Z5ebIqfaJVvJquUpb7gfFk/w==',key_name='tempest-keypair-1957800049',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0e024f5a578e4543a02c6adc7d456f39',ramdisk_id='',reservation_id='r-rufirbfe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-656117710',owner_user_name='tempest-TaggedBootDevicesTest-656117710-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T10:43:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f6dac34303f4965babaee39bb363b5e',uuid=d1516acc-354e-41f6-a639-61dea870b11e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4d65e4a1-4cea-4636-8ad8-21065de3c747", "address": "fa:16:3e:c2:1b:8c", "network": {"id": "bb8c5688-db8f-47c0-a2b5-0a44d2f97461", "bridge": "br-int", "label": "tempest-device-tagging-net1-527368946", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e024f5a578e4543a02c6adc7d456f39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d65e4a1-4c", "ovs_interfaceid": "4d65e4a1-4cea-4636-8ad8-21065de3c747", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 10:44:22 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Converting VIF {"id": "4d65e4a1-4cea-4636-8ad8-21065de3c747", "address": "fa:16:3e:c2:1b:8c", "network": {"id": "bb8c5688-db8f-47c0-a2b5-0a44d2f97461", "bridge": "br-int", "label": "tempest-device-tagging-net1-527368946", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e024f5a578e4543a02c6adc7d456f39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d65e4a1-4c", "ovs_interfaceid": "4d65e4a1-4cea-4636-8ad8-21065de3c747", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:44:22 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:1b:8c,bridge_name='br-int',has_traffic_filtering=True,id=4d65e4a1-4cea-4636-8ad8-21065de3c747,network=Network(bb8c5688-db8f-47c0-a2b5-0a44d2f97461),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d65e4a1-4c') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:44:22 user nova-compute[71509]: DEBUG os_vif [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:1b:8c,bridge_name='br-int',has_traffic_filtering=True,id=4d65e4a1-4cea-4636-8ad8-21065de3c747,network=Network(bb8c5688-db8f-47c0-a2b5-0a44d2f97461),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d65e4a1-4c') {{(pid=71509) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 10:44:22 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:22 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:44:22 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 10:44:22 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:22 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4d65e4a1-4c, may_exist=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:44:22 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4d65e4a1-4c, col_values=(('external_ids', {'iface-id': '4d65e4a1-4cea-4636-8ad8-21065de3c747', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c2:1b:8c', 'vm-uuid': 'd1516acc-354e-41f6-a639-61dea870b11e'}),)) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:44:22 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:22 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 10:44:22 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:22 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:22 user nova-compute[71509]: INFO os_vif [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:1b:8c,bridge_name='br-int',has_traffic_filtering=True,id=4d65e4a1-4cea-4636-8ad8-21065de3c747,network=Network(bb8c5688-db8f-47c0-a2b5-0a44d2f97461),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d65e4a1-4c')
Apr 14 10:44:22 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T10:43:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1636555058',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1636555058',id=12,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFiuA4lBJVtYfiy/p87uKYDDoanpcxZLwOKehEbraw8DqN/tSzDkhXnQCUYZYSydWf6HuXl2lM5q4KKhfjVIPIOpfWr+UnggY0Ln4rrMx5Z5ebIqfaJVvJquUpb7gfFk/w==',key_name='tempest-keypair-1957800049',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0e024f5a578e4543a02c6adc7d456f39',ramdisk_id='',reservation_id='r-rufirbfe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-656117710',owner_user_name='tempest-TaggedBootDevicesTest-656117710-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T10:43:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f6dac34303f4965babaee39bb363b5e',uuid=d1516acc-354e-41f6-a639-61dea870b11e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d70f6f4d-f2bc-4d5e-9e98-a0daa1b35a0f", "address": "fa:16:3e:64:ce:c5", "network": {"id": "bb8c5688-db8f-47c0-a2b5-0a44d2f97461", "bridge": "br-int", "label": "tempest-device-tagging-net1-527368946", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e024f5a578e4543a02c6adc7d456f39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd70f6f4d-f2", "ovs_interfaceid": "d70f6f4d-f2bc-4d5e-9e98-a0daa1b35a0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 10:44:22 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Converting VIF {"id": "d70f6f4d-f2bc-4d5e-9e98-a0daa1b35a0f", "address": "fa:16:3e:64:ce:c5", "network": {"id": "bb8c5688-db8f-47c0-a2b5-0a44d2f97461", "bridge": "br-int", "label": "tempest-device-tagging-net1-527368946", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e024f5a578e4543a02c6adc7d456f39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd70f6f4d-f2", "ovs_interfaceid": "d70f6f4d-f2bc-4d5e-9e98-a0daa1b35a0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:44:22 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:ce:c5,bridge_name='br-int',has_traffic_filtering=True,id=d70f6f4d-f2bc-4d5e-9e98-a0daa1b35a0f,network=Network(bb8c5688-db8f-47c0-a2b5-0a44d2f97461),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd70f6f4d-f2') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:44:22 user nova-compute[71509]: DEBUG os_vif [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:ce:c5,bridge_name='br-int',has_traffic_filtering=True,id=d70f6f4d-f2bc-4d5e-9e98-a0daa1b35a0f,network=Network(bb8c5688-db8f-47c0-a2b5-0a44d2f97461),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd70f6f4d-f2') {{(pid=71509) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 10:44:22 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:22 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:44:22 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 10:44:22 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:22 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd70f6f4d-f2, may_exist=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:44:22 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd70f6f4d-f2, col_values=(('external_ids', {'iface-id': 'd70f6f4d-f2bc-4d5e-9e98-a0daa1b35a0f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:64:ce:c5', 'vm-uuid': 'd1516acc-354e-41f6-a639-61dea870b11e'}),)) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:44:22 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:22 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 10:44:22 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:22 user nova-compute[71509]: INFO os_vif [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:ce:c5,bridge_name='br-int',has_traffic_filtering=True,id=d70f6f4d-f2bc-4d5e-9e98-a0daa1b35a0f,network=Network(bb8c5688-db8f-47c0-a2b5-0a44d2f97461),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd70f6f4d-f2')
Apr 14 10:44:22 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T10:43:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1636555058',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1636555058',id=12,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFiuA4lBJVtYfiy/p87uKYDDoanpcxZLwOKehEbraw8DqN/tSzDkhXnQCUYZYSydWf6HuXl2lM5q4KKhfjVIPIOpfWr+UnggY0Ln4rrMx5Z5ebIqfaJVvJquUpb7gfFk/w==',key_name='tempest-keypair-1957800049',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0e024f5a578e4543a02c6adc7d456f39',ramdisk_id='',reservation_id='r-rufirbfe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-656117710',owner_user_name='tempest-TaggedBootDevicesTest-656117710-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T10:43:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f6dac34303f4965babaee39bb363b5e',uuid=d1516acc-354e-41f6-a639-61dea870b11e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "328d2b64-7bc6-425a-b3a4-8cda754ffd56", "address": "fa:16:3e:a6:55:10", "network": {"id": "1c6521c7-7280-4952-b1bc-a3aa0918e27c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1095863542", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e024f5a578e4543a02c6adc7d456f39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap328d2b64-7b", "ovs_interfaceid": "328d2b64-7bc6-425a-b3a4-8cda754ffd56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 10:44:22 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Converting VIF {"id": "328d2b64-7bc6-425a-b3a4-8cda754ffd56", "address": "fa:16:3e:a6:55:10", "network": {"id": "1c6521c7-7280-4952-b1bc-a3aa0918e27c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1095863542", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e024f5a578e4543a02c6adc7d456f39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap328d2b64-7b", "ovs_interfaceid": "328d2b64-7bc6-425a-b3a4-8cda754ffd56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:44:22 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:55:10,bridge_name='br-int',has_traffic_filtering=True,id=328d2b64-7bc6-425a-b3a4-8cda754ffd56,network=Network(1c6521c7-7280-4952-b1bc-a3aa0918e27c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap328d2b64-7b') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:44:22 user nova-compute[71509]: DEBUG os_vif [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:55:10,bridge_name='br-int',has_traffic_filtering=True,id=328d2b64-7bc6-425a-b3a4-8cda754ffd56,network=Network(1c6521c7-7280-4952-b1bc-a3aa0918e27c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap328d2b64-7b') {{(pid=71509) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 10:44:22 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:22 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:44:22 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 10:44:22 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:22 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap328d2b64-7b, may_exist=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:44:22 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap328d2b64-7b, col_values=(('external_ids', {'iface-id': '328d2b64-7bc6-425a-b3a4-8cda754ffd56', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a6:55:10', 'vm-uuid': 'd1516acc-354e-41f6-a639-61dea870b11e'}),)) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:44:22 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:22 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 10:44:22 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:22 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:22 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:22 user nova-compute[71509]: INFO os_vif [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:55:10,bridge_name='br-int',has_traffic_filtering=True,id=328d2b64-7bc6-425a-b3a4-8cda754ffd56,network=Network(1c6521c7-7280-4952-b1bc-a3aa0918e27c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap328d2b64-7b')
Apr 14 10:44:22 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T10:43:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1636555058',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1636555058',id=12,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFiuA4lBJVtYfiy/p87uKYDDoanpcxZLwOKehEbraw8DqN/tSzDkhXnQCUYZYSydWf6HuXl2lM5q4KKhfjVIPIOpfWr+UnggY0Ln4rrMx5Z5ebIqfaJVvJquUpb7gfFk/w==',key_name='tempest-keypair-1957800049',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0e024f5a578e4543a02c6adc7d456f39',ramdisk_id='',reservation_id='r-rufirbfe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-656117710',owner_user_name='tempest-TaggedBootDevicesTest-656117710-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T10:43:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f6dac34303f4965babaee39bb363b5e',uuid=d1516acc-354e-41f6-a639-61dea870b11e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6e295a29-0297-49c0-9298-7d3a41a07585", "address": "fa:16:3e:32:10:a4", "network": {"id": "1c6521c7-7280-4952-b1bc-a3aa0918e27c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1095863542", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e024f5a578e4543a02c6adc7d456f39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e295a29-02", "ovs_interfaceid": "6e295a29-0297-49c0-9298-7d3a41a07585", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 10:44:22 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Converting VIF {"id": "6e295a29-0297-49c0-9298-7d3a41a07585", "address": "fa:16:3e:32:10:a4", "network": {"id": "1c6521c7-7280-4952-b1bc-a3aa0918e27c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1095863542", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e024f5a578e4543a02c6adc7d456f39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e295a29-02", "ovs_interfaceid": "6e295a29-0297-49c0-9298-7d3a41a07585", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:44:22 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:10:a4,bridge_name='br-int',has_traffic_filtering=True,id=6e295a29-0297-49c0-9298-7d3a41a07585,network=Network(1c6521c7-7280-4952-b1bc-a3aa0918e27c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e295a29-02') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:44:22 user nova-compute[71509]: DEBUG os_vif [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:10:a4,bridge_name='br-int',has_traffic_filtering=True,id=6e295a29-0297-49c0-9298-7d3a41a07585,network=Network(1c6521c7-7280-4952-b1bc-a3aa0918e27c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e295a29-02') {{(pid=71509) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 10:44:22 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:22 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:44:22 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 10:44:23 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:23 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6e295a29-02, may_exist=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:44:23 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6e295a29-02, col_values=(('external_ids', {'iface-id': '6e295a29-0297-49c0-9298-7d3a41a07585', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:32:10:a4', 'vm-uuid': 'd1516acc-354e-41f6-a639-61dea870b11e'}),)) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:44:23 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:23 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 10:44:23 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:23 user nova-compute[71509]: INFO os_vif [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:10:a4,bridge_name='br-int',has_traffic_filtering=True,id=6e295a29-0297-49c0-9298-7d3a41a07585,network=Network(1c6521c7-7280-4952-b1bc-a3aa0918e27c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e295a29-02')
Apr 14 10:44:23 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:23 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] No BDM found with device name hda, not building metadata. {{(pid=71509) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 10:44:23 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71509) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 10:44:23 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] No VIF found with MAC fa:16:3e:ad:4e:cf, not building metadata {{(pid=71509) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 10:44:23 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] No VIF found with MAC fa:16:3e:64:ce:c5, not building metadata {{(pid=71509) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 10:44:23 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Using config drive
Apr 14 10:44:23 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:23 user nova-compute[71509]: DEBUG nova.compute.manager [req-a1946755-a6b7-43b2-89f0-514728863183 req-fcdd2b51-ff82-4dda-bf6b-7f2f6ac6d6fb service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Received event network-vif-plugged-8789c03e-397c-439a-8bc5-5d8ce5fc36ac {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:44:23 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-a1946755-a6b7-43b2-89f0-514728863183 req-fcdd2b51-ff82-4dda-bf6b-7f2f6ac6d6fb service nova] Acquiring lock "a81da242-e8d8-4b41-b84a-e12d603823ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:44:23 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-a1946755-a6b7-43b2-89f0-514728863183 req-fcdd2b51-ff82-4dda-bf6b-7f2f6ac6d6fb service nova] Lock "a81da242-e8d8-4b41-b84a-e12d603823ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:44:23 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-a1946755-a6b7-43b2-89f0-514728863183 req-fcdd2b51-ff82-4dda-bf6b-7f2f6ac6d6fb service nova] Lock "a81da242-e8d8-4b41-b84a-e12d603823ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:44:23 user nova-compute[71509]: DEBUG nova.compute.manager [req-a1946755-a6b7-43b2-89f0-514728863183 req-fcdd2b51-ff82-4dda-bf6b-7f2f6ac6d6fb service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] No waiting events found dispatching network-vif-plugged-8789c03e-397c-439a-8bc5-5d8ce5fc36ac {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:44:23 user nova-compute[71509]: WARNING nova.compute.manager [req-a1946755-a6b7-43b2-89f0-514728863183 req-fcdd2b51-ff82-4dda-bf6b-7f2f6ac6d6fb service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Received unexpected event network-vif-plugged-8789c03e-397c-439a-8bc5-5d8ce5fc36ac for instance with vm_state building and task_state spawning.
Apr 14 10:44:23 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:23 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:23 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Creating config drive at /opt/stack/data/nova/instances/d1516acc-354e-41f6-a639-61dea870b11e/disk.config
Apr 14 10:44:23 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/d1516acc-354e-41f6-a639-61dea870b11e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpe5td56jh {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:23 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:23 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/d1516acc-354e-41f6-a639-61dea870b11e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpe5td56jh" returned: 0 in 0.068s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:44:23 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:23 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:23 user nova-compute[71509]: DEBUG nova.compute.manager [req-52ecb80d-3551-4271-8bb3-3be0c99a9727 req-8f4a130d-70ad-4f51-ae15-79dab4d1efa5 service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Received event network-vif-plugged-2b341364-55e1-439f-9a3b-2b2fb7ad33b7 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:44:23 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-52ecb80d-3551-4271-8bb3-3be0c99a9727 req-8f4a130d-70ad-4f51-ae15-79dab4d1efa5 service nova] Acquiring lock "a81da242-e8d8-4b41-b84a-e12d603823ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:44:23 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-52ecb80d-3551-4271-8bb3-3be0c99a9727 req-8f4a130d-70ad-4f51-ae15-79dab4d1efa5 service nova] Lock "a81da242-e8d8-4b41-b84a-e12d603823ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:44:23 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-52ecb80d-3551-4271-8bb3-3be0c99a9727 req-8f4a130d-70ad-4f51-ae15-79dab4d1efa5 service nova] Lock "a81da242-e8d8-4b41-b84a-e12d603823ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:44:23 user nova-compute[71509]: DEBUG nova.compute.manager [req-52ecb80d-3551-4271-8bb3-3be0c99a9727 req-8f4a130d-70ad-4f51-ae15-79dab4d1efa5 service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] No waiting events found dispatching network-vif-plugged-2b341364-55e1-439f-9a3b-2b2fb7ad33b7 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:44:23 user nova-compute[71509]: WARNING nova.compute.manager [req-52ecb80d-3551-4271-8bb3-3be0c99a9727 req-8f4a130d-70ad-4f51-ae15-79dab4d1efa5 service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Received unexpected event network-vif-plugged-2b341364-55e1-439f-9a3b-2b2fb7ad33b7 for instance with vm_state building and task_state spawning.
Apr 14 10:44:23 user nova-compute[71509]: DEBUG nova.compute.manager [req-52ecb80d-3551-4271-8bb3-3be0c99a9727 req-8f4a130d-70ad-4f51-ae15-79dab4d1efa5 service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Received event network-vif-plugged-f3e8f62b-77e2-49d5-9fd9-b75f024a4ee7 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:44:23 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-52ecb80d-3551-4271-8bb3-3be0c99a9727 req-8f4a130d-70ad-4f51-ae15-79dab4d1efa5 service nova] Acquiring lock "a81da242-e8d8-4b41-b84a-e12d603823ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:44:23 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-52ecb80d-3551-4271-8bb3-3be0c99a9727 req-8f4a130d-70ad-4f51-ae15-79dab4d1efa5 service nova] Lock "a81da242-e8d8-4b41-b84a-e12d603823ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:44:23 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-52ecb80d-3551-4271-8bb3-3be0c99a9727 req-8f4a130d-70ad-4f51-ae15-79dab4d1efa5 service nova] Lock "a81da242-e8d8-4b41-b84a-e12d603823ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:44:23 user nova-compute[71509]: DEBUG nova.compute.manager [req-52ecb80d-3551-4271-8bb3-3be0c99a9727 req-8f4a130d-70ad-4f51-ae15-79dab4d1efa5 service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] No waiting events found dispatching network-vif-plugged-f3e8f62b-77e2-49d5-9fd9-b75f024a4ee7 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:44:23 user nova-compute[71509]: WARNING nova.compute.manager [req-52ecb80d-3551-4271-8bb3-3be0c99a9727 req-8f4a130d-70ad-4f51-ae15-79dab4d1efa5 service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Received unexpected event network-vif-plugged-f3e8f62b-77e2-49d5-9fd9-b75f024a4ee7 for instance with vm_state building and task_state spawning.
Apr 14 10:44:23 user nova-compute[71509]: DEBUG nova.compute.manager [req-52ecb80d-3551-4271-8bb3-3be0c99a9727 req-8f4a130d-70ad-4f51-ae15-79dab4d1efa5 service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Received event network-vif-plugged-f3e8f62b-77e2-49d5-9fd9-b75f024a4ee7 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:44:23 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-52ecb80d-3551-4271-8bb3-3be0c99a9727 req-8f4a130d-70ad-4f51-ae15-79dab4d1efa5 service nova] Acquiring lock "a81da242-e8d8-4b41-b84a-e12d603823ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:44:23 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-52ecb80d-3551-4271-8bb3-3be0c99a9727 req-8f4a130d-70ad-4f51-ae15-79dab4d1efa5 service nova] Lock "a81da242-e8d8-4b41-b84a-e12d603823ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:44:23 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-52ecb80d-3551-4271-8bb3-3be0c99a9727 req-8f4a130d-70ad-4f51-ae15-79dab4d1efa5 service nova] Lock "a81da242-e8d8-4b41-b84a-e12d603823ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:44:23 user nova-compute[71509]: DEBUG nova.compute.manager [req-52ecb80d-3551-4271-8bb3-3be0c99a9727 req-8f4a130d-70ad-4f51-ae15-79dab4d1efa5 service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] No waiting events found dispatching network-vif-plugged-f3e8f62b-77e2-49d5-9fd9-b75f024a4ee7 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:44:23 user nova-compute[71509]: WARNING nova.compute.manager [req-52ecb80d-3551-4271-8bb3-3be0c99a9727 req-8f4a130d-70ad-4f51-ae15-79dab4d1efa5 service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Received unexpected event network-vif-plugged-f3e8f62b-77e2-49d5-9fd9-b75f024a4ee7 for instance with vm_state building and task_state spawning.
Apr 14 10:44:23 user nova-compute[71509]: DEBUG nova.compute.manager [req-52ecb80d-3551-4271-8bb3-3be0c99a9727 req-8f4a130d-70ad-4f51-ae15-79dab4d1efa5 service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Received event network-vif-plugged-d2d71e67-1807-43cf-8753-7bdd77de6317 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:44:23 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-52ecb80d-3551-4271-8bb3-3be0c99a9727 req-8f4a130d-70ad-4f51-ae15-79dab4d1efa5 service nova] Acquiring lock "a81da242-e8d8-4b41-b84a-e12d603823ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:44:23 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-52ecb80d-3551-4271-8bb3-3be0c99a9727 req-8f4a130d-70ad-4f51-ae15-79dab4d1efa5 service nova] Lock "a81da242-e8d8-4b41-b84a-e12d603823ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:44:23 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-52ecb80d-3551-4271-8bb3-3be0c99a9727 req-8f4a130d-70ad-4f51-ae15-79dab4d1efa5 service nova] Lock "a81da242-e8d8-4b41-b84a-e12d603823ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:44:23 user nova-compute[71509]: DEBUG nova.compute.manager [req-52ecb80d-3551-4271-8bb3-3be0c99a9727 req-8f4a130d-70ad-4f51-ae15-79dab4d1efa5 service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] No waiting events found dispatching network-vif-plugged-d2d71e67-1807-43cf-8753-7bdd77de6317 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:44:23 user nova-compute[71509]: WARNING nova.compute.manager [req-52ecb80d-3551-4271-8bb3-3be0c99a9727 req-8f4a130d-70ad-4f51-ae15-79dab4d1efa5 service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Received unexpected event network-vif-plugged-d2d71e67-1807-43cf-8753-7bdd77de6317 for instance with vm_state building and task_state spawning.
Apr 14 10:44:23 user nova-compute[71509]: DEBUG nova.compute.manager [req-52ecb80d-3551-4271-8bb3-3be0c99a9727 req-8f4a130d-70ad-4f51-ae15-79dab4d1efa5 service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Received event network-vif-plugged-d2d71e67-1807-43cf-8753-7bdd77de6317 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:44:23 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-52ecb80d-3551-4271-8bb3-3be0c99a9727 req-8f4a130d-70ad-4f51-ae15-79dab4d1efa5 service nova] Acquiring lock "a81da242-e8d8-4b41-b84a-e12d603823ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:44:23 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-52ecb80d-3551-4271-8bb3-3be0c99a9727 req-8f4a130d-70ad-4f51-ae15-79dab4d1efa5 service nova] Lock "a81da242-e8d8-4b41-b84a-e12d603823ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:44:23 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-52ecb80d-3551-4271-8bb3-3be0c99a9727 req-8f4a130d-70ad-4f51-ae15-79dab4d1efa5 service nova] Lock "a81da242-e8d8-4b41-b84a-e12d603823ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:44:23 user nova-compute[71509]: DEBUG nova.compute.manager [req-52ecb80d-3551-4271-8bb3-3be0c99a9727 req-8f4a130d-70ad-4f51-ae15-79dab4d1efa5 service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] No waiting events found dispatching network-vif-plugged-d2d71e67-1807-43cf-8753-7bdd77de6317 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:44:23 user nova-compute[71509]: WARNING nova.compute.manager [req-52ecb80d-3551-4271-8bb3-3be0c99a9727 req-8f4a130d-70ad-4f51-ae15-79dab4d1efa5 service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Received unexpected event network-vif-plugged-d2d71e67-1807-43cf-8753-7bdd77de6317 for instance with vm_state building and task_state spawning.
Apr 14 10:44:23 user nova-compute[71509]: DEBUG nova.compute.manager [req-52ecb80d-3551-4271-8bb3-3be0c99a9727 req-8f4a130d-70ad-4f51-ae15-79dab4d1efa5 service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Received event network-vif-plugged-c46b5082-6634-4c7f-89c1-7e58a3cd8987 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:44:23 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-52ecb80d-3551-4271-8bb3-3be0c99a9727 req-8f4a130d-70ad-4f51-ae15-79dab4d1efa5 service nova] Acquiring lock "a81da242-e8d8-4b41-b84a-e12d603823ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:44:23 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-52ecb80d-3551-4271-8bb3-3be0c99a9727 req-8f4a130d-70ad-4f51-ae15-79dab4d1efa5 service nova] Lock "a81da242-e8d8-4b41-b84a-e12d603823ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:44:23 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-52ecb80d-3551-4271-8bb3-3be0c99a9727 req-8f4a130d-70ad-4f51-ae15-79dab4d1efa5 service nova] Lock "a81da242-e8d8-4b41-b84a-e12d603823ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:44:23 user nova-compute[71509]: DEBUG nova.compute.manager [req-52ecb80d-3551-4271-8bb3-3be0c99a9727 req-8f4a130d-70ad-4f51-ae15-79dab4d1efa5 service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] No waiting events found dispatching network-vif-plugged-c46b5082-6634-4c7f-89c1-7e58a3cd8987 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:44:23 user nova-compute[71509]: WARNING nova.compute.manager [req-52ecb80d-3551-4271-8bb3-3be0c99a9727 req-8f4a130d-70ad-4f51-ae15-79dab4d1efa5 service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Received unexpected event network-vif-plugged-c46b5082-6634-4c7f-89c1-7e58a3cd8987 for instance with vm_state building and task_state spawning.
Apr 14 10:44:23 user nova-compute[71509]: DEBUG nova.compute.manager [req-52ecb80d-3551-4271-8bb3-3be0c99a9727 req-8f4a130d-70ad-4f51-ae15-79dab4d1efa5 service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Received event network-vif-plugged-c46b5082-6634-4c7f-89c1-7e58a3cd8987 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:44:23 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-52ecb80d-3551-4271-8bb3-3be0c99a9727 req-8f4a130d-70ad-4f51-ae15-79dab4d1efa5 service nova] Acquiring lock "a81da242-e8d8-4b41-b84a-e12d603823ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:44:23 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-52ecb80d-3551-4271-8bb3-3be0c99a9727 req-8f4a130d-70ad-4f51-ae15-79dab4d1efa5 service nova] Lock "a81da242-e8d8-4b41-b84a-e12d603823ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:44:23 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-52ecb80d-3551-4271-8bb3-3be0c99a9727 req-8f4a130d-70ad-4f51-ae15-79dab4d1efa5 service nova] Lock "a81da242-e8d8-4b41-b84a-e12d603823ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:44:23 user nova-compute[71509]: DEBUG nova.compute.manager [req-52ecb80d-3551-4271-8bb3-3be0c99a9727 req-8f4a130d-70ad-4f51-ae15-79dab4d1efa5 service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] No waiting events found dispatching network-vif-plugged-c46b5082-6634-4c7f-89c1-7e58a3cd8987 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:44:23 user nova-compute[71509]: WARNING nova.compute.manager [req-52ecb80d-3551-4271-8bb3-3be0c99a9727 req-8f4a130d-70ad-4f51-ae15-79dab4d1efa5 service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Received unexpected event network-vif-plugged-c46b5082-6634-4c7f-89c1-7e58a3cd8987 for instance with vm_state building and task_state spawning.
Apr 14 10:44:23 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:23 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:23 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:24 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:24 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:24 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:24 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:25 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:25 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:25 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:25 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:25 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:25 user nova-compute[71509]: DEBUG nova.compute.manager [req-7f07947c-8714-4828-8c9d-4530d72db36d req-d14e09a2-17b7-443a-9417-b211b1684c4a service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Received event network-vif-plugged-8789c03e-397c-439a-8bc5-5d8ce5fc36ac {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:44:25 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-7f07947c-8714-4828-8c9d-4530d72db36d req-d14e09a2-17b7-443a-9417-b211b1684c4a service nova] Acquiring lock "a81da242-e8d8-4b41-b84a-e12d603823ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:44:25 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-7f07947c-8714-4828-8c9d-4530d72db36d req-d14e09a2-17b7-443a-9417-b211b1684c4a service nova] Lock "a81da242-e8d8-4b41-b84a-e12d603823ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:44:25 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-7f07947c-8714-4828-8c9d-4530d72db36d req-d14e09a2-17b7-443a-9417-b211b1684c4a service nova] Lock "a81da242-e8d8-4b41-b84a-e12d603823ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:44:25 user nova-compute[71509]: DEBUG nova.compute.manager [req-7f07947c-8714-4828-8c9d-4530d72db36d req-d14e09a2-17b7-443a-9417-b211b1684c4a service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] No waiting events found dispatching network-vif-plugged-8789c03e-397c-439a-8bc5-5d8ce5fc36ac {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:44:25 user nova-compute[71509]: WARNING nova.compute.manager [req-7f07947c-8714-4828-8c9d-4530d72db36d req-d14e09a2-17b7-443a-9417-b211b1684c4a service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Received unexpected event network-vif-plugged-8789c03e-397c-439a-8bc5-5d8ce5fc36ac for instance with vm_state building and task_state spawning.
Apr 14 10:44:25 user nova-compute[71509]: DEBUG nova.compute.manager [req-7f07947c-8714-4828-8c9d-4530d72db36d req-d14e09a2-17b7-443a-9417-b211b1684c4a service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Received event network-vif-plugged-717e6c20-676e-40f2-b4c1-47ca0f3e6f22 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:44:25 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-7f07947c-8714-4828-8c9d-4530d72db36d req-d14e09a2-17b7-443a-9417-b211b1684c4a service nova] Acquiring lock "a81da242-e8d8-4b41-b84a-e12d603823ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:44:25 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-7f07947c-8714-4828-8c9d-4530d72db36d req-d14e09a2-17b7-443a-9417-b211b1684c4a service nova] Lock "a81da242-e8d8-4b41-b84a-e12d603823ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:44:25 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-7f07947c-8714-4828-8c9d-4530d72db36d req-d14e09a2-17b7-443a-9417-b211b1684c4a service nova] Lock "a81da242-e8d8-4b41-b84a-e12d603823ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:44:25 user nova-compute[71509]: DEBUG nova.compute.manager [req-7f07947c-8714-4828-8c9d-4530d72db36d req-d14e09a2-17b7-443a-9417-b211b1684c4a service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] No waiting events found dispatching network-vif-plugged-717e6c20-676e-40f2-b4c1-47ca0f3e6f22 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:44:25 user nova-compute[71509]: WARNING nova.compute.manager [req-7f07947c-8714-4828-8c9d-4530d72db36d req-d14e09a2-17b7-443a-9417-b211b1684c4a service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Received unexpected event network-vif-plugged-717e6c20-676e-40f2-b4c1-47ca0f3e6f22 for instance with vm_state building and task_state spawning.
Apr 14 10:44:25 user nova-compute[71509]: DEBUG nova.compute.manager [req-7f07947c-8714-4828-8c9d-4530d72db36d req-d14e09a2-17b7-443a-9417-b211b1684c4a service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Received event network-vif-plugged-717e6c20-676e-40f2-b4c1-47ca0f3e6f22 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:44:25 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-7f07947c-8714-4828-8c9d-4530d72db36d req-d14e09a2-17b7-443a-9417-b211b1684c4a service nova] Acquiring lock "a81da242-e8d8-4b41-b84a-e12d603823ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:44:25 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-7f07947c-8714-4828-8c9d-4530d72db36d req-d14e09a2-17b7-443a-9417-b211b1684c4a service nova] Lock "a81da242-e8d8-4b41-b84a-e12d603823ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:44:25 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-7f07947c-8714-4828-8c9d-4530d72db36d req-d14e09a2-17b7-443a-9417-b211b1684c4a service nova] Lock "a81da242-e8d8-4b41-b84a-e12d603823ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:44:25 user nova-compute[71509]: DEBUG nova.compute.manager [req-7f07947c-8714-4828-8c9d-4530d72db36d req-d14e09a2-17b7-443a-9417-b211b1684c4a service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] No waiting events found dispatching network-vif-plugged-717e6c20-676e-40f2-b4c1-47ca0f3e6f22 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:44:25 user nova-compute[71509]: WARNING nova.compute.manager [req-7f07947c-8714-4828-8c9d-4530d72db36d req-d14e09a2-17b7-443a-9417-b211b1684c4a service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Received unexpected event network-vif-plugged-717e6c20-676e-40f2-b4c1-47ca0f3e6f22 for instance with vm_state building and task_state spawning.
Apr 14 10:44:25 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:25 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:25 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:25 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:25 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:25 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:25 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:25 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:25 user nova-compute[71509]: DEBUG nova.compute.manager [req-2eaaad70-01c1-47a7-9be1-84b295951060 req-483cc08f-2c7e-4e08-bd71-6067a71b57a2 service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Received event network-vif-plugged-84e561e8-01c6-4d50-ab37-bc64b5509e31 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:44:25 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-2eaaad70-01c1-47a7-9be1-84b295951060 req-483cc08f-2c7e-4e08-bd71-6067a71b57a2 service nova] Acquiring lock "a81da242-e8d8-4b41-b84a-e12d603823ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:44:25 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-2eaaad70-01c1-47a7-9be1-84b295951060 req-483cc08f-2c7e-4e08-bd71-6067a71b57a2 service nova] Lock "a81da242-e8d8-4b41-b84a-e12d603823ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:44:25 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-2eaaad70-01c1-47a7-9be1-84b295951060 req-483cc08f-2c7e-4e08-bd71-6067a71b57a2 service nova] Lock "a81da242-e8d8-4b41-b84a-e12d603823ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:44:25 user nova-compute[71509]: DEBUG nova.compute.manager [req-2eaaad70-01c1-47a7-9be1-84b295951060 req-483cc08f-2c7e-4e08-bd71-6067a71b57a2 service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] No waiting events found dispatching network-vif-plugged-84e561e8-01c6-4d50-ab37-bc64b5509e31 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:44:25 user nova-compute[71509]: WARNING nova.compute.manager [req-2eaaad70-01c1-47a7-9be1-84b295951060 req-483cc08f-2c7e-4e08-bd71-6067a71b57a2 service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Received unexpected event network-vif-plugged-84e561e8-01c6-4d50-ab37-bc64b5509e31 for instance with vm_state building and task_state spawning.
Apr 14 10:44:25 user nova-compute[71509]: DEBUG nova.compute.manager [req-2eaaad70-01c1-47a7-9be1-84b295951060 req-483cc08f-2c7e-4e08-bd71-6067a71b57a2 service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Received event network-vif-plugged-84e561e8-01c6-4d50-ab37-bc64b5509e31 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:44:25 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-2eaaad70-01c1-47a7-9be1-84b295951060 req-483cc08f-2c7e-4e08-bd71-6067a71b57a2 service nova] Acquiring lock "a81da242-e8d8-4b41-b84a-e12d603823ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:44:25 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-2eaaad70-01c1-47a7-9be1-84b295951060 req-483cc08f-2c7e-4e08-bd71-6067a71b57a2 service nova] Lock "a81da242-e8d8-4b41-b84a-e12d603823ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:44:25 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-2eaaad70-01c1-47a7-9be1-84b295951060 req-483cc08f-2c7e-4e08-bd71-6067a71b57a2 service nova] Lock "a81da242-e8d8-4b41-b84a-e12d603823ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:44:25 user nova-compute[71509]: DEBUG nova.compute.manager [req-2eaaad70-01c1-47a7-9be1-84b295951060 req-483cc08f-2c7e-4e08-bd71-6067a71b57a2 service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] No waiting events found dispatching network-vif-plugged-84e561e8-01c6-4d50-ab37-bc64b5509e31 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:44:25 user nova-compute[71509]: WARNING nova.compute.manager [req-2eaaad70-01c1-47a7-9be1-84b295951060 req-483cc08f-2c7e-4e08-bd71-6067a71b57a2 service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Received unexpected event network-vif-plugged-84e561e8-01c6-4d50-ab37-bc64b5509e31 for instance with vm_state building and task_state spawning.
Apr 14 10:44:25 user nova-compute[71509]: DEBUG nova.compute.manager [req-2eaaad70-01c1-47a7-9be1-84b295951060 req-483cc08f-2c7e-4e08-bd71-6067a71b57a2 service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Received event network-vif-plugged-2a2ef05a-2d58-4cdf-ab6c-35df823a68bc {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:44:25 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-2eaaad70-01c1-47a7-9be1-84b295951060 req-483cc08f-2c7e-4e08-bd71-6067a71b57a2 service nova] Acquiring lock "d1516acc-354e-41f6-a639-61dea870b11e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:44:25 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-2eaaad70-01c1-47a7-9be1-84b295951060 req-483cc08f-2c7e-4e08-bd71-6067a71b57a2 service nova] Lock "d1516acc-354e-41f6-a639-61dea870b11e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:44:25 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-2eaaad70-01c1-47a7-9be1-84b295951060 req-483cc08f-2c7e-4e08-bd71-6067a71b57a2 service nova] Lock "d1516acc-354e-41f6-a639-61dea870b11e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:44:25 user nova-compute[71509]: DEBUG nova.compute.manager [req-2eaaad70-01c1-47a7-9be1-84b295951060 req-483cc08f-2c7e-4e08-bd71-6067a71b57a2 service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] No waiting events found dispatching network-vif-plugged-2a2ef05a-2d58-4cdf-ab6c-35df823a68bc {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:44:25 user nova-compute[71509]: WARNING nova.compute.manager [req-2eaaad70-01c1-47a7-9be1-84b295951060 req-483cc08f-2c7e-4e08-bd71-6067a71b57a2 service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Received unexpected event network-vif-plugged-2a2ef05a-2d58-4cdf-ab6c-35df823a68bc for instance with vm_state building and task_state spawning.
Apr 14 10:44:26 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:26 user nova-compute[71509]: DEBUG nova.compute.manager [req-7a0380ca-2ea3-4b0d-9759-2f536fc41a97 req-fc087e75-2d0c-41dd-9741-35aaa93f2dd2 service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Received event network-vif-plugged-23214923-0217-4046-9a68-675f2ee8e42d {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:44:26 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-7a0380ca-2ea3-4b0d-9759-2f536fc41a97 req-fc087e75-2d0c-41dd-9741-35aaa93f2dd2 service nova] Acquiring lock "d1516acc-354e-41f6-a639-61dea870b11e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:44:26 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-7a0380ca-2ea3-4b0d-9759-2f536fc41a97 req-fc087e75-2d0c-41dd-9741-35aaa93f2dd2 service nova] Lock "d1516acc-354e-41f6-a639-61dea870b11e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:44:26 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-7a0380ca-2ea3-4b0d-9759-2f536fc41a97 req-fc087e75-2d0c-41dd-9741-35aaa93f2dd2 service nova] Lock "d1516acc-354e-41f6-a639-61dea870b11e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:44:26 user nova-compute[71509]: DEBUG nova.compute.manager [req-7a0380ca-2ea3-4b0d-9759-2f536fc41a97 req-fc087e75-2d0c-41dd-9741-35aaa93f2dd2 service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] No waiting events found dispatching network-vif-plugged-23214923-0217-4046-9a68-675f2ee8e42d {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:44:26 user nova-compute[71509]: WARNING nova.compute.manager [req-7a0380ca-2ea3-4b0d-9759-2f536fc41a97 req-fc087e75-2d0c-41dd-9741-35aaa93f2dd2 service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Received unexpected event network-vif-plugged-23214923-0217-4046-9a68-675f2ee8e42d for instance with vm_state building and task_state spawning.
Apr 14 10:44:26 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:26 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:26 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:26 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:26 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:26 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:26 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:26 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:26 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:26 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:26 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:26 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:26 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:27 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:27 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:27 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:27 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:27 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681469067.2185817, a81da242-e8d8-4b41-b84a-e12d603823ca => Resumed> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 10:44:27 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] VM Resumed (Lifecycle Event)
Apr 14 10:44:27 user nova-compute[71509]: DEBUG nova.compute.manager [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Instance event wait completed in 0 seconds for  {{(pid=71509) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 10:44:27 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Guest created on hypervisor {{(pid=71509) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 10:44:27 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:27 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Instance spawned successfully.
Apr 14 10:44:27 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 10:44:27 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:27 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:44:27 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:27 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 10:44:27 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Found default for hw_cdrom_bus of ide {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:44:27 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Found default for hw_disk_bus of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:44:27 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Found default for hw_input_bus of None {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:44:27 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Found default for hw_pointer_model of None {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:44:27 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Found default for hw_video_model of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:44:27 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Found default for hw_vif_model of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:44:27 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:27 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:27 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 10:44:27 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681469067.2244165, a81da242-e8d8-4b41-b84a-e12d603823ca => Started> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 10:44:27 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] VM Started (Lifecycle Event)
Apr 14 10:44:27 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:44:27 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 10:44:27 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 10:44:27 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:27 user nova-compute[71509]: INFO nova.compute.manager [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Took 16.17 seconds to spawn the instance on the hypervisor.
Apr 14 10:44:27 user nova-compute[71509]: DEBUG nova.compute.manager [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:44:27 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:27 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:27 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:44:27 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71509) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 10:44:27 user nova-compute[71509]: INFO nova.compute.manager [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Took 35.71 seconds to build instance.
Apr 14 10:44:27 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-08e2e2e2-2209-4d96-a992-87455a34e5a9 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Lock "a81da242-e8d8-4b41-b84a-e12d603823ca" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 35.858s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:44:27 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:27 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:27 user nova-compute[71509]: DEBUG nova.compute.manager [req-58bb6bb0-4d41-4a36-a43b-d98c6b11120c req-1969d081-8d52-476f-a537-75dce0d518c3 service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Received event network-vif-plugged-2a2ef05a-2d58-4cdf-ab6c-35df823a68bc {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:44:27 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-58bb6bb0-4d41-4a36-a43b-d98c6b11120c req-1969d081-8d52-476f-a537-75dce0d518c3 service nova] Acquiring lock "d1516acc-354e-41f6-a639-61dea870b11e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:44:27 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-58bb6bb0-4d41-4a36-a43b-d98c6b11120c req-1969d081-8d52-476f-a537-75dce0d518c3 service nova] Lock "d1516acc-354e-41f6-a639-61dea870b11e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:44:27 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-58bb6bb0-4d41-4a36-a43b-d98c6b11120c req-1969d081-8d52-476f-a537-75dce0d518c3 service nova] Lock "d1516acc-354e-41f6-a639-61dea870b11e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:44:27 user nova-compute[71509]: DEBUG nova.compute.manager [req-58bb6bb0-4d41-4a36-a43b-d98c6b11120c req-1969d081-8d52-476f-a537-75dce0d518c3 service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] No waiting events found dispatching network-vif-plugged-2a2ef05a-2d58-4cdf-ab6c-35df823a68bc {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:44:27 user nova-compute[71509]: WARNING nova.compute.manager [req-58bb6bb0-4d41-4a36-a43b-d98c6b11120c req-1969d081-8d52-476f-a537-75dce0d518c3 service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Received unexpected event network-vif-plugged-2a2ef05a-2d58-4cdf-ab6c-35df823a68bc for instance with vm_state building and task_state spawning.
Apr 14 10:44:27 user nova-compute[71509]: DEBUG nova.compute.manager [req-58bb6bb0-4d41-4a36-a43b-d98c6b11120c req-1969d081-8d52-476f-a537-75dce0d518c3 service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Received event network-vif-plugged-7f7db929-b2fd-4242-9d23-5d58a374f961 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:44:27 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-58bb6bb0-4d41-4a36-a43b-d98c6b11120c req-1969d081-8d52-476f-a537-75dce0d518c3 service nova] Acquiring lock "d1516acc-354e-41f6-a639-61dea870b11e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:44:27 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-58bb6bb0-4d41-4a36-a43b-d98c6b11120c req-1969d081-8d52-476f-a537-75dce0d518c3 service nova] Lock "d1516acc-354e-41f6-a639-61dea870b11e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:44:27 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-58bb6bb0-4d41-4a36-a43b-d98c6b11120c req-1969d081-8d52-476f-a537-75dce0d518c3 service nova] Lock "d1516acc-354e-41f6-a639-61dea870b11e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:44:27 user nova-compute[71509]: DEBUG nova.compute.manager [req-58bb6bb0-4d41-4a36-a43b-d98c6b11120c req-1969d081-8d52-476f-a537-75dce0d518c3 service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] No waiting events found dispatching network-vif-plugged-7f7db929-b2fd-4242-9d23-5d58a374f961 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:44:27 user nova-compute[71509]: WARNING nova.compute.manager [req-58bb6bb0-4d41-4a36-a43b-d98c6b11120c req-1969d081-8d52-476f-a537-75dce0d518c3 service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Received unexpected event network-vif-plugged-7f7db929-b2fd-4242-9d23-5d58a374f961 for instance with vm_state building and task_state spawning.
Apr 14 10:44:27 user nova-compute[71509]: DEBUG nova.compute.manager [req-58bb6bb0-4d41-4a36-a43b-d98c6b11120c req-1969d081-8d52-476f-a537-75dce0d518c3 service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Received event network-vif-plugged-7f7db929-b2fd-4242-9d23-5d58a374f961 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:44:27 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-58bb6bb0-4d41-4a36-a43b-d98c6b11120c req-1969d081-8d52-476f-a537-75dce0d518c3 service nova] Acquiring lock "d1516acc-354e-41f6-a639-61dea870b11e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:44:27 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-58bb6bb0-4d41-4a36-a43b-d98c6b11120c req-1969d081-8d52-476f-a537-75dce0d518c3 service nova] Lock "d1516acc-354e-41f6-a639-61dea870b11e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:44:27 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-58bb6bb0-4d41-4a36-a43b-d98c6b11120c req-1969d081-8d52-476f-a537-75dce0d518c3 service nova] Lock "d1516acc-354e-41f6-a639-61dea870b11e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:44:27 user nova-compute[71509]: DEBUG nova.compute.manager [req-58bb6bb0-4d41-4a36-a43b-d98c6b11120c req-1969d081-8d52-476f-a537-75dce0d518c3 service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] No waiting events found dispatching network-vif-plugged-7f7db929-b2fd-4242-9d23-5d58a374f961 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:44:27 user nova-compute[71509]: WARNING nova.compute.manager [req-58bb6bb0-4d41-4a36-a43b-d98c6b11120c req-1969d081-8d52-476f-a537-75dce0d518c3 service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Received unexpected event network-vif-plugged-7f7db929-b2fd-4242-9d23-5d58a374f961 for instance with vm_state building and task_state spawning.
Apr 14 10:44:27 user nova-compute[71509]: DEBUG nova.compute.manager [req-58bb6bb0-4d41-4a36-a43b-d98c6b11120c req-1969d081-8d52-476f-a537-75dce0d518c3 service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Received event network-vif-plugged-328d2b64-7bc6-425a-b3a4-8cda754ffd56 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:44:27 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-58bb6bb0-4d41-4a36-a43b-d98c6b11120c req-1969d081-8d52-476f-a537-75dce0d518c3 service nova] Acquiring lock "d1516acc-354e-41f6-a639-61dea870b11e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:44:27 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-58bb6bb0-4d41-4a36-a43b-d98c6b11120c req-1969d081-8d52-476f-a537-75dce0d518c3 service nova] Lock "d1516acc-354e-41f6-a639-61dea870b11e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:44:27 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-58bb6bb0-4d41-4a36-a43b-d98c6b11120c req-1969d081-8d52-476f-a537-75dce0d518c3 service nova] Lock "d1516acc-354e-41f6-a639-61dea870b11e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:44:27 user nova-compute[71509]: DEBUG nova.compute.manager [req-58bb6bb0-4d41-4a36-a43b-d98c6b11120c req-1969d081-8d52-476f-a537-75dce0d518c3 service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] No waiting events found dispatching network-vif-plugged-328d2b64-7bc6-425a-b3a4-8cda754ffd56 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:44:27 user nova-compute[71509]: WARNING nova.compute.manager [req-58bb6bb0-4d41-4a36-a43b-d98c6b11120c req-1969d081-8d52-476f-a537-75dce0d518c3 service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Received unexpected event network-vif-plugged-328d2b64-7bc6-425a-b3a4-8cda754ffd56 for instance with vm_state building and task_state spawning.
Apr 14 10:44:27 user nova-compute[71509]: DEBUG nova.compute.manager [req-58bb6bb0-4d41-4a36-a43b-d98c6b11120c req-1969d081-8d52-476f-a537-75dce0d518c3 service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Received event network-vif-plugged-328d2b64-7bc6-425a-b3a4-8cda754ffd56 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:44:27 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-58bb6bb0-4d41-4a36-a43b-d98c6b11120c req-1969d081-8d52-476f-a537-75dce0d518c3 service nova] Acquiring lock "d1516acc-354e-41f6-a639-61dea870b11e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:44:27 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-58bb6bb0-4d41-4a36-a43b-d98c6b11120c req-1969d081-8d52-476f-a537-75dce0d518c3 service nova] Lock "d1516acc-354e-41f6-a639-61dea870b11e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:44:27 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-58bb6bb0-4d41-4a36-a43b-d98c6b11120c req-1969d081-8d52-476f-a537-75dce0d518c3 service nova] Lock "d1516acc-354e-41f6-a639-61dea870b11e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:44:27 user nova-compute[71509]: DEBUG nova.compute.manager [req-58bb6bb0-4d41-4a36-a43b-d98c6b11120c req-1969d081-8d52-476f-a537-75dce0d518c3 service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] No waiting events found dispatching network-vif-plugged-328d2b64-7bc6-425a-b3a4-8cda754ffd56 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:44:27 user nova-compute[71509]: WARNING nova.compute.manager [req-58bb6bb0-4d41-4a36-a43b-d98c6b11120c req-1969d081-8d52-476f-a537-75dce0d518c3 service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Received unexpected event network-vif-plugged-328d2b64-7bc6-425a-b3a4-8cda754ffd56 for instance with vm_state building and task_state spawning.
Apr 14 10:44:27 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:27 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:28 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:28 user nova-compute[71509]: DEBUG nova.compute.manager [req-bdc3bcdf-003b-45ab-bfad-a1a8f6f3825f req-39956206-65b0-425f-a6fa-27d9cd32d1ce service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Received event network-vif-plugged-23214923-0217-4046-9a68-675f2ee8e42d {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:44:28 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-bdc3bcdf-003b-45ab-bfad-a1a8f6f3825f req-39956206-65b0-425f-a6fa-27d9cd32d1ce service nova] Acquiring lock "d1516acc-354e-41f6-a639-61dea870b11e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:44:28 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-bdc3bcdf-003b-45ab-bfad-a1a8f6f3825f req-39956206-65b0-425f-a6fa-27d9cd32d1ce service nova] Lock "d1516acc-354e-41f6-a639-61dea870b11e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:44:28 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-bdc3bcdf-003b-45ab-bfad-a1a8f6f3825f req-39956206-65b0-425f-a6fa-27d9cd32d1ce service nova] Lock "d1516acc-354e-41f6-a639-61dea870b11e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:44:28 user nova-compute[71509]: DEBUG nova.compute.manager [req-bdc3bcdf-003b-45ab-bfad-a1a8f6f3825f req-39956206-65b0-425f-a6fa-27d9cd32d1ce service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] No waiting events found dispatching network-vif-plugged-23214923-0217-4046-9a68-675f2ee8e42d {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:44:28 user nova-compute[71509]: WARNING nova.compute.manager [req-bdc3bcdf-003b-45ab-bfad-a1a8f6f3825f req-39956206-65b0-425f-a6fa-27d9cd32d1ce service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Received unexpected event network-vif-plugged-23214923-0217-4046-9a68-675f2ee8e42d for instance with vm_state building and task_state spawning.
Apr 14 10:44:28 user nova-compute[71509]: DEBUG nova.compute.manager [req-bdc3bcdf-003b-45ab-bfad-a1a8f6f3825f req-39956206-65b0-425f-a6fa-27d9cd32d1ce service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Received event network-vif-plugged-4d65e4a1-4cea-4636-8ad8-21065de3c747 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:44:28 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-bdc3bcdf-003b-45ab-bfad-a1a8f6f3825f req-39956206-65b0-425f-a6fa-27d9cd32d1ce service nova] Acquiring lock "d1516acc-354e-41f6-a639-61dea870b11e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:44:28 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-bdc3bcdf-003b-45ab-bfad-a1a8f6f3825f req-39956206-65b0-425f-a6fa-27d9cd32d1ce service nova] Lock "d1516acc-354e-41f6-a639-61dea870b11e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:44:28 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-bdc3bcdf-003b-45ab-bfad-a1a8f6f3825f req-39956206-65b0-425f-a6fa-27d9cd32d1ce service nova] Lock "d1516acc-354e-41f6-a639-61dea870b11e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:44:28 user nova-compute[71509]: DEBUG nova.compute.manager [req-bdc3bcdf-003b-45ab-bfad-a1a8f6f3825f req-39956206-65b0-425f-a6fa-27d9cd32d1ce service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] No waiting events found dispatching network-vif-plugged-4d65e4a1-4cea-4636-8ad8-21065de3c747 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:44:28 user nova-compute[71509]: WARNING nova.compute.manager [req-bdc3bcdf-003b-45ab-bfad-a1a8f6f3825f req-39956206-65b0-425f-a6fa-27d9cd32d1ce service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Received unexpected event network-vif-plugged-4d65e4a1-4cea-4636-8ad8-21065de3c747 for instance with vm_state building and task_state spawning.
Apr 14 10:44:28 user nova-compute[71509]: DEBUG nova.compute.manager [req-bdc3bcdf-003b-45ab-bfad-a1a8f6f3825f req-39956206-65b0-425f-a6fa-27d9cd32d1ce service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Received event network-vif-plugged-4d65e4a1-4cea-4636-8ad8-21065de3c747 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:44:28 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-bdc3bcdf-003b-45ab-bfad-a1a8f6f3825f req-39956206-65b0-425f-a6fa-27d9cd32d1ce service nova] Acquiring lock "d1516acc-354e-41f6-a639-61dea870b11e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:44:28 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-bdc3bcdf-003b-45ab-bfad-a1a8f6f3825f req-39956206-65b0-425f-a6fa-27d9cd32d1ce service nova] Lock "d1516acc-354e-41f6-a639-61dea870b11e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:44:28 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-bdc3bcdf-003b-45ab-bfad-a1a8f6f3825f req-39956206-65b0-425f-a6fa-27d9cd32d1ce service nova] Lock "d1516acc-354e-41f6-a639-61dea870b11e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:44:28 user nova-compute[71509]: DEBUG nova.compute.manager [req-bdc3bcdf-003b-45ab-bfad-a1a8f6f3825f req-39956206-65b0-425f-a6fa-27d9cd32d1ce service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] No waiting events found dispatching network-vif-plugged-4d65e4a1-4cea-4636-8ad8-21065de3c747 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:44:28 user nova-compute[71509]: WARNING nova.compute.manager [req-bdc3bcdf-003b-45ab-bfad-a1a8f6f3825f req-39956206-65b0-425f-a6fa-27d9cd32d1ce service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Received unexpected event network-vif-plugged-4d65e4a1-4cea-4636-8ad8-21065de3c747 for instance with vm_state building and task_state spawning.
Apr 14 10:44:28 user nova-compute[71509]: DEBUG nova.compute.manager [req-bdc3bcdf-003b-45ab-bfad-a1a8f6f3825f req-39956206-65b0-425f-a6fa-27d9cd32d1ce service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Received event network-vif-plugged-d70f6f4d-f2bc-4d5e-9e98-a0daa1b35a0f {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:44:28 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-bdc3bcdf-003b-45ab-bfad-a1a8f6f3825f req-39956206-65b0-425f-a6fa-27d9cd32d1ce service nova] Acquiring lock "d1516acc-354e-41f6-a639-61dea870b11e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:44:28 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-bdc3bcdf-003b-45ab-bfad-a1a8f6f3825f req-39956206-65b0-425f-a6fa-27d9cd32d1ce service nova] Lock "d1516acc-354e-41f6-a639-61dea870b11e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:44:28 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-bdc3bcdf-003b-45ab-bfad-a1a8f6f3825f req-39956206-65b0-425f-a6fa-27d9cd32d1ce service nova] Lock "d1516acc-354e-41f6-a639-61dea870b11e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:44:28 user nova-compute[71509]: DEBUG nova.compute.manager [req-bdc3bcdf-003b-45ab-bfad-a1a8f6f3825f req-39956206-65b0-425f-a6fa-27d9cd32d1ce service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] No waiting events found dispatching network-vif-plugged-d70f6f4d-f2bc-4d5e-9e98-a0daa1b35a0f {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:44:28 user nova-compute[71509]: WARNING nova.compute.manager [req-bdc3bcdf-003b-45ab-bfad-a1a8f6f3825f req-39956206-65b0-425f-a6fa-27d9cd32d1ce service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Received unexpected event network-vif-plugged-d70f6f4d-f2bc-4d5e-9e98-a0daa1b35a0f for instance with vm_state building and task_state spawning.
Apr 14 10:44:28 user nova-compute[71509]: DEBUG nova.compute.manager [req-bdc3bcdf-003b-45ab-bfad-a1a8f6f3825f req-39956206-65b0-425f-a6fa-27d9cd32d1ce service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Received event network-vif-plugged-d70f6f4d-f2bc-4d5e-9e98-a0daa1b35a0f {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:44:28 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-bdc3bcdf-003b-45ab-bfad-a1a8f6f3825f req-39956206-65b0-425f-a6fa-27d9cd32d1ce service nova] Acquiring lock "d1516acc-354e-41f6-a639-61dea870b11e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:44:28 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-bdc3bcdf-003b-45ab-bfad-a1a8f6f3825f req-39956206-65b0-425f-a6fa-27d9cd32d1ce service nova] Lock "d1516acc-354e-41f6-a639-61dea870b11e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:44:28 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-bdc3bcdf-003b-45ab-bfad-a1a8f6f3825f req-39956206-65b0-425f-a6fa-27d9cd32d1ce service nova] Lock "d1516acc-354e-41f6-a639-61dea870b11e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:44:28 user nova-compute[71509]: DEBUG nova.compute.manager [req-bdc3bcdf-003b-45ab-bfad-a1a8f6f3825f req-39956206-65b0-425f-a6fa-27d9cd32d1ce service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] No waiting events found dispatching network-vif-plugged-d70f6f4d-f2bc-4d5e-9e98-a0daa1b35a0f {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:44:28 user nova-compute[71509]: WARNING nova.compute.manager [req-bdc3bcdf-003b-45ab-bfad-a1a8f6f3825f req-39956206-65b0-425f-a6fa-27d9cd32d1ce service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Received unexpected event network-vif-plugged-d70f6f4d-f2bc-4d5e-9e98-a0daa1b35a0f for instance with vm_state building and task_state spawning.
Apr 14 10:44:28 user nova-compute[71509]: DEBUG nova.compute.manager [req-bdc3bcdf-003b-45ab-bfad-a1a8f6f3825f req-39956206-65b0-425f-a6fa-27d9cd32d1ce service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Received event network-vif-plugged-6e295a29-0297-49c0-9298-7d3a41a07585 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:44:28 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-bdc3bcdf-003b-45ab-bfad-a1a8f6f3825f req-39956206-65b0-425f-a6fa-27d9cd32d1ce service nova] Acquiring lock "d1516acc-354e-41f6-a639-61dea870b11e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:44:28 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-bdc3bcdf-003b-45ab-bfad-a1a8f6f3825f req-39956206-65b0-425f-a6fa-27d9cd32d1ce service nova] Lock "d1516acc-354e-41f6-a639-61dea870b11e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:44:28 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-bdc3bcdf-003b-45ab-bfad-a1a8f6f3825f req-39956206-65b0-425f-a6fa-27d9cd32d1ce service nova] Lock "d1516acc-354e-41f6-a639-61dea870b11e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:44:28 user nova-compute[71509]: DEBUG nova.compute.manager [req-bdc3bcdf-003b-45ab-bfad-a1a8f6f3825f req-39956206-65b0-425f-a6fa-27d9cd32d1ce service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] No waiting events found dispatching network-vif-plugged-6e295a29-0297-49c0-9298-7d3a41a07585 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:44:28 user nova-compute[71509]: WARNING nova.compute.manager [req-bdc3bcdf-003b-45ab-bfad-a1a8f6f3825f req-39956206-65b0-425f-a6fa-27d9cd32d1ce service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Received unexpected event network-vif-plugged-6e295a29-0297-49c0-9298-7d3a41a07585 for instance with vm_state building and task_state spawning.
Apr 14 10:44:28 user nova-compute[71509]: DEBUG nova.compute.manager [req-bdc3bcdf-003b-45ab-bfad-a1a8f6f3825f req-39956206-65b0-425f-a6fa-27d9cd32d1ce service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Received event network-vif-plugged-6e295a29-0297-49c0-9298-7d3a41a07585 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:44:28 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-bdc3bcdf-003b-45ab-bfad-a1a8f6f3825f req-39956206-65b0-425f-a6fa-27d9cd32d1ce service nova] Acquiring lock "d1516acc-354e-41f6-a639-61dea870b11e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:44:28 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-bdc3bcdf-003b-45ab-bfad-a1a8f6f3825f req-39956206-65b0-425f-a6fa-27d9cd32d1ce service nova] Lock "d1516acc-354e-41f6-a639-61dea870b11e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:44:28 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-bdc3bcdf-003b-45ab-bfad-a1a8f6f3825f req-39956206-65b0-425f-a6fa-27d9cd32d1ce service nova] Lock "d1516acc-354e-41f6-a639-61dea870b11e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:44:28 user nova-compute[71509]: DEBUG nova.compute.manager [req-bdc3bcdf-003b-45ab-bfad-a1a8f6f3825f req-39956206-65b0-425f-a6fa-27d9cd32d1ce service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] No waiting events found dispatching network-vif-plugged-6e295a29-0297-49c0-9298-7d3a41a07585 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:44:28 user nova-compute[71509]: WARNING nova.compute.manager [req-bdc3bcdf-003b-45ab-bfad-a1a8f6f3825f req-39956206-65b0-425f-a6fa-27d9cd32d1ce service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Received unexpected event network-vif-plugged-6e295a29-0297-49c0-9298-7d3a41a07585 for instance with vm_state building and task_state spawning.
Apr 14 10:44:28 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:28 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:28 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:28 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:28 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:29 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:29 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:29 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:44:29 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:44:29 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:44:29 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:44:29 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681469069.5633976, d1516acc-354e-41f6-a639-61dea870b11e => Resumed> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 10:44:29 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: d1516acc-354e-41f6-a639-61dea870b11e] VM Resumed (Lifecycle Event)
Apr 14 10:44:29 user nova-compute[71509]: DEBUG nova.compute.manager [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Instance event wait completed in 0 seconds for  {{(pid=71509) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 10:44:29 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Guest created on hypervisor {{(pid=71509) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 10:44:29 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Instance spawned successfully.
Apr 14 10:44:29 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 10:44:29 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:44:29 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 10:44:29 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Found default for hw_cdrom_bus of ide {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:44:29 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Found default for hw_disk_bus of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:44:29 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Found default for hw_input_bus of None {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:44:29 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Found default for hw_pointer_model of None {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:44:29 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Found default for hw_video_model of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:44:29 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Found default for hw_vif_model of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:44:29 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: d1516acc-354e-41f6-a639-61dea870b11e] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 10:44:29 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681469069.5647907, d1516acc-354e-41f6-a639-61dea870b11e => Started> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 10:44:29 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: d1516acc-354e-41f6-a639-61dea870b11e] VM Started (Lifecycle Event)
Apr 14 10:44:29 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:44:29 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 10:44:29 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: d1516acc-354e-41f6-a639-61dea870b11e] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 10:44:29 user nova-compute[71509]: INFO nova.compute.manager [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Took 13.85 seconds to spawn the instance on the hypervisor.
Apr 14 10:44:29 user nova-compute[71509]: DEBUG nova.compute.manager [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:44:29 user nova-compute[71509]: INFO nova.compute.manager [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Took 33.72 seconds to build instance.
Apr 14 10:44:29 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-6b9c43a1-f1f7-411a-a6a2-48b47032f9b2 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Lock "d1516acc-354e-41f6-a639-61dea870b11e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 33.818s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:44:30 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:44:30 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:44:30 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:44:32 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:32 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-17f6814c-8e20-4418-804b-01cbbcd6ce05 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Acquiring lock "c90a9b99-0985-403b-b4d8-eaa8c2eed88a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:44:32 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-17f6814c-8e20-4418-804b-01cbbcd6ce05 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Lock "c90a9b99-0985-403b-b4d8-eaa8c2eed88a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:44:32 user nova-compute[71509]: DEBUG nova.objects.instance [None req-17f6814c-8e20-4418-804b-01cbbcd6ce05 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Lazy-loading 'flavor' on Instance uuid c90a9b99-0985-403b-b4d8-eaa8c2eed88a {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:44:33 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:33 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-17f6814c-8e20-4418-804b-01cbbcd6ce05 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Lock "c90a9b99-0985-403b-b4d8-eaa8c2eed88a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.093s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:44:33 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-17f6814c-8e20-4418-804b-01cbbcd6ce05 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Acquiring lock "c90a9b99-0985-403b-b4d8-eaa8c2eed88a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:44:33 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-17f6814c-8e20-4418-804b-01cbbcd6ce05 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Lock "c90a9b99-0985-403b-b4d8-eaa8c2eed88a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:44:33 user nova-compute[71509]: INFO nova.compute.manager [None req-17f6814c-8e20-4418-804b-01cbbcd6ce05 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] [instance: c90a9b99-0985-403b-b4d8-eaa8c2eed88a] Attaching volume a1908b59-2946-48a2-b435-29a931e13ce3 to /dev/vdb
Apr 14 10:44:33 user nova-compute[71509]: DEBUG os_brick.utils [None req-17f6814c-8e20-4418-804b-01cbbcd6ce05 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 10:44:33 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:33 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:44:33 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[d36ceb80-b5ba-4dea-9fdf-5c60892b9a18]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50119df3c417\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:44:33 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:33 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:44:33 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d099515-47e1-4930-b4a9-e85338da2f75]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:44:33 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:33 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:44:33 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[5781d72f-ee9b-4e0a-a87e-f7e966e6bd52]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:44:33 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[3765859b-561b-46fd-8557-14b1d9351e8c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:44:33 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-17f6814c-8e20-4418-804b-01cbbcd6ce05 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Running cmd (subprocess): nvme version {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:33 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-17f6814c-8e20-4418-804b-01cbbcd6ce05 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] 'nvme version' failed. Not Retrying. {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 10:44:33 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.nvmeof [None req-17f6814c-8e20-4418-804b-01cbbcd6ce05 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] nvme not present on system {{(pid=71509) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 10:44:33 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:33 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 10:44:33 user nova-compute[71509]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 10:44:33 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[98865bba-a10c-4a20-bcd9-470c4d24da2e]: (4, '') {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:44:33 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-17f6814c-8e20-4418-804b-01cbbcd6ce05 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71509) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 10:44:33 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-17f6814c-8e20-4418-804b-01cbbcd6ce05 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71509) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 10:44:33 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-17f6814c-8e20-4418-804b-01cbbcd6ce05 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] LIGHTOS: no hostnqn found. {{(pid=71509) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 10:44:33 user nova-compute[71509]: DEBUG os_brick.utils [None req-17f6814c-8e20-4418-804b-01cbbcd6ce05 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50119df3c417', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 10:44:33 user nova-compute[71509]: DEBUG nova.virt.block_device [None req-17f6814c-8e20-4418-804b-01cbbcd6ce05 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] [instance: c90a9b99-0985-403b-b4d8-eaa8c2eed88a] Updating existing volume attachment record: d71a51b8-620a-4773-9b28-44043bf55403 {{(pid=71509) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 10:44:33 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:44:33 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Starting heal instance info cache {{(pid=71509) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 10:44:33 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "refresh_cache-97f20661-8b60-439e-b7af-2fc2013c5ade" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:44:33 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquired lock "refresh_cache-97f20661-8b60-439e-b7af-2fc2013c5ade" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:44:33 user nova-compute[71509]: DEBUG nova.network.neutron [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] Forcefully refreshing network info cache for instance {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 10:44:33 user nova-compute[71509]: INFO nova.compute.manager [None req-2b689b65-4e39-47a5-bf9f-dbab1861c38d tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: 97820f17-22d1-4ec3-9721-1edadccc794a] Rescuing
Apr 14 10:44:33 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-2b689b65-4e39-47a5-bf9f-dbab1861c38d tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Acquiring lock "refresh_cache-97820f17-22d1-4ec3-9721-1edadccc794a" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:44:33 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-2b689b65-4e39-47a5-bf9f-dbab1861c38d tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Acquired lock "refresh_cache-97820f17-22d1-4ec3-9721-1edadccc794a" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:44:33 user nova-compute[71509]: DEBUG nova.network.neutron [None req-2b689b65-4e39-47a5-bf9f-dbab1861c38d tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: 97820f17-22d1-4ec3-9721-1edadccc794a] Building network info cache for instance {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 10:44:34 user nova-compute[71509]: DEBUG nova.network.neutron [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] Updating instance_info_cache with network_info: [{"id": "270b85b0-1832-4118-a8b0-ff784587b58a", "address": "fa:16:3e:75:ba:ae", "network": {"id": "22eb5f87-be4d-447d-bafe-25e0284ea3ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-787804772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf93e5dac50342d0b65ef09711401e99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap270b85b0-18", "ovs_interfaceid": "270b85b0-1832-4118-a8b0-ff784587b58a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:44:34 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Releasing lock "refresh_cache-97f20661-8b60-439e-b7af-2fc2013c5ade" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:44:34 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] Updated the network info_cache for instance {{(pid=71509) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 10:44:34 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:44:34 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:44:34 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:44:34 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:44:34 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Auditing locally available compute resources for user (node: user) {{(pid=71509) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 10:44:35 user nova-compute[71509]: DEBUG nova.network.neutron [None req-2b689b65-4e39-47a5-bf9f-dbab1861c38d tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: 97820f17-22d1-4ec3-9721-1edadccc794a] Updating instance_info_cache with network_info: [{"id": "dea3830d-9f49-4d5e-953b-eec2ee969b02", "address": "fa:16:3e:77:58:9a", "network": {"id": "22eb5f87-be4d-447d-bafe-25e0284ea3ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-787804772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf93e5dac50342d0b65ef09711401e99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdea3830d-9f", "ovs_interfaceid": "dea3830d-9f49-4d5e-953b-eec2ee969b02", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:44:35 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-2b689b65-4e39-47a5-bf9f-dbab1861c38d tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Releasing lock "refresh_cache-97820f17-22d1-4ec3-9721-1edadccc794a" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:44:35 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:35 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:35 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97820f17-22d1-4ec3-9721-1edadccc794a/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:35 user nova-compute[71509]: DEBUG nova.compute.manager [req-fa695b1f-ee75-4a77-8f8b-2b597cb48949 req-2d23954e-d6db-4705-bc30-38628f8213e6 service nova] [instance: 97820f17-22d1-4ec3-9721-1edadccc794a] Received event network-vif-unplugged-dea3830d-9f49-4d5e-953b-eec2ee969b02 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:44:35 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-fa695b1f-ee75-4a77-8f8b-2b597cb48949 req-2d23954e-d6db-4705-bc30-38628f8213e6 service nova] Acquiring lock "97820f17-22d1-4ec3-9721-1edadccc794a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:44:35 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-fa695b1f-ee75-4a77-8f8b-2b597cb48949 req-2d23954e-d6db-4705-bc30-38628f8213e6 service nova] Lock "97820f17-22d1-4ec3-9721-1edadccc794a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:44:35 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-fa695b1f-ee75-4a77-8f8b-2b597cb48949 req-2d23954e-d6db-4705-bc30-38628f8213e6 service nova] Lock "97820f17-22d1-4ec3-9721-1edadccc794a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:44:35 user nova-compute[71509]: DEBUG nova.compute.manager [req-fa695b1f-ee75-4a77-8f8b-2b597cb48949 req-2d23954e-d6db-4705-bc30-38628f8213e6 service nova] [instance: 97820f17-22d1-4ec3-9721-1edadccc794a] No waiting events found dispatching network-vif-unplugged-dea3830d-9f49-4d5e-953b-eec2ee969b02 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:44:35 user nova-compute[71509]: WARNING nova.compute.manager [req-fa695b1f-ee75-4a77-8f8b-2b597cb48949 req-2d23954e-d6db-4705-bc30-38628f8213e6 service nova] [instance: 97820f17-22d1-4ec3-9721-1edadccc794a] Received unexpected event network-vif-unplugged-dea3830d-9f49-4d5e-953b-eec2ee969b02 for instance with vm_state active and task_state rescuing.
Apr 14 10:44:35 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:35 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:35 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97820f17-22d1-4ec3-9721-1edadccc794a/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:44:35 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97820f17-22d1-4ec3-9721-1edadccc794a/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:36 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97820f17-22d1-4ec3-9721-1edadccc794a/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:44:36 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0e2af6d-3694-4166-a3d0-b5be1107c488/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:36 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: 97820f17-22d1-4ec3-9721-1edadccc794a] Instance destroyed successfully.
Apr 14 10:44:36 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-2b689b65-4e39-47a5-bf9f-dbab1861c38d tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: 97820f17-22d1-4ec3-9721-1edadccc794a] Attempting rescue
Apr 14 10:44:36 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-2b689b65-4e39-47a5-bf9f-dbab1861c38d tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71509) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 14 10:44:36 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-2b689b65-4e39-47a5-bf9f-dbab1861c38d tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: 97820f17-22d1-4ec3-9721-1edadccc794a] Instance directory exists: not creating {{(pid=71509) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 14 10:44:36 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-2b689b65-4e39-47a5-bf9f-dbab1861c38d tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: 97820f17-22d1-4ec3-9721-1edadccc794a] Creating image(s)
Apr 14 10:44:36 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-2b689b65-4e39-47a5-bf9f-dbab1861c38d tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Acquiring lock "/opt/stack/data/nova/instances/97820f17-22d1-4ec3-9721-1edadccc794a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:44:36 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-2b689b65-4e39-47a5-bf9f-dbab1861c38d tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "/opt/stack/data/nova/instances/97820f17-22d1-4ec3-9721-1edadccc794a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:44:36 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-2b689b65-4e39-47a5-bf9f-dbab1861c38d tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "/opt/stack/data/nova/instances/97820f17-22d1-4ec3-9721-1edadccc794a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:44:36 user nova-compute[71509]: DEBUG nova.objects.instance [None req-2b689b65-4e39-47a5-bf9f-dbab1861c38d tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lazy-loading 'trusted_certs' on Instance uuid 97820f17-22d1-4ec3-9721-1edadccc794a {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:44:36 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-2b689b65-4e39-47a5-bf9f-dbab1861c38d tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Acquiring lock "5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:44:36 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-2b689b65-4e39-47a5-bf9f-dbab1861c38d tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:44:36 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-2b689b65-4e39-47a5-bf9f-dbab1861c38d tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:36 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0e2af6d-3694-4166-a3d0-b5be1107c488/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:44:36 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0e2af6d-3694-4166-a3d0-b5be1107c488/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:36 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-2b689b65-4e39-47a5-bf9f-dbab1861c38d tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json" returned: 0 in 0.163s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:44:36 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-2b689b65-4e39-47a5-bf9f-dbab1861c38d tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18,backing_fmt=raw /opt/stack/data/nova/instances/97820f17-22d1-4ec3-9721-1edadccc794a/disk.rescue {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:36 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c0e2af6d-3694-4166-a3d0-b5be1107c488/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:44:36 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-2b689b65-4e39-47a5-bf9f-dbab1861c38d tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18,backing_fmt=raw /opt/stack/data/nova/instances/97820f17-22d1-4ec3-9721-1edadccc794a/disk.rescue" returned: 0 in 0.064s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:44:36 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-2b689b65-4e39-47a5-bf9f-dbab1861c38d tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:44:36 user nova-compute[71509]: DEBUG nova.objects.instance [None req-2b689b65-4e39-47a5-bf9f-dbab1861c38d tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lazy-loading 'migration_context' on Instance uuid 97820f17-22d1-4ec3-9721-1edadccc794a {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:44:36 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-2b689b65-4e39-47a5-bf9f-dbab1861c38d tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: 97820f17-22d1-4ec3-9721-1edadccc794a] Created local disks {{(pid=71509) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 10:44:36 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-2b689b65-4e39-47a5-bf9f-dbab1861c38d tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: 97820f17-22d1-4ec3-9721-1edadccc794a] Start _get_guest_xml network_info=[{"id": "dea3830d-9f49-4d5e-953b-eec2ee969b02", "address": "fa:16:3e:77:58:9a", "network": {"id": "22eb5f87-be4d-447d-bafe-25e0284ea3ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-787804772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-787804772-network", "vif_mac": "fa:16:3e:77:58:9a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf93e5dac50342d0b65ef09711401e99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdea3830d-9f", "ovs_interfaceid": "dea3830d-9f49-4d5e-953b-eec2ee969b02", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T10:38:55Z,direct_url=<?>,disk_format='qcow2',id=048ec0ee-0465-448d-8b4c-f072acb101dc,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='9742d6ad20cf48d9bab0fdbcc9491db9',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T10:38:57Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '048ec0ee-0465-448d-8b4c-f072acb101dc', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=71509) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 10:44:36 user nova-compute[71509]: DEBUG nova.objects.instance [None req-2b689b65-4e39-47a5-bf9f-dbab1861c38d tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lazy-loading 'resources' on Instance uuid 97820f17-22d1-4ec3-9721-1edadccc794a {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:44:36 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4abb549-8f36-40c5-971f-8accbb14ff86/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:36 user nova-compute[71509]: DEBUG nova.objects.instance [None req-2b689b65-4e39-47a5-bf9f-dbab1861c38d tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lazy-loading 'numa_topology' on Instance uuid 97820f17-22d1-4ec3-9721-1edadccc794a {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:44:36 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-2b689b65-4e39-47a5-bf9f-dbab1861c38d tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:44:36 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-2b689b65-4e39-47a5-bf9f-dbab1861c38d tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:44:36 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-2b689b65-4e39-47a5-bf9f-dbab1861c38d tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71509) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 10:44:36 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-2b689b65-4e39-47a5-bf9f-dbab1861c38d tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T10:40:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T10:38:55Z,direct_url=<?>,disk_format='qcow2',id=048ec0ee-0465-448d-8b4c-f072acb101dc,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='9742d6ad20cf48d9bab0fdbcc9491db9',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T10:38:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 10:44:36 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-2b689b65-4e39-47a5-bf9f-dbab1861c38d tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Flavor limits 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 10:44:36 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-2b689b65-4e39-47a5-bf9f-dbab1861c38d tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Image limits 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 10:44:36 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-2b689b65-4e39-47a5-bf9f-dbab1861c38d tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Flavor pref 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 10:44:36 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-2b689b65-4e39-47a5-bf9f-dbab1861c38d tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Image pref 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 10:44:36 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-2b689b65-4e39-47a5-bf9f-dbab1861c38d tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 10:44:36 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-2b689b65-4e39-47a5-bf9f-dbab1861c38d tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 10:44:36 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-2b689b65-4e39-47a5-bf9f-dbab1861c38d tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71509) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 10:44:36 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-2b689b65-4e39-47a5-bf9f-dbab1861c38d tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Got 1 possible topologies {{(pid=71509) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 10:44:36 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-2b689b65-4e39-47a5-bf9f-dbab1861c38d tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 10:44:36 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-2b689b65-4e39-47a5-bf9f-dbab1861c38d tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 10:44:36 user nova-compute[71509]: DEBUG nova.objects.instance [None req-2b689b65-4e39-47a5-bf9f-dbab1861c38d tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lazy-loading 'vcpu_model' on Instance uuid 97820f17-22d1-4ec3-9721-1edadccc794a {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:44:36 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-2b689b65-4e39-47a5-bf9f-dbab1861c38d tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T10:42:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-97128358',display_name='tempest-ServerRescueNegativeTestJSON-server-97128358',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-97128358',id=3,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T10:43:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bf93e5dac50342d0b65ef09711401e99',ramdisk_id='',reservation_id='r-1drc6j5k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-563868574',owner_user_name='tempest-ServerRescueNegativeTestJSON-563868574-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T10:43:01Z,user_data=None,user_id='e359578dcbb24755a216415053d415ef',uuid=97820f17-22d1-4ec3-9721-1edadccc794a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dea3830d-9f49-4d5e-953b-eec2ee969b02", "address": "fa:16:3e:77:58:9a", "network": {"id": "22eb5f87-be4d-447d-bafe-25e0284ea3ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-787804772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-787804772-network", "vif_mac": "fa:16:3e:77:58:9a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf93e5dac50342d0b65ef09711401e99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdea3830d-9f", "ovs_interfaceid": "dea3830d-9f49-4d5e-953b-eec2ee969b02", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71509) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 10:44:36 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-2b689b65-4e39-47a5-bf9f-dbab1861c38d tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Converting VIF {"id": "dea3830d-9f49-4d5e-953b-eec2ee969b02", "address": "fa:16:3e:77:58:9a", "network": {"id": "22eb5f87-be4d-447d-bafe-25e0284ea3ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-787804772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-787804772-network", "vif_mac": "fa:16:3e:77:58:9a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf93e5dac50342d0b65ef09711401e99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdea3830d-9f", "ovs_interfaceid": "dea3830d-9f49-4d5e-953b-eec2ee969b02", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:44:36 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-2b689b65-4e39-47a5-bf9f-dbab1861c38d tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:77:58:9a,bridge_name='br-int',has_traffic_filtering=True,id=dea3830d-9f49-4d5e-953b-eec2ee969b02,network=Network(22eb5f87-be4d-447d-bafe-25e0284ea3ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdea3830d-9f') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:44:36 user nova-compute[71509]: DEBUG nova.objects.instance [None req-2b689b65-4e39-47a5-bf9f-dbab1861c38d tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lazy-loading 'pci_devices' on Instance uuid 97820f17-22d1-4ec3-9721-1edadccc794a {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:44:36 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4abb549-8f36-40c5-971f-8accbb14ff86/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:44:36 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4abb549-8f36-40c5-971f-8accbb14ff86/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:36 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-2b689b65-4e39-47a5-bf9f-dbab1861c38d tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: 97820f17-22d1-4ec3-9721-1edadccc794a] End _get_guest_xml xml=<domain type="kvm">
Apr 14 10:44:36 user nova-compute[71509]:   <uuid>97820f17-22d1-4ec3-9721-1edadccc794a</uuid>
Apr 14 10:44:36 user nova-compute[71509]:   <name>instance-00000003</name>
Apr 14 10:44:36 user nova-compute[71509]:   <memory>131072</memory>
Apr 14 10:44:36 user nova-compute[71509]:   <vcpu>1</vcpu>
Apr 14 10:44:36 user nova-compute[71509]:   <metadata>
Apr 14 10:44:36 user nova-compute[71509]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 10:44:36 user nova-compute[71509]:       <nova:package version="0.0.0"/>
Apr 14 10:44:36 user nova-compute[71509]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-97128358</nova:name>
Apr 14 10:44:36 user nova-compute[71509]:       <nova:creationTime>2023-04-14 10:44:36</nova:creationTime>
Apr 14 10:44:36 user nova-compute[71509]:       <nova:flavor name="m1.nano">
Apr 14 10:44:36 user nova-compute[71509]:         <nova:memory>128</nova:memory>
Apr 14 10:44:36 user nova-compute[71509]:         <nova:disk>1</nova:disk>
Apr 14 10:44:36 user nova-compute[71509]:         <nova:swap>0</nova:swap>
Apr 14 10:44:36 user nova-compute[71509]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 10:44:36 user nova-compute[71509]:         <nova:vcpus>1</nova:vcpus>
Apr 14 10:44:36 user nova-compute[71509]:       </nova:flavor>
Apr 14 10:44:36 user nova-compute[71509]:       <nova:owner>
Apr 14 10:44:36 user nova-compute[71509]:         <nova:user uuid="e359578dcbb24755a216415053d415ef">tempest-ServerRescueNegativeTestJSON-563868574-project-member</nova:user>
Apr 14 10:44:36 user nova-compute[71509]:         <nova:project uuid="bf93e5dac50342d0b65ef09711401e99">tempest-ServerRescueNegativeTestJSON-563868574</nova:project>
Apr 14 10:44:36 user nova-compute[71509]:       </nova:owner>
Apr 14 10:44:36 user nova-compute[71509]:       <nova:root type="image" uuid="048ec0ee-0465-448d-8b4c-f072acb101dc"/>
Apr 14 10:44:36 user nova-compute[71509]:       <nova:ports>
Apr 14 10:44:36 user nova-compute[71509]:         <nova:port uuid="dea3830d-9f49-4d5e-953b-eec2ee969b02">
Apr 14 10:44:36 user nova-compute[71509]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 14 10:44:36 user nova-compute[71509]:         </nova:port>
Apr 14 10:44:36 user nova-compute[71509]:       </nova:ports>
Apr 14 10:44:36 user nova-compute[71509]:     </nova:instance>
Apr 14 10:44:36 user nova-compute[71509]:   </metadata>
Apr 14 10:44:36 user nova-compute[71509]:   <sysinfo type="smbios">
Apr 14 10:44:36 user nova-compute[71509]:     <system>
Apr 14 10:44:36 user nova-compute[71509]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 10:44:36 user nova-compute[71509]:       <entry name="product">OpenStack Nova</entry>
Apr 14 10:44:36 user nova-compute[71509]:       <entry name="version">0.0.0</entry>
Apr 14 10:44:36 user nova-compute[71509]:       <entry name="serial">97820f17-22d1-4ec3-9721-1edadccc794a</entry>
Apr 14 10:44:36 user nova-compute[71509]:       <entry name="uuid">97820f17-22d1-4ec3-9721-1edadccc794a</entry>
Apr 14 10:44:36 user nova-compute[71509]:       <entry name="family">Virtual Machine</entry>
Apr 14 10:44:36 user nova-compute[71509]:     </system>
Apr 14 10:44:36 user nova-compute[71509]:   </sysinfo>
Apr 14 10:44:36 user nova-compute[71509]:   <os>
Apr 14 10:44:36 user nova-compute[71509]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 10:44:36 user nova-compute[71509]:     <smbios mode="sysinfo"/>
Apr 14 10:44:36 user nova-compute[71509]:   </os>
Apr 14 10:44:36 user nova-compute[71509]:   <features>
Apr 14 10:44:36 user nova-compute[71509]:     <acpi/>
Apr 14 10:44:36 user nova-compute[71509]:     <apic/>
Apr 14 10:44:36 user nova-compute[71509]:     <vmcoreinfo/>
Apr 14 10:44:36 user nova-compute[71509]:   </features>
Apr 14 10:44:36 user nova-compute[71509]:   <clock offset="utc">
Apr 14 10:44:36 user nova-compute[71509]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 10:44:36 user nova-compute[71509]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 10:44:36 user nova-compute[71509]:     <timer name="hpet" present="no"/>
Apr 14 10:44:36 user nova-compute[71509]:   </clock>
Apr 14 10:44:36 user nova-compute[71509]:   <cpu mode="custom" match="exact">
Apr 14 10:44:36 user nova-compute[71509]:     <model>Nehalem</model>
Apr 14 10:44:36 user nova-compute[71509]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 10:44:36 user nova-compute[71509]:   </cpu>
Apr 14 10:44:36 user nova-compute[71509]:   <devices>
Apr 14 10:44:36 user nova-compute[71509]:     <disk type="file" device="disk">
Apr 14 10:44:36 user nova-compute[71509]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 10:44:36 user nova-compute[71509]:       <source file="/opt/stack/data/nova/instances/97820f17-22d1-4ec3-9721-1edadccc794a/disk.rescue"/>
Apr 14 10:44:36 user nova-compute[71509]:       <target dev="vda" bus="virtio"/>
Apr 14 10:44:36 user nova-compute[71509]:     </disk>
Apr 14 10:44:36 user nova-compute[71509]:     <disk type="file" device="disk">
Apr 14 10:44:36 user nova-compute[71509]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 10:44:36 user nova-compute[71509]:       <source file="/opt/stack/data/nova/instances/97820f17-22d1-4ec3-9721-1edadccc794a/disk"/>
Apr 14 10:44:36 user nova-compute[71509]:       <target dev="vdb" bus="virtio"/>
Apr 14 10:44:36 user nova-compute[71509]:     </disk>
Apr 14 10:44:36 user nova-compute[71509]:     <interface type="ethernet">
Apr 14 10:44:36 user nova-compute[71509]:       <mac address="fa:16:3e:77:58:9a"/>
Apr 14 10:44:36 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 10:44:36 user nova-compute[71509]:       <mtu size="1442"/>
Apr 14 10:44:36 user nova-compute[71509]:       <target dev="tapdea3830d-9f"/>
Apr 14 10:44:36 user nova-compute[71509]:     </interface>
Apr 14 10:44:36 user nova-compute[71509]:     <serial type="pty">
Apr 14 10:44:36 user nova-compute[71509]:       <log file="/opt/stack/data/nova/instances/97820f17-22d1-4ec3-9721-1edadccc794a/console.log" append="off"/>
Apr 14 10:44:36 user nova-compute[71509]:     </serial>
Apr 14 10:44:36 user nova-compute[71509]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 10:44:36 user nova-compute[71509]:     <video>
Apr 14 10:44:36 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 10:44:36 user nova-compute[71509]:     </video>
Apr 14 10:44:36 user nova-compute[71509]:     <rng model="virtio">
Apr 14 10:44:36 user nova-compute[71509]:       <backend model="random">/dev/urandom</backend>
Apr 14 10:44:36 user nova-compute[71509]:     </rng>
Apr 14 10:44:36 user nova-compute[71509]:     <controller type="usb" index="0" model="none"/>
Apr 14 10:44:36 user nova-compute[71509]:     <memballoon model="virtio">
Apr 14 10:44:36 user nova-compute[71509]:       <stats period="10"/>
Apr 14 10:44:36 user nova-compute[71509]:     </memballoon>
Apr 14 10:44:36 user nova-compute[71509]:   </devices>
Apr 14 10:44:36 user nova-compute[71509]: </domain>
Apr 14 10:44:36 user nova-compute[71509]:  {{(pid=71509) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 10:44:36 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: 97820f17-22d1-4ec3-9721-1edadccc794a] Instance destroyed successfully.
Apr 14 10:44:37 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4abb549-8f36-40c5-971f-8accbb14ff86/disk --force-share --output=json" returned: 0 in 0.326s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:44:37 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71509) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 10:44:37 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55178126-9766-4875-9122-39dcc87ce82c/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:37 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-2b689b65-4e39-47a5-bf9f-dbab1861c38d tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] No BDM found with device name vda, not building metadata. {{(pid=71509) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 10:44:37 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-2b689b65-4e39-47a5-bf9f-dbab1861c38d tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71509) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 10:44:37 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-2b689b65-4e39-47a5-bf9f-dbab1861c38d tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] No VIF found with MAC fa:16:3e:77:58:9a, not building metadata {{(pid=71509) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 10:44:37 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55178126-9766-4875-9122-39dcc87ce82c/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:44:37 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55178126-9766-4875-9122-39dcc87ce82c/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:37 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55178126-9766-4875-9122-39dcc87ce82c/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:44:37 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71509) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 10:44:37 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71509) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 10:44:37 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=71509) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 10:44:37 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6f539d8-4144-467b-ac69-44011c5b3564/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:37 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6f539d8-4144-467b-ac69-44011c5b3564/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:44:37 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6f539d8-4144-467b-ac69-44011c5b3564/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:37 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:37 user nova-compute[71509]: DEBUG nova.compute.manager [req-b4ea330f-78e6-4067-a9ac-32e08a5f5e48 req-82fe4bda-c0f5-467a-837f-d78f90544e09 service nova] [instance: 97820f17-22d1-4ec3-9721-1edadccc794a] Received event network-vif-plugged-dea3830d-9f49-4d5e-953b-eec2ee969b02 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:44:37 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-b4ea330f-78e6-4067-a9ac-32e08a5f5e48 req-82fe4bda-c0f5-467a-837f-d78f90544e09 service nova] Acquiring lock "97820f17-22d1-4ec3-9721-1edadccc794a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:44:37 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-b4ea330f-78e6-4067-a9ac-32e08a5f5e48 req-82fe4bda-c0f5-467a-837f-d78f90544e09 service nova] Lock "97820f17-22d1-4ec3-9721-1edadccc794a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:44:37 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-b4ea330f-78e6-4067-a9ac-32e08a5f5e48 req-82fe4bda-c0f5-467a-837f-d78f90544e09 service nova] Lock "97820f17-22d1-4ec3-9721-1edadccc794a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:44:37 user nova-compute[71509]: DEBUG nova.compute.manager [req-b4ea330f-78e6-4067-a9ac-32e08a5f5e48 req-82fe4bda-c0f5-467a-837f-d78f90544e09 service nova] [instance: 97820f17-22d1-4ec3-9721-1edadccc794a] No waiting events found dispatching network-vif-plugged-dea3830d-9f49-4d5e-953b-eec2ee969b02 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:44:37 user nova-compute[71509]: WARNING nova.compute.manager [req-b4ea330f-78e6-4067-a9ac-32e08a5f5e48 req-82fe4bda-c0f5-467a-837f-d78f90544e09 service nova] [instance: 97820f17-22d1-4ec3-9721-1edadccc794a] Received unexpected event network-vif-plugged-dea3830d-9f49-4d5e-953b-eec2ee969b02 for instance with vm_state active and task_state rescuing.
Apr 14 10:44:37 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6f539d8-4144-467b-ac69-44011c5b3564/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:44:37 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e6c800c-9b35-4e35-969e-c40367056dce/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:37 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e6c800c-9b35-4e35-969e-c40367056dce/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:44:37 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e6c800c-9b35-4e35-969e-c40367056dce/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:37 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e6c800c-9b35-4e35-969e-c40367056dce/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:44:37 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97f20661-8b60-439e-b7af-2fc2013c5ade/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:38 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:38 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97f20661-8b60-439e-b7af-2fc2013c5ade/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:44:38 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97f20661-8b60-439e-b7af-2fc2013c5ade/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:38 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97f20661-8b60-439e-b7af-2fc2013c5ade/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:44:38 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec16b4bc-5385-4eea-856f-710d52d0261d/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:38 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec16b4bc-5385-4eea-856f-710d52d0261d/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:44:38 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec16b4bc-5385-4eea-856f-710d52d0261d/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:38 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:38 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:38 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec16b4bc-5385-4eea-856f-710d52d0261d/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:44:38 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31f6ad8c-40d3-4b6e-af07-4848fafc431d/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:38 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:38 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31f6ad8c-40d3-4b6e-af07-4848fafc431d/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:44:38 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31f6ad8c-40d3-4b6e-af07-4848fafc431d/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:38 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:38 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31f6ad8c-40d3-4b6e-af07-4848fafc431d/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:44:38 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c90a9b99-0985-403b-b4d8-eaa8c2eed88a/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:38 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17f6814c-8e20-4418-804b-01cbbcd6ce05 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] [instance: c90a9b99-0985-403b-b4d8-eaa8c2eed88a] Calling os-brick to attach iSCSI Volume {{(pid=71509) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 10:44:38 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-17f6814c-8e20-4418-804b-01cbbcd6ce05 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0bf0749390>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a1908b59-2946-48a2-b435-29a931e13ce3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ItAzUCeP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 10:44:38 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-17f6814c-8e20-4418-804b-01cbbcd6ce05 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 10:44:38 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-17f6814c-8e20-4418-804b-01cbbcd6ce05 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 10:44:38 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-17f6814c-8e20-4418-804b-01cbbcd6ce05 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 10:44:38 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-17f6814c-8e20-4418-804b-01cbbcd6ce05 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 10:44:38 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-17f6814c-8e20-4418-804b-01cbbcd6ce05 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a1908b59-2946-48a2-b435-29a931e13ce3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 10:44:38 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-17f6814c-8e20-4418-804b-01cbbcd6ce05 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a1908b59-2946-48a2-b435-29a931e13ce3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 10:44:38 user nova-compute[71509]: INFO os_brick.initiator.connectors.iscsi [None req-17f6814c-8e20-4418-804b-01cbbcd6ce05 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 10:44:38 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1908b59-2946-48a2-b435-29a931e13ce3 -p 172.16.0.220:3260 {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:39 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1908b59-2946-48a2-b435-29a931e13ce3 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:44:39 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6d2f52a-dad3-4e29-9555-bdc3aab80422]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:44:39 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-17f6814c-8e20-4418-804b-01cbbcd6ce05 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 10:44:39 user nova-compute[71509]:  {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:44:39 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1908b59-2946-48a2-b435-29a931e13ce3 -p 172.16.0.220:3260 --interface default --op new {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:39 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c90a9b99-0985-403b-b4d8-eaa8c2eed88a/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:44:39 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c90a9b99-0985-403b-b4d8-eaa8c2eed88a/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:39 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1908b59-2946-48a2-b435-29a931e13ce3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:44:39 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d107a0e-b2a4-47ce-83df-5e6e163d82ab]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a1908b59-2946-48a2-b435-29a931e13ce3] added\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:44:39 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-17f6814c-8e20-4418-804b-01cbbcd6ce05 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a1908b59-2946-48a2-b435-29a931e13ce3] added
Apr 14 10:44:39 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:44:39 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1908b59-2946-48a2-b435-29a931e13ce3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:39 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1908b59-2946-48a2-b435-29a931e13ce3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:44:39 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1bf3d2d-00c8-49ce-a56b-816f21ea5323]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:44:39 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-17f6814c-8e20-4418-804b-01cbbcd6ce05 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:44:39 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1908b59-2946-48a2-b435-29a931e13ce3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:39 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1908b59-2946-48a2-b435-29a931e13ce3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:44:39 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[38b68e5c-92e3-4b70-b414-8d878220e276]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:44:39 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-17f6814c-8e20-4418-804b-01cbbcd6ce05 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:44:39 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1908b59-2946-48a2-b435-29a931e13ce3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ItAzUCeP {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:39 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1908b59-2946-48a2-b435-29a931e13ce3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ItAzUCeP" returned: 0 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:44:39 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[68134e65-76b0-4538-9645-5719769430f4]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:44:39 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-17f6814c-8e20-4418-804b-01cbbcd6ce05 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ItAzUCeP'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:44:39 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1908b59-2946-48a2-b435-29a931e13ce3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:39 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c90a9b99-0985-403b-b4d8-eaa8c2eed88a/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:44:39 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1908b59-2946-48a2-b435-29a931e13ce3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.031s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:44:39 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9909994-edd8-4118-b989-a4c98dc769a9]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:44:39 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-17f6814c-8e20-4418-804b-01cbbcd6ce05 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:44:39 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:39 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71509) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 10:44:39 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=71509) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 10:44:39 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] skipping disk /dev/sdh (vdc) as it is a volume {{(pid=71509) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 10:44:39 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:44:39 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[79076940-ab36-4f9e-9ab5-ed3fa519b6dc]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:44:39 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-17f6814c-8e20-4418-804b-01cbbcd6ce05 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee (non-flash)
Apr 14 10:44:39 user nova-compute[71509]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18 (non-flash)
Apr 14 10:44:39 user nova-compute[71509]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768 (non-flash)
Apr 14 10:44:39 user nova-compute[71509]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700 (non-flash)
Apr 14 10:44:39 user nova-compute[71509]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92 (non-flash)
Apr 14 10:44:39 user nova-compute[71509]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171 (non-flash)
Apr 14 10:44:39 user nova-compute[71509]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e (non-flash)
Apr 14 10:44:39 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:44:39 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-17f6814c-8e20-4418-804b-01cbbcd6ce05 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee (non-flash)
Apr 14 10:44:39 user nova-compute[71509]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18 (non-flash)
Apr 14 10:44:39 user nova-compute[71509]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768 (non-flash)
Apr 14 10:44:39 user nova-compute[71509]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700 (non-flash)
Apr 14 10:44:39 user nova-compute[71509]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92 (non-flash)
Apr 14 10:44:39 user nova-compute[71509]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171 (non-flash)
Apr 14 10:44:39 user nova-compute[71509]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e (non-flash)
Apr 14 10:44:39 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 10:44:39 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1908b59-2946-48a2-b435-29a931e13ce3 -p 172.16.0.220:3260 --login {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:41 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1908b59-2946-48a2-b435-29a931e13ce3 -p 172.16.0.220:3260 --login" returned: 0 in 0.092s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:44:41 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[b627641e-2502-40ee-abd6-3ade5cbf6087]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a1908b59-2946-48a2-b435-29a931e13ce3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a1908b59-2946-48a2-b435-29a931e13ce3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:44:41 user nova-compute[71509]: DEBUG nova.compute.manager [req-37348128-0b11-423d-a3e0-a20e0625b47a req-3faeab65-1767-4eae-bf2c-be6b1faee160 service nova] [instance: 97820f17-22d1-4ec3-9721-1edadccc794a] Received event network-vif-plugged-dea3830d-9f49-4d5e-953b-eec2ee969b02 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:44:41 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-37348128-0b11-423d-a3e0-a20e0625b47a req-3faeab65-1767-4eae-bf2c-be6b1faee160 service nova] Acquiring lock "97820f17-22d1-4ec3-9721-1edadccc794a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:44:41 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-37348128-0b11-423d-a3e0-a20e0625b47a req-3faeab65-1767-4eae-bf2c-be6b1faee160 service nova] Lock "97820f17-22d1-4ec3-9721-1edadccc794a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:44:41 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-37348128-0b11-423d-a3e0-a20e0625b47a req-3faeab65-1767-4eae-bf2c-be6b1faee160 service nova] Lock "97820f17-22d1-4ec3-9721-1edadccc794a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:44:41 user nova-compute[71509]: DEBUG nova.compute.manager [req-37348128-0b11-423d-a3e0-a20e0625b47a req-3faeab65-1767-4eae-bf2c-be6b1faee160 service nova] [instance: 97820f17-22d1-4ec3-9721-1edadccc794a] No waiting events found dispatching network-vif-plugged-dea3830d-9f49-4d5e-953b-eec2ee969b02 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:44:41 user nova-compute[71509]: WARNING nova.compute.manager [req-37348128-0b11-423d-a3e0-a20e0625b47a req-3faeab65-1767-4eae-bf2c-be6b1faee160 service nova] [instance: 97820f17-22d1-4ec3-9721-1edadccc794a] Received unexpected event network-vif-plugged-dea3830d-9f49-4d5e-953b-eec2ee969b02 for instance with vm_state active and task_state rescuing.
Apr 14 10:44:41 user nova-compute[71509]: DEBUG nova.compute.manager [req-37348128-0b11-423d-a3e0-a20e0625b47a req-3faeab65-1767-4eae-bf2c-be6b1faee160 service nova] [instance: 97820f17-22d1-4ec3-9721-1edadccc794a] Received event network-vif-plugged-dea3830d-9f49-4d5e-953b-eec2ee969b02 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:44:41 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-37348128-0b11-423d-a3e0-a20e0625b47a req-3faeab65-1767-4eae-bf2c-be6b1faee160 service nova] Acquiring lock "97820f17-22d1-4ec3-9721-1edadccc794a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:44:41 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-37348128-0b11-423d-a3e0-a20e0625b47a req-3faeab65-1767-4eae-bf2c-be6b1faee160 service nova] Lock "97820f17-22d1-4ec3-9721-1edadccc794a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:44:41 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-37348128-0b11-423d-a3e0-a20e0625b47a req-3faeab65-1767-4eae-bf2c-be6b1faee160 service nova] Lock "97820f17-22d1-4ec3-9721-1edadccc794a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:44:41 user nova-compute[71509]: DEBUG nova.compute.manager [req-37348128-0b11-423d-a3e0-a20e0625b47a req-3faeab65-1767-4eae-bf2c-be6b1faee160 service nova] [instance: 97820f17-22d1-4ec3-9721-1edadccc794a] No waiting events found dispatching network-vif-plugged-dea3830d-9f49-4d5e-953b-eec2ee969b02 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:44:41 user nova-compute[71509]: WARNING nova.compute.manager [req-37348128-0b11-423d-a3e0-a20e0625b47a req-3faeab65-1767-4eae-bf2c-be6b1faee160 service nova] [instance: 97820f17-22d1-4ec3-9721-1edadccc794a] Received unexpected event network-vif-plugged-dea3830d-9f49-4d5e-953b-eec2ee969b02 for instance with vm_state active and task_state rescuing.
Apr 14 10:44:41 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-17f6814c-8e20-4418-804b-01cbbcd6ce05 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a1908b59-2946-48a2-b435-29a931e13ce3, portal: 172.16.0.220,3260]
Apr 14 10:44:41 user nova-compute[71509]: Login to [iface: default, target: iqn.2010-10.org.openstack:a1908b59-2946-48a2-b435-29a931e13ce3, portal: 172.16.0.220,3260] successful.
Apr 14 10:44:41 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:44:41 user nova-compute[71509]: DEBUG nova.virt.libvirt.host [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Removed pending event for 97820f17-22d1-4ec3-9721-1edadccc794a due to event {{(pid=71509) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 10:44:41 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681469080.7070832, 97820f17-22d1-4ec3-9721-1edadccc794a => Resumed> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 10:44:41 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 97820f17-22d1-4ec3-9721-1edadccc794a] VM Resumed (Lifecycle Event)
Apr 14 10:44:41 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1908b59-2946-48a2-b435-29a931e13ce3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:41 user nova-compute[71509]: DEBUG nova.compute.manager [None req-2b689b65-4e39-47a5-bf9f-dbab1861c38d tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: 97820f17-22d1-4ec3-9721-1edadccc794a] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:44:41 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:44:41 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:44:41 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Hypervisor/Node resource view: name=user free_ram=7161MB free_disk=26.309947967529297GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71509) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 10:44:41 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:44:41 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.003s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:44:41 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1908b59-2946-48a2-b435-29a931e13ce3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:44:41 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5e566f2-1753-4029-9ec7-041eb4f9dddd]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:44:41 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 97820f17-22d1-4ec3-9721-1edadccc794a] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:44:41 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-17f6814c-8e20-4418-804b-01cbbcd6ce05 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:44:41 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:41 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 97820f17-22d1-4ec3-9721-1edadccc794a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 10:44:41 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:44:41 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fd339b3-85fd-4508-9c46-d289015f0fa3]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1908b59-2946-48a2-b435-29a931e13ce3 (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:44:41 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-17f6814c-8e20-4418-804b-01cbbcd6ce05 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee (non-flash)
Apr 14 10:44:41 user nova-compute[71509]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18 (non-flash)
Apr 14 10:44:41 user nova-compute[71509]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768 (non-flash)
Apr 14 10:44:41 user nova-compute[71509]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700 (non-flash)
Apr 14 10:44:41 user nova-compute[71509]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92 (non-flash)
Apr 14 10:44:41 user nova-compute[71509]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171 (non-flash)
Apr 14 10:44:41 user nova-compute[71509]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e (non-flash)
Apr 14 10:44:41 user nova-compute[71509]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1908b59-2946-48a2-b435-29a931e13ce3 (non-flash)
Apr 14 10:44:41 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:44:41 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-17f6814c-8e20-4418-804b-01cbbcd6ce05 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee (non-flash)
Apr 14 10:44:41 user nova-compute[71509]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18 (non-flash)
Apr 14 10:44:41 user nova-compute[71509]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768 (non-flash)
Apr 14 10:44:41 user nova-compute[71509]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700 (non-flash)
Apr 14 10:44:41 user nova-compute[71509]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92 (non-flash)
Apr 14 10:44:41 user nova-compute[71509]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171 (non-flash)
Apr 14 10:44:41 user nova-compute[71509]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e (non-flash)
Apr 14 10:44:41 user nova-compute[71509]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1908b59-2946-48a2-b435-29a931e13ce3 (non-flash)
Apr 14 10:44:41 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 10:44:41 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-17f6814c-8e20-4418-804b-01cbbcd6ce05 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a1908b59-2946-48a2-b435-29a931e13ce3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.390s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 10:44:41 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-17f6814c-8e20-4418-804b-01cbbcd6ce05 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Connected to 172.16.0.220:3260 {{(pid=71509) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 10:44:41 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-17f6814c-8e20-4418-804b-01cbbcd6ce05 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] HCTL ('40', '-', '-', 0) found on session 9 with lun 0 {{(pid=71509) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 10:44:41 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-17f6814c-8e20-4418-804b-01cbbcd6ce05 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=71509) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 10:44:41 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 97820f17-22d1-4ec3-9721-1edadccc794a] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 14 10:44:41 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681469080.7074203, 97820f17-22d1-4ec3-9721-1edadccc794a => Started> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 10:44:41 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 97820f17-22d1-4ec3-9721-1edadccc794a] VM Started (Lifecycle Event)
Apr 14 10:44:41 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:41 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.017s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:44:41 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7a5de3a-9a3f-4e85-b3cc-ccd7abb08ad5]: (4, ('- - 0', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:44:41 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-17f6814c-8e20-4418-804b-01cbbcd6ce05 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Searching for a device in session 9 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=71509) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 10:44:41 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-17f6814c-8e20-4418-804b-01cbbcd6ce05 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:a1908b59-2946-48a2-b435-29a931e13ce3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ItAzUCeP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71509) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 10:44:41 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 97820f17-22d1-4ec3-9721-1edadccc794a] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:44:41 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 97820f17-22d1-4ec3-9721-1edadccc794a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 10:44:41 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance d1516acc-354e-41f6-a639-61dea870b11e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:44:41 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 55178126-9766-4875-9122-39dcc87ce82c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:44:41 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance c90a9b99-0985-403b-b4d8-eaa8c2eed88a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:44:41 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 39586d44-1d8e-4607-ab4d-c03a7d841606 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:44:41 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance b4abb549-8f36-40c5-971f-8accbb14ff86 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:44:41 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 0e6c800c-9b35-4e35-969e-c40367056dce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:44:41 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance d6f539d8-4144-467b-ac69-44011c5b3564 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:44:41 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance ec16b4bc-5385-4eea-856f-710d52d0261d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:44:41 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance c0e2af6d-3694-4166-a3d0-b5be1107c488 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:44:41 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 97820f17-22d1-4ec3-9721-1edadccc794a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:44:41 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 97f20661-8b60-439e-b7af-2fc2013c5ade actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:44:41 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance a81da242-e8d8-4b41-b84a-e12d603823ca actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:44:41 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 31f6ad8c-40d3-4b6e-af07-4848fafc431d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:44:41 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=71509) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 10:44:41 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Final resource view: name=user phys_ram=16023MB used_ram=2176MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=71509) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 10:44:41 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 10:44:41 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 10:44:42 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Compute_service record updated for user:user {{(pid=71509) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 10:44:42 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.798s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:44:42 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-17f6814c-8e20-4418-804b-01cbbcd6ce05 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.438s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 10:44:42 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-17f6814c-8e20-4418-804b-01cbbcd6ce05 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] <== connect_volume: return (3442ms) {'type': 'block', 'scsi_wwn': '23431336365626538', 'path': '/dev/sdi'} {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 10:44:42 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17f6814c-8e20-4418-804b-01cbbcd6ce05 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] [instance: c90a9b99-0985-403b-b4d8-eaa8c2eed88a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23431336365626538', 'path': '/dev/sdi'} {{(pid=71509) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 10:44:42 user nova-compute[71509]: DEBUG nova.objects.instance [None req-17f6814c-8e20-4418-804b-01cbbcd6ce05 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Lazy-loading 'flavor' on Instance uuid c90a9b99-0985-403b-b4d8-eaa8c2eed88a {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:44:42 user nova-compute[71509]: DEBUG nova.virt.libvirt.guest [None req-17f6814c-8e20-4418-804b-01cbbcd6ce05 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 10:44:42 user nova-compute[71509]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 10:44:42 user nova-compute[71509]:   <source dev="/dev/sdi"/>
Apr 14 10:44:42 user nova-compute[71509]:   <target dev="vdb" bus="virtio"/>
Apr 14 10:44:42 user nova-compute[71509]:   <serial>a1908b59-2946-48a2-b435-29a931e13ce3</serial>
Apr 14 10:44:42 user nova-compute[71509]: </disk>
Apr 14 10:44:42 user nova-compute[71509]:  {{(pid=71509) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 10:44:42 user nova-compute[71509]: DEBUG nova.compute.manager [req-1f62bed9-6d6c-4bbc-936e-fdc97c56e88b req-d64495bf-8470-43b9-bab7-cbd0024c7006 service nova] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Received event network-changed-608a2408-02df-474f-9006-260c8c97def1 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:44:42 user nova-compute[71509]: DEBUG nova.compute.manager [req-1f62bed9-6d6c-4bbc-936e-fdc97c56e88b req-d64495bf-8470-43b9-bab7-cbd0024c7006 service nova] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Refreshing instance network info cache due to event network-changed-608a2408-02df-474f-9006-260c8c97def1. {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 10:44:42 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-1f62bed9-6d6c-4bbc-936e-fdc97c56e88b req-d64495bf-8470-43b9-bab7-cbd0024c7006 service nova] Acquiring lock "refresh_cache-b4abb549-8f36-40c5-971f-8accbb14ff86" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:44:42 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-1f62bed9-6d6c-4bbc-936e-fdc97c56e88b req-d64495bf-8470-43b9-bab7-cbd0024c7006 service nova] Acquired lock "refresh_cache-b4abb549-8f36-40c5-971f-8accbb14ff86" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:44:42 user nova-compute[71509]: DEBUG nova.network.neutron [req-1f62bed9-6d6c-4bbc-936e-fdc97c56e88b req-d64495bf-8470-43b9-bab7-cbd0024c7006 service nova] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Refreshing network info cache for port 608a2408-02df-474f-9006-260c8c97def1 {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 10:44:42 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:42 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-17f6814c-8e20-4418-804b-01cbbcd6ce05 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] No BDM found with device name vda, not building metadata. {{(pid=71509) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 10:44:42 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-17f6814c-8e20-4418-804b-01cbbcd6ce05 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71509) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 10:44:42 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-17f6814c-8e20-4418-804b-01cbbcd6ce05 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] No VIF found with MAC fa:16:3e:80:f6:9f, not building metadata {{(pid=71509) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 10:44:43 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:43 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-17f6814c-8e20-4418-804b-01cbbcd6ce05 tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Lock "c90a9b99-0985-403b-b4d8-eaa8c2eed88a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.958s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:44:43 user nova-compute[71509]: DEBUG nova.network.neutron [req-1f62bed9-6d6c-4bbc-936e-fdc97c56e88b req-d64495bf-8470-43b9-bab7-cbd0024c7006 service nova] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Updated VIF entry in instance network info cache for port 608a2408-02df-474f-9006-260c8c97def1. {{(pid=71509) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 10:44:43 user nova-compute[71509]: DEBUG nova.network.neutron [req-1f62bed9-6d6c-4bbc-936e-fdc97c56e88b req-d64495bf-8470-43b9-bab7-cbd0024c7006 service nova] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Updating instance_info_cache with network_info: [{"id": "608a2408-02df-474f-9006-260c8c97def1", "address": "fa:16:3e:e4:f7:87", "network": {"id": "18a91434-637b-4c19-a97b-736b32c1ea5a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1824162811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea2cb4dfa5b4a52b658efd8f5aefb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap608a2408-02", "ovs_interfaceid": "608a2408-02df-474f-9006-260c8c97def1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:44:43 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-1f62bed9-6d6c-4bbc-936e-fdc97c56e88b req-d64495bf-8470-43b9-bab7-cbd0024c7006 service nova] Releasing lock "refresh_cache-b4abb549-8f36-40c5-971f-8accbb14ff86" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:44:44 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-21d0321e-01f7-4050-ae81-e6a169db305f tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Acquiring lock "c90a9b99-0985-403b-b4d8-eaa8c2eed88a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:44:44 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-21d0321e-01f7-4050-ae81-e6a169db305f tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Lock "c90a9b99-0985-403b-b4d8-eaa8c2eed88a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:44:44 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-21d0321e-01f7-4050-ae81-e6a169db305f tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Acquiring lock "c90a9b99-0985-403b-b4d8-eaa8c2eed88a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:44:44 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-21d0321e-01f7-4050-ae81-e6a169db305f tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Lock "c90a9b99-0985-403b-b4d8-eaa8c2eed88a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:44:44 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-21d0321e-01f7-4050-ae81-e6a169db305f tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Lock "c90a9b99-0985-403b-b4d8-eaa8c2eed88a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:44:44 user nova-compute[71509]: INFO nova.compute.manager [None req-21d0321e-01f7-4050-ae81-e6a169db305f tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] [instance: c90a9b99-0985-403b-b4d8-eaa8c2eed88a] Terminating instance
Apr 14 10:44:44 user nova-compute[71509]: DEBUG nova.compute.manager [None req-21d0321e-01f7-4050-ae81-e6a169db305f tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] [instance: c90a9b99-0985-403b-b4d8-eaa8c2eed88a] Start destroying the instance on the hypervisor. {{(pid=71509) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 10:44:44 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:44 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:44 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:44 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:44 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:44 user nova-compute[71509]: DEBUG nova.compute.manager [req-d4b6debf-f6db-4706-850d-e54ea8c8feee req-6207efef-7cdf-4538-990c-b37793abeda5 service nova] [instance: c90a9b99-0985-403b-b4d8-eaa8c2eed88a] Received event network-vif-unplugged-5bd8d359-958a-4b76-ac87-156c2a2adf35 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:44:44 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-d4b6debf-f6db-4706-850d-e54ea8c8feee req-6207efef-7cdf-4538-990c-b37793abeda5 service nova] Acquiring lock "c90a9b99-0985-403b-b4d8-eaa8c2eed88a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:44:44 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-d4b6debf-f6db-4706-850d-e54ea8c8feee req-6207efef-7cdf-4538-990c-b37793abeda5 service nova] Lock "c90a9b99-0985-403b-b4d8-eaa8c2eed88a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:44:44 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-d4b6debf-f6db-4706-850d-e54ea8c8feee req-6207efef-7cdf-4538-990c-b37793abeda5 service nova] Lock "c90a9b99-0985-403b-b4d8-eaa8c2eed88a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:44:44 user nova-compute[71509]: DEBUG nova.compute.manager [req-d4b6debf-f6db-4706-850d-e54ea8c8feee req-6207efef-7cdf-4538-990c-b37793abeda5 service nova] [instance: c90a9b99-0985-403b-b4d8-eaa8c2eed88a] No waiting events found dispatching network-vif-unplugged-5bd8d359-958a-4b76-ac87-156c2a2adf35 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:44:44 user nova-compute[71509]: DEBUG nova.compute.manager [req-d4b6debf-f6db-4706-850d-e54ea8c8feee req-6207efef-7cdf-4538-990c-b37793abeda5 service nova] [instance: c90a9b99-0985-403b-b4d8-eaa8c2eed88a] Received event network-vif-unplugged-5bd8d359-958a-4b76-ac87-156c2a2adf35 for instance with task_state deleting. {{(pid=71509) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 10:44:45 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: c90a9b99-0985-403b-b4d8-eaa8c2eed88a] Instance destroyed successfully.
Apr 14 10:44:45 user nova-compute[71509]: DEBUG nova.objects.instance [None req-21d0321e-01f7-4050-ae81-e6a169db305f tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Lazy-loading 'resources' on Instance uuid c90a9b99-0985-403b-b4d8-eaa8c2eed88a {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:44:45 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-21d0321e-01f7-4050-ae81-e6a169db305f tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T10:42:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1726126636',display_name='tempest-DeleteServersTestJSON-server-1726126636',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1726126636',id=1,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T10:43:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='30856983340a435d8e92f138fdecaa35',ramdisk_id='',reservation_id='r-pt60gqu6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1788928325',owner_user_name='tempest-DeleteServersTestJSON-1788928325-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T10:43:02Z,user_data=None,user_id='0a9842a4c91c4d45b52da0b404fc27c2',uuid=c90a9b99-0985-403b-b4d8-eaa8c2eed88a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5bd8d359-958a-4b76-ac87-156c2a2adf35", "address": "fa:16:3e:80:f6:9f", "network": {"id": "8034a3f8-0149-4d7b-b457-350a881baafe", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1634360617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30856983340a435d8e92f138fdecaa35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bd8d359-95", "ovs_interfaceid": "5bd8d359-958a-4b76-ac87-156c2a2adf35", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 10:44:45 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-21d0321e-01f7-4050-ae81-e6a169db305f tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Converting VIF {"id": "5bd8d359-958a-4b76-ac87-156c2a2adf35", "address": "fa:16:3e:80:f6:9f", "network": {"id": "8034a3f8-0149-4d7b-b457-350a881baafe", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1634360617-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "30856983340a435d8e92f138fdecaa35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bd8d359-95", "ovs_interfaceid": "5bd8d359-958a-4b76-ac87-156c2a2adf35", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:44:45 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-21d0321e-01f7-4050-ae81-e6a169db305f tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:80:f6:9f,bridge_name='br-int',has_traffic_filtering=True,id=5bd8d359-958a-4b76-ac87-156c2a2adf35,network=Network(8034a3f8-0149-4d7b-b457-350a881baafe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bd8d359-95') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:44:45 user nova-compute[71509]: DEBUG os_vif [None req-21d0321e-01f7-4050-ae81-e6a169db305f tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:80:f6:9f,bridge_name='br-int',has_traffic_filtering=True,id=5bd8d359-958a-4b76-ac87-156c2a2adf35,network=Network(8034a3f8-0149-4d7b-b457-350a881baafe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bd8d359-95') {{(pid=71509) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 10:44:45 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:45 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5bd8d359-95, bridge=br-int, if_exists=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:44:45 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:45 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 10:44:45 user nova-compute[71509]: INFO os_vif [None req-21d0321e-01f7-4050-ae81-e6a169db305f tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:80:f6:9f,bridge_name='br-int',has_traffic_filtering=True,id=5bd8d359-958a-4b76-ac87-156c2a2adf35,network=Network(8034a3f8-0149-4d7b-b457-350a881baafe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bd8d359-95')
Apr 14 10:44:45 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21d0321e-01f7-4050-ae81-e6a169db305f tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] [instance: c90a9b99-0985-403b-b4d8-eaa8c2eed88a] calling os-brick to detach iSCSI Volume {{(pid=71509) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 10:44:45 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-21d0321e-01f7-4050-ae81-e6a169db305f tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0bf0749390>, {'target_iqn': 'iqn.2010-10.org.openstack:a1908b59-2946-48a2-b435-29a931e13ce3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ItAzUCeP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi': {}}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 10:44:45 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-21d0321e-01f7-4050-ae81-e6a169db305f tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 10:44:45 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-21d0321e-01f7-4050-ae81-e6a169db305f tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 10:44:45 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-21d0321e-01f7-4050-ae81-e6a169db305f tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 10:44:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:44:45 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca67b707-d0a5-48a8-ad74-105643375636]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a1908b59-2946-48a2-b435-29a931e13ce3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:44:45 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-21d0321e-01f7-4050-ae81-e6a169db305f tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 10:44:45 user nova-compute[71509]: No targets found.
Apr 14 10:44:45 user nova-compute[71509]: iSNS:
Apr 14 10:44:45 user nova-compute[71509]: No targets found.
Apr 14 10:44:45 user nova-compute[71509]: STATIC:
Apr 14 10:44:45 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18
Apr 14 10:44:45 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:44:45 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:44:45 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768
Apr 14 10:44:45 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:44:45 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:44:45 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171
Apr 14 10:44:45 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:44:45 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:44:45 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee
Apr 14 10:44:45 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:44:45 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:44:45 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e
Apr 14 10:44:45 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:44:45 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:44:45 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700
Apr 14 10:44:45 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:44:45 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:44:45 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92
Apr 14 10:44:45 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:44:45 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:44:45 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:a1908b59-2946-48a2-b435-29a931e13ce3
Apr 14 10:44:45 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:44:45 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:44:45 user nova-compute[71509]: FIRMWARE:
Apr 14 10:44:45 user nova-compute[71509]: No targets found.
Apr 14 10:44:45 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:44:45 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-21d0321e-01f7-4050-ae81-e6a169db305f tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 10:44:45 user nova-compute[71509]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 10:44:45 user nova-compute[71509]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71509) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 10:44:45 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-21d0321e-01f7-4050-ae81-e6a169db305f tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a1908b59-2946-48a2-b435-29a931e13ce3', 0)] {{(pid=71509) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 10:44:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:44:45 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef9f91ac-baaa-44b0-9242-0b32f9a22e8e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1908b59-2946-48a2-b435-29a931e13ce3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:44:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:44:45 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[4036c147-709a-495c-ab73-38649220abc7]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1908b59-2946-48a2-b435-29a931e13ce3 (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:44:45 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-21d0321e-01f7-4050-ae81-e6a169db305f tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee (non-flash)
Apr 14 10:44:45 user nova-compute[71509]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18 (non-flash)
Apr 14 10:44:45 user nova-compute[71509]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768 (non-flash)
Apr 14 10:44:45 user nova-compute[71509]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700 (non-flash)
Apr 14 10:44:45 user nova-compute[71509]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92 (non-flash)
Apr 14 10:44:45 user nova-compute[71509]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171 (non-flash)
Apr 14 10:44:45 user nova-compute[71509]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e (non-flash)
Apr 14 10:44:45 user nova-compute[71509]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1908b59-2946-48a2-b435-29a931e13ce3 (non-flash)
Apr 14 10:44:45 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:44:45 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-21d0321e-01f7-4050-ae81-e6a169db305f tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee (non-flash)
Apr 14 10:44:45 user nova-compute[71509]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18 (non-flash)
Apr 14 10:44:45 user nova-compute[71509]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768 (non-flash)
Apr 14 10:44:45 user nova-compute[71509]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700 (non-flash)
Apr 14 10:44:45 user nova-compute[71509]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92 (non-flash)
Apr 14 10:44:45 user nova-compute[71509]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171 (non-flash)
Apr 14 10:44:45 user nova-compute[71509]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e (non-flash)
Apr 14 10:44:45 user nova-compute[71509]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1908b59-2946-48a2-b435-29a931e13ce3 (non-flash)
Apr 14 10:44:45 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 10:44:45 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-21d0321e-01f7-4050-ae81-e6a169db305f tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0c2c3d0dc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a1908b59-2946-48a2-b435-29a931e13ce3'): ({'sdi'}, set())}) {{(pid=71509) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 10:44:45 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-21d0321e-01f7-4050-ae81-e6a169db305f tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Removing single pathed devices sdi {{(pid=71509) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 10:44:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.031s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:44:45 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[c019bf18-92c2-441b-a781-83019b1d25ab]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:44:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:44:45 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a1db27b-a348-4257-abcb-9ac4134ea870]: (4, ('ok\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:44:45 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-21d0321e-01f7-4050-ae81-e6a169db305f tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Flushing IO for device /dev/sdi {{(pid=71509) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 10:44:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.012s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:44:45 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d65b179-7cc0-4161-9796-e92bbe039dbc]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:44:45 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-21d0321e-01f7-4050-ae81-e6a169db305f tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=71509) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 10:44:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.060s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:44:45 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[e138e4b1-d219-4f6e-891b-3eda5342e591]: (4, ('1', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:44:45 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-21d0321e-01f7-4050-ae81-e6a169db305f tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=71509) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 10:44:45 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-21d0321e-01f7-4050-ae81-e6a169db305f tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] SCSI volumes sdi have been removed. {{(pid=71509) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 10:44:45 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-21d0321e-01f7-4050-ae81-e6a169db305f tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a1908b59-2946-48a2-b435-29a931e13ce3')] {{(pid=71509) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 10:44:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1908b59-2946-48a2-b435-29a931e13ce3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1908b59-2946-48a2-b435-29a931e13ce3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:44:45 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[15fc94fc-ccb8-43c9-945c-3e37c94a2327]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:44:45 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-21d0321e-01f7-4050-ae81-e6a169db305f tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:44:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1908b59-2946-48a2-b435-29a931e13ce3 -p 172.16.0.220:3260 --logout {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:46 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1908b59-2946-48a2-b435-29a931e13ce3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:44:46 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[d554e93b-71c4-4070-b734-025d63493eef]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:a1908b59-2946-48a2-b435-29a931e13ce3, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:a1908b59-2946-48a2-b435-29a931e13ce3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:44:46 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-21d0321e-01f7-4050-ae81-e6a169db305f tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:a1908b59-2946-48a2-b435-29a931e13ce3, portal: 172.16.0.220,3260]
Apr 14 10:44:46 user nova-compute[71509]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:a1908b59-2946-48a2-b435-29a931e13ce3, portal: 172.16.0.220,3260] successful.
Apr 14 10:44:46 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:44:46 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1908b59-2946-48a2-b435-29a931e13ce3 -p 172.16.0.220:3260 --op delete {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:46 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1908b59-2946-48a2-b435-29a931e13ce3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:44:46 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3df5403-5ffd-4b3d-ad15-640f11f74ac8]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:44:46 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-21d0321e-01f7-4050-ae81-e6a169db305f tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:44:46 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-21d0321e-01f7-4050-ae81-e6a169db305f tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.368s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 10:44:46 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-21d0321e-01f7-4050-ae81-e6a169db305f tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] <== disconnect_volume: return (369ms) None {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 10:44:46 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21d0321e-01f7-4050-ae81-e6a169db305f tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] [instance: c90a9b99-0985-403b-b4d8-eaa8c2eed88a] Disconnected iSCSI Volume {{(pid=71509) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 10:44:46 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-21d0321e-01f7-4050-ae81-e6a169db305f tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] [instance: c90a9b99-0985-403b-b4d8-eaa8c2eed88a] Deleting instance files /opt/stack/data/nova/instances/c90a9b99-0985-403b-b4d8-eaa8c2eed88a_del
Apr 14 10:44:46 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-21d0321e-01f7-4050-ae81-e6a169db305f tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] [instance: c90a9b99-0985-403b-b4d8-eaa8c2eed88a] Deletion of /opt/stack/data/nova/instances/c90a9b99-0985-403b-b4d8-eaa8c2eed88a_del complete
Apr 14 10:44:46 user nova-compute[71509]: DEBUG nova.virt.libvirt.host [None req-21d0321e-01f7-4050-ae81-e6a169db305f tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Checking UEFI support for host arch (x86_64) {{(pid=71509) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1722}}
Apr 14 10:44:46 user nova-compute[71509]: INFO nova.virt.libvirt.host [None req-21d0321e-01f7-4050-ae81-e6a169db305f tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] UEFI support detected
Apr 14 10:44:46 user nova-compute[71509]: INFO nova.compute.manager [None req-21d0321e-01f7-4050-ae81-e6a169db305f tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] [instance: c90a9b99-0985-403b-b4d8-eaa8c2eed88a] Took 1.81 seconds to destroy the instance on the hypervisor.
Apr 14 10:44:46 user nova-compute[71509]: DEBUG oslo.service.loopingcall [None req-21d0321e-01f7-4050-ae81-e6a169db305f tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71509) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 10:44:46 user nova-compute[71509]: DEBUG nova.compute.manager [-] [instance: c90a9b99-0985-403b-b4d8-eaa8c2eed88a] Deallocating network for instance {{(pid=71509) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 10:44:46 user nova-compute[71509]: DEBUG nova.network.neutron [-] [instance: c90a9b99-0985-403b-b4d8-eaa8c2eed88a] deallocate_for_instance() {{(pid=71509) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 10:44:46 user nova-compute[71509]: DEBUG nova.network.neutron [-] [instance: c90a9b99-0985-403b-b4d8-eaa8c2eed88a] Updating instance_info_cache with network_info: [] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:44:46 user nova-compute[71509]: INFO nova.compute.manager [-] [instance: c90a9b99-0985-403b-b4d8-eaa8c2eed88a] Took 0.64 seconds to deallocate network for instance.
Apr 14 10:44:46 user nova-compute[71509]: DEBUG nova.compute.manager [req-536a7b5d-c708-4ab5-a929-9bf36ffcea03 req-5857af07-9368-42f9-b213-03b09eeb8e2d service nova] [instance: c90a9b99-0985-403b-b4d8-eaa8c2eed88a] Received event network-vif-plugged-5bd8d359-958a-4b76-ac87-156c2a2adf35 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:44:46 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-536a7b5d-c708-4ab5-a929-9bf36ffcea03 req-5857af07-9368-42f9-b213-03b09eeb8e2d service nova] Acquiring lock "c90a9b99-0985-403b-b4d8-eaa8c2eed88a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:44:46 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-536a7b5d-c708-4ab5-a929-9bf36ffcea03 req-5857af07-9368-42f9-b213-03b09eeb8e2d service nova] Lock "c90a9b99-0985-403b-b4d8-eaa8c2eed88a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:44:46 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-536a7b5d-c708-4ab5-a929-9bf36ffcea03 req-5857af07-9368-42f9-b213-03b09eeb8e2d service nova] Lock "c90a9b99-0985-403b-b4d8-eaa8c2eed88a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:44:46 user nova-compute[71509]: DEBUG nova.compute.manager [req-536a7b5d-c708-4ab5-a929-9bf36ffcea03 req-5857af07-9368-42f9-b213-03b09eeb8e2d service nova] [instance: c90a9b99-0985-403b-b4d8-eaa8c2eed88a] No waiting events found dispatching network-vif-plugged-5bd8d359-958a-4b76-ac87-156c2a2adf35 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:44:46 user nova-compute[71509]: WARNING nova.compute.manager [req-536a7b5d-c708-4ab5-a929-9bf36ffcea03 req-5857af07-9368-42f9-b213-03b09eeb8e2d service nova] [instance: c90a9b99-0985-403b-b4d8-eaa8c2eed88a] Received unexpected event network-vif-plugged-5bd8d359-958a-4b76-ac87-156c2a2adf35 for instance with vm_state active and task_state deleting.
Apr 14 10:44:46 user nova-compute[71509]: DEBUG nova.compute.manager [req-536a7b5d-c708-4ab5-a929-9bf36ffcea03 req-5857af07-9368-42f9-b213-03b09eeb8e2d service nova] [instance: c90a9b99-0985-403b-b4d8-eaa8c2eed88a] Received event network-vif-deleted-5bd8d359-958a-4b76-ac87-156c2a2adf35 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:44:47 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:47 user nova-compute[71509]: INFO nova.compute.manager [None req-21d0321e-01f7-4050-ae81-e6a169db305f tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] [instance: c90a9b99-0985-403b-b4d8-eaa8c2eed88a] Took 0.86 seconds to detach 1 volumes for instance.
Apr 14 10:44:47 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-21d0321e-01f7-4050-ae81-e6a169db305f tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:44:47 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-21d0321e-01f7-4050-ae81-e6a169db305f tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:44:48 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-21d0321e-01f7-4050-ae81-e6a169db305f tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 10:44:48 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-21d0321e-01f7-4050-ae81-e6a169db305f tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 10:44:48 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-21d0321e-01f7-4050-ae81-e6a169db305f tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.428s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:44:48 user nova-compute[71509]: INFO nova.scheduler.client.report [None req-21d0321e-01f7-4050-ae81-e6a169db305f tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Deleted allocations for instance c90a9b99-0985-403b-b4d8-eaa8c2eed88a
Apr 14 10:44:48 user nova-compute[71509]: DEBUG nova.compute.manager [req-e14a24d4-04fd-4cea-a4c7-7842c32f081b req-5caf8b53-1d5f-44bb-af3f-21a73b380d6b service nova] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Received event network-changed-49978689-84ce-4422-add9-9bb12f628c37 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:44:48 user nova-compute[71509]: DEBUG nova.compute.manager [req-e14a24d4-04fd-4cea-a4c7-7842c32f081b req-5caf8b53-1d5f-44bb-af3f-21a73b380d6b service nova] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Refreshing instance network info cache due to event network-changed-49978689-84ce-4422-add9-9bb12f628c37. {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 10:44:48 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-e14a24d4-04fd-4cea-a4c7-7842c32f081b req-5caf8b53-1d5f-44bb-af3f-21a73b380d6b service nova] Acquiring lock "refresh_cache-0e6c800c-9b35-4e35-969e-c40367056dce" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:44:48 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-e14a24d4-04fd-4cea-a4c7-7842c32f081b req-5caf8b53-1d5f-44bb-af3f-21a73b380d6b service nova] Acquired lock "refresh_cache-0e6c800c-9b35-4e35-969e-c40367056dce" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:44:48 user nova-compute[71509]: DEBUG nova.network.neutron [req-e14a24d4-04fd-4cea-a4c7-7842c32f081b req-5caf8b53-1d5f-44bb-af3f-21a73b380d6b service nova] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Refreshing network info cache for port 49978689-84ce-4422-add9-9bb12f628c37 {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 10:44:48 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-21d0321e-01f7-4050-ae81-e6a169db305f tempest-DeleteServersTestJSON-1788928325 tempest-DeleteServersTestJSON-1788928325-project-member] Lock "c90a9b99-0985-403b-b4d8-eaa8c2eed88a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.952s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:44:49 user nova-compute[71509]: DEBUG nova.network.neutron [req-e14a24d4-04fd-4cea-a4c7-7842c32f081b req-5caf8b53-1d5f-44bb-af3f-21a73b380d6b service nova] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Updated VIF entry in instance network info cache for port 49978689-84ce-4422-add9-9bb12f628c37. {{(pid=71509) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 10:44:49 user nova-compute[71509]: DEBUG nova.network.neutron [req-e14a24d4-04fd-4cea-a4c7-7842c32f081b req-5caf8b53-1d5f-44bb-af3f-21a73b380d6b service nova] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Updating instance_info_cache with network_info: [{"id": "49978689-84ce-4422-add9-9bb12f628c37", "address": "fa:16:3e:a6:47:fc", "network": {"id": "9040ebc7-4d6b-4fd2-8543-f22ca3fb249c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2098664740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "482809b9148e408b84b156802a21a225", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49978689-84", "ovs_interfaceid": "49978689-84ce-4422-add9-9bb12f628c37", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:44:49 user nova-compute[71509]: DEBUG nova.compute.manager [None req-25cb3403-7682-4eb3-aedf-82e06517f68a tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:44:49 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-e14a24d4-04fd-4cea-a4c7-7842c32f081b req-5caf8b53-1d5f-44bb-af3f-21a73b380d6b service nova] Releasing lock "refresh_cache-0e6c800c-9b35-4e35-969e-c40367056dce" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:44:49 user nova-compute[71509]: INFO nova.compute.manager [None req-25cb3403-7682-4eb3-aedf-82e06517f68a tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] instance snapshotting
Apr 14 10:44:49 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-25cb3403-7682-4eb3-aedf-82e06517f68a tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Beginning live snapshot process
Apr 14 10:44:49 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-25cb3403-7682-4eb3-aedf-82e06517f68a tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e6c800c-9b35-4e35-969e-c40367056dce/disk --force-share --output=json -f qcow2 {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:49 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-25cb3403-7682-4eb3-aedf-82e06517f68a tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e6c800c-9b35-4e35-969e-c40367056dce/disk --force-share --output=json -f qcow2" returned: 0 in 0.131s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:44:49 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-25cb3403-7682-4eb3-aedf-82e06517f68a tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e6c800c-9b35-4e35-969e-c40367056dce/disk --force-share --output=json -f qcow2 {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:49 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-25cb3403-7682-4eb3-aedf-82e06517f68a tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e6c800c-9b35-4e35-969e-c40367056dce/disk --force-share --output=json -f qcow2" returned: 0 in 0.132s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:44:49 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-25cb3403-7682-4eb3-aedf-82e06517f68a tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:49 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-25cb3403-7682-4eb3-aedf-82e06517f68a tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json" returned: 0 in 0.137s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:44:49 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-25cb3403-7682-4eb3-aedf-82e06517f68a tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpmr3ryxbo/cfb9e625e8dc40a6bbfb53fd629542c9.delta 1073741824 {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:49 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-25cb3403-7682-4eb3-aedf-82e06517f68a tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpmr3ryxbo/cfb9e625e8dc40a6bbfb53fd629542c9.delta 1073741824" returned: 0 in 0.048s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:44:49 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-25cb3403-7682-4eb3-aedf-82e06517f68a tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Quiescing instance not available: QEMU guest agent is not enabled.
Apr 14 10:44:50 user nova-compute[71509]: DEBUG nova.virt.libvirt.guest [None req-25cb3403-7682-4eb3-aedf-82e06517f68a tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] COPY block job progress, current cursor: 65536 final cursor: 43778048 {{(pid=71509) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 10:44:50 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:51 user nova-compute[71509]: DEBUG nova.virt.libvirt.guest [None req-25cb3403-7682-4eb3-aedf-82e06517f68a tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] COPY block job progress, current cursor: 43778048 final cursor: 43778048 {{(pid=71509) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 10:44:51 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-25cb3403-7682-4eb3-aedf-82e06517f68a tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Skipping quiescing instance: QEMU guest agent is not enabled.
Apr 14 10:44:51 user nova-compute[71509]: DEBUG nova.privsep.utils [None req-25cb3403-7682-4eb3-aedf-82e06517f68a tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71509) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 10:44:51 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-25cb3403-7682-4eb3-aedf-82e06517f68a tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpmr3ryxbo/cfb9e625e8dc40a6bbfb53fd629542c9.delta /opt/stack/data/nova/instances/snapshots/tmpmr3ryxbo/cfb9e625e8dc40a6bbfb53fd629542c9 {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:44:51 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-25cb3403-7682-4eb3-aedf-82e06517f68a tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpmr3ryxbo/cfb9e625e8dc40a6bbfb53fd629542c9.delta /opt/stack/data/nova/instances/snapshots/tmpmr3ryxbo/cfb9e625e8dc40a6bbfb53fd629542c9" returned: 0 in 0.302s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:44:51 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-25cb3403-7682-4eb3-aedf-82e06517f68a tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Snapshot extracted, beginning image upload
Apr 14 10:44:52 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:53 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-25cb3403-7682-4eb3-aedf-82e06517f68a tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Snapshot image upload complete
Apr 14 10:44:53 user nova-compute[71509]: INFO nova.compute.manager [None req-25cb3403-7682-4eb3-aedf-82e06517f68a tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Took 4.59 seconds to snapshot the instance on the hypervisor.
Apr 14 10:44:55 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:44:57 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:00 user nova-compute[71509]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681469085.6469924, c90a9b99-0985-403b-b4d8-eaa8c2eed88a => Stopped> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 10:45:00 user nova-compute[71509]: INFO nova.compute.manager [-] [instance: c90a9b99-0985-403b-b4d8-eaa8c2eed88a] VM Stopped (Lifecycle Event)
Apr 14 10:45:00 user nova-compute[71509]: DEBUG nova.compute.manager [None req-2d211de8-478c-43ad-9d99-8631ac6c831e None None] [instance: c90a9b99-0985-403b-b4d8-eaa8c2eed88a] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:45:00 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:02 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:05 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:06 user nova-compute[71509]: DEBUG nova.compute.manager [req-d45050eb-5b0e-4cf1-9287-aab56677d256 req-4b8fb57a-0805-4d14-bb7f-12c4f5276466 service nova] [instance: ec16b4bc-5385-4eea-856f-710d52d0261d] Received event network-changed-2ee28d01-fbb2-4cf6-adcd-342fdabc8458 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:45:06 user nova-compute[71509]: DEBUG nova.compute.manager [req-d45050eb-5b0e-4cf1-9287-aab56677d256 req-4b8fb57a-0805-4d14-bb7f-12c4f5276466 service nova] [instance: ec16b4bc-5385-4eea-856f-710d52d0261d] Refreshing instance network info cache due to event network-changed-2ee28d01-fbb2-4cf6-adcd-342fdabc8458. {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 10:45:06 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-d45050eb-5b0e-4cf1-9287-aab56677d256 req-4b8fb57a-0805-4d14-bb7f-12c4f5276466 service nova] Acquiring lock "refresh_cache-ec16b4bc-5385-4eea-856f-710d52d0261d" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:45:06 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-d45050eb-5b0e-4cf1-9287-aab56677d256 req-4b8fb57a-0805-4d14-bb7f-12c4f5276466 service nova] Acquired lock "refresh_cache-ec16b4bc-5385-4eea-856f-710d52d0261d" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:45:06 user nova-compute[71509]: DEBUG nova.network.neutron [req-d45050eb-5b0e-4cf1-9287-aab56677d256 req-4b8fb57a-0805-4d14-bb7f-12c4f5276466 service nova] [instance: ec16b4bc-5385-4eea-856f-710d52d0261d] Refreshing network info cache for port 2ee28d01-fbb2-4cf6-adcd-342fdabc8458 {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 10:45:07 user nova-compute[71509]: DEBUG nova.network.neutron [req-d45050eb-5b0e-4cf1-9287-aab56677d256 req-4b8fb57a-0805-4d14-bb7f-12c4f5276466 service nova] [instance: ec16b4bc-5385-4eea-856f-710d52d0261d] Updated VIF entry in instance network info cache for port 2ee28d01-fbb2-4cf6-adcd-342fdabc8458. {{(pid=71509) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 10:45:07 user nova-compute[71509]: DEBUG nova.network.neutron [req-d45050eb-5b0e-4cf1-9287-aab56677d256 req-4b8fb57a-0805-4d14-bb7f-12c4f5276466 service nova] [instance: ec16b4bc-5385-4eea-856f-710d52d0261d] Updating instance_info_cache with network_info: [{"id": "2ee28d01-fbb2-4cf6-adcd-342fdabc8458", "address": "fa:16:3e:9a:29:80", "network": {"id": "79481373-f78f-46b0-bda0-5e66dea2fd31", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1244430846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77068eae4fa9459fbe81026615d0c16d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ee28d01-fb", "ovs_interfaceid": "2ee28d01-fbb2-4cf6-adcd-342fdabc8458", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:45:07 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-d45050eb-5b0e-4cf1-9287-aab56677d256 req-4b8fb57a-0805-4d14-bb7f-12c4f5276466 service nova] Releasing lock "refresh_cache-ec16b4bc-5385-4eea-856f-710d52d0261d" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:45:07 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:09 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-94702f45-9087-49bf-8478-7f3b60349243 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Acquiring lock "ec16b4bc-5385-4eea-856f-710d52d0261d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:45:09 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-94702f45-9087-49bf-8478-7f3b60349243 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Lock "ec16b4bc-5385-4eea-856f-710d52d0261d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:45:09 user nova-compute[71509]: DEBUG nova.objects.instance [None req-94702f45-9087-49bf-8478-7f3b60349243 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Lazy-loading 'flavor' on Instance uuid ec16b4bc-5385-4eea-856f-710d52d0261d {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:45:09 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-94702f45-9087-49bf-8478-7f3b60349243 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Lock "ec16b4bc-5385-4eea-856f-710d52d0261d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.079s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:45:09 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-94702f45-9087-49bf-8478-7f3b60349243 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Acquiring lock "ec16b4bc-5385-4eea-856f-710d52d0261d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:45:09 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-94702f45-9087-49bf-8478-7f3b60349243 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Lock "ec16b4bc-5385-4eea-856f-710d52d0261d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:45:09 user nova-compute[71509]: INFO nova.compute.manager [None req-94702f45-9087-49bf-8478-7f3b60349243 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] [instance: ec16b4bc-5385-4eea-856f-710d52d0261d] Attaching volume dc06bb14-764f-4a9f-ac7d-577f85f2bdb2 to /dev/sdc
Apr 14 10:45:09 user nova-compute[71509]: DEBUG os_brick.utils [None req-94702f45-9087-49bf-8478-7f3b60349243 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 10:45:09 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:09 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:09 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4941907-7a4a-4396-9a52-62ec2dc11b55]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50119df3c417\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:09 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:09 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:09 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef9ef282-4068-4886-9da6-6fd9bd7aebf2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:09 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:09 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:09 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[778dfebb-3b57-4aff-bad8-4c437dcad7c6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:09 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5b4749d-7f8a-42ce-a2bd-445b18eb7398]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:09 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-94702f45-9087-49bf-8478-7f3b60349243 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Running cmd (subprocess): nvme version {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:09 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-94702f45-9087-49bf-8478-7f3b60349243 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] 'nvme version' failed. Not Retrying. {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 10:45:09 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.nvmeof [None req-94702f45-9087-49bf-8478-7f3b60349243 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] nvme not present on system {{(pid=71509) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 10:45:09 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:09 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 10:45:09 user nova-compute[71509]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 10:45:09 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fe18201-2151-4fd3-a67b-e9b85db65806]: (4, '') {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:09 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-94702f45-9087-49bf-8478-7f3b60349243 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71509) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 10:45:09 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-94702f45-9087-49bf-8478-7f3b60349243 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71509) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 10:45:09 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-94702f45-9087-49bf-8478-7f3b60349243 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] LIGHTOS: no hostnqn found. {{(pid=71509) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 10:45:09 user nova-compute[71509]: DEBUG os_brick.utils [None req-94702f45-9087-49bf-8478-7f3b60349243 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50119df3c417', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 10:45:09 user nova-compute[71509]: DEBUG nova.virt.block_device [None req-94702f45-9087-49bf-8478-7f3b60349243 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] [instance: ec16b4bc-5385-4eea-856f-710d52d0261d] Updating existing volume attachment record: 4f6493fd-16f6-4731-b612-a6a8467b0ac6 {{(pid=71509) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 10:45:10 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:12 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:13 user nova-compute[71509]: DEBUG nova.compute.manager [req-4ef603b9-49b6-4cf9-acc0-f9ea4622d396 req-66206826-591f-4a86-90d9-eb5023b4e665 service nova] [instance: d6f539d8-4144-467b-ac69-44011c5b3564] Received event network-changed-d9ddcc5e-7cd1-4470-a3a3-4c2332f72b10 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:45:13 user nova-compute[71509]: DEBUG nova.compute.manager [req-4ef603b9-49b6-4cf9-acc0-f9ea4622d396 req-66206826-591f-4a86-90d9-eb5023b4e665 service nova] [instance: d6f539d8-4144-467b-ac69-44011c5b3564] Refreshing instance network info cache due to event network-changed-d9ddcc5e-7cd1-4470-a3a3-4c2332f72b10. {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 10:45:13 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-4ef603b9-49b6-4cf9-acc0-f9ea4622d396 req-66206826-591f-4a86-90d9-eb5023b4e665 service nova] Acquiring lock "refresh_cache-d6f539d8-4144-467b-ac69-44011c5b3564" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:45:13 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-4ef603b9-49b6-4cf9-acc0-f9ea4622d396 req-66206826-591f-4a86-90d9-eb5023b4e665 service nova] Acquired lock "refresh_cache-d6f539d8-4144-467b-ac69-44011c5b3564" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:45:13 user nova-compute[71509]: DEBUG nova.network.neutron [req-4ef603b9-49b6-4cf9-acc0-f9ea4622d396 req-66206826-591f-4a86-90d9-eb5023b4e665 service nova] [instance: d6f539d8-4144-467b-ac69-44011c5b3564] Refreshing network info cache for port d9ddcc5e-7cd1-4470-a3a3-4c2332f72b10 {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 10:45:13 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-546a6f18-7829-4e37-8d23-18a3ee81a015 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Acquiring lock "d6f539d8-4144-467b-ac69-44011c5b3564" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:45:13 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-546a6f18-7829-4e37-8d23-18a3ee81a015 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Lock "d6f539d8-4144-467b-ac69-44011c5b3564" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:45:13 user nova-compute[71509]: DEBUG nova.objects.instance [None req-546a6f18-7829-4e37-8d23-18a3ee81a015 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Lazy-loading 'flavor' on Instance uuid d6f539d8-4144-467b-ac69-44011c5b3564 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:45:13 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-546a6f18-7829-4e37-8d23-18a3ee81a015 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Lock "d6f539d8-4144-467b-ac69-44011c5b3564" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:45:13 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-546a6f18-7829-4e37-8d23-18a3ee81a015 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Acquiring lock "d6f539d8-4144-467b-ac69-44011c5b3564" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:45:13 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-546a6f18-7829-4e37-8d23-18a3ee81a015 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Lock "d6f539d8-4144-467b-ac69-44011c5b3564" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:45:13 user nova-compute[71509]: INFO nova.compute.manager [None req-546a6f18-7829-4e37-8d23-18a3ee81a015 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] [instance: d6f539d8-4144-467b-ac69-44011c5b3564] Attaching volume 4cfc127d-dadf-4588-9781-c90f1906df63 to /dev/vdb
Apr 14 10:45:13 user nova-compute[71509]: DEBUG os_brick.utils [None req-546a6f18-7829-4e37-8d23-18a3ee81a015 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 10:45:13 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:13 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:13 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ca87cc7-5dfe-4f10-90f4-f3f3e3ca37cc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50119df3c417\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:13 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:13 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:13 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ca585f4-988a-4629-be18-58c1965b5c2b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:13 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:13 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:13 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[e781b421-97d1-45e9-a3d0-2eb1da4c5ebf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:13 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0ecb47e-c04b-4b17-b2c5-05b1deb7001c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:13 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-546a6f18-7829-4e37-8d23-18a3ee81a015 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Running cmd (subprocess): nvme version {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:13 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-546a6f18-7829-4e37-8d23-18a3ee81a015 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] 'nvme version' failed. Not Retrying. {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 10:45:13 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.nvmeof [None req-546a6f18-7829-4e37-8d23-18a3ee81a015 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] nvme not present on system {{(pid=71509) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 10:45:13 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:13 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 10:45:13 user nova-compute[71509]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 10:45:13 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c8e53c3-3b56-480c-a02f-fe63eee5d65d]: (4, '') {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:13 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-546a6f18-7829-4e37-8d23-18a3ee81a015 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71509) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 10:45:13 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-546a6f18-7829-4e37-8d23-18a3ee81a015 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71509) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 10:45:13 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-546a6f18-7829-4e37-8d23-18a3ee81a015 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] LIGHTOS: no hostnqn found. {{(pid=71509) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 10:45:13 user nova-compute[71509]: DEBUG os_brick.utils [None req-546a6f18-7829-4e37-8d23-18a3ee81a015 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50119df3c417', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 10:45:13 user nova-compute[71509]: DEBUG nova.virt.block_device [None req-546a6f18-7829-4e37-8d23-18a3ee81a015 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] [instance: d6f539d8-4144-467b-ac69-44011c5b3564] Updating existing volume attachment record: 49dba84c-dfc8-48fc-8622-b63fd26b35c3 {{(pid=71509) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 10:45:13 user nova-compute[71509]: DEBUG nova.network.neutron [req-4ef603b9-49b6-4cf9-acc0-f9ea4622d396 req-66206826-591f-4a86-90d9-eb5023b4e665 service nova] [instance: d6f539d8-4144-467b-ac69-44011c5b3564] Updated VIF entry in instance network info cache for port d9ddcc5e-7cd1-4470-a3a3-4c2332f72b10. {{(pid=71509) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 10:45:13 user nova-compute[71509]: DEBUG nova.network.neutron [req-4ef603b9-49b6-4cf9-acc0-f9ea4622d396 req-66206826-591f-4a86-90d9-eb5023b4e665 service nova] [instance: d6f539d8-4144-467b-ac69-44011c5b3564] Updating instance_info_cache with network_info: [{"id": "d9ddcc5e-7cd1-4470-a3a3-4c2332f72b10", "address": "fa:16:3e:33:37:3e", "network": {"id": "18e10605-b5d7-4446-9cb7-34a989b33763", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1073535411-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64094cc814374da59456a39ef9cd8cd2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9ddcc5e-7c", "ovs_interfaceid": "d9ddcc5e-7cd1-4470-a3a3-4c2332f72b10", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:45:13 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-4ef603b9-49b6-4cf9-acc0-f9ea4622d396 req-66206826-591f-4a86-90d9-eb5023b4e665 service nova] Releasing lock "refresh_cache-d6f539d8-4144-467b-ac69-44011c5b3564" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:45:13 user nova-compute[71509]: DEBUG nova.compute.manager [req-7802afa0-c291-4d59-bc50-7903e4b7580c req-b0462579-ddf6-41c3-891b-43bbd51c7400 service nova] [instance: 31f6ad8c-40d3-4b6e-af07-4848fafc431d] Received event network-changed-edef0af3-01e9-4008-9017-119519f73981 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:45:13 user nova-compute[71509]: DEBUG nova.compute.manager [req-7802afa0-c291-4d59-bc50-7903e4b7580c req-b0462579-ddf6-41c3-891b-43bbd51c7400 service nova] [instance: 31f6ad8c-40d3-4b6e-af07-4848fafc431d] Refreshing instance network info cache due to event network-changed-edef0af3-01e9-4008-9017-119519f73981. {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 10:45:13 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-7802afa0-c291-4d59-bc50-7903e4b7580c req-b0462579-ddf6-41c3-891b-43bbd51c7400 service nova] Acquiring lock "refresh_cache-31f6ad8c-40d3-4b6e-af07-4848fafc431d" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:45:13 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-7802afa0-c291-4d59-bc50-7903e4b7580c req-b0462579-ddf6-41c3-891b-43bbd51c7400 service nova] Acquired lock "refresh_cache-31f6ad8c-40d3-4b6e-af07-4848fafc431d" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:45:13 user nova-compute[71509]: DEBUG nova.network.neutron [req-7802afa0-c291-4d59-bc50-7903e4b7580c req-b0462579-ddf6-41c3-891b-43bbd51c7400 service nova] [instance: 31f6ad8c-40d3-4b6e-af07-4848fafc431d] Refreshing network info cache for port edef0af3-01e9-4008-9017-119519f73981 {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 10:45:14 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-2f3f99bd-bd7d-47f0-b739-37b4d2962f83 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Acquiring lock "interface-31f6ad8c-40d3-4b6e-af07-4848fafc431d-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:45:14 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-2f3f99bd-bd7d-47f0-b739-37b4d2962f83 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Lock "interface-31f6ad8c-40d3-4b6e-af07-4848fafc431d-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:45:14 user nova-compute[71509]: DEBUG nova.objects.instance [None req-2f3f99bd-bd7d-47f0-b739-37b4d2962f83 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Lazy-loading 'flavor' on Instance uuid 31f6ad8c-40d3-4b6e-af07-4848fafc431d {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:45:14 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94702f45-9087-49bf-8478-7f3b60349243 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] [instance: ec16b4bc-5385-4eea-856f-710d52d0261d] Calling os-brick to attach iSCSI Volume {{(pid=71509) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 10:45:14 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-94702f45-9087-49bf-8478-7f3b60349243 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0bf0749390>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:dc06bb14-764f-4a9f-ac7d-577f85f2bdb2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lYcPQqwy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 10:45:14 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-94702f45-9087-49bf-8478-7f3b60349243 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 10:45:14 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-94702f45-9087-49bf-8478-7f3b60349243 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 10:45:14 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-94702f45-9087-49bf-8478-7f3b60349243 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 10:45:14 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-94702f45-9087-49bf-8478-7f3b60349243 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 10:45:14 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-94702f45-9087-49bf-8478-7f3b60349243 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc06bb14-764f-4a9f-ac7d-577f85f2bdb2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 10:45:14 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-94702f45-9087-49bf-8478-7f3b60349243 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc06bb14-764f-4a9f-ac7d-577f85f2bdb2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 10:45:14 user nova-compute[71509]: INFO os_brick.initiator.connectors.iscsi [None req-94702f45-9087-49bf-8478-7f3b60349243 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 10:45:14 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc06bb14-764f-4a9f-ac7d-577f85f2bdb2 -p 172.16.0.220:3260 {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:14 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc06bb14-764f-4a9f-ac7d-577f85f2bdb2 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:14 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[40a8e898-db2e-4321-a5f8-39918fb2760a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:14 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-94702f45-9087-49bf-8478-7f3b60349243 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 10:45:14 user nova-compute[71509]:  {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:45:14 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc06bb14-764f-4a9f-ac7d-577f85f2bdb2 -p 172.16.0.220:3260 --interface default --op new {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:14 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc06bb14-764f-4a9f-ac7d-577f85f2bdb2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:14 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a701262-851f-4bd3-a786-672374ead3b2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dc06bb14-764f-4a9f-ac7d-577f85f2bdb2] added\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:14 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-94702f45-9087-49bf-8478-7f3b60349243 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dc06bb14-764f-4a9f-ac7d-577f85f2bdb2] added
Apr 14 10:45:14 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:45:14 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc06bb14-764f-4a9f-ac7d-577f85f2bdb2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:14 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc06bb14-764f-4a9f-ac7d-577f85f2bdb2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:14 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fc77f79-abfe-4542-813d-b2610f0adbb3]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:14 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-94702f45-9087-49bf-8478-7f3b60349243 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:45:14 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc06bb14-764f-4a9f-ac7d-577f85f2bdb2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:14 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc06bb14-764f-4a9f-ac7d-577f85f2bdb2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:14 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[4edc90ed-c593-432f-84d8-445a749dfe8e]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:14 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-94702f45-9087-49bf-8478-7f3b60349243 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:45:14 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc06bb14-764f-4a9f-ac7d-577f85f2bdb2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lYcPQqwy {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:14 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc06bb14-764f-4a9f-ac7d-577f85f2bdb2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lYcPQqwy" returned: 0 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:14 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[c75d3fdc-3a2e-4a2f-bd24-ac87b47958c9]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:14 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-94702f45-9087-49bf-8478-7f3b60349243 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lYcPQqwy'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:45:14 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc06bb14-764f-4a9f-ac7d-577f85f2bdb2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:14 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc06bb14-764f-4a9f-ac7d-577f85f2bdb2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:14 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[397e6985-c314-46d2-b5a1-fd84b5ea5076]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:14 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-94702f45-9087-49bf-8478-7f3b60349243 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:45:14 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:14 user nova-compute[71509]: DEBUG nova.network.neutron [req-7802afa0-c291-4d59-bc50-7903e4b7580c req-b0462579-ddf6-41c3-891b-43bbd51c7400 service nova] [instance: 31f6ad8c-40d3-4b6e-af07-4848fafc431d] Updated VIF entry in instance network info cache for port edef0af3-01e9-4008-9017-119519f73981. {{(pid=71509) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 10:45:14 user nova-compute[71509]: DEBUG nova.network.neutron [req-7802afa0-c291-4d59-bc50-7903e4b7580c req-b0462579-ddf6-41c3-891b-43bbd51c7400 service nova] [instance: 31f6ad8c-40d3-4b6e-af07-4848fafc431d] Updating instance_info_cache with network_info: [{"id": "edef0af3-01e9-4008-9017-119519f73981", "address": "fa:16:3e:2a:16:ab", "network": {"id": "d0f56839-45f6-4d90-9a69-0a5d300e3c53", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-962046654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe8cdf0a5d7f49a9897167eb79dbfc39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedef0af3-01", "ovs_interfaceid": "edef0af3-01e9-4008-9017-119519f73981", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:45:14 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:14 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[76a06245-efec-4054-a79b-3d47143a0008]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:14 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-94702f45-9087-49bf-8478-7f3b60349243 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee (non-flash)
Apr 14 10:45:14 user nova-compute[71509]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18 (non-flash)
Apr 14 10:45:14 user nova-compute[71509]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768 (non-flash)
Apr 14 10:45:14 user nova-compute[71509]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700 (non-flash)
Apr 14 10:45:14 user nova-compute[71509]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92 (non-flash)
Apr 14 10:45:14 user nova-compute[71509]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171 (non-flash)
Apr 14 10:45:14 user nova-compute[71509]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e (non-flash)
Apr 14 10:45:14 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:45:14 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-94702f45-9087-49bf-8478-7f3b60349243 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee (non-flash)
Apr 14 10:45:14 user nova-compute[71509]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18 (non-flash)
Apr 14 10:45:14 user nova-compute[71509]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768 (non-flash)
Apr 14 10:45:14 user nova-compute[71509]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700 (non-flash)
Apr 14 10:45:14 user nova-compute[71509]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92 (non-flash)
Apr 14 10:45:14 user nova-compute[71509]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171 (non-flash)
Apr 14 10:45:14 user nova-compute[71509]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e (non-flash)
Apr 14 10:45:14 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 10:45:14 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc06bb14-764f-4a9f-ac7d-577f85f2bdb2 -p 172.16.0.220:3260 --login {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:14 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-7802afa0-c291-4d59-bc50-7903e4b7580c req-b0462579-ddf6-41c3-891b-43bbd51c7400 service nova] Releasing lock "refresh_cache-31f6ad8c-40d3-4b6e-af07-4848fafc431d" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:45:14 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc06bb14-764f-4a9f-ac7d-577f85f2bdb2 -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:14 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[58deb8b9-c090-4155-b565-dca9e916e9c9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dc06bb14-764f-4a9f-ac7d-577f85f2bdb2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dc06bb14-764f-4a9f-ac7d-577f85f2bdb2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:14 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-94702f45-9087-49bf-8478-7f3b60349243 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dc06bb14-764f-4a9f-ac7d-577f85f2bdb2, portal: 172.16.0.220,3260]
Apr 14 10:45:14 user nova-compute[71509]: Login to [iface: default, target: iqn.2010-10.org.openstack:dc06bb14-764f-4a9f-ac7d-577f85f2bdb2, portal: 172.16.0.220,3260] successful.
Apr 14 10:45:14 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:45:14 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc06bb14-764f-4a9f-ac7d-577f85f2bdb2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:14 user nova-compute[71509]: DEBUG nova.objects.instance [None req-2f3f99bd-bd7d-47f0-b739-37b4d2962f83 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Lazy-loading 'pci_requests' on Instance uuid 31f6ad8c-40d3-4b6e-af07-4848fafc431d {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:45:14 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc06bb14-764f-4a9f-ac7d-577f85f2bdb2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:14 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7f0a09e-1bae-49e2-a340-cf6a4ed25cf1]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:14 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-94702f45-9087-49bf-8478-7f3b60349243 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:45:14 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:14 user nova-compute[71509]: DEBUG nova.network.neutron [None req-2f3f99bd-bd7d-47f0-b739-37b4d2962f83 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] [instance: 31f6ad8c-40d3-4b6e-af07-4848fafc431d] allocate_for_instance() {{(pid=71509) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 10:45:14 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:14 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab87b6d2-3a1f-40eb-9a44-3f1c15da6b6c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc06bb14-764f-4a9f-ac7d-577f85f2bdb2 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:14 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-94702f45-9087-49bf-8478-7f3b60349243 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc06bb14-764f-4a9f-ac7d-577f85f2bdb2 (non-flash)
Apr 14 10:45:14 user nova-compute[71509]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee (non-flash)
Apr 14 10:45:14 user nova-compute[71509]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18 (non-flash)
Apr 14 10:45:14 user nova-compute[71509]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768 (non-flash)
Apr 14 10:45:14 user nova-compute[71509]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700 (non-flash)
Apr 14 10:45:14 user nova-compute[71509]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92 (non-flash)
Apr 14 10:45:14 user nova-compute[71509]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171 (non-flash)
Apr 14 10:45:14 user nova-compute[71509]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e (non-flash)
Apr 14 10:45:14 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:45:14 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-94702f45-9087-49bf-8478-7f3b60349243 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc06bb14-764f-4a9f-ac7d-577f85f2bdb2 (non-flash)
Apr 14 10:45:14 user nova-compute[71509]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee (non-flash)
Apr 14 10:45:14 user nova-compute[71509]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18 (non-flash)
Apr 14 10:45:14 user nova-compute[71509]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768 (non-flash)
Apr 14 10:45:14 user nova-compute[71509]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700 (non-flash)
Apr 14 10:45:14 user nova-compute[71509]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92 (non-flash)
Apr 14 10:45:14 user nova-compute[71509]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171 (non-flash)
Apr 14 10:45:14 user nova-compute[71509]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e (non-flash)
Apr 14 10:45:14 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 10:45:14 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-94702f45-9087-49bf-8478-7f3b60349243 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc06bb14-764f-4a9f-ac7d-577f85f2bdb2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.323s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 10:45:14 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-94702f45-9087-49bf-8478-7f3b60349243 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Connected to 172.16.0.220:3260 {{(pid=71509) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 10:45:14 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-94702f45-9087-49bf-8478-7f3b60349243 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] HCTL ('40', '-', '-', 0) found on session 10 with lun 0 {{(pid=71509) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 10:45:14 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-94702f45-9087-49bf-8478-7f3b60349243 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=71509) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 10:45:14 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:14 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:14 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d2dbb53-c159-4ce1-9c32-0f9ce70c923d]: (4, ('- - 0', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:14 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-94702f45-9087-49bf-8478-7f3b60349243 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Searching for a device in session 10 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=71509) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 10:45:14 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-94702f45-9087-49bf-8478-7f3b60349243 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:dc06bb14-764f-4a9f-ac7d-577f85f2bdb2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lYcPQqwy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71509) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 10:45:14 user nova-compute[71509]: DEBUG nova.policy [None req-2f3f99bd-bd7d-47f0-b739-37b4d2962f83 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c7ce31180e5946d4a027ae6ac9d136fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8cdf0a5d7f49a9897167eb79dbfc39', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71509) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 10:45:15 user nova-compute[71509]: DEBUG nova.network.neutron [None req-2f3f99bd-bd7d-47f0-b739-37b4d2962f83 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] [instance: 31f6ad8c-40d3-4b6e-af07-4848fafc431d] Successfully created port: 80f4161b-5489-4982-b3be-238ea838561a {{(pid=71509) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 10:45:15 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-94702f45-9087-49bf-8478-7f3b60349243 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.408s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 10:45:15 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-94702f45-9087-49bf-8478-7f3b60349243 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] <== connect_volume: return (1411ms) {'type': 'block', 'scsi_wwn': '23965613066666236', 'path': '/dev/sdi'} {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 10:45:15 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94702f45-9087-49bf-8478-7f3b60349243 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] [instance: ec16b4bc-5385-4eea-856f-710d52d0261d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23965613066666236', 'path': '/dev/sdi'} {{(pid=71509) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 10:45:15 user nova-compute[71509]: DEBUG nova.objects.instance [None req-94702f45-9087-49bf-8478-7f3b60349243 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Lazy-loading 'flavor' on Instance uuid ec16b4bc-5385-4eea-856f-710d52d0261d {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:45:15 user nova-compute[71509]: DEBUG nova.virt.libvirt.guest [None req-94702f45-9087-49bf-8478-7f3b60349243 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 10:45:15 user nova-compute[71509]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 10:45:15 user nova-compute[71509]:   <source dev="/dev/sdi"/>
Apr 14 10:45:15 user nova-compute[71509]:   <target dev="sdc" bus="scsi"/>
Apr 14 10:45:15 user nova-compute[71509]:   <serial>dc06bb14-764f-4a9f-ac7d-577f85f2bdb2</serial>
Apr 14 10:45:15 user nova-compute[71509]:   <address type="drive" controller="0" unit="2"/>
Apr 14 10:45:15 user nova-compute[71509]: </disk>
Apr 14 10:45:15 user nova-compute[71509]:  {{(pid=71509) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 10:45:15 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:16 user nova-compute[71509]: DEBUG nova.network.neutron [None req-2f3f99bd-bd7d-47f0-b739-37b4d2962f83 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] [instance: 31f6ad8c-40d3-4b6e-af07-4848fafc431d] Successfully updated port: 80f4161b-5489-4982-b3be-238ea838561a {{(pid=71509) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 10:45:16 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-2f3f99bd-bd7d-47f0-b739-37b4d2962f83 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Acquiring lock "refresh_cache-31f6ad8c-40d3-4b6e-af07-4848fafc431d" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:45:16 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-2f3f99bd-bd7d-47f0-b739-37b4d2962f83 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Acquired lock "refresh_cache-31f6ad8c-40d3-4b6e-af07-4848fafc431d" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:45:16 user nova-compute[71509]: DEBUG nova.network.neutron [None req-2f3f99bd-bd7d-47f0-b739-37b4d2962f83 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] [instance: 31f6ad8c-40d3-4b6e-af07-4848fafc431d] Building network info cache for instance {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 10:45:16 user nova-compute[71509]: DEBUG nova.compute.manager [req-ccef31de-9024-4062-98a8-649b65639a58 req-b67e90f7-4ec2-4f7c-a940-6c954e16fb8c service nova] [instance: 31f6ad8c-40d3-4b6e-af07-4848fafc431d] Received event network-changed-80f4161b-5489-4982-b3be-238ea838561a {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:45:16 user nova-compute[71509]: DEBUG nova.compute.manager [req-ccef31de-9024-4062-98a8-649b65639a58 req-b67e90f7-4ec2-4f7c-a940-6c954e16fb8c service nova] [instance: 31f6ad8c-40d3-4b6e-af07-4848fafc431d] Refreshing instance network info cache due to event network-changed-80f4161b-5489-4982-b3be-238ea838561a. {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 10:45:16 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-ccef31de-9024-4062-98a8-649b65639a58 req-b67e90f7-4ec2-4f7c-a940-6c954e16fb8c service nova] Acquiring lock "refresh_cache-31f6ad8c-40d3-4b6e-af07-4848fafc431d" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:45:16 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-94702f45-9087-49bf-8478-7f3b60349243 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] No BDM found with device name sda, not building metadata. {{(pid=71509) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 10:45:16 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-94702f45-9087-49bf-8478-7f3b60349243 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] No BDM found with device name sdb, not building metadata. {{(pid=71509) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 10:45:16 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-94702f45-9087-49bf-8478-7f3b60349243 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] No BDM found with device name sdc, not building metadata. {{(pid=71509) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 10:45:16 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-94702f45-9087-49bf-8478-7f3b60349243 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] No VIF found with MAC fa:16:3e:9a:29:80, not building metadata {{(pid=71509) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 10:45:16 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-94702f45-9087-49bf-8478-7f3b60349243 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Lock "ec16b4bc-5385-4eea-856f-710d52d0261d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.935s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:45:16 user nova-compute[71509]: DEBUG nova.network.neutron [None req-2f3f99bd-bd7d-47f0-b739-37b4d2962f83 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] [instance: 31f6ad8c-40d3-4b6e-af07-4848fafc431d] Updating instance_info_cache with network_info: [{"id": "edef0af3-01e9-4008-9017-119519f73981", "address": "fa:16:3e:2a:16:ab", "network": {"id": "d0f56839-45f6-4d90-9a69-0a5d300e3c53", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-962046654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe8cdf0a5d7f49a9897167eb79dbfc39", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedef0af3-01", "ovs_interfaceid": "edef0af3-01e9-4008-9017-119519f73981", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "80f4161b-5489-4982-b3be-238ea838561a", "address": "fa:16:3e:c8:68:35", "network": {"id": "dee46276-cd75-40ca-87ae-c98f51de17c9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-316990603", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "fe8cdf0a5d7f49a9897167eb79dbfc39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80f4161b-54", "ovs_interfaceid": "80f4161b-5489-4982-b3be-238ea838561a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:45:16 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-2f3f99bd-bd7d-47f0-b739-37b4d2962f83 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Releasing lock "refresh_cache-31f6ad8c-40d3-4b6e-af07-4848fafc431d" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:45:16 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-ccef31de-9024-4062-98a8-649b65639a58 req-b67e90f7-4ec2-4f7c-a940-6c954e16fb8c service nova] Acquired lock "refresh_cache-31f6ad8c-40d3-4b6e-af07-4848fafc431d" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:45:16 user nova-compute[71509]: DEBUG nova.network.neutron [req-ccef31de-9024-4062-98a8-649b65639a58 req-b67e90f7-4ec2-4f7c-a940-6c954e16fb8c service nova] [instance: 31f6ad8c-40d3-4b6e-af07-4848fafc431d] Refreshing network info cache for port 80f4161b-5489-4982-b3be-238ea838561a {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 10:45:16 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-2f3f99bd-bd7d-47f0-b739-37b4d2962f83 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T10:43:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1767995033',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1767995033',id=8,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAg92rKWvJLt4w+A2kLtzcKlRZllCdVCDpTieGdgT9uh8Ad5t/MvIIcaNE/YQBHARvcYgshBiRX60EUhdlUvUMSVKsG5MBNdYdax1bLq6yx8+hLej82SZYaOv31/N253aw==',key_name='tempest-keypair-1362955333',keypairs=<?>,launch_index=0,launched_at=2023-04-14T10:43:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='fe8cdf0a5d7f49a9897167eb79dbfc39',ramdisk_id='',reservation_id='r-7roeogsj',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1745854352',owner_user_name='tempest-TaggedAttachmentsTest-1745854352-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T10:43:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c7ce31180e5946d4a027ae6ac9d136fa',uuid=31f6ad8c-40d3-4b6e-af07-4848fafc431d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "80f4161b-5489-4982-b3be-238ea838561a", "address": "fa:16:3e:c8:68:35", "network": {"id": "dee46276-cd75-40ca-87ae-c98f51de17c9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-316990603", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "fe8cdf0a5d7f49a9897167eb79dbfc39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80f4161b-54", "ovs_interfaceid": "80f4161b-5489-4982-b3be-238ea838561a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 10:45:16 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-2f3f99bd-bd7d-47f0-b739-37b4d2962f83 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Converting VIF {"id": "80f4161b-5489-4982-b3be-238ea838561a", "address": "fa:16:3e:c8:68:35", "network": {"id": "dee46276-cd75-40ca-87ae-c98f51de17c9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-316990603", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "fe8cdf0a5d7f49a9897167eb79dbfc39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80f4161b-54", "ovs_interfaceid": "80f4161b-5489-4982-b3be-238ea838561a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:45:16 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-2f3f99bd-bd7d-47f0-b739-37b4d2962f83 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:68:35,bridge_name='br-int',has_traffic_filtering=True,id=80f4161b-5489-4982-b3be-238ea838561a,network=Network(dee46276-cd75-40ca-87ae-c98f51de17c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80f4161b-54') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:45:16 user nova-compute[71509]: DEBUG os_vif [None req-2f3f99bd-bd7d-47f0-b739-37b4d2962f83 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:68:35,bridge_name='br-int',has_traffic_filtering=True,id=80f4161b-5489-4982-b3be-238ea838561a,network=Network(dee46276-cd75-40ca-87ae-c98f51de17c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80f4161b-54') {{(pid=71509) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 10:45:16 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:16 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:45:16 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 10:45:16 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:16 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap80f4161b-54, may_exist=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:45:16 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap80f4161b-54, col_values=(('external_ids', {'iface-id': '80f4161b-5489-4982-b3be-238ea838561a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c8:68:35', 'vm-uuid': '31f6ad8c-40d3-4b6e-af07-4848fafc431d'}),)) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:45:16 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:16 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 10:45:16 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:16 user nova-compute[71509]: INFO os_vif [None req-2f3f99bd-bd7d-47f0-b739-37b4d2962f83 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:68:35,bridge_name='br-int',has_traffic_filtering=True,id=80f4161b-5489-4982-b3be-238ea838561a,network=Network(dee46276-cd75-40ca-87ae-c98f51de17c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80f4161b-54')
Apr 14 10:45:16 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-2f3f99bd-bd7d-47f0-b739-37b4d2962f83 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T10:43:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1767995033',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1767995033',id=8,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAg92rKWvJLt4w+A2kLtzcKlRZllCdVCDpTieGdgT9uh8Ad5t/MvIIcaNE/YQBHARvcYgshBiRX60EUhdlUvUMSVKsG5MBNdYdax1bLq6yx8+hLej82SZYaOv31/N253aw==',key_name='tempest-keypair-1362955333',keypairs=<?>,launch_index=0,launched_at=2023-04-14T10:43:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='fe8cdf0a5d7f49a9897167eb79dbfc39',ramdisk_id='',reservation_id='r-7roeogsj',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1745854352',owner_user_name='tempest-TaggedAttachmentsTest-1745854352-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T10:43:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c7ce31180e5946d4a027ae6ac9d136fa',uuid=31f6ad8c-40d3-4b6e-af07-4848fafc431d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "80f4161b-5489-4982-b3be-238ea838561a", "address": "fa:16:3e:c8:68:35", "network": {"id": "dee46276-cd75-40ca-87ae-c98f51de17c9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-316990603", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "fe8cdf0a5d7f49a9897167eb79dbfc39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80f4161b-54", "ovs_interfaceid": "80f4161b-5489-4982-b3be-238ea838561a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71509) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 10:45:16 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-2f3f99bd-bd7d-47f0-b739-37b4d2962f83 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Converting VIF {"id": "80f4161b-5489-4982-b3be-238ea838561a", "address": "fa:16:3e:c8:68:35", "network": {"id": "dee46276-cd75-40ca-87ae-c98f51de17c9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-316990603", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "fe8cdf0a5d7f49a9897167eb79dbfc39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80f4161b-54", "ovs_interfaceid": "80f4161b-5489-4982-b3be-238ea838561a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:45:16 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-2f3f99bd-bd7d-47f0-b739-37b4d2962f83 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:68:35,bridge_name='br-int',has_traffic_filtering=True,id=80f4161b-5489-4982-b3be-238ea838561a,network=Network(dee46276-cd75-40ca-87ae-c98f51de17c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80f4161b-54') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:45:16 user nova-compute[71509]: DEBUG nova.virt.libvirt.guest [None req-2f3f99bd-bd7d-47f0-b739-37b4d2962f83 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] attach device xml: <interface type="ethernet">
Apr 14 10:45:16 user nova-compute[71509]:   <mac address="fa:16:3e:c8:68:35"/>
Apr 14 10:45:16 user nova-compute[71509]:   <model type="virtio"/>
Apr 14 10:45:16 user nova-compute[71509]:   <mtu size="1442"/>
Apr 14 10:45:16 user nova-compute[71509]:   <target dev="tap80f4161b-54"/>
Apr 14 10:45:16 user nova-compute[71509]: </interface>
Apr 14 10:45:16 user nova-compute[71509]:  {{(pid=71509) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 10:45:16 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:16 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:17 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-2f3f99bd-bd7d-47f0-b739-37b4d2962f83 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] No BDM found with device name vda, not building metadata. {{(pid=71509) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 10:45:17 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-2f3f99bd-bd7d-47f0-b739-37b4d2962f83 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] No BDM found with device name hda, not building metadata. {{(pid=71509) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 10:45:17 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-2f3f99bd-bd7d-47f0-b739-37b4d2962f83 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] No VIF found with MAC fa:16:3e:2a:16:ab, not building metadata {{(pid=71509) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 10:45:17 user nova-compute[71509]: DEBUG nova.virt.libvirt.guest [None req-2f3f99bd-bd7d-47f0-b739-37b4d2962f83 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 10:45:17 user nova-compute[71509]:   <nova:package version="0.0.0"/>
Apr 14 10:45:17 user nova-compute[71509]:   <nova:name>tempest-device-tagging-server-1767995033</nova:name>
Apr 14 10:45:17 user nova-compute[71509]:   <nova:creationTime>2023-04-14 10:45:17</nova:creationTime>
Apr 14 10:45:17 user nova-compute[71509]:   <nova:flavor name="m1.nano">
Apr 14 10:45:17 user nova-compute[71509]:     <nova:memory>128</nova:memory>
Apr 14 10:45:17 user nova-compute[71509]:     <nova:disk>1</nova:disk>
Apr 14 10:45:17 user nova-compute[71509]:     <nova:swap>0</nova:swap>
Apr 14 10:45:17 user nova-compute[71509]:     <nova:ephemeral>0</nova:ephemeral>
Apr 14 10:45:17 user nova-compute[71509]:     <nova:vcpus>1</nova:vcpus>
Apr 14 10:45:17 user nova-compute[71509]:   </nova:flavor>
Apr 14 10:45:17 user nova-compute[71509]:   <nova:owner>
Apr 14 10:45:17 user nova-compute[71509]:     <nova:user uuid="c7ce31180e5946d4a027ae6ac9d136fa">tempest-TaggedAttachmentsTest-1745854352-project-member</nova:user>
Apr 14 10:45:17 user nova-compute[71509]:     <nova:project uuid="fe8cdf0a5d7f49a9897167eb79dbfc39">tempest-TaggedAttachmentsTest-1745854352</nova:project>
Apr 14 10:45:17 user nova-compute[71509]:   </nova:owner>
Apr 14 10:45:17 user nova-compute[71509]:   <nova:root type="image" uuid="048ec0ee-0465-448d-8b4c-f072acb101dc"/>
Apr 14 10:45:17 user nova-compute[71509]:   <nova:ports>
Apr 14 10:45:17 user nova-compute[71509]:     <nova:port uuid="edef0af3-01e9-4008-9017-119519f73981">
Apr 14 10:45:17 user nova-compute[71509]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 14 10:45:17 user nova-compute[71509]:     </nova:port>
Apr 14 10:45:17 user nova-compute[71509]:     <nova:port uuid="80f4161b-5489-4982-b3be-238ea838561a">
Apr 14 10:45:17 user nova-compute[71509]:       <nova:ip type="fixed" address="10.10.10.171" ipVersion="4"/>
Apr 14 10:45:17 user nova-compute[71509]:     </nova:port>
Apr 14 10:45:17 user nova-compute[71509]:   </nova:ports>
Apr 14 10:45:17 user nova-compute[71509]: </nova:instance>
Apr 14 10:45:17 user nova-compute[71509]:  {{(pid=71509) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Apr 14 10:45:17 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-2f3f99bd-bd7d-47f0-b739-37b4d2962f83 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Lock "interface-31f6ad8c-40d3-4b6e-af07-4848fafc431d-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.259s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:45:17 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:17 user nova-compute[71509]: DEBUG nova.network.neutron [req-ccef31de-9024-4062-98a8-649b65639a58 req-b67e90f7-4ec2-4f7c-a940-6c954e16fb8c service nova] [instance: 31f6ad8c-40d3-4b6e-af07-4848fafc431d] Updated VIF entry in instance network info cache for port 80f4161b-5489-4982-b3be-238ea838561a. {{(pid=71509) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 10:45:17 user nova-compute[71509]: DEBUG nova.network.neutron [req-ccef31de-9024-4062-98a8-649b65639a58 req-b67e90f7-4ec2-4f7c-a940-6c954e16fb8c service nova] [instance: 31f6ad8c-40d3-4b6e-af07-4848fafc431d] Updating instance_info_cache with network_info: [{"id": "edef0af3-01e9-4008-9017-119519f73981", "address": "fa:16:3e:2a:16:ab", "network": {"id": "d0f56839-45f6-4d90-9a69-0a5d300e3c53", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-962046654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe8cdf0a5d7f49a9897167eb79dbfc39", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedef0af3-01", "ovs_interfaceid": "edef0af3-01e9-4008-9017-119519f73981", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "80f4161b-5489-4982-b3be-238ea838561a", "address": "fa:16:3e:c8:68:35", "network": {"id": "dee46276-cd75-40ca-87ae-c98f51de17c9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-316990603", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "fe8cdf0a5d7f49a9897167eb79dbfc39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80f4161b-54", "ovs_interfaceid": "80f4161b-5489-4982-b3be-238ea838561a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:45:17 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-a0ae1c67-01be-4f15-a575-b3a7008bae50 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Acquiring lock "ec16b4bc-5385-4eea-856f-710d52d0261d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:45:17 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-a0ae1c67-01be-4f15-a575-b3a7008bae50 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Lock "ec16b4bc-5385-4eea-856f-710d52d0261d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:45:17 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-ccef31de-9024-4062-98a8-649b65639a58 req-b67e90f7-4ec2-4f7c-a940-6c954e16fb8c service nova] Releasing lock "refresh_cache-31f6ad8c-40d3-4b6e-af07-4848fafc431d" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:45:17 user nova-compute[71509]: INFO nova.compute.manager [None req-a0ae1c67-01be-4f15-a575-b3a7008bae50 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] [instance: ec16b4bc-5385-4eea-856f-710d52d0261d] Detaching volume dc06bb14-764f-4a9f-ac7d-577f85f2bdb2
Apr 14 10:45:17 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:17 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:17 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:17 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-e2a1a189-77b7-4a79-a276-6b35cd845f5c tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Acquiring lock "31f6ad8c-40d3-4b6e-af07-4848fafc431d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:45:17 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-e2a1a189-77b7-4a79-a276-6b35cd845f5c tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Lock "31f6ad8c-40d3-4b6e-af07-4848fafc431d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:45:17 user nova-compute[71509]: INFO nova.virt.block_device [None req-a0ae1c67-01be-4f15-a575-b3a7008bae50 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] [instance: ec16b4bc-5385-4eea-856f-710d52d0261d] Attempting to driver detach volume dc06bb14-764f-4a9f-ac7d-577f85f2bdb2 from mountpoint /dev/sdc
Apr 14 10:45:17 user nova-compute[71509]: DEBUG nova.objects.instance [None req-e2a1a189-77b7-4a79-a276-6b35cd845f5c tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Lazy-loading 'flavor' on Instance uuid 31f6ad8c-40d3-4b6e-af07-4848fafc431d {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:45:17 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-a0ae1c67-01be-4f15-a575-b3a7008bae50 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Attempting to detach device sdc from instance ec16b4bc-5385-4eea-856f-710d52d0261d from the persistent domain config. {{(pid=71509) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 10:45:17 user nova-compute[71509]: DEBUG nova.virt.libvirt.guest [None req-a0ae1c67-01be-4f15-a575-b3a7008bae50 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 10:45:17 user nova-compute[71509]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 10:45:17 user nova-compute[71509]:   <source dev="/dev/sdi"/>
Apr 14 10:45:17 user nova-compute[71509]:   <target dev="sdc" bus="scsi"/>
Apr 14 10:45:17 user nova-compute[71509]:   <serial>dc06bb14-764f-4a9f-ac7d-577f85f2bdb2</serial>
Apr 14 10:45:17 user nova-compute[71509]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Apr 14 10:45:17 user nova-compute[71509]: </disk>
Apr 14 10:45:17 user nova-compute[71509]:  {{(pid=71509) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 10:45:17 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-a0ae1c67-01be-4f15-a575-b3a7008bae50 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Successfully detached device sdc from instance ec16b4bc-5385-4eea-856f-710d52d0261d from the persistent domain config.
Apr 14 10:45:17 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-a0ae1c67-01be-4f15-a575-b3a7008bae50 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance ec16b4bc-5385-4eea-856f-710d52d0261d from the live domain config. {{(pid=71509) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 10:45:17 user nova-compute[71509]: DEBUG nova.virt.libvirt.guest [None req-a0ae1c67-01be-4f15-a575-b3a7008bae50 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 10:45:17 user nova-compute[71509]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 10:45:17 user nova-compute[71509]:   <source dev="/dev/sdi"/>
Apr 14 10:45:17 user nova-compute[71509]:   <target dev="sdc" bus="scsi"/>
Apr 14 10:45:17 user nova-compute[71509]:   <serial>dc06bb14-764f-4a9f-ac7d-577f85f2bdb2</serial>
Apr 14 10:45:17 user nova-compute[71509]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Apr 14 10:45:17 user nova-compute[71509]: </disk>
Apr 14 10:45:17 user nova-compute[71509]:  {{(pid=71509) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 10:45:17 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-e2a1a189-77b7-4a79-a276-6b35cd845f5c tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Lock "31f6ad8c-40d3-4b6e-af07-4848fafc431d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.083s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:45:17 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-e2a1a189-77b7-4a79-a276-6b35cd845f5c tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Acquiring lock "31f6ad8c-40d3-4b6e-af07-4848fafc431d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:45:17 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-e2a1a189-77b7-4a79-a276-6b35cd845f5c tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Lock "31f6ad8c-40d3-4b6e-af07-4848fafc431d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:45:17 user nova-compute[71509]: INFO nova.compute.manager [None req-e2a1a189-77b7-4a79-a276-6b35cd845f5c tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] [instance: 31f6ad8c-40d3-4b6e-af07-4848fafc431d] Attaching volume 207caef0-4168-4698-be0c-09ae18f2102d to /dev/vdb
Apr 14 10:45:17 user nova-compute[71509]: DEBUG os_brick.utils [None req-e2a1a189-77b7-4a79-a276-6b35cd845f5c tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 10:45:17 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:17 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:17 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c52b7ec-8f06-49b9-b0d6-c1f7915c540b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50119df3c417\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:17 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:17 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:17 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff16162c-8b59-4a61-83cc-747fe1ac466b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:17 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:17 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:17 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bfa45bf-4992-4520-a11b-25591ec8edf2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:17 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf19e3ac-9c56-4489-b321-0debaa11f228]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:17 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-e2a1a189-77b7-4a79-a276-6b35cd845f5c tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Running cmd (subprocess): nvme version {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:18 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-e2a1a189-77b7-4a79-a276-6b35cd845f5c tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] 'nvme version' failed. Not Retrying. {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 10:45:18 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e2a1a189-77b7-4a79-a276-6b35cd845f5c tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] nvme not present on system {{(pid=71509) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 10:45:18 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:18 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 10:45:18 user nova-compute[71509]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 10:45:18 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8f7bc24-2a97-41ed-be0b-cb6e59ddc277]: (4, '') {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:18 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-e2a1a189-77b7-4a79-a276-6b35cd845f5c tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71509) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 10:45:18 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-e2a1a189-77b7-4a79-a276-6b35cd845f5c tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71509) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 10:45:18 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-e2a1a189-77b7-4a79-a276-6b35cd845f5c tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] LIGHTOS: no hostnqn found. {{(pid=71509) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 10:45:18 user nova-compute[71509]: DEBUG os_brick.utils [None req-e2a1a189-77b7-4a79-a276-6b35cd845f5c tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50119df3c417', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 10:45:18 user nova-compute[71509]: DEBUG nova.virt.block_device [None req-e2a1a189-77b7-4a79-a276-6b35cd845f5c tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] [instance: 31f6ad8c-40d3-4b6e-af07-4848fafc431d] Updating existing volume attachment record: 9db41a1b-e8c9-4614-a639-7f7e49109c9e {{(pid=71509) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 10:45:18 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Received event <DeviceRemovedEvent: 1681469118.0902076, ec16b4bc-5385-4eea-856f-710d52d0261d => scsi0-0-0-2> from libvirt while the driver is waiting for it; dispatched. {{(pid=71509) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 10:45:18 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-a0ae1c67-01be-4f15-a575-b3a7008bae50 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance ec16b4bc-5385-4eea-856f-710d52d0261d {{(pid=71509) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 10:45:18 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-a0ae1c67-01be-4f15-a575-b3a7008bae50 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Successfully detached device sdc from instance ec16b4bc-5385-4eea-856f-710d52d0261d from the live domain config.
Apr 14 10:45:18 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0ae1c67-01be-4f15-a575-b3a7008bae50 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] [instance: ec16b4bc-5385-4eea-856f-710d52d0261d] calling os-brick to detach iSCSI Volume {{(pid=71509) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 10:45:18 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0ae1c67-01be-4f15-a575-b3a7008bae50 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0bf0749390>, {'target_iqn': 'iqn.2010-10.org.openstack:dc06bb14-764f-4a9f-ac7d-577f85f2bdb2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lYcPQqwy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi': {}}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 10:45:18 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-a0ae1c67-01be-4f15-a575-b3a7008bae50 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 10:45:18 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-a0ae1c67-01be-4f15-a575-b3a7008bae50 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 10:45:18 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-a0ae1c67-01be-4f15-a575-b3a7008bae50 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 10:45:18 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:18 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:18 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f18e8aa-d118-4158-98ab-a8786ea3e0a2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dc06bb14-764f-4a9f-ac7d-577f85f2bdb2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:18 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0ae1c67-01be-4f15-a575-b3a7008bae50 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 10:45:18 user nova-compute[71509]: No targets found.
Apr 14 10:45:18 user nova-compute[71509]: iSNS:
Apr 14 10:45:18 user nova-compute[71509]: No targets found.
Apr 14 10:45:18 user nova-compute[71509]: STATIC:
Apr 14 10:45:18 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18
Apr 14 10:45:18 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:45:18 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:45:18 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768
Apr 14 10:45:18 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:45:18 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:45:18 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171
Apr 14 10:45:18 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:45:18 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:45:18 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee
Apr 14 10:45:18 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:45:18 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:45:18 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e
Apr 14 10:45:18 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:45:18 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:45:18 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700
Apr 14 10:45:18 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:45:18 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:45:18 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92
Apr 14 10:45:18 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:45:18 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:45:18 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:dc06bb14-764f-4a9f-ac7d-577f85f2bdb2
Apr 14 10:45:18 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:45:18 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:45:18 user nova-compute[71509]: FIRMWARE:
Apr 14 10:45:18 user nova-compute[71509]: No targets found.
Apr 14 10:45:18 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:45:18 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0ae1c67-01be-4f15-a575-b3a7008bae50 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 10:45:18 user nova-compute[71509]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 10:45:18 user nova-compute[71509]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71509) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 10:45:18 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0ae1c67-01be-4f15-a575-b3a7008bae50 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc06bb14-764f-4a9f-ac7d-577f85f2bdb2', 0)] {{(pid=71509) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 10:45:18 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:18 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:18 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b61251f-6c9c-479d-b80a-1aeaf2ae44c6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc06bb14-764f-4a9f-ac7d-577f85f2bdb2\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:18 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:18 user nova-compute[71509]: DEBUG nova.compute.manager [req-20ed969f-a409-4f62-8eb5-3b6e25f4dedb req-42c5faf1-8024-4082-b8ea-97d69e18b173 service nova] [instance: 31f6ad8c-40d3-4b6e-af07-4848fafc431d] Received event network-vif-plugged-80f4161b-5489-4982-b3be-238ea838561a {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:45:18 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-20ed969f-a409-4f62-8eb5-3b6e25f4dedb req-42c5faf1-8024-4082-b8ea-97d69e18b173 service nova] Acquiring lock "31f6ad8c-40d3-4b6e-af07-4848fafc431d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:45:18 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-20ed969f-a409-4f62-8eb5-3b6e25f4dedb req-42c5faf1-8024-4082-b8ea-97d69e18b173 service nova] Lock "31f6ad8c-40d3-4b6e-af07-4848fafc431d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:45:18 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-20ed969f-a409-4f62-8eb5-3b6e25f4dedb req-42c5faf1-8024-4082-b8ea-97d69e18b173 service nova] Lock "31f6ad8c-40d3-4b6e-af07-4848fafc431d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:45:18 user nova-compute[71509]: DEBUG nova.compute.manager [req-20ed969f-a409-4f62-8eb5-3b6e25f4dedb req-42c5faf1-8024-4082-b8ea-97d69e18b173 service nova] [instance: 31f6ad8c-40d3-4b6e-af07-4848fafc431d] No waiting events found dispatching network-vif-plugged-80f4161b-5489-4982-b3be-238ea838561a {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:45:18 user nova-compute[71509]: WARNING nova.compute.manager [req-20ed969f-a409-4f62-8eb5-3b6e25f4dedb req-42c5faf1-8024-4082-b8ea-97d69e18b173 service nova] [instance: 31f6ad8c-40d3-4b6e-af07-4848fafc431d] Received unexpected event network-vif-plugged-80f4161b-5489-4982-b3be-238ea838561a for instance with vm_state active and task_state None.
Apr 14 10:45:18 user nova-compute[71509]: DEBUG nova.compute.manager [req-20ed969f-a409-4f62-8eb5-3b6e25f4dedb req-42c5faf1-8024-4082-b8ea-97d69e18b173 service nova] [instance: 31f6ad8c-40d3-4b6e-af07-4848fafc431d] Received event network-vif-plugged-80f4161b-5489-4982-b3be-238ea838561a {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:45:18 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-20ed969f-a409-4f62-8eb5-3b6e25f4dedb req-42c5faf1-8024-4082-b8ea-97d69e18b173 service nova] Acquiring lock "31f6ad8c-40d3-4b6e-af07-4848fafc431d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:45:18 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-20ed969f-a409-4f62-8eb5-3b6e25f4dedb req-42c5faf1-8024-4082-b8ea-97d69e18b173 service nova] Lock "31f6ad8c-40d3-4b6e-af07-4848fafc431d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:45:18 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-20ed969f-a409-4f62-8eb5-3b6e25f4dedb req-42c5faf1-8024-4082-b8ea-97d69e18b173 service nova] Lock "31f6ad8c-40d3-4b6e-af07-4848fafc431d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:45:18 user nova-compute[71509]: DEBUG nova.compute.manager [req-20ed969f-a409-4f62-8eb5-3b6e25f4dedb req-42c5faf1-8024-4082-b8ea-97d69e18b173 service nova] [instance: 31f6ad8c-40d3-4b6e-af07-4848fafc431d] No waiting events found dispatching network-vif-plugged-80f4161b-5489-4982-b3be-238ea838561a {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:45:18 user nova-compute[71509]: WARNING nova.compute.manager [req-20ed969f-a409-4f62-8eb5-3b6e25f4dedb req-42c5faf1-8024-4082-b8ea-97d69e18b173 service nova] [instance: 31f6ad8c-40d3-4b6e-af07-4848fafc431d] Received unexpected event network-vif-plugged-80f4161b-5489-4982-b3be-238ea838561a for instance with vm_state active and task_state None.
Apr 14 10:45:18 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:18 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bb83505-5933-4944-8eb4-36367349244a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc06bb14-764f-4a9f-ac7d-577f85f2bdb2 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:18 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0ae1c67-01be-4f15-a575-b3a7008bae50 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc06bb14-764f-4a9f-ac7d-577f85f2bdb2 (non-flash)
Apr 14 10:45:18 user nova-compute[71509]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee (non-flash)
Apr 14 10:45:18 user nova-compute[71509]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18 (non-flash)
Apr 14 10:45:18 user nova-compute[71509]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768 (non-flash)
Apr 14 10:45:18 user nova-compute[71509]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700 (non-flash)
Apr 14 10:45:18 user nova-compute[71509]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92 (non-flash)
Apr 14 10:45:18 user nova-compute[71509]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171 (non-flash)
Apr 14 10:45:18 user nova-compute[71509]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e (non-flash)
Apr 14 10:45:18 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:45:18 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0ae1c67-01be-4f15-a575-b3a7008bae50 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc06bb14-764f-4a9f-ac7d-577f85f2bdb2 (non-flash)
Apr 14 10:45:18 user nova-compute[71509]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee (non-flash)
Apr 14 10:45:18 user nova-compute[71509]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18 (non-flash)
Apr 14 10:45:18 user nova-compute[71509]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768 (non-flash)
Apr 14 10:45:18 user nova-compute[71509]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700 (non-flash)
Apr 14 10:45:18 user nova-compute[71509]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92 (non-flash)
Apr 14 10:45:18 user nova-compute[71509]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171 (non-flash)
Apr 14 10:45:18 user nova-compute[71509]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e (non-flash)
Apr 14 10:45:18 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 10:45:18 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0ae1c67-01be-4f15-a575-b3a7008bae50 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0c2c3cb370>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc06bb14-764f-4a9f-ac7d-577f85f2bdb2'): ({'sdi'}, set())}) {{(pid=71509) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 10:45:18 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-a0ae1c67-01be-4f15-a575-b3a7008bae50 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Removing single pathed devices sdi {{(pid=71509) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 10:45:18 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:18 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:18 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[cad3dd2c-6270-4cbb-9529-e43358925bbc]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:18 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:18 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:18 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[db9ebab6-ee63-4231-9ca8-dd973e627c05]: (4, ('ok\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:18 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-a0ae1c67-01be-4f15-a575-b3a7008bae50 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Flushing IO for device /dev/sdi {{(pid=71509) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 10:45:18 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:18 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.015s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:18 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c8fcf76-14e0-439b-8c4d-41880910885d]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:18 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-a0ae1c67-01be-4f15-a575-b3a7008bae50 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=71509) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 10:45:18 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:18 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-546a6f18-7829-4e37-8d23-18a3ee81a015 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] [instance: d6f539d8-4144-467b-ac69-44011c5b3564] Calling os-brick to attach iSCSI Volume {{(pid=71509) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 10:45:18 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-546a6f18-7829-4e37-8d23-18a3ee81a015 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0bf0749390>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xQnqTguX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 10:45:18 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-546a6f18-7829-4e37-8d23-18a3ee81a015 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 10:45:18 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-546a6f18-7829-4e37-8d23-18a3ee81a015 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 10:45:18 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.041s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:18 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[846f730b-0880-4a3e-ae99-b2f4ac1f5c09]: (4, ('1', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:18 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-a0ae1c67-01be-4f15-a575-b3a7008bae50 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=71509) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 10:45:18 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-a0ae1c67-01be-4f15-a575-b3a7008bae50 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] SCSI volumes sdi have been removed. {{(pid=71509) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 10:45:18 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0ae1c67-01be-4f15-a575-b3a7008bae50 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc06bb14-764f-4a9f-ac7d-577f85f2bdb2')] {{(pid=71509) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 10:45:18 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc06bb14-764f-4a9f-ac7d-577f85f2bdb2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:18 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc06bb14-764f-4a9f-ac7d-577f85f2bdb2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:18 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[28355acc-a809-4a1f-a864-d775c34f1fa3]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:18 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0ae1c67-01be-4f15-a575-b3a7008bae50 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:45:18 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc06bb14-764f-4a9f-ac7d-577f85f2bdb2 -p 172.16.0.220:3260 --logout {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:18 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc06bb14-764f-4a9f-ac7d-577f85f2bdb2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:18 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[1066d293-ac88-418c-b3db-5d2cc47f2b52]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:dc06bb14-764f-4a9f-ac7d-577f85f2bdb2, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:dc06bb14-764f-4a9f-ac7d-577f85f2bdb2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:18 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0ae1c67-01be-4f15-a575-b3a7008bae50 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:dc06bb14-764f-4a9f-ac7d-577f85f2bdb2, portal: 172.16.0.220,3260]
Apr 14 10:45:18 user nova-compute[71509]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:dc06bb14-764f-4a9f-ac7d-577f85f2bdb2, portal: 172.16.0.220,3260] successful.
Apr 14 10:45:18 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:45:18 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc06bb14-764f-4a9f-ac7d-577f85f2bdb2 -p 172.16.0.220:3260 --op delete {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:18 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc06bb14-764f-4a9f-ac7d-577f85f2bdb2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:18 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c15df4c-3097-4277-993c-79c25394d969]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:18 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0ae1c67-01be-4f15-a575-b3a7008bae50 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:45:18 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-a0ae1c67-01be-4f15-a575-b3a7008bae50 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.349s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 10:45:18 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0ae1c67-01be-4f15-a575-b3a7008bae50 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] <== disconnect_volume: return (350ms) None {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 10:45:18 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0ae1c67-01be-4f15-a575-b3a7008bae50 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] [instance: ec16b4bc-5385-4eea-856f-710d52d0261d] Disconnected iSCSI Volume {{(pid=71509) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 10:45:18 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-546a6f18-7829-4e37-8d23-18a3ee81a015 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.154s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 10:45:18 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-546a6f18-7829-4e37-8d23-18a3ee81a015 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 10:45:18 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-546a6f18-7829-4e37-8d23-18a3ee81a015 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 10:45:18 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-546a6f18-7829-4e37-8d23-18a3ee81a015 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 10:45:18 user nova-compute[71509]: INFO os_brick.initiator.connectors.iscsi [None req-546a6f18-7829-4e37-8d23-18a3ee81a015 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 10:45:18 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63 -p 172.16.0.220:3260 {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:18 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:18 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[663d362c-5933-4e4f-83bd-1bbb626ba159]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:18 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-546a6f18-7829-4e37-8d23-18a3ee81a015 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 10:45:18 user nova-compute[71509]:  {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:45:18 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63 -p 172.16.0.220:3260 --interface default --op new {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:18 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:18 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[a99cbb82-2cf7-4c49-8d7d-68e09363845b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63] added\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:18 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-546a6f18-7829-4e37-8d23-18a3ee81a015 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63] added
Apr 14 10:45:18 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:45:18 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:18 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.040s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:18 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dd45cc7-b670-473e-8ff4-ad9173c2e609]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:18 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-546a6f18-7829-4e37-8d23-18a3ee81a015 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:45:18 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:18 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:18 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[e920037c-f45f-4e03-9176-4c8345344946]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:18 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-546a6f18-7829-4e37-8d23-18a3ee81a015 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:45:18 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xQnqTguX {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:18 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xQnqTguX" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:18 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[8244b9b1-85cf-4b7f-a4e5-df8dbb4fc5a4]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:18 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-546a6f18-7829-4e37-8d23-18a3ee81a015 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xQnqTguX'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:45:18 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:18 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:18 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bb68bab-f6be-4381-8650-0dcc04030395]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:18 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-546a6f18-7829-4e37-8d23-18a3ee81a015 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:45:18 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:18 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:18 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d5ed745-06a3-4b5d-ac44-9081240b2b9c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:18 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-546a6f18-7829-4e37-8d23-18a3ee81a015 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee (non-flash)
Apr 14 10:45:18 user nova-compute[71509]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18 (non-flash)
Apr 14 10:45:18 user nova-compute[71509]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768 (non-flash)
Apr 14 10:45:18 user nova-compute[71509]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700 (non-flash)
Apr 14 10:45:18 user nova-compute[71509]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92 (non-flash)
Apr 14 10:45:18 user nova-compute[71509]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171 (non-flash)
Apr 14 10:45:18 user nova-compute[71509]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e (non-flash)
Apr 14 10:45:18 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:45:18 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-546a6f18-7829-4e37-8d23-18a3ee81a015 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee (non-flash)
Apr 14 10:45:18 user nova-compute[71509]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18 (non-flash)
Apr 14 10:45:18 user nova-compute[71509]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768 (non-flash)
Apr 14 10:45:18 user nova-compute[71509]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700 (non-flash)
Apr 14 10:45:18 user nova-compute[71509]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92 (non-flash)
Apr 14 10:45:18 user nova-compute[71509]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171 (non-flash)
Apr 14 10:45:18 user nova-compute[71509]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e (non-flash)
Apr 14 10:45:18 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 10:45:18 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63 -p 172.16.0.220:3260 --login {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:18 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63 -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:18 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[46adc208-5b37-4bad-a214-d6faaf347aa8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:18 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-546a6f18-7829-4e37-8d23-18a3ee81a015 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63, portal: 172.16.0.220,3260]
Apr 14 10:45:18 user nova-compute[71509]: Login to [iface: default, target: iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63, portal: 172.16.0.220,3260] successful.
Apr 14 10:45:18 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:45:18 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:18 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:18 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[f84c415b-583a-42f1-82c0-c5635deede34]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:18 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-546a6f18-7829-4e37-8d23-18a3ee81a015 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:45:18 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:18 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:18 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[13912a80-3b23-4908-acfa-10994969110a]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:18 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-546a6f18-7829-4e37-8d23-18a3ee81a015 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63 (non-flash)
Apr 14 10:45:18 user nova-compute[71509]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee (non-flash)
Apr 14 10:45:18 user nova-compute[71509]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18 (non-flash)
Apr 14 10:45:18 user nova-compute[71509]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768 (non-flash)
Apr 14 10:45:18 user nova-compute[71509]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700 (non-flash)
Apr 14 10:45:18 user nova-compute[71509]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92 (non-flash)
Apr 14 10:45:18 user nova-compute[71509]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171 (non-flash)
Apr 14 10:45:18 user nova-compute[71509]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e (non-flash)
Apr 14 10:45:18 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:45:18 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-546a6f18-7829-4e37-8d23-18a3ee81a015 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63 (non-flash)
Apr 14 10:45:18 user nova-compute[71509]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee (non-flash)
Apr 14 10:45:18 user nova-compute[71509]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18 (non-flash)
Apr 14 10:45:18 user nova-compute[71509]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768 (non-flash)
Apr 14 10:45:18 user nova-compute[71509]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700 (non-flash)
Apr 14 10:45:18 user nova-compute[71509]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92 (non-flash)
Apr 14 10:45:18 user nova-compute[71509]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171 (non-flash)
Apr 14 10:45:18 user nova-compute[71509]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e (non-flash)
Apr 14 10:45:18 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 10:45:18 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-546a6f18-7829-4e37-8d23-18a3ee81a015 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.347s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 10:45:18 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-546a6f18-7829-4e37-8d23-18a3ee81a015 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Connected to 172.16.0.220:3260 {{(pid=71509) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 10:45:18 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-546a6f18-7829-4e37-8d23-18a3ee81a015 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] HCTL ('40', '-', '-', 0) found on session 11 with lun 0 {{(pid=71509) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 10:45:18 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-546a6f18-7829-4e37-8d23-18a3ee81a015 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=71509) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 10:45:18 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:18 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.020s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:18 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef6a8b7d-3900-43dc-b1a9-5406d60bea52]: (4, ('- - 0', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:18 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-546a6f18-7829-4e37-8d23-18a3ee81a015 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Searching for a device in session 11 and hctl ['40', '*', '*', 0] yield: None {{(pid=71509) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 10:45:19 user nova-compute[71509]: DEBUG nova.objects.instance [None req-a0ae1c67-01be-4f15-a575-b3a7008bae50 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Lazy-loading 'flavor' on Instance uuid ec16b4bc-5385-4eea-856f-710d52d0261d {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:45:19 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-a0ae1c67-01be-4f15-a575-b3a7008bae50 tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Lock "ec16b4bc-5385-4eea-856f-710d52d0261d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.837s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:45:19 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-546a6f18-7829-4e37-8d23-18a3ee81a015 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Searching for a device in session 11 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=71509) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 10:45:19 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-546a6f18-7829-4e37-8d23-18a3ee81a015 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xQnqTguX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71509) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 10:45:19 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-546a6f18-7829-4e37-8d23-18a3ee81a015 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.384s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 10:45:19 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-546a6f18-7829-4e37-8d23-18a3ee81a015 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] <== connect_volume: return (1537ms) {'type': 'block', 'scsi_wwn': '26631336661336563', 'path': '/dev/sdi'} {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 10:45:19 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-546a6f18-7829-4e37-8d23-18a3ee81a015 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] [instance: d6f539d8-4144-467b-ac69-44011c5b3564] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26631336661336563', 'path': '/dev/sdi'} {{(pid=71509) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 10:45:19 user nova-compute[71509]: DEBUG nova.objects.instance [None req-546a6f18-7829-4e37-8d23-18a3ee81a015 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Lazy-loading 'flavor' on Instance uuid d6f539d8-4144-467b-ac69-44011c5b3564 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:45:19 user nova-compute[71509]: DEBUG nova.virt.libvirt.guest [None req-546a6f18-7829-4e37-8d23-18a3ee81a015 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 10:45:19 user nova-compute[71509]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 10:45:19 user nova-compute[71509]:   <source dev="/dev/sdi"/>
Apr 14 10:45:19 user nova-compute[71509]:   <target dev="vdb" bus="virtio"/>
Apr 14 10:45:19 user nova-compute[71509]:   <serial>4cfc127d-dadf-4588-9781-c90f1906df63</serial>
Apr 14 10:45:19 user nova-compute[71509]: </disk>
Apr 14 10:45:19 user nova-compute[71509]:  {{(pid=71509) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 10:45:20 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-e10bc877-6504-4543-87fe-cafcded8ca7d tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Acquiring lock "ec16b4bc-5385-4eea-856f-710d52d0261d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:45:20 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-e10bc877-6504-4543-87fe-cafcded8ca7d tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Lock "ec16b4bc-5385-4eea-856f-710d52d0261d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:45:20 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-e10bc877-6504-4543-87fe-cafcded8ca7d tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Acquiring lock "ec16b4bc-5385-4eea-856f-710d52d0261d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:45:20 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-e10bc877-6504-4543-87fe-cafcded8ca7d tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Lock "ec16b4bc-5385-4eea-856f-710d52d0261d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:45:20 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-e10bc877-6504-4543-87fe-cafcded8ca7d tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Lock "ec16b4bc-5385-4eea-856f-710d52d0261d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:45:20 user nova-compute[71509]: INFO nova.compute.manager [None req-e10bc877-6504-4543-87fe-cafcded8ca7d tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] [instance: ec16b4bc-5385-4eea-856f-710d52d0261d] Terminating instance
Apr 14 10:45:20 user nova-compute[71509]: DEBUG nova.compute.manager [None req-e10bc877-6504-4543-87fe-cafcded8ca7d tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] [instance: ec16b4bc-5385-4eea-856f-710d52d0261d] Start destroying the instance on the hypervisor. {{(pid=71509) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 10:45:20 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:20 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-546a6f18-7829-4e37-8d23-18a3ee81a015 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] No BDM found with device name vda, not building metadata. {{(pid=71509) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 10:45:20 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-546a6f18-7829-4e37-8d23-18a3ee81a015 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71509) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 10:45:20 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-546a6f18-7829-4e37-8d23-18a3ee81a015 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] No VIF found with MAC fa:16:3e:33:37:3e, not building metadata {{(pid=71509) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 10:45:20 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:20 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:20 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-546a6f18-7829-4e37-8d23-18a3ee81a015 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Lock "d6f539d8-4144-467b-ac69-44011c5b3564" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.081s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:45:20 user nova-compute[71509]: DEBUG nova.compute.manager [req-958eaf35-3ffc-4407-ad08-b1ae692816b7 req-c677a436-ba5a-4a59-8ac1-a41955870389 service nova] [instance: ec16b4bc-5385-4eea-856f-710d52d0261d] Received event network-vif-unplugged-2ee28d01-fbb2-4cf6-adcd-342fdabc8458 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:45:20 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-958eaf35-3ffc-4407-ad08-b1ae692816b7 req-c677a436-ba5a-4a59-8ac1-a41955870389 service nova] Acquiring lock "ec16b4bc-5385-4eea-856f-710d52d0261d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:45:20 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-958eaf35-3ffc-4407-ad08-b1ae692816b7 req-c677a436-ba5a-4a59-8ac1-a41955870389 service nova] Lock "ec16b4bc-5385-4eea-856f-710d52d0261d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:45:20 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-958eaf35-3ffc-4407-ad08-b1ae692816b7 req-c677a436-ba5a-4a59-8ac1-a41955870389 service nova] Lock "ec16b4bc-5385-4eea-856f-710d52d0261d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:45:20 user nova-compute[71509]: DEBUG nova.compute.manager [req-958eaf35-3ffc-4407-ad08-b1ae692816b7 req-c677a436-ba5a-4a59-8ac1-a41955870389 service nova] [instance: ec16b4bc-5385-4eea-856f-710d52d0261d] No waiting events found dispatching network-vif-unplugged-2ee28d01-fbb2-4cf6-adcd-342fdabc8458 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:45:20 user nova-compute[71509]: DEBUG nova.compute.manager [req-958eaf35-3ffc-4407-ad08-b1ae692816b7 req-c677a436-ba5a-4a59-8ac1-a41955870389 service nova] [instance: ec16b4bc-5385-4eea-856f-710d52d0261d] Received event network-vif-unplugged-2ee28d01-fbb2-4cf6-adcd-342fdabc8458 for instance with task_state deleting. {{(pid=71509) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 10:45:20 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: ec16b4bc-5385-4eea-856f-710d52d0261d] Instance destroyed successfully.
Apr 14 10:45:20 user nova-compute[71509]: DEBUG nova.objects.instance [None req-e10bc877-6504-4543-87fe-cafcded8ca7d tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Lazy-loading 'resources' on Instance uuid ec16b4bc-5385-4eea-856f-710d52d0261d {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:45:20 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-e10bc877-6504-4543-87fe-cafcded8ca7d tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T10:43:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1939318021',display_name='tempest-AttachSCSIVolumeTestJSON-server-1939318021',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1939318021',id=6,image_ref='ed0c452a-8d78-4384-a7fd-42b906083cfb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLJOFZ8W37hnq+kD091gcZmfKt0DbPWyNzwj7yK+k5JHq+c+tzsMxH1HPOh1pMpymrDK+TpdkALjgZfKfob4LIzOz/KHG73qeijcsRYqyklipL4lvgFNZ8j26eWO1fqqtg==',key_name='tempest-keypair-1306588747',keypairs=<?>,launch_index=0,launched_at=2023-04-14T10:43:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='77068eae4fa9459fbe81026615d0c16d',ramdisk_id='',reservation_id='r-mhedquh2',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ed0c452a-8d78-4384-a7fd-42b906083cfb',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1881116553',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1881116553-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T10:43:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='806d72cf0d0f4de3a4b9f0466a8e094d',uuid=ec16b4bc-5385-4eea-856f-710d52d0261d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2ee28d01-fbb2-4cf6-adcd-342fdabc8458", "address": "fa:16:3e:9a:29:80", "network": {"id": "79481373-f78f-46b0-bda0-5e66dea2fd31", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1244430846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77068eae4fa9459fbe81026615d0c16d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ee28d01-fb", "ovs_interfaceid": "2ee28d01-fbb2-4cf6-adcd-342fdabc8458", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 10:45:20 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-e10bc877-6504-4543-87fe-cafcded8ca7d tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Converting VIF {"id": "2ee28d01-fbb2-4cf6-adcd-342fdabc8458", "address": "fa:16:3e:9a:29:80", "network": {"id": "79481373-f78f-46b0-bda0-5e66dea2fd31", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1244430846-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77068eae4fa9459fbe81026615d0c16d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ee28d01-fb", "ovs_interfaceid": "2ee28d01-fbb2-4cf6-adcd-342fdabc8458", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:45:20 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-e10bc877-6504-4543-87fe-cafcded8ca7d tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9a:29:80,bridge_name='br-int',has_traffic_filtering=True,id=2ee28d01-fbb2-4cf6-adcd-342fdabc8458,network=Network(79481373-f78f-46b0-bda0-5e66dea2fd31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ee28d01-fb') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:45:20 user nova-compute[71509]: DEBUG os_vif [None req-e10bc877-6504-4543-87fe-cafcded8ca7d tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9a:29:80,bridge_name='br-int',has_traffic_filtering=True,id=2ee28d01-fbb2-4cf6-adcd-342fdabc8458,network=Network(79481373-f78f-46b0-bda0-5e66dea2fd31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ee28d01-fb') {{(pid=71509) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 10:45:20 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:20 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2ee28d01-fb, bridge=br-int, if_exists=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:45:20 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:20 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:20 user nova-compute[71509]: INFO os_vif [None req-e10bc877-6504-4543-87fe-cafcded8ca7d tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9a:29:80,bridge_name='br-int',has_traffic_filtering=True,id=2ee28d01-fbb2-4cf6-adcd-342fdabc8458,network=Network(79481373-f78f-46b0-bda0-5e66dea2fd31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ee28d01-fb')
Apr 14 10:45:20 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-e10bc877-6504-4543-87fe-cafcded8ca7d tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] [instance: ec16b4bc-5385-4eea-856f-710d52d0261d] Deleting instance files /opt/stack/data/nova/instances/ec16b4bc-5385-4eea-856f-710d52d0261d_del
Apr 14 10:45:20 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-e10bc877-6504-4543-87fe-cafcded8ca7d tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] [instance: ec16b4bc-5385-4eea-856f-710d52d0261d] Deletion of /opt/stack/data/nova/instances/ec16b4bc-5385-4eea-856f-710d52d0261d_del complete
Apr 14 10:45:21 user nova-compute[71509]: INFO nova.compute.manager [None req-e10bc877-6504-4543-87fe-cafcded8ca7d tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] [instance: ec16b4bc-5385-4eea-856f-710d52d0261d] Took 0.88 seconds to destroy the instance on the hypervisor.
Apr 14 10:45:21 user nova-compute[71509]: DEBUG oslo.service.loopingcall [None req-e10bc877-6504-4543-87fe-cafcded8ca7d tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71509) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 10:45:21 user nova-compute[71509]: DEBUG nova.compute.manager [-] [instance: ec16b4bc-5385-4eea-856f-710d52d0261d] Deallocating network for instance {{(pid=71509) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 10:45:21 user nova-compute[71509]: DEBUG nova.network.neutron [-] [instance: ec16b4bc-5385-4eea-856f-710d52d0261d] deallocate_for_instance() {{(pid=71509) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 10:45:21 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-4f08ce28-907f-4117-843f-fadda0a3c043 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] Acquiring lock "d6f539d8-4144-467b-ac69-44011c5b3564" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:45:21 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-4f08ce28-907f-4117-843f-fadda0a3c043 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] Lock "d6f539d8-4144-467b-ac69-44011c5b3564" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:45:21 user nova-compute[71509]: DEBUG os_brick.utils [None req-4f08ce28-907f-4117-843f-fadda0a3c043 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 10:45:21 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:21 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:21 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[7af70d79-9149-40db-95e9-1e8baf81705d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50119df3c417\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:21 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:21 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:21 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[afa793fb-b92b-45ff-96c8-825a4fccce51]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:21 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:21 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:21 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[798f620c-4384-4b0b-87a8-2f405ead83ce]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:21 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0d35782-518b-4475-a217-139e18eb36d2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:21 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-4f08ce28-907f-4117-843f-fadda0a3c043 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] Running cmd (subprocess): nvme version {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:21 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-4f08ce28-907f-4117-843f-fadda0a3c043 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] 'nvme version' failed. Not Retrying. {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 10:45:21 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4f08ce28-907f-4117-843f-fadda0a3c043 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] nvme not present on system {{(pid=71509) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 10:45:21 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:21 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 10:45:21 user nova-compute[71509]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 10:45:21 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[41b481bd-29fe-4ad3-9228-52ce4281b3ef]: (4, '') {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:21 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-4f08ce28-907f-4117-843f-fadda0a3c043 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71509) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 10:45:21 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-4f08ce28-907f-4117-843f-fadda0a3c043 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71509) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 10:45:21 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-4f08ce28-907f-4117-843f-fadda0a3c043 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] LIGHTOS: no hostnqn found. {{(pid=71509) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 10:45:21 user nova-compute[71509]: DEBUG os_brick.utils [None req-4f08ce28-907f-4117-843f-fadda0a3c043 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50119df3c417', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 10:45:21 user nova-compute[71509]: DEBUG nova.network.neutron [-] [instance: ec16b4bc-5385-4eea-856f-710d52d0261d] Updating instance_info_cache with network_info: [] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:45:21 user nova-compute[71509]: INFO nova.compute.manager [-] [instance: ec16b4bc-5385-4eea-856f-710d52d0261d] Took 0.93 seconds to deallocate network for instance.
Apr 14 10:45:22 user nova-compute[71509]: INFO nova.compute.manager [None req-4f08ce28-907f-4117-843f-fadda0a3c043 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] [instance: d6f539d8-4144-467b-ac69-44011c5b3564] Swapping volume 4cfc127d-dadf-4588-9781-c90f1906df63 for 87bf508a-fb5e-40aa-abb8-ca896d37d55f
Apr 14 10:45:22 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-e10bc877-6504-4543-87fe-cafcded8ca7d tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:45:22 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-e10bc877-6504-4543-87fe-cafcded8ca7d tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:45:22 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-e10bc877-6504-4543-87fe-cafcded8ca7d tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 10:45:22 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-e10bc877-6504-4543-87fe-cafcded8ca7d tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 10:45:22 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-e10bc877-6504-4543-87fe-cafcded8ca7d tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.437s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:45:22 user nova-compute[71509]: INFO nova.scheduler.client.report [None req-e10bc877-6504-4543-87fe-cafcded8ca7d tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Deleted allocations for instance ec16b4bc-5385-4eea-856f-710d52d0261d
Apr 14 10:45:22 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-e10bc877-6504-4543-87fe-cafcded8ca7d tempest-AttachSCSIVolumeTestJSON-1881116553 tempest-AttachSCSIVolumeTestJSON-1881116553-project-member] Lock "ec16b4bc-5385-4eea-856f-710d52d0261d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.495s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:45:22 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:22 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2a1a189-77b7-4a79-a276-6b35cd845f5c tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] [instance: 31f6ad8c-40d3-4b6e-af07-4848fafc431d] Calling os-brick to attach iSCSI Volume {{(pid=71509) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 10:45:22 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a1a189-77b7-4a79-a276-6b35cd845f5c tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0bf0749390>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:207caef0-4168-4698-be0c-09ae18f2102d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lrQReLxw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 10:45:22 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-e2a1a189-77b7-4a79-a276-6b35cd845f5c tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 10:45:22 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-e2a1a189-77b7-4a79-a276-6b35cd845f5c tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 10:45:22 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-e2a1a189-77b7-4a79-a276-6b35cd845f5c tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 10:45:22 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-e2a1a189-77b7-4a79-a276-6b35cd845f5c tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 10:45:22 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-e2a1a189-77b7-4a79-a276-6b35cd845f5c tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:207caef0-4168-4698-be0c-09ae18f2102d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 10:45:22 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-e2a1a189-77b7-4a79-a276-6b35cd845f5c tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:207caef0-4168-4698-be0c-09ae18f2102d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 10:45:22 user nova-compute[71509]: INFO os_brick.initiator.connectors.iscsi [None req-e2a1a189-77b7-4a79-a276-6b35cd845f5c tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 10:45:22 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:207caef0-4168-4698-be0c-09ae18f2102d -p 172.16.0.220:3260 {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:22 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:207caef0-4168-4698-be0c-09ae18f2102d -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:22 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[b30350ae-86f6-4342-b2c0-3141fa0a0ff4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:22 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a1a189-77b7-4a79-a276-6b35cd845f5c tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 10:45:22 user nova-compute[71509]:  {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:45:22 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:207caef0-4168-4698-be0c-09ae18f2102d -p 172.16.0.220:3260 --interface default --op new {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:22 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:207caef0-4168-4698-be0c-09ae18f2102d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:22 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[657597df-4500-4691-a324-fe2835704838]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:207caef0-4168-4698-be0c-09ae18f2102d] added\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:22 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a1a189-77b7-4a79-a276-6b35cd845f5c tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:207caef0-4168-4698-be0c-09ae18f2102d] added
Apr 14 10:45:22 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:45:22 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:207caef0-4168-4698-be0c-09ae18f2102d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:22 user nova-compute[71509]: DEBUG nova.compute.manager [req-556fa0db-299c-43cb-af22-f503496c15e6 req-7b5ed49f-6264-43af-973b-b2227855fcbe service nova] [instance: ec16b4bc-5385-4eea-856f-710d52d0261d] Received event network-vif-plugged-2ee28d01-fbb2-4cf6-adcd-342fdabc8458 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:45:22 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-556fa0db-299c-43cb-af22-f503496c15e6 req-7b5ed49f-6264-43af-973b-b2227855fcbe service nova] Acquiring lock "ec16b4bc-5385-4eea-856f-710d52d0261d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:45:22 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-556fa0db-299c-43cb-af22-f503496c15e6 req-7b5ed49f-6264-43af-973b-b2227855fcbe service nova] Lock "ec16b4bc-5385-4eea-856f-710d52d0261d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:45:22 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-556fa0db-299c-43cb-af22-f503496c15e6 req-7b5ed49f-6264-43af-973b-b2227855fcbe service nova] Lock "ec16b4bc-5385-4eea-856f-710d52d0261d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:45:22 user nova-compute[71509]: DEBUG nova.compute.manager [req-556fa0db-299c-43cb-af22-f503496c15e6 req-7b5ed49f-6264-43af-973b-b2227855fcbe service nova] [instance: ec16b4bc-5385-4eea-856f-710d52d0261d] No waiting events found dispatching network-vif-plugged-2ee28d01-fbb2-4cf6-adcd-342fdabc8458 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:45:22 user nova-compute[71509]: WARNING nova.compute.manager [req-556fa0db-299c-43cb-af22-f503496c15e6 req-7b5ed49f-6264-43af-973b-b2227855fcbe service nova] [instance: ec16b4bc-5385-4eea-856f-710d52d0261d] Received unexpected event network-vif-plugged-2ee28d01-fbb2-4cf6-adcd-342fdabc8458 for instance with vm_state deleted and task_state None.
Apr 14 10:45:22 user nova-compute[71509]: DEBUG nova.compute.manager [req-556fa0db-299c-43cb-af22-f503496c15e6 req-7b5ed49f-6264-43af-973b-b2227855fcbe service nova] [instance: ec16b4bc-5385-4eea-856f-710d52d0261d] Received event network-vif-deleted-2ee28d01-fbb2-4cf6-adcd-342fdabc8458 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:45:22 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:207caef0-4168-4698-be0c-09ae18f2102d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:22 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4f64445-924b-47d3-b8bf-65409e1050c7]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:22 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a1a189-77b7-4a79-a276-6b35cd845f5c tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:45:22 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:207caef0-4168-4698-be0c-09ae18f2102d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:22 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:207caef0-4168-4698-be0c-09ae18f2102d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:22 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[76d516c1-5879-45ee-b852-892914014258]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:22 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a1a189-77b7-4a79-a276-6b35cd845f5c tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:45:22 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:207caef0-4168-4698-be0c-09ae18f2102d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lrQReLxw {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:22 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:207caef0-4168-4698-be0c-09ae18f2102d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lrQReLxw" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:22 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[2531679f-bf1b-429f-8877-26ec0e44e56d]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:22 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a1a189-77b7-4a79-a276-6b35cd845f5c tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lrQReLxw'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:45:22 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:207caef0-4168-4698-be0c-09ae18f2102d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:22 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:207caef0-4168-4698-be0c-09ae18f2102d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:22 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fd664b7-bf91-43fb-b12b-f1413adcb523]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:22 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a1a189-77b7-4a79-a276-6b35cd845f5c tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:45:22 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:23 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:23 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[adb50dd5-600b-4c57-9236-a1378058b90d]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:23 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a1a189-77b7-4a79-a276-6b35cd845f5c tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63 (non-flash)
Apr 14 10:45:23 user nova-compute[71509]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee (non-flash)
Apr 14 10:45:23 user nova-compute[71509]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18 (non-flash)
Apr 14 10:45:23 user nova-compute[71509]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768 (non-flash)
Apr 14 10:45:23 user nova-compute[71509]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700 (non-flash)
Apr 14 10:45:23 user nova-compute[71509]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92 (non-flash)
Apr 14 10:45:23 user nova-compute[71509]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171 (non-flash)
Apr 14 10:45:23 user nova-compute[71509]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e (non-flash)
Apr 14 10:45:23 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:45:23 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a1a189-77b7-4a79-a276-6b35cd845f5c tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63 (non-flash)
Apr 14 10:45:23 user nova-compute[71509]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee (non-flash)
Apr 14 10:45:23 user nova-compute[71509]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18 (non-flash)
Apr 14 10:45:23 user nova-compute[71509]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768 (non-flash)
Apr 14 10:45:23 user nova-compute[71509]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700 (non-flash)
Apr 14 10:45:23 user nova-compute[71509]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92 (non-flash)
Apr 14 10:45:23 user nova-compute[71509]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171 (non-flash)
Apr 14 10:45:23 user nova-compute[71509]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e (non-flash)
Apr 14 10:45:23 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 10:45:23 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:207caef0-4168-4698-be0c-09ae18f2102d -p 172.16.0.220:3260 --login {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:23 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:207caef0-4168-4698-be0c-09ae18f2102d -p 172.16.0.220:3260 --login" returned: 0 in 0.096s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:23 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[4edc70dd-ee24-4ade-9f05-e578ea872601]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:207caef0-4168-4698-be0c-09ae18f2102d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:207caef0-4168-4698-be0c-09ae18f2102d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:23 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a1a189-77b7-4a79-a276-6b35cd845f5c tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:207caef0-4168-4698-be0c-09ae18f2102d, portal: 172.16.0.220,3260]
Apr 14 10:45:23 user nova-compute[71509]: Login to [iface: default, target: iqn.2010-10.org.openstack:207caef0-4168-4698-be0c-09ae18f2102d, portal: 172.16.0.220,3260] successful.
Apr 14 10:45:23 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:45:23 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:207caef0-4168-4698-be0c-09ae18f2102d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:23 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:207caef0-4168-4698-be0c-09ae18f2102d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:23 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[71261966-be74-4fe5-a3b4-d3d778cd3931]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:23 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a1a189-77b7-4a79-a276-6b35cd845f5c tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:45:23 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:23 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:23 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d32c0ee-969b-490c-aca9-db95c0da8601]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:207caef0-4168-4698-be0c-09ae18f2102d (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:23 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a1a189-77b7-4a79-a276-6b35cd845f5c tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63 (non-flash)
Apr 14 10:45:23 user nova-compute[71509]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:207caef0-4168-4698-be0c-09ae18f2102d (non-flash)
Apr 14 10:45:23 user nova-compute[71509]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee (non-flash)
Apr 14 10:45:23 user nova-compute[71509]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18 (non-flash)
Apr 14 10:45:23 user nova-compute[71509]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768 (non-flash)
Apr 14 10:45:23 user nova-compute[71509]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700 (non-flash)
Apr 14 10:45:23 user nova-compute[71509]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92 (non-flash)
Apr 14 10:45:23 user nova-compute[71509]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171 (non-flash)
Apr 14 10:45:23 user nova-compute[71509]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e (non-flash)
Apr 14 10:45:23 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:45:23 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a1a189-77b7-4a79-a276-6b35cd845f5c tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63 (non-flash)
Apr 14 10:45:23 user nova-compute[71509]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:207caef0-4168-4698-be0c-09ae18f2102d (non-flash)
Apr 14 10:45:23 user nova-compute[71509]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee (non-flash)
Apr 14 10:45:23 user nova-compute[71509]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18 (non-flash)
Apr 14 10:45:23 user nova-compute[71509]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768 (non-flash)
Apr 14 10:45:23 user nova-compute[71509]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700 (non-flash)
Apr 14 10:45:23 user nova-compute[71509]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92 (non-flash)
Apr 14 10:45:23 user nova-compute[71509]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171 (non-flash)
Apr 14 10:45:23 user nova-compute[71509]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e (non-flash)
Apr 14 10:45:23 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 10:45:23 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-e2a1a189-77b7-4a79-a276-6b35cd845f5c tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:207caef0-4168-4698-be0c-09ae18f2102d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.401s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 10:45:23 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a1a189-77b7-4a79-a276-6b35cd845f5c tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Connected to 172.16.0.220:3260 {{(pid=71509) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 10:45:23 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-e2a1a189-77b7-4a79-a276-6b35cd845f5c tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] HCTL ('41', '-', '-', 0) found on session 12 with lun 0 {{(pid=71509) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 10:45:23 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-e2a1a189-77b7-4a79-a276-6b35cd845f5c tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=71509) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 10:45:23 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:23 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.020s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:23 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[4710ecd7-39ac-41dd-a180-61b28005ff43]: (4, ('- - 0', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:23 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-e2a1a189-77b7-4a79-a276-6b35cd845f5c tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Searching for a device in session 12 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=71509) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 10:45:23 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a1a189-77b7-4a79-a276-6b35cd845f5c tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:207caef0-4168-4698-be0c-09ae18f2102d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lrQReLxw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71509) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 10:45:24 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-e2a1a189-77b7-4a79-a276-6b35cd845f5c tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.443s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 10:45:24 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a1a189-77b7-4a79-a276-6b35cd845f5c tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] <== connect_volume: return (1444ms) {'type': 'block', 'scsi_wwn': '26630623966336431', 'path': '/dev/sdj'} {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 10:45:24 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2a1a189-77b7-4a79-a276-6b35cd845f5c tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] [instance: 31f6ad8c-40d3-4b6e-af07-4848fafc431d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26630623966336431', 'path': '/dev/sdj'} {{(pid=71509) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 10:45:24 user nova-compute[71509]: DEBUG nova.objects.instance [None req-e2a1a189-77b7-4a79-a276-6b35cd845f5c tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Lazy-loading 'flavor' on Instance uuid 31f6ad8c-40d3-4b6e-af07-4848fafc431d {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:45:24 user nova-compute[71509]: DEBUG nova.virt.libvirt.guest [None req-e2a1a189-77b7-4a79-a276-6b35cd845f5c tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 10:45:24 user nova-compute[71509]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 10:45:24 user nova-compute[71509]:   <source dev="/dev/sdj"/>
Apr 14 10:45:24 user nova-compute[71509]:   <target dev="vdb" bus="virtio"/>
Apr 14 10:45:24 user nova-compute[71509]:   <serial>207caef0-4168-4698-be0c-09ae18f2102d</serial>
Apr 14 10:45:24 user nova-compute[71509]: </disk>
Apr 14 10:45:24 user nova-compute[71509]:  {{(pid=71509) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 10:45:24 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-e2a1a189-77b7-4a79-a276-6b35cd845f5c tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] No BDM found with device name vda, not building metadata. {{(pid=71509) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 10:45:24 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-e2a1a189-77b7-4a79-a276-6b35cd845f5c tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] No BDM found with device name hda, not building metadata. {{(pid=71509) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 10:45:24 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-e2a1a189-77b7-4a79-a276-6b35cd845f5c tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] No VIF found with MAC fa:16:3e:2a:16:ab, not building metadata {{(pid=71509) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 10:45:24 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-e2a1a189-77b7-4a79-a276-6b35cd845f5c tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Lock "31f6ad8c-40d3-4b6e-af07-4848fafc431d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.022s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:45:25 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:25 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-c79045be-32b0-474e-b5c3-449b9c73b199 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Acquiring lock "31f6ad8c-40d3-4b6e-af07-4848fafc431d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:45:25 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-c79045be-32b0-474e-b5c3-449b9c73b199 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Lock "31f6ad8c-40d3-4b6e-af07-4848fafc431d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:45:25 user nova-compute[71509]: INFO nova.compute.manager [None req-c79045be-32b0-474e-b5c3-449b9c73b199 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] [instance: 31f6ad8c-40d3-4b6e-af07-4848fafc431d] Detaching volume 207caef0-4168-4698-be0c-09ae18f2102d
Apr 14 10:45:26 user nova-compute[71509]: INFO nova.virt.block_device [None req-c79045be-32b0-474e-b5c3-449b9c73b199 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] [instance: 31f6ad8c-40d3-4b6e-af07-4848fafc431d] Attempting to driver detach volume 207caef0-4168-4698-be0c-09ae18f2102d from mountpoint /dev/vdb
Apr 14 10:45:26 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-c79045be-32b0-474e-b5c3-449b9c73b199 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Attempting to detach device vdb from instance 31f6ad8c-40d3-4b6e-af07-4848fafc431d from the persistent domain config. {{(pid=71509) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 10:45:26 user nova-compute[71509]: DEBUG nova.virt.libvirt.guest [None req-c79045be-32b0-474e-b5c3-449b9c73b199 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 10:45:26 user nova-compute[71509]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 10:45:26 user nova-compute[71509]:   <source dev="/dev/sdj"/>
Apr 14 10:45:26 user nova-compute[71509]:   <target dev="vdb" bus="virtio"/>
Apr 14 10:45:26 user nova-compute[71509]:   <serial>207caef0-4168-4698-be0c-09ae18f2102d</serial>
Apr 14 10:45:26 user nova-compute[71509]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Apr 14 10:45:26 user nova-compute[71509]: </disk>
Apr 14 10:45:26 user nova-compute[71509]:  {{(pid=71509) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 10:45:26 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-c79045be-32b0-474e-b5c3-449b9c73b199 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Successfully detached device vdb from instance 31f6ad8c-40d3-4b6e-af07-4848fafc431d from the persistent domain config.
Apr 14 10:45:26 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-c79045be-32b0-474e-b5c3-449b9c73b199 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 31f6ad8c-40d3-4b6e-af07-4848fafc431d from the live domain config. {{(pid=71509) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 10:45:26 user nova-compute[71509]: DEBUG nova.virt.libvirt.guest [None req-c79045be-32b0-474e-b5c3-449b9c73b199 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 10:45:26 user nova-compute[71509]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 10:45:26 user nova-compute[71509]:   <source dev="/dev/sdj"/>
Apr 14 10:45:26 user nova-compute[71509]:   <target dev="vdb" bus="virtio"/>
Apr 14 10:45:26 user nova-compute[71509]:   <serial>207caef0-4168-4698-be0c-09ae18f2102d</serial>
Apr 14 10:45:26 user nova-compute[71509]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Apr 14 10:45:26 user nova-compute[71509]: </disk>
Apr 14 10:45:26 user nova-compute[71509]:  {{(pid=71509) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 10:45:26 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Received event <DeviceRemovedEvent: 1681469126.5172248, 31f6ad8c-40d3-4b6e-af07-4848fafc431d => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71509) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 10:45:26 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-c79045be-32b0-474e-b5c3-449b9c73b199 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 31f6ad8c-40d3-4b6e-af07-4848fafc431d {{(pid=71509) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 10:45:26 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-c79045be-32b0-474e-b5c3-449b9c73b199 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Successfully detached device vdb from instance 31f6ad8c-40d3-4b6e-af07-4848fafc431d from the live domain config.
Apr 14 10:45:26 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c79045be-32b0-474e-b5c3-449b9c73b199 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] [instance: 31f6ad8c-40d3-4b6e-af07-4848fafc431d] calling os-brick to detach iSCSI Volume {{(pid=71509) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 10:45:26 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79045be-32b0-474e-b5c3-449b9c73b199 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0bf0749390>, {'target_iqn': 'iqn.2010-10.org.openstack:207caef0-4168-4698-be0c-09ae18f2102d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lrQReLxw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj': {}}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 10:45:26 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-c79045be-32b0-474e-b5c3-449b9c73b199 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 10:45:26 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-c79045be-32b0-474e-b5c3-449b9c73b199 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 10:45:26 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-c79045be-32b0-474e-b5c3-449b9c73b199 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 10:45:26 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:26 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:26 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[af44c10c-79ca-4400-aa6f-ab1c4c294129]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:207caef0-4168-4698-be0c-09ae18f2102d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:26 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79045be-32b0-474e-b5c3-449b9c73b199 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 10:45:26 user nova-compute[71509]: No targets found.
Apr 14 10:45:26 user nova-compute[71509]: iSNS:
Apr 14 10:45:26 user nova-compute[71509]: No targets found.
Apr 14 10:45:26 user nova-compute[71509]: STATIC:
Apr 14 10:45:26 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18
Apr 14 10:45:26 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:45:26 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:45:26 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768
Apr 14 10:45:26 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:45:26 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:45:26 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171
Apr 14 10:45:26 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:45:26 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:45:26 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:207caef0-4168-4698-be0c-09ae18f2102d
Apr 14 10:45:26 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:45:26 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:45:26 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee
Apr 14 10:45:26 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:45:26 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:45:26 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e
Apr 14 10:45:26 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:45:26 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:45:26 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700
Apr 14 10:45:26 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:45:26 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:45:26 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63
Apr 14 10:45:26 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:45:26 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:45:26 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92
Apr 14 10:45:26 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:45:26 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:45:26 user nova-compute[71509]: FIRMWARE:
Apr 14 10:45:26 user nova-compute[71509]: No targets found.
Apr 14 10:45:26 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:45:26 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79045be-32b0-474e-b5c3-449b9c73b199 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 10:45:26 user nova-compute[71509]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 10:45:26 user nova-compute[71509]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71509) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 10:45:26 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79045be-32b0-474e-b5c3-449b9c73b199 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:207caef0-4168-4698-be0c-09ae18f2102d', 0)] {{(pid=71509) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 10:45:26 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:26 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:26 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf6da640-ee66-4511-9a3e-c044595a1082]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:207caef0-4168-4698-be0c-09ae18f2102d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:26 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:26 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:26 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8945411-7ccf-4d59-8cc3-1e2d3d5ac3b1]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:207caef0-4168-4698-be0c-09ae18f2102d (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:26 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79045be-32b0-474e-b5c3-449b9c73b199 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63 (non-flash)
Apr 14 10:45:26 user nova-compute[71509]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:207caef0-4168-4698-be0c-09ae18f2102d (non-flash)
Apr 14 10:45:26 user nova-compute[71509]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee (non-flash)
Apr 14 10:45:26 user nova-compute[71509]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18 (non-flash)
Apr 14 10:45:26 user nova-compute[71509]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768 (non-flash)
Apr 14 10:45:26 user nova-compute[71509]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700 (non-flash)
Apr 14 10:45:26 user nova-compute[71509]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92 (non-flash)
Apr 14 10:45:26 user nova-compute[71509]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171 (non-flash)
Apr 14 10:45:26 user nova-compute[71509]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e (non-flash)
Apr 14 10:45:26 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:45:26 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79045be-32b0-474e-b5c3-449b9c73b199 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63 (non-flash)
Apr 14 10:45:26 user nova-compute[71509]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:207caef0-4168-4698-be0c-09ae18f2102d (non-flash)
Apr 14 10:45:26 user nova-compute[71509]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee (non-flash)
Apr 14 10:45:26 user nova-compute[71509]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18 (non-flash)
Apr 14 10:45:26 user nova-compute[71509]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768 (non-flash)
Apr 14 10:45:26 user nova-compute[71509]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700 (non-flash)
Apr 14 10:45:26 user nova-compute[71509]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92 (non-flash)
Apr 14 10:45:26 user nova-compute[71509]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171 (non-flash)
Apr 14 10:45:26 user nova-compute[71509]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e (non-flash)
Apr 14 10:45:26 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 10:45:26 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79045be-32b0-474e-b5c3-449b9c73b199 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0c2c205a20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:207caef0-4168-4698-be0c-09ae18f2102d'): ({'sdj'}, set())}) {{(pid=71509) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 10:45:26 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-c79045be-32b0-474e-b5c3-449b9c73b199 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Removing single pathed devices sdj {{(pid=71509) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 10:45:26 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:26 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:26 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf358f72-bb8b-4d84-878e-67f5cdcaa582]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:26 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:26 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:26 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[a73aed1b-d09c-41c7-b150-b308aca09651]: (4, ('ok\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:26 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-c79045be-32b0-474e-b5c3-449b9c73b199 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Flushing IO for device /dev/sdj {{(pid=71509) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 10:45:26 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:26 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.015s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:26 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[2274dcef-e2bf-4796-a790-b8fc355bc19c]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:26 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-c79045be-32b0-474e-b5c3-449b9c73b199 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=71509) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 10:45:26 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:26 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.035s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:26 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[b149c01f-ae47-41f7-89fe-26f504e47f15]: (4, ('1', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:26 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-c79045be-32b0-474e-b5c3-449b9c73b199 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=71509) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 10:45:26 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-c79045be-32b0-474e-b5c3-449b9c73b199 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] SCSI volumes sdj have been removed. {{(pid=71509) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 10:45:26 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79045be-32b0-474e-b5c3-449b9c73b199 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:207caef0-4168-4698-be0c-09ae18f2102d')] {{(pid=71509) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 10:45:26 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:207caef0-4168-4698-be0c-09ae18f2102d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:26 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:207caef0-4168-4698-be0c-09ae18f2102d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:26 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[a524aba9-7509-45b5-b3f4-39bf367e3031]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:26 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79045be-32b0-474e-b5c3-449b9c73b199 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:45:26 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:207caef0-4168-4698-be0c-09ae18f2102d -p 172.16.0.220:3260 --logout {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:26 user nova-compute[71509]: DEBUG nova.compute.manager [None req-4f08ce28-907f-4117-843f-fadda0a3c043 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] [instance: d6f539d8-4144-467b-ac69-44011c5b3564] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:87bf508a-fb5e-40aa-abb8-ca896d37d55f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GCaprKfE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd6f539d8-4144-467b-ac69-44011c5b3564', 'attached_at': '', 'detached_at': '', 'volume_id': '87bf508a-fb5e-40aa-abb8-ca896d37d55f', 'serial': '87bf508a-fb5e-40aa-abb8-ca896d37d55f'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xQnqTguX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, 'status': 'reserved', 'instance': 'd6f539d8-4144-467b-ac69-44011c5b3564', 'attached_at': '', 'detached_at': '', 'volume_id': '4cfc127d-dadf-4588-9781-c90f1906df63', 'serial'} {{(pid=71509) _swap_volume /opt/stack/nova/nova/compute/manager.py:7656}}
Apr 14 10:45:26 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f08ce28-907f-4117-843f-fadda0a3c043 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] [instance: d6f539d8-4144-467b-ac69-44011c5b3564] Calling os-brick to attach iSCSI Volume {{(pid=71509) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 10:45:26 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f08ce28-907f-4117-843f-fadda0a3c043 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0bf0749390>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:87bf508a-fb5e-40aa-abb8-ca896d37d55f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GCaprKfE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 10:45:26 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-4f08ce28-907f-4117-843f-fadda0a3c043 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 10:45:26 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-4f08ce28-907f-4117-843f-fadda0a3c043 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 10:45:26 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:207caef0-4168-4698-be0c-09ae18f2102d -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:26 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[d090c5e7-8f39-4ae5-b8ea-3635b7bc275b]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:207caef0-4168-4698-be0c-09ae18f2102d, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:207caef0-4168-4698-be0c-09ae18f2102d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:26 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79045be-32b0-474e-b5c3-449b9c73b199 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:207caef0-4168-4698-be0c-09ae18f2102d, portal: 172.16.0.220,3260]
Apr 14 10:45:26 user nova-compute[71509]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:207caef0-4168-4698-be0c-09ae18f2102d, portal: 172.16.0.220,3260] successful.
Apr 14 10:45:26 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:45:26 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:207caef0-4168-4698-be0c-09ae18f2102d -p 172.16.0.220:3260 --op delete {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:26 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:207caef0-4168-4698-be0c-09ae18f2102d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:26 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[b37dcde6-7742-4b34-9afc-25393935870e]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:26 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79045be-32b0-474e-b5c3-449b9c73b199 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:45:26 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-c79045be-32b0-474e-b5c3-449b9c73b199 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 10:45:26 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-c79045be-32b0-474e-b5c3-449b9c73b199 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] <== disconnect_volume: return (348ms) None {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 10:45:26 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c79045be-32b0-474e-b5c3-449b9c73b199 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] [instance: 31f6ad8c-40d3-4b6e-af07-4848fafc431d] Disconnected iSCSI Volume {{(pid=71509) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 10:45:26 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-4f08ce28-907f-4117-843f-fadda0a3c043 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.101s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 10:45:26 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-4f08ce28-907f-4117-843f-fadda0a3c043 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 10:45:26 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-4f08ce28-907f-4117-843f-fadda0a3c043 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:87bf508a-fb5e-40aa-abb8-ca896d37d55f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 10:45:26 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-4f08ce28-907f-4117-843f-fadda0a3c043 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:87bf508a-fb5e-40aa-abb8-ca896d37d55f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 10:45:26 user nova-compute[71509]: INFO os_brick.initiator.connectors.iscsi [None req-4f08ce28-907f-4117-843f-fadda0a3c043 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 10:45:26 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87bf508a-fb5e-40aa-abb8-ca896d37d55f -p 172.16.0.220:3260 {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:26 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87bf508a-fb5e-40aa-abb8-ca896d37d55f -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:26 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f20a65f-4139-416e-b925-29e298195d5d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:26 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f08ce28-907f-4117-843f-fadda0a3c043 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 10:45:26 user nova-compute[71509]:  {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:45:26 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87bf508a-fb5e-40aa-abb8-ca896d37d55f -p 172.16.0.220:3260 --interface default --op new {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:26 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87bf508a-fb5e-40aa-abb8-ca896d37d55f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:26 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8a06736-a71f-45c6-985e-2cf25ce0156d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:87bf508a-fb5e-40aa-abb8-ca896d37d55f] added\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:26 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f08ce28-907f-4117-843f-fadda0a3c043 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:87bf508a-fb5e-40aa-abb8-ca896d37d55f] added
Apr 14 10:45:26 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:45:26 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87bf508a-fb5e-40aa-abb8-ca896d37d55f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:26 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87bf508a-fb5e-40aa-abb8-ca896d37d55f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:26 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aa35d63-3158-4598-a09d-1a992ed111f7]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:26 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f08ce28-907f-4117-843f-fadda0a3c043 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:45:26 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87bf508a-fb5e-40aa-abb8-ca896d37d55f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:26 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87bf508a-fb5e-40aa-abb8-ca896d37d55f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:26 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8945663-4266-4f85-aefa-30a394b9e681]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:26 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f08ce28-907f-4117-843f-fadda0a3c043 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:45:26 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87bf508a-fb5e-40aa-abb8-ca896d37d55f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GCaprKfE {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:27 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87bf508a-fb5e-40aa-abb8-ca896d37d55f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GCaprKfE" returned: 0 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:27 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f277e39-b6d9-4ad9-873c-d1739a054251]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:27 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f08ce28-907f-4117-843f-fadda0a3c043 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GCaprKfE'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:45:27 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87bf508a-fb5e-40aa-abb8-ca896d37d55f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:27 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87bf508a-fb5e-40aa-abb8-ca896d37d55f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:27 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d16df06-4cc5-420b-9945-f526080b6157]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:27 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f08ce28-907f-4117-843f-fadda0a3c043 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:45:27 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:27 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:27 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ad89cc0-4163-431f-9940-63da8a63c35a]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:27 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f08ce28-907f-4117-843f-fadda0a3c043 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63 (non-flash)
Apr 14 10:45:27 user nova-compute[71509]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee (non-flash)
Apr 14 10:45:27 user nova-compute[71509]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18 (non-flash)
Apr 14 10:45:27 user nova-compute[71509]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768 (non-flash)
Apr 14 10:45:27 user nova-compute[71509]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700 (non-flash)
Apr 14 10:45:27 user nova-compute[71509]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92 (non-flash)
Apr 14 10:45:27 user nova-compute[71509]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171 (non-flash)
Apr 14 10:45:27 user nova-compute[71509]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e (non-flash)
Apr 14 10:45:27 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:45:27 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f08ce28-907f-4117-843f-fadda0a3c043 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63 (non-flash)
Apr 14 10:45:27 user nova-compute[71509]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee (non-flash)
Apr 14 10:45:27 user nova-compute[71509]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18 (non-flash)
Apr 14 10:45:27 user nova-compute[71509]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768 (non-flash)
Apr 14 10:45:27 user nova-compute[71509]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700 (non-flash)
Apr 14 10:45:27 user nova-compute[71509]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92 (non-flash)
Apr 14 10:45:27 user nova-compute[71509]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171 (non-flash)
Apr 14 10:45:27 user nova-compute[71509]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e (non-flash)
Apr 14 10:45:27 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 10:45:27 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87bf508a-fb5e-40aa-abb8-ca896d37d55f -p 172.16.0.220:3260 --login {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:27 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87bf508a-fb5e-40aa-abb8-ca896d37d55f -p 172.16.0.220:3260 --login" returned: 0 in 0.092s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:27 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8dbd523-5a17-4fb9-9e6d-7484d05c80ea]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:87bf508a-fb5e-40aa-abb8-ca896d37d55f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:87bf508a-fb5e-40aa-abb8-ca896d37d55f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:27 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f08ce28-907f-4117-843f-fadda0a3c043 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:87bf508a-fb5e-40aa-abb8-ca896d37d55f, portal: 172.16.0.220,3260]
Apr 14 10:45:27 user nova-compute[71509]: Login to [iface: default, target: iqn.2010-10.org.openstack:87bf508a-fb5e-40aa-abb8-ca896d37d55f, portal: 172.16.0.220,3260] successful.
Apr 14 10:45:27 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:45:27 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87bf508a-fb5e-40aa-abb8-ca896d37d55f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:27 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87bf508a-fb5e-40aa-abb8-ca896d37d55f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:27 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2843286-b459-4406-a61c-c96389544fec]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:27 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f08ce28-907f-4117-843f-fadda0a3c043 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:45:27 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:27 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:27 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5053392-af69-4dc6-bfdd-15fa8d15cf57]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87bf508a-fb5e-40aa-abb8-ca896d37d55f (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:27 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f08ce28-907f-4117-843f-fadda0a3c043 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63 (non-flash)
Apr 14 10:45:27 user nova-compute[71509]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87bf508a-fb5e-40aa-abb8-ca896d37d55f (non-flash)
Apr 14 10:45:27 user nova-compute[71509]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee (non-flash)
Apr 14 10:45:27 user nova-compute[71509]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18 (non-flash)
Apr 14 10:45:27 user nova-compute[71509]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768 (non-flash)
Apr 14 10:45:27 user nova-compute[71509]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700 (non-flash)
Apr 14 10:45:27 user nova-compute[71509]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92 (non-flash)
Apr 14 10:45:27 user nova-compute[71509]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171 (non-flash)
Apr 14 10:45:27 user nova-compute[71509]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e (non-flash)
Apr 14 10:45:27 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:45:27 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f08ce28-907f-4117-843f-fadda0a3c043 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63 (non-flash)
Apr 14 10:45:27 user nova-compute[71509]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87bf508a-fb5e-40aa-abb8-ca896d37d55f (non-flash)
Apr 14 10:45:27 user nova-compute[71509]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee (non-flash)
Apr 14 10:45:27 user nova-compute[71509]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18 (non-flash)
Apr 14 10:45:27 user nova-compute[71509]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768 (non-flash)
Apr 14 10:45:27 user nova-compute[71509]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700 (non-flash)
Apr 14 10:45:27 user nova-compute[71509]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92 (non-flash)
Apr 14 10:45:27 user nova-compute[71509]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171 (non-flash)
Apr 14 10:45:27 user nova-compute[71509]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e (non-flash)
Apr 14 10:45:27 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 10:45:27 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-4f08ce28-907f-4117-843f-fadda0a3c043 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:87bf508a-fb5e-40aa-abb8-ca896d37d55f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.339s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 10:45:27 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f08ce28-907f-4117-843f-fadda0a3c043 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] Connected to 172.16.0.220:3260 {{(pid=71509) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 10:45:27 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-4f08ce28-907f-4117-843f-fadda0a3c043 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] HCTL ('41', '-', '-', 0) found on session 13 with lun 0 {{(pid=71509) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 10:45:27 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-4f08ce28-907f-4117-843f-fadda0a3c043 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] Scanning host 41 c: -, t: -, l: 0) {{(pid=71509) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 10:45:27 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:27 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:27 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[35cf694c-d6db-442c-aaab-548e5521f9ba]: (4, ('- - 0', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:27 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-4f08ce28-907f-4117-843f-fadda0a3c043 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] Searching for a device in session 13 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=71509) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 10:45:27 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f08ce28-907f-4117-843f-fadda0a3c043 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:87bf508a-fb5e-40aa-abb8-ca896d37d55f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GCaprKfE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71509) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 10:45:27 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:27 user nova-compute[71509]: DEBUG nova.objects.instance [None req-c79045be-32b0-474e-b5c3-449b9c73b199 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Lazy-loading 'flavor' on Instance uuid 31f6ad8c-40d3-4b6e-af07-4848fafc431d {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:45:27 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-c79045be-32b0-474e-b5c3-449b9c73b199 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Lock "31f6ad8c-40d3-4b6e-af07-4848fafc431d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.813s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:45:28 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-2c6010cc-acf5-4276-98a6-acab32d6c4da tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Acquiring lock "interface-31f6ad8c-40d3-4b6e-af07-4848fafc431d-80f4161b-5489-4982-b3be-238ea838561a" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:45:28 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-2c6010cc-acf5-4276-98a6-acab32d6c4da tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Lock "interface-31f6ad8c-40d3-4b6e-af07-4848fafc431d-80f4161b-5489-4982-b3be-238ea838561a" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:45:28 user nova-compute[71509]: DEBUG nova.objects.instance [None req-2c6010cc-acf5-4276-98a6-acab32d6c4da tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Lazy-loading 'flavor' on Instance uuid 31f6ad8c-40d3-4b6e-af07-4848fafc431d {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:45:28 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-4f08ce28-907f-4117-843f-fadda0a3c043 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.384s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 10:45:28 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f08ce28-907f-4117-843f-fadda0a3c043 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] <== connect_volume: return (1486ms) {'type': 'block', 'scsi_wwn': '23937333738653333', 'path': '/dev/sdj'} {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 10:45:28 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f08ce28-907f-4117-843f-fadda0a3c043 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] [instance: d6f539d8-4144-467b-ac69-44011c5b3564] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23937333738653333', 'path': '/dev/sdj'} {{(pid=71509) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 10:45:28 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-2c6010cc-acf5-4276-98a6-acab32d6c4da tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T10:43:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1767995033',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1767995033',id=8,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAg92rKWvJLt4w+A2kLtzcKlRZllCdVCDpTieGdgT9uh8Ad5t/MvIIcaNE/YQBHARvcYgshBiRX60EUhdlUvUMSVKsG5MBNdYdax1bLq6yx8+hLej82SZYaOv31/N253aw==',key_name='tempest-keypair-1362955333',keypairs=<?>,launch_index=0,launched_at=2023-04-14T10:43:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fe8cdf0a5d7f49a9897167eb79dbfc39',ramdisk_id='',reservation_id='r-7roeogsj',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1745854352',owner_user_name='tempest-TaggedAttachmentsTest-1745854352-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T10:43:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c7ce31180e5946d4a027ae6ac9d136fa',uuid=31f6ad8c-40d3-4b6e-af07-4848fafc431d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "80f4161b-5489-4982-b3be-238ea838561a", "address": "fa:16:3e:c8:68:35", "network": {"id": "dee46276-cd75-40ca-87ae-c98f51de17c9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-316990603", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "fe8cdf0a5d7f49a9897167eb79dbfc39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80f4161b-54", "ovs_interfaceid": "80f4161b-5489-4982-b3be-238ea838561a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71509) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 10:45:28 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-2c6010cc-acf5-4276-98a6-acab32d6c4da tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Converting VIF {"id": "80f4161b-5489-4982-b3be-238ea838561a", "address": "fa:16:3e:c8:68:35", "network": {"id": "dee46276-cd75-40ca-87ae-c98f51de17c9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-316990603", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "fe8cdf0a5d7f49a9897167eb79dbfc39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80f4161b-54", "ovs_interfaceid": "80f4161b-5489-4982-b3be-238ea838561a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:45:28 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-2c6010cc-acf5-4276-98a6-acab32d6c4da tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:68:35,bridge_name='br-int',has_traffic_filtering=True,id=80f4161b-5489-4982-b3be-238ea838561a,network=Network(dee46276-cd75-40ca-87ae-c98f51de17c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80f4161b-54') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:45:28 user nova-compute[71509]: DEBUG nova.virt.libvirt.guest [None req-2c6010cc-acf5-4276-98a6-acab32d6c4da tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:c8:68:35"/><model type="virtio"/><mtu size="1442"/><target dev="tap80f4161b-54"/></interface> {{(pid=71509) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 14 10:45:28 user nova-compute[71509]: DEBUG nova.objects.instance [None req-4f08ce28-907f-4117-843f-fadda0a3c043 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] Lazy-loading 'flavor' on Instance uuid d6f539d8-4144-467b-ac69-44011c5b3564 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:45:28 user nova-compute[71509]: DEBUG nova.virt.libvirt.guest [None req-2c6010cc-acf5-4276-98a6-acab32d6c4da tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:c8:68:35"/><model type="virtio"/><mtu size="1442"/><target dev="tap80f4161b-54"/></interface> {{(pid=71509) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 14 10:45:28 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-2c6010cc-acf5-4276-98a6-acab32d6c4da tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Attempting to detach device tap80f4161b-54 from instance 31f6ad8c-40d3-4b6e-af07-4848fafc431d from the persistent domain config. {{(pid=71509) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 10:45:28 user nova-compute[71509]: DEBUG nova.virt.libvirt.guest [None req-2c6010cc-acf5-4276-98a6-acab32d6c4da tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] detach device xml: <interface type="ethernet">
Apr 14 10:45:28 user nova-compute[71509]:   <mac address="fa:16:3e:c8:68:35"/>
Apr 14 10:45:28 user nova-compute[71509]:   <model type="virtio"/>
Apr 14 10:45:28 user nova-compute[71509]:   <mtu size="1442"/>
Apr 14 10:45:28 user nova-compute[71509]:   <target dev="tap80f4161b-54"/>
Apr 14 10:45:28 user nova-compute[71509]: </interface>
Apr 14 10:45:28 user nova-compute[71509]:  {{(pid=71509) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 10:45:28 user nova-compute[71509]: DEBUG nova.virt.libvirt.guest [None req-2c6010cc-acf5-4276-98a6-acab32d6c4da tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:c8:68:35"/><model type="virtio"/><mtu size="1442"/><target dev="tap80f4161b-54"/></interface> {{(pid=71509) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 14 10:45:28 user nova-compute[71509]: DEBUG nova.virt.libvirt.guest [None req-2c6010cc-acf5-4276-98a6-acab32d6c4da tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:c8:68:35"/><model type="virtio"/><mtu size="1442"/><target dev="tap80f4161b-54"/></interface>not found in domain: <domain type='kvm' id='8'>
Apr 14 10:45:28 user nova-compute[71509]:   <name>instance-00000008</name>
Apr 14 10:45:28 user nova-compute[71509]:   <uuid>31f6ad8c-40d3-4b6e-af07-4848fafc431d</uuid>
Apr 14 10:45:28 user nova-compute[71509]:   <metadata>
Apr 14 10:45:28 user nova-compute[71509]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 10:45:28 user nova-compute[71509]:   <nova:package version="0.0.0"/>
Apr 14 10:45:28 user nova-compute[71509]:   <nova:name>tempest-device-tagging-server-1767995033</nova:name>
Apr 14 10:45:28 user nova-compute[71509]:   <nova:creationTime>2023-04-14 10:45:17</nova:creationTime>
Apr 14 10:45:28 user nova-compute[71509]:   <nova:flavor name="m1.nano">
Apr 14 10:45:28 user nova-compute[71509]:     <nova:memory>128</nova:memory>
Apr 14 10:45:28 user nova-compute[71509]:     <nova:disk>1</nova:disk>
Apr 14 10:45:28 user nova-compute[71509]:     <nova:swap>0</nova:swap>
Apr 14 10:45:28 user nova-compute[71509]:     <nova:ephemeral>0</nova:ephemeral>
Apr 14 10:45:28 user nova-compute[71509]:     <nova:vcpus>1</nova:vcpus>
Apr 14 10:45:28 user nova-compute[71509]:   </nova:flavor>
Apr 14 10:45:28 user nova-compute[71509]:   <nova:owner>
Apr 14 10:45:28 user nova-compute[71509]:     <nova:user uuid="c7ce31180e5946d4a027ae6ac9d136fa">tempest-TaggedAttachmentsTest-1745854352-project-member</nova:user>
Apr 14 10:45:28 user nova-compute[71509]:     <nova:project uuid="fe8cdf0a5d7f49a9897167eb79dbfc39">tempest-TaggedAttachmentsTest-1745854352</nova:project>
Apr 14 10:45:28 user nova-compute[71509]:   </nova:owner>
Apr 14 10:45:28 user nova-compute[71509]:   <nova:root type="image" uuid="048ec0ee-0465-448d-8b4c-f072acb101dc"/>
Apr 14 10:45:28 user nova-compute[71509]:   <nova:ports>
Apr 14 10:45:28 user nova-compute[71509]:     <nova:port uuid="edef0af3-01e9-4008-9017-119519f73981">
Apr 14 10:45:28 user nova-compute[71509]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 14 10:45:28 user nova-compute[71509]:     </nova:port>
Apr 14 10:45:28 user nova-compute[71509]:     <nova:port uuid="80f4161b-5489-4982-b3be-238ea838561a">
Apr 14 10:45:28 user nova-compute[71509]:       <nova:ip type="fixed" address="10.10.10.171" ipVersion="4"/>
Apr 14 10:45:28 user nova-compute[71509]:     </nova:port>
Apr 14 10:45:28 user nova-compute[71509]:   </nova:ports>
Apr 14 10:45:28 user nova-compute[71509]: </nova:instance>
Apr 14 10:45:28 user nova-compute[71509]:   </metadata>
Apr 14 10:45:28 user nova-compute[71509]:   <memory unit='KiB'>131072</memory>
Apr 14 10:45:28 user nova-compute[71509]:   <currentMemory unit='KiB'>131072</currentMemory>
Apr 14 10:45:28 user nova-compute[71509]:   <vcpu placement='static'>1</vcpu>
Apr 14 10:45:28 user nova-compute[71509]:   <resource>
Apr 14 10:45:28 user nova-compute[71509]:     <partition>/machine</partition>
Apr 14 10:45:28 user nova-compute[71509]:   </resource>
Apr 14 10:45:28 user nova-compute[71509]:   <sysinfo type='smbios'>
Apr 14 10:45:28 user nova-compute[71509]:     <system>
Apr 14 10:45:28 user nova-compute[71509]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Apr 14 10:45:28 user nova-compute[71509]:       <entry name='product'>OpenStack Nova</entry>
Apr 14 10:45:28 user nova-compute[71509]:       <entry name='version'>0.0.0</entry>
Apr 14 10:45:28 user nova-compute[71509]:       <entry name='serial'>31f6ad8c-40d3-4b6e-af07-4848fafc431d</entry>
Apr 14 10:45:28 user nova-compute[71509]:       <entry name='uuid'>31f6ad8c-40d3-4b6e-af07-4848fafc431d</entry>
Apr 14 10:45:28 user nova-compute[71509]:       <entry name='family'>Virtual Machine</entry>
Apr 14 10:45:28 user nova-compute[71509]:     </system>
Apr 14 10:45:28 user nova-compute[71509]:   </sysinfo>
Apr 14 10:45:28 user nova-compute[71509]:   <os>
Apr 14 10:45:28 user nova-compute[71509]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Apr 14 10:45:28 user nova-compute[71509]:     <boot dev='hd'/>
Apr 14 10:45:28 user nova-compute[71509]:     <smbios mode='sysinfo'/>
Apr 14 10:45:28 user nova-compute[71509]:   </os>
Apr 14 10:45:28 user nova-compute[71509]:   <features>
Apr 14 10:45:28 user nova-compute[71509]:     <acpi/>
Apr 14 10:45:28 user nova-compute[71509]:     <apic/>
Apr 14 10:45:28 user nova-compute[71509]:     <vmcoreinfo state='on'/>
Apr 14 10:45:28 user nova-compute[71509]:   </features>
Apr 14 10:45:28 user nova-compute[71509]:   <cpu mode='custom' match='exact' check='full'>
Apr 14 10:45:28 user nova-compute[71509]:     <model fallback='forbid'>Nehalem</model>
Apr 14 10:45:28 user nova-compute[71509]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Apr 14 10:45:28 user nova-compute[71509]:     <feature policy='require' name='vme'/>
Apr 14 10:45:28 user nova-compute[71509]:     <feature policy='require' name='x2apic'/>
Apr 14 10:45:28 user nova-compute[71509]:     <feature policy='require' name='hypervisor'/>
Apr 14 10:45:28 user nova-compute[71509]:   </cpu>
Apr 14 10:45:28 user nova-compute[71509]:   <clock offset='utc'>
Apr 14 10:45:28 user nova-compute[71509]:     <timer name='pit' tickpolicy='delay'/>
Apr 14 10:45:28 user nova-compute[71509]:     <timer name='rtc' tickpolicy='catchup'/>
Apr 14 10:45:28 user nova-compute[71509]:     <timer name='hpet' present='no'/>
Apr 14 10:45:28 user nova-compute[71509]:   </clock>
Apr 14 10:45:28 user nova-compute[71509]:   <on_poweroff>destroy</on_poweroff>
Apr 14 10:45:28 user nova-compute[71509]:   <on_reboot>restart</on_reboot>
Apr 14 10:45:28 user nova-compute[71509]:   <on_crash>destroy</on_crash>
Apr 14 10:45:28 user nova-compute[71509]:   <devices>
Apr 14 10:45:28 user nova-compute[71509]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 14 10:45:28 user nova-compute[71509]:     <disk type='file' device='disk'>
Apr 14 10:45:28 user nova-compute[71509]:       <driver name='qemu' type='qcow2' cache='none'/>
Apr 14 10:45:28 user nova-compute[71509]:       <source file='/opt/stack/data/nova/instances/31f6ad8c-40d3-4b6e-af07-4848fafc431d/disk' index='2'/>
Apr 14 10:45:28 user nova-compute[71509]:       <backingStore type='file' index='3'>
Apr 14 10:45:28 user nova-compute[71509]:         <format type='raw'/>
Apr 14 10:45:28 user nova-compute[71509]:         <source file='/opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18'/>
Apr 14 10:45:28 user nova-compute[71509]:         <backingStore/>
Apr 14 10:45:28 user nova-compute[71509]:       </backingStore>
Apr 14 10:45:28 user nova-compute[71509]:       <target dev='vda' bus='virtio'/>
Apr 14 10:45:28 user nova-compute[71509]:       <alias name='virtio-disk0'/>
Apr 14 10:45:28 user nova-compute[71509]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Apr 14 10:45:28 user nova-compute[71509]:     </disk>
Apr 14 10:45:28 user nova-compute[71509]:     <disk type='file' device='cdrom'>
Apr 14 10:45:28 user nova-compute[71509]:       <driver name='qemu' type='raw' cache='none'/>
Apr 14 10:45:28 user nova-compute[71509]:       <source file='/opt/stack/data/nova/instances/31f6ad8c-40d3-4b6e-af07-4848fafc431d/disk.config' index='1'/>
Apr 14 10:45:28 user nova-compute[71509]:       <backingStore/>
Apr 14 10:45:28 user nova-compute[71509]:       <target dev='hda' bus='ide'/>
Apr 14 10:45:28 user nova-compute[71509]:       <readonly/>
Apr 14 10:45:28 user nova-compute[71509]:       <alias name='ide0-0-0'/>
Apr 14 10:45:28 user nova-compute[71509]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Apr 14 10:45:28 user nova-compute[71509]:     </disk>
Apr 14 10:45:28 user nova-compute[71509]:     <controller type='usb' index='0' model='none'>
Apr 14 10:45:28 user nova-compute[71509]:       <alias name='usb'/>
Apr 14 10:45:28 user nova-compute[71509]:     </controller>
Apr 14 10:45:28 user nova-compute[71509]:     <controller type='pci' index='0' model='pci-root'>
Apr 14 10:45:28 user nova-compute[71509]:       <alias name='pci.0'/>
Apr 14 10:45:28 user nova-compute[71509]:     </controller>
Apr 14 10:45:28 user nova-compute[71509]:     <controller type='ide' index='0'>
Apr 14 10:45:28 user nova-compute[71509]:       <alias name='ide'/>
Apr 14 10:45:28 user nova-compute[71509]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Apr 14 10:45:28 user nova-compute[71509]:     </controller>
Apr 14 10:45:28 user nova-compute[71509]:     <interface type='ethernet'>
Apr 14 10:45:28 user nova-compute[71509]:       <mac address='fa:16:3e:2a:16:ab'/>
Apr 14 10:45:28 user nova-compute[71509]:       <target dev='tapedef0af3-01'/>
Apr 14 10:45:28 user nova-compute[71509]:       <model type='virtio'/>
Apr 14 10:45:28 user nova-compute[71509]:       <mtu size='1442'/>
Apr 14 10:45:28 user nova-compute[71509]:       <alias name='net0'/>
Apr 14 10:45:28 user nova-compute[71509]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Apr 14 10:45:28 user nova-compute[71509]:     </interface>
Apr 14 10:45:28 user nova-compute[71509]:     <interface type='ethernet'>
Apr 14 10:45:28 user nova-compute[71509]:       <mac address='fa:16:3e:c8:68:35'/>
Apr 14 10:45:28 user nova-compute[71509]:       <target dev='tap80f4161b-54'/>
Apr 14 10:45:28 user nova-compute[71509]:       <model type='virtio'/>
Apr 14 10:45:28 user nova-compute[71509]:       <mtu size='1442'/>
Apr 14 10:45:28 user nova-compute[71509]:       <alias name='net1'/>
Apr 14 10:45:28 user nova-compute[71509]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Apr 14 10:45:28 user nova-compute[71509]:     </interface>
Apr 14 10:45:28 user nova-compute[71509]:     <serial type='pty'>
Apr 14 10:45:28 user nova-compute[71509]:       <source path='/dev/pts/7'/>
Apr 14 10:45:28 user nova-compute[71509]:       <log file='/opt/stack/data/nova/instances/31f6ad8c-40d3-4b6e-af07-4848fafc431d/console.log' append='off'/>
Apr 14 10:45:28 user nova-compute[71509]:       <target type='isa-serial' port='0'>
Apr 14 10:45:28 user nova-compute[71509]:         <model name='isa-serial'/>
Apr 14 10:45:28 user nova-compute[71509]:       </target>
Apr 14 10:45:28 user nova-compute[71509]:       <alias name='serial0'/>
Apr 14 10:45:28 user nova-compute[71509]:     </serial>
Apr 14 10:45:28 user nova-compute[71509]:     <console type='pty' tty='/dev/pts/7'>
Apr 14 10:45:28 user nova-compute[71509]:       <source path='/dev/pts/7'/>
Apr 14 10:45:28 user nova-compute[71509]:       <log file='/opt/stack/data/nova/instances/31f6ad8c-40d3-4b6e-af07-4848fafc431d/console.log' append='off'/>
Apr 14 10:45:28 user nova-compute[71509]:       <target type='serial' port='0'/>
Apr 14 10:45:28 user nova-compute[71509]:       <alias name='serial0'/>
Apr 14 10:45:28 user nova-compute[71509]:     </console>
Apr 14 10:45:28 user nova-compute[71509]:     <input type='mouse' bus='ps2'>
Apr 14 10:45:28 user nova-compute[71509]:       <alias name='input0'/>
Apr 14 10:45:28 user nova-compute[71509]:     </input>
Apr 14 10:45:28 user nova-compute[71509]:     <input type='keyboard' bus='ps2'>
Apr 14 10:45:28 user nova-compute[71509]:       <alias name='input1'/>
Apr 14 10:45:28 user nova-compute[71509]:     </input>
Apr 14 10:45:28 user nova-compute[71509]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Apr 14 10:45:28 user nova-compute[71509]:       <listen type='address' address='0.0.0.0'/>
Apr 14 10:45:28 user nova-compute[71509]:     </graphics>
Apr 14 10:45:28 user nova-compute[71509]:     <audio id='1' type='none'/>
Apr 14 10:45:28 user nova-compute[71509]:     <video>
Apr 14 10:45:28 user nova-compute[71509]:       <model type='virtio' heads='1' primary='yes'/>
Apr 14 10:45:28 user nova-compute[71509]:       <alias name='video0'/>
Apr 14 10:45:28 user nova-compute[71509]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Apr 14 10:45:28 user nova-compute[71509]:     </video>
Apr 14 10:45:28 user nova-compute[71509]:     <memballoon model='virtio'>
Apr 14 10:45:28 user nova-compute[71509]:       <stats period='10'/>
Apr 14 10:45:28 user nova-compute[71509]:       <alias name='balloon0'/>
Apr 14 10:45:28 user nova-compute[71509]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Apr 14 10:45:28 user nova-compute[71509]:     </memballoon>
Apr 14 10:45:28 user nova-compute[71509]:     <rng model='virtio'>
Apr 14 10:45:28 user nova-compute[71509]:       <backend model='random'>/dev/urandom</backend>
Apr 14 10:45:28 user nova-compute[71509]:       <alias name='rng0'/>
Apr 14 10:45:28 user nova-compute[71509]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Apr 14 10:45:28 user nova-compute[71509]:     </rng>
Apr 14 10:45:28 user nova-compute[71509]:   </devices>
Apr 14 10:45:28 user nova-compute[71509]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Apr 14 10:45:28 user nova-compute[71509]:     <label>libvirt-31f6ad8c-40d3-4b6e-af07-4848fafc431d</label>
Apr 14 10:45:28 user nova-compute[71509]:     <imagelabel>libvirt-31f6ad8c-40d3-4b6e-af07-4848fafc431d</imagelabel>
Apr 14 10:45:28 user nova-compute[71509]:   </seclabel>
Apr 14 10:45:28 user nova-compute[71509]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Apr 14 10:45:28 user nova-compute[71509]:     <label>+64055:+108</label>
Apr 14 10:45:28 user nova-compute[71509]:     <imagelabel>+64055:+108</imagelabel>
Apr 14 10:45:28 user nova-compute[71509]:   </seclabel>
Apr 14 10:45:28 user nova-compute[71509]: </domain>
Apr 14 10:45:28 user nova-compute[71509]:  {{(pid=71509) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Apr 14 10:45:28 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-2c6010cc-acf5-4276-98a6-acab32d6c4da tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Successfully detached device tap80f4161b-54 from instance 31f6ad8c-40d3-4b6e-af07-4848fafc431d from the persistent domain config.
Apr 14 10:45:28 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-2c6010cc-acf5-4276-98a6-acab32d6c4da tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] (1/8): Attempting to detach device tap80f4161b-54 with device alias net1 from instance 31f6ad8c-40d3-4b6e-af07-4848fafc431d from the live domain config. {{(pid=71509) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 10:45:28 user nova-compute[71509]: DEBUG nova.virt.libvirt.guest [None req-2c6010cc-acf5-4276-98a6-acab32d6c4da tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] detach device xml: <interface type="ethernet">
Apr 14 10:45:28 user nova-compute[71509]:   <mac address="fa:16:3e:c8:68:35"/>
Apr 14 10:45:28 user nova-compute[71509]:   <model type="virtio"/>
Apr 14 10:45:28 user nova-compute[71509]:   <mtu size="1442"/>
Apr 14 10:45:28 user nova-compute[71509]:   <target dev="tap80f4161b-54"/>
Apr 14 10:45:28 user nova-compute[71509]: </interface>
Apr 14 10:45:28 user nova-compute[71509]:  {{(pid=71509) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 10:45:28 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:28 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:28 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Received event <DeviceRemovedEvent: 1681469128.558134, 31f6ad8c-40d3-4b6e-af07-4848fafc431d => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71509) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 10:45:28 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-2c6010cc-acf5-4276-98a6-acab32d6c4da tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Start waiting for the detach event from libvirt for device tap80f4161b-54 with device alias net1 for instance 31f6ad8c-40d3-4b6e-af07-4848fafc431d {{(pid=71509) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 10:45:28 user nova-compute[71509]: DEBUG nova.virt.libvirt.guest [None req-2c6010cc-acf5-4276-98a6-acab32d6c4da tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:c8:68:35"/><model type="virtio"/><mtu size="1442"/><target dev="tap80f4161b-54"/></interface> {{(pid=71509) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Apr 14 10:45:28 user nova-compute[71509]: DEBUG nova.virt.libvirt.guest [None req-2c6010cc-acf5-4276-98a6-acab32d6c4da tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:c8:68:35"/><model type="virtio"/><mtu size="1442"/><target dev="tap80f4161b-54"/></interface>not found in domain: <domain type='kvm' id='8'>
Apr 14 10:45:28 user nova-compute[71509]:   <name>instance-00000008</name>
Apr 14 10:45:28 user nova-compute[71509]:   <uuid>31f6ad8c-40d3-4b6e-af07-4848fafc431d</uuid>
Apr 14 10:45:28 user nova-compute[71509]:   <metadata>
Apr 14 10:45:28 user nova-compute[71509]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 10:45:28 user nova-compute[71509]:   <nova:package version="0.0.0"/>
Apr 14 10:45:28 user nova-compute[71509]:   <nova:name>tempest-device-tagging-server-1767995033</nova:name>
Apr 14 10:45:28 user nova-compute[71509]:   <nova:creationTime>2023-04-14 10:45:17</nova:creationTime>
Apr 14 10:45:28 user nova-compute[71509]:   <nova:flavor name="m1.nano">
Apr 14 10:45:28 user nova-compute[71509]:     <nova:memory>128</nova:memory>
Apr 14 10:45:28 user nova-compute[71509]:     <nova:disk>1</nova:disk>
Apr 14 10:45:28 user nova-compute[71509]:     <nova:swap>0</nova:swap>
Apr 14 10:45:28 user nova-compute[71509]:     <nova:ephemeral>0</nova:ephemeral>
Apr 14 10:45:28 user nova-compute[71509]:     <nova:vcpus>1</nova:vcpus>
Apr 14 10:45:28 user nova-compute[71509]:   </nova:flavor>
Apr 14 10:45:28 user nova-compute[71509]:   <nova:owner>
Apr 14 10:45:28 user nova-compute[71509]:     <nova:user uuid="c7ce31180e5946d4a027ae6ac9d136fa">tempest-TaggedAttachmentsTest-1745854352-project-member</nova:user>
Apr 14 10:45:28 user nova-compute[71509]:     <nova:project uuid="fe8cdf0a5d7f49a9897167eb79dbfc39">tempest-TaggedAttachmentsTest-1745854352</nova:project>
Apr 14 10:45:28 user nova-compute[71509]:   </nova:owner>
Apr 14 10:45:28 user nova-compute[71509]:   <nova:root type="image" uuid="048ec0ee-0465-448d-8b4c-f072acb101dc"/>
Apr 14 10:45:28 user nova-compute[71509]:   <nova:ports>
Apr 14 10:45:28 user nova-compute[71509]:     <nova:port uuid="edef0af3-01e9-4008-9017-119519f73981">
Apr 14 10:45:28 user nova-compute[71509]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 14 10:45:28 user nova-compute[71509]:     </nova:port>
Apr 14 10:45:28 user nova-compute[71509]:     <nova:port uuid="80f4161b-5489-4982-b3be-238ea838561a">
Apr 14 10:45:28 user nova-compute[71509]:       <nova:ip type="fixed" address="10.10.10.171" ipVersion="4"/>
Apr 14 10:45:28 user nova-compute[71509]:     </nova:port>
Apr 14 10:45:28 user nova-compute[71509]:   </nova:ports>
Apr 14 10:45:28 user nova-compute[71509]: </nova:instance>
Apr 14 10:45:28 user nova-compute[71509]:   </metadata>
Apr 14 10:45:28 user nova-compute[71509]:   <memory unit='KiB'>131072</memory>
Apr 14 10:45:28 user nova-compute[71509]:   <currentMemory unit='KiB'>131072</currentMemory>
Apr 14 10:45:28 user nova-compute[71509]:   <vcpu placement='static'>1</vcpu>
Apr 14 10:45:28 user nova-compute[71509]:   <resource>
Apr 14 10:45:28 user nova-compute[71509]:     <partition>/machine</partition>
Apr 14 10:45:28 user nova-compute[71509]:   </resource>
Apr 14 10:45:28 user nova-compute[71509]:   <sysinfo type='smbios'>
Apr 14 10:45:28 user nova-compute[71509]:     <system>
Apr 14 10:45:28 user nova-compute[71509]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Apr 14 10:45:28 user nova-compute[71509]:       <entry name='product'>OpenStack Nova</entry>
Apr 14 10:45:28 user nova-compute[71509]:       <entry name='version'>0.0.0</entry>
Apr 14 10:45:28 user nova-compute[71509]:       <entry name='serial'>31f6ad8c-40d3-4b6e-af07-4848fafc431d</entry>
Apr 14 10:45:28 user nova-compute[71509]:       <entry name='uuid'>31f6ad8c-40d3-4b6e-af07-4848fafc431d</entry>
Apr 14 10:45:28 user nova-compute[71509]:       <entry name='family'>Virtual Machine</entry>
Apr 14 10:45:28 user nova-compute[71509]:     </system>
Apr 14 10:45:28 user nova-compute[71509]:   </sysinfo>
Apr 14 10:45:28 user nova-compute[71509]:   <os>
Apr 14 10:45:28 user nova-compute[71509]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Apr 14 10:45:28 user nova-compute[71509]:     <boot dev='hd'/>
Apr 14 10:45:28 user nova-compute[71509]:     <smbios mode='sysinfo'/>
Apr 14 10:45:28 user nova-compute[71509]:   </os>
Apr 14 10:45:28 user nova-compute[71509]:   <features>
Apr 14 10:45:28 user nova-compute[71509]:     <acpi/>
Apr 14 10:45:28 user nova-compute[71509]:     <apic/>
Apr 14 10:45:28 user nova-compute[71509]:     <vmcoreinfo state='on'/>
Apr 14 10:45:28 user nova-compute[71509]:   </features>
Apr 14 10:45:28 user nova-compute[71509]:   <cpu mode='custom' match='exact' check='full'>
Apr 14 10:45:28 user nova-compute[71509]:     <model fallback='forbid'>Nehalem</model>
Apr 14 10:45:28 user nova-compute[71509]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Apr 14 10:45:28 user nova-compute[71509]:     <feature policy='require' name='vme'/>
Apr 14 10:45:28 user nova-compute[71509]:     <feature policy='require' name='x2apic'/>
Apr 14 10:45:28 user nova-compute[71509]:     <feature policy='require' name='hypervisor'/>
Apr 14 10:45:28 user nova-compute[71509]:   </cpu>
Apr 14 10:45:28 user nova-compute[71509]:   <clock offset='utc'>
Apr 14 10:45:28 user nova-compute[71509]:     <timer name='pit' tickpolicy='delay'/>
Apr 14 10:45:28 user nova-compute[71509]:     <timer name='rtc' tickpolicy='catchup'/>
Apr 14 10:45:28 user nova-compute[71509]:     <timer name='hpet' present='no'/>
Apr 14 10:45:28 user nova-compute[71509]:   </clock>
Apr 14 10:45:28 user nova-compute[71509]:   <on_poweroff>destroy</on_poweroff>
Apr 14 10:45:28 user nova-compute[71509]:   <on_reboot>restart</on_reboot>
Apr 14 10:45:28 user nova-compute[71509]:   <on_crash>destroy</on_crash>
Apr 14 10:45:28 user nova-compute[71509]:   <devices>
Apr 14 10:45:28 user nova-compute[71509]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Apr 14 10:45:28 user nova-compute[71509]:     <disk type='file' device='disk'>
Apr 14 10:45:28 user nova-compute[71509]:       <driver name='qemu' type='qcow2' cache='none'/>
Apr 14 10:45:28 user nova-compute[71509]:       <source file='/opt/stack/data/nova/instances/31f6ad8c-40d3-4b6e-af07-4848fafc431d/disk' index='2'/>
Apr 14 10:45:28 user nova-compute[71509]:       <backingStore type='file' index='3'>
Apr 14 10:45:28 user nova-compute[71509]:         <format type='raw'/>
Apr 14 10:45:28 user nova-compute[71509]:         <source file='/opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18'/>
Apr 14 10:45:28 user nova-compute[71509]:         <backingStore/>
Apr 14 10:45:28 user nova-compute[71509]:       </backingStore>
Apr 14 10:45:28 user nova-compute[71509]:       <target dev='vda' bus='virtio'/>
Apr 14 10:45:28 user nova-compute[71509]:       <alias name='virtio-disk0'/>
Apr 14 10:45:28 user nova-compute[71509]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Apr 14 10:45:28 user nova-compute[71509]:     </disk>
Apr 14 10:45:28 user nova-compute[71509]:     <disk type='file' device='cdrom'>
Apr 14 10:45:28 user nova-compute[71509]:       <driver name='qemu' type='raw' cache='none'/>
Apr 14 10:45:28 user nova-compute[71509]:       <source file='/opt/stack/data/nova/instances/31f6ad8c-40d3-4b6e-af07-4848fafc431d/disk.config' index='1'/>
Apr 14 10:45:28 user nova-compute[71509]:       <backingStore/>
Apr 14 10:45:28 user nova-compute[71509]:       <target dev='hda' bus='ide'/>
Apr 14 10:45:28 user nova-compute[71509]:       <readonly/>
Apr 14 10:45:28 user nova-compute[71509]:       <alias name='ide0-0-0'/>
Apr 14 10:45:28 user nova-compute[71509]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Apr 14 10:45:28 user nova-compute[71509]:     </disk>
Apr 14 10:45:28 user nova-compute[71509]:     <controller type='usb' index='0' model='none'>
Apr 14 10:45:28 user nova-compute[71509]:       <alias name='usb'/>
Apr 14 10:45:28 user nova-compute[71509]:     </controller>
Apr 14 10:45:28 user nova-compute[71509]:     <controller type='pci' index='0' model='pci-root'>
Apr 14 10:45:28 user nova-compute[71509]:       <alias name='pci.0'/>
Apr 14 10:45:28 user nova-compute[71509]:     </controller>
Apr 14 10:45:28 user nova-compute[71509]:     <controller type='ide' index='0'>
Apr 14 10:45:28 user nova-compute[71509]:       <alias name='ide'/>
Apr 14 10:45:28 user nova-compute[71509]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Apr 14 10:45:28 user nova-compute[71509]:     </controller>
Apr 14 10:45:28 user nova-compute[71509]:     <interface type='ethernet'>
Apr 14 10:45:28 user nova-compute[71509]:       <mac address='fa:16:3e:2a:16:ab'/>
Apr 14 10:45:28 user nova-compute[71509]:       <target dev='tapedef0af3-01'/>
Apr 14 10:45:28 user nova-compute[71509]:       <model type='virtio'/>
Apr 14 10:45:28 user nova-compute[71509]:       <mtu size='1442'/>
Apr 14 10:45:28 user nova-compute[71509]:       <alias name='net0'/>
Apr 14 10:45:28 user nova-compute[71509]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Apr 14 10:45:28 user nova-compute[71509]:     </interface>
Apr 14 10:45:28 user nova-compute[71509]:     <serial type='pty'>
Apr 14 10:45:28 user nova-compute[71509]:       <source path='/dev/pts/7'/>
Apr 14 10:45:28 user nova-compute[71509]:       <log file='/opt/stack/data/nova/instances/31f6ad8c-40d3-4b6e-af07-4848fafc431d/console.log' append='off'/>
Apr 14 10:45:28 user nova-compute[71509]:       <target type='isa-serial' port='0'>
Apr 14 10:45:28 user nova-compute[71509]:         <model name='isa-serial'/>
Apr 14 10:45:28 user nova-compute[71509]:       </target>
Apr 14 10:45:28 user nova-compute[71509]:       <alias name='serial0'/>
Apr 14 10:45:28 user nova-compute[71509]:     </serial>
Apr 14 10:45:28 user nova-compute[71509]:     <console type='pty' tty='/dev/pts/7'>
Apr 14 10:45:28 user nova-compute[71509]:       <source path='/dev/pts/7'/>
Apr 14 10:45:28 user nova-compute[71509]:       <log file='/opt/stack/data/nova/instances/31f6ad8c-40d3-4b6e-af07-4848fafc431d/console.log' append='off'/>
Apr 14 10:45:28 user nova-compute[71509]:       <target type='serial' port='0'/>
Apr 14 10:45:28 user nova-compute[71509]:       <alias name='serial0'/>
Apr 14 10:45:28 user nova-compute[71509]:     </console>
Apr 14 10:45:28 user nova-compute[71509]:     <input type='mouse' bus='ps2'>
Apr 14 10:45:28 user nova-compute[71509]:       <alias name='input0'/>
Apr 14 10:45:28 user nova-compute[71509]:     </input>
Apr 14 10:45:28 user nova-compute[71509]:     <input type='keyboard' bus='ps2'>
Apr 14 10:45:28 user nova-compute[71509]:       <alias name='input1'/>
Apr 14 10:45:28 user nova-compute[71509]:     </input>
Apr 14 10:45:28 user nova-compute[71509]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Apr 14 10:45:28 user nova-compute[71509]:       <listen type='address' address='0.0.0.0'/>
Apr 14 10:45:28 user nova-compute[71509]:     </graphics>
Apr 14 10:45:28 user nova-compute[71509]:     <audio id='1' type='none'/>
Apr 14 10:45:28 user nova-compute[71509]:     <video>
Apr 14 10:45:28 user nova-compute[71509]:       <model type='virtio' heads='1' primary='yes'/>
Apr 14 10:45:28 user nova-compute[71509]:       <alias name='video0'/>
Apr 14 10:45:28 user nova-compute[71509]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Apr 14 10:45:28 user nova-compute[71509]:     </video>
Apr 14 10:45:28 user nova-compute[71509]:     <memballoon model='virtio'>
Apr 14 10:45:28 user nova-compute[71509]:       <stats period='10'/>
Apr 14 10:45:28 user nova-compute[71509]:       <alias name='balloon0'/>
Apr 14 10:45:28 user nova-compute[71509]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Apr 14 10:45:28 user nova-compute[71509]:     </memballoon>
Apr 14 10:45:28 user nova-compute[71509]:     <rng model='virtio'>
Apr 14 10:45:28 user nova-compute[71509]:       <backend model='random'>/dev/urandom</backend>
Apr 14 10:45:28 user nova-compute[71509]:       <alias name='rng0'/>
Apr 14 10:45:28 user nova-compute[71509]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Apr 14 10:45:28 user nova-compute[71509]:     </rng>
Apr 14 10:45:28 user nova-compute[71509]:   </devices>
Apr 14 10:45:28 user nova-compute[71509]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Apr 14 10:45:28 user nova-compute[71509]:     <label>libvirt-31f6ad8c-40d3-4b6e-af07-4848fafc431d</label>
Apr 14 10:45:28 user nova-compute[71509]:     <imagelabel>libvirt-31f6ad8c-40d3-4b6e-af07-4848fafc431d</imagelabel>
Apr 14 10:45:28 user nova-compute[71509]:   </seclabel>
Apr 14 10:45:28 user nova-compute[71509]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Apr 14 10:45:28 user nova-compute[71509]:     <label>+64055:+108</label>
Apr 14 10:45:28 user nova-compute[71509]:     <imagelabel>+64055:+108</imagelabel>
Apr 14 10:45:28 user nova-compute[71509]:   </seclabel>
Apr 14 10:45:28 user nova-compute[71509]: </domain>
Apr 14 10:45:28 user nova-compute[71509]:  {{(pid=71509) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Apr 14 10:45:28 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-2c6010cc-acf5-4276-98a6-acab32d6c4da tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Successfully detached device tap80f4161b-54 from instance 31f6ad8c-40d3-4b6e-af07-4848fafc431d from the live domain config.
Apr 14 10:45:28 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-2c6010cc-acf5-4276-98a6-acab32d6c4da tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T10:43:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1767995033',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1767995033',id=8,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAg92rKWvJLt4w+A2kLtzcKlRZllCdVCDpTieGdgT9uh8Ad5t/MvIIcaNE/YQBHARvcYgshBiRX60EUhdlUvUMSVKsG5MBNdYdax1bLq6yx8+hLej82SZYaOv31/N253aw==',key_name='tempest-keypair-1362955333',keypairs=<?>,launch_index=0,launched_at=2023-04-14T10:43:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fe8cdf0a5d7f49a9897167eb79dbfc39',ramdisk_id='',reservation_id='r-7roeogsj',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1745854352',owner_user_name='tempest-TaggedAttachmentsTest-1745854352-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T10:43:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c7ce31180e5946d4a027ae6ac9d136fa',uuid=31f6ad8c-40d3-4b6e-af07-4848fafc431d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "80f4161b-5489-4982-b3be-238ea838561a", "address": "fa:16:3e:c8:68:35", "network": {"id": "dee46276-cd75-40ca-87ae-c98f51de17c9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-316990603", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "fe8cdf0a5d7f49a9897167eb79dbfc39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80f4161b-54", "ovs_interfaceid": "80f4161b-5489-4982-b3be-238ea838561a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 10:45:28 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-2c6010cc-acf5-4276-98a6-acab32d6c4da tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Converting VIF {"id": "80f4161b-5489-4982-b3be-238ea838561a", "address": "fa:16:3e:c8:68:35", "network": {"id": "dee46276-cd75-40ca-87ae-c98f51de17c9", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-316990603", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.171", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "fe8cdf0a5d7f49a9897167eb79dbfc39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80f4161b-54", "ovs_interfaceid": "80f4161b-5489-4982-b3be-238ea838561a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:45:28 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-2c6010cc-acf5-4276-98a6-acab32d6c4da tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:68:35,bridge_name='br-int',has_traffic_filtering=True,id=80f4161b-5489-4982-b3be-238ea838561a,network=Network(dee46276-cd75-40ca-87ae-c98f51de17c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80f4161b-54') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:45:28 user nova-compute[71509]: DEBUG os_vif [None req-2c6010cc-acf5-4276-98a6-acab32d6c4da tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:68:35,bridge_name='br-int',has_traffic_filtering=True,id=80f4161b-5489-4982-b3be-238ea838561a,network=Network(dee46276-cd75-40ca-87ae-c98f51de17c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80f4161b-54') {{(pid=71509) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 10:45:28 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:28 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap80f4161b-54, bridge=br-int, if_exists=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:45:28 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:28 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 10:45:28 user nova-compute[71509]: INFO os_vif [None req-2c6010cc-acf5-4276-98a6-acab32d6c4da tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:68:35,bridge_name='br-int',has_traffic_filtering=True,id=80f4161b-5489-4982-b3be-238ea838561a,network=Network(dee46276-cd75-40ca-87ae-c98f51de17c9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80f4161b-54')
Apr 14 10:45:28 user nova-compute[71509]: DEBUG nova.virt.libvirt.guest [None req-2c6010cc-acf5-4276-98a6-acab32d6c4da tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 10:45:28 user nova-compute[71509]:   <nova:package version="0.0.0"/>
Apr 14 10:45:28 user nova-compute[71509]:   <nova:name>tempest-device-tagging-server-1767995033</nova:name>
Apr 14 10:45:28 user nova-compute[71509]:   <nova:creationTime>2023-04-14 10:45:28</nova:creationTime>
Apr 14 10:45:28 user nova-compute[71509]:   <nova:flavor name="m1.nano">
Apr 14 10:45:28 user nova-compute[71509]:     <nova:memory>128</nova:memory>
Apr 14 10:45:28 user nova-compute[71509]:     <nova:disk>1</nova:disk>
Apr 14 10:45:28 user nova-compute[71509]:     <nova:swap>0</nova:swap>
Apr 14 10:45:28 user nova-compute[71509]:     <nova:ephemeral>0</nova:ephemeral>
Apr 14 10:45:28 user nova-compute[71509]:     <nova:vcpus>1</nova:vcpus>
Apr 14 10:45:28 user nova-compute[71509]:   </nova:flavor>
Apr 14 10:45:28 user nova-compute[71509]:   <nova:owner>
Apr 14 10:45:28 user nova-compute[71509]:     <nova:user uuid="c7ce31180e5946d4a027ae6ac9d136fa">tempest-TaggedAttachmentsTest-1745854352-project-member</nova:user>
Apr 14 10:45:28 user nova-compute[71509]:     <nova:project uuid="fe8cdf0a5d7f49a9897167eb79dbfc39">tempest-TaggedAttachmentsTest-1745854352</nova:project>
Apr 14 10:45:28 user nova-compute[71509]:   </nova:owner>
Apr 14 10:45:28 user nova-compute[71509]:   <nova:root type="image" uuid="048ec0ee-0465-448d-8b4c-f072acb101dc"/>
Apr 14 10:45:28 user nova-compute[71509]:   <nova:ports>
Apr 14 10:45:28 user nova-compute[71509]:     <nova:port uuid="edef0af3-01e9-4008-9017-119519f73981">
Apr 14 10:45:28 user nova-compute[71509]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 14 10:45:28 user nova-compute[71509]:     </nova:port>
Apr 14 10:45:28 user nova-compute[71509]:   </nova:ports>
Apr 14 10:45:28 user nova-compute[71509]: </nova:instance>
Apr 14 10:45:28 user nova-compute[71509]:  {{(pid=71509) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Apr 14 10:45:28 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:28 user nova-compute[71509]: DEBUG nova.virt.libvirt.guest [None req-4f08ce28-907f-4117-843f-fadda0a3c043 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=71509) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 10:45:28 user nova-compute[71509]: DEBUG nova.compute.manager [req-6c93e765-b511-49b9-b3b8-1b6c14376697 req-3328fd1a-1084-4499-9206-9ea2fd67b47c service nova] [instance: 31f6ad8c-40d3-4b6e-af07-4848fafc431d] Received event network-vif-unplugged-80f4161b-5489-4982-b3be-238ea838561a {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:45:28 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-6c93e765-b511-49b9-b3b8-1b6c14376697 req-3328fd1a-1084-4499-9206-9ea2fd67b47c service nova] Acquiring lock "31f6ad8c-40d3-4b6e-af07-4848fafc431d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:45:28 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-6c93e765-b511-49b9-b3b8-1b6c14376697 req-3328fd1a-1084-4499-9206-9ea2fd67b47c service nova] Lock "31f6ad8c-40d3-4b6e-af07-4848fafc431d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:45:28 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-6c93e765-b511-49b9-b3b8-1b6c14376697 req-3328fd1a-1084-4499-9206-9ea2fd67b47c service nova] Lock "31f6ad8c-40d3-4b6e-af07-4848fafc431d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:45:28 user nova-compute[71509]: DEBUG nova.compute.manager [req-6c93e765-b511-49b9-b3b8-1b6c14376697 req-3328fd1a-1084-4499-9206-9ea2fd67b47c service nova] [instance: 31f6ad8c-40d3-4b6e-af07-4848fafc431d] No waiting events found dispatching network-vif-unplugged-80f4161b-5489-4982-b3be-238ea838561a {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:45:28 user nova-compute[71509]: WARNING nova.compute.manager [req-6c93e765-b511-49b9-b3b8-1b6c14376697 req-3328fd1a-1084-4499-9206-9ea2fd67b47c service nova] [instance: 31f6ad8c-40d3-4b6e-af07-4848fafc431d] Received unexpected event network-vif-unplugged-80f4161b-5489-4982-b3be-238ea838561a for instance with vm_state active and task_state None.
Apr 14 10:45:29 user nova-compute[71509]: DEBUG nova.virt.libvirt.guest [None req-4f08ce28-907f-4117-843f-fadda0a3c043 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] COPY block job progress, current cursor: 168820736 final cursor: 1073741824 {{(pid=71509) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 10:45:29 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:29 user nova-compute[71509]: DEBUG nova.virt.libvirt.guest [None req-4f08ce28-907f-4117-843f-fadda0a3c043 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] COPY block job progress, current cursor: 178257920 final cursor: 1073741824 {{(pid=71509) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 10:45:29 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-2c6010cc-acf5-4276-98a6-acab32d6c4da tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Acquiring lock "refresh_cache-31f6ad8c-40d3-4b6e-af07-4848fafc431d" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:45:29 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-2c6010cc-acf5-4276-98a6-acab32d6c4da tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Acquired lock "refresh_cache-31f6ad8c-40d3-4b6e-af07-4848fafc431d" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:45:29 user nova-compute[71509]: DEBUG nova.network.neutron [None req-2c6010cc-acf5-4276-98a6-acab32d6c4da tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] [instance: 31f6ad8c-40d3-4b6e-af07-4848fafc431d] Building network info cache for instance {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 10:45:30 user nova-compute[71509]: DEBUG nova.virt.libvirt.guest [None req-4f08ce28-907f-4117-843f-fadda0a3c043 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] COPY block job progress, current cursor: 353370112 final cursor: 1073741824 {{(pid=71509) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 10:45:30 user nova-compute[71509]: INFO nova.network.neutron [None req-2c6010cc-acf5-4276-98a6-acab32d6c4da tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] [instance: 31f6ad8c-40d3-4b6e-af07-4848fafc431d] Port 80f4161b-5489-4982-b3be-238ea838561a from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Apr 14 10:45:30 user nova-compute[71509]: DEBUG nova.network.neutron [None req-2c6010cc-acf5-4276-98a6-acab32d6c4da tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] [instance: 31f6ad8c-40d3-4b6e-af07-4848fafc431d] Updating instance_info_cache with network_info: [{"id": "edef0af3-01e9-4008-9017-119519f73981", "address": "fa:16:3e:2a:16:ab", "network": {"id": "d0f56839-45f6-4d90-9a69-0a5d300e3c53", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-962046654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe8cdf0a5d7f49a9897167eb79dbfc39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedef0af3-01", "ovs_interfaceid": "edef0af3-01e9-4008-9017-119519f73981", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:45:30 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-2c6010cc-acf5-4276-98a6-acab32d6c4da tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Releasing lock "refresh_cache-31f6ad8c-40d3-4b6e-af07-4848fafc431d" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:45:30 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-2c6010cc-acf5-4276-98a6-acab32d6c4da tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Lock "interface-31f6ad8c-40d3-4b6e-af07-4848fafc431d-80f4161b-5489-4982-b3be-238ea838561a" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 2.412s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:45:30 user nova-compute[71509]: DEBUG nova.virt.libvirt.guest [None req-4f08ce28-907f-4117-843f-fadda0a3c043 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] COPY block job progress, current cursor: 516947968 final cursor: 1073741824 {{(pid=71509) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 10:45:30 user nova-compute[71509]: DEBUG nova.compute.manager [req-9fa1fe0b-cb75-493b-a08d-dba811a971ed req-dd5424e0-522b-4664-a70a-102d10b5eac3 service nova] [instance: 31f6ad8c-40d3-4b6e-af07-4848fafc431d] Received event network-vif-plugged-80f4161b-5489-4982-b3be-238ea838561a {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:45:30 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-9fa1fe0b-cb75-493b-a08d-dba811a971ed req-dd5424e0-522b-4664-a70a-102d10b5eac3 service nova] Acquiring lock "31f6ad8c-40d3-4b6e-af07-4848fafc431d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:45:30 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-9fa1fe0b-cb75-493b-a08d-dba811a971ed req-dd5424e0-522b-4664-a70a-102d10b5eac3 service nova] Lock "31f6ad8c-40d3-4b6e-af07-4848fafc431d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:45:30 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-9fa1fe0b-cb75-493b-a08d-dba811a971ed req-dd5424e0-522b-4664-a70a-102d10b5eac3 service nova] Lock "31f6ad8c-40d3-4b6e-af07-4848fafc431d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:45:30 user nova-compute[71509]: DEBUG nova.compute.manager [req-9fa1fe0b-cb75-493b-a08d-dba811a971ed req-dd5424e0-522b-4664-a70a-102d10b5eac3 service nova] [instance: 31f6ad8c-40d3-4b6e-af07-4848fafc431d] No waiting events found dispatching network-vif-plugged-80f4161b-5489-4982-b3be-238ea838561a {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:45:30 user nova-compute[71509]: WARNING nova.compute.manager [req-9fa1fe0b-cb75-493b-a08d-dba811a971ed req-dd5424e0-522b-4664-a70a-102d10b5eac3 service nova] [instance: 31f6ad8c-40d3-4b6e-af07-4848fafc431d] Received unexpected event network-vif-plugged-80f4161b-5489-4982-b3be-238ea838561a for instance with vm_state active and task_state None.
Apr 14 10:45:30 user nova-compute[71509]: DEBUG nova.compute.manager [req-9fa1fe0b-cb75-493b-a08d-dba811a971ed req-dd5424e0-522b-4664-a70a-102d10b5eac3 service nova] [instance: 31f6ad8c-40d3-4b6e-af07-4848fafc431d] Received event network-vif-deleted-80f4161b-5489-4982-b3be-238ea838561a {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:45:31 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-842b4b6b-ef0d-4ad2-bd35-84f6d22620cc tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] Acquiring lock "c0e2af6d-3694-4166-a3d0-b5be1107c488" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:45:31 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-842b4b6b-ef0d-4ad2-bd35-84f6d22620cc tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] Lock "c0e2af6d-3694-4166-a3d0-b5be1107c488" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:45:31 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-842b4b6b-ef0d-4ad2-bd35-84f6d22620cc tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] Acquiring lock "c0e2af6d-3694-4166-a3d0-b5be1107c488-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:45:31 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-842b4b6b-ef0d-4ad2-bd35-84f6d22620cc tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] Lock "c0e2af6d-3694-4166-a3d0-b5be1107c488-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:45:31 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-842b4b6b-ef0d-4ad2-bd35-84f6d22620cc tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] Lock "c0e2af6d-3694-4166-a3d0-b5be1107c488-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:45:31 user nova-compute[71509]: INFO nova.compute.manager [None req-842b4b6b-ef0d-4ad2-bd35-84f6d22620cc tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] [instance: c0e2af6d-3694-4166-a3d0-b5be1107c488] Terminating instance
Apr 14 10:45:31 user nova-compute[71509]: DEBUG nova.compute.manager [None req-842b4b6b-ef0d-4ad2-bd35-84f6d22620cc tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] [instance: c0e2af6d-3694-4166-a3d0-b5be1107c488] Start destroying the instance on the hypervisor. {{(pid=71509) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 10:45:31 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:31 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:31 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:31 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:31 user nova-compute[71509]: DEBUG nova.virt.libvirt.guest [None req-4f08ce28-907f-4117-843f-fadda0a3c043 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] COPY block job progress, current cursor: 687865856 final cursor: 1073741824 {{(pid=71509) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 10:45:31 user nova-compute[71509]: DEBUG nova.compute.manager [req-8923be1e-4bf5-4030-8480-2f71797d9313 req-a47d3e28-18d7-40ee-a5c3-604ad0d43d5a service nova] [instance: c0e2af6d-3694-4166-a3d0-b5be1107c488] Received event network-vif-unplugged-ade20134-2589-42de-8b15-051228d8d647 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:45:31 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-8923be1e-4bf5-4030-8480-2f71797d9313 req-a47d3e28-18d7-40ee-a5c3-604ad0d43d5a service nova] Acquiring lock "c0e2af6d-3694-4166-a3d0-b5be1107c488-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:45:31 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-8923be1e-4bf5-4030-8480-2f71797d9313 req-a47d3e28-18d7-40ee-a5c3-604ad0d43d5a service nova] Lock "c0e2af6d-3694-4166-a3d0-b5be1107c488-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:45:31 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-8923be1e-4bf5-4030-8480-2f71797d9313 req-a47d3e28-18d7-40ee-a5c3-604ad0d43d5a service nova] Lock "c0e2af6d-3694-4166-a3d0-b5be1107c488-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:45:31 user nova-compute[71509]: DEBUG nova.compute.manager [req-8923be1e-4bf5-4030-8480-2f71797d9313 req-a47d3e28-18d7-40ee-a5c3-604ad0d43d5a service nova] [instance: c0e2af6d-3694-4166-a3d0-b5be1107c488] No waiting events found dispatching network-vif-unplugged-ade20134-2589-42de-8b15-051228d8d647 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:45:31 user nova-compute[71509]: DEBUG nova.compute.manager [req-8923be1e-4bf5-4030-8480-2f71797d9313 req-a47d3e28-18d7-40ee-a5c3-604ad0d43d5a service nova] [instance: c0e2af6d-3694-4166-a3d0-b5be1107c488] Received event network-vif-unplugged-ade20134-2589-42de-8b15-051228d8d647 for instance with task_state deleting. {{(pid=71509) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 10:45:31 user nova-compute[71509]: DEBUG nova.virt.libvirt.guest [None req-4f08ce28-907f-4117-843f-fadda0a3c043 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] COPY block job progress, current cursor: 823132160 final cursor: 1073741824 {{(pid=71509) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 10:45:31 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: c0e2af6d-3694-4166-a3d0-b5be1107c488] Instance destroyed successfully.
Apr 14 10:45:31 user nova-compute[71509]: DEBUG nova.objects.instance [None req-842b4b6b-ef0d-4ad2-bd35-84f6d22620cc tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] Lazy-loading 'resources' on Instance uuid c0e2af6d-3694-4166-a3d0-b5be1107c488 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:45:31 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-842b4b6b-ef0d-4ad2-bd35-84f6d22620cc tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T10:43:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-588900252',display_name='tempest-VolumesNegativeTest-instance-588900252',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-588900252',id=9,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T10:43:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='78792d5e25ef4c7aa31b0656dacdd9f4',ramdisk_id='',reservation_id='r-lazhq29r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1757520579',owner_user_name='tempest-VolumesNegativeTest-1757520579-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T10:43:49Z,user_data=None,user_id='187b7b3152ef496cbd84a94232d5ada5',uuid=c0e2af6d-3694-4166-a3d0-b5be1107c488,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ade20134-2589-42de-8b15-051228d8d647", "address": "fa:16:3e:9d:46:10", "network": {"id": "4fe93bfa-3e42-42ca-adf6-3312a99e96b9", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "9742d6ad20cf48d9bab0fdbcc9491db9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapade20134-25", "ovs_interfaceid": "ade20134-2589-42de-8b15-051228d8d647", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 10:45:31 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-842b4b6b-ef0d-4ad2-bd35-84f6d22620cc tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] Converting VIF {"id": "ade20134-2589-42de-8b15-051228d8d647", "address": "fa:16:3e:9d:46:10", "network": {"id": "4fe93bfa-3e42-42ca-adf6-3312a99e96b9", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "9742d6ad20cf48d9bab0fdbcc9491db9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapade20134-25", "ovs_interfaceid": "ade20134-2589-42de-8b15-051228d8d647", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:45:31 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-842b4b6b-ef0d-4ad2-bd35-84f6d22620cc tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:46:10,bridge_name='br-int',has_traffic_filtering=True,id=ade20134-2589-42de-8b15-051228d8d647,network=Network(4fe93bfa-3e42-42ca-adf6-3312a99e96b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapade20134-25') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:45:31 user nova-compute[71509]: DEBUG os_vif [None req-842b4b6b-ef0d-4ad2-bd35-84f6d22620cc tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:46:10,bridge_name='br-int',has_traffic_filtering=True,id=ade20134-2589-42de-8b15-051228d8d647,network=Network(4fe93bfa-3e42-42ca-adf6-3312a99e96b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapade20134-25') {{(pid=71509) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 10:45:31 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:31 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapade20134-25, bridge=br-int, if_exists=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:45:31 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:31 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 10:45:31 user nova-compute[71509]: INFO os_vif [None req-842b4b6b-ef0d-4ad2-bd35-84f6d22620cc tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:46:10,bridge_name='br-int',has_traffic_filtering=True,id=ade20134-2589-42de-8b15-051228d8d647,network=Network(4fe93bfa-3e42-42ca-adf6-3312a99e96b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapade20134-25')
Apr 14 10:45:31 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-842b4b6b-ef0d-4ad2-bd35-84f6d22620cc tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] [instance: c0e2af6d-3694-4166-a3d0-b5be1107c488] Deleting instance files /opt/stack/data/nova/instances/c0e2af6d-3694-4166-a3d0-b5be1107c488_del
Apr 14 10:45:31 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-842b4b6b-ef0d-4ad2-bd35-84f6d22620cc tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] [instance: c0e2af6d-3694-4166-a3d0-b5be1107c488] Deletion of /opt/stack/data/nova/instances/c0e2af6d-3694-4166-a3d0-b5be1107c488_del complete
Apr 14 10:45:32 user nova-compute[71509]: INFO nova.compute.manager [None req-842b4b6b-ef0d-4ad2-bd35-84f6d22620cc tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] [instance: c0e2af6d-3694-4166-a3d0-b5be1107c488] Took 0.94 seconds to destroy the instance on the hypervisor.
Apr 14 10:45:32 user nova-compute[71509]: DEBUG oslo.service.loopingcall [None req-842b4b6b-ef0d-4ad2-bd35-84f6d22620cc tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71509) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 10:45:32 user nova-compute[71509]: DEBUG nova.compute.manager [-] [instance: c0e2af6d-3694-4166-a3d0-b5be1107c488] Deallocating network for instance {{(pid=71509) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 10:45:32 user nova-compute[71509]: DEBUG nova.network.neutron [-] [instance: c0e2af6d-3694-4166-a3d0-b5be1107c488] deallocate_for_instance() {{(pid=71509) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 10:45:32 user nova-compute[71509]: DEBUG nova.virt.libvirt.guest [None req-4f08ce28-907f-4117-843f-fadda0a3c043 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] COPY block job progress, current cursor: 996147200 final cursor: 1073741824 {{(pid=71509) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 10:45:32 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:32 user nova-compute[71509]: DEBUG nova.network.neutron [-] [instance: c0e2af6d-3694-4166-a3d0-b5be1107c488] Updating instance_info_cache with network_info: [] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:45:32 user nova-compute[71509]: INFO nova.compute.manager [-] [instance: c0e2af6d-3694-4166-a3d0-b5be1107c488] Took 0.68 seconds to deallocate network for instance.
Apr 14 10:45:32 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-842b4b6b-ef0d-4ad2-bd35-84f6d22620cc tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:45:32 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-842b4b6b-ef0d-4ad2-bd35-84f6d22620cc tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:45:32 user nova-compute[71509]: DEBUG nova.virt.libvirt.guest [None req-4f08ce28-907f-4117-843f-fadda0a3c043 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=71509) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 10:45:33 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f08ce28-907f-4117-843f-fadda0a3c043 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] [instance: d6f539d8-4144-467b-ac69-44011c5b3564] calling os-brick to detach iSCSI Volume {{(pid=71509) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 10:45:33 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f08ce28-907f-4117-843f-fadda0a3c043 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0bf0749390>, {'target_iqn': 'iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xQnqTguX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi': {}}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 10:45:33 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-4f08ce28-907f-4117-843f-fadda0a3c043 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 10:45:33 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-4f08ce28-907f-4117-843f-fadda0a3c043 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 10:45:33 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-4f08ce28-907f-4117-843f-fadda0a3c043 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 10:45:33 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:33 user nova-compute[71509]: DEBUG nova.compute.manager [req-98753f69-f24c-4678-927e-df6df5036f49 req-5cccdbd9-9bf1-4fef-98fe-bbd19b5d40f2 service nova] [instance: c0e2af6d-3694-4166-a3d0-b5be1107c488] Received event network-vif-deleted-ade20134-2589-42de-8b15-051228d8d647 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:45:33 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:33 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[05c54000-002b-472b-96f9-4d6f4c955100]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:87bf508a-fb5e-40aa-abb8-ca896d37d55f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:33 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f08ce28-907f-4117-843f-fadda0a3c043 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 10:45:33 user nova-compute[71509]: No targets found.
Apr 14 10:45:33 user nova-compute[71509]: iSNS:
Apr 14 10:45:33 user nova-compute[71509]: No targets found.
Apr 14 10:45:33 user nova-compute[71509]: STATIC:
Apr 14 10:45:33 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18
Apr 14 10:45:33 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:45:33 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:45:33 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768
Apr 14 10:45:33 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:45:33 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:45:33 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171
Apr 14 10:45:33 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:45:33 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:45:33 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee
Apr 14 10:45:33 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:45:33 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:45:33 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e
Apr 14 10:45:33 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:45:33 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:45:33 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700
Apr 14 10:45:33 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:45:33 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:45:33 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:87bf508a-fb5e-40aa-abb8-ca896d37d55f
Apr 14 10:45:33 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:45:33 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:45:33 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63
Apr 14 10:45:33 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:45:33 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:45:33 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92
Apr 14 10:45:33 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:45:33 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:45:33 user nova-compute[71509]: FIRMWARE:
Apr 14 10:45:33 user nova-compute[71509]: No targets found.
Apr 14 10:45:33 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:45:33 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f08ce28-907f-4117-843f-fadda0a3c043 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 10:45:33 user nova-compute[71509]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 10:45:33 user nova-compute[71509]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71509) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 10:45:33 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f08ce28-907f-4117-843f-fadda0a3c043 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63', 0)] {{(pid=71509) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 10:45:33 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:33 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:33 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ad62d8d-45f7-477a-9c1b-48c87742f370]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:87bf508a-fb5e-40aa-abb8-ca896d37d55f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:33 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:33 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:33 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[023ff71c-c739-4813-a904-9556d1da0999]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87bf508a-fb5e-40aa-abb8-ca896d37d55f (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:33 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f08ce28-907f-4117-843f-fadda0a3c043 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63 (non-flash)
Apr 14 10:45:33 user nova-compute[71509]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87bf508a-fb5e-40aa-abb8-ca896d37d55f (non-flash)
Apr 14 10:45:33 user nova-compute[71509]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee (non-flash)
Apr 14 10:45:33 user nova-compute[71509]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18 (non-flash)
Apr 14 10:45:33 user nova-compute[71509]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768 (non-flash)
Apr 14 10:45:33 user nova-compute[71509]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700 (non-flash)
Apr 14 10:45:33 user nova-compute[71509]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92 (non-flash)
Apr 14 10:45:33 user nova-compute[71509]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171 (non-flash)
Apr 14 10:45:33 user nova-compute[71509]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e (non-flash)
Apr 14 10:45:33 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:45:33 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f08ce28-907f-4117-843f-fadda0a3c043 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63 (non-flash)
Apr 14 10:45:33 user nova-compute[71509]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87bf508a-fb5e-40aa-abb8-ca896d37d55f (non-flash)
Apr 14 10:45:33 user nova-compute[71509]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee (non-flash)
Apr 14 10:45:33 user nova-compute[71509]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18 (non-flash)
Apr 14 10:45:33 user nova-compute[71509]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768 (non-flash)
Apr 14 10:45:33 user nova-compute[71509]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700 (non-flash)
Apr 14 10:45:33 user nova-compute[71509]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92 (non-flash)
Apr 14 10:45:33 user nova-compute[71509]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171 (non-flash)
Apr 14 10:45:33 user nova-compute[71509]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e (non-flash)
Apr 14 10:45:33 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 10:45:33 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f08ce28-907f-4117-843f-fadda0a3c043 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0c3a74d000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63'): ({'sdi'}, set())}) {{(pid=71509) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 10:45:33 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-4f08ce28-907f-4117-843f-fadda0a3c043 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] Removing single pathed devices sdi {{(pid=71509) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 10:45:33 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:33 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:33 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[3015501a-dcf2-4907-9087-834242806575]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:33 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:33 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:33 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[6198e350-fab1-42e3-b819-9c3dffe2f55f]: (4, ('ok\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:33 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-4f08ce28-907f-4117-843f-fadda0a3c043 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] Flushing IO for device /dev/sdi {{(pid=71509) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 10:45:33 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-842b4b6b-ef0d-4ad2-bd35-84f6d22620cc tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 10:45:33 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:33 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-842b4b6b-ef0d-4ad2-bd35-84f6d22620cc tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 10:45:33 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.013s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:33 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[375e82db-4db9-4418-b134-fedede6eda56]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:33 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-4f08ce28-907f-4117-843f-fadda0a3c043 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=71509) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 10:45:33 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:33 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-842b4b6b-ef0d-4ad2-bd35-84f6d22620cc tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.350s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:45:33 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.044s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:33 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c3b2523-b82e-40fa-a069-b9287714f4a9]: (4, ('1', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:33 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-4f08ce28-907f-4117-843f-fadda0a3c043 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] Checking to see if SCSI volumes sdi have been removed. {{(pid=71509) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 10:45:33 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-4f08ce28-907f-4117-843f-fadda0a3c043 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] SCSI volumes sdi have been removed. {{(pid=71509) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 10:45:33 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f08ce28-907f-4117-843f-fadda0a3c043 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63')] {{(pid=71509) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 10:45:33 user nova-compute[71509]: INFO nova.scheduler.client.report [None req-842b4b6b-ef0d-4ad2-bd35-84f6d22620cc tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] Deleted allocations for instance c0e2af6d-3694-4166-a3d0-b5be1107c488
Apr 14 10:45:33 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:33 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:33 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7c7ec0e-77cd-4786-8a9a-d40d7488995c]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:33 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f08ce28-907f-4117-843f-fadda0a3c043 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:45:33 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63 -p 172.16.0.220:3260 --logout {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:33 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-842b4b6b-ef0d-4ad2-bd35-84f6d22620cc tempest-VolumesNegativeTest-1757520579 tempest-VolumesNegativeTest-1757520579-project-member] Lock "c0e2af6d-3694-4166-a3d0-b5be1107c488" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.215s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:45:33 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63 -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:33 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[309d756f-80c8-428d-b994-c3ab9a3ab697]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:33 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f08ce28-907f-4117-843f-fadda0a3c043 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63, portal: 172.16.0.220,3260]
Apr 14 10:45:33 user nova-compute[71509]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63, portal: 172.16.0.220,3260] successful.
Apr 14 10:45:33 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:45:33 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63 -p 172.16.0.220:3260 --op delete {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:33 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:33 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a1509b6-388b-449c-86a5-144f33451494]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:33 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f08ce28-907f-4117-843f-fadda0a3c043 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:45:33 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-4f08ce28-907f-4117-843f-fadda0a3c043 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.370s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 10:45:33 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f08ce28-907f-4117-843f-fadda0a3c043 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] <== disconnect_volume: return (371ms) None {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 10:45:33 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f08ce28-907f-4117-843f-fadda0a3c043 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] [instance: d6f539d8-4144-467b-ac69-44011c5b3564] Disconnected iSCSI Volume {{(pid=71509) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 10:45:33 user nova-compute[71509]: DEBUG nova.compute.manager [None req-4f08ce28-907f-4117-843f-fadda0a3c043 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:87bf508a-fb5e-40aa-abb8-ca896d37d55f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GCaprKfE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, 'status': 'reserved', 'instance': 'd6f539d8-4144-467b-ac69-44011c5b3564', 'attached_at': '', 'detached_at': '', 'volume_id': '87bf508a-fb5e-40aa-abb8-ca896d37d55f', 'serial'} {{(pid=71509) _swap_volume /opt/stack/nova/nova/compute/manager.py:7665}}
Apr 14 10:45:33 user nova-compute[71509]: DEBUG nova.compute.manager [None req-4f08ce28-907f-4117-843f-fadda0a3c043 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] [instance: d6f539d8-4144-467b-ac69-44011c5b3564] swap_volume: removing Cinder connection for volume 4cfc127d-dadf-4588-9781-c90f1906df63 {{(pid=71509) _swap_volume /opt/stack/nova/nova/compute/manager.py:7710}}
Apr 14 10:45:33 user nova-compute[71509]: DEBUG nova.compute.manager [req-9649fa20-8249-45d8-afc9-42a8356c8ed9 req-53fd509c-87f5-4b61-bcb5-be4a38b6d8aa service nova] [instance: c0e2af6d-3694-4166-a3d0-b5be1107c488] Received event network-vif-plugged-ade20134-2589-42de-8b15-051228d8d647 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:45:33 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-9649fa20-8249-45d8-afc9-42a8356c8ed9 req-53fd509c-87f5-4b61-bcb5-be4a38b6d8aa service nova] Acquiring lock "c0e2af6d-3694-4166-a3d0-b5be1107c488-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:45:33 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-9649fa20-8249-45d8-afc9-42a8356c8ed9 req-53fd509c-87f5-4b61-bcb5-be4a38b6d8aa service nova] Lock "c0e2af6d-3694-4166-a3d0-b5be1107c488-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:45:33 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-9649fa20-8249-45d8-afc9-42a8356c8ed9 req-53fd509c-87f5-4b61-bcb5-be4a38b6d8aa service nova] Lock "c0e2af6d-3694-4166-a3d0-b5be1107c488-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:45:33 user nova-compute[71509]: DEBUG nova.compute.manager [req-9649fa20-8249-45d8-afc9-42a8356c8ed9 req-53fd509c-87f5-4b61-bcb5-be4a38b6d8aa service nova] [instance: c0e2af6d-3694-4166-a3d0-b5be1107c488] No waiting events found dispatching network-vif-plugged-ade20134-2589-42de-8b15-051228d8d647 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:45:33 user nova-compute[71509]: WARNING nova.compute.manager [req-9649fa20-8249-45d8-afc9-42a8356c8ed9 req-53fd509c-87f5-4b61-bcb5-be4a38b6d8aa service nova] [instance: c0e2af6d-3694-4166-a3d0-b5be1107c488] Received unexpected event network-vif-plugged-ade20134-2589-42de-8b15-051228d8d647 for instance with vm_state deleted and task_state None.
Apr 14 10:45:34 user nova-compute[71509]: DEBUG nova.compute.manager [None req-4f08ce28-907f-4117-843f-fadda0a3c043 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] [instance: d6f539d8-4144-467b-ac69-44011c5b3564] swap_volume: Updating volume 4cfc127d-dadf-4588-9781-c90f1906df63 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:87bf508a-fb5e-40aa-abb8-ca896d37d55f", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "GCaprKfE", "auth_password": "XHOgw53WYkaSj7", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdj", "volume_id": "87bf508a-fb5e-40aa-abb8-ca896d37d55f"}, "status": "reserved", "instance": "d6f539d8-4144-467b-ac69-44011c5b3564", "attached_at": "", "detached_at": "", "volume_id": "87bf508a-fb5e-40aa-abb8-ca896d37d55f", "serial": "87bf508a-fb5e-40aa-abb8-ca896d37d55f"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '87bf508a-fb5e-40aa-abb8-ca896d37d55f', 'no_device': None, 'attachment_id': '213ca13d-179e-4f18-a8e8-13b3525fffa0'} {{(pid=71509) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7858}}
Apr 14 10:45:34 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-4f08ce28-907f-4117-843f-fadda0a3c043 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] Lock "d6f539d8-4144-467b-ac69-44011c5b3564" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 12.726s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:45:35 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ca30cce-0aa1-4a16-bbe2-e704e4663d55 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] Acquiring lock "d6f539d8-4144-467b-ac69-44011c5b3564" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:45:35 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ca30cce-0aa1-4a16-bbe2-e704e4663d55 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] Lock "d6f539d8-4144-467b-ac69-44011c5b3564" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:45:35 user nova-compute[71509]: DEBUG os_brick.utils [None req-1ca30cce-0aa1-4a16-bbe2-e704e4663d55 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 10:45:35 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:35 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:35 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e0b9e26-c5eb-4606-81fb-b52e1104bbcb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50119df3c417\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:35 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:35 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:45:35 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:35 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a46daa0-2820-46fc-96fe-aa2868ad6f99]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:35 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:45:35 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Starting heal instance info cache {{(pid=71509) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 10:45:35 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:35 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:35 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d2a04c4-5dce-4f31-be13-ca5db21d96ed]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:35 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f7b56dc-6595-45ed-b150-90ab1d5ee411]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:35 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ca30cce-0aa1-4a16-bbe2-e704e4663d55 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] Running cmd (subprocess): nvme version {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:35 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ca30cce-0aa1-4a16-bbe2-e704e4663d55 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] 'nvme version' failed. Not Retrying. {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 10:45:35 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1ca30cce-0aa1-4a16-bbe2-e704e4663d55 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] nvme not present on system {{(pid=71509) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 10:45:35 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:35 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 10:45:35 user nova-compute[71509]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 10:45:35 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[12f42b78-a451-4882-a5e9-42a529c6c49f]: (4, '') {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:35 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-1ca30cce-0aa1-4a16-bbe2-e704e4663d55 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71509) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 10:45:35 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-1ca30cce-0aa1-4a16-bbe2-e704e4663d55 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71509) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 10:45:35 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-1ca30cce-0aa1-4a16-bbe2-e704e4663d55 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] LIGHTOS: no hostnqn found. {{(pid=71509) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 10:45:35 user nova-compute[71509]: DEBUG os_brick.utils [None req-1ca30cce-0aa1-4a16-bbe2-e704e4663d55 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50119df3c417', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 10:45:35 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "refresh_cache-97820f17-22d1-4ec3-9721-1edadccc794a" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:45:35 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquired lock "refresh_cache-97820f17-22d1-4ec3-9721-1edadccc794a" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:45:35 user nova-compute[71509]: DEBUG nova.network.neutron [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] [instance: 97820f17-22d1-4ec3-9721-1edadccc794a] Forcefully refreshing network info cache for instance {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 10:45:35 user nova-compute[71509]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681469120.9200523, ec16b4bc-5385-4eea-856f-710d52d0261d => Stopped> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 10:45:35 user nova-compute[71509]: INFO nova.compute.manager [-] [instance: ec16b4bc-5385-4eea-856f-710d52d0261d] VM Stopped (Lifecycle Event)
Apr 14 10:45:35 user nova-compute[71509]: DEBUG nova.compute.manager [None req-eed66dbf-c066-4481-94cf-1747ffb44867 None None] [instance: ec16b4bc-5385-4eea-856f-710d52d0261d] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:45:35 user nova-compute[71509]: INFO nova.compute.manager [None req-1ca30cce-0aa1-4a16-bbe2-e704e4663d55 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] [instance: d6f539d8-4144-467b-ac69-44011c5b3564] Swapping volume 87bf508a-fb5e-40aa-abb8-ca896d37d55f for 4cfc127d-dadf-4588-9781-c90f1906df63
Apr 14 10:45:36 user nova-compute[71509]: DEBUG nova.network.neutron [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] [instance: 97820f17-22d1-4ec3-9721-1edadccc794a] Updating instance_info_cache with network_info: [{"id": "dea3830d-9f49-4d5e-953b-eec2ee969b02", "address": "fa:16:3e:77:58:9a", "network": {"id": "22eb5f87-be4d-447d-bafe-25e0284ea3ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-787804772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf93e5dac50342d0b65ef09711401e99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdea3830d-9f", "ovs_interfaceid": "dea3830d-9f49-4d5e-953b-eec2ee969b02", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:45:36 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Releasing lock "refresh_cache-97820f17-22d1-4ec3-9721-1edadccc794a" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:45:36 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] [instance: 97820f17-22d1-4ec3-9721-1edadccc794a] Updated the network info_cache for instance {{(pid=71509) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 10:45:36 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:45:36 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:45:36 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:45:36 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:45:36 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:45:36 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:45:36 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71509) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 10:45:36 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:45:36 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:45:36 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:45:36 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:45:36 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Auditing locally available compute resources for user (node: user) {{(pid=71509) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 10:45:36 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97820f17-22d1-4ec3-9721-1edadccc794a/disk.rescue --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:36 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97820f17-22d1-4ec3-9721-1edadccc794a/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:36 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97820f17-22d1-4ec3-9721-1edadccc794a/disk.rescue --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:36 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:37 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97820f17-22d1-4ec3-9721-1edadccc794a/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:37 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97820f17-22d1-4ec3-9721-1edadccc794a/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:37 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97820f17-22d1-4ec3-9721-1edadccc794a/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:37 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97820f17-22d1-4ec3-9721-1edadccc794a/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:37 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97820f17-22d1-4ec3-9721-1edadccc794a/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:37 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4abb549-8f36-40c5-971f-8accbb14ff86/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:37 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4abb549-8f36-40c5-971f-8accbb14ff86/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:37 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4abb549-8f36-40c5-971f-8accbb14ff86/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:37 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4abb549-8f36-40c5-971f-8accbb14ff86/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:37 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71509) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 10:45:37 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55178126-9766-4875-9122-39dcc87ce82c/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:37 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55178126-9766-4875-9122-39dcc87ce82c/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:37 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55178126-9766-4875-9122-39dcc87ce82c/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:37 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55178126-9766-4875-9122-39dcc87ce82c/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:37 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71509) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 10:45:37 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71509) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 10:45:37 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=71509) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 10:45:37 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6f539d8-4144-467b-ac69-44011c5b3564/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:38 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6f539d8-4144-467b-ac69-44011c5b3564/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:38 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6f539d8-4144-467b-ac69-44011c5b3564/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:38 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6f539d8-4144-467b-ac69-44011c5b3564/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:38 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] skipping disk /dev/sdj (vdb) as it is a volume {{(pid=71509) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 10:45:38 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e6c800c-9b35-4e35-969e-c40367056dce/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:38 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e6c800c-9b35-4e35-969e-c40367056dce/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:38 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e6c800c-9b35-4e35-969e-c40367056dce/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:38 user nova-compute[71509]: DEBUG nova.compute.manager [req-09c434c3-30c9-45fb-a8a3-ef54b5c19437 req-d0ac2ef7-4759-4c4c-a080-bae3dca142b9 service nova] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Received event network-changed-6099437e-5607-4a06-abcb-15d465c7ecf8 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:45:38 user nova-compute[71509]: DEBUG nova.compute.manager [req-09c434c3-30c9-45fb-a8a3-ef54b5c19437 req-d0ac2ef7-4759-4c4c-a080-bae3dca142b9 service nova] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Refreshing instance network info cache due to event network-changed-6099437e-5607-4a06-abcb-15d465c7ecf8. {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 10:45:38 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-09c434c3-30c9-45fb-a8a3-ef54b5c19437 req-d0ac2ef7-4759-4c4c-a080-bae3dca142b9 service nova] Acquiring lock "refresh_cache-39586d44-1d8e-4607-ab4d-c03a7d841606" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:45:38 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-09c434c3-30c9-45fb-a8a3-ef54b5c19437 req-d0ac2ef7-4759-4c4c-a080-bae3dca142b9 service nova] Acquired lock "refresh_cache-39586d44-1d8e-4607-ab4d-c03a7d841606" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:45:38 user nova-compute[71509]: DEBUG nova.network.neutron [req-09c434c3-30c9-45fb-a8a3-ef54b5c19437 req-d0ac2ef7-4759-4c4c-a080-bae3dca142b9 service nova] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Refreshing network info cache for port 6099437e-5607-4a06-abcb-15d465c7ecf8 {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 10:45:38 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e6c800c-9b35-4e35-969e-c40367056dce/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:38 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97f20661-8b60-439e-b7af-2fc2013c5ade/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:38 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97f20661-8b60-439e-b7af-2fc2013c5ade/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:38 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97f20661-8b60-439e-b7af-2fc2013c5ade/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:38 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97f20661-8b60-439e-b7af-2fc2013c5ade/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:38 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31f6ad8c-40d3-4b6e-af07-4848fafc431d/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:38 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-acc98cca-71b2-4525-a6c2-7194d6ca4ccd tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Acquiring lock "39586d44-1d8e-4607-ab4d-c03a7d841606" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:45:38 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-acc98cca-71b2-4525-a6c2-7194d6ca4ccd tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Lock "39586d44-1d8e-4607-ab4d-c03a7d841606" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:45:38 user nova-compute[71509]: INFO nova.compute.manager [None req-acc98cca-71b2-4525-a6c2-7194d6ca4ccd tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Shelve offloading
Apr 14 10:45:39 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31f6ad8c-40d3-4b6e-af07-4848fafc431d/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:39 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31f6ad8c-40d3-4b6e-af07-4848fafc431d/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:39 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:39 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:39 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:39 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/31f6ad8c-40d3-4b6e-af07-4848fafc431d/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:39 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=71509) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 10:45:39 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=71509) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 10:45:39 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] skipping disk /dev/sdh (vdc) as it is a volume {{(pid=71509) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 10:45:40 user nova-compute[71509]: DEBUG nova.compute.manager [req-dc8e259b-a0f5-4e87-b3c7-1d135e5fbd0f req-2c398f39-7efa-4ae1-ba41-4f4138680665 service nova] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Received event network-vif-unplugged-6099437e-5607-4a06-abcb-15d465c7ecf8 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:45:40 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-dc8e259b-a0f5-4e87-b3c7-1d135e5fbd0f req-2c398f39-7efa-4ae1-ba41-4f4138680665 service nova] Acquiring lock "39586d44-1d8e-4607-ab4d-c03a7d841606-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:45:40 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-dc8e259b-a0f5-4e87-b3c7-1d135e5fbd0f req-2c398f39-7efa-4ae1-ba41-4f4138680665 service nova] Lock "39586d44-1d8e-4607-ab4d-c03a7d841606-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:45:40 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-dc8e259b-a0f5-4e87-b3c7-1d135e5fbd0f req-2c398f39-7efa-4ae1-ba41-4f4138680665 service nova] Lock "39586d44-1d8e-4607-ab4d-c03a7d841606-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:45:40 user nova-compute[71509]: DEBUG nova.compute.manager [req-dc8e259b-a0f5-4e87-b3c7-1d135e5fbd0f req-2c398f39-7efa-4ae1-ba41-4f4138680665 service nova] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] No waiting events found dispatching network-vif-unplugged-6099437e-5607-4a06-abcb-15d465c7ecf8 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:45:40 user nova-compute[71509]: WARNING nova.compute.manager [req-dc8e259b-a0f5-4e87-b3c7-1d135e5fbd0f req-2c398f39-7efa-4ae1-ba41-4f4138680665 service nova] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Received unexpected event network-vif-unplugged-6099437e-5607-4a06-abcb-15d465c7ecf8 for instance with vm_state active and task_state shelving.
Apr 14 10:45:40 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:45:40 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:45:40 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Hypervisor/Node resource view: name=user free_ram=7375MB free_disk=26.294219970703125GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71509) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 10:45:40 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:45:40 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:45:40 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Instance destroyed successfully.
Apr 14 10:45:40 user nova-compute[71509]: DEBUG nova.compute.manager [None req-acc98cca-71b2-4525-a6c2-7194d6ca4ccd tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:45:40 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-acc98cca-71b2-4525-a6c2-7194d6ca4ccd tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Acquiring lock "refresh_cache-39586d44-1d8e-4607-ab4d-c03a7d841606" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:45:40 user nova-compute[71509]: DEBUG nova.network.neutron [req-09c434c3-30c9-45fb-a8a3-ef54b5c19437 req-d0ac2ef7-4759-4c4c-a080-bae3dca142b9 service nova] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Updated VIF entry in instance network info cache for port 6099437e-5607-4a06-abcb-15d465c7ecf8. {{(pid=71509) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 10:45:40 user nova-compute[71509]: DEBUG nova.network.neutron [req-09c434c3-30c9-45fb-a8a3-ef54b5c19437 req-d0ac2ef7-4759-4c4c-a080-bae3dca142b9 service nova] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Updating instance_info_cache with network_info: [{"id": "6099437e-5607-4a06-abcb-15d465c7ecf8", "address": "fa:16:3e:4b:6c:e7", "network": {"id": "69274626-4a94-46d8-be28-534a98fb6817", "bridge": "br-int", "label": "tempest-TestShelveInstance-480849665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "340e1e1695464eb5ad8a8c881cf24611", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6099437e-56", "ovs_interfaceid": "6099437e-5607-4a06-abcb-15d465c7ecf8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:45:40 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-09c434c3-30c9-45fb-a8a3-ef54b5c19437 req-d0ac2ef7-4759-4c4c-a080-bae3dca142b9 service nova] Releasing lock "refresh_cache-39586d44-1d8e-4607-ab4d-c03a7d841606" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:45:40 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-acc98cca-71b2-4525-a6c2-7194d6ca4ccd tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Acquired lock "refresh_cache-39586d44-1d8e-4607-ab4d-c03a7d841606" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:45:40 user nova-compute[71509]: DEBUG nova.network.neutron [None req-acc98cca-71b2-4525-a6c2-7194d6ca4ccd tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Building network info cache for instance {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 10:45:40 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 97f20661-8b60-439e-b7af-2fc2013c5ade actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:45:40 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 97820f17-22d1-4ec3-9721-1edadccc794a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:45:40 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance b4abb549-8f36-40c5-971f-8accbb14ff86 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:45:40 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 0e6c800c-9b35-4e35-969e-c40367056dce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:45:40 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance d6f539d8-4144-467b-ac69-44011c5b3564 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:45:40 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 31f6ad8c-40d3-4b6e-af07-4848fafc431d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:45:40 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 39586d44-1d8e-4607-ab4d-c03a7d841606 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:45:40 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance a81da242-e8d8-4b41-b84a-e12d603823ca actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:45:40 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance d1516acc-354e-41f6-a639-61dea870b11e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:45:40 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 55178126-9766-4875-9122-39dcc87ce82c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:45:40 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=71509) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 10:45:40 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Final resource view: name=user phys_ram=16023MB used_ram=1792MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=71509) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 10:45:40 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 10:45:40 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 10:45:40 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Compute_service record updated for user:user {{(pid=71509) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 10:45:40 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.473s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:45:40 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ca30cce-0aa1-4a16-bbe2-e704e4663d55 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] [instance: d6f539d8-4144-467b-ac69-44011c5b3564] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xQnqTguX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd6f539d8-4144-467b-ac69-44011c5b3564', 'attached_at': '', 'detached_at': '', 'volume_id': '4cfc127d-dadf-4588-9781-c90f1906df63', 'serial': '4cfc127d-dadf-4588-9781-c90f1906df63'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:87bf508a-fb5e-40aa-abb8-ca896d37d55f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GCaprKfE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj', 'volume_id': '87bf508a-fb5e-40aa-abb8-ca896d37d55f'}, 'status': 'reserved', 'instance': 'd6f539d8-4144-467b-ac69-44011c5b3564', 'attached_at': '', 'detached_at': '', 'volume_id': '87bf508a-fb5e-40aa-abb8-ca896d37d55f', 'serial'} {{(pid=71509) _swap_volume /opt/stack/nova/nova/compute/manager.py:7656}}
Apr 14 10:45:40 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ca30cce-0aa1-4a16-bbe2-e704e4663d55 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] [instance: d6f539d8-4144-467b-ac69-44011c5b3564] Calling os-brick to attach iSCSI Volume {{(pid=71509) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 10:45:40 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ca30cce-0aa1-4a16-bbe2-e704e4663d55 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0bf0749390>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xQnqTguX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 10:45:40 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-1ca30cce-0aa1-4a16-bbe2-e704e4663d55 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 10:45:40 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-1ca30cce-0aa1-4a16-bbe2-e704e4663d55 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 10:45:40 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-1ca30cce-0aa1-4a16-bbe2-e704e4663d55 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 10:45:40 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-1ca30cce-0aa1-4a16-bbe2-e704e4663d55 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 10:45:40 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-1ca30cce-0aa1-4a16-bbe2-e704e4663d55 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 10:45:40 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-1ca30cce-0aa1-4a16-bbe2-e704e4663d55 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 10:45:40 user nova-compute[71509]: INFO os_brick.initiator.connectors.iscsi [None req-1ca30cce-0aa1-4a16-bbe2-e704e4663d55 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 10:45:40 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63 -p 172.16.0.220:3260 {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:40 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:40 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8958238-0148-43fc-99ac-c919754d97cc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:40 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ca30cce-0aa1-4a16-bbe2-e704e4663d55 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 10:45:40 user nova-compute[71509]:  {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:45:40 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63 -p 172.16.0.220:3260 --interface default --op new {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:40 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:40 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[3344f9d0-6fa3-4cd9-aba2-21139a50a50b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63] added\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:40 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ca30cce-0aa1-4a16-bbe2-e704e4663d55 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63] added
Apr 14 10:45:40 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:45:40 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:40 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:40 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[969a476f-ccf8-430c-8e07-65e1066ba3ae]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:40 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ca30cce-0aa1-4a16-bbe2-e704e4663d55 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:45:40 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:40 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:40 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[960d0f63-355a-4055-824c-929b28ccc197]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:40 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ca30cce-0aa1-4a16-bbe2-e704e4663d55 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:45:40 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xQnqTguX {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:40 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xQnqTguX" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:40 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4986034-ad81-4b9f-acef-128b98346f7e]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:40 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ca30cce-0aa1-4a16-bbe2-e704e4663d55 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xQnqTguX'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:45:40 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:40 user nova-compute[71509]: DEBUG nova.network.neutron [None req-acc98cca-71b2-4525-a6c2-7194d6ca4ccd tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Updating instance_info_cache with network_info: [{"id": "6099437e-5607-4a06-abcb-15d465c7ecf8", "address": "fa:16:3e:4b:6c:e7", "network": {"id": "69274626-4a94-46d8-be28-534a98fb6817", "bridge": "br-int", "label": "tempest-TestShelveInstance-480849665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "340e1e1695464eb5ad8a8c881cf24611", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6099437e-56", "ovs_interfaceid": "6099437e-5607-4a06-abcb-15d465c7ecf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:45:40 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:40 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eb4e6ef-e2d2-4100-a7af-4d959ccb4303]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:40 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ca30cce-0aa1-4a16-bbe2-e704e4663d55 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:45:40 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:40 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-acc98cca-71b2-4525-a6c2-7194d6ca4ccd tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Releasing lock "refresh_cache-39586d44-1d8e-4607-ab4d-c03a7d841606" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:45:40 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:40 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9d144e6-b69a-4860-b6bf-df564b303193]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87bf508a-fb5e-40aa-abb8-ca896d37d55f (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:40 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ca30cce-0aa1-4a16-bbe2-e704e4663d55 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87bf508a-fb5e-40aa-abb8-ca896d37d55f (non-flash)
Apr 14 10:45:40 user nova-compute[71509]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee (non-flash)
Apr 14 10:45:40 user nova-compute[71509]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18 (non-flash)
Apr 14 10:45:40 user nova-compute[71509]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768 (non-flash)
Apr 14 10:45:40 user nova-compute[71509]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700 (non-flash)
Apr 14 10:45:40 user nova-compute[71509]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92 (non-flash)
Apr 14 10:45:40 user nova-compute[71509]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171 (non-flash)
Apr 14 10:45:40 user nova-compute[71509]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e (non-flash)
Apr 14 10:45:40 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:45:40 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ca30cce-0aa1-4a16-bbe2-e704e4663d55 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87bf508a-fb5e-40aa-abb8-ca896d37d55f (non-flash)
Apr 14 10:45:40 user nova-compute[71509]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee (non-flash)
Apr 14 10:45:40 user nova-compute[71509]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18 (non-flash)
Apr 14 10:45:40 user nova-compute[71509]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768 (non-flash)
Apr 14 10:45:40 user nova-compute[71509]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700 (non-flash)
Apr 14 10:45:40 user nova-compute[71509]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92 (non-flash)
Apr 14 10:45:40 user nova-compute[71509]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171 (non-flash)
Apr 14 10:45:40 user nova-compute[71509]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e (non-flash)
Apr 14 10:45:40 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 10:45:40 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63 -p 172.16.0.220:3260 --login {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:41 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63 -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:41 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e1b15a2-7925-491e-a29c-e4e3eee16d97]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:41 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ca30cce-0aa1-4a16-bbe2-e704e4663d55 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63, portal: 172.16.0.220,3260]
Apr 14 10:45:41 user nova-compute[71509]: Login to [iface: default, target: iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63, portal: 172.16.0.220,3260] successful.
Apr 14 10:45:41 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:45:41 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:41 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:41 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6b90079-6805-4940-8e46-abb877786fd7]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:41 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ca30cce-0aa1-4a16-bbe2-e704e4663d55 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:45:41 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:41 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:41 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[795d4dc9-63a2-43a1-b1aa-f25478b0162c]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87bf508a-fb5e-40aa-abb8-ca896d37d55f (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:41 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ca30cce-0aa1-4a16-bbe2-e704e4663d55 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87bf508a-fb5e-40aa-abb8-ca896d37d55f (non-flash)
Apr 14 10:45:41 user nova-compute[71509]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63 (non-flash)
Apr 14 10:45:41 user nova-compute[71509]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee (non-flash)
Apr 14 10:45:41 user nova-compute[71509]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18 (non-flash)
Apr 14 10:45:41 user nova-compute[71509]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768 (non-flash)
Apr 14 10:45:41 user nova-compute[71509]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700 (non-flash)
Apr 14 10:45:41 user nova-compute[71509]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92 (non-flash)
Apr 14 10:45:41 user nova-compute[71509]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171 (non-flash)
Apr 14 10:45:41 user nova-compute[71509]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e (non-flash)
Apr 14 10:45:41 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:45:41 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ca30cce-0aa1-4a16-bbe2-e704e4663d55 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87bf508a-fb5e-40aa-abb8-ca896d37d55f (non-flash)
Apr 14 10:45:41 user nova-compute[71509]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63 (non-flash)
Apr 14 10:45:41 user nova-compute[71509]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee (non-flash)
Apr 14 10:45:41 user nova-compute[71509]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18 (non-flash)
Apr 14 10:45:41 user nova-compute[71509]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768 (non-flash)
Apr 14 10:45:41 user nova-compute[71509]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700 (non-flash)
Apr 14 10:45:41 user nova-compute[71509]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92 (non-flash)
Apr 14 10:45:41 user nova-compute[71509]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171 (non-flash)
Apr 14 10:45:41 user nova-compute[71509]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e (non-flash)
Apr 14 10:45:41 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 10:45:41 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-1ca30cce-0aa1-4a16-bbe2-e704e4663d55 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.325s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 10:45:41 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ca30cce-0aa1-4a16-bbe2-e704e4663d55 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] Connected to 172.16.0.220:3260 {{(pid=71509) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 10:45:41 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-1ca30cce-0aa1-4a16-bbe2-e704e4663d55 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] HCTL ('40', '-', '-', 0) found on session 14 with lun 0 {{(pid=71509) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 10:45:41 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-1ca30cce-0aa1-4a16-bbe2-e704e4663d55 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] Scanning host 40 c: -, t: -, l: 0) {{(pid=71509) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 10:45:41 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:41 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.020s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:41 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[15c22d5e-f804-4598-8a6f-dd15f75a3a38]: (4, ('- - 0', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:41 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-1ca30cce-0aa1-4a16-bbe2-e704e4663d55 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] Searching for a device in session 14 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=71509) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 10:45:41 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ca30cce-0aa1-4a16-bbe2-e704e4663d55 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xQnqTguX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71509) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 10:45:41 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:41 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Instance destroyed successfully.
Apr 14 10:45:41 user nova-compute[71509]: DEBUG nova.objects.instance [None req-acc98cca-71b2-4525-a6c2-7194d6ca4ccd tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Lazy-loading 'resources' on Instance uuid 39586d44-1d8e-4607-ab4d-c03a7d841606 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:45:41 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-acc98cca-71b2-4525-a6c2-7194d6ca4ccd tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T10:43:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1022992671',display_name='tempest-TestShelveInstance-server-1022992671',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1022992671',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE3ZHmXOyTBTmz/eyfbYxzCGMRdCEyszErL9xPCKFdEiRsMyb95B0M7mgiLexh904XoCh1bLLkQyrJ5ED+7iDH16ePICxxSDKO7GY80QCmCqc5cAXakERyNUFb4hTkOeQA==',key_name='tempest-TestShelveInstance-261961953',keypairs=<?>,launch_index=0,launched_at=2023-04-14T10:44:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='340e1e1695464eb5ad8a8c881cf24611',ramdisk_id='',reservation_id='r-ejwha0rq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1930659141',owner_user_name='tempest-TestShelveInstance-1930659141-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T10:44:01Z,user_data=None,user_id='15c4ab86a8d244c4be5889b4ac47561a',uuid=39586d44-1d8e-4607-ab4d-c03a7d841606,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6099437e-5607-4a06-abcb-15d465c7ecf8", "address": "fa:16:3e:4b:6c:e7", "network": {"id": "69274626-4a94-46d8-be28-534a98fb6817", "bridge": "br-int", "label": "tempest-TestShelveInstance-480849665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "340e1e1695464eb5ad8a8c881cf24611", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6099437e-56", "ovs_interfaceid": "6099437e-5607-4a06-abcb-15d465c7ecf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 10:45:41 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-acc98cca-71b2-4525-a6c2-7194d6ca4ccd tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Converting VIF {"id": "6099437e-5607-4a06-abcb-15d465c7ecf8", "address": "fa:16:3e:4b:6c:e7", "network": {"id": "69274626-4a94-46d8-be28-534a98fb6817", "bridge": "br-int", "label": "tempest-TestShelveInstance-480849665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "340e1e1695464eb5ad8a8c881cf24611", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6099437e-56", "ovs_interfaceid": "6099437e-5607-4a06-abcb-15d465c7ecf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:45:41 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-acc98cca-71b2-4525-a6c2-7194d6ca4ccd tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:6c:e7,bridge_name='br-int',has_traffic_filtering=True,id=6099437e-5607-4a06-abcb-15d465c7ecf8,network=Network(69274626-4a94-46d8-be28-534a98fb6817),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6099437e-56') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:45:41 user nova-compute[71509]: DEBUG os_vif [None req-acc98cca-71b2-4525-a6c2-7194d6ca4ccd tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:6c:e7,bridge_name='br-int',has_traffic_filtering=True,id=6099437e-5607-4a06-abcb-15d465c7ecf8,network=Network(69274626-4a94-46d8-be28-534a98fb6817),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6099437e-56') {{(pid=71509) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 10:45:41 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:41 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6099437e-56, bridge=br-int, if_exists=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:45:41 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:41 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:41 user nova-compute[71509]: INFO os_vif [None req-acc98cca-71b2-4525-a6c2-7194d6ca4ccd tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:6c:e7,bridge_name='br-int',has_traffic_filtering=True,id=6099437e-5607-4a06-abcb-15d465c7ecf8,network=Network(69274626-4a94-46d8-be28-534a98fb6817),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6099437e-56')
Apr 14 10:45:41 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-acc98cca-71b2-4525-a6c2-7194d6ca4ccd tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] calling os-brick to detach iSCSI Volume {{(pid=71509) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 10:45:41 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-acc98cca-71b2-4525-a6c2-7194d6ca4ccd tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0bf0749390>, {'target_iqn': 'iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xzHUpiIh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 10:45:41 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-acc98cca-71b2-4525-a6c2-7194d6ca4ccd tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 10:45:41 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-acc98cca-71b2-4525-a6c2-7194d6ca4ccd tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 10:45:41 user nova-compute[71509]: DEBUG nova.compute.manager [req-f72a4002-2f33-4964-bfa8-b6e902259dbb req-90b468e3-1f2b-40f6-909a-4055f03ed5e4 service nova] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Received event network-vif-plugged-6099437e-5607-4a06-abcb-15d465c7ecf8 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:45:41 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-f72a4002-2f33-4964-bfa8-b6e902259dbb req-90b468e3-1f2b-40f6-909a-4055f03ed5e4 service nova] Acquiring lock "39586d44-1d8e-4607-ab4d-c03a7d841606-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:45:41 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-f72a4002-2f33-4964-bfa8-b6e902259dbb req-90b468e3-1f2b-40f6-909a-4055f03ed5e4 service nova] Lock "39586d44-1d8e-4607-ab4d-c03a7d841606-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:45:41 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-f72a4002-2f33-4964-bfa8-b6e902259dbb req-90b468e3-1f2b-40f6-909a-4055f03ed5e4 service nova] Lock "39586d44-1d8e-4607-ab4d-c03a7d841606-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:45:41 user nova-compute[71509]: DEBUG nova.compute.manager [req-f72a4002-2f33-4964-bfa8-b6e902259dbb req-90b468e3-1f2b-40f6-909a-4055f03ed5e4 service nova] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] No waiting events found dispatching network-vif-plugged-6099437e-5607-4a06-abcb-15d465c7ecf8 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:45:41 user nova-compute[71509]: WARNING nova.compute.manager [req-f72a4002-2f33-4964-bfa8-b6e902259dbb req-90b468e3-1f2b-40f6-909a-4055f03ed5e4 service nova] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Received unexpected event network-vif-plugged-6099437e-5607-4a06-abcb-15d465c7ecf8 for instance with vm_state active and task_state shelving.
Apr 14 10:45:41 user nova-compute[71509]: DEBUG nova.compute.manager [req-f72a4002-2f33-4964-bfa8-b6e902259dbb req-90b468e3-1f2b-40f6-909a-4055f03ed5e4 service nova] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Received event network-changed-6099437e-5607-4a06-abcb-15d465c7ecf8 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:45:41 user nova-compute[71509]: DEBUG nova.compute.manager [req-f72a4002-2f33-4964-bfa8-b6e902259dbb req-90b468e3-1f2b-40f6-909a-4055f03ed5e4 service nova] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Refreshing instance network info cache due to event network-changed-6099437e-5607-4a06-abcb-15d465c7ecf8. {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 10:45:41 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-f72a4002-2f33-4964-bfa8-b6e902259dbb req-90b468e3-1f2b-40f6-909a-4055f03ed5e4 service nova] Acquiring lock "refresh_cache-39586d44-1d8e-4607-ab4d-c03a7d841606" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:45:41 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-f72a4002-2f33-4964-bfa8-b6e902259dbb req-90b468e3-1f2b-40f6-909a-4055f03ed5e4 service nova] Acquired lock "refresh_cache-39586d44-1d8e-4607-ab4d-c03a7d841606" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:45:41 user nova-compute[71509]: DEBUG nova.network.neutron [req-f72a4002-2f33-4964-bfa8-b6e902259dbb req-90b468e3-1f2b-40f6-909a-4055f03ed5e4 service nova] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Refreshing network info cache for port 6099437e-5607-4a06-abcb-15d465c7ecf8 {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 10:45:42 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-1ca30cce-0aa1-4a16-bbe2-e704e4663d55 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.362s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 10:45:42 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ca30cce-0aa1-4a16-bbe2-e704e4663d55 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] <== connect_volume: return (1363ms) {'type': 'block', 'scsi_wwn': '26631336661336563', 'path': '/dev/sdi'} {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 10:45:42 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ca30cce-0aa1-4a16-bbe2-e704e4663d55 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] [instance: d6f539d8-4144-467b-ac69-44011c5b3564] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26631336661336563', 'path': '/dev/sdi'} {{(pid=71509) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 10:45:42 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-acc98cca-71b2-4525-a6c2-7194d6ca4ccd tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.585s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 10:45:42 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:42 user nova-compute[71509]: DEBUG nova.objects.instance [None req-1ca30cce-0aa1-4a16-bbe2-e704e4663d55 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] Lazy-loading 'flavor' on Instance uuid d6f539d8-4144-467b-ac69-44011c5b3564 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:45:42 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:42 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc547f2a-b52b-4b28-afae-ae41ba885b81]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:87bf508a-fb5e-40aa-abb8-ca896d37d55f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:42 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-acc98cca-71b2-4525-a6c2-7194d6ca4ccd tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 10:45:42 user nova-compute[71509]: No targets found.
Apr 14 10:45:42 user nova-compute[71509]: iSNS:
Apr 14 10:45:42 user nova-compute[71509]: No targets found.
Apr 14 10:45:42 user nova-compute[71509]: STATIC:
Apr 14 10:45:42 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18
Apr 14 10:45:42 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:45:42 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:45:42 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768
Apr 14 10:45:42 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:45:42 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:45:42 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171
Apr 14 10:45:42 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:45:42 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:45:42 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee
Apr 14 10:45:42 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:45:42 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:45:42 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e
Apr 14 10:45:42 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:45:42 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:45:42 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700
Apr 14 10:45:42 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:45:42 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:45:42 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:87bf508a-fb5e-40aa-abb8-ca896d37d55f
Apr 14 10:45:42 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:45:42 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:45:42 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63
Apr 14 10:45:42 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:45:42 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:45:42 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92
Apr 14 10:45:42 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:45:42 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:45:42 user nova-compute[71509]: FIRMWARE:
Apr 14 10:45:42 user nova-compute[71509]: No targets found.
Apr 14 10:45:42 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:45:42 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-acc98cca-71b2-4525-a6c2-7194d6ca4ccd tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 10:45:42 user nova-compute[71509]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 10:45:42 user nova-compute[71509]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71509) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 10:45:42 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-acc98cca-71b2-4525-a6c2-7194d6ca4ccd tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee', 0)] {{(pid=71509) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 10:45:42 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:42 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:42 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eb93302-fc9b-4180-bfb5-126ddf71548b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:87bf508a-fb5e-40aa-abb8-ca896d37d55f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:42 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:42 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:42 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd317965-7c5b-4d0c-8a16-ed6de6ebe6ac]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87bf508a-fb5e-40aa-abb8-ca896d37d55f (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:42 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-acc98cca-71b2-4525-a6c2-7194d6ca4ccd tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87bf508a-fb5e-40aa-abb8-ca896d37d55f (non-flash)
Apr 14 10:45:42 user nova-compute[71509]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63 (non-flash)
Apr 14 10:45:42 user nova-compute[71509]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee (non-flash)
Apr 14 10:45:42 user nova-compute[71509]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18 (non-flash)
Apr 14 10:45:42 user nova-compute[71509]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768 (non-flash)
Apr 14 10:45:42 user nova-compute[71509]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700 (non-flash)
Apr 14 10:45:42 user nova-compute[71509]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92 (non-flash)
Apr 14 10:45:42 user nova-compute[71509]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171 (non-flash)
Apr 14 10:45:42 user nova-compute[71509]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e (non-flash)
Apr 14 10:45:42 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:45:42 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-acc98cca-71b2-4525-a6c2-7194d6ca4ccd tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87bf508a-fb5e-40aa-abb8-ca896d37d55f (non-flash)
Apr 14 10:45:42 user nova-compute[71509]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63 (non-flash)
Apr 14 10:45:42 user nova-compute[71509]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee (non-flash)
Apr 14 10:45:42 user nova-compute[71509]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18 (non-flash)
Apr 14 10:45:42 user nova-compute[71509]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768 (non-flash)
Apr 14 10:45:42 user nova-compute[71509]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700 (non-flash)
Apr 14 10:45:42 user nova-compute[71509]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92 (non-flash)
Apr 14 10:45:42 user nova-compute[71509]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171 (non-flash)
Apr 14 10:45:42 user nova-compute[71509]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e (non-flash)
Apr 14 10:45:42 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 10:45:42 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-acc98cca-71b2-4525-a6c2-7194d6ca4ccd tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0c3a75e440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee'): ({'sdb'}, set())}) {{(pid=71509) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 10:45:42 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-acc98cca-71b2-4525-a6c2-7194d6ca4ccd tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Removing single pathed devices sdb {{(pid=71509) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 10:45:42 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:42 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:42 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f87b206-1dae-4439-8d39-3ca5aeb5ba8b]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:42 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:42 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:42 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e7ddfe5-0e58-40e9-87b8-48894b401f1f]: (4, ('ok\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:42 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-acc98cca-71b2-4525-a6c2-7194d6ca4ccd tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Flushing IO for device /dev/sdb {{(pid=71509) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 10:45:42 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:42 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:42 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[af61805e-8a5f-4afe-be74-93e7f348706f]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:42 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-acc98cca-71b2-4525-a6c2-7194d6ca4ccd tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71509) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 10:45:42 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:42 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:42 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[e77d4d5f-92dd-4a5d-8f93-efb137302e41]: (4, ('1', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:42 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-acc98cca-71b2-4525-a6c2-7194d6ca4ccd tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71509) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 10:45:42 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-acc98cca-71b2-4525-a6c2-7194d6ca4ccd tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] SCSI volumes sdb have been removed. {{(pid=71509) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 10:45:42 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-acc98cca-71b2-4525-a6c2-7194d6ca4ccd tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee')] {{(pid=71509) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 10:45:42 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:42 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:42 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fe3284c-232b-426f-ad09-1e886b2fa068]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:42 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-acc98cca-71b2-4525-a6c2-7194d6ca4ccd tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:45:42 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee -p 172.16.0.220:3260 --logout {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:42 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:42 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[309c7e41-d2ad-4a9b-a3cc-2d8e7a852f94]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:42 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-acc98cca-71b2-4525-a6c2-7194d6ca4ccd tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee, portal: 172.16.0.220,3260]
Apr 14 10:45:42 user nova-compute[71509]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee, portal: 172.16.0.220,3260] successful.
Apr 14 10:45:42 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:45:42 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee -p 172.16.0.220:3260 --op delete {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:42 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:42 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[510d6e2b-4ddd-4a35-b09c-0678b3cfd2f1]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:42 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-acc98cca-71b2-4525-a6c2-7194d6ca4ccd tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:45:42 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-acc98cca-71b2-4525-a6c2-7194d6ca4ccd tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.356s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 10:45:42 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-acc98cca-71b2-4525-a6c2-7194d6ca4ccd tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] <== disconnect_volume: return (940ms) None {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 10:45:42 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-acc98cca-71b2-4525-a6c2-7194d6ca4ccd tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Disconnected iSCSI Volume {{(pid=71509) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 10:45:42 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-acc98cca-71b2-4525-a6c2-7194d6ca4ccd tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Deleting instance files /opt/stack/data/nova/instances/39586d44-1d8e-4607-ab4d-c03a7d841606_del
Apr 14 10:45:42 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-acc98cca-71b2-4525-a6c2-7194d6ca4ccd tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Deletion of /opt/stack/data/nova/instances/39586d44-1d8e-4607-ab4d-c03a7d841606_del complete
Apr 14 10:45:42 user nova-compute[71509]: DEBUG nova.virt.libvirt.guest [None req-1ca30cce-0aa1-4a16-bbe2-e704e4663d55 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=71509) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 10:45:42 user nova-compute[71509]: DEBUG nova.network.neutron [req-f72a4002-2f33-4964-bfa8-b6e902259dbb req-90b468e3-1f2b-40f6-909a-4055f03ed5e4 service nova] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Updated VIF entry in instance network info cache for port 6099437e-5607-4a06-abcb-15d465c7ecf8. {{(pid=71509) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 10:45:42 user nova-compute[71509]: DEBUG nova.network.neutron [req-f72a4002-2f33-4964-bfa8-b6e902259dbb req-90b468e3-1f2b-40f6-909a-4055f03ed5e4 service nova] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Updating instance_info_cache with network_info: [{"id": "6099437e-5607-4a06-abcb-15d465c7ecf8", "address": "fa:16:3e:4b:6c:e7", "network": {"id": "69274626-4a94-46d8-be28-534a98fb6817", "bridge": null, "label": "tempest-TestShelveInstance-480849665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "340e1e1695464eb5ad8a8c881cf24611", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap6099437e-56", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:45:42 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:42 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-f72a4002-2f33-4964-bfa8-b6e902259dbb req-90b468e3-1f2b-40f6-909a-4055f03ed5e4 service nova] Releasing lock "refresh_cache-39586d44-1d8e-4607-ab4d-c03a7d841606" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:45:43 user nova-compute[71509]: DEBUG nova.virt.libvirt.guest [None req-1ca30cce-0aa1-4a16-bbe2-e704e4663d55 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] COPY block job progress, current cursor: 108003328 final cursor: 1073741824 {{(pid=71509) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 10:45:43 user nova-compute[71509]: DEBUG nova.virt.libvirt.guest [None req-1ca30cce-0aa1-4a16-bbe2-e704e4663d55 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] COPY block job progress, current cursor: 165675008 final cursor: 1073741824 {{(pid=71509) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 10:45:43 user nova-compute[71509]: DEBUG nova.compute.manager [req-fbb061af-179c-4fa0-a8dc-59fc3cc341f2 req-f8915b58-7a87-4221-825e-73120c9868e0 service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Received event network-changed-2b341364-55e1-439f-9a3b-2b2fb7ad33b7 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:45:43 user nova-compute[71509]: DEBUG nova.compute.manager [req-fbb061af-179c-4fa0-a8dc-59fc3cc341f2 req-f8915b58-7a87-4221-825e-73120c9868e0 service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Refreshing instance network info cache due to event network-changed-2b341364-55e1-439f-9a3b-2b2fb7ad33b7. {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 10:45:43 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-fbb061af-179c-4fa0-a8dc-59fc3cc341f2 req-f8915b58-7a87-4221-825e-73120c9868e0 service nova] Acquiring lock "refresh_cache-a81da242-e8d8-4b41-b84a-e12d603823ca" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:45:43 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-fbb061af-179c-4fa0-a8dc-59fc3cc341f2 req-f8915b58-7a87-4221-825e-73120c9868e0 service nova] Acquired lock "refresh_cache-a81da242-e8d8-4b41-b84a-e12d603823ca" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:45:43 user nova-compute[71509]: DEBUG nova.network.neutron [req-fbb061af-179c-4fa0-a8dc-59fc3cc341f2 req-f8915b58-7a87-4221-825e-73120c9868e0 service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Refreshing network info cache for port 2b341364-55e1-439f-9a3b-2b2fb7ad33b7 {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 10:45:44 user nova-compute[71509]: DEBUG nova.virt.libvirt.guest [None req-1ca30cce-0aa1-4a16-bbe2-e704e4663d55 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] COPY block job progress, current cursor: 165675008 final cursor: 1073741824 {{(pid=71509) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 10:45:44 user nova-compute[71509]: DEBUG nova.network.neutron [req-fbb061af-179c-4fa0-a8dc-59fc3cc341f2 req-f8915b58-7a87-4221-825e-73120c9868e0 service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Updated VIF entry in instance network info cache for port 2b341364-55e1-439f-9a3b-2b2fb7ad33b7. {{(pid=71509) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 10:45:44 user nova-compute[71509]: DEBUG nova.network.neutron [req-fbb061af-179c-4fa0-a8dc-59fc3cc341f2 req-f8915b58-7a87-4221-825e-73120c9868e0 service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Updating instance_info_cache with network_info: [{"id": "2b341364-55e1-439f-9a3b-2b2fb7ad33b7", "address": "fa:16:3e:3e:8d:2f", "network": {"id": "e6a6e8f5-448a-41d1-a833-6db7058c611c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-378111892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f701119cef78433280cbddf2adf685db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b341364-55", "ovs_interfaceid": "2b341364-55e1-439f-9a3b-2b2fb7ad33b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f3e8f62b-77e2-49d5-9fd9-b75f024a4ee7", "address": "fa:16:3e:87:fe:bc", "network": {"id": "a50bebb6-d4de-4875-9553-570535dace36", "bridge": "br-int", "label": "tempest-device-tagging-net1-1002288517", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.199", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f701119cef78433280cbddf2adf685db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3e8f62b-77", "ovs_interfaceid": "f3e8f62b-77e2-49d5-9fd9-b75f024a4ee7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d2d71e67-1807-43cf-8753-7bdd77de6317", "address": "fa:16:3e:4a:86:23", "network": {"id": "a50bebb6-d4de-4875-9553-570535dace36", "bridge": "br-int", "label": "tempest-device-tagging-net1-1002288517", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.110", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f701119cef78433280cbddf2adf685db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2d71e67-18", "ovs_interfaceid": "d2d71e67-1807-43cf-8753-7bdd77de6317", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c46b5082-6634-4c7f-89c1-7e58a3cd8987", "address": "fa:16:3e:5b:0c:b3", "network": {"id": "a50bebb6-d4de-4875-9553-570535dace36", "bridge": "br-int", "label": "tempest-device-tagging-net1-1002288517", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f701119cef78433280cbddf2adf685db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc46b5082-66", "ovs_interfaceid": "c46b5082-6634-4c7f-89c1-7e58a3cd8987", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8789c03e-397c-439a-8bc5-5d8ce5fc36ac", "address": "fa:16:3e:cf:67:ac", "network": {"id": "a50bebb6-d4de-4875-9553-570535dace36", "bridge": "br-int", "label": "tempest-device-tagging-net1-1002288517", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f701119cef78433280cbddf2adf685db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8789c03e-39", "ovs_interfaceid": "8789c03e-397c-439a-8bc5-5d8ce5fc36ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "84e561e8-01c6-4d50-ab37-bc64b5509e31", "address": "fa:16:3e:e1:97:d3", "network": {"id": "d6116fed-ce24-4ad4-9e8a-dfb2c1305e1c", "bridge": "br-int", "label": "tempest-device-tagging-net2-564175672", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f701119cef78433280cbddf2adf685db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84e561e8-01", "ovs_interfaceid": "84e561e8-01c6-4d50-ab37-bc64b5509e31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "717e6c20-676e-40f2-b4c1-47ca0f3e6f22", "address": "fa:16:3e:bf:a5:40", "network": {"id": "d6116fed-ce24-4ad4-9e8a-dfb2c1305e1c", "bridge": "br-int", "label": "tempest-device-tagging-net2-564175672", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f701119cef78433280cbddf2adf685db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap717e6c20-67", "ovs_interfaceid": "717e6c20-676e-40f2-b4c1-47ca0f3e6f22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:45:44 user nova-compute[71509]: DEBUG nova.virt.libvirt.guest [None req-1ca30cce-0aa1-4a16-bbe2-e704e4663d55 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] COPY block job progress, current cursor: 204472320 final cursor: 1073741824 {{(pid=71509) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 10:45:44 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-fbb061af-179c-4fa0-a8dc-59fc3cc341f2 req-f8915b58-7a87-4221-825e-73120c9868e0 service nova] Releasing lock "refresh_cache-a81da242-e8d8-4b41-b84a-e12d603823ca" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:45:45 user nova-compute[71509]: DEBUG nova.virt.libvirt.guest [None req-1ca30cce-0aa1-4a16-bbe2-e704e4663d55 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] COPY block job progress, current cursor: 306184192 final cursor: 1073741824 {{(pid=71509) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 10:45:45 user nova-compute[71509]: INFO nova.scheduler.client.report [None req-acc98cca-71b2-4525-a6c2-7194d6ca4ccd tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Deleted allocations for instance 39586d44-1d8e-4607-ab4d-c03a7d841606
Apr 14 10:45:45 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-acc98cca-71b2-4525-a6c2-7194d6ca4ccd tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:45:45 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-acc98cca-71b2-4525-a6c2-7194d6ca4ccd tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:45:45 user nova-compute[71509]: DEBUG nova.objects.instance [None req-acc98cca-71b2-4525-a6c2-7194d6ca4ccd tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Lazy-loading 'numa_topology' on Instance uuid 39586d44-1d8e-4607-ab4d-c03a7d841606 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:45:45 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-f72c1110-988a-453c-ae38-51fb1d73b2e0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Acquiring lock "a81da242-e8d8-4b41-b84a-e12d603823ca" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:45:45 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-f72c1110-988a-453c-ae38-51fb1d73b2e0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Lock "a81da242-e8d8-4b41-b84a-e12d603823ca" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:45:45 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-f72c1110-988a-453c-ae38-51fb1d73b2e0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Acquiring lock "a81da242-e8d8-4b41-b84a-e12d603823ca-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:45:45 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-f72c1110-988a-453c-ae38-51fb1d73b2e0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Lock "a81da242-e8d8-4b41-b84a-e12d603823ca-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:45:45 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-f72c1110-988a-453c-ae38-51fb1d73b2e0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Lock "a81da242-e8d8-4b41-b84a-e12d603823ca-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.002s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:45:45 user nova-compute[71509]: INFO nova.compute.manager [None req-f72c1110-988a-453c-ae38-51fb1d73b2e0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Terminating instance
Apr 14 10:45:45 user nova-compute[71509]: DEBUG nova.compute.manager [None req-f72c1110-988a-453c-ae38-51fb1d73b2e0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Start destroying the instance on the hypervisor. {{(pid=71509) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 10:45:45 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:45 user nova-compute[71509]: DEBUG nova.virt.libvirt.guest [None req-1ca30cce-0aa1-4a16-bbe2-e704e4663d55 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] COPY block job progress, current cursor: 440401920 final cursor: 1073741824 {{(pid=71509) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 10:45:45 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:45 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:45 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:45 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:45 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:45 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:45 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:45 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:46 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-acc98cca-71b2-4525-a6c2-7194d6ca4ccd tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 10:45:46 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-acc98cca-71b2-4525-a6c2-7194d6ca4ccd tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 10:45:46 user nova-compute[71509]: DEBUG nova.virt.libvirt.guest [None req-1ca30cce-0aa1-4a16-bbe2-e704e4663d55 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] COPY block job progress, current cursor: 616562688 final cursor: 1073741824 {{(pid=71509) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 10:45:46 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-acc98cca-71b2-4525-a6c2-7194d6ca4ccd tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.689s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:45:46 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:46 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:46 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-acc98cca-71b2-4525-a6c2-7194d6ca4ccd tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Lock "39586d44-1d8e-4607-ab4d-c03a7d841606" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 7.226s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:45:46 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:46 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:46 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:46 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:46 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:46 user nova-compute[71509]: DEBUG nova.compute.manager [req-4c2609b2-ae87-4ec9-8484-730c170f262c req-4a8db9d6-475d-49a5-a13c-2d41baefb301 service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Received event network-vif-unplugged-2b341364-55e1-439f-9a3b-2b2fb7ad33b7 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:45:46 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-4c2609b2-ae87-4ec9-8484-730c170f262c req-4a8db9d6-475d-49a5-a13c-2d41baefb301 service nova] Acquiring lock "a81da242-e8d8-4b41-b84a-e12d603823ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:45:46 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-4c2609b2-ae87-4ec9-8484-730c170f262c req-4a8db9d6-475d-49a5-a13c-2d41baefb301 service nova] Lock "a81da242-e8d8-4b41-b84a-e12d603823ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:45:46 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-4c2609b2-ae87-4ec9-8484-730c170f262c req-4a8db9d6-475d-49a5-a13c-2d41baefb301 service nova] Lock "a81da242-e8d8-4b41-b84a-e12d603823ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:45:46 user nova-compute[71509]: DEBUG nova.compute.manager [req-4c2609b2-ae87-4ec9-8484-730c170f262c req-4a8db9d6-475d-49a5-a13c-2d41baefb301 service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] No waiting events found dispatching network-vif-unplugged-2b341364-55e1-439f-9a3b-2b2fb7ad33b7 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:45:46 user nova-compute[71509]: DEBUG nova.compute.manager [req-4c2609b2-ae87-4ec9-8484-730c170f262c req-4a8db9d6-475d-49a5-a13c-2d41baefb301 service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Received event network-vif-unplugged-2b341364-55e1-439f-9a3b-2b2fb7ad33b7 for instance with task_state deleting. {{(pid=71509) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 10:45:46 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:46 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:46 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:46 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:46 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:46 user nova-compute[71509]: DEBUG nova.virt.libvirt.guest [None req-1ca30cce-0aa1-4a16-bbe2-e704e4663d55 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] COPY block job progress, current cursor: 767557632 final cursor: 1073741824 {{(pid=71509) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 10:45:46 user nova-compute[71509]: DEBUG nova.compute.manager [req-195b1736-a0d1-4abe-8b92-0ea9953495db req-c226bcad-f7a5-47e7-b8f0-18654fdfd52c service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Received event network-vif-unplugged-8789c03e-397c-439a-8bc5-5d8ce5fc36ac {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:45:46 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-195b1736-a0d1-4abe-8b92-0ea9953495db req-c226bcad-f7a5-47e7-b8f0-18654fdfd52c service nova] Acquiring lock "a81da242-e8d8-4b41-b84a-e12d603823ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:45:46 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-195b1736-a0d1-4abe-8b92-0ea9953495db req-c226bcad-f7a5-47e7-b8f0-18654fdfd52c service nova] Lock "a81da242-e8d8-4b41-b84a-e12d603823ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:45:46 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-195b1736-a0d1-4abe-8b92-0ea9953495db req-c226bcad-f7a5-47e7-b8f0-18654fdfd52c service nova] Lock "a81da242-e8d8-4b41-b84a-e12d603823ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:45:46 user nova-compute[71509]: DEBUG nova.compute.manager [req-195b1736-a0d1-4abe-8b92-0ea9953495db req-c226bcad-f7a5-47e7-b8f0-18654fdfd52c service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] No waiting events found dispatching network-vif-unplugged-8789c03e-397c-439a-8bc5-5d8ce5fc36ac {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:45:46 user nova-compute[71509]: DEBUG nova.compute.manager [req-195b1736-a0d1-4abe-8b92-0ea9953495db req-c226bcad-f7a5-47e7-b8f0-18654fdfd52c service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Received event network-vif-unplugged-8789c03e-397c-439a-8bc5-5d8ce5fc36ac for instance with task_state deleting. {{(pid=71509) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 10:45:46 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:46 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:46 user nova-compute[71509]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681469131.9337718, c0e2af6d-3694-4166-a3d0-b5be1107c488 => Stopped> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 10:45:46 user nova-compute[71509]: INFO nova.compute.manager [-] [instance: c0e2af6d-3694-4166-a3d0-b5be1107c488] VM Stopped (Lifecycle Event)
Apr 14 10:45:46 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:47 user nova-compute[71509]: DEBUG nova.compute.manager [None req-51f9aef7-bd48-43dd-b47d-343a8e30b4f7 None None] [instance: c0e2af6d-3694-4166-a3d0-b5be1107c488] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:45:47 user nova-compute[71509]: DEBUG nova.virt.libvirt.guest [None req-1ca30cce-0aa1-4a16-bbe2-e704e4663d55 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] COPY block job progress, current cursor: 939524096 final cursor: 1073741824 {{(pid=71509) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 10:45:47 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Instance destroyed successfully.
Apr 14 10:45:47 user nova-compute[71509]: DEBUG nova.objects.instance [None req-f72c1110-988a-453c-ae38-51fb1d73b2e0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Lazy-loading 'resources' on Instance uuid a81da242-e8d8-4b41-b84a-e12d603823ca {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:45:47 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-f72c1110-988a-453c-ae38-51fb1d73b2e0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T10:43:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1778823491',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1778823491',id=11,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHQhgKrBsUiMtMBVjIBZKP9TZIRsKtCXglQ+b+qPpSHOKxGrJsHd4CAY6Od528O1Hb16vq8TAcsw6lyU3DudugT46dzAga1vtVSJBR0oeEIq/4xyY6zaQXucI88fNYMmeg==',key_name='tempest-keypair-190287482',keypairs=<?>,launch_index=0,launched_at=2023-04-14T10:44:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f701119cef78433280cbddf2adf685db',ramdisk_id='',reservation_id='r-wllxdslz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1078203530',owner_user_name='tempest-TaggedBootDevicesTest_v242-1078203530-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T10:44:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3579ac20f8094f5a9fbd036ed05cda23',uuid=a81da242-e8d8-4b41-b84a-e12d603823ca,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2b341364-55e1-439f-9a3b-2b2fb7ad33b7", "address": "fa:16:3e:3e:8d:2f", "network": {"id": "e6a6e8f5-448a-41d1-a833-6db7058c611c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-378111892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f701119cef78433280cbddf2adf685db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b341364-55", "ovs_interfaceid": "2b341364-55e1-439f-9a3b-2b2fb7ad33b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 10:45:47 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-f72c1110-988a-453c-ae38-51fb1d73b2e0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Converting VIF {"id": "2b341364-55e1-439f-9a3b-2b2fb7ad33b7", "address": "fa:16:3e:3e:8d:2f", "network": {"id": "e6a6e8f5-448a-41d1-a833-6db7058c611c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-378111892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f701119cef78433280cbddf2adf685db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b341364-55", "ovs_interfaceid": "2b341364-55e1-439f-9a3b-2b2fb7ad33b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:45:47 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-f72c1110-988a-453c-ae38-51fb1d73b2e0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3e:8d:2f,bridge_name='br-int',has_traffic_filtering=True,id=2b341364-55e1-439f-9a3b-2b2fb7ad33b7,network=Network(e6a6e8f5-448a-41d1-a833-6db7058c611c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b341364-55') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:45:47 user nova-compute[71509]: DEBUG os_vif [None req-f72c1110-988a-453c-ae38-51fb1d73b2e0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3e:8d:2f,bridge_name='br-int',has_traffic_filtering=True,id=2b341364-55e1-439f-9a3b-2b2fb7ad33b7,network=Network(e6a6e8f5-448a-41d1-a833-6db7058c611c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b341364-55') {{(pid=71509) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 10:45:47 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:47 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2b341364-55, bridge=br-int, if_exists=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:45:47 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:47 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 10:45:47 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:47 user nova-compute[71509]: INFO os_vif [None req-f72c1110-988a-453c-ae38-51fb1d73b2e0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3e:8d:2f,bridge_name='br-int',has_traffic_filtering=True,id=2b341364-55e1-439f-9a3b-2b2fb7ad33b7,network=Network(e6a6e8f5-448a-41d1-a833-6db7058c611c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b341364-55')
Apr 14 10:45:47 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-f72c1110-988a-453c-ae38-51fb1d73b2e0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T10:43:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1778823491',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1778823491',id=11,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHQhgKrBsUiMtMBVjIBZKP9TZIRsKtCXglQ+b+qPpSHOKxGrJsHd4CAY6Od528O1Hb16vq8TAcsw6lyU3DudugT46dzAga1vtVSJBR0oeEIq/4xyY6zaQXucI88fNYMmeg==',key_name='tempest-keypair-190287482',keypairs=<?>,launch_index=0,launched_at=2023-04-14T10:44:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f701119cef78433280cbddf2adf685db',ramdisk_id='',reservation_id='r-wllxdslz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1078203530',owner_user_name='tempest-TaggedBootDevicesTest_v242-1078203530-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T10:44:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3579ac20f8094f5a9fbd036ed05cda23',uuid=a81da242-e8d8-4b41-b84a-e12d603823ca,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f3e8f62b-77e2-49d5-9fd9-b75f024a4ee7", "address": "fa:16:3e:87:fe:bc", "network": {"id": "a50bebb6-d4de-4875-9553-570535dace36", "bridge": "br-int", "label": "tempest-device-tagging-net1-1002288517", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.199", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f701119cef78433280cbddf2adf685db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3e8f62b-77", "ovs_interfaceid": "f3e8f62b-77e2-49d5-9fd9-b75f024a4ee7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71509) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 10:45:47 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-f72c1110-988a-453c-ae38-51fb1d73b2e0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Converting VIF {"id": "f3e8f62b-77e2-49d5-9fd9-b75f024a4ee7", "address": "fa:16:3e:87:fe:bc", "network": {"id": "a50bebb6-d4de-4875-9553-570535dace36", "bridge": "br-int", "label": "tempest-device-tagging-net1-1002288517", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.199", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f701119cef78433280cbddf2adf685db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3e8f62b-77", "ovs_interfaceid": "f3e8f62b-77e2-49d5-9fd9-b75f024a4ee7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:45:47 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-f72c1110-988a-453c-ae38-51fb1d73b2e0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:fe:bc,bridge_name='br-int',has_traffic_filtering=True,id=f3e8f62b-77e2-49d5-9fd9-b75f024a4ee7,network=Network(a50bebb6-d4de-4875-9553-570535dace36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf3e8f62b-77') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:45:47 user nova-compute[71509]: DEBUG os_vif [None req-f72c1110-988a-453c-ae38-51fb1d73b2e0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:fe:bc,bridge_name='br-int',has_traffic_filtering=True,id=f3e8f62b-77e2-49d5-9fd9-b75f024a4ee7,network=Network(a50bebb6-d4de-4875-9553-570535dace36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf3e8f62b-77') {{(pid=71509) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 10:45:47 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:47 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf3e8f62b-77, bridge=br-int, if_exists=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:45:47 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:47 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 10:45:47 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:47 user nova-compute[71509]: INFO os_vif [None req-f72c1110-988a-453c-ae38-51fb1d73b2e0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:fe:bc,bridge_name='br-int',has_traffic_filtering=True,id=f3e8f62b-77e2-49d5-9fd9-b75f024a4ee7,network=Network(a50bebb6-d4de-4875-9553-570535dace36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapf3e8f62b-77')
Apr 14 10:45:47 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-f72c1110-988a-453c-ae38-51fb1d73b2e0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T10:43:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1778823491',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1778823491',id=11,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHQhgKrBsUiMtMBVjIBZKP9TZIRsKtCXglQ+b+qPpSHOKxGrJsHd4CAY6Od528O1Hb16vq8TAcsw6lyU3DudugT46dzAga1vtVSJBR0oeEIq/4xyY6zaQXucI88fNYMmeg==',key_name='tempest-keypair-190287482',keypairs=<?>,launch_index=0,launched_at=2023-04-14T10:44:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f701119cef78433280cbddf2adf685db',ramdisk_id='',reservation_id='r-wllxdslz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1078203530',owner_user_name='tempest-TaggedBootDevicesTest_v242-1078203530-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T10:44:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3579ac20f8094f5a9fbd036ed05cda23',uuid=a81da242-e8d8-4b41-b84a-e12d603823ca,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d2d71e67-1807-43cf-8753-7bdd77de6317", "address": "fa:16:3e:4a:86:23", "network": {"id": "a50bebb6-d4de-4875-9553-570535dace36", "bridge": "br-int", "label": "tempest-device-tagging-net1-1002288517", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.110", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f701119cef78433280cbddf2adf685db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2d71e67-18", "ovs_interfaceid": "d2d71e67-1807-43cf-8753-7bdd77de6317", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71509) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 10:45:47 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-f72c1110-988a-453c-ae38-51fb1d73b2e0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Converting VIF {"id": "d2d71e67-1807-43cf-8753-7bdd77de6317", "address": "fa:16:3e:4a:86:23", "network": {"id": "a50bebb6-d4de-4875-9553-570535dace36", "bridge": "br-int", "label": "tempest-device-tagging-net1-1002288517", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.110", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f701119cef78433280cbddf2adf685db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2d71e67-18", "ovs_interfaceid": "d2d71e67-1807-43cf-8753-7bdd77de6317", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:45:47 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-f72c1110-988a-453c-ae38-51fb1d73b2e0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:86:23,bridge_name='br-int',has_traffic_filtering=True,id=d2d71e67-1807-43cf-8753-7bdd77de6317,network=Network(a50bebb6-d4de-4875-9553-570535dace36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd2d71e67-18') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:45:47 user nova-compute[71509]: DEBUG os_vif [None req-f72c1110-988a-453c-ae38-51fb1d73b2e0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:86:23,bridge_name='br-int',has_traffic_filtering=True,id=d2d71e67-1807-43cf-8753-7bdd77de6317,network=Network(a50bebb6-d4de-4875-9553-570535dace36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd2d71e67-18') {{(pid=71509) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 10:45:47 user nova-compute[71509]: DEBUG nova.virt.libvirt.guest [None req-1ca30cce-0aa1-4a16-bbe2-e704e4663d55 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=71509) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 10:45:47 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:47 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd2d71e67-18, bridge=br-int, if_exists=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:45:47 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 10:45:47 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:47 user nova-compute[71509]: INFO os_vif [None req-f72c1110-988a-453c-ae38-51fb1d73b2e0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:86:23,bridge_name='br-int',has_traffic_filtering=True,id=d2d71e67-1807-43cf-8753-7bdd77de6317,network=Network(a50bebb6-d4de-4875-9553-570535dace36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd2d71e67-18')
Apr 14 10:45:47 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-f72c1110-988a-453c-ae38-51fb1d73b2e0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T10:43:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1778823491',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1778823491',id=11,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHQhgKrBsUiMtMBVjIBZKP9TZIRsKtCXglQ+b+qPpSHOKxGrJsHd4CAY6Od528O1Hb16vq8TAcsw6lyU3DudugT46dzAga1vtVSJBR0oeEIq/4xyY6zaQXucI88fNYMmeg==',key_name='tempest-keypair-190287482',keypairs=<?>,launch_index=0,launched_at=2023-04-14T10:44:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f701119cef78433280cbddf2adf685db',ramdisk_id='',reservation_id='r-wllxdslz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1078203530',owner_user_name='tempest-TaggedBootDevicesTest_v242-1078203530-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T10:44:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3579ac20f8094f5a9fbd036ed05cda23',uuid=a81da242-e8d8-4b41-b84a-e12d603823ca,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c46b5082-6634-4c7f-89c1-7e58a3cd8987", "address": "fa:16:3e:5b:0c:b3", "network": {"id": "a50bebb6-d4de-4875-9553-570535dace36", "bridge": "br-int", "label": "tempest-device-tagging-net1-1002288517", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f701119cef78433280cbddf2adf685db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc46b5082-66", "ovs_interfaceid": "c46b5082-6634-4c7f-89c1-7e58a3cd8987", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 10:45:47 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-f72c1110-988a-453c-ae38-51fb1d73b2e0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Converting VIF {"id": "c46b5082-6634-4c7f-89c1-7e58a3cd8987", "address": "fa:16:3e:5b:0c:b3", "network": {"id": "a50bebb6-d4de-4875-9553-570535dace36", "bridge": "br-int", "label": "tempest-device-tagging-net1-1002288517", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f701119cef78433280cbddf2adf685db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc46b5082-66", "ovs_interfaceid": "c46b5082-6634-4c7f-89c1-7e58a3cd8987", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:45:47 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-f72c1110-988a-453c-ae38-51fb1d73b2e0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:0c:b3,bridge_name='br-int',has_traffic_filtering=True,id=c46b5082-6634-4c7f-89c1-7e58a3cd8987,network=Network(a50bebb6-d4de-4875-9553-570535dace36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc46b5082-66') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:45:47 user nova-compute[71509]: DEBUG os_vif [None req-f72c1110-988a-453c-ae38-51fb1d73b2e0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:0c:b3,bridge_name='br-int',has_traffic_filtering=True,id=c46b5082-6634-4c7f-89c1-7e58a3cd8987,network=Network(a50bebb6-d4de-4875-9553-570535dace36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc46b5082-66') {{(pid=71509) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 10:45:47 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:47 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc46b5082-66, bridge=br-int, if_exists=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:45:47 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:47 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 10:45:47 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:47 user nova-compute[71509]: INFO os_vif [None req-f72c1110-988a-453c-ae38-51fb1d73b2e0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:0c:b3,bridge_name='br-int',has_traffic_filtering=True,id=c46b5082-6634-4c7f-89c1-7e58a3cd8987,network=Network(a50bebb6-d4de-4875-9553-570535dace36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc46b5082-66')
Apr 14 10:45:47 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-f72c1110-988a-453c-ae38-51fb1d73b2e0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T10:43:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1778823491',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1778823491',id=11,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHQhgKrBsUiMtMBVjIBZKP9TZIRsKtCXglQ+b+qPpSHOKxGrJsHd4CAY6Od528O1Hb16vq8TAcsw6lyU3DudugT46dzAga1vtVSJBR0oeEIq/4xyY6zaQXucI88fNYMmeg==',key_name='tempest-keypair-190287482',keypairs=<?>,launch_index=0,launched_at=2023-04-14T10:44:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f701119cef78433280cbddf2adf685db',ramdisk_id='',reservation_id='r-wllxdslz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1078203530',owner_user_name='tempest-TaggedBootDevicesTest_v242-1078203530-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T10:44:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3579ac20f8094f5a9fbd036ed05cda23',uuid=a81da242-e8d8-4b41-b84a-e12d603823ca,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8789c03e-397c-439a-8bc5-5d8ce5fc36ac", "address": "fa:16:3e:cf:67:ac", "network": {"id": "a50bebb6-d4de-4875-9553-570535dace36", "bridge": "br-int", "label": "tempest-device-tagging-net1-1002288517", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f701119cef78433280cbddf2adf685db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8789c03e-39", "ovs_interfaceid": "8789c03e-397c-439a-8bc5-5d8ce5fc36ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 10:45:47 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-f72c1110-988a-453c-ae38-51fb1d73b2e0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Converting VIF {"id": "8789c03e-397c-439a-8bc5-5d8ce5fc36ac", "address": "fa:16:3e:cf:67:ac", "network": {"id": "a50bebb6-d4de-4875-9553-570535dace36", "bridge": "br-int", "label": "tempest-device-tagging-net1-1002288517", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f701119cef78433280cbddf2adf685db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8789c03e-39", "ovs_interfaceid": "8789c03e-397c-439a-8bc5-5d8ce5fc36ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:45:47 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-f72c1110-988a-453c-ae38-51fb1d73b2e0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:67:ac,bridge_name='br-int',has_traffic_filtering=True,id=8789c03e-397c-439a-8bc5-5d8ce5fc36ac,network=Network(a50bebb6-d4de-4875-9553-570535dace36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8789c03e-39') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:45:47 user nova-compute[71509]: DEBUG os_vif [None req-f72c1110-988a-453c-ae38-51fb1d73b2e0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:67:ac,bridge_name='br-int',has_traffic_filtering=True,id=8789c03e-397c-439a-8bc5-5d8ce5fc36ac,network=Network(a50bebb6-d4de-4875-9553-570535dace36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8789c03e-39') {{(pid=71509) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 10:45:47 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:47 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8789c03e-39, bridge=br-int, if_exists=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:45:47 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:47 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 10:45:47 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:47 user nova-compute[71509]: INFO os_vif [None req-f72c1110-988a-453c-ae38-51fb1d73b2e0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:67:ac,bridge_name='br-int',has_traffic_filtering=True,id=8789c03e-397c-439a-8bc5-5d8ce5fc36ac,network=Network(a50bebb6-d4de-4875-9553-570535dace36),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8789c03e-39')
Apr 14 10:45:47 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-f72c1110-988a-453c-ae38-51fb1d73b2e0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T10:43:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1778823491',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1778823491',id=11,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHQhgKrBsUiMtMBVjIBZKP9TZIRsKtCXglQ+b+qPpSHOKxGrJsHd4CAY6Od528O1Hb16vq8TAcsw6lyU3DudugT46dzAga1vtVSJBR0oeEIq/4xyY6zaQXucI88fNYMmeg==',key_name='tempest-keypair-190287482',keypairs=<?>,launch_index=0,launched_at=2023-04-14T10:44:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f701119cef78433280cbddf2adf685db',ramdisk_id='',reservation_id='r-wllxdslz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1078203530',owner_user_name='tempest-TaggedBootDevicesTest_v242-1078203530-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T10:44:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3579ac20f8094f5a9fbd036ed05cda23',uuid=a81da242-e8d8-4b41-b84a-e12d603823ca,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "84e561e8-01c6-4d50-ab37-bc64b5509e31", "address": "fa:16:3e:e1:97:d3", "network": {"id": "d6116fed-ce24-4ad4-9e8a-dfb2c1305e1c", "bridge": "br-int", "label": "tempest-device-tagging-net2-564175672", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f701119cef78433280cbddf2adf685db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84e561e8-01", "ovs_interfaceid": "84e561e8-01c6-4d50-ab37-bc64b5509e31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 10:45:47 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-f72c1110-988a-453c-ae38-51fb1d73b2e0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Converting VIF {"id": "84e561e8-01c6-4d50-ab37-bc64b5509e31", "address": "fa:16:3e:e1:97:d3", "network": {"id": "d6116fed-ce24-4ad4-9e8a-dfb2c1305e1c", "bridge": "br-int", "label": "tempest-device-tagging-net2-564175672", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f701119cef78433280cbddf2adf685db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84e561e8-01", "ovs_interfaceid": "84e561e8-01c6-4d50-ab37-bc64b5509e31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:45:47 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-f72c1110-988a-453c-ae38-51fb1d73b2e0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:97:d3,bridge_name='br-int',has_traffic_filtering=True,id=84e561e8-01c6-4d50-ab37-bc64b5509e31,network=Network(d6116fed-ce24-4ad4-9e8a-dfb2c1305e1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84e561e8-01') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:45:47 user nova-compute[71509]: DEBUG os_vif [None req-f72c1110-988a-453c-ae38-51fb1d73b2e0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:97:d3,bridge_name='br-int',has_traffic_filtering=True,id=84e561e8-01c6-4d50-ab37-bc64b5509e31,network=Network(d6116fed-ce24-4ad4-9e8a-dfb2c1305e1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84e561e8-01') {{(pid=71509) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 10:45:47 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:47 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap84e561e8-01, bridge=br-int, if_exists=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:45:47 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:47 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 10:45:47 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ca30cce-0aa1-4a16-bbe2-e704e4663d55 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] [instance: d6f539d8-4144-467b-ac69-44011c5b3564] calling os-brick to detach iSCSI Volume {{(pid=71509) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 10:45:47 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ca30cce-0aa1-4a16-bbe2-e704e4663d55 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0bf0749390>, {'target_iqn': 'iqn.2010-10.org.openstack:87bf508a-fb5e-40aa-abb8-ca896d37d55f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GCaprKfE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj', 'volume_id': '87bf508a-fb5e-40aa-abb8-ca896d37d55f': {}}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 10:45:47 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-1ca30cce-0aa1-4a16-bbe2-e704e4663d55 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 10:45:47 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-1ca30cce-0aa1-4a16-bbe2-e704e4663d55 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 10:45:47 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-1ca30cce-0aa1-4a16-bbe2-e704e4663d55 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 10:45:47 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:47 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:47 user nova-compute[71509]: INFO os_vif [None req-f72c1110-988a-453c-ae38-51fb1d73b2e0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:97:d3,bridge_name='br-int',has_traffic_filtering=True,id=84e561e8-01c6-4d50-ab37-bc64b5509e31,network=Network(d6116fed-ce24-4ad4-9e8a-dfb2c1305e1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84e561e8-01')
Apr 14 10:45:47 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-f72c1110-988a-453c-ae38-51fb1d73b2e0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T10:43:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1778823491',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1778823491',id=11,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHQhgKrBsUiMtMBVjIBZKP9TZIRsKtCXglQ+b+qPpSHOKxGrJsHd4CAY6Od528O1Hb16vq8TAcsw6lyU3DudugT46dzAga1vtVSJBR0oeEIq/4xyY6zaQXucI88fNYMmeg==',key_name='tempest-keypair-190287482',keypairs=<?>,launch_index=0,launched_at=2023-04-14T10:44:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f701119cef78433280cbddf2adf685db',ramdisk_id='',reservation_id='r-wllxdslz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1078203530',owner_user_name='tempest-TaggedBootDevicesTest_v242-1078203530-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T10:44:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3579ac20f8094f5a9fbd036ed05cda23',uuid=a81da242-e8d8-4b41-b84a-e12d603823ca,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "717e6c20-676e-40f2-b4c1-47ca0f3e6f22", "address": "fa:16:3e:bf:a5:40", "network": {"id": "d6116fed-ce24-4ad4-9e8a-dfb2c1305e1c", "bridge": "br-int", "label": "tempest-device-tagging-net2-564175672", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f701119cef78433280cbddf2adf685db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap717e6c20-67", "ovs_interfaceid": "717e6c20-676e-40f2-b4c1-47ca0f3e6f22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 10:45:47 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-f72c1110-988a-453c-ae38-51fb1d73b2e0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Converting VIF {"id": "717e6c20-676e-40f2-b4c1-47ca0f3e6f22", "address": "fa:16:3e:bf:a5:40", "network": {"id": "d6116fed-ce24-4ad4-9e8a-dfb2c1305e1c", "bridge": "br-int", "label": "tempest-device-tagging-net2-564175672", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f701119cef78433280cbddf2adf685db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap717e6c20-67", "ovs_interfaceid": "717e6c20-676e-40f2-b4c1-47ca0f3e6f22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:45:47 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-f72c1110-988a-453c-ae38-51fb1d73b2e0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:a5:40,bridge_name='br-int',has_traffic_filtering=True,id=717e6c20-676e-40f2-b4c1-47ca0f3e6f22,network=Network(d6116fed-ce24-4ad4-9e8a-dfb2c1305e1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap717e6c20-67') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:45:47 user nova-compute[71509]: DEBUG os_vif [None req-f72c1110-988a-453c-ae38-51fb1d73b2e0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:a5:40,bridge_name='br-int',has_traffic_filtering=True,id=717e6c20-676e-40f2-b4c1-47ca0f3e6f22,network=Network(d6116fed-ce24-4ad4-9e8a-dfb2c1305e1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap717e6c20-67') {{(pid=71509) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 10:45:47 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:47 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[74abe82b-3602-414d-9224-81a1c8710ab0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:87bf508a-fb5e-40aa-abb8-ca896d37d55f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:47 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ca30cce-0aa1-4a16-bbe2-e704e4663d55 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 10:45:47 user nova-compute[71509]: No targets found.
Apr 14 10:45:47 user nova-compute[71509]: iSNS:
Apr 14 10:45:47 user nova-compute[71509]: No targets found.
Apr 14 10:45:47 user nova-compute[71509]: STATIC:
Apr 14 10:45:47 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18
Apr 14 10:45:47 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:45:47 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:45:47 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768
Apr 14 10:45:47 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:45:47 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:45:47 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171
Apr 14 10:45:47 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:45:47 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:45:47 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e
Apr 14 10:45:47 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:45:47 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:45:47 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700
Apr 14 10:45:47 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:45:47 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:45:47 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:87bf508a-fb5e-40aa-abb8-ca896d37d55f
Apr 14 10:45:47 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:45:47 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:45:47 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63
Apr 14 10:45:47 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:45:47 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:45:47 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92
Apr 14 10:45:47 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:45:47 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:45:47 user nova-compute[71509]: FIRMWARE:
Apr 14 10:45:47 user nova-compute[71509]: No targets found.
Apr 14 10:45:47 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:45:47 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ca30cce-0aa1-4a16-bbe2-e704e4663d55 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 10:45:47 user nova-compute[71509]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 10:45:47 user nova-compute[71509]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71509) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 10:45:47 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ca30cce-0aa1-4a16-bbe2-e704e4663d55 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:87bf508a-fb5e-40aa-abb8-ca896d37d55f', 0)] {{(pid=71509) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 10:45:47 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:47 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap717e6c20-67, bridge=br-int, if_exists=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:45:47 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:47 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:47 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 10:45:47 user nova-compute[71509]: INFO os_vif [None req-f72c1110-988a-453c-ae38-51fb1d73b2e0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:a5:40,bridge_name='br-int',has_traffic_filtering=True,id=717e6c20-676e-40f2-b4c1-47ca0f3e6f22,network=Network(d6116fed-ce24-4ad4-9e8a-dfb2c1305e1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap717e6c20-67')
Apr 14 10:45:47 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:47 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0ce89bd-7113-44be-a911-83518a600a94]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:87bf508a-fb5e-40aa-abb8-ca896d37d55f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:47 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f72c1110-988a-453c-ae38-51fb1d73b2e0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] calling os-brick to detach iSCSI Volume {{(pid=71509) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 10:45:47 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-f72c1110-988a-453c-ae38-51fb1d73b2e0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0bf0749390>, {'target_iqn': 'iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HpOizdNI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 10:45:47 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-f72c1110-988a-453c-ae38-51fb1d73b2e0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 10:45:47 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-f72c1110-988a-453c-ae38-51fb1d73b2e0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 10:45:47 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:47 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:47 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[44b9cfec-46d6-4bb2-a08b-aee7f496a7dc]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87bf508a-fb5e-40aa-abb8-ca896d37d55f (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:47 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ca30cce-0aa1-4a16-bbe2-e704e4663d55 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87bf508a-fb5e-40aa-abb8-ca896d37d55f (non-flash)
Apr 14 10:45:47 user nova-compute[71509]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63 (non-flash)
Apr 14 10:45:47 user nova-compute[71509]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18 (non-flash)
Apr 14 10:45:47 user nova-compute[71509]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768 (non-flash)
Apr 14 10:45:47 user nova-compute[71509]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700 (non-flash)
Apr 14 10:45:47 user nova-compute[71509]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92 (non-flash)
Apr 14 10:45:47 user nova-compute[71509]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171 (non-flash)
Apr 14 10:45:47 user nova-compute[71509]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e (non-flash)
Apr 14 10:45:47 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:45:47 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ca30cce-0aa1-4a16-bbe2-e704e4663d55 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87bf508a-fb5e-40aa-abb8-ca896d37d55f (non-flash)
Apr 14 10:45:47 user nova-compute[71509]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63 (non-flash)
Apr 14 10:45:47 user nova-compute[71509]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18 (non-flash)
Apr 14 10:45:47 user nova-compute[71509]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768 (non-flash)
Apr 14 10:45:47 user nova-compute[71509]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700 (non-flash)
Apr 14 10:45:47 user nova-compute[71509]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92 (non-flash)
Apr 14 10:45:47 user nova-compute[71509]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171 (non-flash)
Apr 14 10:45:47 user nova-compute[71509]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e (non-flash)
Apr 14 10:45:47 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 10:45:47 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ca30cce-0aa1-4a16-bbe2-e704e4663d55 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0c142bfd00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:87bf508a-fb5e-40aa-abb8-ca896d37d55f'): ({'sdj'}, set())}) {{(pid=71509) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 10:45:47 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-1ca30cce-0aa1-4a16-bbe2-e704e4663d55 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] Removing single pathed devices sdj {{(pid=71509) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 10:45:47 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:47 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.036s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:47 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[0acc5437-647a-43cc-bcf3-4a382253432c]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:47 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.032s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad69e56e-2d08-4291-809b-07881de2c920]: (4, ('ok\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-1ca30cce-0aa1-4a16-bbe2-e704e4663d55 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] Flushing IO for device /dev/sdj {{(pid=71509) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.020s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[5867fba2-37ed-4879-b053-1a7a77672b95]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-1ca30cce-0aa1-4a16-bbe2-e704e4663d55 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=71509) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.049s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9fccc65-2b1a-4790-adb5-dd1bce22952d]: (4, ('1', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-1ca30cce-0aa1-4a16-bbe2-e704e4663d55 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] Checking to see if SCSI volumes sdj have been removed. {{(pid=71509) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-1ca30cce-0aa1-4a16-bbe2-e704e4663d55 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] SCSI volumes sdj have been removed. {{(pid=71509) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ca30cce-0aa1-4a16-bbe2-e704e4663d55 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:87bf508a-fb5e-40aa-abb8-ca896d37d55f')] {{(pid=71509) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87bf508a-fb5e-40aa-abb8-ca896d37d55f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87bf508a-fb5e-40aa-abb8-ca896d37d55f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcd87f89-1985-4a9a-a22a-cef6ce1fdb31]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ca30cce-0aa1-4a16-bbe2-e704e4663d55 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87bf508a-fb5e-40aa-abb8-ca896d37d55f -p 172.16.0.220:3260 --logout {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87bf508a-fb5e-40aa-abb8-ca896d37d55f -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb3662eb-9efe-42c6-86e5-aaacc3d4a541]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:87bf508a-fb5e-40aa-abb8-ca896d37d55f, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:87bf508a-fb5e-40aa-abb8-ca896d37d55f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ca30cce-0aa1-4a16-bbe2-e704e4663d55 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:87bf508a-fb5e-40aa-abb8-ca896d37d55f, portal: 172.16.0.220,3260]
Apr 14 10:45:48 user nova-compute[71509]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:87bf508a-fb5e-40aa-abb8-ca896d37d55f, portal: 172.16.0.220,3260] successful.
Apr 14 10:45:48 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87bf508a-fb5e-40aa-abb8-ca896d37d55f -p 172.16.0.220:3260 --op delete {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87bf508a-fb5e-40aa-abb8-ca896d37d55f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[63a7e510-e5c1-429d-9fd5-6e25747ce283]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ca30cce-0aa1-4a16-bbe2-e704e4663d55 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-1ca30cce-0aa1-4a16-bbe2-e704e4663d55 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.407s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ca30cce-0aa1-4a16-bbe2-e704e4663d55 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] <== disconnect_volume: return (408ms) None {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ca30cce-0aa1-4a16-bbe2-e704e4663d55 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] [instance: d6f539d8-4144-467b-ac69-44011c5b3564] Disconnected iSCSI Volume {{(pid=71509) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-f72c1110-988a-453c-ae38-51fb1d73b2e0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.361s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[69c8c1d1-14c7-4e21-845c-b1bc4705365d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-f72c1110-988a-453c-ae38-51fb1d73b2e0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 10:45:48 user nova-compute[71509]: No targets found.
Apr 14 10:45:48 user nova-compute[71509]: iSNS:
Apr 14 10:45:48 user nova-compute[71509]: No targets found.
Apr 14 10:45:48 user nova-compute[71509]: STATIC:
Apr 14 10:45:48 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18
Apr 14 10:45:48 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:45:48 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:45:48 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768
Apr 14 10:45:48 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:45:48 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:45:48 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171
Apr 14 10:45:48 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:45:48 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:45:48 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e
Apr 14 10:45:48 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:45:48 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:45:48 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700
Apr 14 10:45:48 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:45:48 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:45:48 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63
Apr 14 10:45:48 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:45:48 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:45:48 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92
Apr 14 10:45:48 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:45:48 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:45:48 user nova-compute[71509]: FIRMWARE:
Apr 14 10:45:48 user nova-compute[71509]: No targets found.
Apr 14 10:45:48 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-f72c1110-988a-453c-ae38-51fb1d73b2e0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 10:45:48 user nova-compute[71509]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 10:45:48 user nova-compute[71509]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71509) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-f72c1110-988a-453c-ae38-51fb1d73b2e0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18', 0)] {{(pid=71509) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[e176985c-48ba-4833-a7bc-9e1a7f7bc4b8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ca30cce-0aa1-4a16-bbe2-e704e4663d55 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xQnqTguX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, 'status': 'reserved', 'instance': 'd6f539d8-4144-467b-ac69-44011c5b3564', 'attached_at': '', 'detached_at': '', 'volume_id': '4cfc127d-dadf-4588-9781-c90f1906df63', 'serial'} {{(pid=71509) _swap_volume /opt/stack/nova/nova/compute/manager.py:7665}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ca30cce-0aa1-4a16-bbe2-e704e4663d55 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] [instance: d6f539d8-4144-467b-ac69-44011c5b3564] swap_volume: removing Cinder connection for volume 87bf508a-fb5e-40aa-abb8-ca896d37d55f {{(pid=71509) _swap_volume /opt/stack/nova/nova/compute/manager.py:7710}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0809f29-3760-4a48-8978-fe1335be2af2]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-f72c1110-988a-453c-ae38-51fb1d73b2e0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63 (non-flash)
Apr 14 10:45:48 user nova-compute[71509]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18 (non-flash)
Apr 14 10:45:48 user nova-compute[71509]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768 (non-flash)
Apr 14 10:45:48 user nova-compute[71509]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700 (non-flash)
Apr 14 10:45:48 user nova-compute[71509]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92 (non-flash)
Apr 14 10:45:48 user nova-compute[71509]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171 (non-flash)
Apr 14 10:45:48 user nova-compute[71509]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e (non-flash)
Apr 14 10:45:48 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-f72c1110-988a-453c-ae38-51fb1d73b2e0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63 (non-flash)
Apr 14 10:45:48 user nova-compute[71509]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18 (non-flash)
Apr 14 10:45:48 user nova-compute[71509]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768 (non-flash)
Apr 14 10:45:48 user nova-compute[71509]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700 (non-flash)
Apr 14 10:45:48 user nova-compute[71509]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92 (non-flash)
Apr 14 10:45:48 user nova-compute[71509]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171 (non-flash)
Apr 14 10:45:48 user nova-compute[71509]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e (non-flash)
Apr 14 10:45:48 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-f72c1110-988a-453c-ae38-51fb1d73b2e0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0c2c206170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18'): ({'sdc'}, set())}) {{(pid=71509) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-f72c1110-988a-453c-ae38-51fb1d73b2e0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Removing single pathed devices sdc {{(pid=71509) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[520b83d2-de22-47a5-8de0-567fed03377a]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[73d7601d-0a66-4996-8435-950b4fc547bc]: (4, ('ok\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-f72c1110-988a-453c-ae38-51fb1d73b2e0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Flushing IO for device /dev/sdc {{(pid=71509) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f576268-a422-4633-9828-48b79ac61f7d]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-f72c1110-988a-453c-ae38-51fb1d73b2e0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71509) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.036s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[51ba1e9c-8149-46bb-823d-00da4cf749b7]: (4, ('1', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-f72c1110-988a-453c-ae38-51fb1d73b2e0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71509) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-f72c1110-988a-453c-ae38-51fb1d73b2e0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] SCSI volumes sdc have been removed. {{(pid=71509) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-f72c1110-988a-453c-ae38-51fb1d73b2e0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18')] {{(pid=71509) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e2372ee-4969-426d-827e-f83b594affd9]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-f72c1110-988a-453c-ae38-51fb1d73b2e0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18 -p 172.16.0.220:3260 --logout {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18 -p 172.16.0.220:3260 --logout" returned: 0 in 0.090s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[08dda375-9c75-4fb2-9e44-e93864ed9a13]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-f72c1110-988a-453c-ae38-51fb1d73b2e0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18, portal: 172.16.0.220,3260]
Apr 14 10:45:48 user nova-compute[71509]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18, portal: 172.16.0.220,3260] successful.
Apr 14 10:45:48 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18 -p 172.16.0.220:3260 --op delete {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b354544-2f2e-40f1-bb9b-5f60c8497f18 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e7d9652-b059-4993-88a9-74ceae2ac620]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-f72c1110-988a-453c-ae38-51fb1d73b2e0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-f72c1110-988a-453c-ae38-51fb1d73b2e0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.358s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-f72c1110-988a-453c-ae38-51fb1d73b2e0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] <== disconnect_volume: return (719ms) None {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f72c1110-988a-453c-ae38-51fb1d73b2e0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Disconnected iSCSI Volume {{(pid=71509) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f72c1110-988a-453c-ae38-51fb1d73b2e0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] calling os-brick to detach iSCSI Volume {{(pid=71509) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-f72c1110-988a-453c-ae38-51fb1d73b2e0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0bf0749390>, {'target_iqn': 'iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GIrHQbTF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 10:45:48 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-f72c1110-988a-453c-ae38-51fb1d73b2e0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 10:45:48 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-f72c1110-988a-453c-ae38-51fb1d73b2e0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-f72c1110-988a-453c-ae38-51fb1d73b2e0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG nova.compute.manager [req-662f25fe-841f-4aaa-90d7-7cf7361aa0d3 req-803fbbc1-a556-409a-ac63-f646ae3eb4d1 service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Received event network-vif-plugged-2b341364-55e1-439f-9a3b-2b2fb7ad33b7 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-662f25fe-841f-4aaa-90d7-7cf7361aa0d3 req-803fbbc1-a556-409a-ac63-f646ae3eb4d1 service nova] Acquiring lock "a81da242-e8d8-4b41-b84a-e12d603823ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-662f25fe-841f-4aaa-90d7-7cf7361aa0d3 req-803fbbc1-a556-409a-ac63-f646ae3eb4d1 service nova] Lock "a81da242-e8d8-4b41-b84a-e12d603823ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-662f25fe-841f-4aaa-90d7-7cf7361aa0d3 req-803fbbc1-a556-409a-ac63-f646ae3eb4d1 service nova] Lock "a81da242-e8d8-4b41-b84a-e12d603823ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG nova.compute.manager [req-662f25fe-841f-4aaa-90d7-7cf7361aa0d3 req-803fbbc1-a556-409a-ac63-f646ae3eb4d1 service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] No waiting events found dispatching network-vif-plugged-2b341364-55e1-439f-9a3b-2b2fb7ad33b7 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:45:48 user nova-compute[71509]: WARNING nova.compute.manager [req-662f25fe-841f-4aaa-90d7-7cf7361aa0d3 req-803fbbc1-a556-409a-ac63-f646ae3eb4d1 service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Received unexpected event network-vif-plugged-2b341364-55e1-439f-9a3b-2b2fb7ad33b7 for instance with vm_state active and task_state deleting.
Apr 14 10:45:48 user nova-compute[71509]: DEBUG nova.compute.manager [req-662f25fe-841f-4aaa-90d7-7cf7361aa0d3 req-803fbbc1-a556-409a-ac63-f646ae3eb4d1 service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Received event network-vif-unplugged-f3e8f62b-77e2-49d5-9fd9-b75f024a4ee7 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-662f25fe-841f-4aaa-90d7-7cf7361aa0d3 req-803fbbc1-a556-409a-ac63-f646ae3eb4d1 service nova] Acquiring lock "a81da242-e8d8-4b41-b84a-e12d603823ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-662f25fe-841f-4aaa-90d7-7cf7361aa0d3 req-803fbbc1-a556-409a-ac63-f646ae3eb4d1 service nova] Lock "a81da242-e8d8-4b41-b84a-e12d603823ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-662f25fe-841f-4aaa-90d7-7cf7361aa0d3 req-803fbbc1-a556-409a-ac63-f646ae3eb4d1 service nova] Lock "a81da242-e8d8-4b41-b84a-e12d603823ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG nova.compute.manager [req-662f25fe-841f-4aaa-90d7-7cf7361aa0d3 req-803fbbc1-a556-409a-ac63-f646ae3eb4d1 service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] No waiting events found dispatching network-vif-unplugged-f3e8f62b-77e2-49d5-9fd9-b75f024a4ee7 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG nova.compute.manager [req-662f25fe-841f-4aaa-90d7-7cf7361aa0d3 req-803fbbc1-a556-409a-ac63-f646ae3eb4d1 service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Received event network-vif-unplugged-f3e8f62b-77e2-49d5-9fd9-b75f024a4ee7 for instance with task_state deleting. {{(pid=71509) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG nova.compute.manager [req-662f25fe-841f-4aaa-90d7-7cf7361aa0d3 req-803fbbc1-a556-409a-ac63-f646ae3eb4d1 service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Received event network-vif-plugged-f3e8f62b-77e2-49d5-9fd9-b75f024a4ee7 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-662f25fe-841f-4aaa-90d7-7cf7361aa0d3 req-803fbbc1-a556-409a-ac63-f646ae3eb4d1 service nova] Acquiring lock "a81da242-e8d8-4b41-b84a-e12d603823ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-662f25fe-841f-4aaa-90d7-7cf7361aa0d3 req-803fbbc1-a556-409a-ac63-f646ae3eb4d1 service nova] Lock "a81da242-e8d8-4b41-b84a-e12d603823ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-662f25fe-841f-4aaa-90d7-7cf7361aa0d3 req-803fbbc1-a556-409a-ac63-f646ae3eb4d1 service nova] Lock "a81da242-e8d8-4b41-b84a-e12d603823ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG nova.compute.manager [req-662f25fe-841f-4aaa-90d7-7cf7361aa0d3 req-803fbbc1-a556-409a-ac63-f646ae3eb4d1 service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] No waiting events found dispatching network-vif-plugged-f3e8f62b-77e2-49d5-9fd9-b75f024a4ee7 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:45:48 user nova-compute[71509]: WARNING nova.compute.manager [req-662f25fe-841f-4aaa-90d7-7cf7361aa0d3 req-803fbbc1-a556-409a-ac63-f646ae3eb4d1 service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Received unexpected event network-vif-plugged-f3e8f62b-77e2-49d5-9fd9-b75f024a4ee7 for instance with vm_state active and task_state deleting.
Apr 14 10:45:48 user nova-compute[71509]: DEBUG nova.compute.manager [req-662f25fe-841f-4aaa-90d7-7cf7361aa0d3 req-803fbbc1-a556-409a-ac63-f646ae3eb4d1 service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Received event network-vif-unplugged-d2d71e67-1807-43cf-8753-7bdd77de6317 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-662f25fe-841f-4aaa-90d7-7cf7361aa0d3 req-803fbbc1-a556-409a-ac63-f646ae3eb4d1 service nova] Acquiring lock "a81da242-e8d8-4b41-b84a-e12d603823ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-662f25fe-841f-4aaa-90d7-7cf7361aa0d3 req-803fbbc1-a556-409a-ac63-f646ae3eb4d1 service nova] Lock "a81da242-e8d8-4b41-b84a-e12d603823ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-662f25fe-841f-4aaa-90d7-7cf7361aa0d3 req-803fbbc1-a556-409a-ac63-f646ae3eb4d1 service nova] Lock "a81da242-e8d8-4b41-b84a-e12d603823ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG nova.compute.manager [req-662f25fe-841f-4aaa-90d7-7cf7361aa0d3 req-803fbbc1-a556-409a-ac63-f646ae3eb4d1 service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] No waiting events found dispatching network-vif-unplugged-d2d71e67-1807-43cf-8753-7bdd77de6317 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG nova.compute.manager [req-662f25fe-841f-4aaa-90d7-7cf7361aa0d3 req-803fbbc1-a556-409a-ac63-f646ae3eb4d1 service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Received event network-vif-unplugged-d2d71e67-1807-43cf-8753-7bdd77de6317 for instance with task_state deleting. {{(pid=71509) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG nova.compute.manager [req-662f25fe-841f-4aaa-90d7-7cf7361aa0d3 req-803fbbc1-a556-409a-ac63-f646ae3eb4d1 service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Received event network-vif-plugged-d2d71e67-1807-43cf-8753-7bdd77de6317 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-662f25fe-841f-4aaa-90d7-7cf7361aa0d3 req-803fbbc1-a556-409a-ac63-f646ae3eb4d1 service nova] Acquiring lock "a81da242-e8d8-4b41-b84a-e12d603823ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-662f25fe-841f-4aaa-90d7-7cf7361aa0d3 req-803fbbc1-a556-409a-ac63-f646ae3eb4d1 service nova] Lock "a81da242-e8d8-4b41-b84a-e12d603823ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-662f25fe-841f-4aaa-90d7-7cf7361aa0d3 req-803fbbc1-a556-409a-ac63-f646ae3eb4d1 service nova] Lock "a81da242-e8d8-4b41-b84a-e12d603823ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG nova.compute.manager [req-662f25fe-841f-4aaa-90d7-7cf7361aa0d3 req-803fbbc1-a556-409a-ac63-f646ae3eb4d1 service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] No waiting events found dispatching network-vif-plugged-d2d71e67-1807-43cf-8753-7bdd77de6317 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:45:48 user nova-compute[71509]: WARNING nova.compute.manager [req-662f25fe-841f-4aaa-90d7-7cf7361aa0d3 req-803fbbc1-a556-409a-ac63-f646ae3eb4d1 service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Received unexpected event network-vif-plugged-d2d71e67-1807-43cf-8753-7bdd77de6317 for instance with vm_state active and task_state deleting.
Apr 14 10:45:48 user nova-compute[71509]: DEBUG nova.compute.manager [req-662f25fe-841f-4aaa-90d7-7cf7361aa0d3 req-803fbbc1-a556-409a-ac63-f646ae3eb4d1 service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Received event network-vif-unplugged-c46b5082-6634-4c7f-89c1-7e58a3cd8987 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-662f25fe-841f-4aaa-90d7-7cf7361aa0d3 req-803fbbc1-a556-409a-ac63-f646ae3eb4d1 service nova] Acquiring lock "a81da242-e8d8-4b41-b84a-e12d603823ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-662f25fe-841f-4aaa-90d7-7cf7361aa0d3 req-803fbbc1-a556-409a-ac63-f646ae3eb4d1 service nova] Lock "a81da242-e8d8-4b41-b84a-e12d603823ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-662f25fe-841f-4aaa-90d7-7cf7361aa0d3 req-803fbbc1-a556-409a-ac63-f646ae3eb4d1 service nova] Lock "a81da242-e8d8-4b41-b84a-e12d603823ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG nova.compute.manager [req-662f25fe-841f-4aaa-90d7-7cf7361aa0d3 req-803fbbc1-a556-409a-ac63-f646ae3eb4d1 service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] No waiting events found dispatching network-vif-unplugged-c46b5082-6634-4c7f-89c1-7e58a3cd8987 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG nova.compute.manager [req-662f25fe-841f-4aaa-90d7-7cf7361aa0d3 req-803fbbc1-a556-409a-ac63-f646ae3eb4d1 service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Received event network-vif-unplugged-c46b5082-6634-4c7f-89c1-7e58a3cd8987 for instance with task_state deleting. {{(pid=71509) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG nova.compute.manager [req-662f25fe-841f-4aaa-90d7-7cf7361aa0d3 req-803fbbc1-a556-409a-ac63-f646ae3eb4d1 service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Received event network-vif-plugged-c46b5082-6634-4c7f-89c1-7e58a3cd8987 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-662f25fe-841f-4aaa-90d7-7cf7361aa0d3 req-803fbbc1-a556-409a-ac63-f646ae3eb4d1 service nova] Acquiring lock "a81da242-e8d8-4b41-b84a-e12d603823ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-662f25fe-841f-4aaa-90d7-7cf7361aa0d3 req-803fbbc1-a556-409a-ac63-f646ae3eb4d1 service nova] Lock "a81da242-e8d8-4b41-b84a-e12d603823ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-662f25fe-841f-4aaa-90d7-7cf7361aa0d3 req-803fbbc1-a556-409a-ac63-f646ae3eb4d1 service nova] Lock "a81da242-e8d8-4b41-b84a-e12d603823ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG nova.compute.manager [req-662f25fe-841f-4aaa-90d7-7cf7361aa0d3 req-803fbbc1-a556-409a-ac63-f646ae3eb4d1 service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] No waiting events found dispatching network-vif-plugged-c46b5082-6634-4c7f-89c1-7e58a3cd8987 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:45:48 user nova-compute[71509]: WARNING nova.compute.manager [req-662f25fe-841f-4aaa-90d7-7cf7361aa0d3 req-803fbbc1-a556-409a-ac63-f646ae3eb4d1 service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Received unexpected event network-vif-plugged-c46b5082-6634-4c7f-89c1-7e58a3cd8987 for instance with vm_state active and task_state deleting.
Apr 14 10:45:48 user nova-compute[71509]: DEBUG nova.compute.manager [req-662f25fe-841f-4aaa-90d7-7cf7361aa0d3 req-803fbbc1-a556-409a-ac63-f646ae3eb4d1 service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Received event network-vif-unplugged-84e561e8-01c6-4d50-ab37-bc64b5509e31 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-662f25fe-841f-4aaa-90d7-7cf7361aa0d3 req-803fbbc1-a556-409a-ac63-f646ae3eb4d1 service nova] Acquiring lock "a81da242-e8d8-4b41-b84a-e12d603823ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-662f25fe-841f-4aaa-90d7-7cf7361aa0d3 req-803fbbc1-a556-409a-ac63-f646ae3eb4d1 service nova] Lock "a81da242-e8d8-4b41-b84a-e12d603823ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-662f25fe-841f-4aaa-90d7-7cf7361aa0d3 req-803fbbc1-a556-409a-ac63-f646ae3eb4d1 service nova] Lock "a81da242-e8d8-4b41-b84a-e12d603823ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG nova.compute.manager [req-662f25fe-841f-4aaa-90d7-7cf7361aa0d3 req-803fbbc1-a556-409a-ac63-f646ae3eb4d1 service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] No waiting events found dispatching network-vif-unplugged-84e561e8-01c6-4d50-ab37-bc64b5509e31 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG nova.compute.manager [req-662f25fe-841f-4aaa-90d7-7cf7361aa0d3 req-803fbbc1-a556-409a-ac63-f646ae3eb4d1 service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Received event network-vif-unplugged-84e561e8-01c6-4d50-ab37-bc64b5509e31 for instance with task_state deleting. {{(pid=71509) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[0078e7b8-1fd9-42bf-ac53-648195939a04]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-f72c1110-988a-453c-ae38-51fb1d73b2e0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 10:45:48 user nova-compute[71509]: No targets found.
Apr 14 10:45:48 user nova-compute[71509]: iSNS:
Apr 14 10:45:48 user nova-compute[71509]: No targets found.
Apr 14 10:45:48 user nova-compute[71509]: STATIC:
Apr 14 10:45:48 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768
Apr 14 10:45:48 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:45:48 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:45:48 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171
Apr 14 10:45:48 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:45:48 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:45:48 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e
Apr 14 10:45:48 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:45:48 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:45:48 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700
Apr 14 10:45:48 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:45:48 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:45:48 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63
Apr 14 10:45:48 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:45:48 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:45:48 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92
Apr 14 10:45:48 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:45:48 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:45:48 user nova-compute[71509]: FIRMWARE:
Apr 14 10:45:48 user nova-compute[71509]: No targets found.
Apr 14 10:45:48 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-f72c1110-988a-453c-ae38-51fb1d73b2e0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 10:45:48 user nova-compute[71509]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 10:45:48 user nova-compute[71509]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71509) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-f72c1110-988a-453c-ae38-51fb1d73b2e0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768', 0)] {{(pid=71509) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fcb6d17-02dd-480b-891e-ee396e89ed6c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c390d4a-7bf2-4d91-a21e-9d27b72216bf]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-f72c1110-988a-453c-ae38-51fb1d73b2e0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63 (non-flash)
Apr 14 10:45:48 user nova-compute[71509]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768 (non-flash)
Apr 14 10:45:48 user nova-compute[71509]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700 (non-flash)
Apr 14 10:45:48 user nova-compute[71509]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92 (non-flash)
Apr 14 10:45:48 user nova-compute[71509]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171 (non-flash)
Apr 14 10:45:48 user nova-compute[71509]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e (non-flash)
Apr 14 10:45:48 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-f72c1110-988a-453c-ae38-51fb1d73b2e0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63 (non-flash)
Apr 14 10:45:48 user nova-compute[71509]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768 (non-flash)
Apr 14 10:45:48 user nova-compute[71509]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700 (non-flash)
Apr 14 10:45:48 user nova-compute[71509]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92 (non-flash)
Apr 14 10:45:48 user nova-compute[71509]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171 (non-flash)
Apr 14 10:45:48 user nova-compute[71509]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e (non-flash)
Apr 14 10:45:48 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-f72c1110-988a-453c-ae38-51fb1d73b2e0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0c2c3c8310>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768'): ({'sdd'}, set())}) {{(pid=71509) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-f72c1110-988a-453c-ae38-51fb1d73b2e0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Removing single pathed devices sdd {{(pid=71509) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff03e0e1-cef3-4d0a-ad39-04418ae949d8]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[8007f180-c094-4643-987f-e8c682b5c866]: (4, ('ok\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-f72c1110-988a-453c-ae38-51fb1d73b2e0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Flushing IO for device /dev/sdd {{(pid=71509) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG nova.compute.manager [req-311e9953-8bc7-40fe-8ce3-12193cffdd02 req-5f7625a7-2c66-4cee-917e-cfd96444ff59 service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Received event network-vif-plugged-8789c03e-397c-439a-8bc5-5d8ce5fc36ac {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-311e9953-8bc7-40fe-8ce3-12193cffdd02 req-5f7625a7-2c66-4cee-917e-cfd96444ff59 service nova] Acquiring lock "a81da242-e8d8-4b41-b84a-e12d603823ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-311e9953-8bc7-40fe-8ce3-12193cffdd02 req-5f7625a7-2c66-4cee-917e-cfd96444ff59 service nova] Lock "a81da242-e8d8-4b41-b84a-e12d603823ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-311e9953-8bc7-40fe-8ce3-12193cffdd02 req-5f7625a7-2c66-4cee-917e-cfd96444ff59 service nova] Lock "a81da242-e8d8-4b41-b84a-e12d603823ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG nova.compute.manager [req-311e9953-8bc7-40fe-8ce3-12193cffdd02 req-5f7625a7-2c66-4cee-917e-cfd96444ff59 service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] No waiting events found dispatching network-vif-plugged-8789c03e-397c-439a-8bc5-5d8ce5fc36ac {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:45:48 user nova-compute[71509]: WARNING nova.compute.manager [req-311e9953-8bc7-40fe-8ce3-12193cffdd02 req-5f7625a7-2c66-4cee-917e-cfd96444ff59 service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Received unexpected event network-vif-plugged-8789c03e-397c-439a-8bc5-5d8ce5fc36ac for instance with vm_state active and task_state deleting.
Apr 14 10:45:48 user nova-compute[71509]: DEBUG nova.compute.manager [req-311e9953-8bc7-40fe-8ce3-12193cffdd02 req-5f7625a7-2c66-4cee-917e-cfd96444ff59 service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Received event network-vif-unplugged-717e6c20-676e-40f2-b4c1-47ca0f3e6f22 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-311e9953-8bc7-40fe-8ce3-12193cffdd02 req-5f7625a7-2c66-4cee-917e-cfd96444ff59 service nova] Acquiring lock "a81da242-e8d8-4b41-b84a-e12d603823ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-311e9953-8bc7-40fe-8ce3-12193cffdd02 req-5f7625a7-2c66-4cee-917e-cfd96444ff59 service nova] Lock "a81da242-e8d8-4b41-b84a-e12d603823ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-311e9953-8bc7-40fe-8ce3-12193cffdd02 req-5f7625a7-2c66-4cee-917e-cfd96444ff59 service nova] Lock "a81da242-e8d8-4b41-b84a-e12d603823ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG nova.compute.manager [req-311e9953-8bc7-40fe-8ce3-12193cffdd02 req-5f7625a7-2c66-4cee-917e-cfd96444ff59 service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] No waiting events found dispatching network-vif-unplugged-717e6c20-676e-40f2-b4c1-47ca0f3e6f22 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG nova.compute.manager [req-311e9953-8bc7-40fe-8ce3-12193cffdd02 req-5f7625a7-2c66-4cee-917e-cfd96444ff59 service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Received event network-vif-unplugged-717e6c20-676e-40f2-b4c1-47ca0f3e6f22 for instance with task_state deleting. {{(pid=71509) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG nova.compute.manager [req-311e9953-8bc7-40fe-8ce3-12193cffdd02 req-5f7625a7-2c66-4cee-917e-cfd96444ff59 service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Received event network-changed-2a2ef05a-2d58-4cdf-ab6c-35df823a68bc {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG nova.compute.manager [req-311e9953-8bc7-40fe-8ce3-12193cffdd02 req-5f7625a7-2c66-4cee-917e-cfd96444ff59 service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Refreshing instance network info cache due to event network-changed-2a2ef05a-2d58-4cdf-ab6c-35df823a68bc. {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-311e9953-8bc7-40fe-8ce3-12193cffdd02 req-5f7625a7-2c66-4cee-917e-cfd96444ff59 service nova] Acquiring lock "refresh_cache-d1516acc-354e-41f6-a639-61dea870b11e" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-311e9953-8bc7-40fe-8ce3-12193cffdd02 req-5f7625a7-2c66-4cee-917e-cfd96444ff59 service nova] Acquired lock "refresh_cache-d1516acc-354e-41f6-a639-61dea870b11e" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG nova.network.neutron [req-311e9953-8bc7-40fe-8ce3-12193cffdd02 req-5f7625a7-2c66-4cee-917e-cfd96444ff59 service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Refreshing network info cache for port 2a2ef05a-2d58-4cdf-ab6c-35df823a68bc {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[2595f6e7-b7c7-4e23-8219-5f329c8fd1bb]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-f72c1110-988a-453c-ae38-51fb1d73b2e0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71509) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.041s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[57b20a58-a9cb-483c-9f69-697d71183574]: (4, ('1', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-f72c1110-988a-453c-ae38-51fb1d73b2e0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71509) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-f72c1110-988a-453c-ae38-51fb1d73b2e0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] SCSI volumes sdd have been removed. {{(pid=71509) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-f72c1110-988a-453c-ae38-51fb1d73b2e0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768')] {{(pid=71509) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[137d8aac-2fec-46c7-bdf0-61555eb1d989]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-f72c1110-988a-453c-ae38-51fb1d73b2e0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768 -p 172.16.0.220:3260 --logout {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[5037cf8d-54a3-4c39-a765-89fb240c6d3a]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-f72c1110-988a-453c-ae38-51fb1d73b2e0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768, portal: 172.16.0.220,3260]
Apr 14 10:45:48 user nova-compute[71509]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768, portal: 172.16.0.220,3260] successful.
Apr 14 10:45:48 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768 -p 172.16.0.220:3260 --op delete {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18ba60c5-2a70-402c-a557-69dd9c886768 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[021622c8-1497-4cba-8cdc-473890315379]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-f72c1110-988a-453c-ae38-51fb1d73b2e0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-f72c1110-988a-453c-ae38-51fb1d73b2e0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.346s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-f72c1110-988a-453c-ae38-51fb1d73b2e0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] <== disconnect_volume: return (347ms) None {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f72c1110-988a-453c-ae38-51fb1d73b2e0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Disconnected iSCSI Volume {{(pid=71509) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f72c1110-988a-453c-ae38-51fb1d73b2e0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] calling os-brick to detach iSCSI Volume {{(pid=71509) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-f72c1110-988a-453c-ae38-51fb1d73b2e0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0bf0749390>, {'target_iqn': 'iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fdbWvrhQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 10:45:48 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-f72c1110-988a-453c-ae38-51fb1d73b2e0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 10:45:48 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-f72c1110-988a-453c-ae38-51fb1d73b2e0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-f72c1110-988a-453c-ae38-51fb1d73b2e0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 10:45:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:49 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:49 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[de7c1c37-e702-462c-b753-63c10eae4fee]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:49 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-f72c1110-988a-453c-ae38-51fb1d73b2e0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 10:45:49 user nova-compute[71509]: No targets found.
Apr 14 10:45:49 user nova-compute[71509]: iSNS:
Apr 14 10:45:49 user nova-compute[71509]: No targets found.
Apr 14 10:45:49 user nova-compute[71509]: STATIC:
Apr 14 10:45:49 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171
Apr 14 10:45:49 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:45:49 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:45:49 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e
Apr 14 10:45:49 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:45:49 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:45:49 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700
Apr 14 10:45:49 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:45:49 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:45:49 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63
Apr 14 10:45:49 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:45:49 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:45:49 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92
Apr 14 10:45:49 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:45:49 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:45:49 user nova-compute[71509]: FIRMWARE:
Apr 14 10:45:49 user nova-compute[71509]: No targets found.
Apr 14 10:45:49 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:45:49 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-f72c1110-988a-453c-ae38-51fb1d73b2e0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 10:45:49 user nova-compute[71509]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 10:45:49 user nova-compute[71509]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71509) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 10:45:49 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-f72c1110-988a-453c-ae38-51fb1d73b2e0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92', 0)] {{(pid=71509) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 10:45:49 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:49 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:49 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[057a7501-c2c8-479b-b375-4eb2c4467f5f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:49 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:49 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:49 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5d7e163-07e9-484f-ad06-812da471e24e]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:49 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-f72c1110-988a-453c-ae38-51fb1d73b2e0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63 (non-flash)
Apr 14 10:45:49 user nova-compute[71509]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700 (non-flash)
Apr 14 10:45:49 user nova-compute[71509]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92 (non-flash)
Apr 14 10:45:49 user nova-compute[71509]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171 (non-flash)
Apr 14 10:45:49 user nova-compute[71509]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e (non-flash)
Apr 14 10:45:49 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:45:49 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-f72c1110-988a-453c-ae38-51fb1d73b2e0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63 (non-flash)
Apr 14 10:45:49 user nova-compute[71509]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700 (non-flash)
Apr 14 10:45:49 user nova-compute[71509]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92 (non-flash)
Apr 14 10:45:49 user nova-compute[71509]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171 (non-flash)
Apr 14 10:45:49 user nova-compute[71509]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e (non-flash)
Apr 14 10:45:49 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 10:45:49 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-f72c1110-988a-453c-ae38-51fb1d73b2e0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0c2c3cbb50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92'): ({'sdf'}, set())}) {{(pid=71509) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 10:45:49 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-f72c1110-988a-453c-ae38-51fb1d73b2e0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Removing single pathed devices sdf {{(pid=71509) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 10:45:49 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:49 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:49 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[27de8042-41a1-4f9a-b84f-4aa935e3ed39]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:49 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:49 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:49 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[16cbe764-37be-41f2-bfb2-86117b21966a]: (4, ('ok\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:49 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-f72c1110-988a-453c-ae38-51fb1d73b2e0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Flushing IO for device /dev/sdf {{(pid=71509) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 10:45:49 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:49 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.016s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:49 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[607c46bb-ad6c-4b7a-963b-c5f9598139e9]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:49 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-f72c1110-988a-453c-ae38-51fb1d73b2e0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71509) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 10:45:49 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:49 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.045s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:49 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[c651549a-9611-40fa-80ac-29d186377c3f]: (4, ('1', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:49 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-f72c1110-988a-453c-ae38-51fb1d73b2e0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=71509) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 10:45:49 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-f72c1110-988a-453c-ae38-51fb1d73b2e0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] SCSI volumes sdf have been removed. {{(pid=71509) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 10:45:49 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-f72c1110-988a-453c-ae38-51fb1d73b2e0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92')] {{(pid=71509) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 10:45:49 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:49 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:49 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[051dc83b-ae61-41cf-9539-7e093ef2cf9c]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:49 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-f72c1110-988a-453c-ae38-51fb1d73b2e0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:45:49 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92 -p 172.16.0.220:3260 --logout {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:49 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:49 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ca30cce-0aa1-4a16-bbe2-e704e4663d55 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] [instance: d6f539d8-4144-467b-ac69-44011c5b3564] swap_volume: Updating volume 87bf508a-fb5e-40aa-abb8-ca896d37d55f BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "xQnqTguX", "auth_password": "41m7PSG5KatkqA", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdi", "volume_id": "4cfc127d-dadf-4588-9781-c90f1906df63"}, "status": "reserved", "instance": "d6f539d8-4144-467b-ac69-44011c5b3564", "attached_at": "", "detached_at": "", "volume_id": "4cfc127d-dadf-4588-9781-c90f1906df63", "serial": "4cfc127d-dadf-4588-9781-c90f1906df63"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '4cfc127d-dadf-4588-9781-c90f1906df63', 'no_device': None, 'attachment_id': '6dc86089-320e-4a5e-a4f6-215257818595'} {{(pid=71509) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7858}}
Apr 14 10:45:49 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:49 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[37a3b7da-cf06-4783-b2fe-c67f0d1b7d5c]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:49 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-f72c1110-988a-453c-ae38-51fb1d73b2e0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92, portal: 172.16.0.220,3260]
Apr 14 10:45:49 user nova-compute[71509]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92, portal: 172.16.0.220,3260] successful.
Apr 14 10:45:49 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:45:49 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92 -p 172.16.0.220:3260 --op delete {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:49 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ca30cce-0aa1-4a16-bbe2-e704e4663d55 tempest-TestVolumeSwap-1862504553 tempest-TestVolumeSwap-1862504553-project-admin] Lock "d6f539d8-4144-467b-ac69-44011c5b3564" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 13.680s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:45:49 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7653f786-98b3-4e3d-b593-3b9fec984d92 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:49 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[59bd1382-9400-4346-9c55-8098a81d3449]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:49 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-f72c1110-988a-453c-ae38-51fb1d73b2e0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:45:49 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-f72c1110-988a-453c-ae38-51fb1d73b2e0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.368s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 10:45:49 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-f72c1110-988a-453c-ae38-51fb1d73b2e0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] <== disconnect_volume: return (369ms) None {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 10:45:49 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f72c1110-988a-453c-ae38-51fb1d73b2e0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Disconnected iSCSI Volume {{(pid=71509) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 10:45:49 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-f72c1110-988a-453c-ae38-51fb1d73b2e0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Deleting instance files /opt/stack/data/nova/instances/a81da242-e8d8-4b41-b84a-e12d603823ca_del
Apr 14 10:45:49 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-f72c1110-988a-453c-ae38-51fb1d73b2e0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Deletion of /opt/stack/data/nova/instances/a81da242-e8d8-4b41-b84a-e12d603823ca_del complete
Apr 14 10:45:49 user nova-compute[71509]: INFO nova.compute.manager [None req-f72c1110-988a-453c-ae38-51fb1d73b2e0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Took 3.93 seconds to destroy the instance on the hypervisor.
Apr 14 10:45:49 user nova-compute[71509]: DEBUG oslo.service.loopingcall [None req-f72c1110-988a-453c-ae38-51fb1d73b2e0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71509) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 10:45:49 user nova-compute[71509]: DEBUG nova.compute.manager [-] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Deallocating network for instance {{(pid=71509) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 10:45:49 user nova-compute[71509]: DEBUG nova.network.neutron [-] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] deallocate_for_instance() {{(pid=71509) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 10:45:49 user nova-compute[71509]: DEBUG nova.network.neutron [req-311e9953-8bc7-40fe-8ce3-12193cffdd02 req-5f7625a7-2c66-4cee-917e-cfd96444ff59 service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Updated VIF entry in instance network info cache for port 2a2ef05a-2d58-4cdf-ab6c-35df823a68bc. {{(pid=71509) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 10:45:49 user nova-compute[71509]: DEBUG nova.network.neutron [req-311e9953-8bc7-40fe-8ce3-12193cffdd02 req-5f7625a7-2c66-4cee-917e-cfd96444ff59 service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Updating instance_info_cache with network_info: [{"id": "2a2ef05a-2d58-4cdf-ab6c-35df823a68bc", "address": "fa:16:3e:ad:4e:cf", "network": {"id": "3c95a463-71cf-446f-8214-5f52f2da54b7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-325252986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e024f5a578e4543a02c6adc7d456f39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a2ef05a-2d", "ovs_interfaceid": "2a2ef05a-2d58-4cdf-ab6c-35df823a68bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "23214923-0217-4046-9a68-675f2ee8e42d", "address": "fa:16:3e:8a:5a:1a", "network": {"id": "bb8c5688-db8f-47c0-a2b5-0a44d2f97461", "bridge": "br-int", "label": "tempest-device-tagging-net1-527368946", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e024f5a578e4543a02c6adc7d456f39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23214923-02", "ovs_interfaceid": "23214923-0217-4046-9a68-675f2ee8e42d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7f7db929-b2fd-4242-9d23-5d58a374f961", "address": "fa:16:3e:28:88:b4", "network": {"id": "bb8c5688-db8f-47c0-a2b5-0a44d2f97461", "bridge": "br-int", "label": "tempest-device-tagging-net1-527368946", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e024f5a578e4543a02c6adc7d456f39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f7db929-b2", "ovs_interfaceid": "7f7db929-b2fd-4242-9d23-5d58a374f961", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4d65e4a1-4cea-4636-8ad8-21065de3c747", "address": "fa:16:3e:c2:1b:8c", "network": {"id": "bb8c5688-db8f-47c0-a2b5-0a44d2f97461", "bridge": "br-int", "label": "tempest-device-tagging-net1-527368946", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e024f5a578e4543a02c6adc7d456f39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d65e4a1-4c", "ovs_interfaceid": "4d65e4a1-4cea-4636-8ad8-21065de3c747", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d70f6f4d-f2bc-4d5e-9e98-a0daa1b35a0f", "address": "fa:16:3e:64:ce:c5", "network": {"id": "bb8c5688-db8f-47c0-a2b5-0a44d2f97461", "bridge": "br-int", "label": "tempest-device-tagging-net1-527368946", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e024f5a578e4543a02c6adc7d456f39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd70f6f4d-f2", "ovs_interfaceid": "d70f6f4d-f2bc-4d5e-9e98-a0daa1b35a0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "328d2b64-7bc6-425a-b3a4-8cda754ffd56", "address": "fa:16:3e:a6:55:10", "network": {"id": "1c6521c7-7280-4952-b1bc-a3aa0918e27c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1095863542", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e024f5a578e4543a02c6adc7d456f39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap328d2b64-7b", "ovs_interfaceid": "328d2b64-7bc6-425a-b3a4-8cda754ffd56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6e295a29-0297-49c0-9298-7d3a41a07585", "address": "fa:16:3e:32:10:a4", "network": {"id": "1c6521c7-7280-4952-b1bc-a3aa0918e27c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1095863542", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e024f5a578e4543a02c6adc7d456f39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e295a29-02", "ovs_interfaceid": "6e295a29-0297-49c0-9298-7d3a41a07585", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:45:49 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-311e9953-8bc7-40fe-8ce3-12193cffdd02 req-5f7625a7-2c66-4cee-917e-cfd96444ff59 service nova] Releasing lock "refresh_cache-d1516acc-354e-41f6-a639-61dea870b11e" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:45:49 user nova-compute[71509]: DEBUG nova.compute.manager [req-311e9953-8bc7-40fe-8ce3-12193cffdd02 req-5f7625a7-2c66-4cee-917e-cfd96444ff59 service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Received event network-vif-plugged-717e6c20-676e-40f2-b4c1-47ca0f3e6f22 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:45:49 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-311e9953-8bc7-40fe-8ce3-12193cffdd02 req-5f7625a7-2c66-4cee-917e-cfd96444ff59 service nova] Acquiring lock "a81da242-e8d8-4b41-b84a-e12d603823ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:45:49 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-311e9953-8bc7-40fe-8ce3-12193cffdd02 req-5f7625a7-2c66-4cee-917e-cfd96444ff59 service nova] Lock "a81da242-e8d8-4b41-b84a-e12d603823ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:45:49 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-311e9953-8bc7-40fe-8ce3-12193cffdd02 req-5f7625a7-2c66-4cee-917e-cfd96444ff59 service nova] Lock "a81da242-e8d8-4b41-b84a-e12d603823ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:45:49 user nova-compute[71509]: DEBUG nova.compute.manager [req-311e9953-8bc7-40fe-8ce3-12193cffdd02 req-5f7625a7-2c66-4cee-917e-cfd96444ff59 service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] No waiting events found dispatching network-vif-plugged-717e6c20-676e-40f2-b4c1-47ca0f3e6f22 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:45:49 user nova-compute[71509]: WARNING nova.compute.manager [req-311e9953-8bc7-40fe-8ce3-12193cffdd02 req-5f7625a7-2c66-4cee-917e-cfd96444ff59 service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Received unexpected event network-vif-plugged-717e6c20-676e-40f2-b4c1-47ca0f3e6f22 for instance with vm_state active and task_state deleting.
Apr 14 10:45:49 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-c5f92253-36a7-4e58-ab43-a926cfd06402 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Acquiring lock "d1516acc-354e-41f6-a639-61dea870b11e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:45:49 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-c5f92253-36a7-4e58-ab43-a926cfd06402 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Lock "d1516acc-354e-41f6-a639-61dea870b11e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:45:49 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-c5f92253-36a7-4e58-ab43-a926cfd06402 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Acquiring lock "d1516acc-354e-41f6-a639-61dea870b11e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:45:49 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-c5f92253-36a7-4e58-ab43-a926cfd06402 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Lock "d1516acc-354e-41f6-a639-61dea870b11e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:45:49 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-c5f92253-36a7-4e58-ab43-a926cfd06402 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Lock "d1516acc-354e-41f6-a639-61dea870b11e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:45:49 user nova-compute[71509]: INFO nova.compute.manager [None req-c5f92253-36a7-4e58-ab43-a926cfd06402 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Terminating instance
Apr 14 10:45:49 user nova-compute[71509]: DEBUG nova.compute.manager [None req-c5f92253-36a7-4e58-ab43-a926cfd06402 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Start destroying the instance on the hypervisor. {{(pid=71509) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 10:45:50 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:50 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:50 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:50 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:50 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:50 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:50 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:50 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-d3a211ee-d9fc-4ac2-a500-c569a793db37 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Acquiring lock "d6f539d8-4144-467b-ac69-44011c5b3564" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:45:50 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-d3a211ee-d9fc-4ac2-a500-c569a793db37 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Lock "d6f539d8-4144-467b-ac69-44011c5b3564" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:45:50 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:50 user nova-compute[71509]: INFO nova.compute.manager [None req-d3a211ee-d9fc-4ac2-a500-c569a793db37 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] [instance: d6f539d8-4144-467b-ac69-44011c5b3564] Detaching volume 4cfc127d-dadf-4588-9781-c90f1906df63
Apr 14 10:45:50 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:50 user nova-compute[71509]: INFO nova.virt.block_device [None req-d3a211ee-d9fc-4ac2-a500-c569a793db37 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] [instance: d6f539d8-4144-467b-ac69-44011c5b3564] Attempting to driver detach volume 4cfc127d-dadf-4588-9781-c90f1906df63 from mountpoint /dev/vdb
Apr 14 10:45:50 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-d3a211ee-d9fc-4ac2-a500-c569a793db37 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Attempting to detach device vdb from instance d6f539d8-4144-467b-ac69-44011c5b3564 from the persistent domain config. {{(pid=71509) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 10:45:50 user nova-compute[71509]: DEBUG nova.virt.libvirt.guest [None req-d3a211ee-d9fc-4ac2-a500-c569a793db37 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 10:45:50 user nova-compute[71509]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 10:45:50 user nova-compute[71509]:   <source dev="/dev/sdi"/>
Apr 14 10:45:50 user nova-compute[71509]:   <target dev="vdb" bus="virtio"/>
Apr 14 10:45:50 user nova-compute[71509]:   <serial>4cfc127d-dadf-4588-9781-c90f1906df63</serial>
Apr 14 10:45:50 user nova-compute[71509]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 10:45:50 user nova-compute[71509]: </disk>
Apr 14 10:45:50 user nova-compute[71509]:  {{(pid=71509) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 10:45:50 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-d3a211ee-d9fc-4ac2-a500-c569a793db37 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Successfully detached device vdb from instance d6f539d8-4144-467b-ac69-44011c5b3564 from the persistent domain config.
Apr 14 10:45:50 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-d3a211ee-d9fc-4ac2-a500-c569a793db37 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d6f539d8-4144-467b-ac69-44011c5b3564 from the live domain config. {{(pid=71509) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 10:45:50 user nova-compute[71509]: DEBUG nova.virt.libvirt.guest [None req-d3a211ee-d9fc-4ac2-a500-c569a793db37 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 10:45:50 user nova-compute[71509]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 10:45:50 user nova-compute[71509]:   <source dev="/dev/sdi"/>
Apr 14 10:45:50 user nova-compute[71509]:   <target dev="vdb" bus="virtio"/>
Apr 14 10:45:50 user nova-compute[71509]:   <serial>4cfc127d-dadf-4588-9781-c90f1906df63</serial>
Apr 14 10:45:50 user nova-compute[71509]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 10:45:50 user nova-compute[71509]: </disk>
Apr 14 10:45:50 user nova-compute[71509]:  {{(pid=71509) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 10:45:50 user nova-compute[71509]: DEBUG nova.compute.manager [req-778b5dc0-f353-45ce-a8b4-daf1b856562a req-1770bc21-2f10-4a1d-b677-10fa17a002ba service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Received event network-vif-unplugged-23214923-0217-4046-9a68-675f2ee8e42d {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:45:50 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-778b5dc0-f353-45ce-a8b4-daf1b856562a req-1770bc21-2f10-4a1d-b677-10fa17a002ba service nova] Acquiring lock "d1516acc-354e-41f6-a639-61dea870b11e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:45:50 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-778b5dc0-f353-45ce-a8b4-daf1b856562a req-1770bc21-2f10-4a1d-b677-10fa17a002ba service nova] Lock "d1516acc-354e-41f6-a639-61dea870b11e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:45:50 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-778b5dc0-f353-45ce-a8b4-daf1b856562a req-1770bc21-2f10-4a1d-b677-10fa17a002ba service nova] Lock "d1516acc-354e-41f6-a639-61dea870b11e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:45:50 user nova-compute[71509]: DEBUG nova.compute.manager [req-778b5dc0-f353-45ce-a8b4-daf1b856562a req-1770bc21-2f10-4a1d-b677-10fa17a002ba service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] No waiting events found dispatching network-vif-unplugged-23214923-0217-4046-9a68-675f2ee8e42d {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:45:50 user nova-compute[71509]: DEBUG nova.compute.manager [req-778b5dc0-f353-45ce-a8b4-daf1b856562a req-1770bc21-2f10-4a1d-b677-10fa17a002ba service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Received event network-vif-unplugged-23214923-0217-4046-9a68-675f2ee8e42d for instance with task_state deleting. {{(pid=71509) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 10:45:50 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:50 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:50 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:50 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:50 user nova-compute[71509]: DEBUG nova.compute.manager [req-6351669b-35bc-4922-a372-fb4afafae60b req-5298b924-f53d-4441-9892-21d174e0d406 service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Received event network-vif-plugged-84e561e8-01c6-4d50-ab37-bc64b5509e31 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:45:50 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-6351669b-35bc-4922-a372-fb4afafae60b req-5298b924-f53d-4441-9892-21d174e0d406 service nova] Acquiring lock "a81da242-e8d8-4b41-b84a-e12d603823ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:45:50 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-6351669b-35bc-4922-a372-fb4afafae60b req-5298b924-f53d-4441-9892-21d174e0d406 service nova] Lock "a81da242-e8d8-4b41-b84a-e12d603823ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:45:50 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-6351669b-35bc-4922-a372-fb4afafae60b req-5298b924-f53d-4441-9892-21d174e0d406 service nova] Lock "a81da242-e8d8-4b41-b84a-e12d603823ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:45:50 user nova-compute[71509]: DEBUG nova.compute.manager [req-6351669b-35bc-4922-a372-fb4afafae60b req-5298b924-f53d-4441-9892-21d174e0d406 service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] No waiting events found dispatching network-vif-plugged-84e561e8-01c6-4d50-ab37-bc64b5509e31 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:45:50 user nova-compute[71509]: WARNING nova.compute.manager [req-6351669b-35bc-4922-a372-fb4afafae60b req-5298b924-f53d-4441-9892-21d174e0d406 service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Received unexpected event network-vif-plugged-84e561e8-01c6-4d50-ab37-bc64b5509e31 for instance with vm_state active and task_state deleting.
Apr 14 10:45:50 user nova-compute[71509]: DEBUG nova.compute.manager [req-6351669b-35bc-4922-a372-fb4afafae60b req-5298b924-f53d-4441-9892-21d174e0d406 service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Received event network-vif-unplugged-2a2ef05a-2d58-4cdf-ab6c-35df823a68bc {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:45:50 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-6351669b-35bc-4922-a372-fb4afafae60b req-5298b924-f53d-4441-9892-21d174e0d406 service nova] Acquiring lock "d1516acc-354e-41f6-a639-61dea870b11e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:45:50 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-6351669b-35bc-4922-a372-fb4afafae60b req-5298b924-f53d-4441-9892-21d174e0d406 service nova] Lock "d1516acc-354e-41f6-a639-61dea870b11e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:45:50 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-6351669b-35bc-4922-a372-fb4afafae60b req-5298b924-f53d-4441-9892-21d174e0d406 service nova] Lock "d1516acc-354e-41f6-a639-61dea870b11e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:45:50 user nova-compute[71509]: DEBUG nova.compute.manager [req-6351669b-35bc-4922-a372-fb4afafae60b req-5298b924-f53d-4441-9892-21d174e0d406 service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] No waiting events found dispatching network-vif-unplugged-2a2ef05a-2d58-4cdf-ab6c-35df823a68bc {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:45:50 user nova-compute[71509]: DEBUG nova.compute.manager [req-6351669b-35bc-4922-a372-fb4afafae60b req-5298b924-f53d-4441-9892-21d174e0d406 service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Received event network-vif-unplugged-2a2ef05a-2d58-4cdf-ab6c-35df823a68bc for instance with task_state deleting. {{(pid=71509) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 10:45:50 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:50 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:51 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:51 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:51 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:51 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:51 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:51 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Received event <DeviceRemovedEvent: 1681469151.2096522, d6f539d8-4144-467b-ac69-44011c5b3564 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71509) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 10:45:51 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-d3a211ee-d9fc-4ac2-a500-c569a793db37 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d6f539d8-4144-467b-ac69-44011c5b3564 {{(pid=71509) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 10:45:51 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-d3a211ee-d9fc-4ac2-a500-c569a793db37 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Successfully detached device vdb from instance d6f539d8-4144-467b-ac69-44011c5b3564 from the live domain config.
Apr 14 10:45:51 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3a211ee-d9fc-4ac2-a500-c569a793db37 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] [instance: d6f539d8-4144-467b-ac69-44011c5b3564] calling os-brick to detach iSCSI Volume {{(pid=71509) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 10:45:51 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3a211ee-d9fc-4ac2-a500-c569a793db37 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0bf0749390>, {'target_iqn': 'iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xQnqTguX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi', 'volume_id': '4cfc127d-dadf-4588-9781-c90f1906df63': {}}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 10:45:51 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-d3a211ee-d9fc-4ac2-a500-c569a793db37 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 10:45:51 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-d3a211ee-d9fc-4ac2-a500-c569a793db37 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 10:45:51 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-d3a211ee-d9fc-4ac2-a500-c569a793db37 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 10:45:51 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:51 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:51 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[4280036d-db89-47cc-bce7-4e5959a7a5e2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:51 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3a211ee-d9fc-4ac2-a500-c569a793db37 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 10:45:51 user nova-compute[71509]: No targets found.
Apr 14 10:45:51 user nova-compute[71509]: iSNS:
Apr 14 10:45:51 user nova-compute[71509]: No targets found.
Apr 14 10:45:51 user nova-compute[71509]: STATIC:
Apr 14 10:45:51 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171
Apr 14 10:45:51 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:45:51 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:45:51 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e
Apr 14 10:45:51 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:45:51 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:45:51 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700
Apr 14 10:45:51 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:45:51 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:45:51 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63
Apr 14 10:45:51 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:45:51 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:45:51 user nova-compute[71509]: FIRMWARE:
Apr 14 10:45:51 user nova-compute[71509]: No targets found.
Apr 14 10:45:51 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:45:51 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3a211ee-d9fc-4ac2-a500-c569a793db37 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 10:45:51 user nova-compute[71509]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 10:45:51 user nova-compute[71509]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71509) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 10:45:51 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3a211ee-d9fc-4ac2-a500-c569a793db37 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63', 0)] {{(pid=71509) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 10:45:51 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:51 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:51 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:51 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[f96af57e-fb75-4070-b436-5025f742c40c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:51 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:51 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:51 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[3da53b3e-8a22-4969-ae0d-5046e28a3ac8]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:51 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3a211ee-d9fc-4ac2-a500-c569a793db37 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63 (non-flash)
Apr 14 10:45:51 user nova-compute[71509]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700 (non-flash)
Apr 14 10:45:51 user nova-compute[71509]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171 (non-flash)
Apr 14 10:45:51 user nova-compute[71509]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e (non-flash)
Apr 14 10:45:51 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:45:51 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3a211ee-d9fc-4ac2-a500-c569a793db37 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63 (non-flash)
Apr 14 10:45:51 user nova-compute[71509]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700 (non-flash)
Apr 14 10:45:51 user nova-compute[71509]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171 (non-flash)
Apr 14 10:45:51 user nova-compute[71509]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e (non-flash)
Apr 14 10:45:51 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 10:45:51 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3a211ee-d9fc-4ac2-a500-c569a793db37 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0c2c3cb250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63'): ({'sdi'}, set())}) {{(pid=71509) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 10:45:51 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-d3a211ee-d9fc-4ac2-a500-c569a793db37 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Removing single pathed devices sdi {{(pid=71509) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 10:45:51 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:51 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:51 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e6dd7a3-538a-4b27-a518-40f2b25d7bcd]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:51 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:51 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.021s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:51 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[38032401-ce0a-43f5-8f32-1927c492aa03]: (4, ('ok\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:51 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-d3a211ee-d9fc-4ac2-a500-c569a793db37 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Flushing IO for device /dev/sdi {{(pid=71509) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 10:45:51 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:51 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.022s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:51 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fc0d2af-94bc-4af8-a2f4-16d1c5d3fc14]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:51 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-d3a211ee-d9fc-4ac2-a500-c569a793db37 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=71509) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 10:45:51 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:51 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:51 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:51 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.052s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:51 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[10fbb530-7a36-4bbf-a08b-9b158172dfb4]: (4, ('1', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:51 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-d3a211ee-d9fc-4ac2-a500-c569a793db37 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=71509) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 10:45:51 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-d3a211ee-d9fc-4ac2-a500-c569a793db37 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] SCSI volumes sdi have been removed. {{(pid=71509) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 10:45:51 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3a211ee-d9fc-4ac2-a500-c569a793db37 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63')] {{(pid=71509) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 10:45:51 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:51 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:51 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[c730ddf0-01b8-4c60-8eeb-1e9c0b7b14a4]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:51 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3a211ee-d9fc-4ac2-a500-c569a793db37 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:45:51 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63 -p 172.16.0.220:3260 --logout {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:51 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:51 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63 -p 172.16.0.220:3260 --logout" returned: 0 in 0.104s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:51 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cfcd885-a531-4ac3-9156-b8ac3c94fac0]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:51 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3a211ee-d9fc-4ac2-a500-c569a793db37 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63, portal: 172.16.0.220,3260]
Apr 14 10:45:51 user nova-compute[71509]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63, portal: 172.16.0.220,3260] successful.
Apr 14 10:45:51 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:45:51 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63 -p 172.16.0.220:3260 --op delete {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:51 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4cfc127d-dadf-4588-9781-c90f1906df63 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.043s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:51 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d403771-1dad-415f-9a7b-85b71fb03a3b]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:51 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3a211ee-d9fc-4ac2-a500-c569a793db37 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:45:51 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-d3a211ee-d9fc-4ac2-a500-c569a793db37 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.432s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 10:45:51 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3a211ee-d9fc-4ac2-a500-c569a793db37 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] <== disconnect_volume: return (433ms) None {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 10:45:51 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3a211ee-d9fc-4ac2-a500-c569a793db37 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] [instance: d6f539d8-4144-467b-ac69-44011c5b3564] Disconnected iSCSI Volume {{(pid=71509) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 10:45:51 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Instance destroyed successfully.
Apr 14 10:45:51 user nova-compute[71509]: DEBUG nova.objects.instance [None req-c5f92253-36a7-4e58-ab43-a926cfd06402 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Lazy-loading 'resources' on Instance uuid d1516acc-354e-41f6-a639-61dea870b11e {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-c5f92253-36a7-4e58-ab43-a926cfd06402 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T10:43:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1636555058',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1636555058',id=12,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFiuA4lBJVtYfiy/p87uKYDDoanpcxZLwOKehEbraw8DqN/tSzDkhXnQCUYZYSydWf6HuXl2lM5q4KKhfjVIPIOpfWr+UnggY0Ln4rrMx5Z5ebIqfaJVvJquUpb7gfFk/w==',key_name='tempest-keypair-1957800049',keypairs=<?>,launch_index=0,launched_at=2023-04-14T10:44:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0e024f5a578e4543a02c6adc7d456f39',ramdisk_id='',reservation_id='r-rufirbfe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-656117710',owner_user_name='tempest-TaggedBootDevicesTest-656117710-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T10:44:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f6dac34303f4965babaee39bb363b5e',uuid=d1516acc-354e-41f6-a639-61dea870b11e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2a2ef05a-2d58-4cdf-ab6c-35df823a68bc", "address": "fa:16:3e:ad:4e:cf", "network": {"id": "3c95a463-71cf-446f-8214-5f52f2da54b7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-325252986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e024f5a578e4543a02c6adc7d456f39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a2ef05a-2d", "ovs_interfaceid": "2a2ef05a-2d58-4cdf-ab6c-35df823a68bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-c5f92253-36a7-4e58-ab43-a926cfd06402 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Converting VIF {"id": "2a2ef05a-2d58-4cdf-ab6c-35df823a68bc", "address": "fa:16:3e:ad:4e:cf", "network": {"id": "3c95a463-71cf-446f-8214-5f52f2da54b7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-325252986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e024f5a578e4543a02c6adc7d456f39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a2ef05a-2d", "ovs_interfaceid": "2a2ef05a-2d58-4cdf-ab6c-35df823a68bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-c5f92253-36a7-4e58-ab43-a926cfd06402 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ad:4e:cf,bridge_name='br-int',has_traffic_filtering=True,id=2a2ef05a-2d58-4cdf-ab6c-35df823a68bc,network=Network(3c95a463-71cf-446f-8214-5f52f2da54b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a2ef05a-2d') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG os_vif [None req-c5f92253-36a7-4e58-ab43-a926cfd06402 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ad:4e:cf,bridge_name='br-int',has_traffic_filtering=True,id=2a2ef05a-2d58-4cdf-ab6c-35df823a68bc,network=Network(3c95a463-71cf-446f-8214-5f52f2da54b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a2ef05a-2d') {{(pid=71509) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2a2ef05a-2d, bridge=br-int, if_exists=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:52 user nova-compute[71509]: INFO os_vif [None req-c5f92253-36a7-4e58-ab43-a926cfd06402 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ad:4e:cf,bridge_name='br-int',has_traffic_filtering=True,id=2a2ef05a-2d58-4cdf-ab6c-35df823a68bc,network=Network(3c95a463-71cf-446f-8214-5f52f2da54b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a2ef05a-2d')
Apr 14 10:45:52 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-c5f92253-36a7-4e58-ab43-a926cfd06402 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T10:43:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1636555058',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1636555058',id=12,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFiuA4lBJVtYfiy/p87uKYDDoanpcxZLwOKehEbraw8DqN/tSzDkhXnQCUYZYSydWf6HuXl2lM5q4KKhfjVIPIOpfWr+UnggY0Ln4rrMx5Z5ebIqfaJVvJquUpb7gfFk/w==',key_name='tempest-keypair-1957800049',keypairs=<?>,launch_index=0,launched_at=2023-04-14T10:44:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0e024f5a578e4543a02c6adc7d456f39',ramdisk_id='',reservation_id='r-rufirbfe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-656117710',owner_user_name='tempest-TaggedBootDevicesTest-656117710-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T10:44:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f6dac34303f4965babaee39bb363b5e',uuid=d1516acc-354e-41f6-a639-61dea870b11e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "23214923-0217-4046-9a68-675f2ee8e42d", "address": "fa:16:3e:8a:5a:1a", "network": {"id": "bb8c5688-db8f-47c0-a2b5-0a44d2f97461", "bridge": "br-int", "label": "tempest-device-tagging-net1-527368946", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e024f5a578e4543a02c6adc7d456f39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23214923-02", "ovs_interfaceid": "23214923-0217-4046-9a68-675f2ee8e42d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71509) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-c5f92253-36a7-4e58-ab43-a926cfd06402 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Converting VIF {"id": "23214923-0217-4046-9a68-675f2ee8e42d", "address": "fa:16:3e:8a:5a:1a", "network": {"id": "bb8c5688-db8f-47c0-a2b5-0a44d2f97461", "bridge": "br-int", "label": "tempest-device-tagging-net1-527368946", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e024f5a578e4543a02c6adc7d456f39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23214923-02", "ovs_interfaceid": "23214923-0217-4046-9a68-675f2ee8e42d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-c5f92253-36a7-4e58-ab43-a926cfd06402 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:5a:1a,bridge_name='br-int',has_traffic_filtering=True,id=23214923-0217-4046-9a68-675f2ee8e42d,network=Network(bb8c5688-db8f-47c0-a2b5-0a44d2f97461),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap23214923-02') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG os_vif [None req-c5f92253-36a7-4e58-ab43-a926cfd06402 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:5a:1a,bridge_name='br-int',has_traffic_filtering=True,id=23214923-0217-4046-9a68-675f2ee8e42d,network=Network(bb8c5688-db8f-47c0-a2b5-0a44d2f97461),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap23214923-02') {{(pid=71509) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap23214923-02, bridge=br-int, if_exists=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:52 user nova-compute[71509]: INFO os_vif [None req-c5f92253-36a7-4e58-ab43-a926cfd06402 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:5a:1a,bridge_name='br-int',has_traffic_filtering=True,id=23214923-0217-4046-9a68-675f2ee8e42d,network=Network(bb8c5688-db8f-47c0-a2b5-0a44d2f97461),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap23214923-02')
Apr 14 10:45:52 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-c5f92253-36a7-4e58-ab43-a926cfd06402 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T10:43:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1636555058',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1636555058',id=12,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFiuA4lBJVtYfiy/p87uKYDDoanpcxZLwOKehEbraw8DqN/tSzDkhXnQCUYZYSydWf6HuXl2lM5q4KKhfjVIPIOpfWr+UnggY0Ln4rrMx5Z5ebIqfaJVvJquUpb7gfFk/w==',key_name='tempest-keypair-1957800049',keypairs=<?>,launch_index=0,launched_at=2023-04-14T10:44:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0e024f5a578e4543a02c6adc7d456f39',ramdisk_id='',reservation_id='r-rufirbfe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-656117710',owner_user_name='tempest-TaggedBootDevicesTest-656117710-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T10:44:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f6dac34303f4965babaee39bb363b5e',uuid=d1516acc-354e-41f6-a639-61dea870b11e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7f7db929-b2fd-4242-9d23-5d58a374f961", "address": "fa:16:3e:28:88:b4", "network": {"id": "bb8c5688-db8f-47c0-a2b5-0a44d2f97461", "bridge": "br-int", "label": "tempest-device-tagging-net1-527368946", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e024f5a578e4543a02c6adc7d456f39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f7db929-b2", "ovs_interfaceid": "7f7db929-b2fd-4242-9d23-5d58a374f961", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71509) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-c5f92253-36a7-4e58-ab43-a926cfd06402 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Converting VIF {"id": "7f7db929-b2fd-4242-9d23-5d58a374f961", "address": "fa:16:3e:28:88:b4", "network": {"id": "bb8c5688-db8f-47c0-a2b5-0a44d2f97461", "bridge": "br-int", "label": "tempest-device-tagging-net1-527368946", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e024f5a578e4543a02c6adc7d456f39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f7db929-b2", "ovs_interfaceid": "7f7db929-b2fd-4242-9d23-5d58a374f961", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-c5f92253-36a7-4e58-ab43-a926cfd06402 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:88:b4,bridge_name='br-int',has_traffic_filtering=True,id=7f7db929-b2fd-4242-9d23-5d58a374f961,network=Network(bb8c5688-db8f-47c0-a2b5-0a44d2f97461),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7f7db929-b2') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG os_vif [None req-c5f92253-36a7-4e58-ab43-a926cfd06402 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:88:b4,bridge_name='br-int',has_traffic_filtering=True,id=7f7db929-b2fd-4242-9d23-5d58a374f961,network=Network(bb8c5688-db8f-47c0-a2b5-0a44d2f97461),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7f7db929-b2') {{(pid=71509) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7f7db929-b2, bridge=br-int, if_exists=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:52 user nova-compute[71509]: INFO os_vif [None req-c5f92253-36a7-4e58-ab43-a926cfd06402 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:88:b4,bridge_name='br-int',has_traffic_filtering=True,id=7f7db929-b2fd-4242-9d23-5d58a374f961,network=Network(bb8c5688-db8f-47c0-a2b5-0a44d2f97461),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7f7db929-b2')
Apr 14 10:45:52 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-c5f92253-36a7-4e58-ab43-a926cfd06402 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T10:43:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1636555058',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1636555058',id=12,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFiuA4lBJVtYfiy/p87uKYDDoanpcxZLwOKehEbraw8DqN/tSzDkhXnQCUYZYSydWf6HuXl2lM5q4KKhfjVIPIOpfWr+UnggY0Ln4rrMx5Z5ebIqfaJVvJquUpb7gfFk/w==',key_name='tempest-keypair-1957800049',keypairs=<?>,launch_index=0,launched_at=2023-04-14T10:44:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0e024f5a578e4543a02c6adc7d456f39',ramdisk_id='',reservation_id='r-rufirbfe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-656117710',owner_user_name='tempest-TaggedBootDevicesTest-656117710-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T10:44:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f6dac34303f4965babaee39bb363b5e',uuid=d1516acc-354e-41f6-a639-61dea870b11e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4d65e4a1-4cea-4636-8ad8-21065de3c747", "address": "fa:16:3e:c2:1b:8c", "network": {"id": "bb8c5688-db8f-47c0-a2b5-0a44d2f97461", "bridge": "br-int", "label": "tempest-device-tagging-net1-527368946", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e024f5a578e4543a02c6adc7d456f39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d65e4a1-4c", "ovs_interfaceid": "4d65e4a1-4cea-4636-8ad8-21065de3c747", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-c5f92253-36a7-4e58-ab43-a926cfd06402 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Converting VIF {"id": "4d65e4a1-4cea-4636-8ad8-21065de3c747", "address": "fa:16:3e:c2:1b:8c", "network": {"id": "bb8c5688-db8f-47c0-a2b5-0a44d2f97461", "bridge": "br-int", "label": "tempest-device-tagging-net1-527368946", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e024f5a578e4543a02c6adc7d456f39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d65e4a1-4c", "ovs_interfaceid": "4d65e4a1-4cea-4636-8ad8-21065de3c747", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-c5f92253-36a7-4e58-ab43-a926cfd06402 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:1b:8c,bridge_name='br-int',has_traffic_filtering=True,id=4d65e4a1-4cea-4636-8ad8-21065de3c747,network=Network(bb8c5688-db8f-47c0-a2b5-0a44d2f97461),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d65e4a1-4c') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG os_vif [None req-c5f92253-36a7-4e58-ab43-a926cfd06402 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:1b:8c,bridge_name='br-int',has_traffic_filtering=True,id=4d65e4a1-4cea-4636-8ad8-21065de3c747,network=Network(bb8c5688-db8f-47c0-a2b5-0a44d2f97461),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d65e4a1-4c') {{(pid=71509) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4d65e4a1-4c, bridge=br-int, if_exists=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:52 user nova-compute[71509]: INFO os_vif [None req-c5f92253-36a7-4e58-ab43-a926cfd06402 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:1b:8c,bridge_name='br-int',has_traffic_filtering=True,id=4d65e4a1-4cea-4636-8ad8-21065de3c747,network=Network(bb8c5688-db8f-47c0-a2b5-0a44d2f97461),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d65e4a1-4c')
Apr 14 10:45:52 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-c5f92253-36a7-4e58-ab43-a926cfd06402 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T10:43:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1636555058',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1636555058',id=12,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFiuA4lBJVtYfiy/p87uKYDDoanpcxZLwOKehEbraw8DqN/tSzDkhXnQCUYZYSydWf6HuXl2lM5q4KKhfjVIPIOpfWr+UnggY0Ln4rrMx5Z5ebIqfaJVvJquUpb7gfFk/w==',key_name='tempest-keypair-1957800049',keypairs=<?>,launch_index=0,launched_at=2023-04-14T10:44:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0e024f5a578e4543a02c6adc7d456f39',ramdisk_id='',reservation_id='r-rufirbfe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-656117710',owner_user_name='tempest-TaggedBootDevicesTest-656117710-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T10:44:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f6dac34303f4965babaee39bb363b5e',uuid=d1516acc-354e-41f6-a639-61dea870b11e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d70f6f4d-f2bc-4d5e-9e98-a0daa1b35a0f", "address": "fa:16:3e:64:ce:c5", "network": {"id": "bb8c5688-db8f-47c0-a2b5-0a44d2f97461", "bridge": "br-int", "label": "tempest-device-tagging-net1-527368946", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e024f5a578e4543a02c6adc7d456f39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd70f6f4d-f2", "ovs_interfaceid": "d70f6f4d-f2bc-4d5e-9e98-a0daa1b35a0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-c5f92253-36a7-4e58-ab43-a926cfd06402 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Converting VIF {"id": "d70f6f4d-f2bc-4d5e-9e98-a0daa1b35a0f", "address": "fa:16:3e:64:ce:c5", "network": {"id": "bb8c5688-db8f-47c0-a2b5-0a44d2f97461", "bridge": "br-int", "label": "tempest-device-tagging-net1-527368946", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e024f5a578e4543a02c6adc7d456f39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd70f6f4d-f2", "ovs_interfaceid": "d70f6f4d-f2bc-4d5e-9e98-a0daa1b35a0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-c5f92253-36a7-4e58-ab43-a926cfd06402 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:ce:c5,bridge_name='br-int',has_traffic_filtering=True,id=d70f6f4d-f2bc-4d5e-9e98-a0daa1b35a0f,network=Network(bb8c5688-db8f-47c0-a2b5-0a44d2f97461),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd70f6f4d-f2') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG os_vif [None req-c5f92253-36a7-4e58-ab43-a926cfd06402 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:ce:c5,bridge_name='br-int',has_traffic_filtering=True,id=d70f6f4d-f2bc-4d5e-9e98-a0daa1b35a0f,network=Network(bb8c5688-db8f-47c0-a2b5-0a44d2f97461),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd70f6f4d-f2') {{(pid=71509) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd70f6f4d-f2, bridge=br-int, if_exists=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:52 user nova-compute[71509]: INFO os_vif [None req-c5f92253-36a7-4e58-ab43-a926cfd06402 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:ce:c5,bridge_name='br-int',has_traffic_filtering=True,id=d70f6f4d-f2bc-4d5e-9e98-a0daa1b35a0f,network=Network(bb8c5688-db8f-47c0-a2b5-0a44d2f97461),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd70f6f4d-f2')
Apr 14 10:45:52 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-c5f92253-36a7-4e58-ab43-a926cfd06402 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T10:43:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1636555058',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1636555058',id=12,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFiuA4lBJVtYfiy/p87uKYDDoanpcxZLwOKehEbraw8DqN/tSzDkhXnQCUYZYSydWf6HuXl2lM5q4KKhfjVIPIOpfWr+UnggY0Ln4rrMx5Z5ebIqfaJVvJquUpb7gfFk/w==',key_name='tempest-keypair-1957800049',keypairs=<?>,launch_index=0,launched_at=2023-04-14T10:44:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0e024f5a578e4543a02c6adc7d456f39',ramdisk_id='',reservation_id='r-rufirbfe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-656117710',owner_user_name='tempest-TaggedBootDevicesTest-656117710-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T10:44:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f6dac34303f4965babaee39bb363b5e',uuid=d1516acc-354e-41f6-a639-61dea870b11e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "328d2b64-7bc6-425a-b3a4-8cda754ffd56", "address": "fa:16:3e:a6:55:10", "network": {"id": "1c6521c7-7280-4952-b1bc-a3aa0918e27c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1095863542", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e024f5a578e4543a02c6adc7d456f39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap328d2b64-7b", "ovs_interfaceid": "328d2b64-7bc6-425a-b3a4-8cda754ffd56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-c5f92253-36a7-4e58-ab43-a926cfd06402 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Converting VIF {"id": "328d2b64-7bc6-425a-b3a4-8cda754ffd56", "address": "fa:16:3e:a6:55:10", "network": {"id": "1c6521c7-7280-4952-b1bc-a3aa0918e27c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1095863542", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e024f5a578e4543a02c6adc7d456f39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap328d2b64-7b", "ovs_interfaceid": "328d2b64-7bc6-425a-b3a4-8cda754ffd56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-c5f92253-36a7-4e58-ab43-a926cfd06402 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:55:10,bridge_name='br-int',has_traffic_filtering=True,id=328d2b64-7bc6-425a-b3a4-8cda754ffd56,network=Network(1c6521c7-7280-4952-b1bc-a3aa0918e27c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap328d2b64-7b') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG os_vif [None req-c5f92253-36a7-4e58-ab43-a926cfd06402 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:55:10,bridge_name='br-int',has_traffic_filtering=True,id=328d2b64-7bc6-425a-b3a4-8cda754ffd56,network=Network(1c6521c7-7280-4952-b1bc-a3aa0918e27c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap328d2b64-7b') {{(pid=71509) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap328d2b64-7b, bridge=br-int, if_exists=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:52 user nova-compute[71509]: INFO os_vif [None req-c5f92253-36a7-4e58-ab43-a926cfd06402 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:55:10,bridge_name='br-int',has_traffic_filtering=True,id=328d2b64-7bc6-425a-b3a4-8cda754ffd56,network=Network(1c6521c7-7280-4952-b1bc-a3aa0918e27c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap328d2b64-7b')
Apr 14 10:45:52 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-c5f92253-36a7-4e58-ab43-a926cfd06402 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T10:43:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1636555058',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1636555058',id=12,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFiuA4lBJVtYfiy/p87uKYDDoanpcxZLwOKehEbraw8DqN/tSzDkhXnQCUYZYSydWf6HuXl2lM5q4KKhfjVIPIOpfWr+UnggY0Ln4rrMx5Z5ebIqfaJVvJquUpb7gfFk/w==',key_name='tempest-keypair-1957800049',keypairs=<?>,launch_index=0,launched_at=2023-04-14T10:44:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0e024f5a578e4543a02c6adc7d456f39',ramdisk_id='',reservation_id='r-rufirbfe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-656117710',owner_user_name='tempest-TaggedBootDevicesTest-656117710-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T10:44:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f6dac34303f4965babaee39bb363b5e',uuid=d1516acc-354e-41f6-a639-61dea870b11e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6e295a29-0297-49c0-9298-7d3a41a07585", "address": "fa:16:3e:32:10:a4", "network": {"id": "1c6521c7-7280-4952-b1bc-a3aa0918e27c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1095863542", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e024f5a578e4543a02c6adc7d456f39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e295a29-02", "ovs_interfaceid": "6e295a29-0297-49c0-9298-7d3a41a07585", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-c5f92253-36a7-4e58-ab43-a926cfd06402 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Converting VIF {"id": "6e295a29-0297-49c0-9298-7d3a41a07585", "address": "fa:16:3e:32:10:a4", "network": {"id": "1c6521c7-7280-4952-b1bc-a3aa0918e27c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1095863542", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e024f5a578e4543a02c6adc7d456f39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e295a29-02", "ovs_interfaceid": "6e295a29-0297-49c0-9298-7d3a41a07585", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-c5f92253-36a7-4e58-ab43-a926cfd06402 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:10:a4,bridge_name='br-int',has_traffic_filtering=True,id=6e295a29-0297-49c0-9298-7d3a41a07585,network=Network(1c6521c7-7280-4952-b1bc-a3aa0918e27c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e295a29-02') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG os_vif [None req-c5f92253-36a7-4e58-ab43-a926cfd06402 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:10:a4,bridge_name='br-int',has_traffic_filtering=True,id=6e295a29-0297-49c0-9298-7d3a41a07585,network=Network(1c6521c7-7280-4952-b1bc-a3aa0918e27c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e295a29-02') {{(pid=71509) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6e295a29-02, bridge=br-int, if_exists=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:52 user nova-compute[71509]: INFO os_vif [None req-c5f92253-36a7-4e58-ab43-a926cfd06402 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:10:a4,bridge_name='br-int',has_traffic_filtering=True,id=6e295a29-0297-49c0-9298-7d3a41a07585,network=Network(1c6521c7-7280-4952-b1bc-a3aa0918e27c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e295a29-02')
Apr 14 10:45:52 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5f92253-36a7-4e58-ab43-a926cfd06402 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] [instance: d1516acc-354e-41f6-a639-61dea870b11e] calling os-brick to detach iSCSI Volume {{(pid=71509) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f92253-36a7-4e58-ab43-a926cfd06402 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0bf0749390>, {'target_iqn': 'iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OTvmgYce', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 10:45:52 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-c5f92253-36a7-4e58-ab43-a926cfd06402 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 10:45:52 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-c5f92253-36a7-4e58-ab43-a926cfd06402 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-c5f92253-36a7-4e58-ab43-a926cfd06402 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[034b52ac-ab7d-4c04-9913-e4e8a437a3e5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f92253-36a7-4e58-ab43-a926cfd06402 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 10:45:52 user nova-compute[71509]: No targets found.
Apr 14 10:45:52 user nova-compute[71509]: iSNS:
Apr 14 10:45:52 user nova-compute[71509]: No targets found.
Apr 14 10:45:52 user nova-compute[71509]: STATIC:
Apr 14 10:45:52 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171
Apr 14 10:45:52 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:45:52 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:45:52 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e
Apr 14 10:45:52 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:45:52 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:45:52 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700
Apr 14 10:45:52 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:45:52 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:45:52 user nova-compute[71509]: FIRMWARE:
Apr 14 10:45:52 user nova-compute[71509]: No targets found.
Apr 14 10:45:52 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f92253-36a7-4e58-ab43-a926cfd06402 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 10:45:52 user nova-compute[71509]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 10:45:52 user nova-compute[71509]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71509) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f92253-36a7-4e58-ab43-a926cfd06402 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700', 0)] {{(pid=71509) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3d9265f-f05a-4569-b972-5c6ac028d928]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[0816ee5d-4d48-4782-8d01-f615b4fdf294]: (4, ('tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f92253-36a7-4e58-ab43-a926cfd06402 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700 (non-flash)
Apr 14 10:45:52 user nova-compute[71509]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171 (non-flash)
Apr 14 10:45:52 user nova-compute[71509]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e (non-flash)
Apr 14 10:45:52 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f92253-36a7-4e58-ab43-a926cfd06402 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] iscsi session list stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700 (non-flash)
Apr 14 10:45:52 user nova-compute[71509]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171 (non-flash)
Apr 14 10:45:52 user nova-compute[71509]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e (non-flash)
Apr 14 10:45:52 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f92253-36a7-4e58-ab43-a926cfd06402 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0c2c3d2b90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700'): ({'sde'}, set())}) {{(pid=71509) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-c5f92253-36a7-4e58-ab43-a926cfd06402 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Removing single pathed devices sde {{(pid=71509) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7db4f4a-07be-487f-8160-d69d0a78c29f]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1440908-28e9-47ed-a87b-4a24bcf107f0]: (4, ('ok\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-c5f92253-36a7-4e58-ab43-a926cfd06402 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Flushing IO for device /dev/sde {{(pid=71509) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eee2ee2-353d-466b-879a-a57a4f70ab92]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-c5f92253-36a7-4e58-ab43-a926cfd06402 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71509) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG nova.compute.manager [req-f75f21e1-fa82-4c03-9eb6-ee58fa9708be req-fb9384ef-3c72-437c-b2fb-1cf583837e5b service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Received event network-vif-plugged-23214923-0217-4046-9a68-675f2ee8e42d {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-f75f21e1-fa82-4c03-9eb6-ee58fa9708be req-fb9384ef-3c72-437c-b2fb-1cf583837e5b service nova] Acquiring lock "d1516acc-354e-41f6-a639-61dea870b11e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-f75f21e1-fa82-4c03-9eb6-ee58fa9708be req-fb9384ef-3c72-437c-b2fb-1cf583837e5b service nova] Lock "d1516acc-354e-41f6-a639-61dea870b11e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-f75f21e1-fa82-4c03-9eb6-ee58fa9708be req-fb9384ef-3c72-437c-b2fb-1cf583837e5b service nova] Lock "d1516acc-354e-41f6-a639-61dea870b11e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG nova.compute.manager [req-f75f21e1-fa82-4c03-9eb6-ee58fa9708be req-fb9384ef-3c72-437c-b2fb-1cf583837e5b service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] No waiting events found dispatching network-vif-plugged-23214923-0217-4046-9a68-675f2ee8e42d {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:45:52 user nova-compute[71509]: WARNING nova.compute.manager [req-f75f21e1-fa82-4c03-9eb6-ee58fa9708be req-fb9384ef-3c72-437c-b2fb-1cf583837e5b service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Received unexpected event network-vif-plugged-23214923-0217-4046-9a68-675f2ee8e42d for instance with vm_state active and task_state deleting.
Apr 14 10:45:52 user nova-compute[71509]: DEBUG nova.compute.manager [req-f75f21e1-fa82-4c03-9eb6-ee58fa9708be req-fb9384ef-3c72-437c-b2fb-1cf583837e5b service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Received event network-vif-unplugged-4d65e4a1-4cea-4636-8ad8-21065de3c747 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-f75f21e1-fa82-4c03-9eb6-ee58fa9708be req-fb9384ef-3c72-437c-b2fb-1cf583837e5b service nova] Acquiring lock "d1516acc-354e-41f6-a639-61dea870b11e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-f75f21e1-fa82-4c03-9eb6-ee58fa9708be req-fb9384ef-3c72-437c-b2fb-1cf583837e5b service nova] Lock "d1516acc-354e-41f6-a639-61dea870b11e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-f75f21e1-fa82-4c03-9eb6-ee58fa9708be req-fb9384ef-3c72-437c-b2fb-1cf583837e5b service nova] Lock "d1516acc-354e-41f6-a639-61dea870b11e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG nova.compute.manager [req-f75f21e1-fa82-4c03-9eb6-ee58fa9708be req-fb9384ef-3c72-437c-b2fb-1cf583837e5b service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] No waiting events found dispatching network-vif-unplugged-4d65e4a1-4cea-4636-8ad8-21065de3c747 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG nova.compute.manager [req-f75f21e1-fa82-4c03-9eb6-ee58fa9708be req-fb9384ef-3c72-437c-b2fb-1cf583837e5b service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Received event network-vif-unplugged-4d65e4a1-4cea-4636-8ad8-21065de3c747 for instance with task_state deleting. {{(pid=71509) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG nova.compute.manager [req-f75f21e1-fa82-4c03-9eb6-ee58fa9708be req-fb9384ef-3c72-437c-b2fb-1cf583837e5b service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Received event network-vif-plugged-4d65e4a1-4cea-4636-8ad8-21065de3c747 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-f75f21e1-fa82-4c03-9eb6-ee58fa9708be req-fb9384ef-3c72-437c-b2fb-1cf583837e5b service nova] Acquiring lock "d1516acc-354e-41f6-a639-61dea870b11e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-f75f21e1-fa82-4c03-9eb6-ee58fa9708be req-fb9384ef-3c72-437c-b2fb-1cf583837e5b service nova] Lock "d1516acc-354e-41f6-a639-61dea870b11e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-f75f21e1-fa82-4c03-9eb6-ee58fa9708be req-fb9384ef-3c72-437c-b2fb-1cf583837e5b service nova] Lock "d1516acc-354e-41f6-a639-61dea870b11e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG nova.compute.manager [req-f75f21e1-fa82-4c03-9eb6-ee58fa9708be req-fb9384ef-3c72-437c-b2fb-1cf583837e5b service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] No waiting events found dispatching network-vif-plugged-4d65e4a1-4cea-4636-8ad8-21065de3c747 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:45:52 user nova-compute[71509]: WARNING nova.compute.manager [req-f75f21e1-fa82-4c03-9eb6-ee58fa9708be req-fb9384ef-3c72-437c-b2fb-1cf583837e5b service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Received unexpected event network-vif-plugged-4d65e4a1-4cea-4636-8ad8-21065de3c747 for instance with vm_state active and task_state deleting.
Apr 14 10:45:52 user nova-compute[71509]: DEBUG nova.compute.manager [req-f75f21e1-fa82-4c03-9eb6-ee58fa9708be req-fb9384ef-3c72-437c-b2fb-1cf583837e5b service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Received event network-vif-unplugged-d70f6f4d-f2bc-4d5e-9e98-a0daa1b35a0f {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-f75f21e1-fa82-4c03-9eb6-ee58fa9708be req-fb9384ef-3c72-437c-b2fb-1cf583837e5b service nova] Acquiring lock "d1516acc-354e-41f6-a639-61dea870b11e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-f75f21e1-fa82-4c03-9eb6-ee58fa9708be req-fb9384ef-3c72-437c-b2fb-1cf583837e5b service nova] Lock "d1516acc-354e-41f6-a639-61dea870b11e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-f75f21e1-fa82-4c03-9eb6-ee58fa9708be req-fb9384ef-3c72-437c-b2fb-1cf583837e5b service nova] Lock "d1516acc-354e-41f6-a639-61dea870b11e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG nova.compute.manager [req-f75f21e1-fa82-4c03-9eb6-ee58fa9708be req-fb9384ef-3c72-437c-b2fb-1cf583837e5b service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] No waiting events found dispatching network-vif-unplugged-d70f6f4d-f2bc-4d5e-9e98-a0daa1b35a0f {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG nova.compute.manager [req-f75f21e1-fa82-4c03-9eb6-ee58fa9708be req-fb9384ef-3c72-437c-b2fb-1cf583837e5b service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Received event network-vif-unplugged-d70f6f4d-f2bc-4d5e-9e98-a0daa1b35a0f for instance with task_state deleting. {{(pid=71509) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG nova.compute.manager [req-f75f21e1-fa82-4c03-9eb6-ee58fa9708be req-fb9384ef-3c72-437c-b2fb-1cf583837e5b service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Received event network-vif-plugged-d70f6f4d-f2bc-4d5e-9e98-a0daa1b35a0f {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-f75f21e1-fa82-4c03-9eb6-ee58fa9708be req-fb9384ef-3c72-437c-b2fb-1cf583837e5b service nova] Acquiring lock "d1516acc-354e-41f6-a639-61dea870b11e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-f75f21e1-fa82-4c03-9eb6-ee58fa9708be req-fb9384ef-3c72-437c-b2fb-1cf583837e5b service nova] Lock "d1516acc-354e-41f6-a639-61dea870b11e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-f75f21e1-fa82-4c03-9eb6-ee58fa9708be req-fb9384ef-3c72-437c-b2fb-1cf583837e5b service nova] Lock "d1516acc-354e-41f6-a639-61dea870b11e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG nova.compute.manager [req-f75f21e1-fa82-4c03-9eb6-ee58fa9708be req-fb9384ef-3c72-437c-b2fb-1cf583837e5b service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] No waiting events found dispatching network-vif-plugged-d70f6f4d-f2bc-4d5e-9e98-a0daa1b35a0f {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:45:52 user nova-compute[71509]: WARNING nova.compute.manager [req-f75f21e1-fa82-4c03-9eb6-ee58fa9708be req-fb9384ef-3c72-437c-b2fb-1cf583837e5b service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Received unexpected event network-vif-plugged-d70f6f4d-f2bc-4d5e-9e98-a0daa1b35a0f for instance with vm_state active and task_state deleting.
Apr 14 10:45:52 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.053s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc95152e-98a9-448f-99b2-e597b833180a]: (4, ('1', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-c5f92253-36a7-4e58-ab43-a926cfd06402 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71509) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-c5f92253-36a7-4e58-ab43-a926cfd06402 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] SCSI volumes sde have been removed. {{(pid=71509) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f92253-36a7-4e58-ab43-a926cfd06402 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700')] {{(pid=71509) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[42bd738e-9bc1-4f67-b147-c044a7cf3712]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f92253-36a7-4e58-ab43-a926cfd06402 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700 -p 172.16.0.220:3260 --logout {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG nova.objects.instance [None req-d3a211ee-d9fc-4ac2-a500-c569a793db37 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Lazy-loading 'flavor' on Instance uuid d6f539d8-4144-467b-ac69-44011c5b3564 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[80e2a87b-4a86-4890-b320-e54d13131ab0]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f92253-36a7-4e58-ab43-a926cfd06402 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700, portal: 172.16.0.220,3260]
Apr 14 10:45:52 user nova-compute[71509]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700, portal: 172.16.0.220,3260] successful.
Apr 14 10:45:52 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700 -p 172.16.0.220:3260 --op delete {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:146f2d89-f831-40b0-a5cd-75a2761fb700 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[718a4e9d-f402-4374-bb8e-54aaa0fdee73]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f92253-36a7-4e58-ab43-a926cfd06402 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-c5f92253-36a7-4e58-ab43-a926cfd06402 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.380s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f92253-36a7-4e58-ab43-a926cfd06402 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] <== disconnect_volume: return (381ms) None {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5f92253-36a7-4e58-ab43-a926cfd06402 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Disconnected iSCSI Volume {{(pid=71509) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5f92253-36a7-4e58-ab43-a926cfd06402 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] [instance: d1516acc-354e-41f6-a639-61dea870b11e] calling os-brick to detach iSCSI Volume {{(pid=71509) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f92253-36a7-4e58-ab43-a926cfd06402 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0bf0749390>, {'target_iqn': 'iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sRGbgDXN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg': {}}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 10:45:52 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-c5f92253-36a7-4e58-ab43-a926cfd06402 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 10:45:52 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-c5f92253-36a7-4e58-ab43-a926cfd06402 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-c5f92253-36a7-4e58-ab43-a926cfd06402 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[30fd003b-58cc-4f80-b681-1572de80e49d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f92253-36a7-4e58-ab43-a926cfd06402 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 10:45:52 user nova-compute[71509]: No targets found.
Apr 14 10:45:52 user nova-compute[71509]: iSNS:
Apr 14 10:45:52 user nova-compute[71509]: No targets found.
Apr 14 10:45:52 user nova-compute[71509]: STATIC:
Apr 14 10:45:52 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171
Apr 14 10:45:52 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:45:52 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:45:52 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e
Apr 14 10:45:52 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:45:52 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:45:52 user nova-compute[71509]: FIRMWARE:
Apr 14 10:45:52 user nova-compute[71509]: No targets found.
Apr 14 10:45:52 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f92253-36a7-4e58-ab43-a926cfd06402 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 10:45:52 user nova-compute[71509]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 10:45:52 user nova-compute[71509]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71509) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f92253-36a7-4e58-ab43-a926cfd06402 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171', 0)] {{(pid=71509) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-d3a211ee-d9fc-4ac2-a500-c569a793db37 tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Lock "d6f539d8-4144-467b-ac69-44011c5b3564" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.513s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG nova.compute.manager [req-2981509d-9713-49b6-86a1-0cfdf3f345ff req-a41049f1-8d72-4fcf-92db-c67816420bb9 service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Received event network-vif-plugged-2a2ef05a-2d58-4cdf-ab6c-35df823a68bc {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-2981509d-9713-49b6-86a1-0cfdf3f345ff req-a41049f1-8d72-4fcf-92db-c67816420bb9 service nova] Acquiring lock "d1516acc-354e-41f6-a639-61dea870b11e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-2981509d-9713-49b6-86a1-0cfdf3f345ff req-a41049f1-8d72-4fcf-92db-c67816420bb9 service nova] Lock "d1516acc-354e-41f6-a639-61dea870b11e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-2981509d-9713-49b6-86a1-0cfdf3f345ff req-a41049f1-8d72-4fcf-92db-c67816420bb9 service nova] Lock "d1516acc-354e-41f6-a639-61dea870b11e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG nova.compute.manager [req-2981509d-9713-49b6-86a1-0cfdf3f345ff req-a41049f1-8d72-4fcf-92db-c67816420bb9 service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] No waiting events found dispatching network-vif-plugged-2a2ef05a-2d58-4cdf-ab6c-35df823a68bc {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:45:52 user nova-compute[71509]: WARNING nova.compute.manager [req-2981509d-9713-49b6-86a1-0cfdf3f345ff req-a41049f1-8d72-4fcf-92db-c67816420bb9 service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Received unexpected event network-vif-plugged-2a2ef05a-2d58-4cdf-ab6c-35df823a68bc for instance with vm_state active and task_state deleting.
Apr 14 10:45:52 user nova-compute[71509]: DEBUG nova.compute.manager [req-2981509d-9713-49b6-86a1-0cfdf3f345ff req-a41049f1-8d72-4fcf-92db-c67816420bb9 service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Received event network-vif-unplugged-7f7db929-b2fd-4242-9d23-5d58a374f961 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-2981509d-9713-49b6-86a1-0cfdf3f345ff req-a41049f1-8d72-4fcf-92db-c67816420bb9 service nova] Acquiring lock "d1516acc-354e-41f6-a639-61dea870b11e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-2981509d-9713-49b6-86a1-0cfdf3f345ff req-a41049f1-8d72-4fcf-92db-c67816420bb9 service nova] Lock "d1516acc-354e-41f6-a639-61dea870b11e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-2981509d-9713-49b6-86a1-0cfdf3f345ff req-a41049f1-8d72-4fcf-92db-c67816420bb9 service nova] Lock "d1516acc-354e-41f6-a639-61dea870b11e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG nova.compute.manager [req-2981509d-9713-49b6-86a1-0cfdf3f345ff req-a41049f1-8d72-4fcf-92db-c67816420bb9 service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] No waiting events found dispatching network-vif-unplugged-7f7db929-b2fd-4242-9d23-5d58a374f961 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG nova.compute.manager [req-2981509d-9713-49b6-86a1-0cfdf3f345ff req-a41049f1-8d72-4fcf-92db-c67816420bb9 service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Received event network-vif-unplugged-7f7db929-b2fd-4242-9d23-5d58a374f961 for instance with task_state deleting. {{(pid=71509) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG nova.compute.manager [req-2981509d-9713-49b6-86a1-0cfdf3f345ff req-a41049f1-8d72-4fcf-92db-c67816420bb9 service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Received event network-vif-plugged-7f7db929-b2fd-4242-9d23-5d58a374f961 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-2981509d-9713-49b6-86a1-0cfdf3f345ff req-a41049f1-8d72-4fcf-92db-c67816420bb9 service nova] Acquiring lock "d1516acc-354e-41f6-a639-61dea870b11e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-2981509d-9713-49b6-86a1-0cfdf3f345ff req-a41049f1-8d72-4fcf-92db-c67816420bb9 service nova] Lock "d1516acc-354e-41f6-a639-61dea870b11e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-2981509d-9713-49b6-86a1-0cfdf3f345ff req-a41049f1-8d72-4fcf-92db-c67816420bb9 service nova] Lock "d1516acc-354e-41f6-a639-61dea870b11e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG nova.compute.manager [req-2981509d-9713-49b6-86a1-0cfdf3f345ff req-a41049f1-8d72-4fcf-92db-c67816420bb9 service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] No waiting events found dispatching network-vif-plugged-7f7db929-b2fd-4242-9d23-5d58a374f961 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:45:52 user nova-compute[71509]: WARNING nova.compute.manager [req-2981509d-9713-49b6-86a1-0cfdf3f345ff req-a41049f1-8d72-4fcf-92db-c67816420bb9 service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Received unexpected event network-vif-plugged-7f7db929-b2fd-4242-9d23-5d58a374f961 for instance with vm_state active and task_state deleting.
Apr 14 10:45:52 user nova-compute[71509]: DEBUG nova.compute.manager [req-2981509d-9713-49b6-86a1-0cfdf3f345ff req-a41049f1-8d72-4fcf-92db-c67816420bb9 service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Received event network-vif-unplugged-328d2b64-7bc6-425a-b3a4-8cda754ffd56 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-2981509d-9713-49b6-86a1-0cfdf3f345ff req-a41049f1-8d72-4fcf-92db-c67816420bb9 service nova] Acquiring lock "d1516acc-354e-41f6-a639-61dea870b11e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-2981509d-9713-49b6-86a1-0cfdf3f345ff req-a41049f1-8d72-4fcf-92db-c67816420bb9 service nova] Lock "d1516acc-354e-41f6-a639-61dea870b11e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-2981509d-9713-49b6-86a1-0cfdf3f345ff req-a41049f1-8d72-4fcf-92db-c67816420bb9 service nova] Lock "d1516acc-354e-41f6-a639-61dea870b11e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG nova.compute.manager [req-2981509d-9713-49b6-86a1-0cfdf3f345ff req-a41049f1-8d72-4fcf-92db-c67816420bb9 service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] No waiting events found dispatching network-vif-unplugged-328d2b64-7bc6-425a-b3a4-8cda754ffd56 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG nova.compute.manager [req-2981509d-9713-49b6-86a1-0cfdf3f345ff req-a41049f1-8d72-4fcf-92db-c67816420bb9 service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Received event network-vif-unplugged-328d2b64-7bc6-425a-b3a4-8cda754ffd56 for instance with task_state deleting. {{(pid=71509) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG nova.compute.manager [req-2981509d-9713-49b6-86a1-0cfdf3f345ff req-a41049f1-8d72-4fcf-92db-c67816420bb9 service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Received event network-vif-plugged-328d2b64-7bc6-425a-b3a4-8cda754ffd56 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-2981509d-9713-49b6-86a1-0cfdf3f345ff req-a41049f1-8d72-4fcf-92db-c67816420bb9 service nova] Acquiring lock "d1516acc-354e-41f6-a639-61dea870b11e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-2981509d-9713-49b6-86a1-0cfdf3f345ff req-a41049f1-8d72-4fcf-92db-c67816420bb9 service nova] Lock "d1516acc-354e-41f6-a639-61dea870b11e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-2981509d-9713-49b6-86a1-0cfdf3f345ff req-a41049f1-8d72-4fcf-92db-c67816420bb9 service nova] Lock "d1516acc-354e-41f6-a639-61dea870b11e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG nova.compute.manager [req-2981509d-9713-49b6-86a1-0cfdf3f345ff req-a41049f1-8d72-4fcf-92db-c67816420bb9 service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] No waiting events found dispatching network-vif-plugged-328d2b64-7bc6-425a-b3a4-8cda754ffd56 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:45:52 user nova-compute[71509]: WARNING nova.compute.manager [req-2981509d-9713-49b6-86a1-0cfdf3f345ff req-a41049f1-8d72-4fcf-92db-c67816420bb9 service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Received unexpected event network-vif-plugged-328d2b64-7bc6-425a-b3a4-8cda754ffd56 for instance with vm_state active and task_state deleting.
Apr 14 10:45:52 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[817a2a3a-47d0-48a5-b7ba-5d78a720769b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b54a255-bf9d-470c-bedb-770f6e4c9c4a]: (4, ('tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f92253-36a7-4e58-ab43-a926cfd06402 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171 (non-flash)
Apr 14 10:45:52 user nova-compute[71509]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e (non-flash)
Apr 14 10:45:52 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f92253-36a7-4e58-ab43-a926cfd06402 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] iscsi session list stdout=tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171 (non-flash)
Apr 14 10:45:52 user nova-compute[71509]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e (non-flash)
Apr 14 10:45:52 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f92253-36a7-4e58-ab43-a926cfd06402 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0c3a75c280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171'): ({'sdg'}, set())}) {{(pid=71509) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-c5f92253-36a7-4e58-ab43-a926cfd06402 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Removing single pathed devices sdg {{(pid=71509) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[41ab6f23-2ef2-4c80-b2df-f1b65452a21f]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.020s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[587b2058-cd9f-47db-af39-ed5df7d1f029]: (4, ('ok\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-c5f92253-36a7-4e58-ab43-a926cfd06402 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Flushing IO for device /dev/sdg {{(pid=71509) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.017s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f377f26-51ef-4237-9194-1c7470b5e298]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-c5f92253-36a7-4e58-ab43-a926cfd06402 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=71509) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.032s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[52074c7b-3cbd-4848-b99b-2396c1fec0a7]: (4, ('1', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-c5f92253-36a7-4e58-ab43-a926cfd06402 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=71509) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-c5f92253-36a7-4e58-ab43-a926cfd06402 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] SCSI volumes sdg have been removed. {{(pid=71509) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f92253-36a7-4e58-ab43-a926cfd06402 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171')] {{(pid=71509) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 10:45:52 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:53 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aed0e0f-da6d-4fdd-8ec6-8a59b67b26e3]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:53 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f92253-36a7-4e58-ab43-a926cfd06402 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:45:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171 -p 172.16.0.220:3260 --logout {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:53 user nova-compute[71509]: DEBUG nova.compute.manager [req-2d3e8b8a-da04-466d-a1c5-c421d97db575 req-45f76d78-d199-46db-a925-886e5e9d0550 service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Received event network-vif-deleted-c46b5082-6634-4c7f-89c1-7e58a3cd8987 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:45:53 user nova-compute[71509]: INFO nova.compute.manager [req-2d3e8b8a-da04-466d-a1c5-c421d97db575 req-45f76d78-d199-46db-a925-886e5e9d0550 service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Neutron deleted interface c46b5082-6634-4c7f-89c1-7e58a3cd8987; detaching it from the instance and deleting it from the info cache
Apr 14 10:45:53 user nova-compute[71509]: DEBUG nova.network.neutron [req-2d3e8b8a-da04-466d-a1c5-c421d97db575 req-45f76d78-d199-46db-a925-886e5e9d0550 service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Updating instance_info_cache with network_info: [{"id": "2b341364-55e1-439f-9a3b-2b2fb7ad33b7", "address": "fa:16:3e:3e:8d:2f", "network": {"id": "e6a6e8f5-448a-41d1-a833-6db7058c611c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-378111892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f701119cef78433280cbddf2adf685db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b341364-55", "ovs_interfaceid": "2b341364-55e1-439f-9a3b-2b2fb7ad33b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f3e8f62b-77e2-49d5-9fd9-b75f024a4ee7", "address": "fa:16:3e:87:fe:bc", "network": {"id": "a50bebb6-d4de-4875-9553-570535dace36", "bridge": "br-int", "label": "tempest-device-tagging-net1-1002288517", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.199", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f701119cef78433280cbddf2adf685db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3e8f62b-77", "ovs_interfaceid": "f3e8f62b-77e2-49d5-9fd9-b75f024a4ee7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d2d71e67-1807-43cf-8753-7bdd77de6317", "address": "fa:16:3e:4a:86:23", "network": {"id": "a50bebb6-d4de-4875-9553-570535dace36", "bridge": "br-int", "label": "tempest-device-tagging-net1-1002288517", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.110", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f701119cef78433280cbddf2adf685db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2d71e67-18", "ovs_interfaceid": "d2d71e67-1807-43cf-8753-7bdd77de6317", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8789c03e-397c-439a-8bc5-5d8ce5fc36ac", "address": "fa:16:3e:cf:67:ac", "network": {"id": "a50bebb6-d4de-4875-9553-570535dace36", "bridge": "br-int", "label": "tempest-device-tagging-net1-1002288517", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f701119cef78433280cbddf2adf685db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8789c03e-39", "ovs_interfaceid": "8789c03e-397c-439a-8bc5-5d8ce5fc36ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "84e561e8-01c6-4d50-ab37-bc64b5509e31", "address": "fa:16:3e:e1:97:d3", "network": {"id": "d6116fed-ce24-4ad4-9e8a-dfb2c1305e1c", "bridge": "br-int", "label": "tempest-device-tagging-net2-564175672", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f701119cef78433280cbddf2adf685db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84e561e8-01", "ovs_interfaceid": "84e561e8-01c6-4d50-ab37-bc64b5509e31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "717e6c20-676e-40f2-b4c1-47ca0f3e6f22", "address": "fa:16:3e:bf:a5:40", "network": {"id": "d6116fed-ce24-4ad4-9e8a-dfb2c1305e1c", "bridge": "br-int", "label": "tempest-device-tagging-net2-564175672", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f701119cef78433280cbddf2adf685db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap717e6c20-67", "ovs_interfaceid": "717e6c20-676e-40f2-b4c1-47ca0f3e6f22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:45:53 user nova-compute[71509]: DEBUG nova.compute.manager [req-2d3e8b8a-da04-466d-a1c5-c421d97db575 req-45f76d78-d199-46db-a925-886e5e9d0550 service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Detach interface failed, port_id=c46b5082-6634-4c7f-89c1-7e58a3cd8987, reason: Instance a81da242-e8d8-4b41-b84a-e12d603823ca could not be found. {{(pid=71509) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 10:45:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:53 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d6bca25-3adb-440c-b016-a4a0b83bfdda]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:53 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f92253-36a7-4e58-ab43-a926cfd06402 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171, portal: 172.16.0.220,3260]
Apr 14 10:45:53 user nova-compute[71509]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171, portal: 172.16.0.220,3260] successful.
Apr 14 10:45:53 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:45:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171 -p 172.16.0.220:3260 --op delete {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a80b10a6-3148-4db6-842e-f343407b1171 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:53 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[af3d640d-5d35-4ec7-9f0f-0af03776d88c]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:53 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f92253-36a7-4e58-ab43-a926cfd06402 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:45:53 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-c5f92253-36a7-4e58-ab43-a926cfd06402 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.345s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 10:45:53 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f92253-36a7-4e58-ab43-a926cfd06402 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] <== disconnect_volume: return (347ms) None {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 10:45:53 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5f92253-36a7-4e58-ab43-a926cfd06402 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Disconnected iSCSI Volume {{(pid=71509) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 10:45:53 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5f92253-36a7-4e58-ab43-a926cfd06402 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] [instance: d1516acc-354e-41f6-a639-61dea870b11e] calling os-brick to detach iSCSI Volume {{(pid=71509) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 10:45:53 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f92253-36a7-4e58-ab43-a926cfd06402 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0bf0749390>, {'target_iqn': 'iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jasETYwQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh': {}}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 10:45:53 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-c5f92253-36a7-4e58-ab43-a926cfd06402 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 10:45:53 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-c5f92253-36a7-4e58-ab43-a926cfd06402 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 10:45:53 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-c5f92253-36a7-4e58-ab43-a926cfd06402 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 10:45:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:53 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d02fedf-fa33-4f51-91fd-82c52bfb9392]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:53 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f92253-36a7-4e58-ab43-a926cfd06402 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 10:45:53 user nova-compute[71509]: No targets found.
Apr 14 10:45:53 user nova-compute[71509]: iSNS:
Apr 14 10:45:53 user nova-compute[71509]: No targets found.
Apr 14 10:45:53 user nova-compute[71509]: STATIC:
Apr 14 10:45:53 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e
Apr 14 10:45:53 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:45:53 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:45:53 user nova-compute[71509]: FIRMWARE:
Apr 14 10:45:53 user nova-compute[71509]: No targets found.
Apr 14 10:45:53 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:45:53 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f92253-36a7-4e58-ab43-a926cfd06402 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 10:45:53 user nova-compute[71509]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 10:45:53 user nova-compute[71509]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71509) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 10:45:53 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f92253-36a7-4e58-ab43-a926cfd06402 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e', 0)] {{(pid=71509) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 10:45:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:53 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[8896471a-f34b-40e0-8620-2fde009cbc28]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:53 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b9e7f53-0d80-4ed4-8300-7111d64433da]: (4, ('tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:53 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f92253-36a7-4e58-ab43-a926cfd06402 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e (non-flash)
Apr 14 10:45:53 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:45:53 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f92253-36a7-4e58-ab43-a926cfd06402 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] iscsi session list stdout=tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e (non-flash)
Apr 14 10:45:53 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 10:45:53 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f92253-36a7-4e58-ab43-a926cfd06402 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0c141157e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e'): ({'sdh'}, set())}) {{(pid=71509) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 10:45:53 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-c5f92253-36a7-4e58-ab43-a926cfd06402 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Removing single pathed devices sdh {{(pid=71509) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 10:45:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:53 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac0507a7-45e9-4f62-9331-8ed35e929eec]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.021s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:53 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0a4c73f-8cce-4920-a380-bc87cdc0ef4e]: (4, ('ok\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:53 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-c5f92253-36a7-4e58-ab43-a926cfd06402 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Flushing IO for device /dev/sdh {{(pid=71509) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 10:45:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.016s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:53 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d946673-e675-4742-9584-11c9481ea269]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:53 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-c5f92253-36a7-4e58-ab43-a926cfd06402 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=71509) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 10:45:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.052s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:53 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[032c778e-ea41-4812-91ed-96d24b6a3539]: (4, ('1', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:53 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-c5f92253-36a7-4e58-ab43-a926cfd06402 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=71509) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 10:45:53 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-c5f92253-36a7-4e58-ab43-a926cfd06402 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] SCSI volumes sdh have been removed. {{(pid=71509) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 10:45:53 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f92253-36a7-4e58-ab43-a926cfd06402 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e')] {{(pid=71509) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 10:45:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:53 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d4306ab-6268-4d69-a566-e6dbb2861224]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:53 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f92253-36a7-4e58-ab43-a926cfd06402 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:45:53 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e -p 172.16.0.220:3260 --logout {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:53 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[315830f1-d8dd-4cad-881c-c3c1ba359f02]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:53 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f92253-36a7-4e58-ab43-a926cfd06402 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e, portal: 172.16.0.220,3260]
Apr 14 10:45:53 user nova-compute[71509]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e, portal: 172.16.0.220,3260] successful.
Apr 14 10:45:53 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:45:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e -p 172.16.0.220:3260 --op delete {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d1e04e5-b8c3-4127-b22f-5535d2d28e7e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:53 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[f23f1c6f-a0ed-49c8-af58-cdde1830a2e6]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:53 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f92253-36a7-4e58-ab43-a926cfd06402 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:45:53 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-c5f92253-36a7-4e58-ab43-a926cfd06402 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 10:45:53 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f92253-36a7-4e58-ab43-a926cfd06402 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] <== disconnect_volume: return (319ms) None {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 10:45:53 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5f92253-36a7-4e58-ab43-a926cfd06402 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Disconnected iSCSI Volume {{(pid=71509) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 10:45:53 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-c5f92253-36a7-4e58-ab43-a926cfd06402 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Deleting instance files /opt/stack/data/nova/instances/d1516acc-354e-41f6-a639-61dea870b11e_del
Apr 14 10:45:53 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-c5f92253-36a7-4e58-ab43-a926cfd06402 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Deletion of /opt/stack/data/nova/instances/d1516acc-354e-41f6-a639-61dea870b11e_del complete
Apr 14 10:45:53 user nova-compute[71509]: INFO nova.compute.manager [None req-c5f92253-36a7-4e58-ab43-a926cfd06402 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Took 3.51 seconds to destroy the instance on the hypervisor.
Apr 14 10:45:53 user nova-compute[71509]: DEBUG oslo.service.loopingcall [None req-c5f92253-36a7-4e58-ab43-a926cfd06402 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71509) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 10:45:53 user nova-compute[71509]: DEBUG nova.compute.manager [-] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Deallocating network for instance {{(pid=71509) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 10:45:53 user nova-compute[71509]: DEBUG nova.network.neutron [-] [instance: d1516acc-354e-41f6-a639-61dea870b11e] deallocate_for_instance() {{(pid=71509) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 10:45:54 user nova-compute[71509]: DEBUG nova.compute.manager [req-bfba66e5-456e-4b10-af4c-864c49d28d2f req-9996ec54-b41a-46da-84d1-1e370a5cd534 service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Received event network-vif-unplugged-6e295a29-0297-49c0-9298-7d3a41a07585 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:45:54 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-bfba66e5-456e-4b10-af4c-864c49d28d2f req-9996ec54-b41a-46da-84d1-1e370a5cd534 service nova] Acquiring lock "d1516acc-354e-41f6-a639-61dea870b11e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:45:54 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-bfba66e5-456e-4b10-af4c-864c49d28d2f req-9996ec54-b41a-46da-84d1-1e370a5cd534 service nova] Lock "d1516acc-354e-41f6-a639-61dea870b11e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:45:54 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-bfba66e5-456e-4b10-af4c-864c49d28d2f req-9996ec54-b41a-46da-84d1-1e370a5cd534 service nova] Lock "d1516acc-354e-41f6-a639-61dea870b11e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:45:54 user nova-compute[71509]: DEBUG nova.compute.manager [req-bfba66e5-456e-4b10-af4c-864c49d28d2f req-9996ec54-b41a-46da-84d1-1e370a5cd534 service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] No waiting events found dispatching network-vif-unplugged-6e295a29-0297-49c0-9298-7d3a41a07585 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:45:54 user nova-compute[71509]: DEBUG nova.compute.manager [req-bfba66e5-456e-4b10-af4c-864c49d28d2f req-9996ec54-b41a-46da-84d1-1e370a5cd534 service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Received event network-vif-unplugged-6e295a29-0297-49c0-9298-7d3a41a07585 for instance with task_state deleting. {{(pid=71509) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 10:45:54 user nova-compute[71509]: DEBUG nova.compute.manager [req-bfba66e5-456e-4b10-af4c-864c49d28d2f req-9996ec54-b41a-46da-84d1-1e370a5cd534 service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Received event network-vif-plugged-6e295a29-0297-49c0-9298-7d3a41a07585 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:45:54 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-bfba66e5-456e-4b10-af4c-864c49d28d2f req-9996ec54-b41a-46da-84d1-1e370a5cd534 service nova] Acquiring lock "d1516acc-354e-41f6-a639-61dea870b11e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:45:54 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-bfba66e5-456e-4b10-af4c-864c49d28d2f req-9996ec54-b41a-46da-84d1-1e370a5cd534 service nova] Lock "d1516acc-354e-41f6-a639-61dea870b11e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:45:54 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-bfba66e5-456e-4b10-af4c-864c49d28d2f req-9996ec54-b41a-46da-84d1-1e370a5cd534 service nova] Lock "d1516acc-354e-41f6-a639-61dea870b11e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:45:54 user nova-compute[71509]: DEBUG nova.compute.manager [req-bfba66e5-456e-4b10-af4c-864c49d28d2f req-9996ec54-b41a-46da-84d1-1e370a5cd534 service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] No waiting events found dispatching network-vif-plugged-6e295a29-0297-49c0-9298-7d3a41a07585 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:45:54 user nova-compute[71509]: WARNING nova.compute.manager [req-bfba66e5-456e-4b10-af4c-864c49d28d2f req-9996ec54-b41a-46da-84d1-1e370a5cd534 service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Received unexpected event network-vif-plugged-6e295a29-0297-49c0-9298-7d3a41a07585 for instance with vm_state active and task_state deleting.
Apr 14 10:45:55 user nova-compute[71509]: DEBUG nova.compute.manager [req-ea40573b-31c7-42ae-922c-890a3833fd7a req-5fe40df8-8d69-4cb3-8fcb-74c0eeed566f service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Received event network-vif-deleted-717e6c20-676e-40f2-b4c1-47ca0f3e6f22 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:45:55 user nova-compute[71509]: INFO nova.compute.manager [req-ea40573b-31c7-42ae-922c-890a3833fd7a req-5fe40df8-8d69-4cb3-8fcb-74c0eeed566f service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Neutron deleted interface 717e6c20-676e-40f2-b4c1-47ca0f3e6f22; detaching it from the instance and deleting it from the info cache
Apr 14 10:45:55 user nova-compute[71509]: DEBUG nova.network.neutron [req-ea40573b-31c7-42ae-922c-890a3833fd7a req-5fe40df8-8d69-4cb3-8fcb-74c0eeed566f service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Updating instance_info_cache with network_info: [{"id": "2b341364-55e1-439f-9a3b-2b2fb7ad33b7", "address": "fa:16:3e:3e:8d:2f", "network": {"id": "e6a6e8f5-448a-41d1-a833-6db7058c611c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-378111892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f701119cef78433280cbddf2adf685db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b341364-55", "ovs_interfaceid": "2b341364-55e1-439f-9a3b-2b2fb7ad33b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f3e8f62b-77e2-49d5-9fd9-b75f024a4ee7", "address": "fa:16:3e:87:fe:bc", "network": {"id": "a50bebb6-d4de-4875-9553-570535dace36", "bridge": "br-int", "label": "tempest-device-tagging-net1-1002288517", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.199", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f701119cef78433280cbddf2adf685db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3e8f62b-77", "ovs_interfaceid": "f3e8f62b-77e2-49d5-9fd9-b75f024a4ee7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d2d71e67-1807-43cf-8753-7bdd77de6317", "address": "fa:16:3e:4a:86:23", "network": {"id": "a50bebb6-d4de-4875-9553-570535dace36", "bridge": "br-int", "label": "tempest-device-tagging-net1-1002288517", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.110", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f701119cef78433280cbddf2adf685db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2d71e67-18", "ovs_interfaceid": "d2d71e67-1807-43cf-8753-7bdd77de6317", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8789c03e-397c-439a-8bc5-5d8ce5fc36ac", "address": "fa:16:3e:cf:67:ac", "network": {"id": "a50bebb6-d4de-4875-9553-570535dace36", "bridge": "br-int", "label": "tempest-device-tagging-net1-1002288517", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f701119cef78433280cbddf2adf685db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8789c03e-39", "ovs_interfaceid": "8789c03e-397c-439a-8bc5-5d8ce5fc36ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "84e561e8-01c6-4d50-ab37-bc64b5509e31", "address": "fa:16:3e:e1:97:d3", "network": {"id": "d6116fed-ce24-4ad4-9e8a-dfb2c1305e1c", "bridge": "br-int", "label": "tempest-device-tagging-net2-564175672", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f701119cef78433280cbddf2adf685db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84e561e8-01", "ovs_interfaceid": "84e561e8-01c6-4d50-ab37-bc64b5509e31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:45:55 user nova-compute[71509]: DEBUG nova.compute.manager [req-ea40573b-31c7-42ae-922c-890a3833fd7a req-5fe40df8-8d69-4cb3-8fcb-74c0eeed566f service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Detach interface failed, port_id=717e6c20-676e-40f2-b4c1-47ca0f3e6f22, reason: Instance a81da242-e8d8-4b41-b84a-e12d603823ca could not be found. {{(pid=71509) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 10:45:55 user nova-compute[71509]: DEBUG nova.compute.manager [req-ea40573b-31c7-42ae-922c-890a3833fd7a req-5fe40df8-8d69-4cb3-8fcb-74c0eeed566f service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Received event network-vif-deleted-2b341364-55e1-439f-9a3b-2b2fb7ad33b7 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:45:55 user nova-compute[71509]: INFO nova.compute.manager [req-ea40573b-31c7-42ae-922c-890a3833fd7a req-5fe40df8-8d69-4cb3-8fcb-74c0eeed566f service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Neutron deleted interface 2b341364-55e1-439f-9a3b-2b2fb7ad33b7; detaching it from the instance and deleting it from the info cache
Apr 14 10:45:55 user nova-compute[71509]: DEBUG nova.network.neutron [req-ea40573b-31c7-42ae-922c-890a3833fd7a req-5fe40df8-8d69-4cb3-8fcb-74c0eeed566f service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Updating instance_info_cache with network_info: [{"id": "f3e8f62b-77e2-49d5-9fd9-b75f024a4ee7", "address": "fa:16:3e:87:fe:bc", "network": {"id": "a50bebb6-d4de-4875-9553-570535dace36", "bridge": "br-int", "label": "tempest-device-tagging-net1-1002288517", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.199", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f701119cef78433280cbddf2adf685db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3e8f62b-77", "ovs_interfaceid": "f3e8f62b-77e2-49d5-9fd9-b75f024a4ee7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d2d71e67-1807-43cf-8753-7bdd77de6317", "address": "fa:16:3e:4a:86:23", "network": {"id": "a50bebb6-d4de-4875-9553-570535dace36", "bridge": "br-int", "label": "tempest-device-tagging-net1-1002288517", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.110", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f701119cef78433280cbddf2adf685db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2d71e67-18", "ovs_interfaceid": "d2d71e67-1807-43cf-8753-7bdd77de6317", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8789c03e-397c-439a-8bc5-5d8ce5fc36ac", "address": "fa:16:3e:cf:67:ac", "network": {"id": "a50bebb6-d4de-4875-9553-570535dace36", "bridge": "br-int", "label": "tempest-device-tagging-net1-1002288517", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.111", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f701119cef78433280cbddf2adf685db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8789c03e-39", "ovs_interfaceid": "8789c03e-397c-439a-8bc5-5d8ce5fc36ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "84e561e8-01c6-4d50-ab37-bc64b5509e31", "address": "fa:16:3e:e1:97:d3", "network": {"id": "d6116fed-ce24-4ad4-9e8a-dfb2c1305e1c", "bridge": "br-int", "label": "tempest-device-tagging-net2-564175672", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f701119cef78433280cbddf2adf685db", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84e561e8-01", "ovs_interfaceid": "84e561e8-01c6-4d50-ab37-bc64b5509e31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:45:55 user nova-compute[71509]: DEBUG nova.compute.manager [req-ea40573b-31c7-42ae-922c-890a3833fd7a req-5fe40df8-8d69-4cb3-8fcb-74c0eeed566f service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Detach interface failed, port_id=2b341364-55e1-439f-9a3b-2b2fb7ad33b7, reason: Instance a81da242-e8d8-4b41-b84a-e12d603823ca could not be found. {{(pid=71509) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 10:45:55 user nova-compute[71509]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681469139.7540138, 39586d44-1d8e-4607-ab4d-c03a7d841606 => Stopped> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 10:45:55 user nova-compute[71509]: INFO nova.compute.manager [-] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] VM Stopped (Lifecycle Event)
Apr 14 10:45:55 user nova-compute[71509]: DEBUG nova.compute.manager [None req-346f218f-ad44-4564-b60f-37fe6a33f5c3 None None] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:45:56 user nova-compute[71509]: DEBUG nova.network.neutron [-] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Updating instance_info_cache with network_info: [] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:45:56 user nova-compute[71509]: INFO nova.compute.manager [-] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Took 6.94 seconds to deallocate network for instance.
Apr 14 10:45:56 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-fd85afb4-9343-456e-9e24-bef1ddd6cc6e tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Acquiring lock "4b767f1b-e97e-497c-8c70-8806203c76ae" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:45:56 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-fd85afb4-9343-456e-9e24-bef1ddd6cc6e tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "4b767f1b-e97e-497c-8c70-8806203c76ae" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:45:56 user nova-compute[71509]: DEBUG nova.compute.manager [None req-fd85afb4-9343-456e-9e24-bef1ddd6cc6e tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Starting instance... {{(pid=71509) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 10:45:56 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-fd85afb4-9343-456e-9e24-bef1ddd6cc6e tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:45:56 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-fd85afb4-9343-456e-9e24-bef1ddd6cc6e tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:45:56 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-fd85afb4-9343-456e-9e24-bef1ddd6cc6e tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71509) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 10:45:56 user nova-compute[71509]: INFO nova.compute.claims [None req-fd85afb4-9343-456e-9e24-bef1ddd6cc6e tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Claim successful on node user
Apr 14 10:45:57 user nova-compute[71509]: DEBUG nova.compute.manager [req-679bf796-9587-4fa7-8221-4539ed472234 req-a7a39490-6537-4bcc-9abb-ffa7455ffcf6 service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Received event network-vif-deleted-8789c03e-397c-439a-8bc5-5d8ce5fc36ac {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:45:57 user nova-compute[71509]: DEBUG nova.compute.manager [req-679bf796-9587-4fa7-8221-4539ed472234 req-a7a39490-6537-4bcc-9abb-ffa7455ffcf6 service nova] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Received event network-vif-deleted-84e561e8-01c6-4d50-ab37-bc64b5509e31 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:45:57 user nova-compute[71509]: DEBUG nova.compute.manager [req-679bf796-9587-4fa7-8221-4539ed472234 req-a7a39490-6537-4bcc-9abb-ffa7455ffcf6 service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Received event network-vif-deleted-4d65e4a1-4cea-4636-8ad8-21065de3c747 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:45:57 user nova-compute[71509]: INFO nova.compute.manager [req-679bf796-9587-4fa7-8221-4539ed472234 req-a7a39490-6537-4bcc-9abb-ffa7455ffcf6 service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Neutron deleted interface 4d65e4a1-4cea-4636-8ad8-21065de3c747; detaching it from the instance and deleting it from the info cache
Apr 14 10:45:57 user nova-compute[71509]: DEBUG nova.network.neutron [req-679bf796-9587-4fa7-8221-4539ed472234 req-a7a39490-6537-4bcc-9abb-ffa7455ffcf6 service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Updating instance_info_cache with network_info: [{"id": "2a2ef05a-2d58-4cdf-ab6c-35df823a68bc", "address": "fa:16:3e:ad:4e:cf", "network": {"id": "3c95a463-71cf-446f-8214-5f52f2da54b7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-325252986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e024f5a578e4543a02c6adc7d456f39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a2ef05a-2d", "ovs_interfaceid": "2a2ef05a-2d58-4cdf-ab6c-35df823a68bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "23214923-0217-4046-9a68-675f2ee8e42d", "address": "fa:16:3e:8a:5a:1a", "network": {"id": "bb8c5688-db8f-47c0-a2b5-0a44d2f97461", "bridge": "br-int", "label": "tempest-device-tagging-net1-527368946", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e024f5a578e4543a02c6adc7d456f39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23214923-02", "ovs_interfaceid": "23214923-0217-4046-9a68-675f2ee8e42d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7f7db929-b2fd-4242-9d23-5d58a374f961", "address": "fa:16:3e:28:88:b4", "network": {"id": "bb8c5688-db8f-47c0-a2b5-0a44d2f97461", "bridge": "br-int", "label": "tempest-device-tagging-net1-527368946", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e024f5a578e4543a02c6adc7d456f39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f7db929-b2", "ovs_interfaceid": "7f7db929-b2fd-4242-9d23-5d58a374f961", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d70f6f4d-f2bc-4d5e-9e98-a0daa1b35a0f", "address": "fa:16:3e:64:ce:c5", "network": {"id": "bb8c5688-db8f-47c0-a2b5-0a44d2f97461", "bridge": "br-int", "label": "tempest-device-tagging-net1-527368946", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e024f5a578e4543a02c6adc7d456f39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd70f6f4d-f2", "ovs_interfaceid": "d70f6f4d-f2bc-4d5e-9e98-a0daa1b35a0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "328d2b64-7bc6-425a-b3a4-8cda754ffd56", "address": "fa:16:3e:a6:55:10", "network": {"id": "1c6521c7-7280-4952-b1bc-a3aa0918e27c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1095863542", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e024f5a578e4543a02c6adc7d456f39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap328d2b64-7b", "ovs_interfaceid": "328d2b64-7bc6-425a-b3a4-8cda754ffd56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6e295a29-0297-49c0-9298-7d3a41a07585", "address": "fa:16:3e:32:10:a4", "network": {"id": "1c6521c7-7280-4952-b1bc-a3aa0918e27c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1095863542", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e024f5a578e4543a02c6adc7d456f39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e295a29-02", "ovs_interfaceid": "6e295a29-0297-49c0-9298-7d3a41a07585", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:45:57 user nova-compute[71509]: DEBUG nova.compute.manager [req-679bf796-9587-4fa7-8221-4539ed472234 req-a7a39490-6537-4bcc-9abb-ffa7455ffcf6 service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Detach interface failed, port_id=4d65e4a1-4cea-4636-8ad8-21065de3c747, reason: Instance d1516acc-354e-41f6-a639-61dea870b11e could not be found. {{(pid=71509) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 10:45:57 user nova-compute[71509]: DEBUG nova.compute.manager [req-679bf796-9587-4fa7-8221-4539ed472234 req-a7a39490-6537-4bcc-9abb-ffa7455ffcf6 service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Received event network-vif-deleted-328d2b64-7bc6-425a-b3a4-8cda754ffd56 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:45:57 user nova-compute[71509]: INFO nova.compute.manager [req-679bf796-9587-4fa7-8221-4539ed472234 req-a7a39490-6537-4bcc-9abb-ffa7455ffcf6 service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Neutron deleted interface 328d2b64-7bc6-425a-b3a4-8cda754ffd56; detaching it from the instance and deleting it from the info cache
Apr 14 10:45:57 user nova-compute[71509]: DEBUG nova.network.neutron [req-679bf796-9587-4fa7-8221-4539ed472234 req-a7a39490-6537-4bcc-9abb-ffa7455ffcf6 service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Updating instance_info_cache with network_info: [{"id": "2a2ef05a-2d58-4cdf-ab6c-35df823a68bc", "address": "fa:16:3e:ad:4e:cf", "network": {"id": "3c95a463-71cf-446f-8214-5f52f2da54b7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-325252986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e024f5a578e4543a02c6adc7d456f39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a2ef05a-2d", "ovs_interfaceid": "2a2ef05a-2d58-4cdf-ab6c-35df823a68bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "23214923-0217-4046-9a68-675f2ee8e42d", "address": "fa:16:3e:8a:5a:1a", "network": {"id": "bb8c5688-db8f-47c0-a2b5-0a44d2f97461", "bridge": "br-int", "label": "tempest-device-tagging-net1-527368946", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e024f5a578e4543a02c6adc7d456f39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23214923-02", "ovs_interfaceid": "23214923-0217-4046-9a68-675f2ee8e42d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7f7db929-b2fd-4242-9d23-5d58a374f961", "address": "fa:16:3e:28:88:b4", "network": {"id": "bb8c5688-db8f-47c0-a2b5-0a44d2f97461", "bridge": "br-int", "label": "tempest-device-tagging-net1-527368946", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e024f5a578e4543a02c6adc7d456f39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f7db929-b2", "ovs_interfaceid": "7f7db929-b2fd-4242-9d23-5d58a374f961", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d70f6f4d-f2bc-4d5e-9e98-a0daa1b35a0f", "address": "fa:16:3e:64:ce:c5", "network": {"id": "bb8c5688-db8f-47c0-a2b5-0a44d2f97461", "bridge": "br-int", "label": "tempest-device-tagging-net1-527368946", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e024f5a578e4543a02c6adc7d456f39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd70f6f4d-f2", "ovs_interfaceid": "d70f6f4d-f2bc-4d5e-9e98-a0daa1b35a0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6e295a29-0297-49c0-9298-7d3a41a07585", "address": "fa:16:3e:32:10:a4", "network": {"id": "1c6521c7-7280-4952-b1bc-a3aa0918e27c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1095863542", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0e024f5a578e4543a02c6adc7d456f39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e295a29-02", "ovs_interfaceid": "6e295a29-0297-49c0-9298-7d3a41a07585", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:45:57 user nova-compute[71509]: DEBUG nova.compute.manager [req-679bf796-9587-4fa7-8221-4539ed472234 req-a7a39490-6537-4bcc-9abb-ffa7455ffcf6 service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Detach interface failed, port_id=328d2b64-7bc6-425a-b3a4-8cda754ffd56, reason: Instance d1516acc-354e-41f6-a639-61dea870b11e could not be found. {{(pid=71509) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 10:45:57 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-fd85afb4-9343-456e-9e24-bef1ddd6cc6e tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 10:45:57 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-fd85afb4-9343-456e-9e24-bef1ddd6cc6e tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 10:45:57 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:57 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-fd85afb4-9343-456e-9e24-bef1ddd6cc6e tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.508s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:45:57 user nova-compute[71509]: DEBUG nova.compute.manager [None req-fd85afb4-9343-456e-9e24-bef1ddd6cc6e tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Start building networks asynchronously for instance. {{(pid=71509) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 10:45:57 user nova-compute[71509]: DEBUG nova.compute.manager [None req-fd85afb4-9343-456e-9e24-bef1ddd6cc6e tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Allocating IP information in the background. {{(pid=71509) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 10:45:57 user nova-compute[71509]: DEBUG nova.network.neutron [None req-fd85afb4-9343-456e-9e24-bef1ddd6cc6e tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] allocate_for_instance() {{(pid=71509) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 10:45:57 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-fd85afb4-9343-456e-9e24-bef1ddd6cc6e tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 10:45:57 user nova-compute[71509]: DEBUG nova.compute.manager [None req-fd85afb4-9343-456e-9e24-bef1ddd6cc6e tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Start building block device mappings for instance. {{(pid=71509) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 10:45:57 user nova-compute[71509]: DEBUG nova.compute.manager [None req-fd85afb4-9343-456e-9e24-bef1ddd6cc6e tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Start spawning the instance on the hypervisor. {{(pid=71509) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 10:45:57 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-fd85afb4-9343-456e-9e24-bef1ddd6cc6e tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Creating instance directory {{(pid=71509) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 10:45:57 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-fd85afb4-9343-456e-9e24-bef1ddd6cc6e tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Creating image(s)
Apr 14 10:45:57 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-fd85afb4-9343-456e-9e24-bef1ddd6cc6e tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Acquiring lock "/opt/stack/data/nova/instances/4b767f1b-e97e-497c-8c70-8806203c76ae/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:45:57 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-fd85afb4-9343-456e-9e24-bef1ddd6cc6e tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "/opt/stack/data/nova/instances/4b767f1b-e97e-497c-8c70-8806203c76ae/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:45:57 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-fd85afb4-9343-456e-9e24-bef1ddd6cc6e tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "/opt/stack/data/nova/instances/4b767f1b-e97e-497c-8c70-8806203c76ae/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:45:57 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-fd85afb4-9343-456e-9e24-bef1ddd6cc6e tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:57 user nova-compute[71509]: DEBUG nova.policy [None req-fd85afb4-9343-456e-9e24-bef1ddd6cc6e tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5afd3930d3a14aff8124a4782ec79870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8a9941095d445f48d70df26d8c90e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71509) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 10:45:57 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:45:57 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-fd85afb4-9343-456e-9e24-bef1ddd6cc6e tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json" returned: 0 in 0.142s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:57 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-fd85afb4-9343-456e-9e24-bef1ddd6cc6e tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Acquiring lock "5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:45:57 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-fd85afb4-9343-456e-9e24-bef1ddd6cc6e tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:45:57 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-fd85afb4-9343-456e-9e24-bef1ddd6cc6e tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:57 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-fd85afb4-9343-456e-9e24-bef1ddd6cc6e tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json" returned: 0 in 0.145s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:57 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-fd85afb4-9343-456e-9e24-bef1ddd6cc6e tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18,backing_fmt=raw /opt/stack/data/nova/instances/4b767f1b-e97e-497c-8c70-8806203c76ae/disk 1073741824 {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:57 user nova-compute[71509]: DEBUG nova.compute.manager [req-ba2f753c-fad3-4850-98ce-92fe7f3d2351 req-ee28baf5-2a2d-4ef2-bee6-582f445e08ef service nova] [instance: 55178126-9766-4875-9122-39dcc87ce82c] Received event network-changed-578e84c9-8c30-41bb-b61d-8fdeaa0c3a3f {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:45:57 user nova-compute[71509]: DEBUG nova.compute.manager [req-ba2f753c-fad3-4850-98ce-92fe7f3d2351 req-ee28baf5-2a2d-4ef2-bee6-582f445e08ef service nova] [instance: 55178126-9766-4875-9122-39dcc87ce82c] Refreshing instance network info cache due to event network-changed-578e84c9-8c30-41bb-b61d-8fdeaa0c3a3f. {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 10:45:57 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-ba2f753c-fad3-4850-98ce-92fe7f3d2351 req-ee28baf5-2a2d-4ef2-bee6-582f445e08ef service nova] Acquiring lock "refresh_cache-55178126-9766-4875-9122-39dcc87ce82c" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:45:57 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-ba2f753c-fad3-4850-98ce-92fe7f3d2351 req-ee28baf5-2a2d-4ef2-bee6-582f445e08ef service nova] Acquired lock "refresh_cache-55178126-9766-4875-9122-39dcc87ce82c" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:45:57 user nova-compute[71509]: DEBUG nova.network.neutron [req-ba2f753c-fad3-4850-98ce-92fe7f3d2351 req-ee28baf5-2a2d-4ef2-bee6-582f445e08ef service nova] [instance: 55178126-9766-4875-9122-39dcc87ce82c] Refreshing network info cache for port 578e84c9-8c30-41bb-b61d-8fdeaa0c3a3f {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 10:45:58 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-fd85afb4-9343-456e-9e24-bef1ddd6cc6e tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18,backing_fmt=raw /opt/stack/data/nova/instances/4b767f1b-e97e-497c-8c70-8806203c76ae/disk 1073741824" returned: 0 in 0.165s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:58 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-fd85afb4-9343-456e-9e24-bef1ddd6cc6e tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.314s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:45:58 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-fd85afb4-9343-456e-9e24-bef1ddd6cc6e tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:58 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-fd85afb4-9343-456e-9e24-bef1ddd6cc6e tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json" returned: 0 in 0.131s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:58 user nova-compute[71509]: DEBUG nova.virt.disk.api [None req-fd85afb4-9343-456e-9e24-bef1ddd6cc6e tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4b767f1b-e97e-497c-8c70-8806203c76ae/disk. size=1073741824 {{(pid=71509) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 10:45:58 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-fd85afb4-9343-456e-9e24-bef1ddd6cc6e tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b767f1b-e97e-497c-8c70-8806203c76ae/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:58 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-21c01582-3a50-4b7d-a63f-f4fe2201ce63 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Acquiring lock "55178126-9766-4875-9122-39dcc87ce82c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:45:58 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-21c01582-3a50-4b7d-a63f-f4fe2201ce63 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "55178126-9766-4875-9122-39dcc87ce82c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.004s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:45:58 user nova-compute[71509]: DEBUG nova.objects.instance [None req-21c01582-3a50-4b7d-a63f-f4fe2201ce63 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lazy-loading 'flavor' on Instance uuid 55178126-9766-4875-9122-39dcc87ce82c {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:45:58 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-21c01582-3a50-4b7d-a63f-f4fe2201ce63 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "55178126-9766-4875-9122-39dcc87ce82c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.071s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:45:58 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-fd85afb4-9343-456e-9e24-bef1ddd6cc6e tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b767f1b-e97e-497c-8c70-8806203c76ae/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:58 user nova-compute[71509]: DEBUG nova.virt.disk.api [None req-fd85afb4-9343-456e-9e24-bef1ddd6cc6e tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Cannot resize image /opt/stack/data/nova/instances/4b767f1b-e97e-497c-8c70-8806203c76ae/disk to a smaller size. {{(pid=71509) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 10:45:58 user nova-compute[71509]: DEBUG nova.objects.instance [None req-fd85afb4-9343-456e-9e24-bef1ddd6cc6e tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lazy-loading 'migration_context' on Instance uuid 4b767f1b-e97e-497c-8c70-8806203c76ae {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:45:58 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-fd85afb4-9343-456e-9e24-bef1ddd6cc6e tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Created local disks {{(pid=71509) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 10:45:58 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-fd85afb4-9343-456e-9e24-bef1ddd6cc6e tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Ensure instance console log exists: /opt/stack/data/nova/instances/4b767f1b-e97e-497c-8c70-8806203c76ae/console.log {{(pid=71509) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 10:45:58 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-fd85afb4-9343-456e-9e24-bef1ddd6cc6e tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:45:58 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-fd85afb4-9343-456e-9e24-bef1ddd6cc6e tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:45:58 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-fd85afb4-9343-456e-9e24-bef1ddd6cc6e tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:45:58 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-21c01582-3a50-4b7d-a63f-f4fe2201ce63 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Acquiring lock "55178126-9766-4875-9122-39dcc87ce82c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:45:58 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-21c01582-3a50-4b7d-a63f-f4fe2201ce63 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "55178126-9766-4875-9122-39dcc87ce82c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:45:58 user nova-compute[71509]: INFO nova.compute.manager [None req-21c01582-3a50-4b7d-a63f-f4fe2201ce63 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] [instance: 55178126-9766-4875-9122-39dcc87ce82c] Attaching volume 3fb9ddb1-b3b7-44ab-8cc2-7a1de34b8e75 to /dev/vdb
Apr 14 10:45:58 user nova-compute[71509]: DEBUG os_brick.utils [None req-21c01582-3a50-4b7d-a63f-f4fe2201ce63 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 10:45:58 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:58 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:58 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[745b4481-964a-46ee-846d-9b896e171628]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50119df3c417\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:58 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:58 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:58 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[8214b8bc-5011-48cd-90f8-970098fafb01]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:58 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:58 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:45:58 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[be4de793-4d95-4067-8ff6-1fc22f7a6868]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:58 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[b82a651f-238e-4b29-8967-1aef4acb2a7b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:58 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-21c01582-3a50-4b7d-a63f-f4fe2201ce63 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Running cmd (subprocess): nvme version {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:58 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-21c01582-3a50-4b7d-a63f-f4fe2201ce63 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] 'nvme version' failed. Not Retrying. {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 10:45:58 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.nvmeof [None req-21c01582-3a50-4b7d-a63f-f4fe2201ce63 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] nvme not present on system {{(pid=71509) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 10:45:58 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:45:58 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 10:45:58 user nova-compute[71509]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 10:45:58 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eb654f2-c30c-429b-ace8-521bab24da49]: (4, '') {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:45:58 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-21c01582-3a50-4b7d-a63f-f4fe2201ce63 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71509) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 10:45:58 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-21c01582-3a50-4b7d-a63f-f4fe2201ce63 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71509) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 10:45:58 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-21c01582-3a50-4b7d-a63f-f4fe2201ce63 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] LIGHTOS: no hostnqn found. {{(pid=71509) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 10:45:58 user nova-compute[71509]: DEBUG os_brick.utils [None req-21c01582-3a50-4b7d-a63f-f4fe2201ce63 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50119df3c417', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 10:45:58 user nova-compute[71509]: DEBUG nova.virt.block_device [None req-21c01582-3a50-4b7d-a63f-f4fe2201ce63 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] [instance: 55178126-9766-4875-9122-39dcc87ce82c] Updating existing volume attachment record: 34692995-ea13-41c7-8a15-13ab5717b6bb {{(pid=71509) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 10:45:58 user nova-compute[71509]: DEBUG nova.network.neutron [req-ba2f753c-fad3-4850-98ce-92fe7f3d2351 req-ee28baf5-2a2d-4ef2-bee6-582f445e08ef service nova] [instance: 55178126-9766-4875-9122-39dcc87ce82c] Updated VIF entry in instance network info cache for port 578e84c9-8c30-41bb-b61d-8fdeaa0c3a3f. {{(pid=71509) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 10:45:58 user nova-compute[71509]: DEBUG nova.network.neutron [req-ba2f753c-fad3-4850-98ce-92fe7f3d2351 req-ee28baf5-2a2d-4ef2-bee6-582f445e08ef service nova] [instance: 55178126-9766-4875-9122-39dcc87ce82c] Updating instance_info_cache with network_info: [{"id": "578e84c9-8c30-41bb-b61d-8fdeaa0c3a3f", "address": "fa:16:3e:85:23:c1", "network": {"id": "cec30aec-4cbb-4cff-8aae-6ecdfe8dfdbd", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1777093386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1696bf804b2e4d7f86162513015c8e52", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap578e84c9-8c", "ovs_interfaceid": "578e84c9-8c30-41bb-b61d-8fdeaa0c3a3f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:45:58 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-ba2f753c-fad3-4850-98ce-92fe7f3d2351 req-ee28baf5-2a2d-4ef2-bee6-582f445e08ef service nova] Releasing lock "refresh_cache-55178126-9766-4875-9122-39dcc87ce82c" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:45:58 user nova-compute[71509]: INFO nova.compute.manager [None req-f72c1110-988a-453c-ae38-51fb1d73b2e0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Took 2.51 seconds to detach 3 volumes for instance.
Apr 14 10:45:58 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-f72c1110-988a-453c-ae38-51fb1d73b2e0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:45:58 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-f72c1110-988a-453c-ae38-51fb1d73b2e0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:45:59 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-f72c1110-988a-453c-ae38-51fb1d73b2e0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 10:45:59 user nova-compute[71509]: DEBUG nova.compute.manager [req-9af61b8b-c07f-48c6-81cf-4f568124c3bd req-bd1a9ad2-82df-4bb4-9fca-070b709f48d2 service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Received event network-vif-deleted-6e295a29-0297-49c0-9298-7d3a41a07585 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:45:59 user nova-compute[71509]: INFO nova.compute.manager [req-9af61b8b-c07f-48c6-81cf-4f568124c3bd req-bd1a9ad2-82df-4bb4-9fca-070b709f48d2 service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Neutron deleted interface 6e295a29-0297-49c0-9298-7d3a41a07585; detaching it from the instance and deleting it from the info cache
Apr 14 10:45:59 user nova-compute[71509]: DEBUG nova.network.neutron [req-9af61b8b-c07f-48c6-81cf-4f568124c3bd req-bd1a9ad2-82df-4bb4-9fca-070b709f48d2 service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Updating instance_info_cache with network_info: [{"id": "2a2ef05a-2d58-4cdf-ab6c-35df823a68bc", "address": "fa:16:3e:ad:4e:cf", "network": {"id": "3c95a463-71cf-446f-8214-5f52f2da54b7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-325252986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e024f5a578e4543a02c6adc7d456f39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a2ef05a-2d", "ovs_interfaceid": "2a2ef05a-2d58-4cdf-ab6c-35df823a68bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "23214923-0217-4046-9a68-675f2ee8e42d", "address": "fa:16:3e:8a:5a:1a", "network": {"id": "bb8c5688-db8f-47c0-a2b5-0a44d2f97461", "bridge": "br-int", "label": "tempest-device-tagging-net1-527368946", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e024f5a578e4543a02c6adc7d456f39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23214923-02", "ovs_interfaceid": "23214923-0217-4046-9a68-675f2ee8e42d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7f7db929-b2fd-4242-9d23-5d58a374f961", "address": "fa:16:3e:28:88:b4", "network": {"id": "bb8c5688-db8f-47c0-a2b5-0a44d2f97461", "bridge": "br-int", "label": "tempest-device-tagging-net1-527368946", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e024f5a578e4543a02c6adc7d456f39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f7db929-b2", "ovs_interfaceid": "7f7db929-b2fd-4242-9d23-5d58a374f961", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d70f6f4d-f2bc-4d5e-9e98-a0daa1b35a0f", "address": "fa:16:3e:64:ce:c5", "network": {"id": "bb8c5688-db8f-47c0-a2b5-0a44d2f97461", "bridge": "br-int", "label": "tempest-device-tagging-net1-527368946", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e024f5a578e4543a02c6adc7d456f39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd70f6f4d-f2", "ovs_interfaceid": "d70f6f4d-f2bc-4d5e-9e98-a0daa1b35a0f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:45:59 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-f72c1110-988a-453c-ae38-51fb1d73b2e0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 10:45:59 user nova-compute[71509]: DEBUG nova.compute.manager [req-9af61b8b-c07f-48c6-81cf-4f568124c3bd req-bd1a9ad2-82df-4bb4-9fca-070b709f48d2 service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Detach interface failed, port_id=6e295a29-0297-49c0-9298-7d3a41a07585, reason: Instance d1516acc-354e-41f6-a639-61dea870b11e could not be found. {{(pid=71509) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 10:45:59 user nova-compute[71509]: DEBUG nova.compute.manager [req-9af61b8b-c07f-48c6-81cf-4f568124c3bd req-bd1a9ad2-82df-4bb4-9fca-070b709f48d2 service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Received event network-vif-deleted-d70f6f4d-f2bc-4d5e-9e98-a0daa1b35a0f {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:45:59 user nova-compute[71509]: INFO nova.compute.manager [req-9af61b8b-c07f-48c6-81cf-4f568124c3bd req-bd1a9ad2-82df-4bb4-9fca-070b709f48d2 service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Neutron deleted interface d70f6f4d-f2bc-4d5e-9e98-a0daa1b35a0f; detaching it from the instance and deleting it from the info cache
Apr 14 10:45:59 user nova-compute[71509]: DEBUG nova.network.neutron [req-9af61b8b-c07f-48c6-81cf-4f568124c3bd req-bd1a9ad2-82df-4bb4-9fca-070b709f48d2 service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Updating instance_info_cache with network_info: [{"id": "2a2ef05a-2d58-4cdf-ab6c-35df823a68bc", "address": "fa:16:3e:ad:4e:cf", "network": {"id": "3c95a463-71cf-446f-8214-5f52f2da54b7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-325252986-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e024f5a578e4543a02c6adc7d456f39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a2ef05a-2d", "ovs_interfaceid": "2a2ef05a-2d58-4cdf-ab6c-35df823a68bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "23214923-0217-4046-9a68-675f2ee8e42d", "address": "fa:16:3e:8a:5a:1a", "network": {"id": "bb8c5688-db8f-47c0-a2b5-0a44d2f97461", "bridge": "br-int", "label": "tempest-device-tagging-net1-527368946", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e024f5a578e4543a02c6adc7d456f39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23214923-02", "ovs_interfaceid": "23214923-0217-4046-9a68-675f2ee8e42d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7f7db929-b2fd-4242-9d23-5d58a374f961", "address": "fa:16:3e:28:88:b4", "network": {"id": "bb8c5688-db8f-47c0-a2b5-0a44d2f97461", "bridge": "br-int", "label": "tempest-device-tagging-net1-527368946", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.56", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0e024f5a578e4543a02c6adc7d456f39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f7db929-b2", "ovs_interfaceid": "7f7db929-b2fd-4242-9d23-5d58a374f961", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:45:59 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-f72c1110-988a-453c-ae38-51fb1d73b2e0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.397s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:45:59 user nova-compute[71509]: DEBUG nova.compute.manager [req-9af61b8b-c07f-48c6-81cf-4f568124c3bd req-bd1a9ad2-82df-4bb4-9fca-070b709f48d2 service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Detach interface failed, port_id=d70f6f4d-f2bc-4d5e-9e98-a0daa1b35a0f, reason: Instance d1516acc-354e-41f6-a639-61dea870b11e could not be found. {{(pid=71509) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 10:45:59 user nova-compute[71509]: INFO nova.scheduler.client.report [None req-f72c1110-988a-453c-ae38-51fb1d73b2e0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Deleted allocations for instance a81da242-e8d8-4b41-b84a-e12d603823ca
Apr 14 10:45:59 user nova-compute[71509]: DEBUG nova.network.neutron [None req-fd85afb4-9343-456e-9e24-bef1ddd6cc6e tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Successfully created port: 8d8a356d-c198-4e13-a489-5c626fbd025c {{(pid=71509) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 10:45:59 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-f72c1110-988a-453c-ae38-51fb1d73b2e0 tempest-TaggedBootDevicesTest_v242-1078203530 tempest-TaggedBootDevicesTest_v242-1078203530-project-member] Lock "a81da242-e8d8-4b41-b84a-e12d603823ca" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 13.998s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:45:59 user nova-compute[71509]: DEBUG nova.network.neutron [-] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Updating instance_info_cache with network_info: [] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:45:59 user nova-compute[71509]: INFO nova.compute.manager [-] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Took 6.02 seconds to deallocate network for instance.
Apr 14 10:46:00 user nova-compute[71509]: DEBUG nova.network.neutron [None req-fd85afb4-9343-456e-9e24-bef1ddd6cc6e tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Successfully updated port: 8d8a356d-c198-4e13-a489-5c626fbd025c {{(pid=71509) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 10:46:00 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-fd85afb4-9343-456e-9e24-bef1ddd6cc6e tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Acquiring lock "refresh_cache-4b767f1b-e97e-497c-8c70-8806203c76ae" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:46:00 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-fd85afb4-9343-456e-9e24-bef1ddd6cc6e tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Acquired lock "refresh_cache-4b767f1b-e97e-497c-8c70-8806203c76ae" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:46:00 user nova-compute[71509]: DEBUG nova.network.neutron [None req-fd85afb4-9343-456e-9e24-bef1ddd6cc6e tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Building network info cache for instance {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 10:46:00 user nova-compute[71509]: DEBUG nova.network.neutron [None req-fd85afb4-9343-456e-9e24-bef1ddd6cc6e tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Instance cache missing network info. {{(pid=71509) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 10:46:00 user nova-compute[71509]: DEBUG nova.network.neutron [None req-fd85afb4-9343-456e-9e24-bef1ddd6cc6e tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Updating instance_info_cache with network_info: [{"id": "8d8a356d-c198-4e13-a489-5c626fbd025c", "address": "fa:16:3e:c6:af:76", "network": {"id": "1cb09253-66a4-4c81-82d0-c6d948e0aed4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1557121746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8a9941095d445f48d70df26d8c90e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d8a356d-c1", "ovs_interfaceid": "8d8a356d-c198-4e13-a489-5c626fbd025c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:46:00 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-fd85afb4-9343-456e-9e24-bef1ddd6cc6e tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Releasing lock "refresh_cache-4b767f1b-e97e-497c-8c70-8806203c76ae" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:46:00 user nova-compute[71509]: DEBUG nova.compute.manager [None req-fd85afb4-9343-456e-9e24-bef1ddd6cc6e tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Instance network_info: |[{"id": "8d8a356d-c198-4e13-a489-5c626fbd025c", "address": "fa:16:3e:c6:af:76", "network": {"id": "1cb09253-66a4-4c81-82d0-c6d948e0aed4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1557121746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8a9941095d445f48d70df26d8c90e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d8a356d-c1", "ovs_interfaceid": "8d8a356d-c198-4e13-a489-5c626fbd025c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71509) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 10:46:00 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-fd85afb4-9343-456e-9e24-bef1ddd6cc6e tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Start _get_guest_xml network_info=[{"id": "8d8a356d-c198-4e13-a489-5c626fbd025c", "address": "fa:16:3e:c6:af:76", "network": {"id": "1cb09253-66a4-4c81-82d0-c6d948e0aed4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1557121746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8a9941095d445f48d70df26d8c90e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d8a356d-c1", "ovs_interfaceid": "8d8a356d-c198-4e13-a489-5c626fbd025c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T10:38:55Z,direct_url=<?>,disk_format='qcow2',id=048ec0ee-0465-448d-8b4c-f072acb101dc,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='9742d6ad20cf48d9bab0fdbcc9491db9',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T10:38:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '048ec0ee-0465-448d-8b4c-f072acb101dc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71509) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 10:46:00 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-fd85afb4-9343-456e-9e24-bef1ddd6cc6e tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:46:00 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-fd85afb4-9343-456e-9e24-bef1ddd6cc6e tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:46:00 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-fd85afb4-9343-456e-9e24-bef1ddd6cc6e tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71509) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 10:46:00 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-fd85afb4-9343-456e-9e24-bef1ddd6cc6e tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T10:40:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T10:38:55Z,direct_url=<?>,disk_format='qcow2',id=048ec0ee-0465-448d-8b4c-f072acb101dc,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='9742d6ad20cf48d9bab0fdbcc9491db9',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T10:38:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 10:46:00 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-fd85afb4-9343-456e-9e24-bef1ddd6cc6e tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Flavor limits 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 10:46:00 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-fd85afb4-9343-456e-9e24-bef1ddd6cc6e tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Image limits 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 10:46:00 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-fd85afb4-9343-456e-9e24-bef1ddd6cc6e tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Flavor pref 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 10:46:00 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-fd85afb4-9343-456e-9e24-bef1ddd6cc6e tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Image pref 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 10:46:00 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-fd85afb4-9343-456e-9e24-bef1ddd6cc6e tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 10:46:00 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-fd85afb4-9343-456e-9e24-bef1ddd6cc6e tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 10:46:00 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-fd85afb4-9343-456e-9e24-bef1ddd6cc6e tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71509) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 10:46:00 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-fd85afb4-9343-456e-9e24-bef1ddd6cc6e tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Got 1 possible topologies {{(pid=71509) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 10:46:00 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-fd85afb4-9343-456e-9e24-bef1ddd6cc6e tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 10:46:00 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-fd85afb4-9343-456e-9e24-bef1ddd6cc6e tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 10:46:00 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-fd85afb4-9343-456e-9e24-bef1ddd6cc6e tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T10:45:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1779641770',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1779641770',id=14,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ+BJG2hs5u25cAKxVjcO06DHIw9v85rt9ybRTOcJ5Z2J6Lwyi75EbIt/XGY4FaiJAg302gOYYve73U7hVGmBbLP+TE/GpIu0YYFEbftUPUQVwIX7wT/hvM2WJymZnJdhQ==',key_name='tempest-keypair-1533515584',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f8a9941095d445f48d70df26d8c90e6c',ramdisk_id='',reservation_id='r-8ce8ejer',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1250068675',owner_user_name='tempest-AttachVolumeShelveTestJSON-1250068675-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T10:45:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5afd3930d3a14aff8124a4782ec79870',uuid=4b767f1b-e97e-497c-8c70-8806203c76ae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8d8a356d-c198-4e13-a489-5c626fbd025c", "address": "fa:16:3e:c6:af:76", "network": {"id": "1cb09253-66a4-4c81-82d0-c6d948e0aed4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1557121746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8a9941095d445f48d70df26d8c90e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d8a356d-c1", "ovs_interfaceid": "8d8a356d-c198-4e13-a489-5c626fbd025c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71509) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 10:46:00 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-fd85afb4-9343-456e-9e24-bef1ddd6cc6e tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Converting VIF {"id": "8d8a356d-c198-4e13-a489-5c626fbd025c", "address": "fa:16:3e:c6:af:76", "network": {"id": "1cb09253-66a4-4c81-82d0-c6d948e0aed4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1557121746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8a9941095d445f48d70df26d8c90e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d8a356d-c1", "ovs_interfaceid": "8d8a356d-c198-4e13-a489-5c626fbd025c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:46:00 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-fd85afb4-9343-456e-9e24-bef1ddd6cc6e tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:af:76,bridge_name='br-int',has_traffic_filtering=True,id=8d8a356d-c198-4e13-a489-5c626fbd025c,network=Network(1cb09253-66a4-4c81-82d0-c6d948e0aed4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d8a356d-c1') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:46:00 user nova-compute[71509]: DEBUG nova.objects.instance [None req-fd85afb4-9343-456e-9e24-bef1ddd6cc6e tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lazy-loading 'pci_devices' on Instance uuid 4b767f1b-e97e-497c-8c70-8806203c76ae {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:46:00 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-fd85afb4-9343-456e-9e24-bef1ddd6cc6e tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] End _get_guest_xml xml=<domain type="kvm">
Apr 14 10:46:00 user nova-compute[71509]:   <uuid>4b767f1b-e97e-497c-8c70-8806203c76ae</uuid>
Apr 14 10:46:00 user nova-compute[71509]:   <name>instance-0000000e</name>
Apr 14 10:46:00 user nova-compute[71509]:   <memory>131072</memory>
Apr 14 10:46:00 user nova-compute[71509]:   <vcpu>1</vcpu>
Apr 14 10:46:00 user nova-compute[71509]:   <metadata>
Apr 14 10:46:00 user nova-compute[71509]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 10:46:00 user nova-compute[71509]:       <nova:package version="0.0.0"/>
Apr 14 10:46:00 user nova-compute[71509]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1779641770</nova:name>
Apr 14 10:46:00 user nova-compute[71509]:       <nova:creationTime>2023-04-14 10:46:00</nova:creationTime>
Apr 14 10:46:00 user nova-compute[71509]:       <nova:flavor name="m1.nano">
Apr 14 10:46:00 user nova-compute[71509]:         <nova:memory>128</nova:memory>
Apr 14 10:46:00 user nova-compute[71509]:         <nova:disk>1</nova:disk>
Apr 14 10:46:00 user nova-compute[71509]:         <nova:swap>0</nova:swap>
Apr 14 10:46:00 user nova-compute[71509]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 10:46:00 user nova-compute[71509]:         <nova:vcpus>1</nova:vcpus>
Apr 14 10:46:00 user nova-compute[71509]:       </nova:flavor>
Apr 14 10:46:00 user nova-compute[71509]:       <nova:owner>
Apr 14 10:46:00 user nova-compute[71509]:         <nova:user uuid="5afd3930d3a14aff8124a4782ec79870">tempest-AttachVolumeShelveTestJSON-1250068675-project-member</nova:user>
Apr 14 10:46:00 user nova-compute[71509]:         <nova:project uuid="f8a9941095d445f48d70df26d8c90e6c">tempest-AttachVolumeShelveTestJSON-1250068675</nova:project>
Apr 14 10:46:00 user nova-compute[71509]:       </nova:owner>
Apr 14 10:46:00 user nova-compute[71509]:       <nova:root type="image" uuid="048ec0ee-0465-448d-8b4c-f072acb101dc"/>
Apr 14 10:46:00 user nova-compute[71509]:       <nova:ports>
Apr 14 10:46:00 user nova-compute[71509]:         <nova:port uuid="8d8a356d-c198-4e13-a489-5c626fbd025c">
Apr 14 10:46:00 user nova-compute[71509]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 14 10:46:00 user nova-compute[71509]:         </nova:port>
Apr 14 10:46:00 user nova-compute[71509]:       </nova:ports>
Apr 14 10:46:00 user nova-compute[71509]:     </nova:instance>
Apr 14 10:46:00 user nova-compute[71509]:   </metadata>
Apr 14 10:46:00 user nova-compute[71509]:   <sysinfo type="smbios">
Apr 14 10:46:00 user nova-compute[71509]:     <system>
Apr 14 10:46:00 user nova-compute[71509]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 10:46:00 user nova-compute[71509]:       <entry name="product">OpenStack Nova</entry>
Apr 14 10:46:00 user nova-compute[71509]:       <entry name="version">0.0.0</entry>
Apr 14 10:46:00 user nova-compute[71509]:       <entry name="serial">4b767f1b-e97e-497c-8c70-8806203c76ae</entry>
Apr 14 10:46:00 user nova-compute[71509]:       <entry name="uuid">4b767f1b-e97e-497c-8c70-8806203c76ae</entry>
Apr 14 10:46:00 user nova-compute[71509]:       <entry name="family">Virtual Machine</entry>
Apr 14 10:46:00 user nova-compute[71509]:     </system>
Apr 14 10:46:00 user nova-compute[71509]:   </sysinfo>
Apr 14 10:46:00 user nova-compute[71509]:   <os>
Apr 14 10:46:00 user nova-compute[71509]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 10:46:00 user nova-compute[71509]:     <boot dev="hd"/>
Apr 14 10:46:00 user nova-compute[71509]:     <smbios mode="sysinfo"/>
Apr 14 10:46:00 user nova-compute[71509]:   </os>
Apr 14 10:46:00 user nova-compute[71509]:   <features>
Apr 14 10:46:00 user nova-compute[71509]:     <acpi/>
Apr 14 10:46:00 user nova-compute[71509]:     <apic/>
Apr 14 10:46:00 user nova-compute[71509]:     <vmcoreinfo/>
Apr 14 10:46:00 user nova-compute[71509]:   </features>
Apr 14 10:46:00 user nova-compute[71509]:   <clock offset="utc">
Apr 14 10:46:00 user nova-compute[71509]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 10:46:00 user nova-compute[71509]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 10:46:00 user nova-compute[71509]:     <timer name="hpet" present="no"/>
Apr 14 10:46:00 user nova-compute[71509]:   </clock>
Apr 14 10:46:00 user nova-compute[71509]:   <cpu mode="custom" match="exact">
Apr 14 10:46:00 user nova-compute[71509]:     <model>Nehalem</model>
Apr 14 10:46:00 user nova-compute[71509]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 10:46:00 user nova-compute[71509]:   </cpu>
Apr 14 10:46:00 user nova-compute[71509]:   <devices>
Apr 14 10:46:00 user nova-compute[71509]:     <disk type="file" device="disk">
Apr 14 10:46:00 user nova-compute[71509]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 10:46:00 user nova-compute[71509]:       <source file="/opt/stack/data/nova/instances/4b767f1b-e97e-497c-8c70-8806203c76ae/disk"/>
Apr 14 10:46:00 user nova-compute[71509]:       <target dev="vda" bus="virtio"/>
Apr 14 10:46:00 user nova-compute[71509]:     </disk>
Apr 14 10:46:00 user nova-compute[71509]:     <interface type="ethernet">
Apr 14 10:46:00 user nova-compute[71509]:       <mac address="fa:16:3e:c6:af:76"/>
Apr 14 10:46:00 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 10:46:00 user nova-compute[71509]:       <mtu size="1442"/>
Apr 14 10:46:00 user nova-compute[71509]:       <target dev="tap8d8a356d-c1"/>
Apr 14 10:46:00 user nova-compute[71509]:     </interface>
Apr 14 10:46:00 user nova-compute[71509]:     <serial type="pty">
Apr 14 10:46:00 user nova-compute[71509]:       <log file="/opt/stack/data/nova/instances/4b767f1b-e97e-497c-8c70-8806203c76ae/console.log" append="off"/>
Apr 14 10:46:00 user nova-compute[71509]:     </serial>
Apr 14 10:46:00 user nova-compute[71509]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 10:46:00 user nova-compute[71509]:     <video>
Apr 14 10:46:00 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 10:46:00 user nova-compute[71509]:     </video>
Apr 14 10:46:00 user nova-compute[71509]:     <rng model="virtio">
Apr 14 10:46:00 user nova-compute[71509]:       <backend model="random">/dev/urandom</backend>
Apr 14 10:46:00 user nova-compute[71509]:     </rng>
Apr 14 10:46:00 user nova-compute[71509]:     <controller type="usb" index="0" model="none"/>
Apr 14 10:46:00 user nova-compute[71509]:     <memballoon model="virtio">
Apr 14 10:46:00 user nova-compute[71509]:       <stats period="10"/>
Apr 14 10:46:00 user nova-compute[71509]:     </memballoon>
Apr 14 10:46:00 user nova-compute[71509]:   </devices>
Apr 14 10:46:00 user nova-compute[71509]: </domain>
Apr 14 10:46:00 user nova-compute[71509]:  {{(pid=71509) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 10:46:00 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-fd85afb4-9343-456e-9e24-bef1ddd6cc6e tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T10:45:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1779641770',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1779641770',id=14,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ+BJG2hs5u25cAKxVjcO06DHIw9v85rt9ybRTOcJ5Z2J6Lwyi75EbIt/XGY4FaiJAg302gOYYve73U7hVGmBbLP+TE/GpIu0YYFEbftUPUQVwIX7wT/hvM2WJymZnJdhQ==',key_name='tempest-keypair-1533515584',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f8a9941095d445f48d70df26d8c90e6c',ramdisk_id='',reservation_id='r-8ce8ejer',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1250068675',owner_user_name='tempest-AttachVolumeShelveTestJSON-1250068675-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T10:45:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5afd3930d3a14aff8124a4782ec79870',uuid=4b767f1b-e97e-497c-8c70-8806203c76ae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8d8a356d-c198-4e13-a489-5c626fbd025c", "address": "fa:16:3e:c6:af:76", "network": {"id": "1cb09253-66a4-4c81-82d0-c6d948e0aed4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1557121746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8a9941095d445f48d70df26d8c90e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d8a356d-c1", "ovs_interfaceid": "8d8a356d-c198-4e13-a489-5c626fbd025c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 10:46:00 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-fd85afb4-9343-456e-9e24-bef1ddd6cc6e tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Converting VIF {"id": "8d8a356d-c198-4e13-a489-5c626fbd025c", "address": "fa:16:3e:c6:af:76", "network": {"id": "1cb09253-66a4-4c81-82d0-c6d948e0aed4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1557121746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8a9941095d445f48d70df26d8c90e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d8a356d-c1", "ovs_interfaceid": "8d8a356d-c198-4e13-a489-5c626fbd025c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:46:00 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-fd85afb4-9343-456e-9e24-bef1ddd6cc6e tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:af:76,bridge_name='br-int',has_traffic_filtering=True,id=8d8a356d-c198-4e13-a489-5c626fbd025c,network=Network(1cb09253-66a4-4c81-82d0-c6d948e0aed4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d8a356d-c1') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:46:00 user nova-compute[71509]: DEBUG os_vif [None req-fd85afb4-9343-456e-9e24-bef1ddd6cc6e tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:af:76,bridge_name='br-int',has_traffic_filtering=True,id=8d8a356d-c198-4e13-a489-5c626fbd025c,network=Network(1cb09253-66a4-4c81-82d0-c6d948e0aed4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d8a356d-c1') {{(pid=71509) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 10:46:00 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:46:00 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:46:00 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 10:46:00 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:46:00 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8d8a356d-c1, may_exist=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:46:00 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8d8a356d-c1, col_values=(('external_ids', {'iface-id': '8d8a356d-c198-4e13-a489-5c626fbd025c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c6:af:76', 'vm-uuid': '4b767f1b-e97e-497c-8c70-8806203c76ae'}),)) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:46:00 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:46:00 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 10:46:00 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:46:00 user nova-compute[71509]: INFO os_vif [None req-fd85afb4-9343-456e-9e24-bef1ddd6cc6e tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:af:76,bridge_name='br-int',has_traffic_filtering=True,id=8d8a356d-c198-4e13-a489-5c626fbd025c,network=Network(1cb09253-66a4-4c81-82d0-c6d948e0aed4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d8a356d-c1')
Apr 14 10:46:00 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-fd85afb4-9343-456e-9e24-bef1ddd6cc6e tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] No BDM found with device name vda, not building metadata. {{(pid=71509) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 10:46:00 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-fd85afb4-9343-456e-9e24-bef1ddd6cc6e tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] No VIF found with MAC fa:16:3e:c6:af:76, not building metadata {{(pid=71509) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 10:46:01 user nova-compute[71509]: DEBUG nova.compute.manager [req-ddce5868-1b3b-4383-8791-ffb4177a64a3 req-3b9b0acf-06b1-4585-843a-30455ecd387f service nova] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Received event network-vif-deleted-2a2ef05a-2d58-4cdf-ab6c-35df823a68bc {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:46:01 user nova-compute[71509]: DEBUG nova.compute.manager [req-ddce5868-1b3b-4383-8791-ffb4177a64a3 req-3b9b0acf-06b1-4585-843a-30455ecd387f service nova] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Received event network-changed-8d8a356d-c198-4e13-a489-5c626fbd025c {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:46:01 user nova-compute[71509]: DEBUG nova.compute.manager [req-ddce5868-1b3b-4383-8791-ffb4177a64a3 req-3b9b0acf-06b1-4585-843a-30455ecd387f service nova] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Refreshing instance network info cache due to event network-changed-8d8a356d-c198-4e13-a489-5c626fbd025c. {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 10:46:01 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-ddce5868-1b3b-4383-8791-ffb4177a64a3 req-3b9b0acf-06b1-4585-843a-30455ecd387f service nova] Acquiring lock "refresh_cache-4b767f1b-e97e-497c-8c70-8806203c76ae" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:46:01 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-ddce5868-1b3b-4383-8791-ffb4177a64a3 req-3b9b0acf-06b1-4585-843a-30455ecd387f service nova] Acquired lock "refresh_cache-4b767f1b-e97e-497c-8c70-8806203c76ae" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:46:01 user nova-compute[71509]: DEBUG nova.network.neutron [req-ddce5868-1b3b-4383-8791-ffb4177a64a3 req-3b9b0acf-06b1-4585-843a-30455ecd387f service nova] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Refreshing network info cache for port 8d8a356d-c198-4e13-a489-5c626fbd025c {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 10:46:01 user nova-compute[71509]: DEBUG nova.network.neutron [req-ddce5868-1b3b-4383-8791-ffb4177a64a3 req-3b9b0acf-06b1-4585-843a-30455ecd387f service nova] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Updated VIF entry in instance network info cache for port 8d8a356d-c198-4e13-a489-5c626fbd025c. {{(pid=71509) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 10:46:01 user nova-compute[71509]: DEBUG nova.network.neutron [req-ddce5868-1b3b-4383-8791-ffb4177a64a3 req-3b9b0acf-06b1-4585-843a-30455ecd387f service nova] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Updating instance_info_cache with network_info: [{"id": "8d8a356d-c198-4e13-a489-5c626fbd025c", "address": "fa:16:3e:c6:af:76", "network": {"id": "1cb09253-66a4-4c81-82d0-c6d948e0aed4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1557121746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8a9941095d445f48d70df26d8c90e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d8a356d-c1", "ovs_interfaceid": "8d8a356d-c198-4e13-a489-5c626fbd025c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:46:01 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-ddce5868-1b3b-4383-8791-ffb4177a64a3 req-3b9b0acf-06b1-4585-843a-30455ecd387f service nova] Releasing lock "refresh_cache-4b767f1b-e97e-497c-8c70-8806203c76ae" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:46:01 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:46:02 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:46:02 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:46:02 user nova-compute[71509]: INFO nova.compute.manager [None req-c5f92253-36a7-4e58-ab43-a926cfd06402 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Took 2.53 seconds to detach 3 volumes for instance.
Apr 14 10:46:02 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-c5f92253-36a7-4e58-ab43-a926cfd06402 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:46:02 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-c5f92253-36a7-4e58-ab43-a926cfd06402 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:46:02 user nova-compute[71509]: DEBUG nova.compute.manager [req-65c0f0e5-2f12-4d9a-b1e1-88b631722d57 req-b0b1ce85-29e0-4793-a035-608a16d8cc7c service nova] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Received event network-vif-plugged-8d8a356d-c198-4e13-a489-5c626fbd025c {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:46:02 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-65c0f0e5-2f12-4d9a-b1e1-88b631722d57 req-b0b1ce85-29e0-4793-a035-608a16d8cc7c service nova] Acquiring lock "4b767f1b-e97e-497c-8c70-8806203c76ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:46:02 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-65c0f0e5-2f12-4d9a-b1e1-88b631722d57 req-b0b1ce85-29e0-4793-a035-608a16d8cc7c service nova] Lock "4b767f1b-e97e-497c-8c70-8806203c76ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:46:02 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-65c0f0e5-2f12-4d9a-b1e1-88b631722d57 req-b0b1ce85-29e0-4793-a035-608a16d8cc7c service nova] Lock "4b767f1b-e97e-497c-8c70-8806203c76ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:46:02 user nova-compute[71509]: DEBUG nova.compute.manager [req-65c0f0e5-2f12-4d9a-b1e1-88b631722d57 req-b0b1ce85-29e0-4793-a035-608a16d8cc7c service nova] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] No waiting events found dispatching network-vif-plugged-8d8a356d-c198-4e13-a489-5c626fbd025c {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:46:02 user nova-compute[71509]: WARNING nova.compute.manager [req-65c0f0e5-2f12-4d9a-b1e1-88b631722d57 req-b0b1ce85-29e0-4793-a035-608a16d8cc7c service nova] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Received unexpected event network-vif-plugged-8d8a356d-c198-4e13-a489-5c626fbd025c for instance with vm_state building and task_state spawning.
Apr 14 10:46:02 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-c5f92253-36a7-4e58-ab43-a926cfd06402 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 10:46:02 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-c5f92253-36a7-4e58-ab43-a926cfd06402 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 10:46:02 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-c5f92253-36a7-4e58-ab43-a926cfd06402 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.349s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:46:02 user nova-compute[71509]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681469147.481567, a81da242-e8d8-4b41-b84a-e12d603823ca => Stopped> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 10:46:02 user nova-compute[71509]: INFO nova.compute.manager [-] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] VM Stopped (Lifecycle Event)
Apr 14 10:46:02 user nova-compute[71509]: INFO nova.scheduler.client.report [None req-c5f92253-36a7-4e58-ab43-a926cfd06402 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Deleted allocations for instance d1516acc-354e-41f6-a639-61dea870b11e
Apr 14 10:46:02 user nova-compute[71509]: DEBUG nova.compute.manager [None req-3bcb82c9-9bc2-4f44-9584-99eba46b814c None None] [instance: a81da242-e8d8-4b41-b84a-e12d603823ca] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:46:02 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-c5f92253-36a7-4e58-ab43-a926cfd06402 tempest-TaggedBootDevicesTest-656117710 tempest-TaggedBootDevicesTest-656117710-project-member] Lock "d1516acc-354e-41f6-a639-61dea870b11e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 12.638s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:46:02 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:46:02 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:46:02 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:46:02 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:46:02 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:46:03 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21c01582-3a50-4b7d-a63f-f4fe2201ce63 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] [instance: 55178126-9766-4875-9122-39dcc87ce82c] Calling os-brick to attach iSCSI Volume {{(pid=71509) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 10:46:03 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-21c01582-3a50-4b7d-a63f-f4fe2201ce63 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0bf0749390>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3fb9ddb1-b3b7-44ab-8cc2-7a1de34b8e75', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WzsBXDOv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 10:46:03 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-21c01582-3a50-4b7d-a63f-f4fe2201ce63 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 10:46:03 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-21c01582-3a50-4b7d-a63f-f4fe2201ce63 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 10:46:03 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-21c01582-3a50-4b7d-a63f-f4fe2201ce63 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 10:46:03 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-21c01582-3a50-4b7d-a63f-f4fe2201ce63 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 10:46:03 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-21c01582-3a50-4b7d-a63f-f4fe2201ce63 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3fb9ddb1-b3b7-44ab-8cc2-7a1de34b8e75" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 10:46:03 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-21c01582-3a50-4b7d-a63f-f4fe2201ce63 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3fb9ddb1-b3b7-44ab-8cc2-7a1de34b8e75" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 10:46:03 user nova-compute[71509]: INFO os_brick.initiator.connectors.iscsi [None req-21c01582-3a50-4b7d-a63f-f4fe2201ce63 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 10:46:03 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fb9ddb1-b3b7-44ab-8cc2-7a1de34b8e75 -p 172.16.0.220:3260 {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:46:03 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fb9ddb1-b3b7-44ab-8cc2-7a1de34b8e75 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:46:03 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf47327e-a6ef-4b62-ba4b-41afba5c3711]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:46:03 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-21c01582-3a50-4b7d-a63f-f4fe2201ce63 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 10:46:03 user nova-compute[71509]:  {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:46:03 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fb9ddb1-b3b7-44ab-8cc2-7a1de34b8e75 -p 172.16.0.220:3260 --interface default --op new {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:46:03 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fb9ddb1-b3b7-44ab-8cc2-7a1de34b8e75 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:46:03 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[d841a933-5b46-46dd-8e2d-a053d5dc114a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3fb9ddb1-b3b7-44ab-8cc2-7a1de34b8e75] added\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:46:03 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-21c01582-3a50-4b7d-a63f-f4fe2201ce63 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3fb9ddb1-b3b7-44ab-8cc2-7a1de34b8e75] added
Apr 14 10:46:03 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:46:03 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fb9ddb1-b3b7-44ab-8cc2-7a1de34b8e75 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:46:03 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fb9ddb1-b3b7-44ab-8cc2-7a1de34b8e75 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:46:03 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[b532b60d-43de-4bda-8487-4d1313ced879]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:46:03 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-21c01582-3a50-4b7d-a63f-f4fe2201ce63 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:46:03 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fb9ddb1-b3b7-44ab-8cc2-7a1de34b8e75 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:46:03 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fb9ddb1-b3b7-44ab-8cc2-7a1de34b8e75 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:46:03 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[31cc7cd1-76d8-42c6-8b2e-3cb47ed8c32c]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:46:03 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-21c01582-3a50-4b7d-a63f-f4fe2201ce63 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:46:03 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fb9ddb1-b3b7-44ab-8cc2-7a1de34b8e75 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WzsBXDOv {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:46:03 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fb9ddb1-b3b7-44ab-8cc2-7a1de34b8e75 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WzsBXDOv" returned: 0 in 0.016s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:46:03 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[997f5398-ed36-43c8-8f07-67273d1458b4]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:46:03 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-21c01582-3a50-4b7d-a63f-f4fe2201ce63 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WzsBXDOv'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:46:03 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fb9ddb1-b3b7-44ab-8cc2-7a1de34b8e75 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:46:03 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fb9ddb1-b3b7-44ab-8cc2-7a1de34b8e75 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:46:03 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[83afa7aa-e6b1-402d-bf2a-ec338132f5b2]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:46:03 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-21c01582-3a50-4b7d-a63f-f4fe2201ce63 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:46:03 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:46:03 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:46:03 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f4f7c8e-3fff-4f83-9c10-9fd598fb7760]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:46:03 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-21c01582-3a50-4b7d-a63f-f4fe2201ce63 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 14 10:46:03 user nova-compute[71509]:  {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:46:03 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-21c01582-3a50-4b7d-a63f-f4fe2201ce63 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 14 10:46:03 user nova-compute[71509]:  {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 10:46:03 user nova-compute[71509]: WARNING os_brick.initiator.connectors.iscsi [None req-21c01582-3a50-4b7d-a63f-f4fe2201ce63 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 14 10:46:03 user nova-compute[71509]: 
Apr 14 10:46:03 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fb9ddb1-b3b7-44ab-8cc2-7a1de34b8e75 -p 172.16.0.220:3260 --login {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:46:03 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fb9ddb1-b3b7-44ab-8cc2-7a1de34b8e75 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:46:03 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[40c79481-8d38-418f-b9ed-59edb30bb760]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3fb9ddb1-b3b7-44ab-8cc2-7a1de34b8e75, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3fb9ddb1-b3b7-44ab-8cc2-7a1de34b8e75, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:46:03 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-21c01582-3a50-4b7d-a63f-f4fe2201ce63 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3fb9ddb1-b3b7-44ab-8cc2-7a1de34b8e75, portal: 172.16.0.220,3260]
Apr 14 10:46:03 user nova-compute[71509]: Login to [iface: default, target: iqn.2010-10.org.openstack:3fb9ddb1-b3b7-44ab-8cc2-7a1de34b8e75, portal: 172.16.0.220,3260] successful.
Apr 14 10:46:03 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:46:03 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fb9ddb1-b3b7-44ab-8cc2-7a1de34b8e75 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:46:03 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fb9ddb1-b3b7-44ab-8cc2-7a1de34b8e75 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:46:03 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[abdb1929-e26c-446a-ae17-b9dbd4579573]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:46:03 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-21c01582-3a50-4b7d-a63f-f4fe2201ce63 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:46:03 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:46:03 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:46:03 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9e8975e-d651-44a3-89f1-5a4432130f85]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fb9ddb1-b3b7-44ab-8cc2-7a1de34b8e75 (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:46:03 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-21c01582-3a50-4b7d-a63f-f4fe2201ce63 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fb9ddb1-b3b7-44ab-8cc2-7a1de34b8e75 (non-flash)
Apr 14 10:46:03 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:46:03 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-21c01582-3a50-4b7d-a63f-f4fe2201ce63 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fb9ddb1-b3b7-44ab-8cc2-7a1de34b8e75 (non-flash)
Apr 14 10:46:03 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 10:46:03 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-21c01582-3a50-4b7d-a63f-f4fe2201ce63 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3fb9ddb1-b3b7-44ab-8cc2-7a1de34b8e75" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.236s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 10:46:03 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-21c01582-3a50-4b7d-a63f-f4fe2201ce63 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Connected to 172.16.0.220:3260 {{(pid=71509) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 10:46:03 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-21c01582-3a50-4b7d-a63f-f4fe2201ce63 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] HCTL ('33', '-', '-', 0) found on session 15 with lun 0 {{(pid=71509) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 10:46:03 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-21c01582-3a50-4b7d-a63f-f4fe2201ce63 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71509) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 10:46:03 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:46:03 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:46:03 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3dd1071-b6a7-4428-b9fb-267e57bc8e10]: (4, ('- - 0', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:46:03 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-21c01582-3a50-4b7d-a63f-f4fe2201ce63 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Searching for a device in session 15 and hctl ['33', '*', '*', 0] yield: None {{(pid=71509) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 10:46:04 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681469164.1104512, 4b767f1b-e97e-497c-8c70-8806203c76ae => Resumed> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 10:46:04 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] VM Resumed (Lifecycle Event)
Apr 14 10:46:04 user nova-compute[71509]: DEBUG nova.compute.manager [None req-fd85afb4-9343-456e-9e24-bef1ddd6cc6e tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Instance event wait completed in 0 seconds for  {{(pid=71509) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 10:46:04 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-fd85afb4-9343-456e-9e24-bef1ddd6cc6e tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Guest created on hypervisor {{(pid=71509) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 10:46:04 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Instance spawned successfully.
Apr 14 10:46:04 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-fd85afb4-9343-456e-9e24-bef1ddd6cc6e tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 10:46:04 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:46:04 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-fd85afb4-9343-456e-9e24-bef1ddd6cc6e tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Found default for hw_cdrom_bus of ide {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:46:04 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-fd85afb4-9343-456e-9e24-bef1ddd6cc6e tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Found default for hw_disk_bus of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:46:04 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-fd85afb4-9343-456e-9e24-bef1ddd6cc6e tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Found default for hw_input_bus of None {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:46:04 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-fd85afb4-9343-456e-9e24-bef1ddd6cc6e tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Found default for hw_pointer_model of None {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:46:04 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-fd85afb4-9343-456e-9e24-bef1ddd6cc6e tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Found default for hw_video_model of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:46:04 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-fd85afb4-9343-456e-9e24-bef1ddd6cc6e tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Found default for hw_vif_model of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:46:04 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 10:46:04 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 10:46:04 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681469164.1119761, 4b767f1b-e97e-497c-8c70-8806203c76ae => Started> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 10:46:04 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] VM Started (Lifecycle Event)
Apr 14 10:46:04 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:46:04 user nova-compute[71509]: INFO nova.compute.manager [None req-fd85afb4-9343-456e-9e24-bef1ddd6cc6e tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Took 6.65 seconds to spawn the instance on the hypervisor.
Apr 14 10:46:04 user nova-compute[71509]: DEBUG nova.compute.manager [None req-fd85afb4-9343-456e-9e24-bef1ddd6cc6e tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:46:04 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 10:46:04 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 10:46:04 user nova-compute[71509]: INFO nova.compute.manager [None req-fd85afb4-9343-456e-9e24-bef1ddd6cc6e tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Took 7.48 seconds to build instance.
Apr 14 10:46:04 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-fd85afb4-9343-456e-9e24-bef1ddd6cc6e tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "4b767f1b-e97e-497c-8c70-8806203c76ae" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.577s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:46:04 user nova-compute[71509]: DEBUG nova.compute.manager [req-a5495a79-ab5f-4a14-bf93-16b020078439 req-36eec626-cbc6-46aa-89ba-088b6fc669e0 service nova] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Received event network-vif-plugged-8d8a356d-c198-4e13-a489-5c626fbd025c {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:46:04 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-a5495a79-ab5f-4a14-bf93-16b020078439 req-36eec626-cbc6-46aa-89ba-088b6fc669e0 service nova] Acquiring lock "4b767f1b-e97e-497c-8c70-8806203c76ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:46:04 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-a5495a79-ab5f-4a14-bf93-16b020078439 req-36eec626-cbc6-46aa-89ba-088b6fc669e0 service nova] Lock "4b767f1b-e97e-497c-8c70-8806203c76ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:46:04 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-a5495a79-ab5f-4a14-bf93-16b020078439 req-36eec626-cbc6-46aa-89ba-088b6fc669e0 service nova] Lock "4b767f1b-e97e-497c-8c70-8806203c76ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:46:04 user nova-compute[71509]: DEBUG nova.compute.manager [req-a5495a79-ab5f-4a14-bf93-16b020078439 req-36eec626-cbc6-46aa-89ba-088b6fc669e0 service nova] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] No waiting events found dispatching network-vif-plugged-8d8a356d-c198-4e13-a489-5c626fbd025c {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:46:04 user nova-compute[71509]: WARNING nova.compute.manager [req-a5495a79-ab5f-4a14-bf93-16b020078439 req-36eec626-cbc6-46aa-89ba-088b6fc669e0 service nova] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Received unexpected event network-vif-plugged-8d8a356d-c198-4e13-a489-5c626fbd025c for instance with vm_state active and task_state None.
Apr 14 10:46:04 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-21c01582-3a50-4b7d-a63f-f4fe2201ce63 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Searching for a device in session 15 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71509) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 10:46:04 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-21c01582-3a50-4b7d-a63f-f4fe2201ce63 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3fb9ddb1-b3b7-44ab-8cc2-7a1de34b8e75', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WzsBXDOv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71509) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 10:46:04 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-21c01582-3a50-4b7d-a63f-f4fe2201ce63 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.264s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 10:46:04 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-21c01582-3a50-4b7d-a63f-f4fe2201ce63 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] <== connect_volume: return (1264ms) {'type': 'block', 'scsi_wwn': '26263356137636538', 'path': '/dev/sdb'} {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 10:46:04 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21c01582-3a50-4b7d-a63f-f4fe2201ce63 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] [instance: 55178126-9766-4875-9122-39dcc87ce82c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26263356137636538', 'path': '/dev/sdb'} {{(pid=71509) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 10:46:04 user nova-compute[71509]: DEBUG nova.objects.instance [None req-21c01582-3a50-4b7d-a63f-f4fe2201ce63 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lazy-loading 'flavor' on Instance uuid 55178126-9766-4875-9122-39dcc87ce82c {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:46:04 user nova-compute[71509]: DEBUG nova.virt.libvirt.guest [None req-21c01582-3a50-4b7d-a63f-f4fe2201ce63 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 10:46:04 user nova-compute[71509]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 10:46:04 user nova-compute[71509]:   <source dev="/dev/sdb"/>
Apr 14 10:46:04 user nova-compute[71509]:   <target dev="vdb" bus="virtio"/>
Apr 14 10:46:04 user nova-compute[71509]:   <serial>3fb9ddb1-b3b7-44ab-8cc2-7a1de34b8e75</serial>
Apr 14 10:46:04 user nova-compute[71509]: </disk>
Apr 14 10:46:04 user nova-compute[71509]:  {{(pid=71509) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 10:46:04 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-21c01582-3a50-4b7d-a63f-f4fe2201ce63 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] No BDM found with device name vda, not building metadata. {{(pid=71509) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 10:46:04 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-21c01582-3a50-4b7d-a63f-f4fe2201ce63 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71509) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 10:46:04 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-21c01582-3a50-4b7d-a63f-f4fe2201ce63 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] No VIF found with MAC fa:16:3e:85:23:c1, not building metadata {{(pid=71509) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 10:46:05 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-21c01582-3a50-4b7d-a63f-f4fe2201ce63 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "55178126-9766-4875-9122-39dcc87ce82c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.644s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:46:05 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:46:06 user nova-compute[71509]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681469151.9838915, d1516acc-354e-41f6-a639-61dea870b11e => Stopped> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 10:46:06 user nova-compute[71509]: INFO nova.compute.manager [-] [instance: d1516acc-354e-41f6-a639-61dea870b11e] VM Stopped (Lifecycle Event)
Apr 14 10:46:07 user nova-compute[71509]: DEBUG nova.compute.manager [None req-31cf8df6-0b9d-48a7-a2e0-e2d7e73dc0ad None None] [instance: d1516acc-354e-41f6-a639-61dea870b11e] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:46:07 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:46:10 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:46:12 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:46:15 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:46:16 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:46:17 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-213c658f-e6b9-4e3c-9e79-aaa535f28f79 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Acquiring lock "55178126-9766-4875-9122-39dcc87ce82c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:46:17 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-213c658f-e6b9-4e3c-9e79-aaa535f28f79 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "55178126-9766-4875-9122-39dcc87ce82c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:46:17 user nova-compute[71509]: INFO nova.compute.manager [None req-213c658f-e6b9-4e3c-9e79-aaa535f28f79 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] [instance: 55178126-9766-4875-9122-39dcc87ce82c] Detaching volume 3fb9ddb1-b3b7-44ab-8cc2-7a1de34b8e75
Apr 14 10:46:17 user nova-compute[71509]: INFO nova.virt.block_device [None req-213c658f-e6b9-4e3c-9e79-aaa535f28f79 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] [instance: 55178126-9766-4875-9122-39dcc87ce82c] Attempting to driver detach volume 3fb9ddb1-b3b7-44ab-8cc2-7a1de34b8e75 from mountpoint /dev/vdb
Apr 14 10:46:17 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-213c658f-e6b9-4e3c-9e79-aaa535f28f79 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Attempting to detach device vdb from instance 55178126-9766-4875-9122-39dcc87ce82c from the persistent domain config. {{(pid=71509) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 10:46:17 user nova-compute[71509]: DEBUG nova.virt.libvirt.guest [None req-213c658f-e6b9-4e3c-9e79-aaa535f28f79 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 10:46:17 user nova-compute[71509]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 10:46:17 user nova-compute[71509]:   <source dev="/dev/sdb"/>
Apr 14 10:46:17 user nova-compute[71509]:   <target dev="vdb" bus="virtio"/>
Apr 14 10:46:17 user nova-compute[71509]:   <serial>3fb9ddb1-b3b7-44ab-8cc2-7a1de34b8e75</serial>
Apr 14 10:46:17 user nova-compute[71509]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 10:46:17 user nova-compute[71509]: </disk>
Apr 14 10:46:17 user nova-compute[71509]:  {{(pid=71509) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 10:46:17 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-213c658f-e6b9-4e3c-9e79-aaa535f28f79 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Successfully detached device vdb from instance 55178126-9766-4875-9122-39dcc87ce82c from the persistent domain config.
Apr 14 10:46:17 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-213c658f-e6b9-4e3c-9e79-aaa535f28f79 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 55178126-9766-4875-9122-39dcc87ce82c from the live domain config. {{(pid=71509) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 10:46:17 user nova-compute[71509]: DEBUG nova.virt.libvirt.guest [None req-213c658f-e6b9-4e3c-9e79-aaa535f28f79 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 10:46:17 user nova-compute[71509]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 10:46:17 user nova-compute[71509]:   <source dev="/dev/sdb"/>
Apr 14 10:46:17 user nova-compute[71509]:   <target dev="vdb" bus="virtio"/>
Apr 14 10:46:17 user nova-compute[71509]:   <serial>3fb9ddb1-b3b7-44ab-8cc2-7a1de34b8e75</serial>
Apr 14 10:46:17 user nova-compute[71509]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 10:46:17 user nova-compute[71509]: </disk>
Apr 14 10:46:17 user nova-compute[71509]:  {{(pid=71509) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 10:46:17 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:46:18 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Received event <DeviceRemovedEvent: 1681469178.1279197, 55178126-9766-4875-9122-39dcc87ce82c => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71509) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 10:46:18 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-213c658f-e6b9-4e3c-9e79-aaa535f28f79 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 55178126-9766-4875-9122-39dcc87ce82c {{(pid=71509) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 10:46:18 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-213c658f-e6b9-4e3c-9e79-aaa535f28f79 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Successfully detached device vdb from instance 55178126-9766-4875-9122-39dcc87ce82c from the live domain config.
Apr 14 10:46:18 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-213c658f-e6b9-4e3c-9e79-aaa535f28f79 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] [instance: 55178126-9766-4875-9122-39dcc87ce82c] calling os-brick to detach iSCSI Volume {{(pid=71509) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 10:46:18 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-213c658f-e6b9-4e3c-9e79-aaa535f28f79 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0bf0749390>, {'target_iqn': 'iqn.2010-10.org.openstack:3fb9ddb1-b3b7-44ab-8cc2-7a1de34b8e75', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WzsBXDOv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 10:46:18 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-213c658f-e6b9-4e3c-9e79-aaa535f28f79 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 10:46:18 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-213c658f-e6b9-4e3c-9e79-aaa535f28f79 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 10:46:18 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-213c658f-e6b9-4e3c-9e79-aaa535f28f79 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 10:46:18 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:46:18 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:46:18 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bb0fc5b-23d2-48dc-bedd-fd507f63321d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3fb9ddb1-b3b7-44ab-8cc2-7a1de34b8e75\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:46:18 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-213c658f-e6b9-4e3c-9e79-aaa535f28f79 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 10:46:18 user nova-compute[71509]: No targets found.
Apr 14 10:46:18 user nova-compute[71509]: iSNS:
Apr 14 10:46:18 user nova-compute[71509]: No targets found.
Apr 14 10:46:18 user nova-compute[71509]: STATIC:
Apr 14 10:46:18 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:3fb9ddb1-b3b7-44ab-8cc2-7a1de34b8e75
Apr 14 10:46:18 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:46:18 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:46:18 user nova-compute[71509]: FIRMWARE:
Apr 14 10:46:18 user nova-compute[71509]: No targets found.
Apr 14 10:46:18 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:46:18 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-213c658f-e6b9-4e3c-9e79-aaa535f28f79 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 10:46:18 user nova-compute[71509]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 10:46:18 user nova-compute[71509]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71509) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 10:46:18 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-213c658f-e6b9-4e3c-9e79-aaa535f28f79 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3fb9ddb1-b3b7-44ab-8cc2-7a1de34b8e75', 0)] {{(pid=71509) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 10:46:18 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:46:18 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:46:18 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[97cb131f-1aa5-46b5-b6f8-8bcc9cd7ab0d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3fb9ddb1-b3b7-44ab-8cc2-7a1de34b8e75\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:46:18 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:46:18 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:46:18 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c0e938f-f187-4cc9-aaca-238158097398]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fb9ddb1-b3b7-44ab-8cc2-7a1de34b8e75 (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:46:18 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-213c658f-e6b9-4e3c-9e79-aaa535f28f79 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fb9ddb1-b3b7-44ab-8cc2-7a1de34b8e75 (non-flash)
Apr 14 10:46:18 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:46:18 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-213c658f-e6b9-4e3c-9e79-aaa535f28f79 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fb9ddb1-b3b7-44ab-8cc2-7a1de34b8e75 (non-flash)
Apr 14 10:46:18 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 10:46:18 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-213c658f-e6b9-4e3c-9e79-aaa535f28f79 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0bf0782320>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3fb9ddb1-b3b7-44ab-8cc2-7a1de34b8e75'): ({'sdb'}, set())}) {{(pid=71509) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 10:46:18 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-213c658f-e6b9-4e3c-9e79-aaa535f28f79 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Removing single pathed devices sdb {{(pid=71509) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 10:46:18 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:46:18 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:46:18 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c8e32a5-49fc-407d-acbb-a7ec02aaac2a]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:46:18 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:46:18 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:46:18 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a47308b-1919-4693-84c0-f1f31cea8642]: (4, ('ok\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:46:18 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-213c658f-e6b9-4e3c-9e79-aaa535f28f79 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Flushing IO for device /dev/sdb {{(pid=71509) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 10:46:18 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:46:18 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:46:18 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[63bd8295-adcd-4dd8-a438-ec3a27b0910c]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:46:18 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-213c658f-e6b9-4e3c-9e79-aaa535f28f79 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71509) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 10:46:18 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:46:18 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.058s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:46:18 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[4797830d-3b12-4181-9a4c-65916582946e]: (4, ('1', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:46:18 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-213c658f-e6b9-4e3c-9e79-aaa535f28f79 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71509) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 10:46:18 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-213c658f-e6b9-4e3c-9e79-aaa535f28f79 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] SCSI volumes sdb have been removed. {{(pid=71509) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 10:46:18 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-213c658f-e6b9-4e3c-9e79-aaa535f28f79 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3fb9ddb1-b3b7-44ab-8cc2-7a1de34b8e75')] {{(pid=71509) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 10:46:18 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fb9ddb1-b3b7-44ab-8cc2-7a1de34b8e75 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:46:18 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fb9ddb1-b3b7-44ab-8cc2-7a1de34b8e75 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:46:18 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[5de9eb88-cb37-46d5-909d-7a83cc25c6a0]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:46:18 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-213c658f-e6b9-4e3c-9e79-aaa535f28f79 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:46:18 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fb9ddb1-b3b7-44ab-8cc2-7a1de34b8e75 -p 172.16.0.220:3260 --logout {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:46:18 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fb9ddb1-b3b7-44ab-8cc2-7a1de34b8e75 -p 172.16.0.220:3260 --logout" returned: 0 in 0.043s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:46:18 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[126a3164-280c-4a7e-b765-98644de17af1]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:3fb9ddb1-b3b7-44ab-8cc2-7a1de34b8e75, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:3fb9ddb1-b3b7-44ab-8cc2-7a1de34b8e75, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:46:18 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-213c658f-e6b9-4e3c-9e79-aaa535f28f79 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:3fb9ddb1-b3b7-44ab-8cc2-7a1de34b8e75, portal: 172.16.0.220,3260]
Apr 14 10:46:18 user nova-compute[71509]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:3fb9ddb1-b3b7-44ab-8cc2-7a1de34b8e75, portal: 172.16.0.220,3260] successful.
Apr 14 10:46:18 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:46:18 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fb9ddb1-b3b7-44ab-8cc2-7a1de34b8e75 -p 172.16.0.220:3260 --op delete {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:46:18 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fb9ddb1-b3b7-44ab-8cc2-7a1de34b8e75 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:46:18 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfc98956-7683-49ed-bde9-b531d952b829]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:46:18 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-213c658f-e6b9-4e3c-9e79-aaa535f28f79 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:46:18 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-213c658f-e6b9-4e3c-9e79-aaa535f28f79 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.287s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 10:46:18 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-213c658f-e6b9-4e3c-9e79-aaa535f28f79 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] <== disconnect_volume: return (287ms) None {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 10:46:18 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-213c658f-e6b9-4e3c-9e79-aaa535f28f79 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] [instance: 55178126-9766-4875-9122-39dcc87ce82c] Disconnected iSCSI Volume {{(pid=71509) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 10:46:18 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-fc3bccf8-0966-4ffc-8d4c-9197ad7352e5 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Acquiring lock "31f6ad8c-40d3-4b6e-af07-4848fafc431d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:46:18 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-fc3bccf8-0966-4ffc-8d4c-9197ad7352e5 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Lock "31f6ad8c-40d3-4b6e-af07-4848fafc431d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:46:18 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-fc3bccf8-0966-4ffc-8d4c-9197ad7352e5 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Acquiring lock "31f6ad8c-40d3-4b6e-af07-4848fafc431d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:46:18 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-fc3bccf8-0966-4ffc-8d4c-9197ad7352e5 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Lock "31f6ad8c-40d3-4b6e-af07-4848fafc431d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.003s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:46:18 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-fc3bccf8-0966-4ffc-8d4c-9197ad7352e5 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Lock "31f6ad8c-40d3-4b6e-af07-4848fafc431d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:46:18 user nova-compute[71509]: INFO nova.compute.manager [None req-fc3bccf8-0966-4ffc-8d4c-9197ad7352e5 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] [instance: 31f6ad8c-40d3-4b6e-af07-4848fafc431d] Terminating instance
Apr 14 10:46:18 user nova-compute[71509]: DEBUG nova.compute.manager [None req-fc3bccf8-0966-4ffc-8d4c-9197ad7352e5 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] [instance: 31f6ad8c-40d3-4b6e-af07-4848fafc431d] Start destroying the instance on the hypervisor. {{(pid=71509) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 10:46:19 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:46:19 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:46:19 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:46:19 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:46:19 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:46:19 user nova-compute[71509]: DEBUG nova.compute.manager [req-8f39d43d-485e-4831-837a-fff5f63d4437 req-26dc5944-e468-416c-baa8-e7eafff05145 service nova] [instance: 31f6ad8c-40d3-4b6e-af07-4848fafc431d] Received event network-vif-unplugged-edef0af3-01e9-4008-9017-119519f73981 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:46:19 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-8f39d43d-485e-4831-837a-fff5f63d4437 req-26dc5944-e468-416c-baa8-e7eafff05145 service nova] Acquiring lock "31f6ad8c-40d3-4b6e-af07-4848fafc431d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:46:19 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-8f39d43d-485e-4831-837a-fff5f63d4437 req-26dc5944-e468-416c-baa8-e7eafff05145 service nova] Lock "31f6ad8c-40d3-4b6e-af07-4848fafc431d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:46:19 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-8f39d43d-485e-4831-837a-fff5f63d4437 req-26dc5944-e468-416c-baa8-e7eafff05145 service nova] Lock "31f6ad8c-40d3-4b6e-af07-4848fafc431d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:46:19 user nova-compute[71509]: DEBUG nova.compute.manager [req-8f39d43d-485e-4831-837a-fff5f63d4437 req-26dc5944-e468-416c-baa8-e7eafff05145 service nova] [instance: 31f6ad8c-40d3-4b6e-af07-4848fafc431d] No waiting events found dispatching network-vif-unplugged-edef0af3-01e9-4008-9017-119519f73981 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:46:19 user nova-compute[71509]: DEBUG nova.compute.manager [req-8f39d43d-485e-4831-837a-fff5f63d4437 req-26dc5944-e468-416c-baa8-e7eafff05145 service nova] [instance: 31f6ad8c-40d3-4b6e-af07-4848fafc431d] Received event network-vif-unplugged-edef0af3-01e9-4008-9017-119519f73981 for instance with task_state deleting. {{(pid=71509) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 10:46:19 user nova-compute[71509]: DEBUG nova.objects.instance [None req-213c658f-e6b9-4e3c-9e79-aaa535f28f79 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lazy-loading 'flavor' on Instance uuid 55178126-9766-4875-9122-39dcc87ce82c {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:46:19 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-213c658f-e6b9-4e3c-9e79-aaa535f28f79 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "55178126-9766-4875-9122-39dcc87ce82c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.830s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:46:19 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: 31f6ad8c-40d3-4b6e-af07-4848fafc431d] Instance destroyed successfully.
Apr 14 10:46:19 user nova-compute[71509]: DEBUG nova.objects.instance [None req-fc3bccf8-0966-4ffc-8d4c-9197ad7352e5 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Lazy-loading 'resources' on Instance uuid 31f6ad8c-40d3-4b6e-af07-4848fafc431d {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:46:19 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-fc3bccf8-0966-4ffc-8d4c-9197ad7352e5 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='True',created_at=2023-04-14T10:43:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1767995033',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-device-tagging-server-1767995033',id=8,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAg92rKWvJLt4w+A2kLtzcKlRZllCdVCDpTieGdgT9uh8Ad5t/MvIIcaNE/YQBHARvcYgshBiRX60EUhdlUvUMSVKsG5MBNdYdax1bLq6yx8+hLej82SZYaOv31/N253aw==',key_name='tempest-keypair-1362955333',keypairs=<?>,launch_index=0,launched_at=2023-04-14T10:43:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fe8cdf0a5d7f49a9897167eb79dbfc39',ramdisk_id='',reservation_id='r-7roeogsj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1745854352',owner_user_name='tempest-TaggedAttachmentsTest-1745854352-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T10:43:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c7ce31180e5946d4a027ae6ac9d136fa',uuid=31f6ad8c-40d3-4b6e-af07-4848fafc431d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "edef0af3-01e9-4008-9017-119519f73981", "address": "fa:16:3e:2a:16:ab", "network": {"id": "d0f56839-45f6-4d90-9a69-0a5d300e3c53", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-962046654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe8cdf0a5d7f49a9897167eb79dbfc39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedef0af3-01", "ovs_interfaceid": "edef0af3-01e9-4008-9017-119519f73981", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 10:46:19 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-fc3bccf8-0966-4ffc-8d4c-9197ad7352e5 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Converting VIF {"id": "edef0af3-01e9-4008-9017-119519f73981", "address": "fa:16:3e:2a:16:ab", "network": {"id": "d0f56839-45f6-4d90-9a69-0a5d300e3c53", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-962046654-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe8cdf0a5d7f49a9897167eb79dbfc39", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedef0af3-01", "ovs_interfaceid": "edef0af3-01e9-4008-9017-119519f73981", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:46:19 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-fc3bccf8-0966-4ffc-8d4c-9197ad7352e5 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2a:16:ab,bridge_name='br-int',has_traffic_filtering=True,id=edef0af3-01e9-4008-9017-119519f73981,network=Network(d0f56839-45f6-4d90-9a69-0a5d300e3c53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedef0af3-01') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:46:19 user nova-compute[71509]: DEBUG os_vif [None req-fc3bccf8-0966-4ffc-8d4c-9197ad7352e5 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2a:16:ab,bridge_name='br-int',has_traffic_filtering=True,id=edef0af3-01e9-4008-9017-119519f73981,network=Network(d0f56839-45f6-4d90-9a69-0a5d300e3c53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedef0af3-01') {{(pid=71509) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 10:46:19 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:46:19 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapedef0af3-01, bridge=br-int, if_exists=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:46:19 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:46:19 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 10:46:19 user nova-compute[71509]: INFO os_vif [None req-fc3bccf8-0966-4ffc-8d4c-9197ad7352e5 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2a:16:ab,bridge_name='br-int',has_traffic_filtering=True,id=edef0af3-01e9-4008-9017-119519f73981,network=Network(d0f56839-45f6-4d90-9a69-0a5d300e3c53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedef0af3-01')
Apr 14 10:46:19 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-fc3bccf8-0966-4ffc-8d4c-9197ad7352e5 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] [instance: 31f6ad8c-40d3-4b6e-af07-4848fafc431d] Deleting instance files /opt/stack/data/nova/instances/31f6ad8c-40d3-4b6e-af07-4848fafc431d_del
Apr 14 10:46:19 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-fc3bccf8-0966-4ffc-8d4c-9197ad7352e5 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] [instance: 31f6ad8c-40d3-4b6e-af07-4848fafc431d] Deletion of /opt/stack/data/nova/instances/31f6ad8c-40d3-4b6e-af07-4848fafc431d_del complete
Apr 14 10:46:19 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:46:19 user nova-compute[71509]: INFO nova.compute.manager [None req-fc3bccf8-0966-4ffc-8d4c-9197ad7352e5 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] [instance: 31f6ad8c-40d3-4b6e-af07-4848fafc431d] Took 0.88 seconds to destroy the instance on the hypervisor.
Apr 14 10:46:19 user nova-compute[71509]: DEBUG oslo.service.loopingcall [None req-fc3bccf8-0966-4ffc-8d4c-9197ad7352e5 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71509) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 10:46:19 user nova-compute[71509]: DEBUG nova.compute.manager [-] [instance: 31f6ad8c-40d3-4b6e-af07-4848fafc431d] Deallocating network for instance {{(pid=71509) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 10:46:19 user nova-compute[71509]: DEBUG nova.network.neutron [-] [instance: 31f6ad8c-40d3-4b6e-af07-4848fafc431d] deallocate_for_instance() {{(pid=71509) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 10:46:21 user nova-compute[71509]: DEBUG nova.network.neutron [-] [instance: 31f6ad8c-40d3-4b6e-af07-4848fafc431d] Updating instance_info_cache with network_info: [] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:46:21 user nova-compute[71509]: INFO nova.compute.manager [-] [instance: 31f6ad8c-40d3-4b6e-af07-4848fafc431d] Took 1.22 seconds to deallocate network for instance.
Apr 14 10:46:21 user nova-compute[71509]: DEBUG nova.compute.manager [req-fae5af27-ffbf-491e-93b9-4cabed0f64cf req-b241344e-a4e1-472b-8702-a85d5e322dd8 service nova] [instance: 31f6ad8c-40d3-4b6e-af07-4848fafc431d] Received event network-vif-deleted-edef0af3-01e9-4008-9017-119519f73981 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:46:21 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-fc3bccf8-0966-4ffc-8d4c-9197ad7352e5 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:46:21 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-fc3bccf8-0966-4ffc-8d4c-9197ad7352e5 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:46:21 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-fc3bccf8-0966-4ffc-8d4c-9197ad7352e5 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 10:46:21 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-fc3bccf8-0966-4ffc-8d4c-9197ad7352e5 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 10:46:21 user nova-compute[71509]: DEBUG nova.compute.manager [req-6d2f21ec-8d74-4735-bdc7-743490d107e0 req-b13bfdd0-8dcc-4b9d-ae82-d385782b4fe6 service nova] [instance: 31f6ad8c-40d3-4b6e-af07-4848fafc431d] Received event network-vif-plugged-edef0af3-01e9-4008-9017-119519f73981 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:46:21 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-6d2f21ec-8d74-4735-bdc7-743490d107e0 req-b13bfdd0-8dcc-4b9d-ae82-d385782b4fe6 service nova] Acquiring lock "31f6ad8c-40d3-4b6e-af07-4848fafc431d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:46:21 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-6d2f21ec-8d74-4735-bdc7-743490d107e0 req-b13bfdd0-8dcc-4b9d-ae82-d385782b4fe6 service nova] Lock "31f6ad8c-40d3-4b6e-af07-4848fafc431d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:46:21 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-6d2f21ec-8d74-4735-bdc7-743490d107e0 req-b13bfdd0-8dcc-4b9d-ae82-d385782b4fe6 service nova] Lock "31f6ad8c-40d3-4b6e-af07-4848fafc431d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:46:21 user nova-compute[71509]: DEBUG nova.compute.manager [req-6d2f21ec-8d74-4735-bdc7-743490d107e0 req-b13bfdd0-8dcc-4b9d-ae82-d385782b4fe6 service nova] [instance: 31f6ad8c-40d3-4b6e-af07-4848fafc431d] No waiting events found dispatching network-vif-plugged-edef0af3-01e9-4008-9017-119519f73981 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:46:21 user nova-compute[71509]: WARNING nova.compute.manager [req-6d2f21ec-8d74-4735-bdc7-743490d107e0 req-b13bfdd0-8dcc-4b9d-ae82-d385782b4fe6 service nova] [instance: 31f6ad8c-40d3-4b6e-af07-4848fafc431d] Received unexpected event network-vif-plugged-edef0af3-01e9-4008-9017-119519f73981 for instance with vm_state deleted and task_state None.
Apr 14 10:46:21 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-fc3bccf8-0966-4ffc-8d4c-9197ad7352e5 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.304s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:46:21 user nova-compute[71509]: INFO nova.scheduler.client.report [None req-fc3bccf8-0966-4ffc-8d4c-9197ad7352e5 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Deleted allocations for instance 31f6ad8c-40d3-4b6e-af07-4848fafc431d
Apr 14 10:46:21 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-fc3bccf8-0966-4ffc-8d4c-9197ad7352e5 tempest-TaggedAttachmentsTest-1745854352 tempest-TaggedAttachmentsTest-1745854352-project-member] Lock "31f6ad8c-40d3-4b6e-af07-4848fafc431d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.646s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:46:22 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:46:24 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:46:26 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:46:27 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:46:28 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:46:29 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:46:30 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-00fa7754-3bb6-41c0-94d2-ae44f9fbfb90 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Acquiring lock "e479154a-acd6-47aa-9a5b-43c6e0feda07" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:46:30 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-00fa7754-3bb6-41c0-94d2-ae44f9fbfb90 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "e479154a-acd6-47aa-9a5b-43c6e0feda07" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:46:30 user nova-compute[71509]: DEBUG nova.compute.manager [None req-00fa7754-3bb6-41c0-94d2-ae44f9fbfb90 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: e479154a-acd6-47aa-9a5b-43c6e0feda07] Starting instance... {{(pid=71509) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 10:46:30 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-00fa7754-3bb6-41c0-94d2-ae44f9fbfb90 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:46:30 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-00fa7754-3bb6-41c0-94d2-ae44f9fbfb90 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:46:30 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-00fa7754-3bb6-41c0-94d2-ae44f9fbfb90 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71509) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 10:46:30 user nova-compute[71509]: INFO nova.compute.claims [None req-00fa7754-3bb6-41c0-94d2-ae44f9fbfb90 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: e479154a-acd6-47aa-9a5b-43c6e0feda07] Claim successful on node user
Apr 14 10:46:30 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-00fa7754-3bb6-41c0-94d2-ae44f9fbfb90 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 10:46:30 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-00fa7754-3bb6-41c0-94d2-ae44f9fbfb90 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 10:46:30 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-00fa7754-3bb6-41c0-94d2-ae44f9fbfb90 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.466s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:46:30 user nova-compute[71509]: DEBUG nova.compute.manager [None req-00fa7754-3bb6-41c0-94d2-ae44f9fbfb90 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: e479154a-acd6-47aa-9a5b-43c6e0feda07] Start building networks asynchronously for instance. {{(pid=71509) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 10:46:30 user nova-compute[71509]: DEBUG nova.compute.manager [None req-00fa7754-3bb6-41c0-94d2-ae44f9fbfb90 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: e479154a-acd6-47aa-9a5b-43c6e0feda07] Allocating IP information in the background. {{(pid=71509) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 10:46:30 user nova-compute[71509]: DEBUG nova.network.neutron [None req-00fa7754-3bb6-41c0-94d2-ae44f9fbfb90 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: e479154a-acd6-47aa-9a5b-43c6e0feda07] allocate_for_instance() {{(pid=71509) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 10:46:30 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-00fa7754-3bb6-41c0-94d2-ae44f9fbfb90 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: e479154a-acd6-47aa-9a5b-43c6e0feda07] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 10:46:30 user nova-compute[71509]: DEBUG nova.compute.manager [None req-00fa7754-3bb6-41c0-94d2-ae44f9fbfb90 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: e479154a-acd6-47aa-9a5b-43c6e0feda07] Start building block device mappings for instance. {{(pid=71509) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 10:46:30 user nova-compute[71509]: DEBUG nova.policy [None req-00fa7754-3bb6-41c0-94d2-ae44f9fbfb90 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '395bc9d7007c4e01ac7effd418bcea19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71289f80a05141f482cb538dac3d7b38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71509) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 10:46:30 user nova-compute[71509]: DEBUG nova.compute.manager [None req-00fa7754-3bb6-41c0-94d2-ae44f9fbfb90 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: e479154a-acd6-47aa-9a5b-43c6e0feda07] Start spawning the instance on the hypervisor. {{(pid=71509) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 10:46:30 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-00fa7754-3bb6-41c0-94d2-ae44f9fbfb90 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: e479154a-acd6-47aa-9a5b-43c6e0feda07] Creating instance directory {{(pid=71509) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 10:46:30 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-00fa7754-3bb6-41c0-94d2-ae44f9fbfb90 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: e479154a-acd6-47aa-9a5b-43c6e0feda07] Creating image(s)
Apr 14 10:46:30 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-00fa7754-3bb6-41c0-94d2-ae44f9fbfb90 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Acquiring lock "/opt/stack/data/nova/instances/e479154a-acd6-47aa-9a5b-43c6e0feda07/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:46:30 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-00fa7754-3bb6-41c0-94d2-ae44f9fbfb90 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "/opt/stack/data/nova/instances/e479154a-acd6-47aa-9a5b-43c6e0feda07/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:46:30 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-00fa7754-3bb6-41c0-94d2-ae44f9fbfb90 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "/opt/stack/data/nova/instances/e479154a-acd6-47aa-9a5b-43c6e0feda07/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.010s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:46:30 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-00fa7754-3bb6-41c0-94d2-ae44f9fbfb90 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:46:31 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-00fa7754-3bb6-41c0-94d2-ae44f9fbfb90 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json" returned: 0 in 0.141s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:46:31 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-00fa7754-3bb6-41c0-94d2-ae44f9fbfb90 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Acquiring lock "5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:46:31 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-00fa7754-3bb6-41c0-94d2-ae44f9fbfb90 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:46:31 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-00fa7754-3bb6-41c0-94d2-ae44f9fbfb90 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:46:31 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-00fa7754-3bb6-41c0-94d2-ae44f9fbfb90 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json" returned: 0 in 0.142s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:46:31 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-00fa7754-3bb6-41c0-94d2-ae44f9fbfb90 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18,backing_fmt=raw /opt/stack/data/nova/instances/e479154a-acd6-47aa-9a5b-43c6e0feda07/disk 1073741824 {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:46:31 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-00fa7754-3bb6-41c0-94d2-ae44f9fbfb90 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18,backing_fmt=raw /opt/stack/data/nova/instances/e479154a-acd6-47aa-9a5b-43c6e0feda07/disk 1073741824" returned: 0 in 0.055s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:46:31 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-00fa7754-3bb6-41c0-94d2-ae44f9fbfb90 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.205s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:46:31 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-00fa7754-3bb6-41c0-94d2-ae44f9fbfb90 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:46:31 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-00fa7754-3bb6-41c0-94d2-ae44f9fbfb90 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json" returned: 0 in 0.172s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:46:31 user nova-compute[71509]: DEBUG nova.virt.disk.api [None req-00fa7754-3bb6-41c0-94d2-ae44f9fbfb90 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e479154a-acd6-47aa-9a5b-43c6e0feda07/disk. size=1073741824 {{(pid=71509) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 10:46:31 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-00fa7754-3bb6-41c0-94d2-ae44f9fbfb90 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e479154a-acd6-47aa-9a5b-43c6e0feda07/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:46:31 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:46:31 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-00fa7754-3bb6-41c0-94d2-ae44f9fbfb90 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e479154a-acd6-47aa-9a5b-43c6e0feda07/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:46:31 user nova-compute[71509]: DEBUG nova.virt.disk.api [None req-00fa7754-3bb6-41c0-94d2-ae44f9fbfb90 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Cannot resize image /opt/stack/data/nova/instances/e479154a-acd6-47aa-9a5b-43c6e0feda07/disk to a smaller size. {{(pid=71509) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 10:46:31 user nova-compute[71509]: DEBUG nova.objects.instance [None req-00fa7754-3bb6-41c0-94d2-ae44f9fbfb90 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lazy-loading 'migration_context' on Instance uuid e479154a-acd6-47aa-9a5b-43c6e0feda07 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:46:31 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-00fa7754-3bb6-41c0-94d2-ae44f9fbfb90 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: e479154a-acd6-47aa-9a5b-43c6e0feda07] Created local disks {{(pid=71509) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 10:46:31 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-00fa7754-3bb6-41c0-94d2-ae44f9fbfb90 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: e479154a-acd6-47aa-9a5b-43c6e0feda07] Ensure instance console log exists: /opt/stack/data/nova/instances/e479154a-acd6-47aa-9a5b-43c6e0feda07/console.log {{(pid=71509) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 10:46:31 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-00fa7754-3bb6-41c0-94d2-ae44f9fbfb90 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:46:31 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-00fa7754-3bb6-41c0-94d2-ae44f9fbfb90 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:46:31 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-00fa7754-3bb6-41c0-94d2-ae44f9fbfb90 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:46:31 user nova-compute[71509]: DEBUG nova.network.neutron [None req-00fa7754-3bb6-41c0-94d2-ae44f9fbfb90 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: e479154a-acd6-47aa-9a5b-43c6e0feda07] Successfully created port: 2fbfd894-8e16-4039-b726-638e802602c5 {{(pid=71509) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 10:46:32 user nova-compute[71509]: DEBUG nova.network.neutron [None req-00fa7754-3bb6-41c0-94d2-ae44f9fbfb90 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: e479154a-acd6-47aa-9a5b-43c6e0feda07] Successfully updated port: 2fbfd894-8e16-4039-b726-638e802602c5 {{(pid=71509) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 10:46:32 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-00fa7754-3bb6-41c0-94d2-ae44f9fbfb90 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Acquiring lock "refresh_cache-e479154a-acd6-47aa-9a5b-43c6e0feda07" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:46:32 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-00fa7754-3bb6-41c0-94d2-ae44f9fbfb90 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Acquired lock "refresh_cache-e479154a-acd6-47aa-9a5b-43c6e0feda07" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:46:32 user nova-compute[71509]: DEBUG nova.network.neutron [None req-00fa7754-3bb6-41c0-94d2-ae44f9fbfb90 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: e479154a-acd6-47aa-9a5b-43c6e0feda07] Building network info cache for instance {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 10:46:32 user nova-compute[71509]: DEBUG nova.compute.manager [req-2c2ad35f-f050-49a3-ace5-9300827f0de4 req-e0fbd520-5958-494b-bad2-cf711aacf6be service nova] [instance: e479154a-acd6-47aa-9a5b-43c6e0feda07] Received event network-changed-2fbfd894-8e16-4039-b726-638e802602c5 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:46:32 user nova-compute[71509]: DEBUG nova.compute.manager [req-2c2ad35f-f050-49a3-ace5-9300827f0de4 req-e0fbd520-5958-494b-bad2-cf711aacf6be service nova] [instance: e479154a-acd6-47aa-9a5b-43c6e0feda07] Refreshing instance network info cache due to event network-changed-2fbfd894-8e16-4039-b726-638e802602c5. {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 10:46:32 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-2c2ad35f-f050-49a3-ace5-9300827f0de4 req-e0fbd520-5958-494b-bad2-cf711aacf6be service nova] Acquiring lock "refresh_cache-e479154a-acd6-47aa-9a5b-43c6e0feda07" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:46:32 user nova-compute[71509]: DEBUG nova.network.neutron [None req-00fa7754-3bb6-41c0-94d2-ae44f9fbfb90 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: e479154a-acd6-47aa-9a5b-43c6e0feda07] Instance cache missing network info. {{(pid=71509) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 10:46:32 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:46:33 user nova-compute[71509]: DEBUG nova.network.neutron [None req-00fa7754-3bb6-41c0-94d2-ae44f9fbfb90 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: e479154a-acd6-47aa-9a5b-43c6e0feda07] Updating instance_info_cache with network_info: [{"id": "2fbfd894-8e16-4039-b726-638e802602c5", "address": "fa:16:3e:4d:3b:0d", "network": {"id": "07f1f39e-292a-4e73-b4ed-99e5799d6fa8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1339551596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71289f80a05141f482cb538dac3d7b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fbfd894-8e", "ovs_interfaceid": "2fbfd894-8e16-4039-b726-638e802602c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:46:33 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-00fa7754-3bb6-41c0-94d2-ae44f9fbfb90 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Releasing lock "refresh_cache-e479154a-acd6-47aa-9a5b-43c6e0feda07" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:46:33 user nova-compute[71509]: DEBUG nova.compute.manager [None req-00fa7754-3bb6-41c0-94d2-ae44f9fbfb90 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: e479154a-acd6-47aa-9a5b-43c6e0feda07] Instance network_info: |[{"id": "2fbfd894-8e16-4039-b726-638e802602c5", "address": "fa:16:3e:4d:3b:0d", "network": {"id": "07f1f39e-292a-4e73-b4ed-99e5799d6fa8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1339551596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71289f80a05141f482cb538dac3d7b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fbfd894-8e", "ovs_interfaceid": "2fbfd894-8e16-4039-b726-638e802602c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71509) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 10:46:33 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-2c2ad35f-f050-49a3-ace5-9300827f0de4 req-e0fbd520-5958-494b-bad2-cf711aacf6be service nova] Acquired lock "refresh_cache-e479154a-acd6-47aa-9a5b-43c6e0feda07" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:46:33 user nova-compute[71509]: DEBUG nova.network.neutron [req-2c2ad35f-f050-49a3-ace5-9300827f0de4 req-e0fbd520-5958-494b-bad2-cf711aacf6be service nova] [instance: e479154a-acd6-47aa-9a5b-43c6e0feda07] Refreshing network info cache for port 2fbfd894-8e16-4039-b726-638e802602c5 {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 10:46:33 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-00fa7754-3bb6-41c0-94d2-ae44f9fbfb90 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: e479154a-acd6-47aa-9a5b-43c6e0feda07] Start _get_guest_xml network_info=[{"id": "2fbfd894-8e16-4039-b726-638e802602c5", "address": "fa:16:3e:4d:3b:0d", "network": {"id": "07f1f39e-292a-4e73-b4ed-99e5799d6fa8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1339551596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71289f80a05141f482cb538dac3d7b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fbfd894-8e", "ovs_interfaceid": "2fbfd894-8e16-4039-b726-638e802602c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T10:38:55Z,direct_url=<?>,disk_format='qcow2',id=048ec0ee-0465-448d-8b4c-f072acb101dc,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='9742d6ad20cf48d9bab0fdbcc9491db9',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T10:38:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '048ec0ee-0465-448d-8b4c-f072acb101dc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71509) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 10:46:33 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-00fa7754-3bb6-41c0-94d2-ae44f9fbfb90 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:46:33 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-00fa7754-3bb6-41c0-94d2-ae44f9fbfb90 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:46:33 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-00fa7754-3bb6-41c0-94d2-ae44f9fbfb90 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71509) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 10:46:33 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-00fa7754-3bb6-41c0-94d2-ae44f9fbfb90 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T10:40:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T10:38:55Z,direct_url=<?>,disk_format='qcow2',id=048ec0ee-0465-448d-8b4c-f072acb101dc,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='9742d6ad20cf48d9bab0fdbcc9491db9',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T10:38:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 10:46:33 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-00fa7754-3bb6-41c0-94d2-ae44f9fbfb90 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Flavor limits 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 10:46:33 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-00fa7754-3bb6-41c0-94d2-ae44f9fbfb90 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Image limits 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 10:46:33 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-00fa7754-3bb6-41c0-94d2-ae44f9fbfb90 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Flavor pref 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 10:46:33 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-00fa7754-3bb6-41c0-94d2-ae44f9fbfb90 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Image pref 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 10:46:33 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-00fa7754-3bb6-41c0-94d2-ae44f9fbfb90 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 10:46:33 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-00fa7754-3bb6-41c0-94d2-ae44f9fbfb90 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 10:46:33 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-00fa7754-3bb6-41c0-94d2-ae44f9fbfb90 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71509) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 10:46:33 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-00fa7754-3bb6-41c0-94d2-ae44f9fbfb90 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Got 1 possible topologies {{(pid=71509) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 10:46:33 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-00fa7754-3bb6-41c0-94d2-ae44f9fbfb90 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 10:46:33 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-00fa7754-3bb6-41c0-94d2-ae44f9fbfb90 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 10:46:33 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-00fa7754-3bb6-41c0-94d2-ae44f9fbfb90 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T10:46:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-917884205',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-917884205',id=15,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='71289f80a05141f482cb538dac3d7b38',ramdisk_id='',reservation_id='r-lrwitdb5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2130542140',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T10:46:31Z,user_data=None,user_id='395bc9d7007c4e01ac7effd418bcea19',uuid=e479154a-acd6-47aa-9a5b-43c6e0feda07,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2fbfd894-8e16-4039-b726-638e802602c5", "address": "fa:16:3e:4d:3b:0d", "network": {"id": "07f1f39e-292a-4e73-b4ed-99e5799d6fa8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1339551596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71289f80a05141f482cb538dac3d7b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fbfd894-8e", "ovs_interfaceid": "2fbfd894-8e16-4039-b726-638e802602c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71509) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 10:46:33 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-00fa7754-3bb6-41c0-94d2-ae44f9fbfb90 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Converting VIF {"id": "2fbfd894-8e16-4039-b726-638e802602c5", "address": "fa:16:3e:4d:3b:0d", "network": {"id": "07f1f39e-292a-4e73-b4ed-99e5799d6fa8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1339551596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71289f80a05141f482cb538dac3d7b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fbfd894-8e", "ovs_interfaceid": "2fbfd894-8e16-4039-b726-638e802602c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:46:33 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-00fa7754-3bb6-41c0-94d2-ae44f9fbfb90 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:3b:0d,bridge_name='br-int',has_traffic_filtering=True,id=2fbfd894-8e16-4039-b726-638e802602c5,network=Network(07f1f39e-292a-4e73-b4ed-99e5799d6fa8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2fbfd894-8e') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:46:33 user nova-compute[71509]: DEBUG nova.objects.instance [None req-00fa7754-3bb6-41c0-94d2-ae44f9fbfb90 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lazy-loading 'pci_devices' on Instance uuid e479154a-acd6-47aa-9a5b-43c6e0feda07 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:46:33 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-00fa7754-3bb6-41c0-94d2-ae44f9fbfb90 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: e479154a-acd6-47aa-9a5b-43c6e0feda07] End _get_guest_xml xml=<domain type="kvm">
Apr 14 10:46:33 user nova-compute[71509]:   <uuid>e479154a-acd6-47aa-9a5b-43c6e0feda07</uuid>
Apr 14 10:46:33 user nova-compute[71509]:   <name>instance-0000000f</name>
Apr 14 10:46:33 user nova-compute[71509]:   <memory>131072</memory>
Apr 14 10:46:33 user nova-compute[71509]:   <vcpu>1</vcpu>
Apr 14 10:46:33 user nova-compute[71509]:   <metadata>
Apr 14 10:46:33 user nova-compute[71509]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 10:46:33 user nova-compute[71509]:       <nova:package version="0.0.0"/>
Apr 14 10:46:33 user nova-compute[71509]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-917884205</nova:name>
Apr 14 10:46:33 user nova-compute[71509]:       <nova:creationTime>2023-04-14 10:46:33</nova:creationTime>
Apr 14 10:46:33 user nova-compute[71509]:       <nova:flavor name="m1.nano">
Apr 14 10:46:33 user nova-compute[71509]:         <nova:memory>128</nova:memory>
Apr 14 10:46:33 user nova-compute[71509]:         <nova:disk>1</nova:disk>
Apr 14 10:46:33 user nova-compute[71509]:         <nova:swap>0</nova:swap>
Apr 14 10:46:33 user nova-compute[71509]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 10:46:33 user nova-compute[71509]:         <nova:vcpus>1</nova:vcpus>
Apr 14 10:46:33 user nova-compute[71509]:       </nova:flavor>
Apr 14 10:46:33 user nova-compute[71509]:       <nova:owner>
Apr 14 10:46:33 user nova-compute[71509]:         <nova:user uuid="395bc9d7007c4e01ac7effd418bcea19">tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member</nova:user>
Apr 14 10:46:33 user nova-compute[71509]:         <nova:project uuid="71289f80a05141f482cb538dac3d7b38">tempest-ServerBootFromVolumeStableRescueTest-2130542140</nova:project>
Apr 14 10:46:33 user nova-compute[71509]:       </nova:owner>
Apr 14 10:46:33 user nova-compute[71509]:       <nova:root type="image" uuid="048ec0ee-0465-448d-8b4c-f072acb101dc"/>
Apr 14 10:46:33 user nova-compute[71509]:       <nova:ports>
Apr 14 10:46:33 user nova-compute[71509]:         <nova:port uuid="2fbfd894-8e16-4039-b726-638e802602c5">
Apr 14 10:46:33 user nova-compute[71509]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 14 10:46:33 user nova-compute[71509]:         </nova:port>
Apr 14 10:46:33 user nova-compute[71509]:       </nova:ports>
Apr 14 10:46:33 user nova-compute[71509]:     </nova:instance>
Apr 14 10:46:33 user nova-compute[71509]:   </metadata>
Apr 14 10:46:33 user nova-compute[71509]:   <sysinfo type="smbios">
Apr 14 10:46:33 user nova-compute[71509]:     <system>
Apr 14 10:46:33 user nova-compute[71509]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 10:46:33 user nova-compute[71509]:       <entry name="product">OpenStack Nova</entry>
Apr 14 10:46:33 user nova-compute[71509]:       <entry name="version">0.0.0</entry>
Apr 14 10:46:33 user nova-compute[71509]:       <entry name="serial">e479154a-acd6-47aa-9a5b-43c6e0feda07</entry>
Apr 14 10:46:33 user nova-compute[71509]:       <entry name="uuid">e479154a-acd6-47aa-9a5b-43c6e0feda07</entry>
Apr 14 10:46:33 user nova-compute[71509]:       <entry name="family">Virtual Machine</entry>
Apr 14 10:46:33 user nova-compute[71509]:     </system>
Apr 14 10:46:33 user nova-compute[71509]:   </sysinfo>
Apr 14 10:46:33 user nova-compute[71509]:   <os>
Apr 14 10:46:33 user nova-compute[71509]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 10:46:33 user nova-compute[71509]:     <boot dev="hd"/>
Apr 14 10:46:33 user nova-compute[71509]:     <smbios mode="sysinfo"/>
Apr 14 10:46:33 user nova-compute[71509]:   </os>
Apr 14 10:46:33 user nova-compute[71509]:   <features>
Apr 14 10:46:33 user nova-compute[71509]:     <acpi/>
Apr 14 10:46:33 user nova-compute[71509]:     <apic/>
Apr 14 10:46:33 user nova-compute[71509]:     <vmcoreinfo/>
Apr 14 10:46:33 user nova-compute[71509]:   </features>
Apr 14 10:46:33 user nova-compute[71509]:   <clock offset="utc">
Apr 14 10:46:33 user nova-compute[71509]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 10:46:33 user nova-compute[71509]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 10:46:33 user nova-compute[71509]:     <timer name="hpet" present="no"/>
Apr 14 10:46:33 user nova-compute[71509]:   </clock>
Apr 14 10:46:33 user nova-compute[71509]:   <cpu mode="custom" match="exact">
Apr 14 10:46:33 user nova-compute[71509]:     <model>Nehalem</model>
Apr 14 10:46:33 user nova-compute[71509]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 10:46:33 user nova-compute[71509]:   </cpu>
Apr 14 10:46:33 user nova-compute[71509]:   <devices>
Apr 14 10:46:33 user nova-compute[71509]:     <disk type="file" device="disk">
Apr 14 10:46:33 user nova-compute[71509]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 10:46:33 user nova-compute[71509]:       <source file="/opt/stack/data/nova/instances/e479154a-acd6-47aa-9a5b-43c6e0feda07/disk"/>
Apr 14 10:46:33 user nova-compute[71509]:       <target dev="vda" bus="virtio"/>
Apr 14 10:46:33 user nova-compute[71509]:     </disk>
Apr 14 10:46:33 user nova-compute[71509]:     <interface type="ethernet">
Apr 14 10:46:33 user nova-compute[71509]:       <mac address="fa:16:3e:4d:3b:0d"/>
Apr 14 10:46:33 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 10:46:33 user nova-compute[71509]:       <mtu size="1442"/>
Apr 14 10:46:33 user nova-compute[71509]:       <target dev="tap2fbfd894-8e"/>
Apr 14 10:46:33 user nova-compute[71509]:     </interface>
Apr 14 10:46:33 user nova-compute[71509]:     <serial type="pty">
Apr 14 10:46:33 user nova-compute[71509]:       <log file="/opt/stack/data/nova/instances/e479154a-acd6-47aa-9a5b-43c6e0feda07/console.log" append="off"/>
Apr 14 10:46:33 user nova-compute[71509]:     </serial>
Apr 14 10:46:33 user nova-compute[71509]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 10:46:33 user nova-compute[71509]:     <video>
Apr 14 10:46:33 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 10:46:33 user nova-compute[71509]:     </video>
Apr 14 10:46:33 user nova-compute[71509]:     <rng model="virtio">
Apr 14 10:46:33 user nova-compute[71509]:       <backend model="random">/dev/urandom</backend>
Apr 14 10:46:33 user nova-compute[71509]:     </rng>
Apr 14 10:46:33 user nova-compute[71509]:     <controller type="usb" index="0" model="none"/>
Apr 14 10:46:33 user nova-compute[71509]:     <memballoon model="virtio">
Apr 14 10:46:33 user nova-compute[71509]:       <stats period="10"/>
Apr 14 10:46:33 user nova-compute[71509]:     </memballoon>
Apr 14 10:46:33 user nova-compute[71509]:   </devices>
Apr 14 10:46:33 user nova-compute[71509]: </domain>
Apr 14 10:46:33 user nova-compute[71509]:  {{(pid=71509) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 10:46:33 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-00fa7754-3bb6-41c0-94d2-ae44f9fbfb90 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T10:46:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-917884205',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-917884205',id=15,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='71289f80a05141f482cb538dac3d7b38',ramdisk_id='',reservation_id='r-lrwitdb5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2130542140',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T10:46:31Z,user_data=None,user_id='395bc9d7007c4e01ac7effd418bcea19',uuid=e479154a-acd6-47aa-9a5b-43c6e0feda07,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2fbfd894-8e16-4039-b726-638e802602c5", "address": "fa:16:3e:4d:3b:0d", "network": {"id": "07f1f39e-292a-4e73-b4ed-99e5799d6fa8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1339551596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71289f80a05141f482cb538dac3d7b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fbfd894-8e", "ovs_interfaceid": "2fbfd894-8e16-4039-b726-638e802602c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 10:46:33 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-00fa7754-3bb6-41c0-94d2-ae44f9fbfb90 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Converting VIF {"id": "2fbfd894-8e16-4039-b726-638e802602c5", "address": "fa:16:3e:4d:3b:0d", "network": {"id": "07f1f39e-292a-4e73-b4ed-99e5799d6fa8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1339551596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71289f80a05141f482cb538dac3d7b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fbfd894-8e", "ovs_interfaceid": "2fbfd894-8e16-4039-b726-638e802602c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:46:33 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-00fa7754-3bb6-41c0-94d2-ae44f9fbfb90 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:3b:0d,bridge_name='br-int',has_traffic_filtering=True,id=2fbfd894-8e16-4039-b726-638e802602c5,network=Network(07f1f39e-292a-4e73-b4ed-99e5799d6fa8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2fbfd894-8e') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:46:33 user nova-compute[71509]: DEBUG os_vif [None req-00fa7754-3bb6-41c0-94d2-ae44f9fbfb90 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:3b:0d,bridge_name='br-int',has_traffic_filtering=True,id=2fbfd894-8e16-4039-b726-638e802602c5,network=Network(07f1f39e-292a-4e73-b4ed-99e5799d6fa8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2fbfd894-8e') {{(pid=71509) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 10:46:33 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:46:33 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:46:33 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 10:46:33 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:46:33 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2fbfd894-8e, may_exist=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:46:33 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2fbfd894-8e, col_values=(('external_ids', {'iface-id': '2fbfd894-8e16-4039-b726-638e802602c5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4d:3b:0d', 'vm-uuid': 'e479154a-acd6-47aa-9a5b-43c6e0feda07'}),)) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:46:33 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:46:33 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 10:46:33 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:46:33 user nova-compute[71509]: INFO os_vif [None req-00fa7754-3bb6-41c0-94d2-ae44f9fbfb90 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:3b:0d,bridge_name='br-int',has_traffic_filtering=True,id=2fbfd894-8e16-4039-b726-638e802602c5,network=Network(07f1f39e-292a-4e73-b4ed-99e5799d6fa8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2fbfd894-8e')
Apr 14 10:46:33 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-00fa7754-3bb6-41c0-94d2-ae44f9fbfb90 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] No BDM found with device name vda, not building metadata. {{(pid=71509) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 10:46:33 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-00fa7754-3bb6-41c0-94d2-ae44f9fbfb90 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] No VIF found with MAC fa:16:3e:4d:3b:0d, not building metadata {{(pid=71509) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 10:46:33 user nova-compute[71509]: DEBUG nova.network.neutron [req-2c2ad35f-f050-49a3-ace5-9300827f0de4 req-e0fbd520-5958-494b-bad2-cf711aacf6be service nova] [instance: e479154a-acd6-47aa-9a5b-43c6e0feda07] Updated VIF entry in instance network info cache for port 2fbfd894-8e16-4039-b726-638e802602c5. {{(pid=71509) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 10:46:33 user nova-compute[71509]: DEBUG nova.network.neutron [req-2c2ad35f-f050-49a3-ace5-9300827f0de4 req-e0fbd520-5958-494b-bad2-cf711aacf6be service nova] [instance: e479154a-acd6-47aa-9a5b-43c6e0feda07] Updating instance_info_cache with network_info: [{"id": "2fbfd894-8e16-4039-b726-638e802602c5", "address": "fa:16:3e:4d:3b:0d", "network": {"id": "07f1f39e-292a-4e73-b4ed-99e5799d6fa8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1339551596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71289f80a05141f482cb538dac3d7b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fbfd894-8e", "ovs_interfaceid": "2fbfd894-8e16-4039-b726-638e802602c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:46:33 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-2c2ad35f-f050-49a3-ace5-9300827f0de4 req-e0fbd520-5958-494b-bad2-cf711aacf6be service nova] Releasing lock "refresh_cache-e479154a-acd6-47aa-9a5b-43c6e0feda07" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:46:33 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:46:33 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:46:33 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:46:33 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:46:33 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:46:33 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:46:33 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:46:33 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71509) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 10:46:34 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:46:34 user nova-compute[71509]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681469179.7408087, 31f6ad8c-40d3-4b6e-af07-4848fafc431d => Stopped> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 10:46:34 user nova-compute[71509]: INFO nova.compute.manager [-] [instance: 31f6ad8c-40d3-4b6e-af07-4848fafc431d] VM Stopped (Lifecycle Event)
Apr 14 10:46:34 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:46:34 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:46:34 user nova-compute[71509]: DEBUG nova.compute.manager [None req-e5de6d1a-2871-47a1-ae85-044475f2550f None None] [instance: 31f6ad8c-40d3-4b6e-af07-4848fafc431d] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:46:34 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:46:35 user nova-compute[71509]: DEBUG nova.compute.manager [req-f582fa09-1e92-4418-bf0c-c4d3604665e4 req-07c5554d-443e-4f18-9e90-2c6617bee834 service nova] [instance: e479154a-acd6-47aa-9a5b-43c6e0feda07] Received event network-vif-plugged-2fbfd894-8e16-4039-b726-638e802602c5 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:46:35 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-f582fa09-1e92-4418-bf0c-c4d3604665e4 req-07c5554d-443e-4f18-9e90-2c6617bee834 service nova] Acquiring lock "e479154a-acd6-47aa-9a5b-43c6e0feda07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:46:35 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-f582fa09-1e92-4418-bf0c-c4d3604665e4 req-07c5554d-443e-4f18-9e90-2c6617bee834 service nova] Lock "e479154a-acd6-47aa-9a5b-43c6e0feda07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:46:35 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-f582fa09-1e92-4418-bf0c-c4d3604665e4 req-07c5554d-443e-4f18-9e90-2c6617bee834 service nova] Lock "e479154a-acd6-47aa-9a5b-43c6e0feda07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:46:35 user nova-compute[71509]: DEBUG nova.compute.manager [req-f582fa09-1e92-4418-bf0c-c4d3604665e4 req-07c5554d-443e-4f18-9e90-2c6617bee834 service nova] [instance: e479154a-acd6-47aa-9a5b-43c6e0feda07] No waiting events found dispatching network-vif-plugged-2fbfd894-8e16-4039-b726-638e802602c5 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:46:35 user nova-compute[71509]: WARNING nova.compute.manager [req-f582fa09-1e92-4418-bf0c-c4d3604665e4 req-07c5554d-443e-4f18-9e90-2c6617bee834 service nova] [instance: e479154a-acd6-47aa-9a5b-43c6e0feda07] Received unexpected event network-vif-plugged-2fbfd894-8e16-4039-b726-638e802602c5 for instance with vm_state building and task_state spawning.
Apr 14 10:46:35 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:46:35 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Starting heal instance info cache {{(pid=71509) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 10:46:35 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "refresh_cache-b4abb549-8f36-40c5-971f-8accbb14ff86" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:46:35 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquired lock "refresh_cache-b4abb549-8f36-40c5-971f-8accbb14ff86" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:46:35 user nova-compute[71509]: DEBUG nova.network.neutron [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Forcefully refreshing network info cache for instance {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 10:46:35 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:46:35 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:46:36 user nova-compute[71509]: DEBUG nova.network.neutron [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Updating instance_info_cache with network_info: [{"id": "608a2408-02df-474f-9006-260c8c97def1", "address": "fa:16:3e:e4:f7:87", "network": {"id": "18a91434-637b-4c19-a97b-736b32c1ea5a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1824162811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea2cb4dfa5b4a52b658efd8f5aefb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap608a2408-02", "ovs_interfaceid": "608a2408-02df-474f-9006-260c8c97def1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:46:36 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Releasing lock "refresh_cache-b4abb549-8f36-40c5-971f-8accbb14ff86" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:46:36 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Updated the network info_cache for instance {{(pid=71509) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 10:46:36 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-a304f2ca-f979-44bd-8574-60df17393651 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "b4abb549-8f36-40c5-971f-8accbb14ff86" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:46:36 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-a304f2ca-f979-44bd-8574-60df17393651 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "b4abb549-8f36-40c5-971f-8accbb14ff86" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:46:36 user nova-compute[71509]: DEBUG nova.objects.instance [None req-a304f2ca-f979-44bd-8574-60df17393651 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lazy-loading 'flavor' on Instance uuid b4abb549-8f36-40c5-971f-8accbb14ff86 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:46:37 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-a304f2ca-f979-44bd-8574-60df17393651 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "b4abb549-8f36-40c5-971f-8accbb14ff86" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:46:37 user nova-compute[71509]: DEBUG nova.compute.manager [req-f677886d-07b5-4365-b798-bd840c9d5600 req-16a407d9-42c3-4646-9bd9-9b3393cf51ad service nova] [instance: e479154a-acd6-47aa-9a5b-43c6e0feda07] Received event network-vif-plugged-2fbfd894-8e16-4039-b726-638e802602c5 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:46:37 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-f677886d-07b5-4365-b798-bd840c9d5600 req-16a407d9-42c3-4646-9bd9-9b3393cf51ad service nova] Acquiring lock "e479154a-acd6-47aa-9a5b-43c6e0feda07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:46:37 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-f677886d-07b5-4365-b798-bd840c9d5600 req-16a407d9-42c3-4646-9bd9-9b3393cf51ad service nova] Lock "e479154a-acd6-47aa-9a5b-43c6e0feda07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:46:37 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-f677886d-07b5-4365-b798-bd840c9d5600 req-16a407d9-42c3-4646-9bd9-9b3393cf51ad service nova] Lock "e479154a-acd6-47aa-9a5b-43c6e0feda07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:46:37 user nova-compute[71509]: DEBUG nova.compute.manager [req-f677886d-07b5-4365-b798-bd840c9d5600 req-16a407d9-42c3-4646-9bd9-9b3393cf51ad service nova] [instance: e479154a-acd6-47aa-9a5b-43c6e0feda07] No waiting events found dispatching network-vif-plugged-2fbfd894-8e16-4039-b726-638e802602c5 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:46:37 user nova-compute[71509]: WARNING nova.compute.manager [req-f677886d-07b5-4365-b798-bd840c9d5600 req-16a407d9-42c3-4646-9bd9-9b3393cf51ad service nova] [instance: e479154a-acd6-47aa-9a5b-43c6e0feda07] Received unexpected event network-vif-plugged-2fbfd894-8e16-4039-b726-638e802602c5 for instance with vm_state building and task_state spawning.
Apr 14 10:46:37 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-a304f2ca-f979-44bd-8574-60df17393651 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "b4abb549-8f36-40c5-971f-8accbb14ff86" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:46:37 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-a304f2ca-f979-44bd-8574-60df17393651 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "b4abb549-8f36-40c5-971f-8accbb14ff86" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:46:37 user nova-compute[71509]: INFO nova.compute.manager [None req-a304f2ca-f979-44bd-8574-60df17393651 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Attaching volume 2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d to /dev/vdb
Apr 14 10:46:37 user nova-compute[71509]: DEBUG os_brick.utils [None req-a304f2ca-f979-44bd-8574-60df17393651 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 10:46:37 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:46:37 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:46:37 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[51754126-705f-4fc0-b26e-affa5f5c21af]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50119df3c417\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:46:37 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:46:37 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:46:37 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:46:37 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7b24088-0708-4483-b640-b8d9a70e07cf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:46:37 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:46:37 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:46:37 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:46:37 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:46:37 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Auditing locally available compute resources for user (node: user) {{(pid=71509) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 10:46:37 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:46:37 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[8650d43c-6ed7-46bf-b238-0ccb0cbab4c2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:46:37 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1227387-9269-4b0e-ac0a-a57d8bc984b6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:46:37 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-a304f2ca-f979-44bd-8574-60df17393651 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Running cmd (subprocess): nvme version {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:46:37 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-a304f2ca-f979-44bd-8574-60df17393651 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] 'nvme version' failed. Not Retrying. {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 10:46:37 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a304f2ca-f979-44bd-8574-60df17393651 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] nvme not present on system {{(pid=71509) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 10:46:37 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:46:37 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 10:46:37 user nova-compute[71509]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 10:46:37 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[80dfa540-3fe6-4644-8646-949e3c75da44]: (4, '') {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:46:37 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-a304f2ca-f979-44bd-8574-60df17393651 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71509) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 10:46:37 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-a304f2ca-f979-44bd-8574-60df17393651 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71509) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 10:46:37 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-a304f2ca-f979-44bd-8574-60df17393651 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] LIGHTOS: no hostnqn found. {{(pid=71509) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 10:46:37 user nova-compute[71509]: DEBUG os_brick.utils [None req-a304f2ca-f979-44bd-8574-60df17393651 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] <== get_connector_properties: return (155ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50119df3c417', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 10:46:37 user nova-compute[71509]: DEBUG nova.virt.block_device [None req-a304f2ca-f979-44bd-8574-60df17393651 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Updating existing volume attachment record: 530c8ed2-1de8-4aaa-b448-002efd41e149 {{(pid=71509) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 10:46:37 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:46:37 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681469197.8514173, e479154a-acd6-47aa-9a5b-43c6e0feda07 => Resumed> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 10:46:37 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: e479154a-acd6-47aa-9a5b-43c6e0feda07] VM Resumed (Lifecycle Event)
Apr 14 10:46:37 user nova-compute[71509]: DEBUG nova.compute.manager [None req-00fa7754-3bb6-41c0-94d2-ae44f9fbfb90 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: e479154a-acd6-47aa-9a5b-43c6e0feda07] Instance event wait completed in 0 seconds for  {{(pid=71509) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 10:46:37 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-00fa7754-3bb6-41c0-94d2-ae44f9fbfb90 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: e479154a-acd6-47aa-9a5b-43c6e0feda07] Guest created on hypervisor {{(pid=71509) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 10:46:37 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: e479154a-acd6-47aa-9a5b-43c6e0feda07] Instance spawned successfully.
Apr 14 10:46:37 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-00fa7754-3bb6-41c0-94d2-ae44f9fbfb90 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: e479154a-acd6-47aa-9a5b-43c6e0feda07] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 10:46:37 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: e479154a-acd6-47aa-9a5b-43c6e0feda07] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:46:37 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: e479154a-acd6-47aa-9a5b-43c6e0feda07] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 10:46:37 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-00fa7754-3bb6-41c0-94d2-ae44f9fbfb90 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: e479154a-acd6-47aa-9a5b-43c6e0feda07] Found default for hw_cdrom_bus of ide {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:46:37 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-00fa7754-3bb6-41c0-94d2-ae44f9fbfb90 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: e479154a-acd6-47aa-9a5b-43c6e0feda07] Found default for hw_disk_bus of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:46:37 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-00fa7754-3bb6-41c0-94d2-ae44f9fbfb90 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: e479154a-acd6-47aa-9a5b-43c6e0feda07] Found default for hw_input_bus of None {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:46:37 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-00fa7754-3bb6-41c0-94d2-ae44f9fbfb90 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: e479154a-acd6-47aa-9a5b-43c6e0feda07] Found default for hw_pointer_model of None {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:46:37 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-00fa7754-3bb6-41c0-94d2-ae44f9fbfb90 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: e479154a-acd6-47aa-9a5b-43c6e0feda07] Found default for hw_video_model of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:46:37 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-00fa7754-3bb6-41c0-94d2-ae44f9fbfb90 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: e479154a-acd6-47aa-9a5b-43c6e0feda07] Found default for hw_vif_model of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:46:37 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: e479154a-acd6-47aa-9a5b-43c6e0feda07] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 10:46:37 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681469197.853372, e479154a-acd6-47aa-9a5b-43c6e0feda07 => Started> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 10:46:37 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: e479154a-acd6-47aa-9a5b-43c6e0feda07] VM Started (Lifecycle Event)
Apr 14 10:46:37 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: e479154a-acd6-47aa-9a5b-43c6e0feda07] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:46:37 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: e479154a-acd6-47aa-9a5b-43c6e0feda07] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 10:46:37 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: e479154a-acd6-47aa-9a5b-43c6e0feda07] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 10:46:38 user nova-compute[71509]: INFO nova.compute.manager [None req-00fa7754-3bb6-41c0-94d2-ae44f9fbfb90 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: e479154a-acd6-47aa-9a5b-43c6e0feda07] Took 7.04 seconds to spawn the instance on the hypervisor.
Apr 14 10:46:38 user nova-compute[71509]: DEBUG nova.compute.manager [None req-00fa7754-3bb6-41c0-94d2-ae44f9fbfb90 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: e479154a-acd6-47aa-9a5b-43c6e0feda07] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:46:38 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97820f17-22d1-4ec3-9721-1edadccc794a/disk.rescue --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:46:38 user nova-compute[71509]: INFO nova.compute.manager [None req-00fa7754-3bb6-41c0-94d2-ae44f9fbfb90 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: e479154a-acd6-47aa-9a5b-43c6e0feda07] Took 7.86 seconds to build instance.
Apr 14 10:46:38 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-00fa7754-3bb6-41c0-94d2-ae44f9fbfb90 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "e479154a-acd6-47aa-9a5b-43c6e0feda07" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.976s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:46:38 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:46:38 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97820f17-22d1-4ec3-9721-1edadccc794a/disk.rescue --force-share --output=json" returned: 0 in 0.148s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:46:38 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97820f17-22d1-4ec3-9721-1edadccc794a/disk.rescue --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:46:38 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97820f17-22d1-4ec3-9721-1edadccc794a/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:46:38 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97820f17-22d1-4ec3-9721-1edadccc794a/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:46:38 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97820f17-22d1-4ec3-9721-1edadccc794a/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:46:38 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97820f17-22d1-4ec3-9721-1edadccc794a/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:46:38 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97820f17-22d1-4ec3-9721-1edadccc794a/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:46:38 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b767f1b-e97e-497c-8c70-8806203c76ae/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:46:38 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b767f1b-e97e-497c-8c70-8806203c76ae/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:46:38 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b767f1b-e97e-497c-8c70-8806203c76ae/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:46:39 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b767f1b-e97e-497c-8c70-8806203c76ae/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:46:39 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4abb549-8f36-40c5-971f-8accbb14ff86/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:46:39 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4abb549-8f36-40c5-971f-8accbb14ff86/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:46:39 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4abb549-8f36-40c5-971f-8accbb14ff86/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:46:39 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4abb549-8f36-40c5-971f-8accbb14ff86/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:46:39 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55178126-9766-4875-9122-39dcc87ce82c/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:46:39 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55178126-9766-4875-9122-39dcc87ce82c/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:46:39 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55178126-9766-4875-9122-39dcc87ce82c/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:46:39 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55178126-9766-4875-9122-39dcc87ce82c/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:46:39 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e479154a-acd6-47aa-9a5b-43c6e0feda07/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:46:39 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e479154a-acd6-47aa-9a5b-43c6e0feda07/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:46:39 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e479154a-acd6-47aa-9a5b-43c6e0feda07/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:46:39 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e479154a-acd6-47aa-9a5b-43c6e0feda07/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:46:39 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6f539d8-4144-467b-ac69-44011c5b3564/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:46:40 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6f539d8-4144-467b-ac69-44011c5b3564/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:46:40 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6f539d8-4144-467b-ac69-44011c5b3564/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:46:40 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6f539d8-4144-467b-ac69-44011c5b3564/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:46:40 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e6c800c-9b35-4e35-969e-c40367056dce/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:46:40 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e6c800c-9b35-4e35-969e-c40367056dce/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:46:40 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e6c800c-9b35-4e35-969e-c40367056dce/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:46:40 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e6c800c-9b35-4e35-969e-c40367056dce/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:46:40 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97f20661-8b60-439e-b7af-2fc2013c5ade/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:46:40 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-9484c391-596b-42c5-88fb-e4f40e5b8cec tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Acquiring lock "d6f539d8-4144-467b-ac69-44011c5b3564" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:46:40 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-9484c391-596b-42c5-88fb-e4f40e5b8cec tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Lock "d6f539d8-4144-467b-ac69-44011c5b3564" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:46:40 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-9484c391-596b-42c5-88fb-e4f40e5b8cec tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Acquiring lock "d6f539d8-4144-467b-ac69-44011c5b3564-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:46:40 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-9484c391-596b-42c5-88fb-e4f40e5b8cec tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Lock "d6f539d8-4144-467b-ac69-44011c5b3564-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:46:40 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-9484c391-596b-42c5-88fb-e4f40e5b8cec tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Lock "d6f539d8-4144-467b-ac69-44011c5b3564-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:46:40 user nova-compute[71509]: INFO nova.compute.manager [None req-9484c391-596b-42c5-88fb-e4f40e5b8cec tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] [instance: d6f539d8-4144-467b-ac69-44011c5b3564] Terminating instance
Apr 14 10:46:40 user nova-compute[71509]: DEBUG nova.compute.manager [None req-9484c391-596b-42c5-88fb-e4f40e5b8cec tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] [instance: d6f539d8-4144-467b-ac69-44011c5b3564] Start destroying the instance on the hypervisor. {{(pid=71509) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 10:46:40 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:46:40 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97f20661-8b60-439e-b7af-2fc2013c5ade/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:46:40 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97f20661-8b60-439e-b7af-2fc2013c5ade/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:46:40 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:46:40 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:46:41 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97f20661-8b60-439e-b7af-2fc2013c5ade/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:46:41 user nova-compute[71509]: DEBUG nova.compute.manager [req-73f2a669-f53d-43d3-a901-808ba312b62c req-7746828d-8b3d-4836-9ce0-33d5c52fdc09 service nova] [instance: d6f539d8-4144-467b-ac69-44011c5b3564] Received event network-vif-unplugged-d9ddcc5e-7cd1-4470-a3a3-4c2332f72b10 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:46:41 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-73f2a669-f53d-43d3-a901-808ba312b62c req-7746828d-8b3d-4836-9ce0-33d5c52fdc09 service nova] Acquiring lock "d6f539d8-4144-467b-ac69-44011c5b3564-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:46:41 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-73f2a669-f53d-43d3-a901-808ba312b62c req-7746828d-8b3d-4836-9ce0-33d5c52fdc09 service nova] Lock "d6f539d8-4144-467b-ac69-44011c5b3564-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:46:41 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-73f2a669-f53d-43d3-a901-808ba312b62c req-7746828d-8b3d-4836-9ce0-33d5c52fdc09 service nova] Lock "d6f539d8-4144-467b-ac69-44011c5b3564-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:46:41 user nova-compute[71509]: DEBUG nova.compute.manager [req-73f2a669-f53d-43d3-a901-808ba312b62c req-7746828d-8b3d-4836-9ce0-33d5c52fdc09 service nova] [instance: d6f539d8-4144-467b-ac69-44011c5b3564] No waiting events found dispatching network-vif-unplugged-d9ddcc5e-7cd1-4470-a3a3-4c2332f72b10 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:46:41 user nova-compute[71509]: DEBUG nova.compute.manager [req-73f2a669-f53d-43d3-a901-808ba312b62c req-7746828d-8b3d-4836-9ce0-33d5c52fdc09 service nova] [instance: d6f539d8-4144-467b-ac69-44011c5b3564] Received event network-vif-unplugged-d9ddcc5e-7cd1-4470-a3a3-4c2332f72b10 for instance with task_state deleting. {{(pid=71509) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 10:46:41 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: d6f539d8-4144-467b-ac69-44011c5b3564] Instance destroyed successfully.
Apr 14 10:46:41 user nova-compute[71509]: DEBUG nova.objects.instance [None req-9484c391-596b-42c5-88fb-e4f40e5b8cec tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Lazy-loading 'resources' on Instance uuid d6f539d8-4144-467b-ac69-44011c5b3564 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:46:41 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:46:42 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:46:42 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Hypervisor/Node resource view: name=user free_ram=7736MB free_disk=26.30118179321289GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71509) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 10:46:42 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:46:42 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:46:42 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-9484c391-596b-42c5-88fb-e4f40e5b8cec tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T10:43:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-200701793',display_name='tempest-TestVolumeSwap-server-200701793',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumeswap-server-200701793',id=7,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFdp8DvIWzTdfQlZzBSWMm9TWVpW4Azm62lnWvgtwkAByNAiB4NOgWADUm4IuHKDHgDw6vr4SDZiH+/UlF++dOtHWNBkJxFq/sQk6UhVQojd3P/v2dpPDWmyAw5MBNgqfg==',key_name='tempest-keypair-1731536774',keypairs=<?>,launch_index=0,launched_at=2023-04-14T10:43:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='64094cc814374da59456a39ef9cd8cd2',ramdisk_id='',reservation_id='r-k1zsu4t1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-2101147705',owner_user_name='tempest-TestVolumeSwap-2101147705-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T10:43:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e15c150540fa4d9c825a9ac81d674308',uuid=d6f539d8-4144-467b-ac69-44011c5b3564,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d9ddcc5e-7cd1-4470-a3a3-4c2332f72b10", "address": "fa:16:3e:33:37:3e", "network": {"id": "18e10605-b5d7-4446-9cb7-34a989b33763", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1073535411-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64094cc814374da59456a39ef9cd8cd2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9ddcc5e-7c", "ovs_interfaceid": "d9ddcc5e-7cd1-4470-a3a3-4c2332f72b10", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 10:46:42 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-9484c391-596b-42c5-88fb-e4f40e5b8cec tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Converting VIF {"id": "d9ddcc5e-7cd1-4470-a3a3-4c2332f72b10", "address": "fa:16:3e:33:37:3e", "network": {"id": "18e10605-b5d7-4446-9cb7-34a989b33763", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1073535411-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "64094cc814374da59456a39ef9cd8cd2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9ddcc5e-7c", "ovs_interfaceid": "d9ddcc5e-7cd1-4470-a3a3-4c2332f72b10", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:46:42 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-9484c391-596b-42c5-88fb-e4f40e5b8cec tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:33:37:3e,bridge_name='br-int',has_traffic_filtering=True,id=d9ddcc5e-7cd1-4470-a3a3-4c2332f72b10,network=Network(18e10605-b5d7-4446-9cb7-34a989b33763),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9ddcc5e-7c') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:46:42 user nova-compute[71509]: DEBUG os_vif [None req-9484c391-596b-42c5-88fb-e4f40e5b8cec tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:33:37:3e,bridge_name='br-int',has_traffic_filtering=True,id=d9ddcc5e-7cd1-4470-a3a3-4c2332f72b10,network=Network(18e10605-b5d7-4446-9cb7-34a989b33763),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9ddcc5e-7c') {{(pid=71509) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 10:46:42 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:46:42 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd9ddcc5e-7c, bridge=br-int, if_exists=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:46:42 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:46:42 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:46:42 user nova-compute[71509]: INFO os_vif [None req-9484c391-596b-42c5-88fb-e4f40e5b8cec tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:33:37:3e,bridge_name='br-int',has_traffic_filtering=True,id=d9ddcc5e-7cd1-4470-a3a3-4c2332f72b10,network=Network(18e10605-b5d7-4446-9cb7-34a989b33763),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9ddcc5e-7c')
Apr 14 10:46:42 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-9484c391-596b-42c5-88fb-e4f40e5b8cec tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] [instance: d6f539d8-4144-467b-ac69-44011c5b3564] Deleting instance files /opt/stack/data/nova/instances/d6f539d8-4144-467b-ac69-44011c5b3564_del
Apr 14 10:46:42 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-9484c391-596b-42c5-88fb-e4f40e5b8cec tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] [instance: d6f539d8-4144-467b-ac69-44011c5b3564] Deletion of /opt/stack/data/nova/instances/d6f539d8-4144-467b-ac69-44011c5b3564_del complete
Apr 14 10:46:42 user nova-compute[71509]: INFO nova.compute.manager [None req-9484c391-596b-42c5-88fb-e4f40e5b8cec tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] [instance: d6f539d8-4144-467b-ac69-44011c5b3564] Took 1.39 seconds to destroy the instance on the hypervisor.
Apr 14 10:46:42 user nova-compute[71509]: DEBUG oslo.service.loopingcall [None req-9484c391-596b-42c5-88fb-e4f40e5b8cec tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71509) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 10:46:42 user nova-compute[71509]: DEBUG nova.compute.manager [-] [instance: d6f539d8-4144-467b-ac69-44011c5b3564] Deallocating network for instance {{(pid=71509) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 10:46:42 user nova-compute[71509]: DEBUG nova.network.neutron [-] [instance: d6f539d8-4144-467b-ac69-44011c5b3564] deallocate_for_instance() {{(pid=71509) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 10:46:42 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 97f20661-8b60-439e-b7af-2fc2013c5ade actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:46:42 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 97820f17-22d1-4ec3-9721-1edadccc794a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:46:42 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance b4abb549-8f36-40c5-971f-8accbb14ff86 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:46:42 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 0e6c800c-9b35-4e35-969e-c40367056dce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:46:42 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance d6f539d8-4144-467b-ac69-44011c5b3564 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:46:42 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 55178126-9766-4875-9122-39dcc87ce82c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:46:42 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 4b767f1b-e97e-497c-8c70-8806203c76ae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:46:42 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance e479154a-acd6-47aa-9a5b-43c6e0feda07 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:46:42 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=71509) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 10:46:42 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Final resource view: name=user phys_ram=16023MB used_ram=1536MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=71509) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 10:46:42 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 10:46:42 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 10:46:42 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Compute_service record updated for user:user {{(pid=71509) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 10:46:42 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.595s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:46:42 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:46:43 user nova-compute[71509]: DEBUG nova.compute.manager [req-a9fcb987-d2e8-4a85-9369-5efd6d61da58 req-6d4961e4-5a8e-40b1-a68e-254b37fa25fe service nova] [instance: d6f539d8-4144-467b-ac69-44011c5b3564] Received event network-vif-plugged-d9ddcc5e-7cd1-4470-a3a3-4c2332f72b10 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:46:43 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-a9fcb987-d2e8-4a85-9369-5efd6d61da58 req-6d4961e4-5a8e-40b1-a68e-254b37fa25fe service nova] Acquiring lock "d6f539d8-4144-467b-ac69-44011c5b3564-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:46:43 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-a9fcb987-d2e8-4a85-9369-5efd6d61da58 req-6d4961e4-5a8e-40b1-a68e-254b37fa25fe service nova] Lock "d6f539d8-4144-467b-ac69-44011c5b3564-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:46:43 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-a9fcb987-d2e8-4a85-9369-5efd6d61da58 req-6d4961e4-5a8e-40b1-a68e-254b37fa25fe service nova] Lock "d6f539d8-4144-467b-ac69-44011c5b3564-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:46:43 user nova-compute[71509]: DEBUG nova.compute.manager [req-a9fcb987-d2e8-4a85-9369-5efd6d61da58 req-6d4961e4-5a8e-40b1-a68e-254b37fa25fe service nova] [instance: d6f539d8-4144-467b-ac69-44011c5b3564] No waiting events found dispatching network-vif-plugged-d9ddcc5e-7cd1-4470-a3a3-4c2332f72b10 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:46:43 user nova-compute[71509]: WARNING nova.compute.manager [req-a9fcb987-d2e8-4a85-9369-5efd6d61da58 req-6d4961e4-5a8e-40b1-a68e-254b37fa25fe service nova] [instance: d6f539d8-4144-467b-ac69-44011c5b3564] Received unexpected event network-vif-plugged-d9ddcc5e-7cd1-4470-a3a3-4c2332f72b10 for instance with vm_state active and task_state deleting.
Apr 14 10:46:43 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-e75f74ee-2c40-4749-98ef-223fa658c590 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Acquiring lock "0e6c800c-9b35-4e35-969e-c40367056dce" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:46:43 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-e75f74ee-2c40-4749-98ef-223fa658c590 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Lock "0e6c800c-9b35-4e35-969e-c40367056dce" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:46:43 user nova-compute[71509]: DEBUG nova.network.neutron [-] [instance: d6f539d8-4144-467b-ac69-44011c5b3564] Updating instance_info_cache with network_info: [] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:46:43 user nova-compute[71509]: DEBUG nova.objects.instance [None req-e75f74ee-2c40-4749-98ef-223fa658c590 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Lazy-loading 'flavor' on Instance uuid 0e6c800c-9b35-4e35-969e-c40367056dce {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:46:43 user nova-compute[71509]: INFO nova.compute.manager [-] [instance: d6f539d8-4144-467b-ac69-44011c5b3564] Took 1.24 seconds to deallocate network for instance.
Apr 14 10:46:43 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-e75f74ee-2c40-4749-98ef-223fa658c590 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Lock "0e6c800c-9b35-4e35-969e-c40367056dce" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:46:43 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-9484c391-596b-42c5-88fb-e4f40e5b8cec tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:46:43 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-9484c391-596b-42c5-88fb-e4f40e5b8cec tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:46:43 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-e75f74ee-2c40-4749-98ef-223fa658c590 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Acquiring lock "0e6c800c-9b35-4e35-969e-c40367056dce" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:46:43 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-e75f74ee-2c40-4749-98ef-223fa658c590 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Lock "0e6c800c-9b35-4e35-969e-c40367056dce" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:46:43 user nova-compute[71509]: INFO nova.compute.manager [None req-e75f74ee-2c40-4749-98ef-223fa658c590 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Attaching volume 4116efc6-988f-40cf-af06-2abf9c6cd44a to /dev/vdb
Apr 14 10:46:43 user nova-compute[71509]: DEBUG os_brick.utils [None req-e75f74ee-2c40-4749-98ef-223fa658c590 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 10:46:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:46:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:46:43 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[444e799d-6ac0-4f5e-8543-19509b6b9bb8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50119df3c417\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:46:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:46:43 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-9484c391-596b-42c5-88fb-e4f40e5b8cec tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 10:46:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:46:43 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[d88ec8f0-7534-4312-85d6-67765a59d556]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:46:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:46:43 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-9484c391-596b-42c5-88fb-e4f40e5b8cec tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 10:46:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:46:43 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[74faf70b-693c-4b68-a116-be04ae44ab7a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:46:43 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[548065e8-20a6-457e-91bd-f36ecc57dc5e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:46:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-e75f74ee-2c40-4749-98ef-223fa658c590 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Running cmd (subprocess): nvme version {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:46:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-e75f74ee-2c40-4749-98ef-223fa658c590 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] 'nvme version' failed. Not Retrying. {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 10:46:43 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e75f74ee-2c40-4749-98ef-223fa658c590 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] nvme not present on system {{(pid=71509) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 10:46:43 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-9484c391-596b-42c5-88fb-e4f40e5b8cec tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.406s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:46:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:46:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 10:46:43 user nova-compute[71509]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 10:46:43 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[63ecaecb-78f1-4aff-944e-b48a4591cc20]: (4, '') {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:46:43 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-e75f74ee-2c40-4749-98ef-223fa658c590 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71509) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 10:46:43 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-e75f74ee-2c40-4749-98ef-223fa658c590 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71509) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 10:46:43 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-e75f74ee-2c40-4749-98ef-223fa658c590 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] LIGHTOS: no hostnqn found. {{(pid=71509) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 10:46:43 user nova-compute[71509]: DEBUG os_brick.utils [None req-e75f74ee-2c40-4749-98ef-223fa658c590 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] <== get_connector_properties: return (161ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50119df3c417', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 10:46:43 user nova-compute[71509]: DEBUG nova.virt.block_device [None req-e75f74ee-2c40-4749-98ef-223fa658c590 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Updating existing volume attachment record: 6b5bbd45-8d7b-460b-a3f9-da70d9ca579a {{(pid=71509) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 10:46:43 user nova-compute[71509]: INFO nova.scheduler.client.report [None req-9484c391-596b-42c5-88fb-e4f40e5b8cec tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Deleted allocations for instance d6f539d8-4144-467b-ac69-44011c5b3564
Apr 14 10:46:44 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-9484c391-596b-42c5-88fb-e4f40e5b8cec tempest-TestVolumeSwap-2101147705 tempest-TestVolumeSwap-2101147705-project-member] Lock "d6f539d8-4144-467b-ac69-44011c5b3564" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.296s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:46:44 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a304f2ca-f979-44bd-8574-60df17393651 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Calling os-brick to attach iSCSI Volume {{(pid=71509) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 10:46:44 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-a304f2ca-f979-44bd-8574-60df17393651 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0bf0749390>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZWfaEHNS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 10:46:44 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-a304f2ca-f979-44bd-8574-60df17393651 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 10:46:44 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-a304f2ca-f979-44bd-8574-60df17393651 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 10:46:44 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-a304f2ca-f979-44bd-8574-60df17393651 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 10:46:44 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-a304f2ca-f979-44bd-8574-60df17393651 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 10:46:44 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-a304f2ca-f979-44bd-8574-60df17393651 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 10:46:44 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-a304f2ca-f979-44bd-8574-60df17393651 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.007s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 10:46:44 user nova-compute[71509]: INFO os_brick.initiator.connectors.iscsi [None req-a304f2ca-f979-44bd-8574-60df17393651 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 10:46:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d -p 172.16.0.220:3260 {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:46:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:46:44 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[595c148b-ce84-4e6e-9c18-6f99fcccc70d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:46:44 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-a304f2ca-f979-44bd-8574-60df17393651 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 10:46:44 user nova-compute[71509]:  {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:46:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d -p 172.16.0.220:3260 --interface default --op new {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:46:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:46:44 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[d475ce98-a1f9-4f61-a0f3-994606a61a64]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d] added\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:46:44 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-a304f2ca-f979-44bd-8574-60df17393651 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d] added
Apr 14 10:46:44 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:46:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:46:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:46:44 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b60555c-d1c8-44e5-868d-408ce8d83d55]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:46:44 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-a304f2ca-f979-44bd-8574-60df17393651 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:46:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:46:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:46:44 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a5f9f86-8d11-4217-944d-3ba841a24921]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:46:44 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-a304f2ca-f979-44bd-8574-60df17393651 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:46:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZWfaEHNS {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:46:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZWfaEHNS" returned: 0 in 0.023s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:46:44 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[77696805-8c03-4b78-b59f-6e51eb061920]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:46:44 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-a304f2ca-f979-44bd-8574-60df17393651 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZWfaEHNS'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:46:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:46:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:46:44 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[0657464a-86b5-4cfd-8afd-f0c273b607f0]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:46:44 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-a304f2ca-f979-44bd-8574-60df17393651 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:46:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:46:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:46:44 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cae6bab-38e5-4bbf-91eb-d7558c5f7d82]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:46:44 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-a304f2ca-f979-44bd-8574-60df17393651 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 14 10:46:44 user nova-compute[71509]:  {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:46:44 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-a304f2ca-f979-44bd-8574-60df17393651 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 14 10:46:44 user nova-compute[71509]:  {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 10:46:44 user nova-compute[71509]: WARNING os_brick.initiator.connectors.iscsi [None req-a304f2ca-f979-44bd-8574-60df17393651 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 14 10:46:44 user nova-compute[71509]: 
Apr 14 10:46:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d -p 172.16.0.220:3260 --login {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:46:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:46:44 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d71ea17-876f-4c8b-af51-f0b68d379f8c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:46:44 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-a304f2ca-f979-44bd-8574-60df17393651 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d, portal: 172.16.0.220,3260]
Apr 14 10:46:44 user nova-compute[71509]: Login to [iface: default, target: iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d, portal: 172.16.0.220,3260] successful.
Apr 14 10:46:44 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:46:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:46:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:46:44 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[44f3cef2-965b-42eb-9de2-bb3c983fe65d]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:46:44 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-a304f2ca-f979-44bd-8574-60df17393651 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:46:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:46:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:46:44 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[a43d2ddd-b94f-486a-8d3c-167bcaf5579a]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:46:44 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-a304f2ca-f979-44bd-8574-60df17393651 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d (non-flash)
Apr 14 10:46:44 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:46:44 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-a304f2ca-f979-44bd-8574-60df17393651 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d (non-flash)
Apr 14 10:46:44 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 10:46:44 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-a304f2ca-f979-44bd-8574-60df17393651 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.303s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 10:46:44 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-a304f2ca-f979-44bd-8574-60df17393651 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Connected to 172.16.0.220:3260 {{(pid=71509) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 10:46:44 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-a304f2ca-f979-44bd-8574-60df17393651 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] HCTL ('33', '-', '-', 0) found on session 16 with lun 0 {{(pid=71509) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 10:46:44 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-a304f2ca-f979-44bd-8574-60df17393651 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71509) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 10:46:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:46:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:46:45 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cf28223-e685-48c8-80a6-8ab40fcd8707]: (4, ('- - 0', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:46:45 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-a304f2ca-f979-44bd-8574-60df17393651 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Searching for a device in session 16 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71509) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 10:46:45 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-a304f2ca-f979-44bd-8574-60df17393651 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZWfaEHNS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71509) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 10:46:45 user nova-compute[71509]: DEBUG nova.compute.manager [req-88035b44-dcdd-4c51-a4fd-6b1c9c47eda2 req-cdc2e079-b9e0-4b0f-8130-e99dbafa3923 service nova] [instance: d6f539d8-4144-467b-ac69-44011c5b3564] Received event network-vif-deleted-d9ddcc5e-7cd1-4470-a3a3-4c2332f72b10 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:46:46 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-a304f2ca-f979-44bd-8574-60df17393651 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.365s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 10:46:46 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-a304f2ca-f979-44bd-8574-60df17393651 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] <== connect_volume: return (1366ms) {'type': 'block', 'scsi_wwn': '23639333132393439', 'path': '/dev/sdb'} {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 10:46:46 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a304f2ca-f979-44bd-8574-60df17393651 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23639333132393439', 'path': '/dev/sdb'} {{(pid=71509) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 10:46:46 user nova-compute[71509]: DEBUG nova.objects.instance [None req-a304f2ca-f979-44bd-8574-60df17393651 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lazy-loading 'flavor' on Instance uuid b4abb549-8f36-40c5-971f-8accbb14ff86 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:46:46 user nova-compute[71509]: DEBUG nova.virt.libvirt.guest [None req-a304f2ca-f979-44bd-8574-60df17393651 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 10:46:46 user nova-compute[71509]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 10:46:46 user nova-compute[71509]:   <source dev="/dev/sdb"/>
Apr 14 10:46:46 user nova-compute[71509]:   <target dev="vdb" bus="virtio"/>
Apr 14 10:46:46 user nova-compute[71509]:   <serial>2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d</serial>
Apr 14 10:46:46 user nova-compute[71509]: </disk>
Apr 14 10:46:46 user nova-compute[71509]:  {{(pid=71509) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 10:46:46 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-a304f2ca-f979-44bd-8574-60df17393651 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] No BDM found with device name vda, not building metadata. {{(pid=71509) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 10:46:46 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-a304f2ca-f979-44bd-8574-60df17393651 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71509) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 10:46:46 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-a304f2ca-f979-44bd-8574-60df17393651 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] No VIF found with MAC fa:16:3e:e4:f7:87, not building metadata {{(pid=71509) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 10:46:46 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-a304f2ca-f979-44bd-8574-60df17393651 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "b4abb549-8f36-40c5-971f-8accbb14ff86" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.463s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:46:47 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:46:47 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:46:47 user nova-compute[71509]: INFO nova.compute.manager [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Rebuilding instance
Apr 14 10:46:48 user nova-compute[71509]: DEBUG nova.objects.instance [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lazy-loading 'trusted_certs' on Instance uuid b4abb549-8f36-40c5-971f-8accbb14ff86 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:46:48 user nova-compute[71509]: DEBUG nova.compute.manager [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:46:48 user nova-compute[71509]: DEBUG nova.objects.instance [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lazy-loading 'pci_requests' on Instance uuid b4abb549-8f36-40c5-971f-8accbb14ff86 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:46:48 user nova-compute[71509]: DEBUG nova.objects.instance [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lazy-loading 'pci_devices' on Instance uuid b4abb549-8f36-40c5-971f-8accbb14ff86 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:46:48 user nova-compute[71509]: DEBUG nova.objects.instance [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lazy-loading 'resources' on Instance uuid b4abb549-8f36-40c5-971f-8accbb14ff86 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:46:48 user nova-compute[71509]: DEBUG nova.objects.instance [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lazy-loading 'migration_context' on Instance uuid b4abb549-8f36-40c5-971f-8accbb14ff86 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:46:48 user nova-compute[71509]: DEBUG nova.objects.instance [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Trying to apply a migration context that does not seem to be set for this instance {{(pid=71509) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1032}}
Apr 14 10:46:48 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:46:48 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:46:48 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:46:48 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:46:48 user nova-compute[71509]: DEBUG nova.compute.manager [req-8a3a03ca-735b-44a5-a597-bbe3aa73d32c req-e829eb27-694b-4687-8a15-9554b8d0c4d2 service nova] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Received event network-vif-unplugged-608a2408-02df-474f-9006-260c8c97def1 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:46:48 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-8a3a03ca-735b-44a5-a597-bbe3aa73d32c req-e829eb27-694b-4687-8a15-9554b8d0c4d2 service nova] Acquiring lock "b4abb549-8f36-40c5-971f-8accbb14ff86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:46:48 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-8a3a03ca-735b-44a5-a597-bbe3aa73d32c req-e829eb27-694b-4687-8a15-9554b8d0c4d2 service nova] Lock "b4abb549-8f36-40c5-971f-8accbb14ff86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:46:48 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-8a3a03ca-735b-44a5-a597-bbe3aa73d32c req-e829eb27-694b-4687-8a15-9554b8d0c4d2 service nova] Lock "b4abb549-8f36-40c5-971f-8accbb14ff86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:46:48 user nova-compute[71509]: DEBUG nova.compute.manager [req-8a3a03ca-735b-44a5-a597-bbe3aa73d32c req-e829eb27-694b-4687-8a15-9554b8d0c4d2 service nova] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] No waiting events found dispatching network-vif-unplugged-608a2408-02df-474f-9006-260c8c97def1 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:46:48 user nova-compute[71509]: WARNING nova.compute.manager [req-8a3a03ca-735b-44a5-a597-bbe3aa73d32c req-e829eb27-694b-4687-8a15-9554b8d0c4d2 service nova] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Received unexpected event network-vif-unplugged-608a2408-02df-474f-9006-260c8c97def1 for instance with vm_state active and task_state rebuilding.
Apr 14 10:46:48 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e75f74ee-2c40-4749-98ef-223fa658c590 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Calling os-brick to attach iSCSI Volume {{(pid=71509) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 10:46:48 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-e75f74ee-2c40-4749-98ef-223fa658c590 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0bf0749390>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4116efc6-988f-40cf-af06-2abf9c6cd44a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GJNowkDY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 10:46:48 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-e75f74ee-2c40-4749-98ef-223fa658c590 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 10:46:48 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-e75f74ee-2c40-4749-98ef-223fa658c590 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 10:46:48 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-e75f74ee-2c40-4749-98ef-223fa658c590 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 10:46:48 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-e75f74ee-2c40-4749-98ef-223fa658c590 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 10:46:48 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-e75f74ee-2c40-4749-98ef-223fa658c590 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4116efc6-988f-40cf-af06-2abf9c6cd44a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 10:46:48 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-e75f74ee-2c40-4749-98ef-223fa658c590 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4116efc6-988f-40cf-af06-2abf9c6cd44a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 10:46:48 user nova-compute[71509]: INFO os_brick.initiator.connectors.iscsi [None req-e75f74ee-2c40-4749-98ef-223fa658c590 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 10:46:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4116efc6-988f-40cf-af06-2abf9c6cd44a -p 172.16.0.220:3260 {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:46:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4116efc6-988f-40cf-af06-2abf9c6cd44a -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:46:48 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[5450a022-acfc-4445-8d14-30ac87c6563f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:46:48 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-e75f74ee-2c40-4749-98ef-223fa658c590 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 10:46:48 user nova-compute[71509]:  {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:46:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4116efc6-988f-40cf-af06-2abf9c6cd44a -p 172.16.0.220:3260 --interface default --op new {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:46:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4116efc6-988f-40cf-af06-2abf9c6cd44a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:46:49 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[48bd4a71-b51f-49d8-8ce5-596177287139]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4116efc6-988f-40cf-af06-2abf9c6cd44a] added\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:46:49 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-e75f74ee-2c40-4749-98ef-223fa658c590 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4116efc6-988f-40cf-af06-2abf9c6cd44a] added
Apr 14 10:46:49 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:46:49 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4116efc6-988f-40cf-af06-2abf9c6cd44a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:46:49 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:46:49 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:46:49 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4116efc6-988f-40cf-af06-2abf9c6cd44a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.037s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:46:49 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[f48c7c9b-d3c4-43e7-bd2c-af7c173999dd]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:46:49 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-e75f74ee-2c40-4749-98ef-223fa658c590 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:46:49 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:46:49 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4116efc6-988f-40cf-af06-2abf9c6cd44a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:46:49 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:46:49 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4116efc6-988f-40cf-af06-2abf9c6cd44a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:46:49 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[3359d9b0-6559-45c6-ac5d-79bc26e9fef8]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:46:49 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-e75f74ee-2c40-4749-98ef-223fa658c590 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:46:49 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4116efc6-988f-40cf-af06-2abf9c6cd44a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GJNowkDY {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:46:49 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4116efc6-988f-40cf-af06-2abf9c6cd44a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GJNowkDY" returned: 0 in 0.031s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:46:49 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[68a5159c-2f22-41eb-93ad-854de7c1a13d]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:46:49 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-e75f74ee-2c40-4749-98ef-223fa658c590 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GJNowkDY'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:46:49 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4116efc6-988f-40cf-af06-2abf9c6cd44a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:46:49 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Instance destroyed successfully.
Apr 14 10:46:49 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4116efc6-988f-40cf-af06-2abf9c6cd44a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.038s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:46:49 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[99156846-1b11-49a1-bc4f-90490691595b]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:46:49 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-e75f74ee-2c40-4749-98ef-223fa658c590 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:46:49 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:46:49 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:46:49 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[beef6ca1-210b-479f-9c0a-c29a793701e4]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:46:49 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-e75f74ee-2c40-4749-98ef-223fa658c590 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d (non-flash)
Apr 14 10:46:49 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:46:49 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-e75f74ee-2c40-4749-98ef-223fa658c590 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d (non-flash)
Apr 14 10:46:49 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 10:46:49 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:46:49 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4116efc6-988f-40cf-af06-2abf9c6cd44a -p 172.16.0.220:3260 --login {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:46:49 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4116efc6-988f-40cf-af06-2abf9c6cd44a -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:46:49 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f98fdea-6dfa-43df-b791-ab62577f7ab8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4116efc6-988f-40cf-af06-2abf9c6cd44a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4116efc6-988f-40cf-af06-2abf9c6cd44a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:46:49 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-e75f74ee-2c40-4749-98ef-223fa658c590 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4116efc6-988f-40cf-af06-2abf9c6cd44a, portal: 172.16.0.220,3260]
Apr 14 10:46:49 user nova-compute[71509]: Login to [iface: default, target: iqn.2010-10.org.openstack:4116efc6-988f-40cf-af06-2abf9c6cd44a, portal: 172.16.0.220,3260] successful.
Apr 14 10:46:49 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:46:49 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4116efc6-988f-40cf-af06-2abf9c6cd44a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:46:49 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4116efc6-988f-40cf-af06-2abf9c6cd44a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:46:49 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eaf674f-dcb6-4d10-bb6f-d8cc7c96e9ae]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:46:49 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-e75f74ee-2c40-4749-98ef-223fa658c590 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:46:49 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:46:49 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:46:49 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a833785-2b6d-49d6-92d5-68347ee54008]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4116efc6-988f-40cf-af06-2abf9c6cd44a (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:46:49 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-e75f74ee-2c40-4749-98ef-223fa658c590 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d (non-flash)
Apr 14 10:46:49 user nova-compute[71509]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4116efc6-988f-40cf-af06-2abf9c6cd44a (non-flash)
Apr 14 10:46:49 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:46:49 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-e75f74ee-2c40-4749-98ef-223fa658c590 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d (non-flash)
Apr 14 10:46:49 user nova-compute[71509]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4116efc6-988f-40cf-af06-2abf9c6cd44a (non-flash)
Apr 14 10:46:49 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 10:46:49 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-e75f74ee-2c40-4749-98ef-223fa658c590 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4116efc6-988f-40cf-af06-2abf9c6cd44a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.392s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 10:46:49 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-e75f74ee-2c40-4749-98ef-223fa658c590 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Connected to 172.16.0.220:3260 {{(pid=71509) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 10:46:49 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-e75f74ee-2c40-4749-98ef-223fa658c590 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] HCTL ('34', '-', '-', 0) found on session 17 with lun 0 {{(pid=71509) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 10:46:49 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-e75f74ee-2c40-4749-98ef-223fa658c590 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71509) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 10:46:49 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:46:49 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.025s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:46:49 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[b10a23f9-abea-4183-b3fa-d94844d3e27d]: (4, ('- - 0', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:46:49 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-e75f74ee-2c40-4749-98ef-223fa658c590 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Searching for a device in session 17 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71509) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 10:46:49 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-e75f74ee-2c40-4749-98ef-223fa658c590 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:4116efc6-988f-40cf-af06-2abf9c6cd44a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GJNowkDY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71509) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 10:46:49 user nova-compute[71509]: INFO nova.compute.manager [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Detaching volume 2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d
Apr 14 10:46:49 user nova-compute[71509]: INFO nova.virt.block_device [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Attempting to driver detach volume 2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d from mountpoint /dev/vdb
Apr 14 10:46:49 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Attempting to detach device vdb from instance b4abb549-8f36-40c5-971f-8accbb14ff86 from the persistent domain config. {{(pid=71509) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 10:46:49 user nova-compute[71509]: DEBUG nova.virt.libvirt.guest [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 10:46:49 user nova-compute[71509]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 10:46:49 user nova-compute[71509]:   <source dev="/dev/sdb"/>
Apr 14 10:46:49 user nova-compute[71509]:   <target dev="vdb" bus="virtio"/>
Apr 14 10:46:49 user nova-compute[71509]:   <serial>2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d</serial>
Apr 14 10:46:49 user nova-compute[71509]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 10:46:49 user nova-compute[71509]: </disk>
Apr 14 10:46:49 user nova-compute[71509]:  {{(pid=71509) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 10:46:49 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Successfully detached device vdb from instance b4abb549-8f36-40c5-971f-8accbb14ff86 from the persistent domain config.
Apr 14 10:46:49 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] calling os-brick to detach iSCSI Volume {{(pid=71509) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 10:46:49 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0bf0749390>, {'target_iqn': 'iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZWfaEHNS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 10:46:49 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Apr 14 10:46:49 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 10:46:49 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:46:49 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:46:49 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:46:49 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:46:49 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:46:49 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:46:49 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:46:49 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:46:50 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-e75f74ee-2c40-4749-98ef-223fa658c590 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.436s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 10:46:50 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-e75f74ee-2c40-4749-98ef-223fa658c590 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] <== connect_volume: return (1439ms) {'type': 'block', 'scsi_wwn': '23038643237383763', 'path': '/dev/sdc'} {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 10:46:50 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e75f74ee-2c40-4749-98ef-223fa658c590 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23038643237383763', 'path': '/dev/sdc'} {{(pid=71509) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 10:46:50 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.783s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 10:46:50 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:46:50 user nova-compute[71509]: DEBUG nova.objects.instance [None req-e75f74ee-2c40-4749-98ef-223fa658c590 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Lazy-loading 'flavor' on Instance uuid 0e6c800c-9b35-4e35-969e-c40367056dce {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:46:50 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:46:50 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a280fb8-b83c-4049-8e76-6eee96e3ca19]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4116efc6-988f-40cf-af06-2abf9c6cd44a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:46:50 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 10:46:50 user nova-compute[71509]: No targets found.
Apr 14 10:46:50 user nova-compute[71509]: iSNS:
Apr 14 10:46:50 user nova-compute[71509]: No targets found.
Apr 14 10:46:50 user nova-compute[71509]: STATIC:
Apr 14 10:46:50 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:4116efc6-988f-40cf-af06-2abf9c6cd44a
Apr 14 10:46:50 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:46:50 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:46:50 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d
Apr 14 10:46:50 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:46:50 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:46:50 user nova-compute[71509]: FIRMWARE:
Apr 14 10:46:50 user nova-compute[71509]: No targets found.
Apr 14 10:46:50 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:46:50 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 10:46:50 user nova-compute[71509]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 10:46:50 user nova-compute[71509]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71509) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 10:46:50 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d', 0)] {{(pid=71509) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 10:46:50 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:46:50 user nova-compute[71509]: DEBUG nova.virt.libvirt.guest [None req-e75f74ee-2c40-4749-98ef-223fa658c590 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 10:46:50 user nova-compute[71509]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 10:46:50 user nova-compute[71509]:   <source dev="/dev/sdc"/>
Apr 14 10:46:50 user nova-compute[71509]:   <target dev="vdb" bus="virtio"/>
Apr 14 10:46:50 user nova-compute[71509]:   <serial>4116efc6-988f-40cf-af06-2abf9c6cd44a</serial>
Apr 14 10:46:50 user nova-compute[71509]: </disk>
Apr 14 10:46:50 user nova-compute[71509]:  {{(pid=71509) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 10:46:50 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.131s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:46:50 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[37f02707-f4da-4aed-bb15-b84fdd63e093]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4116efc6-988f-40cf-af06-2abf9c6cd44a\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:46:50 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:46:50 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:46:50 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[5209532f-31a4-4f33-842b-a246c791ef21]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4116efc6-988f-40cf-af06-2abf9c6cd44a (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:46:50 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d (non-flash)
Apr 14 10:46:50 user nova-compute[71509]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4116efc6-988f-40cf-af06-2abf9c6cd44a (non-flash)
Apr 14 10:46:50 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:46:50 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d (non-flash)
Apr 14 10:46:50 user nova-compute[71509]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4116efc6-988f-40cf-af06-2abf9c6cd44a (non-flash)
Apr 14 10:46:50 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 10:46:50 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0c3a7b9870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d'): ({'sdb'}, set())}) {{(pid=71509) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 10:46:50 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Removing single pathed devices sdb {{(pid=71509) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 10:46:50 user nova-compute[71509]: DEBUG nova.compute.manager [req-c066de84-f622-406e-9d40-7b74025ccd46 req-725f9821-407f-4b14-a235-2b48a40dad6b service nova] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Received event network-vif-plugged-608a2408-02df-474f-9006-260c8c97def1 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:46:50 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-c066de84-f622-406e-9d40-7b74025ccd46 req-725f9821-407f-4b14-a235-2b48a40dad6b service nova] Acquiring lock "b4abb549-8f36-40c5-971f-8accbb14ff86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:46:50 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-c066de84-f622-406e-9d40-7b74025ccd46 req-725f9821-407f-4b14-a235-2b48a40dad6b service nova] Lock "b4abb549-8f36-40c5-971f-8accbb14ff86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:46:50 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-c066de84-f622-406e-9d40-7b74025ccd46 req-725f9821-407f-4b14-a235-2b48a40dad6b service nova] Lock "b4abb549-8f36-40c5-971f-8accbb14ff86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:46:50 user nova-compute[71509]: DEBUG nova.compute.manager [req-c066de84-f622-406e-9d40-7b74025ccd46 req-725f9821-407f-4b14-a235-2b48a40dad6b service nova] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] No waiting events found dispatching network-vif-plugged-608a2408-02df-474f-9006-260c8c97def1 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:46:50 user nova-compute[71509]: WARNING nova.compute.manager [req-c066de84-f622-406e-9d40-7b74025ccd46 req-725f9821-407f-4b14-a235-2b48a40dad6b service nova] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Received unexpected event network-vif-plugged-608a2408-02df-474f-9006-260c8c97def1 for instance with vm_state active and task_state rebuilding.
Apr 14 10:46:50 user nova-compute[71509]: DEBUG nova.compute.manager [req-c066de84-f622-406e-9d40-7b74025ccd46 req-725f9821-407f-4b14-a235-2b48a40dad6b service nova] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Received event network-vif-plugged-608a2408-02df-474f-9006-260c8c97def1 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:46:50 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-c066de84-f622-406e-9d40-7b74025ccd46 req-725f9821-407f-4b14-a235-2b48a40dad6b service nova] Acquiring lock "b4abb549-8f36-40c5-971f-8accbb14ff86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:46:50 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-c066de84-f622-406e-9d40-7b74025ccd46 req-725f9821-407f-4b14-a235-2b48a40dad6b service nova] Lock "b4abb549-8f36-40c5-971f-8accbb14ff86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:46:50 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-c066de84-f622-406e-9d40-7b74025ccd46 req-725f9821-407f-4b14-a235-2b48a40dad6b service nova] Lock "b4abb549-8f36-40c5-971f-8accbb14ff86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:46:50 user nova-compute[71509]: DEBUG nova.compute.manager [req-c066de84-f622-406e-9d40-7b74025ccd46 req-725f9821-407f-4b14-a235-2b48a40dad6b service nova] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] No waiting events found dispatching network-vif-plugged-608a2408-02df-474f-9006-260c8c97def1 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:46:50 user nova-compute[71509]: WARNING nova.compute.manager [req-c066de84-f622-406e-9d40-7b74025ccd46 req-725f9821-407f-4b14-a235-2b48a40dad6b service nova] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Received unexpected event network-vif-plugged-608a2408-02df-474f-9006-260c8c97def1 for instance with vm_state active and task_state rebuilding.
Apr 14 10:46:50 user nova-compute[71509]: DEBUG nova.compute.manager [req-c066de84-f622-406e-9d40-7b74025ccd46 req-725f9821-407f-4b14-a235-2b48a40dad6b service nova] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Received event network-vif-plugged-608a2408-02df-474f-9006-260c8c97def1 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:46:50 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-c066de84-f622-406e-9d40-7b74025ccd46 req-725f9821-407f-4b14-a235-2b48a40dad6b service nova] Acquiring lock "b4abb549-8f36-40c5-971f-8accbb14ff86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:46:50 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-c066de84-f622-406e-9d40-7b74025ccd46 req-725f9821-407f-4b14-a235-2b48a40dad6b service nova] Lock "b4abb549-8f36-40c5-971f-8accbb14ff86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:46:50 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-c066de84-f622-406e-9d40-7b74025ccd46 req-725f9821-407f-4b14-a235-2b48a40dad6b service nova] Lock "b4abb549-8f36-40c5-971f-8accbb14ff86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:46:50 user nova-compute[71509]: DEBUG nova.compute.manager [req-c066de84-f622-406e-9d40-7b74025ccd46 req-725f9821-407f-4b14-a235-2b48a40dad6b service nova] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] No waiting events found dispatching network-vif-plugged-608a2408-02df-474f-9006-260c8c97def1 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:46:50 user nova-compute[71509]: WARNING nova.compute.manager [req-c066de84-f622-406e-9d40-7b74025ccd46 req-725f9821-407f-4b14-a235-2b48a40dad6b service nova] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Received unexpected event network-vif-plugged-608a2408-02df-474f-9006-260c8c97def1 for instance with vm_state active and task_state rebuilding.
Apr 14 10:46:50 user nova-compute[71509]: DEBUG nova.compute.manager [req-c066de84-f622-406e-9d40-7b74025ccd46 req-725f9821-407f-4b14-a235-2b48a40dad6b service nova] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Received event network-vif-unplugged-608a2408-02df-474f-9006-260c8c97def1 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:46:50 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-c066de84-f622-406e-9d40-7b74025ccd46 req-725f9821-407f-4b14-a235-2b48a40dad6b service nova] Acquiring lock "b4abb549-8f36-40c5-971f-8accbb14ff86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:46:50 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-c066de84-f622-406e-9d40-7b74025ccd46 req-725f9821-407f-4b14-a235-2b48a40dad6b service nova] Lock "b4abb549-8f36-40c5-971f-8accbb14ff86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:46:50 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-c066de84-f622-406e-9d40-7b74025ccd46 req-725f9821-407f-4b14-a235-2b48a40dad6b service nova] Lock "b4abb549-8f36-40c5-971f-8accbb14ff86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:46:50 user nova-compute[71509]: DEBUG nova.compute.manager [req-c066de84-f622-406e-9d40-7b74025ccd46 req-725f9821-407f-4b14-a235-2b48a40dad6b service nova] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] No waiting events found dispatching network-vif-unplugged-608a2408-02df-474f-9006-260c8c97def1 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:46:50 user nova-compute[71509]: WARNING nova.compute.manager [req-c066de84-f622-406e-9d40-7b74025ccd46 req-725f9821-407f-4b14-a235-2b48a40dad6b service nova] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Received unexpected event network-vif-unplugged-608a2408-02df-474f-9006-260c8c97def1 for instance with vm_state active and task_state rebuilding.
Apr 14 10:46:50 user nova-compute[71509]: DEBUG nova.compute.manager [req-c066de84-f622-406e-9d40-7b74025ccd46 req-725f9821-407f-4b14-a235-2b48a40dad6b service nova] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Received event network-vif-plugged-608a2408-02df-474f-9006-260c8c97def1 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:46:50 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-c066de84-f622-406e-9d40-7b74025ccd46 req-725f9821-407f-4b14-a235-2b48a40dad6b service nova] Acquiring lock "b4abb549-8f36-40c5-971f-8accbb14ff86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:46:50 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-c066de84-f622-406e-9d40-7b74025ccd46 req-725f9821-407f-4b14-a235-2b48a40dad6b service nova] Lock "b4abb549-8f36-40c5-971f-8accbb14ff86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:46:50 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-c066de84-f622-406e-9d40-7b74025ccd46 req-725f9821-407f-4b14-a235-2b48a40dad6b service nova] Lock "b4abb549-8f36-40c5-971f-8accbb14ff86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:46:50 user nova-compute[71509]: DEBUG nova.compute.manager [req-c066de84-f622-406e-9d40-7b74025ccd46 req-725f9821-407f-4b14-a235-2b48a40dad6b service nova] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] No waiting events found dispatching network-vif-plugged-608a2408-02df-474f-9006-260c8c97def1 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:46:50 user nova-compute[71509]: WARNING nova.compute.manager [req-c066de84-f622-406e-9d40-7b74025ccd46 req-725f9821-407f-4b14-a235-2b48a40dad6b service nova] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Received unexpected event network-vif-plugged-608a2408-02df-474f-9006-260c8c97def1 for instance with vm_state active and task_state rebuilding.
Apr 14 10:46:50 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:46:50 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:46:50 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dcc86a7-a35c-4df5-b4c4-edf7aa01069c]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:46:50 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:46:50 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.028s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:46:50 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[63574e53-eeae-440b-b6a8-d301a7e8cf3b]: (4, ('ok\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:46:50 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Flushing IO for device /dev/sdb {{(pid=71509) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 10:46:50 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:46:50 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:46:50 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2987bc0-b88c-43a1-9e37-dcfdfb333d2a]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:46:50 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71509) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 10:46:50 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:46:50 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:46:50 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd362d2c-292d-4c31-9c25-b3980e414e51]: (4, ('1', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:46:50 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71509) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 10:46:50 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] SCSI volumes sdb have been removed. {{(pid=71509) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 10:46:50 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d')] {{(pid=71509) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 10:46:50 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:46:50 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:46:50 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[cab3024e-5644-4816-a714-bf33e891b412]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:46:50 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:46:50 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d -p 172.16.0.220:3260 --logout {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:46:50 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:46:50 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ab11854-d4f3-48fc-98d3-20e3a5fac04b]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:46:50 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d, portal: 172.16.0.220,3260]
Apr 14 10:46:50 user nova-compute[71509]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d, portal: 172.16.0.220,3260] successful.
Apr 14 10:46:50 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:46:50 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d -p 172.16.0.220:3260 --op delete {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:46:50 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:46:50 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[17bb7795-2bda-402f-b81f-15fe705e5522]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:46:50 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:46:50 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.483s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 10:46:50 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] <== disconnect_volume: return (1266ms) None {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 10:46:50 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Disconnected iSCSI Volume {{(pid=71509) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 10:46:51 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-e75f74ee-2c40-4749-98ef-223fa658c590 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] No BDM found with device name vda, not building metadata. {{(pid=71509) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 10:46:51 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-e75f74ee-2c40-4749-98ef-223fa658c590 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71509) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 10:46:51 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-e75f74ee-2c40-4749-98ef-223fa658c590 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] No VIF found with MAC fa:16:3e:a6:47:fc, not building metadata {{(pid=71509) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 10:46:51 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-e75f74ee-2c40-4749-98ef-223fa658c590 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Lock "0e6c800c-9b35-4e35-969e-c40367056dce" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.612s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:46:52 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:46:52 user nova-compute[71509]: INFO nova.compute.manager [None req-af306871-7b15-472c-a43d-040e5a30e019 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Rescuing
Apr 14 10:46:52 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-af306871-7b15-472c-a43d-040e5a30e019 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Acquiring lock "refresh_cache-0e6c800c-9b35-4e35-969e-c40367056dce" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:46:52 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-af306871-7b15-472c-a43d-040e5a30e019 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Acquired lock "refresh_cache-0e6c800c-9b35-4e35-969e-c40367056dce" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:46:52 user nova-compute[71509]: DEBUG nova.network.neutron [None req-af306871-7b15-472c-a43d-040e5a30e019 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Building network info cache for instance {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 10:46:52 user nova-compute[71509]: DEBUG nova.network.neutron [None req-af306871-7b15-472c-a43d-040e5a30e019 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Updating instance_info_cache with network_info: [{"id": "49978689-84ce-4422-add9-9bb12f628c37", "address": "fa:16:3e:a6:47:fc", "network": {"id": "9040ebc7-4d6b-4fd2-8543-f22ca3fb249c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2098664740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "482809b9148e408b84b156802a21a225", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49978689-84", "ovs_interfaceid": "49978689-84ce-4422-add9-9bb12f628c37", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:46:52 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-af306871-7b15-472c-a43d-040e5a30e019 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Releasing lock "refresh_cache-0e6c800c-9b35-4e35-969e-c40367056dce" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:46:52 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:46:52 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:46:52 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:46:52 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:46:52 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:46:52 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:46:53 user nova-compute[71509]: DEBUG nova.compute.manager [req-7663a8e4-382c-41f3-9d89-7374a8e78369 req-cfba2239-3e55-430a-b9ed-93863fd55563 service nova] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Received event network-vif-unplugged-49978689-84ce-4422-add9-9bb12f628c37 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:46:53 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-7663a8e4-382c-41f3-9d89-7374a8e78369 req-cfba2239-3e55-430a-b9ed-93863fd55563 service nova] Acquiring lock "0e6c800c-9b35-4e35-969e-c40367056dce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:46:53 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-7663a8e4-382c-41f3-9d89-7374a8e78369 req-cfba2239-3e55-430a-b9ed-93863fd55563 service nova] Lock "0e6c800c-9b35-4e35-969e-c40367056dce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:46:53 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-7663a8e4-382c-41f3-9d89-7374a8e78369 req-cfba2239-3e55-430a-b9ed-93863fd55563 service nova] Lock "0e6c800c-9b35-4e35-969e-c40367056dce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:46:53 user nova-compute[71509]: DEBUG nova.compute.manager [req-7663a8e4-382c-41f3-9d89-7374a8e78369 req-cfba2239-3e55-430a-b9ed-93863fd55563 service nova] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] No waiting events found dispatching network-vif-unplugged-49978689-84ce-4422-add9-9bb12f628c37 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:46:53 user nova-compute[71509]: WARNING nova.compute.manager [req-7663a8e4-382c-41f3-9d89-7374a8e78369 req-cfba2239-3e55-430a-b9ed-93863fd55563 service nova] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Received unexpected event network-vif-unplugged-49978689-84ce-4422-add9-9bb12f628c37 for instance with vm_state active and task_state rescuing.
Apr 14 10:46:53 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Instance destroyed successfully.
Apr 14 10:46:53 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T10:42:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-375061147',display_name='tempest-ServerActionsTestJSON-server-564468196',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-375061147',id=4,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNt/FyD1XXsxB5kJC+SJ1dgkjoXXHkL+KX0Cr5HvI72xTIz+DAtuVRPHeIpMNLt39mbbZ9KAoCJibRQza0Qbd8j8EEoV7QHombhWz2Mdusr+gJ2OYTqrrRzVbjIHACTFWw==',key_name='tempest-keypair-1544270235',keypairs=<?>,launch_index=0,launched_at=2023-04-14T10:43:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3ea2cb4dfa5b4a52b658efd8f5aefb36',ramdisk_id='',reservation_id='r-2qmryidz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-1923052090',owner_user_name='tempest-ServerActionsTestJSON-1923052090-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T10:46:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5873a358bf544691b12cd2979f5e36dc',uuid=b4abb549-8f36-40c5-971f-8accbb14ff86,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "608a2408-02df-474f-9006-260c8c97def1", "address": "fa:16:3e:e4:f7:87", "network": {"id": "18a91434-637b-4c19-a97b-736b32c1ea5a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1824162811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea2cb4dfa5b4a52b658efd8f5aefb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap608a2408-02", "ovs_interfaceid": "608a2408-02df-474f-9006-260c8c97def1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 10:46:53 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Converting VIF {"id": "608a2408-02df-474f-9006-260c8c97def1", "address": "fa:16:3e:e4:f7:87", "network": {"id": "18a91434-637b-4c19-a97b-736b32c1ea5a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1824162811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea2cb4dfa5b4a52b658efd8f5aefb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap608a2408-02", "ovs_interfaceid": "608a2408-02df-474f-9006-260c8c97def1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:46:53 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e4:f7:87,bridge_name='br-int',has_traffic_filtering=True,id=608a2408-02df-474f-9006-260c8c97def1,network=Network(18a91434-637b-4c19-a97b-736b32c1ea5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap608a2408-02') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:46:53 user nova-compute[71509]: DEBUG os_vif [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e4:f7:87,bridge_name='br-int',has_traffic_filtering=True,id=608a2408-02df-474f-9006-260c8c97def1,network=Network(18a91434-637b-4c19-a97b-736b32c1ea5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap608a2408-02') {{(pid=71509) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 10:46:53 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:46:53 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap608a2408-02, bridge=br-int, if_exists=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:46:53 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:46:53 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 10:46:53 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:46:53 user nova-compute[71509]: INFO os_vif [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e4:f7:87,bridge_name='br-int',has_traffic_filtering=True,id=608a2408-02df-474f-9006-260c8c97def1,network=Network(18a91434-637b-4c19-a97b-736b32c1ea5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap608a2408-02')
Apr 14 10:46:53 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] calling os-brick to detach iSCSI Volume {{(pid=71509) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 10:46:53 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0bf0749390>, {'target_iqn': 'iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZWfaEHNS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 10:46:53 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Apr 14 10:46:53 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 10:46:53 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 10:46:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:46:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:46:53 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0f55ffe-1e16-4072-b2e4-0247bd4ae8c9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4116efc6-988f-40cf-af06-2abf9c6cd44a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:46:53 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 10:46:53 user nova-compute[71509]: No targets found.
Apr 14 10:46:53 user nova-compute[71509]: iSNS:
Apr 14 10:46:53 user nova-compute[71509]: No targets found.
Apr 14 10:46:53 user nova-compute[71509]: STATIC:
Apr 14 10:46:53 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:4116efc6-988f-40cf-af06-2abf9c6cd44a
Apr 14 10:46:53 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:46:53 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:46:53 user nova-compute[71509]: FIRMWARE:
Apr 14 10:46:53 user nova-compute[71509]: No targets found.
Apr 14 10:46:53 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:46:53 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 10:46:53 user nova-compute[71509]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 10:46:53 user nova-compute[71509]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71509) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 10:46:53 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d', 0)] {{(pid=71509) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 10:46:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:46:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:46:53 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[529edaf5-cce5-4fd7-a624-461c83f9d3a6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4116efc6-988f-40cf-af06-2abf9c6cd44a\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:46:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:46:53 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Instance destroyed successfully.
Apr 14 10:46:53 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-af306871-7b15-472c-a43d-040e5a30e019 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Attempting a stable device rescue
Apr 14 10:46:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:46:53 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[d710fdb6-0cc6-4512-b564-144eea300020]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4116efc6-988f-40cf-af06-2abf9c6cd44a (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:46:53 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4116efc6-988f-40cf-af06-2abf9c6cd44a (non-flash)
Apr 14 10:46:53 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:46:53 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4116efc6-988f-40cf-af06-2abf9c6cd44a (non-flash)
Apr 14 10:46:53 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 10:46:53 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0c2c3d0310>, {}) {{(pid=71509) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 10:46:53 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Disconnecting from: [] {{(pid=71509) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 10:46:53 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.090s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 10:46:53 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] <== disconnect_volume: return (91ms) None {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 10:46:53 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Disconnected iSCSI Volume {{(pid=71509) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 10:46:53 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Deleting instance files /opt/stack/data/nova/instances/b4abb549-8f36-40c5-971f-8accbb14ff86_del
Apr 14 10:46:53 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Deletion of /opt/stack/data/nova/instances/b4abb549-8f36-40c5-971f-8accbb14ff86_del complete
Apr 14 10:46:53 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-af306871-7b15-472c-a43d-040e5a30e019 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=71509) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 14 10:46:53 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-af306871-7b15-472c-a43d-040e5a30e019 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Instance directory exists: not creating {{(pid=71509) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 14 10:46:53 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-af306871-7b15-472c-a43d-040e5a30e019 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Creating image(s)
Apr 14 10:46:53 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-af306871-7b15-472c-a43d-040e5a30e019 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Acquiring lock "/opt/stack/data/nova/instances/0e6c800c-9b35-4e35-969e-c40367056dce/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:46:53 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-af306871-7b15-472c-a43d-040e5a30e019 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Lock "/opt/stack/data/nova/instances/0e6c800c-9b35-4e35-969e-c40367056dce/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:46:53 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-af306871-7b15-472c-a43d-040e5a30e019 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Lock "/opt/stack/data/nova/instances/0e6c800c-9b35-4e35-969e-c40367056dce/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.013s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:46:53 user nova-compute[71509]: DEBUG nova.objects.instance [None req-af306871-7b15-472c-a43d-040e5a30e019 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Lazy-loading 'trusted_certs' on Instance uuid 0e6c800c-9b35-4e35-969e-c40367056dce {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:46:53 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-af306871-7b15-472c-a43d-040e5a30e019 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Acquiring lock "6b8f42e2843f710ca610e9ecab77173b1a99345b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:46:53 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-af306871-7b15-472c-a43d-040e5a30e019 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Lock "6b8f42e2843f710ca610e9ecab77173b1a99345b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:46:53 user nova-compute[71509]: INFO nova.virt.block_device [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Booting with volume 2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d at /dev/vdb
Apr 14 10:46:54 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-af306871-7b15-472c-a43d-040e5a30e019 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6b8f42e2843f710ca610e9ecab77173b1a99345b.part --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:46:54 user nova-compute[71509]: DEBUG os_brick.utils [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 10:46:54 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:46:54 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:46:54 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[05dd1b1f-3330-42bc-ad2c-56b61b275577]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50119df3c417\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:46:54 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-af306871-7b15-472c-a43d-040e5a30e019 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6b8f42e2843f710ca610e9ecab77173b1a99345b.part --force-share --output=json" returned: 0 in 0.152s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:46:54 user nova-compute[71509]: DEBUG nova.virt.images [None req-af306871-7b15-472c-a43d-040e5a30e019 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] aefc0dd9-6bb6-4a2f-ada9-e21b5f4d6151 was qcow2, converting to raw {{(pid=71509) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 14 10:46:54 user nova-compute[71509]: DEBUG nova.privsep.utils [None req-af306871-7b15-472c-a43d-040e5a30e019 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71509) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 10:46:54 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-af306871-7b15-472c-a43d-040e5a30e019 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6b8f42e2843f710ca610e9ecab77173b1a99345b.part /opt/stack/data/nova/instances/_base/6b8f42e2843f710ca610e9ecab77173b1a99345b.converted {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:46:54 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:46:54 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:46:54 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c1ceac1-2904-4f32-bc8f-7861fa089fe6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:46:54 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:46:54 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.031s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:46:54 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[853ff469-c3c0-46e4-af7e-bc8cf2955063]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:46:54 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[93f0161f-073b-486c-9a35-4394b5316065]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:46:54 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Running cmd (subprocess): nvme version {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:46:54 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] 'nvme version' failed. Not Retrying. {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 10:46:54 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.nvmeof [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] nvme not present on system {{(pid=71509) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 10:46:54 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:46:54 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 10:46:54 user nova-compute[71509]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 10:46:54 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffd549db-8dc0-4f58-8419-0d6b27f2d7c3]: (4, '') {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:46:54 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71509) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 10:46:54 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71509) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 10:46:54 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] LIGHTOS: no hostnqn found. {{(pid=71509) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 10:46:54 user nova-compute[71509]: DEBUG os_brick.utils [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] <== get_connector_properties: return (163ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50119df3c417', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 10:46:54 user nova-compute[71509]: DEBUG nova.virt.block_device [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Updating existing volume attachment record: 525b8e4a-8b29-4d82-b50c-1b1a410bf331 {{(pid=71509) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 10:46:55 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-af306871-7b15-472c-a43d-040e5a30e019 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6b8f42e2843f710ca610e9ecab77173b1a99345b.part /opt/stack/data/nova/instances/_base/6b8f42e2843f710ca610e9ecab77173b1a99345b.converted" returned: 0 in 0.310s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:46:55 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-af306871-7b15-472c-a43d-040e5a30e019 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6b8f42e2843f710ca610e9ecab77173b1a99345b.converted --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:46:55 user nova-compute[71509]: DEBUG nova.compute.manager [req-a105a47d-8e89-4397-82ce-6258a3cd4a3f req-07db0708-b729-4e82-80b6-055e80df7942 service nova] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Received event network-vif-plugged-49978689-84ce-4422-add9-9bb12f628c37 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:46:55 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-a105a47d-8e89-4397-82ce-6258a3cd4a3f req-07db0708-b729-4e82-80b6-055e80df7942 service nova] Acquiring lock "0e6c800c-9b35-4e35-969e-c40367056dce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:46:55 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-a105a47d-8e89-4397-82ce-6258a3cd4a3f req-07db0708-b729-4e82-80b6-055e80df7942 service nova] Lock "0e6c800c-9b35-4e35-969e-c40367056dce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:46:55 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-a105a47d-8e89-4397-82ce-6258a3cd4a3f req-07db0708-b729-4e82-80b6-055e80df7942 service nova] Lock "0e6c800c-9b35-4e35-969e-c40367056dce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:46:55 user nova-compute[71509]: DEBUG nova.compute.manager [req-a105a47d-8e89-4397-82ce-6258a3cd4a3f req-07db0708-b729-4e82-80b6-055e80df7942 service nova] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] No waiting events found dispatching network-vif-plugged-49978689-84ce-4422-add9-9bb12f628c37 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:46:55 user nova-compute[71509]: WARNING nova.compute.manager [req-a105a47d-8e89-4397-82ce-6258a3cd4a3f req-07db0708-b729-4e82-80b6-055e80df7942 service nova] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Received unexpected event network-vif-plugged-49978689-84ce-4422-add9-9bb12f628c37 for instance with vm_state active and task_state rescuing.
Apr 14 10:46:55 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-af306871-7b15-472c-a43d-040e5a30e019 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6b8f42e2843f710ca610e9ecab77173b1a99345b.converted --force-share --output=json" returned: 0 in 0.149s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:46:55 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-af306871-7b15-472c-a43d-040e5a30e019 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Lock "6b8f42e2843f710ca610e9ecab77173b1a99345b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.536s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:46:55 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-af306871-7b15-472c-a43d-040e5a30e019 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Acquiring lock "6b8f42e2843f710ca610e9ecab77173b1a99345b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:46:55 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-af306871-7b15-472c-a43d-040e5a30e019 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Lock "6b8f42e2843f710ca610e9ecab77173b1a99345b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:46:55 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-af306871-7b15-472c-a43d-040e5a30e019 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6b8f42e2843f710ca610e9ecab77173b1a99345b --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:46:55 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-af306871-7b15-472c-a43d-040e5a30e019 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6b8f42e2843f710ca610e9ecab77173b1a99345b --force-share --output=json" returned: 0 in 0.184s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:46:55 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-af306871-7b15-472c-a43d-040e5a30e019 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6b8f42e2843f710ca610e9ecab77173b1a99345b,backing_fmt=raw /opt/stack/data/nova/instances/0e6c800c-9b35-4e35-969e-c40367056dce/disk.rescue {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:46:55 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-af306871-7b15-472c-a43d-040e5a30e019 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6b8f42e2843f710ca610e9ecab77173b1a99345b,backing_fmt=raw /opt/stack/data/nova/instances/0e6c800c-9b35-4e35-969e-c40367056dce/disk.rescue" returned: 0 in 0.052s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:46:55 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-af306871-7b15-472c-a43d-040e5a30e019 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Lock "6b8f42e2843f710ca610e9ecab77173b1a99345b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:46:55 user nova-compute[71509]: DEBUG nova.objects.instance [None req-af306871-7b15-472c-a43d-040e5a30e019 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Lazy-loading 'migration_context' on Instance uuid 0e6c800c-9b35-4e35-969e-c40367056dce {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:46:55 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-af306871-7b15-472c-a43d-040e5a30e019 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Created local disks {{(pid=71509) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 10:46:55 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-af306871-7b15-472c-a43d-040e5a30e019 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Start _get_guest_xml network_info=[{"id": "49978689-84ce-4422-add9-9bb12f628c37", "address": "fa:16:3e:a6:47:fc", "network": {"id": "9040ebc7-4d6b-4fd2-8543-f22ca3fb249c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2098664740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-2098664740-network", "vif_mac": "fa:16:3e:a6:47:fc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "482809b9148e408b84b156802a21a225", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49978689-84", "ovs_interfaceid": "49978689-84ce-4422-add9-9bb12f628c37", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T10:38:55Z,direct_url=<?>,disk_format='qcow2',id=048ec0ee-0465-448d-8b4c-f072acb101dc,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='9742d6ad20cf48d9bab0fdbcc9491db9',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T10:38:57Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'aefc0dd9-6bb6-4a2f-ada9-e21b5f4d6151', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '048ec0ee-0465-448d-8b4c-f072acb101dc'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vdb', 'boot_index': None, 'device_type': 'disk', 'attachment_id': '6b5bbd45-8d7b-460b-a3f9-da70d9ca579a', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4116efc6-988f-40cf-af06-2abf9c6cd44a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GJNowkDY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '0e6c800c-9b35-4e35-969e-c40367056dce', 'attached_at': '', 'detached_at': '', 'volume_id': '4116efc6-988f-40cf-af06-2abf9c6cd44a', 'serial': '4116efc6-988f-40cf-af06-2abf9c6cd44a'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'volume_type': None} {{(pid=71509) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 10:46:55 user nova-compute[71509]: DEBUG nova.objects.instance [None req-af306871-7b15-472c-a43d-040e5a30e019 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Lazy-loading 'resources' on Instance uuid 0e6c800c-9b35-4e35-969e-c40367056dce {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:46:55 user nova-compute[71509]: DEBUG nova.objects.instance [None req-af306871-7b15-472c-a43d-040e5a30e019 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Lazy-loading 'numa_topology' on Instance uuid 0e6c800c-9b35-4e35-969e-c40367056dce {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:46:55 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-af306871-7b15-472c-a43d-040e5a30e019 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:46:55 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-af306871-7b15-472c-a43d-040e5a30e019 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:46:55 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-af306871-7b15-472c-a43d-040e5a30e019 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71509) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 10:46:55 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-af306871-7b15-472c-a43d-040e5a30e019 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T10:40:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T10:38:55Z,direct_url=<?>,disk_format='qcow2',id=048ec0ee-0465-448d-8b4c-f072acb101dc,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='9742d6ad20cf48d9bab0fdbcc9491db9',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T10:38:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 10:46:55 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-af306871-7b15-472c-a43d-040e5a30e019 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Flavor limits 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 10:46:55 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-af306871-7b15-472c-a43d-040e5a30e019 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Image limits 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 10:46:55 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-af306871-7b15-472c-a43d-040e5a30e019 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Flavor pref 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 10:46:55 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-af306871-7b15-472c-a43d-040e5a30e019 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Image pref 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 10:46:55 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-af306871-7b15-472c-a43d-040e5a30e019 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 10:46:55 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-af306871-7b15-472c-a43d-040e5a30e019 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 10:46:55 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-af306871-7b15-472c-a43d-040e5a30e019 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71509) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 10:46:55 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-af306871-7b15-472c-a43d-040e5a30e019 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Got 1 possible topologies {{(pid=71509) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 10:46:55 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-af306871-7b15-472c-a43d-040e5a30e019 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 10:46:55 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-af306871-7b15-472c-a43d-040e5a30e019 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 10:46:55 user nova-compute[71509]: DEBUG nova.objects.instance [None req-af306871-7b15-472c-a43d-040e5a30e019 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0e6c800c-9b35-4e35-969e-c40367056dce {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:46:55 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af306871-7b15-472c-a43d-040e5a30e019 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Calling os-brick to attach iSCSI Volume {{(pid=71509) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 10:46:55 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-af306871-7b15-472c-a43d-040e5a30e019 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0bf0749390>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4116efc6-988f-40cf-af06-2abf9c6cd44a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GJNowkDY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 10:46:55 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-af306871-7b15-472c-a43d-040e5a30e019 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 10:46:55 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-af306871-7b15-472c-a43d-040e5a30e019 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 10:46:55 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-af306871-7b15-472c-a43d-040e5a30e019 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 10:46:55 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-af306871-7b15-472c-a43d-040e5a30e019 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 10:46:55 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-af306871-7b15-472c-a43d-040e5a30e019 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4116efc6-988f-40cf-af06-2abf9c6cd44a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 10:46:55 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-af306871-7b15-472c-a43d-040e5a30e019 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4116efc6-988f-40cf-af06-2abf9c6cd44a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 10:46:55 user nova-compute[71509]: INFO os_brick.initiator.connectors.iscsi [None req-af306871-7b15-472c-a43d-040e5a30e019 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 10:46:55 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4116efc6-988f-40cf-af06-2abf9c6cd44a -p 172.16.0.220:3260 {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:46:55 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4116efc6-988f-40cf-af06-2abf9c6cd44a -p 172.16.0.220:3260" returned: 0 in 0.022s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:46:55 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[35a9466b-fa77-4e74-b924-d44791a7cdeb]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:4116efc6-988f-40cf-af06-2abf9c6cd44a\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = GJNowkDY\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:46:55 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-af306871-7b15-472c-a43d-040e5a30e019 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Apr 14 10:46:55 user nova-compute[71509]: node.name = iqn.2010-10.org.openstack:4116efc6-988f-40cf-af06-2abf9c6cd44a
Apr 14 10:46:55 user nova-compute[71509]: node.tpgt = -1
Apr 14 10:46:55 user nova-compute[71509]: node.startup = automatic
Apr 14 10:46:55 user nova-compute[71509]: node.leading_login = No
Apr 14 10:46:55 user nova-compute[71509]: iface.iscsi_ifacename = default
Apr 14 10:46:55 user nova-compute[71509]: iface.net_ifacename = <empty>
Apr 14 10:46:55 user nova-compute[71509]: iface.ipaddress = <empty>
Apr 14 10:46:55 user nova-compute[71509]: iface.prefix_len = 0
Apr 14 10:46:55 user nova-compute[71509]: iface.hwaddress = <empty>
Apr 14 10:46:55 user nova-compute[71509]: iface.transport_name = tcp
Apr 14 10:46:55 user nova-compute[71509]: iface.initiatorname = <empty>
Apr 14 10:46:55 user nova-compute[71509]: iface.state = <empty>
Apr 14 10:46:55 user nova-compute[71509]: iface.vlan_id = 0
Apr 14 10:46:55 user nova-compute[71509]: iface.vlan_priority = 0
Apr 14 10:46:55 user nova-compute[71509]: iface.vlan_state = <empty>
Apr 14 10:46:55 user nova-compute[71509]: iface.iface_num = 0
Apr 14 10:46:55 user nova-compute[71509]: iface.mtu = 0
Apr 14 10:46:55 user nova-compute[71509]: iface.port = 0
Apr 14 10:46:55 user nova-compute[71509]: iface.bootproto = <empty>
Apr 14 10:46:55 user nova-compute[71509]: iface.subnet_mask = <empty>
Apr 14 10:46:55 user nova-compute[71509]: iface.gateway = <empty>
Apr 14 10:46:55 user nova-compute[71509]: iface.dhcp_alt_client_id_state = <empty>
Apr 14 10:46:55 user nova-compute[71509]: iface.dhcp_alt_client_id = <empty>
Apr 14 10:46:55 user nova-compute[71509]: iface.dhcp_dns = <empty>
Apr 14 10:46:55 user nova-compute[71509]: iface.dhcp_learn_iqn = <empty>
Apr 14 10:46:55 user nova-compute[71509]: iface.dhcp_req_vendor_id_state = <empty>
Apr 14 10:46:55 user nova-compute[71509]: iface.dhcp_vendor_id_state = <empty>
Apr 14 10:46:55 user nova-compute[71509]: iface.dhcp_vendor_id = <empty>
Apr 14 10:46:55 user nova-compute[71509]: iface.dhcp_slp_da = <empty>
Apr 14 10:46:55 user nova-compute[71509]: iface.fragmentation = <empty>
Apr 14 10:46:55 user nova-compute[71509]: iface.gratuitous_arp = <empty>
Apr 14 10:46:55 user nova-compute[71509]: iface.incoming_forwarding = <empty>
Apr 14 10:46:55 user nova-compute[71509]: iface.tos_state = <empty>
Apr 14 10:46:55 user nova-compute[71509]: iface.tos = 0
Apr 14 10:46:55 user nova-compute[71509]: iface.ttl = 0
Apr 14 10:46:55 user nova-compute[71509]: iface.delayed_ack = <empty>
Apr 14 10:46:55 user nova-compute[71509]: iface.tcp_nagle = <empty>
Apr 14 10:46:55 user nova-compute[71509]: iface.tcp_wsf_state = <empty>
Apr 14 10:46:55 user nova-compute[71509]: iface.tcp_wsf = 0
Apr 14 10:46:55 user nova-compute[71509]: iface.tcp_timer_scale = 0
Apr 14 10:46:55 user nova-compute[71509]: iface.tcp_timestamp = <empty>
Apr 14 10:46:55 user nova-compute[71509]: iface.redirect = <empty>
Apr 14 10:46:55 user nova-compute[71509]: iface.def_task_mgmt_timeout = 0
Apr 14 10:46:55 user nova-compute[71509]: iface.header_digest = <empty>
Apr 14 10:46:55 user nova-compute[71509]: iface.data_digest = <empty>
Apr 14 10:46:55 user nova-compute[71509]: iface.immediate_data = <empty>
Apr 14 10:46:55 user nova-compute[71509]: iface.initial_r2t = <empty>
Apr 14 10:46:55 user nova-compute[71509]: iface.data_seq_inorder = <empty>
Apr 14 10:46:55 user nova-compute[71509]: iface.data_pdu_inorder = <empty>
Apr 14 10:46:55 user nova-compute[71509]: iface.erl = 0
Apr 14 10:46:55 user nova-compute[71509]: iface.max_receive_data_len = 0
Apr 14 10:46:55 user nova-compute[71509]: iface.first_burst_len = 0
Apr 14 10:46:55 user nova-compute[71509]: iface.max_outstanding_r2t = 0
Apr 14 10:46:55 user nova-compute[71509]: iface.max_burst_len = 0
Apr 14 10:46:55 user nova-compute[71509]: iface.chap_auth = <empty>
Apr 14 10:46:55 user nova-compute[71509]: iface.bidi_chap = <empty>
Apr 14 10:46:55 user nova-compute[71509]: iface.strict_login_compliance = <empty>
Apr 14 10:46:55 user nova-compute[71509]: iface.discovery_auth = <empty>
Apr 14 10:46:55 user nova-compute[71509]: iface.discovery_logout = <empty>
Apr 14 10:46:55 user nova-compute[71509]: node.discovery_address = <empty>
Apr 14 10:46:55 user nova-compute[71509]: node.discovery_port = 0
Apr 14 10:46:55 user nova-compute[71509]: node.discovery_type = static
Apr 14 10:46:55 user nova-compute[71509]: node.session.initial_cmdsn = 0
Apr 14 10:46:55 user nova-compute[71509]: node.session.initial_login_retry_max = 8
Apr 14 10:46:55 user nova-compute[71509]: node.session.xmit_thread_priority = -20
Apr 14 10:46:55 user nova-compute[71509]: node.session.cmds_max = 128
Apr 14 10:46:55 user nova-compute[71509]: node.session.queue_depth = 32
Apr 14 10:46:55 user nova-compute[71509]: node.session.nr_sessions = 1
Apr 14 10:46:55 user nova-compute[71509]: node.session.auth.authmethod = CHAP
Apr 14 10:46:55 user nova-compute[71509]: node.session.auth.username = GJNowkDY
Apr 14 10:46:55 user nova-compute[71509]: node.session.auth.password = ***
Apr 14 10:46:55 user nova-compute[71509]: node.session.auth.username_in = <empty>
Apr 14 10:46:55 user nova-compute[71509]: node.session.auth.password_in = <empty>
Apr 14 10:46:55 user nova-compute[71509]: node.session.auth.chap_algs = MD5
Apr 14 10:46:55 user nova-compute[71509]: node.session.timeo.replacement_timeout = 120
Apr 14 10:46:55 user nova-compute[71509]: node.session.err_timeo.abort_timeout = 15
Apr 14 10:46:55 user nova-compute[71509]: node.session.err_timeo.lu_reset_timeout = 30
Apr 14 10:46:55 user nova-compute[71509]: node.session.err_timeo.tgt_reset_timeout = 30
Apr 14 10:46:55 user nova-compute[71509]: node.session.err_timeo.host_reset_timeout = 60
Apr 14 10:46:55 user nova-compute[71509]: node.session.iscsi.FastAbort = Yes
Apr 14 10:46:55 user nova-compute[71509]: node.session.iscsi.InitialR2T = No
Apr 14 10:46:55 user nova-compute[71509]: node.session.iscsi.ImmediateData = Yes
Apr 14 10:46:55 user nova-compute[71509]: node.session.iscsi.FirstBurstLength = 262144
Apr 14 10:46:55 user nova-compute[71509]: node.session.iscsi.MaxBurstLength = 16776192
Apr 14 10:46:55 user nova-compute[71509]: node.session.iscsi.DefaultTime2Retain = 0
Apr 14 10:46:55 user nova-compute[71509]: node.session.iscsi.DefaultTime2Wait = 2
Apr 14 10:46:55 user nova-compute[71509]: node.session.iscsi.MaxConnections = 1
Apr 14 10:46:55 user nova-compute[71509]: node.session.iscsi.MaxOutstandingR2T = 1
Apr 14 10:46:55 user nova-compute[71509]: node.session.iscsi.ERL = 0
Apr 14 10:46:55 user nova-compute[71509]: node.session.scan = manual
Apr 14 10:46:55 user nova-compute[71509]: node.session.reopen_max = 0
Apr 14 10:46:55 user nova-compute[71509]: node.conn[0].address = 172.16.0.220
Apr 14 10:46:55 user nova-compute[71509]: node.conn[0].port = 3260
Apr 14 10:46:55 user nova-compute[71509]: node.conn[0].startup = manual
Apr 14 10:46:55 user nova-compute[71509]: node.conn[0].tcp.window_size = 524288
Apr 14 10:46:55 user nova-compute[71509]: node.conn[0].tcp.type_of_service = 0
Apr 14 10:46:55 user nova-compute[71509]: node.conn[0].timeo.logout_timeout = 15
Apr 14 10:46:55 user nova-compute[71509]: node.conn[0].timeo.login_timeout = 15
Apr 14 10:46:55 user nova-compute[71509]: node.conn[0].timeo.auth_timeout = 45
Apr 14 10:46:55 user nova-compute[71509]: node.conn[0].timeo.noop_out_interval = 5
Apr 14 10:46:55 user nova-compute[71509]: node.conn[0].timeo.noop_out_timeout = 5
Apr 14 10:46:55 user nova-compute[71509]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Apr 14 10:46:55 user nova-compute[71509]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Apr 14 10:46:55 user nova-compute[71509]: node.conn[0].iscsi.HeaderDigest = None
Apr 14 10:46:55 user nova-compute[71509]: node.conn[0].iscsi.DataDigest = None
Apr 14 10:46:55 user nova-compute[71509]: node.conn[0].iscsi.IFMarker = No
Apr 14 10:46:55 user nova-compute[71509]: node.conn[0].iscsi.OFMarker = No
Apr 14 10:46:55 user nova-compute[71509]: # END RECORD
Apr 14 10:46:55 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:46:55 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4116efc6-988f-40cf-af06-2abf9c6cd44a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:46:55 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4116efc6-988f-40cf-af06-2abf9c6cd44a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:46:55 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[5243e9e8-2185-40c1-afc8-3c1ec20e0ac3]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:46:55 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-af306871-7b15-472c-a43d-040e5a30e019 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:46:55 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4116efc6-988f-40cf-af06-2abf9c6cd44a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:46:55 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4116efc6-988f-40cf-af06-2abf9c6cd44a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:46:55 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3be393a-b872-4e89-a142-986e0fabc891]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:46:55 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-af306871-7b15-472c-a43d-040e5a30e019 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:46:55 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4116efc6-988f-40cf-af06-2abf9c6cd44a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GJNowkDY {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:46:55 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4116efc6-988f-40cf-af06-2abf9c6cd44a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GJNowkDY" returned: 0 in 0.028s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:46:55 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[025127c5-56ad-41e0-af93-897d45e61a8d]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:46:55 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-af306871-7b15-472c-a43d-040e5a30e019 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GJNowkDY'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:46:55 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4116efc6-988f-40cf-af06-2abf9c6cd44a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:46:55 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4116efc6-988f-40cf-af06-2abf9c6cd44a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:46:55 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[07aaefca-7917-4de9-8f45-98387e843a94]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:46:55 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-af306871-7b15-472c-a43d-040e5a30e019 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:46:55 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:46:55 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:46:55 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[56cab0d1-8927-40ad-b3d9-7a166f003764]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4116efc6-988f-40cf-af06-2abf9c6cd44a (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:46:55 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-af306871-7b15-472c-a43d-040e5a30e019 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4116efc6-988f-40cf-af06-2abf9c6cd44a (non-flash)
Apr 14 10:46:55 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:46:55 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-af306871-7b15-472c-a43d-040e5a30e019 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4116efc6-988f-40cf-af06-2abf9c6cd44a (non-flash)
Apr 14 10:46:55 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 10:46:55 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-af306871-7b15-472c-a43d-040e5a30e019 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4116efc6-988f-40cf-af06-2abf9c6cd44a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.158s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 10:46:55 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-af306871-7b15-472c-a43d-040e5a30e019 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Connected to 172.16.0.220:3260 {{(pid=71509) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 10:46:55 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-af306871-7b15-472c-a43d-040e5a30e019 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] HCTL ('34', '0', '0', 0) found on session 17 with lun 0 {{(pid=71509) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 10:46:55 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-af306871-7b15-472c-a43d-040e5a30e019 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=71509) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 10:46:55 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:46:55 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:46:55 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[839992d5-edb9-4cb1-b64f-a5583136c3da]: (4, ('0 0 0', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:46:55 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-af306871-7b15-472c-a43d-040e5a30e019 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Searching for a device in session 17 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=71509) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 10:46:55 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-af306871-7b15-472c-a43d-040e5a30e019 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:4116efc6-988f-40cf-af06-2abf9c6cd44a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GJNowkDY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71509) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 10:46:55 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-af306871-7b15-472c-a43d-040e5a30e019 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.184s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 10:46:55 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-af306871-7b15-472c-a43d-040e5a30e019 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] <== connect_volume: return (185ms) {'type': 'block', 'scsi_wwn': '23038643237383763', 'path': '/dev/sdc'} {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 10:46:55 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af306871-7b15-472c-a43d-040e5a30e019 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23038643237383763', 'path': '/dev/sdc'} {{(pid=71509) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 10:46:55 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-af306871-7b15-472c-a43d-040e5a30e019 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T10:42:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-715949836',display_name='tempest-ServerStableDeviceRescueTest-server-715949836',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-715949836',id=5,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJw5z6VaHRNlxDN06wTJu5Wi0bke1xDu+QHMTsTYS+v80iCfFQaOubP6JBaY/P1b1NeL45VzvxaEoBY4znewTkoI5fdIZ/AucgMjWw1BB8Bl59D4DxJIt+KUZTUDjHw3Lg==',key_name='tempest-keypair-882808316',keypairs=<?>,launch_index=0,launched_at=2023-04-14T10:43:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='482809b9148e408b84b156802a21a225',ramdisk_id='',reservation_id='r-ipx61qut',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1396047341',owner_user_name='tempest-ServerStableDeviceRescueTest-1396047341-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T10:44:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7212c3fe50ef465c99a0eefec4cbd753',uuid=0e6c800c-9b35-4e35-969e-c40367056dce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "49978689-84ce-4422-add9-9bb12f628c37", "address": "fa:16:3e:a6:47:fc", "network": {"id": "9040ebc7-4d6b-4fd2-8543-f22ca3fb249c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2098664740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-2098664740-network", "vif_mac": "fa:16:3e:a6:47:fc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "482809b9148e408b84b156802a21a225", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49978689-84", "ovs_interfaceid": "49978689-84ce-4422-add9-9bb12f628c37", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71509) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 10:46:55 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-af306871-7b15-472c-a43d-040e5a30e019 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Converting VIF {"id": "49978689-84ce-4422-add9-9bb12f628c37", "address": "fa:16:3e:a6:47:fc", "network": {"id": "9040ebc7-4d6b-4fd2-8543-f22ca3fb249c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2098664740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-2098664740-network", "vif_mac": "fa:16:3e:a6:47:fc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "482809b9148e408b84b156802a21a225", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49978689-84", "ovs_interfaceid": "49978689-84ce-4422-add9-9bb12f628c37", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:46:55 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-af306871-7b15-472c-a43d-040e5a30e019 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a6:47:fc,bridge_name='br-int',has_traffic_filtering=True,id=49978689-84ce-4422-add9-9bb12f628c37,network=Network(9040ebc7-4d6b-4fd2-8543-f22ca3fb249c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49978689-84') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:46:55 user nova-compute[71509]: DEBUG nova.objects.instance [None req-af306871-7b15-472c-a43d-040e5a30e019 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Lazy-loading 'pci_devices' on Instance uuid 0e6c800c-9b35-4e35-969e-c40367056dce {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:46:55 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-af306871-7b15-472c-a43d-040e5a30e019 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] End _get_guest_xml xml=<domain type="kvm">
Apr 14 10:46:55 user nova-compute[71509]:   <uuid>0e6c800c-9b35-4e35-969e-c40367056dce</uuid>
Apr 14 10:46:55 user nova-compute[71509]:   <name>instance-00000005</name>
Apr 14 10:46:55 user nova-compute[71509]:   <memory>131072</memory>
Apr 14 10:46:55 user nova-compute[71509]:   <vcpu>1</vcpu>
Apr 14 10:46:55 user nova-compute[71509]:   <metadata>
Apr 14 10:46:55 user nova-compute[71509]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 10:46:55 user nova-compute[71509]:       <nova:package version="0.0.0"/>
Apr 14 10:46:55 user nova-compute[71509]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-715949836</nova:name>
Apr 14 10:46:55 user nova-compute[71509]:       <nova:creationTime>2023-04-14 10:46:55</nova:creationTime>
Apr 14 10:46:55 user nova-compute[71509]:       <nova:flavor name="m1.nano">
Apr 14 10:46:55 user nova-compute[71509]:         <nova:memory>128</nova:memory>
Apr 14 10:46:55 user nova-compute[71509]:         <nova:disk>1</nova:disk>
Apr 14 10:46:55 user nova-compute[71509]:         <nova:swap>0</nova:swap>
Apr 14 10:46:55 user nova-compute[71509]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 10:46:55 user nova-compute[71509]:         <nova:vcpus>1</nova:vcpus>
Apr 14 10:46:55 user nova-compute[71509]:       </nova:flavor>
Apr 14 10:46:55 user nova-compute[71509]:       <nova:owner>
Apr 14 10:46:55 user nova-compute[71509]:         <nova:user uuid="7212c3fe50ef465c99a0eefec4cbd753">tempest-ServerStableDeviceRescueTest-1396047341-project-member</nova:user>
Apr 14 10:46:55 user nova-compute[71509]:         <nova:project uuid="482809b9148e408b84b156802a21a225">tempest-ServerStableDeviceRescueTest-1396047341</nova:project>
Apr 14 10:46:55 user nova-compute[71509]:       </nova:owner>
Apr 14 10:46:55 user nova-compute[71509]:       <nova:root type="image" uuid="048ec0ee-0465-448d-8b4c-f072acb101dc"/>
Apr 14 10:46:55 user nova-compute[71509]:       <nova:ports>
Apr 14 10:46:55 user nova-compute[71509]:         <nova:port uuid="49978689-84ce-4422-add9-9bb12f628c37">
Apr 14 10:46:55 user nova-compute[71509]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 14 10:46:55 user nova-compute[71509]:         </nova:port>
Apr 14 10:46:55 user nova-compute[71509]:       </nova:ports>
Apr 14 10:46:55 user nova-compute[71509]:     </nova:instance>
Apr 14 10:46:55 user nova-compute[71509]:   </metadata>
Apr 14 10:46:55 user nova-compute[71509]:   <sysinfo type="smbios">
Apr 14 10:46:55 user nova-compute[71509]:     <system>
Apr 14 10:46:55 user nova-compute[71509]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 10:46:55 user nova-compute[71509]:       <entry name="product">OpenStack Nova</entry>
Apr 14 10:46:55 user nova-compute[71509]:       <entry name="version">0.0.0</entry>
Apr 14 10:46:55 user nova-compute[71509]:       <entry name="serial">0e6c800c-9b35-4e35-969e-c40367056dce</entry>
Apr 14 10:46:55 user nova-compute[71509]:       <entry name="uuid">0e6c800c-9b35-4e35-969e-c40367056dce</entry>
Apr 14 10:46:55 user nova-compute[71509]:       <entry name="family">Virtual Machine</entry>
Apr 14 10:46:55 user nova-compute[71509]:     </system>
Apr 14 10:46:55 user nova-compute[71509]:   </sysinfo>
Apr 14 10:46:55 user nova-compute[71509]:   <os>
Apr 14 10:46:55 user nova-compute[71509]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 10:46:55 user nova-compute[71509]:     <smbios mode="sysinfo"/>
Apr 14 10:46:55 user nova-compute[71509]:   </os>
Apr 14 10:46:55 user nova-compute[71509]:   <features>
Apr 14 10:46:55 user nova-compute[71509]:     <acpi/>
Apr 14 10:46:55 user nova-compute[71509]:     <apic/>
Apr 14 10:46:55 user nova-compute[71509]:     <vmcoreinfo/>
Apr 14 10:46:55 user nova-compute[71509]:   </features>
Apr 14 10:46:55 user nova-compute[71509]:   <clock offset="utc">
Apr 14 10:46:55 user nova-compute[71509]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 10:46:55 user nova-compute[71509]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 10:46:55 user nova-compute[71509]:     <timer name="hpet" present="no"/>
Apr 14 10:46:55 user nova-compute[71509]:   </clock>
Apr 14 10:46:55 user nova-compute[71509]:   <cpu mode="custom" match="exact">
Apr 14 10:46:55 user nova-compute[71509]:     <model>Nehalem</model>
Apr 14 10:46:55 user nova-compute[71509]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 10:46:55 user nova-compute[71509]:   </cpu>
Apr 14 10:46:55 user nova-compute[71509]:   <devices>
Apr 14 10:46:55 user nova-compute[71509]:     <disk type="file" device="disk">
Apr 14 10:46:55 user nova-compute[71509]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 10:46:55 user nova-compute[71509]:       <source file="/opt/stack/data/nova/instances/0e6c800c-9b35-4e35-969e-c40367056dce/disk"/>
Apr 14 10:46:55 user nova-compute[71509]:       <target dev="vda" bus="virtio"/>
Apr 14 10:46:55 user nova-compute[71509]:     </disk>
Apr 14 10:46:55 user nova-compute[71509]:     <disk type="block" device="disk">
Apr 14 10:46:55 user nova-compute[71509]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 10:46:55 user nova-compute[71509]:       <source dev="/dev/sdc"/>
Apr 14 10:46:55 user nova-compute[71509]:       <target dev="vdb" bus="virtio"/>
Apr 14 10:46:55 user nova-compute[71509]:       <serial>4116efc6-988f-40cf-af06-2abf9c6cd44a</serial>
Apr 14 10:46:55 user nova-compute[71509]:     </disk>
Apr 14 10:46:55 user nova-compute[71509]:     <disk type="file" device="disk">
Apr 14 10:46:55 user nova-compute[71509]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 10:46:55 user nova-compute[71509]:       <source file="/opt/stack/data/nova/instances/0e6c800c-9b35-4e35-969e-c40367056dce/disk.rescue"/>
Apr 14 10:46:55 user nova-compute[71509]:       <target dev="vdc" bus="virtio"/>
Apr 14 10:46:55 user nova-compute[71509]:       <boot order="1"/>
Apr 14 10:46:55 user nova-compute[71509]:     </disk>
Apr 14 10:46:55 user nova-compute[71509]:     <interface type="ethernet">
Apr 14 10:46:55 user nova-compute[71509]:       <mac address="fa:16:3e:a6:47:fc"/>
Apr 14 10:46:55 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 10:46:55 user nova-compute[71509]:       <mtu size="1442"/>
Apr 14 10:46:55 user nova-compute[71509]:       <target dev="tap49978689-84"/>
Apr 14 10:46:55 user nova-compute[71509]:     </interface>
Apr 14 10:46:55 user nova-compute[71509]:     <serial type="pty">
Apr 14 10:46:55 user nova-compute[71509]:       <log file="/opt/stack/data/nova/instances/0e6c800c-9b35-4e35-969e-c40367056dce/console.log" append="off"/>
Apr 14 10:46:55 user nova-compute[71509]:     </serial>
Apr 14 10:46:55 user nova-compute[71509]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 10:46:55 user nova-compute[71509]:     <video>
Apr 14 10:46:55 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 10:46:55 user nova-compute[71509]:     </video>
Apr 14 10:46:55 user nova-compute[71509]:     <rng model="virtio">
Apr 14 10:46:55 user nova-compute[71509]:       <backend model="random">/dev/urandom</backend>
Apr 14 10:46:55 user nova-compute[71509]:     </rng>
Apr 14 10:46:55 user nova-compute[71509]:     <controller type="usb" index="0" model="none"/>
Apr 14 10:46:55 user nova-compute[71509]:     <memballoon model="virtio">
Apr 14 10:46:55 user nova-compute[71509]:       <stats period="10"/>
Apr 14 10:46:55 user nova-compute[71509]:     </memballoon>
Apr 14 10:46:55 user nova-compute[71509]:   </devices>
Apr 14 10:46:55 user nova-compute[71509]: </domain>
Apr 14 10:46:55 user nova-compute[71509]:  {{(pid=71509) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 10:46:55 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Instance destroyed successfully.
Apr 14 10:46:55 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-af306871-7b15-472c-a43d-040e5a30e019 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] No BDM found with device name vda, not building metadata. {{(pid=71509) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 10:46:55 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-af306871-7b15-472c-a43d-040e5a30e019 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71509) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 10:46:55 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-af306871-7b15-472c-a43d-040e5a30e019 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71509) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 10:46:55 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-af306871-7b15-472c-a43d-040e5a30e019 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] No VIF found with MAC fa:16:3e:a6:47:fc, not building metadata {{(pid=71509) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 10:46:56 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:46:56 user nova-compute[71509]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681469201.5672073, d6f539d8-4144-467b-ac69-44011c5b3564 => Stopped> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 10:46:56 user nova-compute[71509]: INFO nova.compute.manager [-] [instance: d6f539d8-4144-467b-ac69-44011c5b3564] VM Stopped (Lifecycle Event)
Apr 14 10:46:57 user nova-compute[71509]: DEBUG nova.compute.manager [None req-9c0f9ea6-369d-4ce5-b4aa-e704bf33a2a5 None None] [instance: d6f539d8-4144-467b-ac69-44011c5b3564] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:46:57 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:46:57 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:46:57 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:46:57 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:46:57 user nova-compute[71509]: DEBUG nova.compute.manager [req-4463727f-c945-4105-acdc-5e3a8de572c1 req-3b082136-8306-40bd-b8a4-98b5c36a4234 service nova] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Received event network-vif-plugged-49978689-84ce-4422-add9-9bb12f628c37 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:46:57 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-4463727f-c945-4105-acdc-5e3a8de572c1 req-3b082136-8306-40bd-b8a4-98b5c36a4234 service nova] Acquiring lock "0e6c800c-9b35-4e35-969e-c40367056dce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:46:57 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-4463727f-c945-4105-acdc-5e3a8de572c1 req-3b082136-8306-40bd-b8a4-98b5c36a4234 service nova] Lock "0e6c800c-9b35-4e35-969e-c40367056dce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:46:57 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-4463727f-c945-4105-acdc-5e3a8de572c1 req-3b082136-8306-40bd-b8a4-98b5c36a4234 service nova] Lock "0e6c800c-9b35-4e35-969e-c40367056dce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:46:57 user nova-compute[71509]: DEBUG nova.compute.manager [req-4463727f-c945-4105-acdc-5e3a8de572c1 req-3b082136-8306-40bd-b8a4-98b5c36a4234 service nova] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] No waiting events found dispatching network-vif-plugged-49978689-84ce-4422-add9-9bb12f628c37 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:46:57 user nova-compute[71509]: WARNING nova.compute.manager [req-4463727f-c945-4105-acdc-5e3a8de572c1 req-3b082136-8306-40bd-b8a4-98b5c36a4234 service nova] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Received unexpected event network-vif-plugged-49978689-84ce-4422-add9-9bb12f628c37 for instance with vm_state active and task_state rescuing.
Apr 14 10:46:58 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:46:58 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:46:58 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:46:58 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:46:58 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:46:58 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:47:00 user nova-compute[71509]: DEBUG nova.compute.manager [req-06bd5d69-ae71-43ba-b86a-857fa1257e91 req-f3d026ad-54c4-4b53-9c59-cc690bfbbd43 service nova] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Received event network-vif-plugged-49978689-84ce-4422-add9-9bb12f628c37 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:47:00 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-06bd5d69-ae71-43ba-b86a-857fa1257e91 req-f3d026ad-54c4-4b53-9c59-cc690bfbbd43 service nova] Acquiring lock "0e6c800c-9b35-4e35-969e-c40367056dce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:47:00 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-06bd5d69-ae71-43ba-b86a-857fa1257e91 req-f3d026ad-54c4-4b53-9c59-cc690bfbbd43 service nova] Lock "0e6c800c-9b35-4e35-969e-c40367056dce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:47:00 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-06bd5d69-ae71-43ba-b86a-857fa1257e91 req-f3d026ad-54c4-4b53-9c59-cc690bfbbd43 service nova] Lock "0e6c800c-9b35-4e35-969e-c40367056dce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:47:00 user nova-compute[71509]: DEBUG nova.compute.manager [req-06bd5d69-ae71-43ba-b86a-857fa1257e91 req-f3d026ad-54c4-4b53-9c59-cc690bfbbd43 service nova] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] No waiting events found dispatching network-vif-plugged-49978689-84ce-4422-add9-9bb12f628c37 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:47:00 user nova-compute[71509]: WARNING nova.compute.manager [req-06bd5d69-ae71-43ba-b86a-857fa1257e91 req-f3d026ad-54c4-4b53-9c59-cc690bfbbd43 service nova] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Received unexpected event network-vif-plugged-49978689-84ce-4422-add9-9bb12f628c37 for instance with vm_state active and task_state rescuing.
Apr 14 10:47:00 user nova-compute[71509]: DEBUG nova.virt.libvirt.host [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Removed pending event for 0e6c800c-9b35-4e35-969e-c40367056dce due to event {{(pid=71509) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 10:47:00 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681469220.3122888, 0e6c800c-9b35-4e35-969e-c40367056dce => Resumed> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 10:47:00 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] VM Resumed (Lifecycle Event)
Apr 14 10:47:00 user nova-compute[71509]: DEBUG nova.compute.manager [None req-af306871-7b15-472c-a43d-040e5a30e019 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:47:00 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Creating instance directory {{(pid=71509) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 10:47:00 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Creating image(s)
Apr 14 10:47:00 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "/opt/stack/data/nova/instances/b4abb549-8f36-40c5-971f-8accbb14ff86/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:47:00 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "/opt/stack/data/nova/instances/b4abb549-8f36-40c5-971f-8accbb14ff86/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:47:00 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "/opt/stack/data/nova/instances/b4abb549-8f36-40c5-971f-8accbb14ff86/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:47:00 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:47:00 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:47:00 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 10:47:00 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 14 10:47:00 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681469220.3144226, 0e6c800c-9b35-4e35-969e-c40367056dce => Started> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 10:47:00 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] VM Started (Lifecycle Event)
Apr 14 10:47:00 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:47:00 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 10:47:00 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json" returned: 0 in 0.175s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:47:00 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:47:00 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:47:00 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:47:00 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json" returned: 0 in 0.134s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:47:00 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18,backing_fmt=raw /opt/stack/data/nova/instances/b4abb549-8f36-40c5-971f-8accbb14ff86/disk 1073741824 {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:47:00 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18,backing_fmt=raw /opt/stack/data/nova/instances/b4abb549-8f36-40c5-971f-8accbb14ff86/disk 1073741824" returned: 0 in 0.053s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:47:00 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.196s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:47:00 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:47:00 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json" returned: 0 in 0.146s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:47:00 user nova-compute[71509]: DEBUG nova.virt.disk.api [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b4abb549-8f36-40c5-971f-8accbb14ff86/disk. size=1073741824 {{(pid=71509) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 10:47:00 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4abb549-8f36-40c5-971f-8accbb14ff86/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:47:01 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4abb549-8f36-40c5-971f-8accbb14ff86/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:47:01 user nova-compute[71509]: DEBUG nova.virt.disk.api [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Cannot resize image /opt/stack/data/nova/instances/b4abb549-8f36-40c5-971f-8accbb14ff86/disk to a smaller size. {{(pid=71509) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 10:47:01 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Created local disks {{(pid=71509) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 10:47:01 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Ensure instance console log exists: /opt/stack/data/nova/instances/b4abb549-8f36-40c5-971f-8accbb14ff86/console.log {{(pid=71509) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 10:47:01 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:47:01 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:47:01 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:47:01 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Start _get_guest_xml network_info=[{"id": "608a2408-02df-474f-9006-260c8c97def1", "address": "fa:16:3e:e4:f7:87", "network": {"id": "18a91434-637b-4c19-a97b-736b32c1ea5a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1824162811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea2cb4dfa5b4a52b658efd8f5aefb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap608a2408-02", "ovs_interfaceid": "608a2408-02df-474f-9006-260c8c97def1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T10:38:55Z,direct_url=<?>,disk_format='qcow2',id=048ec0ee-0465-448d-8b4c-f072acb101dc,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='9742d6ad20cf48d9bab0fdbcc9491db9',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T10:38:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '048ec0ee-0465-448d-8b4c-f072acb101dc'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vdb', 'boot_index': None, 'device_type': 'disk', 'attachment_id': '525b8e4a-8b29-4d82-b50c-1b1a410bf331', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZWfaEHNS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b4abb549-8f36-40c5-971f-8accbb14ff86', 'attached_at': '', 'detached_at': '', 'volume_id': '2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d', 'serial': '2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'volume_type': None} {{(pid=71509) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 10:47:01 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Apr 14 10:47:01 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Apr 14 10:47:01 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71509) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 10:47:01 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T10:40:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T10:38:55Z,direct_url=<?>,disk_format='qcow2',id=048ec0ee-0465-448d-8b4c-f072acb101dc,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='9742d6ad20cf48d9bab0fdbcc9491db9',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T10:38:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 10:47:01 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Flavor limits 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 10:47:01 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Image limits 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 10:47:01 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Flavor pref 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 10:47:01 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Image pref 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 10:47:01 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 10:47:01 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 10:47:01 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71509) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 10:47:01 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Got 1 possible topologies {{(pid=71509) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 10:47:01 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 10:47:01 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 10:47:01 user nova-compute[71509]: DEBUG nova.objects.instance [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lazy-loading 'vcpu_model' on Instance uuid b4abb549-8f36-40c5-971f-8accbb14ff86 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:47:01 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Calling os-brick to attach iSCSI Volume {{(pid=71509) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 10:47:01 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0bf0749390>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZWfaEHNS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 10:47:01 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Apr 14 10:47:01 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 10:47:01 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 10:47:01 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Apr 14 10:47:01 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 10:47:01 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 10:47:01 user nova-compute[71509]: INFO os_brick.initiator.connectors.iscsi [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 10:47:01 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:47:01 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d -p 172.16.0.220:3260 {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:47:01 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:47:01 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fb47130-f877-490e-9ac8-6bf9a070ec6e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:47:01 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 10:47:01 user nova-compute[71509]:  {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:47:01 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d -p 172.16.0.220:3260 --interface default --op new {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:47:01 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:47:01 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2c78ce2-3b8c-4fc7-8374-144db210aaaa]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d] added\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:47:01 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d] added
Apr 14 10:47:01 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:47:01 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:47:01 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:47:01 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f0e1560-ba3e-4c7b-83af-8e6a665a5472]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:47:01 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:47:01 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:47:01 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:47:01 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e9d7d0e-a175-41b0-bcbb-0b6c936e3799]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:47:01 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:47:01 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZWfaEHNS {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:47:01 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZWfaEHNS" returned: 0 in 0.022s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:47:01 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaa38a2f-86f2-4dab-9446-9699815661d3]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:47:01 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZWfaEHNS'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:47:01 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:47:01 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:47:01 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d7f0b4a-0393-4fba-93d4-888ff3be5ba7]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:47:01 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:47:01 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:47:01 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:47:01 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[743ca216-08a2-4280-baa8-4d4e50ca41aa]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4116efc6-988f-40cf-af06-2abf9c6cd44a (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:47:01 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4116efc6-988f-40cf-af06-2abf9c6cd44a (non-flash)
Apr 14 10:47:01 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:47:01 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4116efc6-988f-40cf-af06-2abf9c6cd44a (non-flash)
Apr 14 10:47:01 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 10:47:01 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d -p 172.16.0.220:3260 --login {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:47:01 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:47:01 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e40e631-e784-4e5b-8ef2-9089bf6dc93f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:47:01 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d, portal: 172.16.0.220,3260]
Apr 14 10:47:01 user nova-compute[71509]: Login to [iface: default, target: iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d, portal: 172.16.0.220,3260] successful.
Apr 14 10:47:01 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:47:01 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:47:01 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:47:01 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fdab1d9-5be0-4519-8ed2-323c822f8479]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:47:01 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:47:01 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:47:01 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:47:01 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[d15b5219-3501-4d99-9152-d3f2e98a82ea]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4116efc6-988f-40cf-af06-2abf9c6cd44a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:47:01 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4116efc6-988f-40cf-af06-2abf9c6cd44a (non-flash)
Apr 14 10:47:01 user nova-compute[71509]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d (non-flash)
Apr 14 10:47:01 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:47:01 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4116efc6-988f-40cf-af06-2abf9c6cd44a (non-flash)
Apr 14 10:47:01 user nova-compute[71509]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d (non-flash)
Apr 14 10:47:01 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 10:47:01 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.373s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 10:47:01 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Connected to 172.16.0.220:3260 {{(pid=71509) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 10:47:01 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] HCTL ('33', '-', '-', 0) found on session 18 with lun 0 {{(pid=71509) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 10:47:01 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71509) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 10:47:01 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:47:01 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:47:01 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[08d7607d-fe73-40a9-b643-8656fbe921dd]: (4, ('- - 0', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:47:01 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Searching for a device in session 18 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71509) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 10:47:01 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZWfaEHNS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71509) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 10:47:02 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.417s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 10:47:02 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] <== connect_volume: return (1419ms) {'type': 'block', 'scsi_wwn': '23639333132393439', 'path': '/dev/sdb'} {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 10:47:02 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23639333132393439', 'path': '/dev/sdb'} {{(pid=71509) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 10:47:02 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T10:42:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-375061147',display_name='tempest-ServerActionsTestJSON-server-564468196',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-375061147',id=4,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNt/FyD1XXsxB5kJC+SJ1dgkjoXXHkL+KX0Cr5HvI72xTIz+DAtuVRPHeIpMNLt39mbbZ9KAoCJibRQza0Qbd8j8EEoV7QHombhWz2Mdusr+gJ2OYTqrrRzVbjIHACTFWw==',key_name='tempest-keypair-1544270235',keypairs=<?>,launch_index=0,launched_at=2023-04-14T10:43:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3ea2cb4dfa5b4a52b658efd8f5aefb36',ramdisk_id='',reservation_id='r-2qmryidz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-1923052090',owner_user_name='tempest-ServerActionsTestJSON-1923052090-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T10:46:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5873a358bf544691b12cd2979f5e36dc',uuid=b4abb549-8f36-40c5-971f-8accbb14ff86,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "608a2408-02df-474f-9006-260c8c97def1", "address": "fa:16:3e:e4:f7:87", "network": {"id": "18a91434-637b-4c19-a97b-736b32c1ea5a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1824162811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea2cb4dfa5b4a52b658efd8f5aefb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap608a2408-02", "ovs_interfaceid": "608a2408-02df-474f-9006-260c8c97def1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71509) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 10:47:02 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Converting VIF {"id": "608a2408-02df-474f-9006-260c8c97def1", "address": "fa:16:3e:e4:f7:87", "network": {"id": "18a91434-637b-4c19-a97b-736b32c1ea5a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1824162811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea2cb4dfa5b4a52b658efd8f5aefb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap608a2408-02", "ovs_interfaceid": "608a2408-02df-474f-9006-260c8c97def1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:47:02 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e4:f7:87,bridge_name='br-int',has_traffic_filtering=True,id=608a2408-02df-474f-9006-260c8c97def1,network=Network(18a91434-637b-4c19-a97b-736b32c1ea5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap608a2408-02') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:47:02 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] End _get_guest_xml xml=<domain type="kvm">
Apr 14 10:47:02 user nova-compute[71509]:   <uuid>b4abb549-8f36-40c5-971f-8accbb14ff86</uuid>
Apr 14 10:47:02 user nova-compute[71509]:   <name>instance-00000004</name>
Apr 14 10:47:02 user nova-compute[71509]:   <memory>131072</memory>
Apr 14 10:47:02 user nova-compute[71509]:   <vcpu>1</vcpu>
Apr 14 10:47:02 user nova-compute[71509]:   <metadata>
Apr 14 10:47:02 user nova-compute[71509]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 10:47:02 user nova-compute[71509]:       <nova:package version="0.0.0"/>
Apr 14 10:47:02 user nova-compute[71509]:       <nova:name>tempest-ServerActionsTestJSON-server-564468196</nova:name>
Apr 14 10:47:02 user nova-compute[71509]:       <nova:creationTime>2023-04-14 10:47:01</nova:creationTime>
Apr 14 10:47:02 user nova-compute[71509]:       <nova:flavor name="m1.nano">
Apr 14 10:47:02 user nova-compute[71509]:         <nova:memory>128</nova:memory>
Apr 14 10:47:02 user nova-compute[71509]:         <nova:disk>1</nova:disk>
Apr 14 10:47:02 user nova-compute[71509]:         <nova:swap>0</nova:swap>
Apr 14 10:47:02 user nova-compute[71509]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 10:47:02 user nova-compute[71509]:         <nova:vcpus>1</nova:vcpus>
Apr 14 10:47:02 user nova-compute[71509]:       </nova:flavor>
Apr 14 10:47:02 user nova-compute[71509]:       <nova:owner>
Apr 14 10:47:02 user nova-compute[71509]:         <nova:user uuid="5873a358bf544691b12cd2979f5e36dc">tempest-ServerActionsTestJSON-1923052090-project-member</nova:user>
Apr 14 10:47:02 user nova-compute[71509]:         <nova:project uuid="3ea2cb4dfa5b4a52b658efd8f5aefb36">tempest-ServerActionsTestJSON-1923052090</nova:project>
Apr 14 10:47:02 user nova-compute[71509]:       </nova:owner>
Apr 14 10:47:02 user nova-compute[71509]:       <nova:root type="image" uuid="048ec0ee-0465-448d-8b4c-f072acb101dc"/>
Apr 14 10:47:02 user nova-compute[71509]:       <nova:ports>
Apr 14 10:47:02 user nova-compute[71509]:         <nova:port uuid="608a2408-02df-474f-9006-260c8c97def1">
Apr 14 10:47:02 user nova-compute[71509]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 14 10:47:02 user nova-compute[71509]:         </nova:port>
Apr 14 10:47:02 user nova-compute[71509]:       </nova:ports>
Apr 14 10:47:02 user nova-compute[71509]:     </nova:instance>
Apr 14 10:47:02 user nova-compute[71509]:   </metadata>
Apr 14 10:47:02 user nova-compute[71509]:   <sysinfo type="smbios">
Apr 14 10:47:02 user nova-compute[71509]:     <system>
Apr 14 10:47:02 user nova-compute[71509]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 10:47:02 user nova-compute[71509]:       <entry name="product">OpenStack Nova</entry>
Apr 14 10:47:02 user nova-compute[71509]:       <entry name="version">0.0.0</entry>
Apr 14 10:47:02 user nova-compute[71509]:       <entry name="serial">b4abb549-8f36-40c5-971f-8accbb14ff86</entry>
Apr 14 10:47:02 user nova-compute[71509]:       <entry name="uuid">b4abb549-8f36-40c5-971f-8accbb14ff86</entry>
Apr 14 10:47:02 user nova-compute[71509]:       <entry name="family">Virtual Machine</entry>
Apr 14 10:47:02 user nova-compute[71509]:     </system>
Apr 14 10:47:02 user nova-compute[71509]:   </sysinfo>
Apr 14 10:47:02 user nova-compute[71509]:   <os>
Apr 14 10:47:02 user nova-compute[71509]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 10:47:02 user nova-compute[71509]:     <boot dev="hd"/>
Apr 14 10:47:02 user nova-compute[71509]:     <smbios mode="sysinfo"/>
Apr 14 10:47:02 user nova-compute[71509]:   </os>
Apr 14 10:47:02 user nova-compute[71509]:   <features>
Apr 14 10:47:02 user nova-compute[71509]:     <acpi/>
Apr 14 10:47:02 user nova-compute[71509]:     <apic/>
Apr 14 10:47:02 user nova-compute[71509]:     <vmcoreinfo/>
Apr 14 10:47:02 user nova-compute[71509]:   </features>
Apr 14 10:47:02 user nova-compute[71509]:   <clock offset="utc">
Apr 14 10:47:02 user nova-compute[71509]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 10:47:02 user nova-compute[71509]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 10:47:02 user nova-compute[71509]:     <timer name="hpet" present="no"/>
Apr 14 10:47:02 user nova-compute[71509]:   </clock>
Apr 14 10:47:02 user nova-compute[71509]:   <cpu mode="custom" match="exact">
Apr 14 10:47:02 user nova-compute[71509]:     <model>Nehalem</model>
Apr 14 10:47:02 user nova-compute[71509]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 10:47:02 user nova-compute[71509]:   </cpu>
Apr 14 10:47:02 user nova-compute[71509]:   <devices>
Apr 14 10:47:02 user nova-compute[71509]:     <disk type="file" device="disk">
Apr 14 10:47:02 user nova-compute[71509]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 10:47:02 user nova-compute[71509]:       <source file="/opt/stack/data/nova/instances/b4abb549-8f36-40c5-971f-8accbb14ff86/disk"/>
Apr 14 10:47:02 user nova-compute[71509]:       <target dev="vda" bus="virtio"/>
Apr 14 10:47:02 user nova-compute[71509]:     </disk>
Apr 14 10:47:02 user nova-compute[71509]:     <disk type="block" device="disk">
Apr 14 10:47:02 user nova-compute[71509]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 10:47:02 user nova-compute[71509]:       <source dev="/dev/sdb"/>
Apr 14 10:47:02 user nova-compute[71509]:       <target dev="vdb" bus="virtio"/>
Apr 14 10:47:02 user nova-compute[71509]:       <serial>2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d</serial>
Apr 14 10:47:02 user nova-compute[71509]:     </disk>
Apr 14 10:47:02 user nova-compute[71509]:     <interface type="ethernet">
Apr 14 10:47:02 user nova-compute[71509]:       <mac address="fa:16:3e:e4:f7:87"/>
Apr 14 10:47:02 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 10:47:02 user nova-compute[71509]:       <mtu size="1442"/>
Apr 14 10:47:02 user nova-compute[71509]:       <target dev="tap608a2408-02"/>
Apr 14 10:47:02 user nova-compute[71509]:     </interface>
Apr 14 10:47:02 user nova-compute[71509]:     <serial type="pty">
Apr 14 10:47:02 user nova-compute[71509]:       <log file="/opt/stack/data/nova/instances/b4abb549-8f36-40c5-971f-8accbb14ff86/console.log" append="off"/>
Apr 14 10:47:02 user nova-compute[71509]:     </serial>
Apr 14 10:47:02 user nova-compute[71509]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 10:47:02 user nova-compute[71509]:     <video>
Apr 14 10:47:02 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 10:47:02 user nova-compute[71509]:     </video>
Apr 14 10:47:02 user nova-compute[71509]:     <rng model="virtio">
Apr 14 10:47:02 user nova-compute[71509]:       <backend model="random">/dev/urandom</backend>
Apr 14 10:47:02 user nova-compute[71509]:     </rng>
Apr 14 10:47:02 user nova-compute[71509]:     <controller type="usb" index="0" model="none"/>
Apr 14 10:47:02 user nova-compute[71509]:     <memballoon model="virtio">
Apr 14 10:47:02 user nova-compute[71509]:       <stats period="10"/>
Apr 14 10:47:02 user nova-compute[71509]:     </memballoon>
Apr 14 10:47:02 user nova-compute[71509]:   </devices>
Apr 14 10:47:02 user nova-compute[71509]: </domain>
Apr 14 10:47:02 user nova-compute[71509]:  {{(pid=71509) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 10:47:02 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T10:42:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-375061147',display_name='tempest-ServerActionsTestJSON-server-564468196',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-375061147',id=4,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNt/FyD1XXsxB5kJC+SJ1dgkjoXXHkL+KX0Cr5HvI72xTIz+DAtuVRPHeIpMNLt39mbbZ9KAoCJibRQza0Qbd8j8EEoV7QHombhWz2Mdusr+gJ2OYTqrrRzVbjIHACTFWw==',key_name='tempest-keypair-1544270235',keypairs=<?>,launch_index=0,launched_at=2023-04-14T10:43:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3ea2cb4dfa5b4a52b658efd8f5aefb36',ramdisk_id='',reservation_id='r-2qmryidz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-1923052090',owner_user_name='tempest-ServerActionsTestJSON-1923052090-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T10:46:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5873a358bf544691b12cd2979f5e36dc',uuid=b4abb549-8f36-40c5-971f-8accbb14ff86,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "608a2408-02df-474f-9006-260c8c97def1", "address": "fa:16:3e:e4:f7:87", "network": {"id": "18a91434-637b-4c19-a97b-736b32c1ea5a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1824162811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea2cb4dfa5b4a52b658efd8f5aefb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap608a2408-02", "ovs_interfaceid": "608a2408-02df-474f-9006-260c8c97def1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 10:47:02 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Converting VIF {"id": "608a2408-02df-474f-9006-260c8c97def1", "address": "fa:16:3e:e4:f7:87", "network": {"id": "18a91434-637b-4c19-a97b-736b32c1ea5a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1824162811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea2cb4dfa5b4a52b658efd8f5aefb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap608a2408-02", "ovs_interfaceid": "608a2408-02df-474f-9006-260c8c97def1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:47:02 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e4:f7:87,bridge_name='br-int',has_traffic_filtering=True,id=608a2408-02df-474f-9006-260c8c97def1,network=Network(18a91434-637b-4c19-a97b-736b32c1ea5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap608a2408-02') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:47:02 user nova-compute[71509]: DEBUG os_vif [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e4:f7:87,bridge_name='br-int',has_traffic_filtering=True,id=608a2408-02df-474f-9006-260c8c97def1,network=Network(18a91434-637b-4c19-a97b-736b32c1ea5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap608a2408-02') {{(pid=71509) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 10:47:02 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:47:02 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:47:02 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 10:47:02 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:47:02 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap608a2408-02, may_exist=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:47:02 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap608a2408-02, col_values=(('external_ids', {'iface-id': '608a2408-02df-474f-9006-260c8c97def1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e4:f7:87', 'vm-uuid': 'b4abb549-8f36-40c5-971f-8accbb14ff86'}),)) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:47:02 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:47:02 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 10:47:02 user nova-compute[71509]: INFO os_vif [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e4:f7:87,bridge_name='br-int',has_traffic_filtering=True,id=608a2408-02df-474f-9006-260c8c97def1,network=Network(18a91434-637b-4c19-a97b-736b32c1ea5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap608a2408-02')
Apr 14 10:47:02 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] No BDM found with device name vda, not building metadata. {{(pid=71509) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 10:47:02 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71509) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 10:47:02 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] No VIF found with MAC fa:16:3e:e4:f7:87, not building metadata {{(pid=71509) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 10:47:02 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:47:04 user nova-compute[71509]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681469209.110866, b4abb549-8f36-40c5-971f-8accbb14ff86 => Stopped> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 10:47:04 user nova-compute[71509]: INFO nova.compute.manager [-] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] VM Stopped (Lifecycle Event)
Apr 14 10:47:04 user nova-compute[71509]: DEBUG nova.compute.manager [None req-f2b5ee46-026b-4fd0-9473-58dd3ab40cd8 None None] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:47:04 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:47:04 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:47:04 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:47:04 user nova-compute[71509]: DEBUG nova.compute.manager [req-ed9e42f2-e306-411c-9a7e-2735c9a0b9f7 req-f9835eca-dddc-4268-8f0d-082510483752 service nova] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Received event network-vif-plugged-608a2408-02df-474f-9006-260c8c97def1 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:47:04 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-ed9e42f2-e306-411c-9a7e-2735c9a0b9f7 req-f9835eca-dddc-4268-8f0d-082510483752 service nova] Acquiring lock "b4abb549-8f36-40c5-971f-8accbb14ff86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:47:04 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-ed9e42f2-e306-411c-9a7e-2735c9a0b9f7 req-f9835eca-dddc-4268-8f0d-082510483752 service nova] Lock "b4abb549-8f36-40c5-971f-8accbb14ff86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:47:04 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-ed9e42f2-e306-411c-9a7e-2735c9a0b9f7 req-f9835eca-dddc-4268-8f0d-082510483752 service nova] Lock "b4abb549-8f36-40c5-971f-8accbb14ff86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:47:04 user nova-compute[71509]: DEBUG nova.compute.manager [req-ed9e42f2-e306-411c-9a7e-2735c9a0b9f7 req-f9835eca-dddc-4268-8f0d-082510483752 service nova] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] No waiting events found dispatching network-vif-plugged-608a2408-02df-474f-9006-260c8c97def1 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:47:04 user nova-compute[71509]: WARNING nova.compute.manager [req-ed9e42f2-e306-411c-9a7e-2735c9a0b9f7 req-f9835eca-dddc-4268-8f0d-082510483752 service nova] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Received unexpected event network-vif-plugged-608a2408-02df-474f-9006-260c8c97def1 for instance with vm_state active and task_state rebuild_spawning.
Apr 14 10:47:04 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:47:04 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:47:04 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:47:05 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:47:06 user nova-compute[71509]: DEBUG nova.compute.manager [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Instance event wait completed in 0 seconds for  {{(pid=71509) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 10:47:06 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Guest created on hypervisor {{(pid=71509) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 10:47:06 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681469226.60833, b4abb549-8f36-40c5-971f-8accbb14ff86 => Resumed> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 10:47:06 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] VM Resumed (Lifecycle Event)
Apr 14 10:47:06 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Instance spawned successfully.
Apr 14 10:47:06 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 10:47:06 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:47:06 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Found default for hw_cdrom_bus of ide {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:47:06 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Found default for hw_disk_bus of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:47:06 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Found default for hw_input_bus of None {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:47:06 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Found default for hw_pointer_model of None {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:47:06 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Found default for hw_video_model of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:47:06 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Found default for hw_vif_model of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:47:06 user nova-compute[71509]: DEBUG nova.compute.manager [req-18833a60-fa1c-436c-b726-c1deef38f4b5 req-9091ad87-1b5a-4867-91db-b94ceeefa829 service nova] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Received event network-vif-plugged-608a2408-02df-474f-9006-260c8c97def1 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:47:06 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-18833a60-fa1c-436c-b726-c1deef38f4b5 req-9091ad87-1b5a-4867-91db-b94ceeefa829 service nova] Acquiring lock "b4abb549-8f36-40c5-971f-8accbb14ff86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:47:06 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-18833a60-fa1c-436c-b726-c1deef38f4b5 req-9091ad87-1b5a-4867-91db-b94ceeefa829 service nova] Lock "b4abb549-8f36-40c5-971f-8accbb14ff86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:47:06 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-18833a60-fa1c-436c-b726-c1deef38f4b5 req-9091ad87-1b5a-4867-91db-b94ceeefa829 service nova] Lock "b4abb549-8f36-40c5-971f-8accbb14ff86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:47:06 user nova-compute[71509]: DEBUG nova.compute.manager [req-18833a60-fa1c-436c-b726-c1deef38f4b5 req-9091ad87-1b5a-4867-91db-b94ceeefa829 service nova] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] No waiting events found dispatching network-vif-plugged-608a2408-02df-474f-9006-260c8c97def1 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:47:06 user nova-compute[71509]: WARNING nova.compute.manager [req-18833a60-fa1c-436c-b726-c1deef38f4b5 req-9091ad87-1b5a-4867-91db-b94ceeefa829 service nova] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Received unexpected event network-vif-plugged-608a2408-02df-474f-9006-260c8c97def1 for instance with vm_state active and task_state rebuild_spawning.
Apr 14 10:47:06 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 10:47:06 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Apr 14 10:47:06 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681469226.6096838, b4abb549-8f36-40c5-971f-8accbb14ff86 => Started> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 10:47:06 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] VM Started (Lifecycle Event)
Apr 14 10:47:06 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:47:06 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 10:47:06 user nova-compute[71509]: DEBUG nova.compute.manager [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:47:06 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Apr 14 10:47:06 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:47:06 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:47:06 user nova-compute[71509]: DEBUG nova.objects.instance [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Trying to apply a migration context that does not seem to be set for this instance {{(pid=71509) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1032}}
Apr 14 10:47:06 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-42c9a2ef-24d4-46b9-a637-6f5b51ce64a2 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.099s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:47:07 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:47:07 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:47:09 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:47:12 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:47:12 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:47:12 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-638d10c6-ead2-4cdd-87e4-60b292303dab tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Acquiring lock "55178126-9766-4875-9122-39dcc87ce82c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:47:12 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-638d10c6-ead2-4cdd-87e4-60b292303dab tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "55178126-9766-4875-9122-39dcc87ce82c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:47:12 user nova-compute[71509]: DEBUG nova.objects.instance [None req-638d10c6-ead2-4cdd-87e4-60b292303dab tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lazy-loading 'flavor' on Instance uuid 55178126-9766-4875-9122-39dcc87ce82c {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:47:12 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-638d10c6-ead2-4cdd-87e4-60b292303dab tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "55178126-9766-4875-9122-39dcc87ce82c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.081s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:47:13 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-638d10c6-ead2-4cdd-87e4-60b292303dab tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Acquiring lock "55178126-9766-4875-9122-39dcc87ce82c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:47:13 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-638d10c6-ead2-4cdd-87e4-60b292303dab tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "55178126-9766-4875-9122-39dcc87ce82c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:47:13 user nova-compute[71509]: INFO nova.compute.manager [None req-638d10c6-ead2-4cdd-87e4-60b292303dab tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] [instance: 55178126-9766-4875-9122-39dcc87ce82c] Attaching volume c62fdeff-84d5-4e35-9383-8548f12a402d to /dev/vdb
Apr 14 10:47:13 user nova-compute[71509]: DEBUG os_brick.utils [None req-638d10c6-ead2-4cdd-87e4-60b292303dab tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 10:47:13 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:47:13 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:47:13 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[0be176cf-6154-4932-b0d0-74a91d6e2123]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50119df3c417\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:47:13 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:47:13 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.029s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:47:13 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[7439051a-05cc-4308-b923-75cdbbd4c732]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:47:13 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:47:13 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:47:13 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cd8e526-1a6d-45b2-a7a8-a0cc3184d4b0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:47:13 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6d6182e-fa20-4dcc-8839-a5ccbb44d518]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:47:13 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-638d10c6-ead2-4cdd-87e4-60b292303dab tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Running cmd (subprocess): nvme version {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:47:13 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-638d10c6-ead2-4cdd-87e4-60b292303dab tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] 'nvme version' failed. Not Retrying. {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 10:47:13 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.nvmeof [None req-638d10c6-ead2-4cdd-87e4-60b292303dab tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] nvme not present on system {{(pid=71509) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 10:47:13 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:47:13 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 10:47:13 user nova-compute[71509]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 10:47:13 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[43903506-b00b-4842-932a-30859cc891ca]: (4, '') {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:47:13 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-638d10c6-ead2-4cdd-87e4-60b292303dab tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71509) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 10:47:13 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-638d10c6-ead2-4cdd-87e4-60b292303dab tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71509) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 10:47:13 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-638d10c6-ead2-4cdd-87e4-60b292303dab tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] LIGHTOS: no hostnqn found. {{(pid=71509) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 10:47:13 user nova-compute[71509]: DEBUG os_brick.utils [None req-638d10c6-ead2-4cdd-87e4-60b292303dab tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] <== get_connector_properties: return (177ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50119df3c417', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 10:47:13 user nova-compute[71509]: DEBUG nova.virt.block_device [None req-638d10c6-ead2-4cdd-87e4-60b292303dab tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] [instance: 55178126-9766-4875-9122-39dcc87ce82c] Updating existing volume attachment record: c9215543-dcb7-4b2b-90de-2ad79fe0b465 {{(pid=71509) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 10:47:17 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:47:17 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:47:17 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:47:18 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:47:19 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-638d10c6-ead2-4cdd-87e4-60b292303dab tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] [instance: 55178126-9766-4875-9122-39dcc87ce82c] Calling os-brick to attach iSCSI Volume {{(pid=71509) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 10:47:19 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-638d10c6-ead2-4cdd-87e4-60b292303dab tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0bf0749390>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c62fdeff-84d5-4e35-9383-8548f12a402d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FAIbqpxM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 10:47:19 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-638d10c6-ead2-4cdd-87e4-60b292303dab tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 10:47:19 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-638d10c6-ead2-4cdd-87e4-60b292303dab tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 10:47:19 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-638d10c6-ead2-4cdd-87e4-60b292303dab tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 10:47:19 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-638d10c6-ead2-4cdd-87e4-60b292303dab tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 10:47:19 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-638d10c6-ead2-4cdd-87e4-60b292303dab tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c62fdeff-84d5-4e35-9383-8548f12a402d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 10:47:19 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-638d10c6-ead2-4cdd-87e4-60b292303dab tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c62fdeff-84d5-4e35-9383-8548f12a402d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 10:47:19 user nova-compute[71509]: INFO os_brick.initiator.connectors.iscsi [None req-638d10c6-ead2-4cdd-87e4-60b292303dab tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 10:47:19 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c62fdeff-84d5-4e35-9383-8548f12a402d -p 172.16.0.220:3260 {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:47:19 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c62fdeff-84d5-4e35-9383-8548f12a402d -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:47:19 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1b7e224-fb8b-4340-86c6-0ed4a425e4b4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:47:19 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-638d10c6-ead2-4cdd-87e4-60b292303dab tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 10:47:19 user nova-compute[71509]:  {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:47:19 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c62fdeff-84d5-4e35-9383-8548f12a402d -p 172.16.0.220:3260 --interface default --op new {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:47:19 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c62fdeff-84d5-4e35-9383-8548f12a402d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:47:19 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[19ec00d6-7ce0-49f2-8131-df1d19ff34db]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c62fdeff-84d5-4e35-9383-8548f12a402d] added\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:47:19 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-638d10c6-ead2-4cdd-87e4-60b292303dab tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c62fdeff-84d5-4e35-9383-8548f12a402d] added
Apr 14 10:47:19 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:47:19 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c62fdeff-84d5-4e35-9383-8548f12a402d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:47:19 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c62fdeff-84d5-4e35-9383-8548f12a402d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:47:19 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4040e06-17d4-491b-8c62-0e380a995d02]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:47:19 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-638d10c6-ead2-4cdd-87e4-60b292303dab tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:47:19 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c62fdeff-84d5-4e35-9383-8548f12a402d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:47:19 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c62fdeff-84d5-4e35-9383-8548f12a402d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:47:19 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2538486-2822-4e54-bb7d-44c6a9c418a8]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:47:19 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-638d10c6-ead2-4cdd-87e4-60b292303dab tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:47:19 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c62fdeff-84d5-4e35-9383-8548f12a402d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FAIbqpxM {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:47:19 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c62fdeff-84d5-4e35-9383-8548f12a402d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FAIbqpxM" returned: 0 in 0.024s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:47:19 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfc809e0-26e1-4a34-a207-7299db25d793]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:47:19 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-638d10c6-ead2-4cdd-87e4-60b292303dab tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FAIbqpxM'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:47:19 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c62fdeff-84d5-4e35-9383-8548f12a402d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:47:19 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c62fdeff-84d5-4e35-9383-8548f12a402d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:47:19 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[b263c4be-7108-44f0-ac43-db40c01866b9]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:47:19 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-638d10c6-ead2-4cdd-87e4-60b292303dab tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:47:19 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:47:19 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:47:19 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3ea0c91-fe4f-4fc0-8791-2e447a3938e1]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4116efc6-988f-40cf-af06-2abf9c6cd44a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:47:19 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-638d10c6-ead2-4cdd-87e4-60b292303dab tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4116efc6-988f-40cf-af06-2abf9c6cd44a (non-flash)
Apr 14 10:47:19 user nova-compute[71509]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d (non-flash)
Apr 14 10:47:19 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:47:19 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-638d10c6-ead2-4cdd-87e4-60b292303dab tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4116efc6-988f-40cf-af06-2abf9c6cd44a (non-flash)
Apr 14 10:47:19 user nova-compute[71509]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d (non-flash)
Apr 14 10:47:19 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 10:47:19 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c62fdeff-84d5-4e35-9383-8548f12a402d -p 172.16.0.220:3260 --login {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:47:19 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c62fdeff-84d5-4e35-9383-8548f12a402d -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:47:19 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[553521cc-1dc9-44b8-b59e-069cc85a07dd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c62fdeff-84d5-4e35-9383-8548f12a402d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c62fdeff-84d5-4e35-9383-8548f12a402d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:47:19 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-638d10c6-ead2-4cdd-87e4-60b292303dab tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c62fdeff-84d5-4e35-9383-8548f12a402d, portal: 172.16.0.220,3260]
Apr 14 10:47:19 user nova-compute[71509]: Login to [iface: default, target: iqn.2010-10.org.openstack:c62fdeff-84d5-4e35-9383-8548f12a402d, portal: 172.16.0.220,3260] successful.
Apr 14 10:47:19 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:47:19 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c62fdeff-84d5-4e35-9383-8548f12a402d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:47:19 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c62fdeff-84d5-4e35-9383-8548f12a402d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:47:19 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7a9352a-70e7-4d13-a618-aebd690af57f]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:47:19 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-638d10c6-ead2-4cdd-87e4-60b292303dab tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:47:19 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:47:19 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:47:19 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[199f605f-edc5-4477-bfb6-6b697afba37c]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4116efc6-988f-40cf-af06-2abf9c6cd44a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c62fdeff-84d5-4e35-9383-8548f12a402d (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:47:19 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-638d10c6-ead2-4cdd-87e4-60b292303dab tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4116efc6-988f-40cf-af06-2abf9c6cd44a (non-flash)
Apr 14 10:47:19 user nova-compute[71509]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d (non-flash)
Apr 14 10:47:19 user nova-compute[71509]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c62fdeff-84d5-4e35-9383-8548f12a402d (non-flash)
Apr 14 10:47:19 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:47:19 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-638d10c6-ead2-4cdd-87e4-60b292303dab tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4116efc6-988f-40cf-af06-2abf9c6cd44a (non-flash)
Apr 14 10:47:19 user nova-compute[71509]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d (non-flash)
Apr 14 10:47:19 user nova-compute[71509]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c62fdeff-84d5-4e35-9383-8548f12a402d (non-flash)
Apr 14 10:47:19 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 10:47:19 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-638d10c6-ead2-4cdd-87e4-60b292303dab tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c62fdeff-84d5-4e35-9383-8548f12a402d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.337s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 10:47:19 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-638d10c6-ead2-4cdd-87e4-60b292303dab tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Connected to 172.16.0.220:3260 {{(pid=71509) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 10:47:19 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-638d10c6-ead2-4cdd-87e4-60b292303dab tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] HCTL ('35', '-', '-', 0) found on session 19 with lun 0 {{(pid=71509) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 10:47:19 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-638d10c6-ead2-4cdd-87e4-60b292303dab tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71509) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 10:47:19 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:47:19 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.024s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:47:19 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fb135fd-2323-454a-bca2-a14444b7336a]: (4, ('- - 0', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:47:19 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-638d10c6-ead2-4cdd-87e4-60b292303dab tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Searching for a device in session 19 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71509) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 10:47:19 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-638d10c6-ead2-4cdd-87e4-60b292303dab tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:c62fdeff-84d5-4e35-9383-8548f12a402d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FAIbqpxM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71509) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 10:47:20 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-638d10c6-ead2-4cdd-87e4-60b292303dab tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.386s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 10:47:20 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-638d10c6-ead2-4cdd-87e4-60b292303dab tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] <== connect_volume: return (1390ms) {'type': 'block', 'scsi_wwn': '23637316332373830', 'path': '/dev/sdd'} {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 10:47:20 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-638d10c6-ead2-4cdd-87e4-60b292303dab tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] [instance: 55178126-9766-4875-9122-39dcc87ce82c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23637316332373830', 'path': '/dev/sdd'} {{(pid=71509) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 10:47:20 user nova-compute[71509]: DEBUG nova.objects.instance [None req-638d10c6-ead2-4cdd-87e4-60b292303dab tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lazy-loading 'flavor' on Instance uuid 55178126-9766-4875-9122-39dcc87ce82c {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:47:20 user nova-compute[71509]: DEBUG nova.virt.libvirt.guest [None req-638d10c6-ead2-4cdd-87e4-60b292303dab tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 10:47:20 user nova-compute[71509]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 10:47:20 user nova-compute[71509]:   <source dev="/dev/sdd"/>
Apr 14 10:47:20 user nova-compute[71509]:   <target dev="vdb" bus="virtio"/>
Apr 14 10:47:20 user nova-compute[71509]:   <serial>c62fdeff-84d5-4e35-9383-8548f12a402d</serial>
Apr 14 10:47:20 user nova-compute[71509]: </disk>
Apr 14 10:47:20 user nova-compute[71509]:  {{(pid=71509) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 10:47:20 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:47:21 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-638d10c6-ead2-4cdd-87e4-60b292303dab tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] No BDM found with device name vda, not building metadata. {{(pid=71509) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 10:47:21 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-638d10c6-ead2-4cdd-87e4-60b292303dab tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71509) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 10:47:21 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-638d10c6-ead2-4cdd-87e4-60b292303dab tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] No VIF found with MAC fa:16:3e:85:23:c1, not building metadata {{(pid=71509) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 10:47:21 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-638d10c6-ead2-4cdd-87e4-60b292303dab tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "55178126-9766-4875-9122-39dcc87ce82c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.390s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:47:22 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-17fe5bdf-dcb2-4d5f-803c-9487f9f872d1 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Acquiring lock "55178126-9766-4875-9122-39dcc87ce82c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:47:22 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-17fe5bdf-dcb2-4d5f-803c-9487f9f872d1 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "55178126-9766-4875-9122-39dcc87ce82c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:47:22 user nova-compute[71509]: INFO nova.compute.manager [None req-17fe5bdf-dcb2-4d5f-803c-9487f9f872d1 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] [instance: 55178126-9766-4875-9122-39dcc87ce82c] Detaching volume c62fdeff-84d5-4e35-9383-8548f12a402d
Apr 14 10:47:22 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:47:22 user nova-compute[71509]: INFO nova.virt.block_device [None req-17fe5bdf-dcb2-4d5f-803c-9487f9f872d1 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] [instance: 55178126-9766-4875-9122-39dcc87ce82c] Attempting to driver detach volume c62fdeff-84d5-4e35-9383-8548f12a402d from mountpoint /dev/vdb
Apr 14 10:47:22 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-17fe5bdf-dcb2-4d5f-803c-9487f9f872d1 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Attempting to detach device vdb from instance 55178126-9766-4875-9122-39dcc87ce82c from the persistent domain config. {{(pid=71509) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 10:47:22 user nova-compute[71509]: DEBUG nova.virt.libvirt.guest [None req-17fe5bdf-dcb2-4d5f-803c-9487f9f872d1 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 10:47:22 user nova-compute[71509]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 10:47:22 user nova-compute[71509]:   <source dev="/dev/sdd"/>
Apr 14 10:47:22 user nova-compute[71509]:   <target dev="vdb" bus="virtio"/>
Apr 14 10:47:22 user nova-compute[71509]:   <serial>c62fdeff-84d5-4e35-9383-8548f12a402d</serial>
Apr 14 10:47:22 user nova-compute[71509]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 10:47:22 user nova-compute[71509]: </disk>
Apr 14 10:47:22 user nova-compute[71509]:  {{(pid=71509) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 10:47:22 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-17fe5bdf-dcb2-4d5f-803c-9487f9f872d1 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Successfully detached device vdb from instance 55178126-9766-4875-9122-39dcc87ce82c from the persistent domain config.
Apr 14 10:47:22 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-17fe5bdf-dcb2-4d5f-803c-9487f9f872d1 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 55178126-9766-4875-9122-39dcc87ce82c from the live domain config. {{(pid=71509) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 10:47:22 user nova-compute[71509]: DEBUG nova.virt.libvirt.guest [None req-17fe5bdf-dcb2-4d5f-803c-9487f9f872d1 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 10:47:22 user nova-compute[71509]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 10:47:22 user nova-compute[71509]:   <source dev="/dev/sdd"/>
Apr 14 10:47:22 user nova-compute[71509]:   <target dev="vdb" bus="virtio"/>
Apr 14 10:47:22 user nova-compute[71509]:   <serial>c62fdeff-84d5-4e35-9383-8548f12a402d</serial>
Apr 14 10:47:22 user nova-compute[71509]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 10:47:22 user nova-compute[71509]: </disk>
Apr 14 10:47:22 user nova-compute[71509]:  {{(pid=71509) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 10:47:22 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:47:23 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Received event <DeviceRemovedEvent: 1681469243.1534479, 55178126-9766-4875-9122-39dcc87ce82c => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71509) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 10:47:23 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-17fe5bdf-dcb2-4d5f-803c-9487f9f872d1 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 55178126-9766-4875-9122-39dcc87ce82c {{(pid=71509) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 10:47:23 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-17fe5bdf-dcb2-4d5f-803c-9487f9f872d1 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Successfully detached device vdb from instance 55178126-9766-4875-9122-39dcc87ce82c from the live domain config.
Apr 14 10:47:23 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17fe5bdf-dcb2-4d5f-803c-9487f9f872d1 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] [instance: 55178126-9766-4875-9122-39dcc87ce82c] calling os-brick to detach iSCSI Volume {{(pid=71509) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 10:47:23 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-17fe5bdf-dcb2-4d5f-803c-9487f9f872d1 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0bf0749390>, {'target_iqn': 'iqn.2010-10.org.openstack:c62fdeff-84d5-4e35-9383-8548f12a402d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FAIbqpxM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 10:47:23 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-17fe5bdf-dcb2-4d5f-803c-9487f9f872d1 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 10:47:23 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-17fe5bdf-dcb2-4d5f-803c-9487f9f872d1 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 10:47:23 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-17fe5bdf-dcb2-4d5f-803c-9487f9f872d1 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 10:47:23 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:47:23 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:47:23 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.030s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:47:23 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[56ce3fad-a4f7-4843-abca-3f7d7987e763]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4116efc6-988f-40cf-af06-2abf9c6cd44a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c62fdeff-84d5-4e35-9383-8548f12a402d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:47:23 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-17fe5bdf-dcb2-4d5f-803c-9487f9f872d1 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 10:47:23 user nova-compute[71509]: No targets found.
Apr 14 10:47:23 user nova-compute[71509]: iSNS:
Apr 14 10:47:23 user nova-compute[71509]: No targets found.
Apr 14 10:47:23 user nova-compute[71509]: STATIC:
Apr 14 10:47:23 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:4116efc6-988f-40cf-af06-2abf9c6cd44a
Apr 14 10:47:23 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:47:23 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:47:23 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d
Apr 14 10:47:23 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:47:23 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:47:23 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:c62fdeff-84d5-4e35-9383-8548f12a402d
Apr 14 10:47:23 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:47:23 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:47:23 user nova-compute[71509]: FIRMWARE:
Apr 14 10:47:23 user nova-compute[71509]: No targets found.
Apr 14 10:47:23 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:47:23 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-17fe5bdf-dcb2-4d5f-803c-9487f9f872d1 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 10:47:23 user nova-compute[71509]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 10:47:23 user nova-compute[71509]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71509) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 10:47:23 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-17fe5bdf-dcb2-4d5f-803c-9487f9f872d1 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c62fdeff-84d5-4e35-9383-8548f12a402d', 0)] {{(pid=71509) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 10:47:23 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:47:23 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:47:23 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[1909e60b-cabe-4fc5-9273-77cefb98ef13]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4116efc6-988f-40cf-af06-2abf9c6cd44a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c62fdeff-84d5-4e35-9383-8548f12a402d\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:47:23 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:47:23 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.043s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:47:23 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[42a6736c-33f9-490c-9300-4bf9466e9f27]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4116efc6-988f-40cf-af06-2abf9c6cd44a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c62fdeff-84d5-4e35-9383-8548f12a402d (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:47:23 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-17fe5bdf-dcb2-4d5f-803c-9487f9f872d1 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4116efc6-988f-40cf-af06-2abf9c6cd44a (non-flash)
Apr 14 10:47:23 user nova-compute[71509]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d (non-flash)
Apr 14 10:47:23 user nova-compute[71509]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c62fdeff-84d5-4e35-9383-8548f12a402d (non-flash)
Apr 14 10:47:23 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:47:23 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-17fe5bdf-dcb2-4d5f-803c-9487f9f872d1 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4116efc6-988f-40cf-af06-2abf9c6cd44a (non-flash)
Apr 14 10:47:23 user nova-compute[71509]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d (non-flash)
Apr 14 10:47:23 user nova-compute[71509]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c62fdeff-84d5-4e35-9383-8548f12a402d (non-flash)
Apr 14 10:47:23 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 10:47:23 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-17fe5bdf-dcb2-4d5f-803c-9487f9f872d1 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0bf0672290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c62fdeff-84d5-4e35-9383-8548f12a402d'): ({'sdd'}, set())}) {{(pid=71509) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 10:47:23 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-17fe5bdf-dcb2-4d5f-803c-9487f9f872d1 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Removing single pathed devices sdd {{(pid=71509) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 10:47:23 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:47:23 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:47:23 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6f2defe-7ad0-497d-bd0f-7c7fcb7f664f]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:47:23 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:47:23 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:47:23 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6299b0e-62f2-4d7c-9569-1de5d29b2bd7]: (4, ('ok\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:47:23 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-17fe5bdf-dcb2-4d5f-803c-9487f9f872d1 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Flushing IO for device /dev/sdd {{(pid=71509) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 10:47:23 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:47:23 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:47:23 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d2bfd02-cdc8-4e03-afa6-4846cc15a236]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:47:23 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-17fe5bdf-dcb2-4d5f-803c-9487f9f872d1 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71509) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 10:47:23 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:47:23 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.045s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:47:23 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[cba9ac25-4b9a-4c62-8905-cbe94b1bbf18]: (4, ('1', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:47:23 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-17fe5bdf-dcb2-4d5f-803c-9487f9f872d1 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71509) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 10:47:23 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-17fe5bdf-dcb2-4d5f-803c-9487f9f872d1 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] SCSI volumes sdd have been removed. {{(pid=71509) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 10:47:23 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-17fe5bdf-dcb2-4d5f-803c-9487f9f872d1 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c62fdeff-84d5-4e35-9383-8548f12a402d')] {{(pid=71509) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 10:47:23 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c62fdeff-84d5-4e35-9383-8548f12a402d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:47:23 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c62fdeff-84d5-4e35-9383-8548f12a402d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.105s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:47:23 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[532edf9d-3ba6-45a9-88b4-475bcffe7d7b]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:47:23 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-17fe5bdf-dcb2-4d5f-803c-9487f9f872d1 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:47:23 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c62fdeff-84d5-4e35-9383-8548f12a402d -p 172.16.0.220:3260 --logout {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:47:23 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c62fdeff-84d5-4e35-9383-8548f12a402d -p 172.16.0.220:3260 --logout" returned: 0 in 0.257s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:47:23 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[94b0693c-2ef0-455a-9054-f35b893514dc]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:c62fdeff-84d5-4e35-9383-8548f12a402d, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:c62fdeff-84d5-4e35-9383-8548f12a402d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:47:23 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-17fe5bdf-dcb2-4d5f-803c-9487f9f872d1 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:c62fdeff-84d5-4e35-9383-8548f12a402d, portal: 172.16.0.220,3260]
Apr 14 10:47:23 user nova-compute[71509]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:c62fdeff-84d5-4e35-9383-8548f12a402d, portal: 172.16.0.220,3260] successful.
Apr 14 10:47:23 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:47:23 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c62fdeff-84d5-4e35-9383-8548f12a402d -p 172.16.0.220:3260 --op delete {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:47:23 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c62fdeff-84d5-4e35-9383-8548f12a402d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:47:23 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd001dc9-1b06-4c0e-a848-5d0f54bbabf5]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:47:23 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-17fe5bdf-dcb2-4d5f-803c-9487f9f872d1 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:47:23 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-17fe5bdf-dcb2-4d5f-803c-9487f9f872d1 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.662s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 10:47:23 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-17fe5bdf-dcb2-4d5f-803c-9487f9f872d1 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] <== disconnect_volume: return (663ms) None {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 10:47:23 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17fe5bdf-dcb2-4d5f-803c-9487f9f872d1 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] [instance: 55178126-9766-4875-9122-39dcc87ce82c] Disconnected iSCSI Volume {{(pid=71509) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 10:47:24 user nova-compute[71509]: DEBUG nova.objects.instance [None req-17fe5bdf-dcb2-4d5f-803c-9487f9f872d1 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lazy-loading 'flavor' on Instance uuid 55178126-9766-4875-9122-39dcc87ce82c {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:47:24 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-17fe5bdf-dcb2-4d5f-803c-9487f9f872d1 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "55178126-9766-4875-9122-39dcc87ce82c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.113s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:47:25 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-e4e2d8e2-9b42-411e-8a82-e11c6fa0e7ef tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Acquiring lock "8586a70e-9855-4177-ac1b-cf707a4df871" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:47:25 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-e4e2d8e2-9b42-411e-8a82-e11c6fa0e7ef tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "8586a70e-9855-4177-ac1b-cf707a4df871" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:47:25 user nova-compute[71509]: DEBUG nova.compute.manager [None req-e4e2d8e2-9b42-411e-8a82-e11c6fa0e7ef tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Starting instance... {{(pid=71509) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 10:47:25 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-e4e2d8e2-9b42-411e-8a82-e11c6fa0e7ef tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:47:25 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-e4e2d8e2-9b42-411e-8a82-e11c6fa0e7ef tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:47:25 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-e4e2d8e2-9b42-411e-8a82-e11c6fa0e7ef tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71509) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 10:47:25 user nova-compute[71509]: INFO nova.compute.claims [None req-e4e2d8e2-9b42-411e-8a82-e11c6fa0e7ef tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Claim successful on node user
Apr 14 10:47:25 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-e4e2d8e2-9b42-411e-8a82-e11c6fa0e7ef tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 10:47:25 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-e4e2d8e2-9b42-411e-8a82-e11c6fa0e7ef tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 10:47:25 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-e4e2d8e2-9b42-411e-8a82-e11c6fa0e7ef tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.426s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:47:25 user nova-compute[71509]: DEBUG nova.compute.manager [None req-e4e2d8e2-9b42-411e-8a82-e11c6fa0e7ef tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Start building networks asynchronously for instance. {{(pid=71509) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 10:47:25 user nova-compute[71509]: DEBUG nova.compute.manager [None req-e4e2d8e2-9b42-411e-8a82-e11c6fa0e7ef tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Allocating IP information in the background. {{(pid=71509) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 10:47:25 user nova-compute[71509]: DEBUG nova.network.neutron [None req-e4e2d8e2-9b42-411e-8a82-e11c6fa0e7ef tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] allocate_for_instance() {{(pid=71509) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 10:47:25 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-e4e2d8e2-9b42-411e-8a82-e11c6fa0e7ef tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 10:47:25 user nova-compute[71509]: DEBUG nova.compute.manager [None req-e4e2d8e2-9b42-411e-8a82-e11c6fa0e7ef tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Start building block device mappings for instance. {{(pid=71509) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 10:47:25 user nova-compute[71509]: DEBUG nova.policy [None req-e4e2d8e2-9b42-411e-8a82-e11c6fa0e7ef tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '11cb4a1e78d447dbb18cde5453fe499c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9b9fc4f2e244879502006bb844761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71509) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 10:47:25 user nova-compute[71509]: DEBUG nova.compute.manager [None req-e4e2d8e2-9b42-411e-8a82-e11c6fa0e7ef tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Start spawning the instance on the hypervisor. {{(pid=71509) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 10:47:25 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-e4e2d8e2-9b42-411e-8a82-e11c6fa0e7ef tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Creating instance directory {{(pid=71509) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 10:47:25 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-e4e2d8e2-9b42-411e-8a82-e11c6fa0e7ef tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Creating image(s)
Apr 14 10:47:25 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-e4e2d8e2-9b42-411e-8a82-e11c6fa0e7ef tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Acquiring lock "/opt/stack/data/nova/instances/8586a70e-9855-4177-ac1b-cf707a4df871/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:47:25 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-e4e2d8e2-9b42-411e-8a82-e11c6fa0e7ef tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "/opt/stack/data/nova/instances/8586a70e-9855-4177-ac1b-cf707a4df871/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:47:25 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-e4e2d8e2-9b42-411e-8a82-e11c6fa0e7ef tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "/opt/stack/data/nova/instances/8586a70e-9855-4177-ac1b-cf707a4df871/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:47:25 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-e4e2d8e2-9b42-411e-8a82-e11c6fa0e7ef tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:47:26 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-e4e2d8e2-9b42-411e-8a82-e11c6fa0e7ef tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json" returned: 0 in 0.159s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:47:26 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-e4e2d8e2-9b42-411e-8a82-e11c6fa0e7ef tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Acquiring lock "5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:47:26 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-e4e2d8e2-9b42-411e-8a82-e11c6fa0e7ef tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:47:26 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-e4e2d8e2-9b42-411e-8a82-e11c6fa0e7ef tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:47:26 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-e4e2d8e2-9b42-411e-8a82-e11c6fa0e7ef tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json" returned: 0 in 0.158s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:47:26 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-e4e2d8e2-9b42-411e-8a82-e11c6fa0e7ef tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18,backing_fmt=raw /opt/stack/data/nova/instances/8586a70e-9855-4177-ac1b-cf707a4df871/disk 1073741824 {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:47:26 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-e4e2d8e2-9b42-411e-8a82-e11c6fa0e7ef tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18,backing_fmt=raw /opt/stack/data/nova/instances/8586a70e-9855-4177-ac1b-cf707a4df871/disk 1073741824" returned: 0 in 0.052s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:47:26 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-e4e2d8e2-9b42-411e-8a82-e11c6fa0e7ef tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.226s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:47:26 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-e4e2d8e2-9b42-411e-8a82-e11c6fa0e7ef tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:47:26 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-e4e2d8e2-9b42-411e-8a82-e11c6fa0e7ef tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json" returned: 0 in 0.143s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:47:26 user nova-compute[71509]: DEBUG nova.virt.disk.api [None req-e4e2d8e2-9b42-411e-8a82-e11c6fa0e7ef tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8586a70e-9855-4177-ac1b-cf707a4df871/disk. size=1073741824 {{(pid=71509) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 10:47:26 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-e4e2d8e2-9b42-411e-8a82-e11c6fa0e7ef tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8586a70e-9855-4177-ac1b-cf707a4df871/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:47:26 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-e4e2d8e2-9b42-411e-8a82-e11c6fa0e7ef tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8586a70e-9855-4177-ac1b-cf707a4df871/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:47:26 user nova-compute[71509]: DEBUG nova.virt.disk.api [None req-e4e2d8e2-9b42-411e-8a82-e11c6fa0e7ef tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Cannot resize image /opt/stack/data/nova/instances/8586a70e-9855-4177-ac1b-cf707a4df871/disk to a smaller size. {{(pid=71509) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 10:47:26 user nova-compute[71509]: DEBUG nova.objects.instance [None req-e4e2d8e2-9b42-411e-8a82-e11c6fa0e7ef tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lazy-loading 'migration_context' on Instance uuid 8586a70e-9855-4177-ac1b-cf707a4df871 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:47:26 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-e4e2d8e2-9b42-411e-8a82-e11c6fa0e7ef tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Created local disks {{(pid=71509) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 10:47:26 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-e4e2d8e2-9b42-411e-8a82-e11c6fa0e7ef tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Ensure instance console log exists: /opt/stack/data/nova/instances/8586a70e-9855-4177-ac1b-cf707a4df871/console.log {{(pid=71509) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 10:47:26 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-e4e2d8e2-9b42-411e-8a82-e11c6fa0e7ef tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:47:26 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-e4e2d8e2-9b42-411e-8a82-e11c6fa0e7ef tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:47:26 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-e4e2d8e2-9b42-411e-8a82-e11c6fa0e7ef tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:47:26 user nova-compute[71509]: DEBUG nova.network.neutron [None req-e4e2d8e2-9b42-411e-8a82-e11c6fa0e7ef tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Successfully created port: 473d9af8-25a0-4e5a-9afb-7a0c843115cc {{(pid=71509) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 10:47:27 user nova-compute[71509]: INFO nova.compute.manager [None req-8363d7be-a77e-4ce4-8967-91d30673b0f1 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] Rescuing
Apr 14 10:47:27 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-8363d7be-a77e-4ce4-8967-91d30673b0f1 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Acquiring lock "refresh_cache-97f20661-8b60-439e-b7af-2fc2013c5ade" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:47:27 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-8363d7be-a77e-4ce4-8967-91d30673b0f1 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Acquired lock "refresh_cache-97f20661-8b60-439e-b7af-2fc2013c5ade" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:47:27 user nova-compute[71509]: DEBUG nova.network.neutron [None req-8363d7be-a77e-4ce4-8967-91d30673b0f1 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] Building network info cache for instance {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 10:47:27 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:47:27 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:47:28 user nova-compute[71509]: DEBUG nova.network.neutron [None req-8363d7be-a77e-4ce4-8967-91d30673b0f1 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] Updating instance_info_cache with network_info: [{"id": "270b85b0-1832-4118-a8b0-ff784587b58a", "address": "fa:16:3e:75:ba:ae", "network": {"id": "22eb5f87-be4d-447d-bafe-25e0284ea3ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-787804772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf93e5dac50342d0b65ef09711401e99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap270b85b0-18", "ovs_interfaceid": "270b85b0-1832-4118-a8b0-ff784587b58a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:47:28 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-8363d7be-a77e-4ce4-8967-91d30673b0f1 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Releasing lock "refresh_cache-97f20661-8b60-439e-b7af-2fc2013c5ade" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:47:28 user nova-compute[71509]: DEBUG nova.network.neutron [None req-e4e2d8e2-9b42-411e-8a82-e11c6fa0e7ef tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Successfully updated port: 473d9af8-25a0-4e5a-9afb-7a0c843115cc {{(pid=71509) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 10:47:28 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-e4e2d8e2-9b42-411e-8a82-e11c6fa0e7ef tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Acquiring lock "refresh_cache-8586a70e-9855-4177-ac1b-cf707a4df871" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:47:28 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-e4e2d8e2-9b42-411e-8a82-e11c6fa0e7ef tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Acquired lock "refresh_cache-8586a70e-9855-4177-ac1b-cf707a4df871" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:47:28 user nova-compute[71509]: DEBUG nova.network.neutron [None req-e4e2d8e2-9b42-411e-8a82-e11c6fa0e7ef tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Building network info cache for instance {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 10:47:28 user nova-compute[71509]: DEBUG nova.compute.manager [req-119c683a-9b6d-41fd-8682-33568c40e209 req-66466de0-7924-44be-827a-6281ac23c4c7 service nova] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Received event network-changed-473d9af8-25a0-4e5a-9afb-7a0c843115cc {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:47:28 user nova-compute[71509]: DEBUG nova.compute.manager [req-119c683a-9b6d-41fd-8682-33568c40e209 req-66466de0-7924-44be-827a-6281ac23c4c7 service nova] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Refreshing instance network info cache due to event network-changed-473d9af8-25a0-4e5a-9afb-7a0c843115cc. {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 10:47:28 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-119c683a-9b6d-41fd-8682-33568c40e209 req-66466de0-7924-44be-827a-6281ac23c4c7 service nova] Acquiring lock "refresh_cache-8586a70e-9855-4177-ac1b-cf707a4df871" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:47:28 user nova-compute[71509]: DEBUG nova.network.neutron [None req-e4e2d8e2-9b42-411e-8a82-e11c6fa0e7ef tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Instance cache missing network info. {{(pid=71509) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 10:47:28 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:47:28 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:47:28 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:47:28 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:47:28 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:47:29 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:47:29 user nova-compute[71509]: DEBUG nova.network.neutron [None req-e4e2d8e2-9b42-411e-8a82-e11c6fa0e7ef tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Updating instance_info_cache with network_info: [{"id": "473d9af8-25a0-4e5a-9afb-7a0c843115cc", "address": "fa:16:3e:b0:12:bf", "network": {"id": "653f0c81-1afd-4ca6-9639-675ead1a6127", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-932652547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb9b9fc4f2e244879502006bb844761c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap473d9af8-25", "ovs_interfaceid": "473d9af8-25a0-4e5a-9afb-7a0c843115cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:47:29 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] Instance destroyed successfully.
Apr 14 10:47:29 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-8363d7be-a77e-4ce4-8967-91d30673b0f1 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] Attempting rescue
Apr 14 10:47:29 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-8363d7be-a77e-4ce4-8967-91d30673b0f1 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71509) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 14 10:47:29 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-e4e2d8e2-9b42-411e-8a82-e11c6fa0e7ef tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Releasing lock "refresh_cache-8586a70e-9855-4177-ac1b-cf707a4df871" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:47:29 user nova-compute[71509]: DEBUG nova.compute.manager [None req-e4e2d8e2-9b42-411e-8a82-e11c6fa0e7ef tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Instance network_info: |[{"id": "473d9af8-25a0-4e5a-9afb-7a0c843115cc", "address": "fa:16:3e:b0:12:bf", "network": {"id": "653f0c81-1afd-4ca6-9639-675ead1a6127", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-932652547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb9b9fc4f2e244879502006bb844761c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap473d9af8-25", "ovs_interfaceid": "473d9af8-25a0-4e5a-9afb-7a0c843115cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71509) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 10:47:29 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-119c683a-9b6d-41fd-8682-33568c40e209 req-66466de0-7924-44be-827a-6281ac23c4c7 service nova] Acquired lock "refresh_cache-8586a70e-9855-4177-ac1b-cf707a4df871" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:47:29 user nova-compute[71509]: DEBUG nova.network.neutron [req-119c683a-9b6d-41fd-8682-33568c40e209 req-66466de0-7924-44be-827a-6281ac23c4c7 service nova] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Refreshing network info cache for port 473d9af8-25a0-4e5a-9afb-7a0c843115cc {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 10:47:29 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-e4e2d8e2-9b42-411e-8a82-e11c6fa0e7ef tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Start _get_guest_xml network_info=[{"id": "473d9af8-25a0-4e5a-9afb-7a0c843115cc", "address": "fa:16:3e:b0:12:bf", "network": {"id": "653f0c81-1afd-4ca6-9639-675ead1a6127", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-932652547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb9b9fc4f2e244879502006bb844761c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap473d9af8-25", "ovs_interfaceid": "473d9af8-25a0-4e5a-9afb-7a0c843115cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T10:38:55Z,direct_url=<?>,disk_format='qcow2',id=048ec0ee-0465-448d-8b4c-f072acb101dc,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='9742d6ad20cf48d9bab0fdbcc9491db9',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T10:38:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '048ec0ee-0465-448d-8b4c-f072acb101dc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71509) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 10:47:29 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:47:29 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-8363d7be-a77e-4ce4-8967-91d30673b0f1 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] Instance directory exists: not creating {{(pid=71509) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 14 10:47:29 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-8363d7be-a77e-4ce4-8967-91d30673b0f1 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] Creating image(s)
Apr 14 10:47:29 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-8363d7be-a77e-4ce4-8967-91d30673b0f1 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Acquiring lock "/opt/stack/data/nova/instances/97f20661-8b60-439e-b7af-2fc2013c5ade/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:47:29 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-8363d7be-a77e-4ce4-8967-91d30673b0f1 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "/opt/stack/data/nova/instances/97f20661-8b60-439e-b7af-2fc2013c5ade/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:47:29 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-8363d7be-a77e-4ce4-8967-91d30673b0f1 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "/opt/stack/data/nova/instances/97f20661-8b60-439e-b7af-2fc2013c5ade/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:47:29 user nova-compute[71509]: DEBUG nova.objects.instance [None req-8363d7be-a77e-4ce4-8967-91d30673b0f1 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lazy-loading 'trusted_certs' on Instance uuid 97f20661-8b60-439e-b7af-2fc2013c5ade {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:47:29 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-e4e2d8e2-9b42-411e-8a82-e11c6fa0e7ef tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:47:29 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-e4e2d8e2-9b42-411e-8a82-e11c6fa0e7ef tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:47:29 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-e4e2d8e2-9b42-411e-8a82-e11c6fa0e7ef tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71509) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 10:47:29 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-e4e2d8e2-9b42-411e-8a82-e11c6fa0e7ef tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T10:40:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T10:38:55Z,direct_url=<?>,disk_format='qcow2',id=048ec0ee-0465-448d-8b4c-f072acb101dc,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='9742d6ad20cf48d9bab0fdbcc9491db9',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T10:38:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 10:47:29 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-e4e2d8e2-9b42-411e-8a82-e11c6fa0e7ef tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Flavor limits 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 10:47:29 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-e4e2d8e2-9b42-411e-8a82-e11c6fa0e7ef tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Image limits 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 10:47:29 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-e4e2d8e2-9b42-411e-8a82-e11c6fa0e7ef tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Flavor pref 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 10:47:29 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-e4e2d8e2-9b42-411e-8a82-e11c6fa0e7ef tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Image pref 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 10:47:29 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-e4e2d8e2-9b42-411e-8a82-e11c6fa0e7ef tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 10:47:29 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-e4e2d8e2-9b42-411e-8a82-e11c6fa0e7ef tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 10:47:29 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-e4e2d8e2-9b42-411e-8a82-e11c6fa0e7ef tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71509) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 10:47:29 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-e4e2d8e2-9b42-411e-8a82-e11c6fa0e7ef tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Got 1 possible topologies {{(pid=71509) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 10:47:29 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-e4e2d8e2-9b42-411e-8a82-e11c6fa0e7ef tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 10:47:29 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-e4e2d8e2-9b42-411e-8a82-e11c6fa0e7ef tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 10:47:29 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-e4e2d8e2-9b42-411e-8a82-e11c6fa0e7ef tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T10:47:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1909620947',display_name='tempest-AttachVolumeTestJSON-server-1909620947',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1909620947',id=16,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB8cubhYj6kalSkwto2AOwwQ8SwXu5MQ/cjSK0TQBgPs7qiNcfKtpFOEItZcvi+VTwGeXlKnu4SiqcBNrbUUIw9hxThGtWyniX5k6WeMBHziH1L0bIiIvkr1gDZ6mYbTMQ==',key_name='tempest-keypair-1352311307',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eb9b9fc4f2e244879502006bb844761c',ramdisk_id='',reservation_id='r-043k765a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-821788322',owner_user_name='tempest-AttachVolumeTestJSON-821788322-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T10:47:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11cb4a1e78d447dbb18cde5453fe499c',uuid=8586a70e-9855-4177-ac1b-cf707a4df871,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "473d9af8-25a0-4e5a-9afb-7a0c843115cc", "address": "fa:16:3e:b0:12:bf", "network": {"id": "653f0c81-1afd-4ca6-9639-675ead1a6127", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-932652547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb9b9fc4f2e244879502006bb844761c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap473d9af8-25", "ovs_interfaceid": "473d9af8-25a0-4e5a-9afb-7a0c843115cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71509) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 10:47:29 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-e4e2d8e2-9b42-411e-8a82-e11c6fa0e7ef tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Converting VIF {"id": "473d9af8-25a0-4e5a-9afb-7a0c843115cc", "address": "fa:16:3e:b0:12:bf", "network": {"id": "653f0c81-1afd-4ca6-9639-675ead1a6127", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-932652547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb9b9fc4f2e244879502006bb844761c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap473d9af8-25", "ovs_interfaceid": "473d9af8-25a0-4e5a-9afb-7a0c843115cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:47:29 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-e4e2d8e2-9b42-411e-8a82-e11c6fa0e7ef tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:12:bf,bridge_name='br-int',has_traffic_filtering=True,id=473d9af8-25a0-4e5a-9afb-7a0c843115cc,network=Network(653f0c81-1afd-4ca6-9639-675ead1a6127),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap473d9af8-25') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:47:29 user nova-compute[71509]: DEBUG nova.objects.instance [None req-e4e2d8e2-9b42-411e-8a82-e11c6fa0e7ef tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lazy-loading 'pci_devices' on Instance uuid 8586a70e-9855-4177-ac1b-cf707a4df871 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:47:29 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-8363d7be-a77e-4ce4-8967-91d30673b0f1 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Acquiring lock "5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:47:29 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-8363d7be-a77e-4ce4-8967-91d30673b0f1 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:47:29 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-8363d7be-a77e-4ce4-8967-91d30673b0f1 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:47:29 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-e4e2d8e2-9b42-411e-8a82-e11c6fa0e7ef tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] End _get_guest_xml xml=<domain type="kvm">
Apr 14 10:47:29 user nova-compute[71509]:   <uuid>8586a70e-9855-4177-ac1b-cf707a4df871</uuid>
Apr 14 10:47:29 user nova-compute[71509]:   <name>instance-00000010</name>
Apr 14 10:47:29 user nova-compute[71509]:   <memory>131072</memory>
Apr 14 10:47:29 user nova-compute[71509]:   <vcpu>1</vcpu>
Apr 14 10:47:29 user nova-compute[71509]:   <metadata>
Apr 14 10:47:29 user nova-compute[71509]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 10:47:29 user nova-compute[71509]:       <nova:package version="0.0.0"/>
Apr 14 10:47:29 user nova-compute[71509]:       <nova:name>tempest-AttachVolumeTestJSON-server-1909620947</nova:name>
Apr 14 10:47:29 user nova-compute[71509]:       <nova:creationTime>2023-04-14 10:47:29</nova:creationTime>
Apr 14 10:47:29 user nova-compute[71509]:       <nova:flavor name="m1.nano">
Apr 14 10:47:29 user nova-compute[71509]:         <nova:memory>128</nova:memory>
Apr 14 10:47:29 user nova-compute[71509]:         <nova:disk>1</nova:disk>
Apr 14 10:47:29 user nova-compute[71509]:         <nova:swap>0</nova:swap>
Apr 14 10:47:29 user nova-compute[71509]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 10:47:29 user nova-compute[71509]:         <nova:vcpus>1</nova:vcpus>
Apr 14 10:47:29 user nova-compute[71509]:       </nova:flavor>
Apr 14 10:47:29 user nova-compute[71509]:       <nova:owner>
Apr 14 10:47:29 user nova-compute[71509]:         <nova:user uuid="11cb4a1e78d447dbb18cde5453fe499c">tempest-AttachVolumeTestJSON-821788322-project-member</nova:user>
Apr 14 10:47:29 user nova-compute[71509]:         <nova:project uuid="eb9b9fc4f2e244879502006bb844761c">tempest-AttachVolumeTestJSON-821788322</nova:project>
Apr 14 10:47:29 user nova-compute[71509]:       </nova:owner>
Apr 14 10:47:29 user nova-compute[71509]:       <nova:root type="image" uuid="048ec0ee-0465-448d-8b4c-f072acb101dc"/>
Apr 14 10:47:29 user nova-compute[71509]:       <nova:ports>
Apr 14 10:47:29 user nova-compute[71509]:         <nova:port uuid="473d9af8-25a0-4e5a-9afb-7a0c843115cc">
Apr 14 10:47:29 user nova-compute[71509]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 14 10:47:29 user nova-compute[71509]:         </nova:port>
Apr 14 10:47:29 user nova-compute[71509]:       </nova:ports>
Apr 14 10:47:29 user nova-compute[71509]:     </nova:instance>
Apr 14 10:47:29 user nova-compute[71509]:   </metadata>
Apr 14 10:47:29 user nova-compute[71509]:   <sysinfo type="smbios">
Apr 14 10:47:29 user nova-compute[71509]:     <system>
Apr 14 10:47:29 user nova-compute[71509]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 10:47:29 user nova-compute[71509]:       <entry name="product">OpenStack Nova</entry>
Apr 14 10:47:29 user nova-compute[71509]:       <entry name="version">0.0.0</entry>
Apr 14 10:47:29 user nova-compute[71509]:       <entry name="serial">8586a70e-9855-4177-ac1b-cf707a4df871</entry>
Apr 14 10:47:29 user nova-compute[71509]:       <entry name="uuid">8586a70e-9855-4177-ac1b-cf707a4df871</entry>
Apr 14 10:47:29 user nova-compute[71509]:       <entry name="family">Virtual Machine</entry>
Apr 14 10:47:29 user nova-compute[71509]:     </system>
Apr 14 10:47:29 user nova-compute[71509]:   </sysinfo>
Apr 14 10:47:29 user nova-compute[71509]:   <os>
Apr 14 10:47:29 user nova-compute[71509]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 10:47:29 user nova-compute[71509]:     <boot dev="hd"/>
Apr 14 10:47:29 user nova-compute[71509]:     <smbios mode="sysinfo"/>
Apr 14 10:47:29 user nova-compute[71509]:   </os>
Apr 14 10:47:29 user nova-compute[71509]:   <features>
Apr 14 10:47:29 user nova-compute[71509]:     <acpi/>
Apr 14 10:47:29 user nova-compute[71509]:     <apic/>
Apr 14 10:47:29 user nova-compute[71509]:     <vmcoreinfo/>
Apr 14 10:47:29 user nova-compute[71509]:   </features>
Apr 14 10:47:29 user nova-compute[71509]:   <clock offset="utc">
Apr 14 10:47:29 user nova-compute[71509]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 10:47:29 user nova-compute[71509]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 10:47:29 user nova-compute[71509]:     <timer name="hpet" present="no"/>
Apr 14 10:47:29 user nova-compute[71509]:   </clock>
Apr 14 10:47:29 user nova-compute[71509]:   <cpu mode="custom" match="exact">
Apr 14 10:47:29 user nova-compute[71509]:     <model>Nehalem</model>
Apr 14 10:47:29 user nova-compute[71509]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 10:47:29 user nova-compute[71509]:   </cpu>
Apr 14 10:47:29 user nova-compute[71509]:   <devices>
Apr 14 10:47:29 user nova-compute[71509]:     <disk type="file" device="disk">
Apr 14 10:47:29 user nova-compute[71509]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 10:47:29 user nova-compute[71509]:       <source file="/opt/stack/data/nova/instances/8586a70e-9855-4177-ac1b-cf707a4df871/disk"/>
Apr 14 10:47:29 user nova-compute[71509]:       <target dev="vda" bus="virtio"/>
Apr 14 10:47:29 user nova-compute[71509]:     </disk>
Apr 14 10:47:29 user nova-compute[71509]:     <interface type="ethernet">
Apr 14 10:47:29 user nova-compute[71509]:       <mac address="fa:16:3e:b0:12:bf"/>
Apr 14 10:47:29 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 10:47:29 user nova-compute[71509]:       <mtu size="1442"/>
Apr 14 10:47:29 user nova-compute[71509]:       <target dev="tap473d9af8-25"/>
Apr 14 10:47:29 user nova-compute[71509]:     </interface>
Apr 14 10:47:29 user nova-compute[71509]:     <serial type="pty">
Apr 14 10:47:29 user nova-compute[71509]:       <log file="/opt/stack/data/nova/instances/8586a70e-9855-4177-ac1b-cf707a4df871/console.log" append="off"/>
Apr 14 10:47:29 user nova-compute[71509]:     </serial>
Apr 14 10:47:29 user nova-compute[71509]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 10:47:29 user nova-compute[71509]:     <video>
Apr 14 10:47:29 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 10:47:29 user nova-compute[71509]:     </video>
Apr 14 10:47:29 user nova-compute[71509]:     <rng model="virtio">
Apr 14 10:47:29 user nova-compute[71509]:       <backend model="random">/dev/urandom</backend>
Apr 14 10:47:29 user nova-compute[71509]:     </rng>
Apr 14 10:47:29 user nova-compute[71509]:     <controller type="usb" index="0" model="none"/>
Apr 14 10:47:29 user nova-compute[71509]:     <memballoon model="virtio">
Apr 14 10:47:29 user nova-compute[71509]:       <stats period="10"/>
Apr 14 10:47:29 user nova-compute[71509]:     </memballoon>
Apr 14 10:47:29 user nova-compute[71509]:   </devices>
Apr 14 10:47:29 user nova-compute[71509]: </domain>
Apr 14 10:47:29 user nova-compute[71509]:  {{(pid=71509) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 10:47:29 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-e4e2d8e2-9b42-411e-8a82-e11c6fa0e7ef tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T10:47:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1909620947',display_name='tempest-AttachVolumeTestJSON-server-1909620947',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1909620947',id=16,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB8cubhYj6kalSkwto2AOwwQ8SwXu5MQ/cjSK0TQBgPs7qiNcfKtpFOEItZcvi+VTwGeXlKnu4SiqcBNrbUUIw9hxThGtWyniX5k6WeMBHziH1L0bIiIvkr1gDZ6mYbTMQ==',key_name='tempest-keypair-1352311307',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eb9b9fc4f2e244879502006bb844761c',ramdisk_id='',reservation_id='r-043k765a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-821788322',owner_user_name='tempest-AttachVolumeTestJSON-821788322-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T10:47:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11cb4a1e78d447dbb18cde5453fe499c',uuid=8586a70e-9855-4177-ac1b-cf707a4df871,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "473d9af8-25a0-4e5a-9afb-7a0c843115cc", "address": "fa:16:3e:b0:12:bf", "network": {"id": "653f0c81-1afd-4ca6-9639-675ead1a6127", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-932652547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb9b9fc4f2e244879502006bb844761c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap473d9af8-25", "ovs_interfaceid": "473d9af8-25a0-4e5a-9afb-7a0c843115cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 10:47:29 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-e4e2d8e2-9b42-411e-8a82-e11c6fa0e7ef tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Converting VIF {"id": "473d9af8-25a0-4e5a-9afb-7a0c843115cc", "address": "fa:16:3e:b0:12:bf", "network": {"id": "653f0c81-1afd-4ca6-9639-675ead1a6127", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-932652547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb9b9fc4f2e244879502006bb844761c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap473d9af8-25", "ovs_interfaceid": "473d9af8-25a0-4e5a-9afb-7a0c843115cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:47:29 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-e4e2d8e2-9b42-411e-8a82-e11c6fa0e7ef tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:12:bf,bridge_name='br-int',has_traffic_filtering=True,id=473d9af8-25a0-4e5a-9afb-7a0c843115cc,network=Network(653f0c81-1afd-4ca6-9639-675ead1a6127),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap473d9af8-25') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:47:29 user nova-compute[71509]: DEBUG os_vif [None req-e4e2d8e2-9b42-411e-8a82-e11c6fa0e7ef tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:12:bf,bridge_name='br-int',has_traffic_filtering=True,id=473d9af8-25a0-4e5a-9afb-7a0c843115cc,network=Network(653f0c81-1afd-4ca6-9639-675ead1a6127),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap473d9af8-25') {{(pid=71509) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 10:47:29 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:47:29 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:47:29 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 10:47:29 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:47:29 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap473d9af8-25, may_exist=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:47:29 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap473d9af8-25, col_values=(('external_ids', {'iface-id': '473d9af8-25a0-4e5a-9afb-7a0c843115cc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b0:12:bf', 'vm-uuid': '8586a70e-9855-4177-ac1b-cf707a4df871'}),)) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:47:29 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:47:29 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 10:47:29 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:47:29 user nova-compute[71509]: INFO os_vif [None req-e4e2d8e2-9b42-411e-8a82-e11c6fa0e7ef tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:12:bf,bridge_name='br-int',has_traffic_filtering=True,id=473d9af8-25a0-4e5a-9afb-7a0c843115cc,network=Network(653f0c81-1afd-4ca6-9639-675ead1a6127),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap473d9af8-25')
Apr 14 10:47:29 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:47:29 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:47:29 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-8363d7be-a77e-4ce4-8967-91d30673b0f1 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json" returned: 0 in 0.150s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:47:29 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-8363d7be-a77e-4ce4-8967-91d30673b0f1 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18,backing_fmt=raw /opt/stack/data/nova/instances/97f20661-8b60-439e-b7af-2fc2013c5ade/disk.rescue {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:47:29 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-8363d7be-a77e-4ce4-8967-91d30673b0f1 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18,backing_fmt=raw /opt/stack/data/nova/instances/97f20661-8b60-439e-b7af-2fc2013c5ade/disk.rescue" returned: 0 in 0.058s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:47:29 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-8363d7be-a77e-4ce4-8967-91d30673b0f1 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.216s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:47:29 user nova-compute[71509]: DEBUG nova.objects.instance [None req-8363d7be-a77e-4ce4-8967-91d30673b0f1 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lazy-loading 'migration_context' on Instance uuid 97f20661-8b60-439e-b7af-2fc2013c5ade {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:47:29 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-8363d7be-a77e-4ce4-8967-91d30673b0f1 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] Created local disks {{(pid=71509) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 10:47:29 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-8363d7be-a77e-4ce4-8967-91d30673b0f1 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] Start _get_guest_xml network_info=[{"id": "270b85b0-1832-4118-a8b0-ff784587b58a", "address": "fa:16:3e:75:ba:ae", "network": {"id": "22eb5f87-be4d-447d-bafe-25e0284ea3ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-787804772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-787804772-network", "vif_mac": "fa:16:3e:75:ba:ae"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf93e5dac50342d0b65ef09711401e99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap270b85b0-18", "ovs_interfaceid": "270b85b0-1832-4118-a8b0-ff784587b58a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T10:38:55Z,direct_url=<?>,disk_format='qcow2',id=048ec0ee-0465-448d-8b4c-f072acb101dc,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='9742d6ad20cf48d9bab0fdbcc9491db9',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T10:38:57Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '048ec0ee-0465-448d-8b4c-f072acb101dc', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=71509) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 10:47:29 user nova-compute[71509]: DEBUG nova.objects.instance [None req-8363d7be-a77e-4ce4-8967-91d30673b0f1 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lazy-loading 'resources' on Instance uuid 97f20661-8b60-439e-b7af-2fc2013c5ade {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:47:29 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-e4e2d8e2-9b42-411e-8a82-e11c6fa0e7ef tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] No BDM found with device name vda, not building metadata. {{(pid=71509) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 10:47:29 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-e4e2d8e2-9b42-411e-8a82-e11c6fa0e7ef tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] No VIF found with MAC fa:16:3e:b0:12:bf, not building metadata {{(pid=71509) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 10:47:29 user nova-compute[71509]: DEBUG nova.objects.instance [None req-8363d7be-a77e-4ce4-8967-91d30673b0f1 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lazy-loading 'numa_topology' on Instance uuid 97f20661-8b60-439e-b7af-2fc2013c5ade {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:47:29 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-8363d7be-a77e-4ce4-8967-91d30673b0f1 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:47:29 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-8363d7be-a77e-4ce4-8967-91d30673b0f1 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:47:29 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-8363d7be-a77e-4ce4-8967-91d30673b0f1 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71509) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 10:47:29 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-8363d7be-a77e-4ce4-8967-91d30673b0f1 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T10:40:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T10:38:55Z,direct_url=<?>,disk_format='qcow2',id=048ec0ee-0465-448d-8b4c-f072acb101dc,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='9742d6ad20cf48d9bab0fdbcc9491db9',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T10:38:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 10:47:29 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-8363d7be-a77e-4ce4-8967-91d30673b0f1 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Flavor limits 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 10:47:29 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-8363d7be-a77e-4ce4-8967-91d30673b0f1 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Image limits 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 10:47:29 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-8363d7be-a77e-4ce4-8967-91d30673b0f1 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Flavor pref 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 10:47:29 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-8363d7be-a77e-4ce4-8967-91d30673b0f1 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Image pref 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 10:47:29 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-8363d7be-a77e-4ce4-8967-91d30673b0f1 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 10:47:29 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-8363d7be-a77e-4ce4-8967-91d30673b0f1 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 10:47:29 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-8363d7be-a77e-4ce4-8967-91d30673b0f1 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71509) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 10:47:29 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-8363d7be-a77e-4ce4-8967-91d30673b0f1 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Got 1 possible topologies {{(pid=71509) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 10:47:29 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-8363d7be-a77e-4ce4-8967-91d30673b0f1 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 10:47:29 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-8363d7be-a77e-4ce4-8967-91d30673b0f1 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 10:47:29 user nova-compute[71509]: DEBUG nova.objects.instance [None req-8363d7be-a77e-4ce4-8967-91d30673b0f1 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lazy-loading 'vcpu_model' on Instance uuid 97f20661-8b60-439e-b7af-2fc2013c5ade {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:47:29 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-8363d7be-a77e-4ce4-8967-91d30673b0f1 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T10:42:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1197292957',display_name='tempest-ServerRescueNegativeTestJSON-server-1197292957',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1197292957',id=2,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T10:43:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bf93e5dac50342d0b65ef09711401e99',ramdisk_id='',reservation_id='r-0zxo4k30',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-563868574',owner_user_name='tempest-ServerRescueNegativeTestJSON-563868574-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T10:43:01Z,user_data=None,user_id='e359578dcbb24755a216415053d415ef',uuid=97f20661-8b60-439e-b7af-2fc2013c5ade,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "270b85b0-1832-4118-a8b0-ff784587b58a", "address": "fa:16:3e:75:ba:ae", "network": {"id": "22eb5f87-be4d-447d-bafe-25e0284ea3ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-787804772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-787804772-network", "vif_mac": "fa:16:3e:75:ba:ae"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf93e5dac50342d0b65ef09711401e99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap270b85b0-18", "ovs_interfaceid": "270b85b0-1832-4118-a8b0-ff784587b58a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71509) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 10:47:29 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-8363d7be-a77e-4ce4-8967-91d30673b0f1 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Converting VIF {"id": "270b85b0-1832-4118-a8b0-ff784587b58a", "address": "fa:16:3e:75:ba:ae", "network": {"id": "22eb5f87-be4d-447d-bafe-25e0284ea3ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-787804772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-787804772-network", "vif_mac": "fa:16:3e:75:ba:ae"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf93e5dac50342d0b65ef09711401e99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap270b85b0-18", "ovs_interfaceid": "270b85b0-1832-4118-a8b0-ff784587b58a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:47:29 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-8363d7be-a77e-4ce4-8967-91d30673b0f1 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:75:ba:ae,bridge_name='br-int',has_traffic_filtering=True,id=270b85b0-1832-4118-a8b0-ff784587b58a,network=Network(22eb5f87-be4d-447d-bafe-25e0284ea3ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap270b85b0-18') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:47:29 user nova-compute[71509]: DEBUG nova.objects.instance [None req-8363d7be-a77e-4ce4-8967-91d30673b0f1 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lazy-loading 'pci_devices' on Instance uuid 97f20661-8b60-439e-b7af-2fc2013c5ade {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:47:29 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-8363d7be-a77e-4ce4-8967-91d30673b0f1 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] End _get_guest_xml xml=<domain type="kvm">
Apr 14 10:47:29 user nova-compute[71509]:   <uuid>97f20661-8b60-439e-b7af-2fc2013c5ade</uuid>
Apr 14 10:47:29 user nova-compute[71509]:   <name>instance-00000002</name>
Apr 14 10:47:29 user nova-compute[71509]:   <memory>131072</memory>
Apr 14 10:47:29 user nova-compute[71509]:   <vcpu>1</vcpu>
Apr 14 10:47:29 user nova-compute[71509]:   <metadata>
Apr 14 10:47:29 user nova-compute[71509]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 10:47:29 user nova-compute[71509]:       <nova:package version="0.0.0"/>
Apr 14 10:47:29 user nova-compute[71509]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1197292957</nova:name>
Apr 14 10:47:29 user nova-compute[71509]:       <nova:creationTime>2023-04-14 10:47:29</nova:creationTime>
Apr 14 10:47:29 user nova-compute[71509]:       <nova:flavor name="m1.nano">
Apr 14 10:47:29 user nova-compute[71509]:         <nova:memory>128</nova:memory>
Apr 14 10:47:29 user nova-compute[71509]:         <nova:disk>1</nova:disk>
Apr 14 10:47:29 user nova-compute[71509]:         <nova:swap>0</nova:swap>
Apr 14 10:47:29 user nova-compute[71509]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 10:47:29 user nova-compute[71509]:         <nova:vcpus>1</nova:vcpus>
Apr 14 10:47:29 user nova-compute[71509]:       </nova:flavor>
Apr 14 10:47:29 user nova-compute[71509]:       <nova:owner>
Apr 14 10:47:29 user nova-compute[71509]:         <nova:user uuid="e359578dcbb24755a216415053d415ef">tempest-ServerRescueNegativeTestJSON-563868574-project-member</nova:user>
Apr 14 10:47:29 user nova-compute[71509]:         <nova:project uuid="bf93e5dac50342d0b65ef09711401e99">tempest-ServerRescueNegativeTestJSON-563868574</nova:project>
Apr 14 10:47:29 user nova-compute[71509]:       </nova:owner>
Apr 14 10:47:29 user nova-compute[71509]:       <nova:root type="image" uuid="048ec0ee-0465-448d-8b4c-f072acb101dc"/>
Apr 14 10:47:29 user nova-compute[71509]:       <nova:ports>
Apr 14 10:47:29 user nova-compute[71509]:         <nova:port uuid="270b85b0-1832-4118-a8b0-ff784587b58a">
Apr 14 10:47:29 user nova-compute[71509]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 14 10:47:29 user nova-compute[71509]:         </nova:port>
Apr 14 10:47:29 user nova-compute[71509]:       </nova:ports>
Apr 14 10:47:29 user nova-compute[71509]:     </nova:instance>
Apr 14 10:47:29 user nova-compute[71509]:   </metadata>
Apr 14 10:47:29 user nova-compute[71509]:   <sysinfo type="smbios">
Apr 14 10:47:29 user nova-compute[71509]:     <system>
Apr 14 10:47:29 user nova-compute[71509]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 10:47:29 user nova-compute[71509]:       <entry name="product">OpenStack Nova</entry>
Apr 14 10:47:29 user nova-compute[71509]:       <entry name="version">0.0.0</entry>
Apr 14 10:47:29 user nova-compute[71509]:       <entry name="serial">97f20661-8b60-439e-b7af-2fc2013c5ade</entry>
Apr 14 10:47:29 user nova-compute[71509]:       <entry name="uuid">97f20661-8b60-439e-b7af-2fc2013c5ade</entry>
Apr 14 10:47:29 user nova-compute[71509]:       <entry name="family">Virtual Machine</entry>
Apr 14 10:47:29 user nova-compute[71509]:     </system>
Apr 14 10:47:29 user nova-compute[71509]:   </sysinfo>
Apr 14 10:47:29 user nova-compute[71509]:   <os>
Apr 14 10:47:29 user nova-compute[71509]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 10:47:29 user nova-compute[71509]:     <smbios mode="sysinfo"/>
Apr 14 10:47:29 user nova-compute[71509]:   </os>
Apr 14 10:47:29 user nova-compute[71509]:   <features>
Apr 14 10:47:29 user nova-compute[71509]:     <acpi/>
Apr 14 10:47:29 user nova-compute[71509]:     <apic/>
Apr 14 10:47:29 user nova-compute[71509]:     <vmcoreinfo/>
Apr 14 10:47:29 user nova-compute[71509]:   </features>
Apr 14 10:47:29 user nova-compute[71509]:   <clock offset="utc">
Apr 14 10:47:29 user nova-compute[71509]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 10:47:29 user nova-compute[71509]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 10:47:29 user nova-compute[71509]:     <timer name="hpet" present="no"/>
Apr 14 10:47:29 user nova-compute[71509]:   </clock>
Apr 14 10:47:29 user nova-compute[71509]:   <cpu mode="custom" match="exact">
Apr 14 10:47:29 user nova-compute[71509]:     <model>Nehalem</model>
Apr 14 10:47:29 user nova-compute[71509]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 10:47:29 user nova-compute[71509]:   </cpu>
Apr 14 10:47:29 user nova-compute[71509]:   <devices>
Apr 14 10:47:29 user nova-compute[71509]:     <disk type="file" device="disk">
Apr 14 10:47:29 user nova-compute[71509]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 10:47:29 user nova-compute[71509]:       <source file="/opt/stack/data/nova/instances/97f20661-8b60-439e-b7af-2fc2013c5ade/disk.rescue"/>
Apr 14 10:47:29 user nova-compute[71509]:       <target dev="vda" bus="virtio"/>
Apr 14 10:47:29 user nova-compute[71509]:     </disk>
Apr 14 10:47:29 user nova-compute[71509]:     <disk type="file" device="disk">
Apr 14 10:47:29 user nova-compute[71509]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 10:47:29 user nova-compute[71509]:       <source file="/opt/stack/data/nova/instances/97f20661-8b60-439e-b7af-2fc2013c5ade/disk"/>
Apr 14 10:47:29 user nova-compute[71509]:       <target dev="vdb" bus="virtio"/>
Apr 14 10:47:29 user nova-compute[71509]:     </disk>
Apr 14 10:47:29 user nova-compute[71509]:     <interface type="ethernet">
Apr 14 10:47:29 user nova-compute[71509]:       <mac address="fa:16:3e:75:ba:ae"/>
Apr 14 10:47:29 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 10:47:29 user nova-compute[71509]:       <mtu size="1442"/>
Apr 14 10:47:29 user nova-compute[71509]:       <target dev="tap270b85b0-18"/>
Apr 14 10:47:29 user nova-compute[71509]:     </interface>
Apr 14 10:47:29 user nova-compute[71509]:     <serial type="pty">
Apr 14 10:47:29 user nova-compute[71509]:       <log file="/opt/stack/data/nova/instances/97f20661-8b60-439e-b7af-2fc2013c5ade/console.log" append="off"/>
Apr 14 10:47:29 user nova-compute[71509]:     </serial>
Apr 14 10:47:29 user nova-compute[71509]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 10:47:29 user nova-compute[71509]:     <video>
Apr 14 10:47:29 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 10:47:29 user nova-compute[71509]:     </video>
Apr 14 10:47:29 user nova-compute[71509]:     <rng model="virtio">
Apr 14 10:47:29 user nova-compute[71509]:       <backend model="random">/dev/urandom</backend>
Apr 14 10:47:29 user nova-compute[71509]:     </rng>
Apr 14 10:47:29 user nova-compute[71509]:     <controller type="usb" index="0" model="none"/>
Apr 14 10:47:29 user nova-compute[71509]:     <memballoon model="virtio">
Apr 14 10:47:29 user nova-compute[71509]:       <stats period="10"/>
Apr 14 10:47:29 user nova-compute[71509]:     </memballoon>
Apr 14 10:47:29 user nova-compute[71509]:   </devices>
Apr 14 10:47:29 user nova-compute[71509]: </domain>
Apr 14 10:47:29 user nova-compute[71509]:  {{(pid=71509) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 10:47:29 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] Instance destroyed successfully.
Apr 14 10:47:29 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:47:29 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:47:29 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-8363d7be-a77e-4ce4-8967-91d30673b0f1 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] No BDM found with device name vda, not building metadata. {{(pid=71509) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 10:47:29 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-8363d7be-a77e-4ce4-8967-91d30673b0f1 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71509) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 10:47:29 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-8363d7be-a77e-4ce4-8967-91d30673b0f1 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] No VIF found with MAC fa:16:3e:75:ba:ae, not building metadata {{(pid=71509) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 10:47:30 user nova-compute[71509]: DEBUG nova.network.neutron [req-119c683a-9b6d-41fd-8682-33568c40e209 req-66466de0-7924-44be-827a-6281ac23c4c7 service nova] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Updated VIF entry in instance network info cache for port 473d9af8-25a0-4e5a-9afb-7a0c843115cc. {{(pid=71509) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 10:47:30 user nova-compute[71509]: DEBUG nova.network.neutron [req-119c683a-9b6d-41fd-8682-33568c40e209 req-66466de0-7924-44be-827a-6281ac23c4c7 service nova] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Updating instance_info_cache with network_info: [{"id": "473d9af8-25a0-4e5a-9afb-7a0c843115cc", "address": "fa:16:3e:b0:12:bf", "network": {"id": "653f0c81-1afd-4ca6-9639-675ead1a6127", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-932652547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb9b9fc4f2e244879502006bb844761c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap473d9af8-25", "ovs_interfaceid": "473d9af8-25a0-4e5a-9afb-7a0c843115cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:47:30 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-119c683a-9b6d-41fd-8682-33568c40e209 req-66466de0-7924-44be-827a-6281ac23c4c7 service nova] Releasing lock "refresh_cache-8586a70e-9855-4177-ac1b-cf707a4df871" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:47:30 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-749df4c9-936e-4b4e-a727-35fc33e58450 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Acquiring lock "39586d44-1d8e-4607-ab4d-c03a7d841606" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:47:30 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-749df4c9-936e-4b4e-a727-35fc33e58450 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Lock "39586d44-1d8e-4607-ab4d-c03a7d841606" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:47:30 user nova-compute[71509]: INFO nova.compute.manager [None req-749df4c9-936e-4b4e-a727-35fc33e58450 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Unshelving
Apr 14 10:47:30 user nova-compute[71509]: INFO nova.virt.block_device [None req-749df4c9-936e-4b4e-a727-35fc33e58450 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Booting with volume 5647685a-aec6-4498-b1b4-372602a4c7ee at /dev/vda
Apr 14 10:47:30 user nova-compute[71509]: DEBUG nova.compute.manager [req-0dcbe4d7-af44-41d5-8c4c-5e18cb2e19a5 req-d41716ff-75ca-419c-8bd4-3c3ee22db402 service nova] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] Received event network-vif-unplugged-270b85b0-1832-4118-a8b0-ff784587b58a {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:47:30 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-0dcbe4d7-af44-41d5-8c4c-5e18cb2e19a5 req-d41716ff-75ca-419c-8bd4-3c3ee22db402 service nova] Acquiring lock "97f20661-8b60-439e-b7af-2fc2013c5ade-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:47:30 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-0dcbe4d7-af44-41d5-8c4c-5e18cb2e19a5 req-d41716ff-75ca-419c-8bd4-3c3ee22db402 service nova] Lock "97f20661-8b60-439e-b7af-2fc2013c5ade-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:47:30 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-0dcbe4d7-af44-41d5-8c4c-5e18cb2e19a5 req-d41716ff-75ca-419c-8bd4-3c3ee22db402 service nova] Lock "97f20661-8b60-439e-b7af-2fc2013c5ade-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:47:30 user nova-compute[71509]: DEBUG nova.compute.manager [req-0dcbe4d7-af44-41d5-8c4c-5e18cb2e19a5 req-d41716ff-75ca-419c-8bd4-3c3ee22db402 service nova] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] No waiting events found dispatching network-vif-unplugged-270b85b0-1832-4118-a8b0-ff784587b58a {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:47:30 user nova-compute[71509]: WARNING nova.compute.manager [req-0dcbe4d7-af44-41d5-8c4c-5e18cb2e19a5 req-d41716ff-75ca-419c-8bd4-3c3ee22db402 service nova] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] Received unexpected event network-vif-unplugged-270b85b0-1832-4118-a8b0-ff784587b58a for instance with vm_state active and task_state rescuing.
Apr 14 10:47:30 user nova-compute[71509]: DEBUG nova.compute.manager [req-0dcbe4d7-af44-41d5-8c4c-5e18cb2e19a5 req-d41716ff-75ca-419c-8bd4-3c3ee22db402 service nova] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] Received event network-vif-plugged-270b85b0-1832-4118-a8b0-ff784587b58a {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:47:30 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-0dcbe4d7-af44-41d5-8c4c-5e18cb2e19a5 req-d41716ff-75ca-419c-8bd4-3c3ee22db402 service nova] Acquiring lock "97f20661-8b60-439e-b7af-2fc2013c5ade-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:47:30 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-0dcbe4d7-af44-41d5-8c4c-5e18cb2e19a5 req-d41716ff-75ca-419c-8bd4-3c3ee22db402 service nova] Lock "97f20661-8b60-439e-b7af-2fc2013c5ade-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:47:30 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-0dcbe4d7-af44-41d5-8c4c-5e18cb2e19a5 req-d41716ff-75ca-419c-8bd4-3c3ee22db402 service nova] Lock "97f20661-8b60-439e-b7af-2fc2013c5ade-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:47:30 user nova-compute[71509]: DEBUG nova.compute.manager [req-0dcbe4d7-af44-41d5-8c4c-5e18cb2e19a5 req-d41716ff-75ca-419c-8bd4-3c3ee22db402 service nova] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] No waiting events found dispatching network-vif-plugged-270b85b0-1832-4118-a8b0-ff784587b58a {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:47:30 user nova-compute[71509]: WARNING nova.compute.manager [req-0dcbe4d7-af44-41d5-8c4c-5e18cb2e19a5 req-d41716ff-75ca-419c-8bd4-3c3ee22db402 service nova] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] Received unexpected event network-vif-plugged-270b85b0-1832-4118-a8b0-ff784587b58a for instance with vm_state active and task_state rescuing.
Apr 14 10:47:30 user nova-compute[71509]: DEBUG nova.compute.manager [req-0dcbe4d7-af44-41d5-8c4c-5e18cb2e19a5 req-d41716ff-75ca-419c-8bd4-3c3ee22db402 service nova] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] Received event network-vif-plugged-270b85b0-1832-4118-a8b0-ff784587b58a {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:47:30 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-0dcbe4d7-af44-41d5-8c4c-5e18cb2e19a5 req-d41716ff-75ca-419c-8bd4-3c3ee22db402 service nova] Acquiring lock "97f20661-8b60-439e-b7af-2fc2013c5ade-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:47:30 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-0dcbe4d7-af44-41d5-8c4c-5e18cb2e19a5 req-d41716ff-75ca-419c-8bd4-3c3ee22db402 service nova] Lock "97f20661-8b60-439e-b7af-2fc2013c5ade-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:47:30 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-0dcbe4d7-af44-41d5-8c4c-5e18cb2e19a5 req-d41716ff-75ca-419c-8bd4-3c3ee22db402 service nova] Lock "97f20661-8b60-439e-b7af-2fc2013c5ade-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:47:30 user nova-compute[71509]: DEBUG nova.compute.manager [req-0dcbe4d7-af44-41d5-8c4c-5e18cb2e19a5 req-d41716ff-75ca-419c-8bd4-3c3ee22db402 service nova] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] No waiting events found dispatching network-vif-plugged-270b85b0-1832-4118-a8b0-ff784587b58a {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:47:30 user nova-compute[71509]: WARNING nova.compute.manager [req-0dcbe4d7-af44-41d5-8c4c-5e18cb2e19a5 req-d41716ff-75ca-419c-8bd4-3c3ee22db402 service nova] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] Received unexpected event network-vif-plugged-270b85b0-1832-4118-a8b0-ff784587b58a for instance with vm_state active and task_state rescuing.
Apr 14 10:47:30 user nova-compute[71509]: DEBUG nova.compute.manager [req-0dcbe4d7-af44-41d5-8c4c-5e18cb2e19a5 req-d41716ff-75ca-419c-8bd4-3c3ee22db402 service nova] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] Received event network-vif-plugged-270b85b0-1832-4118-a8b0-ff784587b58a {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:47:30 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-0dcbe4d7-af44-41d5-8c4c-5e18cb2e19a5 req-d41716ff-75ca-419c-8bd4-3c3ee22db402 service nova] Acquiring lock "97f20661-8b60-439e-b7af-2fc2013c5ade-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:47:30 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-0dcbe4d7-af44-41d5-8c4c-5e18cb2e19a5 req-d41716ff-75ca-419c-8bd4-3c3ee22db402 service nova] Lock "97f20661-8b60-439e-b7af-2fc2013c5ade-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:47:30 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-0dcbe4d7-af44-41d5-8c4c-5e18cb2e19a5 req-d41716ff-75ca-419c-8bd4-3c3ee22db402 service nova] Lock "97f20661-8b60-439e-b7af-2fc2013c5ade-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:47:30 user nova-compute[71509]: DEBUG nova.compute.manager [req-0dcbe4d7-af44-41d5-8c4c-5e18cb2e19a5 req-d41716ff-75ca-419c-8bd4-3c3ee22db402 service nova] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] No waiting events found dispatching network-vif-plugged-270b85b0-1832-4118-a8b0-ff784587b58a {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:47:30 user nova-compute[71509]: WARNING nova.compute.manager [req-0dcbe4d7-af44-41d5-8c4c-5e18cb2e19a5 req-d41716ff-75ca-419c-8bd4-3c3ee22db402 service nova] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] Received unexpected event network-vif-plugged-270b85b0-1832-4118-a8b0-ff784587b58a for instance with vm_state active and task_state rescuing.
Apr 14 10:47:30 user nova-compute[71509]: DEBUG nova.compute.manager [req-0dcbe4d7-af44-41d5-8c4c-5e18cb2e19a5 req-d41716ff-75ca-419c-8bd4-3c3ee22db402 service nova] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] Received event network-vif-unplugged-270b85b0-1832-4118-a8b0-ff784587b58a {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:47:30 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-0dcbe4d7-af44-41d5-8c4c-5e18cb2e19a5 req-d41716ff-75ca-419c-8bd4-3c3ee22db402 service nova] Acquiring lock "97f20661-8b60-439e-b7af-2fc2013c5ade-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:47:30 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-0dcbe4d7-af44-41d5-8c4c-5e18cb2e19a5 req-d41716ff-75ca-419c-8bd4-3c3ee22db402 service nova] Lock "97f20661-8b60-439e-b7af-2fc2013c5ade-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:47:30 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-0dcbe4d7-af44-41d5-8c4c-5e18cb2e19a5 req-d41716ff-75ca-419c-8bd4-3c3ee22db402 service nova] Lock "97f20661-8b60-439e-b7af-2fc2013c5ade-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:47:30 user nova-compute[71509]: DEBUG nova.compute.manager [req-0dcbe4d7-af44-41d5-8c4c-5e18cb2e19a5 req-d41716ff-75ca-419c-8bd4-3c3ee22db402 service nova] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] No waiting events found dispatching network-vif-unplugged-270b85b0-1832-4118-a8b0-ff784587b58a {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:47:30 user nova-compute[71509]: WARNING nova.compute.manager [req-0dcbe4d7-af44-41d5-8c4c-5e18cb2e19a5 req-d41716ff-75ca-419c-8bd4-3c3ee22db402 service nova] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] Received unexpected event network-vif-unplugged-270b85b0-1832-4118-a8b0-ff784587b58a for instance with vm_state active and task_state rescuing.
Apr 14 10:47:30 user nova-compute[71509]: DEBUG os_brick.utils [None req-749df4c9-936e-4b4e-a727-35fc33e58450 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 10:47:30 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:47:30 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:47:30 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[db08c5f3-a6c6-47b2-aa9b-c9759f4b1b98]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50119df3c417\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:47:30 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:47:30 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:47:30 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[31549aac-5447-41ea-9c8b-0f16fcad5218]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:47:30 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:47:30 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:47:30 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[77a7ebc4-6912-4888-9881-8fb23a30f949]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:47:30 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed90ccdf-6dc4-4ea5-bdaf-33d535d8c006]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:47:30 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-749df4c9-936e-4b4e-a727-35fc33e58450 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Running cmd (subprocess): nvme version {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:47:30 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-749df4c9-936e-4b4e-a727-35fc33e58450 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] 'nvme version' failed. Not Retrying. {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 10:47:30 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.nvmeof [None req-749df4c9-936e-4b4e-a727-35fc33e58450 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] nvme not present on system {{(pid=71509) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 10:47:30 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:47:30 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 10:47:30 user nova-compute[71509]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 10:47:30 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[084bf6e0-a46c-4a99-b657-f68b54ea8fd4]: (4, '') {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:47:30 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-749df4c9-936e-4b4e-a727-35fc33e58450 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71509) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 10:47:30 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-749df4c9-936e-4b4e-a727-35fc33e58450 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71509) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 10:47:30 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-749df4c9-936e-4b4e-a727-35fc33e58450 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] LIGHTOS: no hostnqn found. {{(pid=71509) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 10:47:30 user nova-compute[71509]: DEBUG os_brick.utils [None req-749df4c9-936e-4b4e-a727-35fc33e58450 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50119df3c417', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 10:47:30 user nova-compute[71509]: DEBUG nova.virt.block_device [None req-749df4c9-936e-4b4e-a727-35fc33e58450 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Updating existing volume attachment record: 89f07ff4-6d50-498c-a004-6f4e0dc8babb {{(pid=71509) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 10:47:31 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:47:31 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:47:31 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:47:31 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:47:31 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:47:32 user nova-compute[71509]: DEBUG nova.compute.manager [req-90fd2b0a-0ad3-4821-9039-f0776b1fe5ac req-dc990553-17aa-4a2a-8652-0d25ee76ebb2 service nova] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Received event network-vif-plugged-473d9af8-25a0-4e5a-9afb-7a0c843115cc {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:47:32 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-90fd2b0a-0ad3-4821-9039-f0776b1fe5ac req-dc990553-17aa-4a2a-8652-0d25ee76ebb2 service nova] Acquiring lock "8586a70e-9855-4177-ac1b-cf707a4df871-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:47:32 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-90fd2b0a-0ad3-4821-9039-f0776b1fe5ac req-dc990553-17aa-4a2a-8652-0d25ee76ebb2 service nova] Lock "8586a70e-9855-4177-ac1b-cf707a4df871-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:47:32 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-90fd2b0a-0ad3-4821-9039-f0776b1fe5ac req-dc990553-17aa-4a2a-8652-0d25ee76ebb2 service nova] Lock "8586a70e-9855-4177-ac1b-cf707a4df871-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:47:32 user nova-compute[71509]: DEBUG nova.compute.manager [req-90fd2b0a-0ad3-4821-9039-f0776b1fe5ac req-dc990553-17aa-4a2a-8652-0d25ee76ebb2 service nova] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] No waiting events found dispatching network-vif-plugged-473d9af8-25a0-4e5a-9afb-7a0c843115cc {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:47:32 user nova-compute[71509]: WARNING nova.compute.manager [req-90fd2b0a-0ad3-4821-9039-f0776b1fe5ac req-dc990553-17aa-4a2a-8652-0d25ee76ebb2 service nova] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Received unexpected event network-vif-plugged-473d9af8-25a0-4e5a-9afb-7a0c843115cc for instance with vm_state building and task_state spawning.
Apr 14 10:47:32 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:47:32 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:47:32 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:47:32 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:47:32 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:47:32 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:47:32 user nova-compute[71509]: DEBUG nova.compute.manager [req-23a6df7b-b149-4c71-9eae-636ef41ba672 req-4d31faec-c9a3-4ed1-9a29-318a15d78afe service nova] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] Received event network-vif-plugged-270b85b0-1832-4118-a8b0-ff784587b58a {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:47:32 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-23a6df7b-b149-4c71-9eae-636ef41ba672 req-4d31faec-c9a3-4ed1-9a29-318a15d78afe service nova] Acquiring lock "97f20661-8b60-439e-b7af-2fc2013c5ade-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:47:32 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-23a6df7b-b149-4c71-9eae-636ef41ba672 req-4d31faec-c9a3-4ed1-9a29-318a15d78afe service nova] Lock "97f20661-8b60-439e-b7af-2fc2013c5ade-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:47:32 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-23a6df7b-b149-4c71-9eae-636ef41ba672 req-4d31faec-c9a3-4ed1-9a29-318a15d78afe service nova] Lock "97f20661-8b60-439e-b7af-2fc2013c5ade-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:47:32 user nova-compute[71509]: DEBUG nova.compute.manager [req-23a6df7b-b149-4c71-9eae-636ef41ba672 req-4d31faec-c9a3-4ed1-9a29-318a15d78afe service nova] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] No waiting events found dispatching network-vif-plugged-270b85b0-1832-4118-a8b0-ff784587b58a {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:47:32 user nova-compute[71509]: WARNING nova.compute.manager [req-23a6df7b-b149-4c71-9eae-636ef41ba672 req-4d31faec-c9a3-4ed1-9a29-318a15d78afe service nova] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] Received unexpected event network-vif-plugged-270b85b0-1832-4118-a8b0-ff784587b58a for instance with vm_state active and task_state rescuing.
Apr 14 10:47:32 user nova-compute[71509]: DEBUG nova.compute.manager [req-23a6df7b-b149-4c71-9eae-636ef41ba672 req-4d31faec-c9a3-4ed1-9a29-318a15d78afe service nova] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] Received event network-vif-plugged-270b85b0-1832-4118-a8b0-ff784587b58a {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:47:32 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-23a6df7b-b149-4c71-9eae-636ef41ba672 req-4d31faec-c9a3-4ed1-9a29-318a15d78afe service nova] Acquiring lock "97f20661-8b60-439e-b7af-2fc2013c5ade-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:47:32 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-23a6df7b-b149-4c71-9eae-636ef41ba672 req-4d31faec-c9a3-4ed1-9a29-318a15d78afe service nova] Lock "97f20661-8b60-439e-b7af-2fc2013c5ade-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:47:32 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-23a6df7b-b149-4c71-9eae-636ef41ba672 req-4d31faec-c9a3-4ed1-9a29-318a15d78afe service nova] Lock "97f20661-8b60-439e-b7af-2fc2013c5ade-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:47:32 user nova-compute[71509]: DEBUG nova.compute.manager [req-23a6df7b-b149-4c71-9eae-636ef41ba672 req-4d31faec-c9a3-4ed1-9a29-318a15d78afe service nova] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] No waiting events found dispatching network-vif-plugged-270b85b0-1832-4118-a8b0-ff784587b58a {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:47:32 user nova-compute[71509]: WARNING nova.compute.manager [req-23a6df7b-b149-4c71-9eae-636ef41ba672 req-4d31faec-c9a3-4ed1-9a29-318a15d78afe service nova] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] Received unexpected event network-vif-plugged-270b85b0-1832-4118-a8b0-ff784587b58a for instance with vm_state active and task_state rescuing.
Apr 14 10:47:32 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:47:32 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:47:34 user nova-compute[71509]: DEBUG nova.compute.manager [req-12e7e42a-8a85-4c3f-b4be-03c875200c89 req-fadcda7d-3578-477f-a6aa-253aa8b17bd9 service nova] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Received event network-vif-plugged-473d9af8-25a0-4e5a-9afb-7a0c843115cc {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:47:34 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-12e7e42a-8a85-4c3f-b4be-03c875200c89 req-fadcda7d-3578-477f-a6aa-253aa8b17bd9 service nova] Acquiring lock "8586a70e-9855-4177-ac1b-cf707a4df871-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:47:34 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-12e7e42a-8a85-4c3f-b4be-03c875200c89 req-fadcda7d-3578-477f-a6aa-253aa8b17bd9 service nova] Lock "8586a70e-9855-4177-ac1b-cf707a4df871-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:47:34 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-12e7e42a-8a85-4c3f-b4be-03c875200c89 req-fadcda7d-3578-477f-a6aa-253aa8b17bd9 service nova] Lock "8586a70e-9855-4177-ac1b-cf707a4df871-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:47:34 user nova-compute[71509]: DEBUG nova.compute.manager [req-12e7e42a-8a85-4c3f-b4be-03c875200c89 req-fadcda7d-3578-477f-a6aa-253aa8b17bd9 service nova] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] No waiting events found dispatching network-vif-plugged-473d9af8-25a0-4e5a-9afb-7a0c843115cc {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:47:34 user nova-compute[71509]: WARNING nova.compute.manager [req-12e7e42a-8a85-4c3f-b4be-03c875200c89 req-fadcda7d-3578-477f-a6aa-253aa8b17bd9 service nova] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Received unexpected event network-vif-plugged-473d9af8-25a0-4e5a-9afb-7a0c843115cc for instance with vm_state building and task_state spawning.
Apr 14 10:47:34 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:47:34 user nova-compute[71509]: DEBUG nova.compute.manager [req-c744ade3-37ac-4aa1-8072-c53febd796b0 req-dc379306-1065-44b7-a335-76a547074f1e service nova] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] Received event network-vif-plugged-270b85b0-1832-4118-a8b0-ff784587b58a {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:47:34 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-c744ade3-37ac-4aa1-8072-c53febd796b0 req-dc379306-1065-44b7-a335-76a547074f1e service nova] Acquiring lock "97f20661-8b60-439e-b7af-2fc2013c5ade-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:47:34 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-c744ade3-37ac-4aa1-8072-c53febd796b0 req-dc379306-1065-44b7-a335-76a547074f1e service nova] Lock "97f20661-8b60-439e-b7af-2fc2013c5ade-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:47:34 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-c744ade3-37ac-4aa1-8072-c53febd796b0 req-dc379306-1065-44b7-a335-76a547074f1e service nova] Lock "97f20661-8b60-439e-b7af-2fc2013c5ade-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:47:34 user nova-compute[71509]: DEBUG nova.compute.manager [req-c744ade3-37ac-4aa1-8072-c53febd796b0 req-dc379306-1065-44b7-a335-76a547074f1e service nova] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] No waiting events found dispatching network-vif-plugged-270b85b0-1832-4118-a8b0-ff784587b58a {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:47:34 user nova-compute[71509]: WARNING nova.compute.manager [req-c744ade3-37ac-4aa1-8072-c53febd796b0 req-dc379306-1065-44b7-a335-76a547074f1e service nova] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] Received unexpected event network-vif-plugged-270b85b0-1832-4118-a8b0-ff784587b58a for instance with vm_state active and task_state rescuing.
Apr 14 10:47:34 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:47:34 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:47:34 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:47:34 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:47:34 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:47:34 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:47:34 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71509) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 10:47:35 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681469255.028769, 8586a70e-9855-4177-ac1b-cf707a4df871 => Resumed> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 10:47:35 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] VM Resumed (Lifecycle Event)
Apr 14 10:47:35 user nova-compute[71509]: DEBUG nova.compute.manager [None req-e4e2d8e2-9b42-411e-8a82-e11c6fa0e7ef tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Instance event wait completed in 0 seconds for  {{(pid=71509) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 10:47:35 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-e4e2d8e2-9b42-411e-8a82-e11c6fa0e7ef tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Guest created on hypervisor {{(pid=71509) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 10:47:35 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Instance spawned successfully.
Apr 14 10:47:35 user nova-compute[71509]: DEBUG nova.compute.manager [None req-8363d7be-a77e-4ce4-8967-91d30673b0f1 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:47:35 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-e4e2d8e2-9b42-411e-8a82-e11c6fa0e7ef tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 10:47:35 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:47:35 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 10:47:35 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-e4e2d8e2-9b42-411e-8a82-e11c6fa0e7ef tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Found default for hw_cdrom_bus of ide {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:47:35 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-e4e2d8e2-9b42-411e-8a82-e11c6fa0e7ef tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Found default for hw_disk_bus of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:47:35 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-e4e2d8e2-9b42-411e-8a82-e11c6fa0e7ef tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Found default for hw_input_bus of None {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:47:35 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-e4e2d8e2-9b42-411e-8a82-e11c6fa0e7ef tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Found default for hw_pointer_model of None {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:47:35 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-e4e2d8e2-9b42-411e-8a82-e11c6fa0e7ef tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Found default for hw_video_model of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:47:35 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-e4e2d8e2-9b42-411e-8a82-e11c6fa0e7ef tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Found default for hw_vif_model of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:47:35 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 10:47:35 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681469255.0399199, 8586a70e-9855-4177-ac1b-cf707a4df871 => Started> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 10:47:35 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] VM Started (Lifecycle Event)
Apr 14 10:47:35 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:47:35 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 10:47:35 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 10:47:35 user nova-compute[71509]: DEBUG nova.virt.libvirt.host [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Removed pending event for 97f20661-8b60-439e-b7af-2fc2013c5ade due to event {{(pid=71509) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 10:47:35 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681469255.0451937, 97f20661-8b60-439e-b7af-2fc2013c5ade => Resumed> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 10:47:35 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] VM Resumed (Lifecycle Event)
Apr 14 10:47:35 user nova-compute[71509]: INFO nova.compute.manager [None req-e4e2d8e2-9b42-411e-8a82-e11c6fa0e7ef tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Took 9.31 seconds to spawn the instance on the hypervisor.
Apr 14 10:47:35 user nova-compute[71509]: DEBUG nova.compute.manager [None req-e4e2d8e2-9b42-411e-8a82-e11c6fa0e7ef tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:47:35 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:47:35 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 10:47:35 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681469255.0462432, 97f20661-8b60-439e-b7af-2fc2013c5ade => Started> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 10:47:35 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] VM Started (Lifecycle Event)
Apr 14 10:47:35 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:47:35 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 10:47:35 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:47:35 user nova-compute[71509]: INFO nova.compute.manager [None req-e4e2d8e2-9b42-411e-8a82-e11c6fa0e7ef tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Took 10.22 seconds to build instance.
Apr 14 10:47:35 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-e4e2d8e2-9b42-411e-8a82-e11c6fa0e7ef tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "8586a70e-9855-4177-ac1b-cf707a4df871" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.369s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:47:36 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:47:36 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Starting heal instance info cache {{(pid=71509) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 10:47:36 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-749df4c9-936e-4b4e-a727-35fc33e58450 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:47:36 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-749df4c9-936e-4b4e-a727-35fc33e58450 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:47:36 user nova-compute[71509]: DEBUG nova.objects.instance [None req-749df4c9-936e-4b4e-a727-35fc33e58450 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Lazy-loading 'pci_requests' on Instance uuid 39586d44-1d8e-4607-ab4d-c03a7d841606 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:47:36 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "refresh_cache-0e6c800c-9b35-4e35-969e-c40367056dce" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:47:36 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquired lock "refresh_cache-0e6c800c-9b35-4e35-969e-c40367056dce" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:47:36 user nova-compute[71509]: DEBUG nova.network.neutron [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Forcefully refreshing network info cache for instance {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 10:47:36 user nova-compute[71509]: DEBUG nova.objects.instance [None req-749df4c9-936e-4b4e-a727-35fc33e58450 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Lazy-loading 'numa_topology' on Instance uuid 39586d44-1d8e-4607-ab4d-c03a7d841606 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:47:36 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-749df4c9-936e-4b4e-a727-35fc33e58450 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71509) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 10:47:36 user nova-compute[71509]: INFO nova.compute.claims [None req-749df4c9-936e-4b4e-a727-35fc33e58450 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Claim successful on node user
Apr 14 10:47:37 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-749df4c9-936e-4b4e-a727-35fc33e58450 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 10:47:37 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-749df4c9-936e-4b4e-a727-35fc33e58450 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 10:47:37 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-749df4c9-936e-4b4e-a727-35fc33e58450 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.711s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:47:37 user nova-compute[71509]: INFO nova.network.neutron [None req-749df4c9-936e-4b4e-a727-35fc33e58450 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Updating port 6099437e-5607-4a06-abcb-15d465c7ecf8 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Apr 14 10:47:37 user nova-compute[71509]: DEBUG nova.network.neutron [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Updating instance_info_cache with network_info: [{"id": "49978689-84ce-4422-add9-9bb12f628c37", "address": "fa:16:3e:a6:47:fc", "network": {"id": "9040ebc7-4d6b-4fd2-8543-f22ca3fb249c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2098664740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "482809b9148e408b84b156802a21a225", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49978689-84", "ovs_interfaceid": "49978689-84ce-4422-add9-9bb12f628c37", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:47:37 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Releasing lock "refresh_cache-0e6c800c-9b35-4e35-969e-c40367056dce" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:47:37 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Updated the network info_cache for instance {{(pid=71509) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 10:47:37 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:47:38 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-749df4c9-936e-4b4e-a727-35fc33e58450 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Acquiring lock "refresh_cache-39586d44-1d8e-4607-ab4d-c03a7d841606" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:47:38 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-749df4c9-936e-4b4e-a727-35fc33e58450 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Acquired lock "refresh_cache-39586d44-1d8e-4607-ab4d-c03a7d841606" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:47:38 user nova-compute[71509]: DEBUG nova.network.neutron [None req-749df4c9-936e-4b4e-a727-35fc33e58450 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Building network info cache for instance {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 10:47:38 user nova-compute[71509]: DEBUG nova.compute.manager [req-49fecfb9-ef96-49ca-85d6-c8a88527b9f1 req-8503e752-f72f-4e4e-88c9-589886d173a1 service nova] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Received event network-changed-6099437e-5607-4a06-abcb-15d465c7ecf8 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:47:38 user nova-compute[71509]: DEBUG nova.compute.manager [req-49fecfb9-ef96-49ca-85d6-c8a88527b9f1 req-8503e752-f72f-4e4e-88c9-589886d173a1 service nova] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Refreshing instance network info cache due to event network-changed-6099437e-5607-4a06-abcb-15d465c7ecf8. {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 10:47:38 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-49fecfb9-ef96-49ca-85d6-c8a88527b9f1 req-8503e752-f72f-4e4e-88c9-589886d173a1 service nova] Acquiring lock "refresh_cache-39586d44-1d8e-4607-ab4d-c03a7d841606" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:47:39 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:47:39 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:47:39 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:47:39 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:47:39 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:47:39 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Auditing locally available compute resources for user (node: user) {{(pid=71509) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 10:47:39 user nova-compute[71509]: DEBUG nova.network.neutron [None req-749df4c9-936e-4b4e-a727-35fc33e58450 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Updating instance_info_cache with network_info: [{"id": "6099437e-5607-4a06-abcb-15d465c7ecf8", "address": "fa:16:3e:4b:6c:e7", "network": {"id": "69274626-4a94-46d8-be28-534a98fb6817", "bridge": "br-int", "label": "tempest-TestShelveInstance-480849665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "340e1e1695464eb5ad8a8c881cf24611", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6099437e-56", "ovs_interfaceid": "6099437e-5607-4a06-abcb-15d465c7ecf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:47:39 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-dd22a66c-5e48-4f49-8a88-58d4a82d2838 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Acquiring lock "203b622c-9e6d-4ac7-a3fa-9f9c82ef3108" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:47:39 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-dd22a66c-5e48-4f49-8a88-58d4a82d2838 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Lock "203b622c-9e6d-4ac7-a3fa-9f9c82ef3108" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:47:39 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-749df4c9-936e-4b4e-a727-35fc33e58450 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Releasing lock "refresh_cache-39586d44-1d8e-4607-ab4d-c03a7d841606" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:47:39 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-749df4c9-936e-4b4e-a727-35fc33e58450 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Creating instance directory {{(pid=71509) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 10:47:39 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-749df4c9-936e-4b4e-a727-35fc33e58450 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Creating image(s)
Apr 14 10:47:39 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-749df4c9-936e-4b4e-a727-35fc33e58450 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Did not create local disks {{(pid=71509) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 10:47:39 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-749df4c9-936e-4b4e-a727-35fc33e58450 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Ensure instance console log exists: /opt/stack/data/nova/instances/39586d44-1d8e-4607-ab4d-c03a7d841606/console.log {{(pid=71509) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 10:47:39 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-749df4c9-936e-4b4e-a727-35fc33e58450 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:47:39 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-749df4c9-936e-4b4e-a727-35fc33e58450 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:47:39 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-749df4c9-936e-4b4e-a727-35fc33e58450 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:47:39 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-749df4c9-936e-4b4e-a727-35fc33e58450 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Start _get_guest_xml network_info=[{"id": "6099437e-5607-4a06-abcb-15d465c7ecf8", "address": "fa:16:3e:4b:6c:e7", "network": {"id": "69274626-4a94-46d8-be28-534a98fb6817", "bridge": "br-int", "label": "tempest-TestShelveInstance-480849665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "340e1e1695464eb5ad8a8c881cf24611", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6099437e-56", "ovs_interfaceid": "6099437e-5607-4a06-abcb-15d465c7ecf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'attachment_id': '89f07ff4-6d50-498c-a004-6f4e0dc8babb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xzHUpiIh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '39586d44-1d8e-4607-ab4d-c03a7d841606', 'attached_at': '', 'detached_at': '', 'volume_id': '5647685a-aec6-4498-b1b4-372602a4c7ee', 'serial': '5647685a-aec6-4498-b1b4-372602a4c7ee'}, 'disk_bus': 'virtio', 'delete_on_termination': True, 'volume_type': None} {{(pid=71509) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 10:47:39 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-49fecfb9-ef96-49ca-85d6-c8a88527b9f1 req-8503e752-f72f-4e4e-88c9-589886d173a1 service nova] Acquired lock "refresh_cache-39586d44-1d8e-4607-ab4d-c03a7d841606" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:47:39 user nova-compute[71509]: DEBUG nova.network.neutron [req-49fecfb9-ef96-49ca-85d6-c8a88527b9f1 req-8503e752-f72f-4e4e-88c9-589886d173a1 service nova] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Refreshing network info cache for port 6099437e-5607-4a06-abcb-15d465c7ecf8 {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 10:47:39 user nova-compute[71509]: DEBUG nova.compute.manager [None req-dd22a66c-5e48-4f49-8a88-58d4a82d2838 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] [instance: 203b622c-9e6d-4ac7-a3fa-9f9c82ef3108] Starting instance... {{(pid=71509) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 10:47:39 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-749df4c9-936e-4b4e-a727-35fc33e58450 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:47:39 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-749df4c9-936e-4b4e-a727-35fc33e58450 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:47:39 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-749df4c9-936e-4b4e-a727-35fc33e58450 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71509) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 10:47:39 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-749df4c9-936e-4b4e-a727-35fc33e58450 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T10:40:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 10:47:39 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-749df4c9-936e-4b4e-a727-35fc33e58450 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Flavor limits 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 10:47:39 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-749df4c9-936e-4b4e-a727-35fc33e58450 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Image limits 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 10:47:39 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-749df4c9-936e-4b4e-a727-35fc33e58450 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Flavor pref 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 10:47:39 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-749df4c9-936e-4b4e-a727-35fc33e58450 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Image pref 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 10:47:39 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-749df4c9-936e-4b4e-a727-35fc33e58450 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 10:47:39 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-749df4c9-936e-4b4e-a727-35fc33e58450 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 10:47:39 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-749df4c9-936e-4b4e-a727-35fc33e58450 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71509) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 10:47:39 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-749df4c9-936e-4b4e-a727-35fc33e58450 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Got 1 possible topologies {{(pid=71509) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 10:47:39 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-749df4c9-936e-4b4e-a727-35fc33e58450 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 10:47:39 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-749df4c9-936e-4b4e-a727-35fc33e58450 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 10:47:39 user nova-compute[71509]: DEBUG nova.objects.instance [None req-749df4c9-936e-4b4e-a727-35fc33e58450 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Lazy-loading 'vcpu_model' on Instance uuid 39586d44-1d8e-4607-ab4d-c03a7d841606 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:47:39 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-749df4c9-936e-4b4e-a727-35fc33e58450 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Calling os-brick to attach iSCSI Volume {{(pid=71509) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 10:47:39 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-749df4c9-936e-4b4e-a727-35fc33e58450 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0bf0749390>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xzHUpiIh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 10:47:39 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-749df4c9-936e-4b4e-a727-35fc33e58450 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 10:47:39 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-749df4c9-936e-4b4e-a727-35fc33e58450 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 10:47:39 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-749df4c9-936e-4b4e-a727-35fc33e58450 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 10:47:39 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-749df4c9-936e-4b4e-a727-35fc33e58450 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 10:47:39 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-749df4c9-936e-4b4e-a727-35fc33e58450 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 10:47:39 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-749df4c9-936e-4b4e-a727-35fc33e58450 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 10:47:39 user nova-compute[71509]: INFO os_brick.initiator.connectors.iscsi [None req-749df4c9-936e-4b4e-a727-35fc33e58450 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 10:47:39 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee -p 172.16.0.220:3260 {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:47:39 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:47:39 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8849a27-3177-4fdd-b55a-d419fffe57b0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:47:39 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-749df4c9-936e-4b4e-a727-35fc33e58450 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 10:47:39 user nova-compute[71509]:  {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:47:39 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee -p 172.16.0.220:3260 --interface default --op new {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:47:39 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:47:39 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-dd22a66c-5e48-4f49-8a88-58d4a82d2838 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:47:39 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-dd22a66c-5e48-4f49-8a88-58d4a82d2838 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:47:39 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7dd0a9c-90de-4dd6-9d58-7be51c888e12]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee] added\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:47:39 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-749df4c9-936e-4b4e-a727-35fc33e58450 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee] added
Apr 14 10:47:39 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:47:39 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:47:39 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-dd22a66c-5e48-4f49-8a88-58d4a82d2838 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71509) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 10:47:39 user nova-compute[71509]: INFO nova.compute.claims [None req-dd22a66c-5e48-4f49-8a88-58d4a82d2838 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] [instance: 203b622c-9e6d-4ac7-a3fa-9f9c82ef3108] Claim successful on node user
Apr 14 10:47:39 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:47:39 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d83cc31-6de7-41ef-bfff-942b469676ee]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:47:39 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-749df4c9-936e-4b4e-a727-35fc33e58450 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:47:39 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:47:39 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.039s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:47:39 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9c668c6-7b2f-474e-b9b1-72f8493d6a22]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:47:39 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-749df4c9-936e-4b4e-a727-35fc33e58450 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:47:39 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xzHUpiIh {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:47:39 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xzHUpiIh" returned: 0 in 0.032s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:47:39 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[661a6cb3-af77-43a1-9e8e-0361855b1e52]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:47:39 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-749df4c9-936e-4b4e-a727-35fc33e58450 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xzHUpiIh'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:47:39 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:47:39 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:47:39 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[db159269-668a-4697-86ff-b20476692233]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:47:39 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-749df4c9-936e-4b4e-a727-35fc33e58450 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:47:39 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:47:39 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97820f17-22d1-4ec3-9721-1edadccc794a/disk.rescue --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:47:39 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:47:39 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[f203a5ef-2e43-4644-ab7a-0e4da825cd9f]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4116efc6-988f-40cf-af06-2abf9c6cd44a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:47:39 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-749df4c9-936e-4b4e-a727-35fc33e58450 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4116efc6-988f-40cf-af06-2abf9c6cd44a (non-flash)
Apr 14 10:47:39 user nova-compute[71509]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d (non-flash)
Apr 14 10:47:39 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:47:39 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-749df4c9-936e-4b4e-a727-35fc33e58450 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4116efc6-988f-40cf-af06-2abf9c6cd44a (non-flash)
Apr 14 10:47:39 user nova-compute[71509]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d (non-flash)
Apr 14 10:47:39 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 10:47:39 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee -p 172.16.0.220:3260 --login {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:47:40 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee -p 172.16.0.220:3260 --login" returned: 0 in 0.089s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:47:40 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeb8d797-8e37-4ba4-999b-07011eda9f1e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:47:40 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-749df4c9-936e-4b4e-a727-35fc33e58450 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee, portal: 172.16.0.220,3260]
Apr 14 10:47:40 user nova-compute[71509]: Login to [iface: default, target: iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee, portal: 172.16.0.220,3260] successful.
Apr 14 10:47:40 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:47:40 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:47:40 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:47:40 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c070b16-86c6-4096-b2be-2d20602e5aaf]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:47:40 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-749df4c9-936e-4b4e-a727-35fc33e58450 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:47:40 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:47:40 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:47:40 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[56e87a89-8d0e-4b37-a71d-cf447fe9418f]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4116efc6-988f-40cf-af06-2abf9c6cd44a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:47:40 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97820f17-22d1-4ec3-9721-1edadccc794a/disk.rescue --force-share --output=json" returned: 0 in 0.214s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:47:40 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-749df4c9-936e-4b4e-a727-35fc33e58450 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4116efc6-988f-40cf-af06-2abf9c6cd44a (non-flash)
Apr 14 10:47:40 user nova-compute[71509]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d (non-flash)
Apr 14 10:47:40 user nova-compute[71509]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee (non-flash)
Apr 14 10:47:40 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:47:40 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-749df4c9-936e-4b4e-a727-35fc33e58450 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4116efc6-988f-40cf-af06-2abf9c6cd44a (non-flash)
Apr 14 10:47:40 user nova-compute[71509]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d (non-flash)
Apr 14 10:47:40 user nova-compute[71509]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee (non-flash)
Apr 14 10:47:40 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 10:47:40 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-749df4c9-936e-4b4e-a727-35fc33e58450 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.445s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 10:47:40 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-749df4c9-936e-4b4e-a727-35fc33e58450 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Connected to 172.16.0.220:3260 {{(pid=71509) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 10:47:40 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-749df4c9-936e-4b4e-a727-35fc33e58450 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] HCTL ('35', '-', '-', 0) found on session 20 with lun 0 {{(pid=71509) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 10:47:40 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-749df4c9-936e-4b4e-a727-35fc33e58450 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71509) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 10:47:40 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97820f17-22d1-4ec3-9721-1edadccc794a/disk.rescue --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:47:40 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:47:40 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.027s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:47:40 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4ea945d-66f6-4aa3-95a8-988bf753f6bd]: (4, ('- - 0', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:47:40 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-749df4c9-936e-4b4e-a727-35fc33e58450 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Searching for a device in session 20 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71509) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 10:47:40 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-749df4c9-936e-4b4e-a727-35fc33e58450 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xzHUpiIh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71509) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 10:47:40 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97820f17-22d1-4ec3-9721-1edadccc794a/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:47:40 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97820f17-22d1-4ec3-9721-1edadccc794a/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:47:40 user nova-compute[71509]: DEBUG nova.network.neutron [req-49fecfb9-ef96-49ca-85d6-c8a88527b9f1 req-8503e752-f72f-4e4e-88c9-589886d173a1 service nova] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Updated VIF entry in instance network info cache for port 6099437e-5607-4a06-abcb-15d465c7ecf8. {{(pid=71509) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 10:47:40 user nova-compute[71509]: DEBUG nova.network.neutron [req-49fecfb9-ef96-49ca-85d6-c8a88527b9f1 req-8503e752-f72f-4e4e-88c9-589886d173a1 service nova] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Updating instance_info_cache with network_info: [{"id": "6099437e-5607-4a06-abcb-15d465c7ecf8", "address": "fa:16:3e:4b:6c:e7", "network": {"id": "69274626-4a94-46d8-be28-534a98fb6817", "bridge": "br-int", "label": "tempest-TestShelveInstance-480849665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "340e1e1695464eb5ad8a8c881cf24611", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6099437e-56", "ovs_interfaceid": "6099437e-5607-4a06-abcb-15d465c7ecf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:47:40 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-49fecfb9-ef96-49ca-85d6-c8a88527b9f1 req-8503e752-f72f-4e4e-88c9-589886d173a1 service nova] Releasing lock "refresh_cache-39586d44-1d8e-4607-ab4d-c03a7d841606" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:47:40 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-dd22a66c-5e48-4f49-8a88-58d4a82d2838 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 10:47:40 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-dd22a66c-5e48-4f49-8a88-58d4a82d2838 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 10:47:40 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97820f17-22d1-4ec3-9721-1edadccc794a/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:47:40 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97820f17-22d1-4ec3-9721-1edadccc794a/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:47:40 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-dd22a66c-5e48-4f49-8a88-58d4a82d2838 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.889s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:47:40 user nova-compute[71509]: DEBUG nova.compute.manager [None req-dd22a66c-5e48-4f49-8a88-58d4a82d2838 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] [instance: 203b622c-9e6d-4ac7-a3fa-9f9c82ef3108] Start building networks asynchronously for instance. {{(pid=71509) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 10:47:40 user nova-compute[71509]: DEBUG nova.compute.manager [None req-dd22a66c-5e48-4f49-8a88-58d4a82d2838 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] [instance: 203b622c-9e6d-4ac7-a3fa-9f9c82ef3108] Allocating IP information in the background. {{(pid=71509) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 10:47:40 user nova-compute[71509]: DEBUG nova.network.neutron [None req-dd22a66c-5e48-4f49-8a88-58d4a82d2838 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] [instance: 203b622c-9e6d-4ac7-a3fa-9f9c82ef3108] allocate_for_instance() {{(pid=71509) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 10:47:40 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-dd22a66c-5e48-4f49-8a88-58d4a82d2838 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] [instance: 203b622c-9e6d-4ac7-a3fa-9f9c82ef3108] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 10:47:40 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97820f17-22d1-4ec3-9721-1edadccc794a/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:47:40 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b767f1b-e97e-497c-8c70-8806203c76ae/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:47:40 user nova-compute[71509]: DEBUG nova.compute.manager [None req-dd22a66c-5e48-4f49-8a88-58d4a82d2838 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] [instance: 203b622c-9e6d-4ac7-a3fa-9f9c82ef3108] Start building block device mappings for instance. {{(pid=71509) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 10:47:40 user nova-compute[71509]: DEBUG nova.policy [None req-dd22a66c-5e48-4f49-8a88-58d4a82d2838 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ac498c56dae543cf9e64fbb61ad50df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84a2fac4604454982dc018b36440b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71509) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 10:47:40 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b767f1b-e97e-497c-8c70-8806203c76ae/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:47:40 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b767f1b-e97e-497c-8c70-8806203c76ae/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:47:41 user nova-compute[71509]: DEBUG nova.compute.manager [None req-dd22a66c-5e48-4f49-8a88-58d4a82d2838 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] [instance: 203b622c-9e6d-4ac7-a3fa-9f9c82ef3108] Start spawning the instance on the hypervisor. {{(pid=71509) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 10:47:41 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-dd22a66c-5e48-4f49-8a88-58d4a82d2838 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] [instance: 203b622c-9e6d-4ac7-a3fa-9f9c82ef3108] Creating instance directory {{(pid=71509) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 10:47:41 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-dd22a66c-5e48-4f49-8a88-58d4a82d2838 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] [instance: 203b622c-9e6d-4ac7-a3fa-9f9c82ef3108] Creating image(s)
Apr 14 10:47:41 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-dd22a66c-5e48-4f49-8a88-58d4a82d2838 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Acquiring lock "/opt/stack/data/nova/instances/203b622c-9e6d-4ac7-a3fa-9f9c82ef3108/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:47:41 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-dd22a66c-5e48-4f49-8a88-58d4a82d2838 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Lock "/opt/stack/data/nova/instances/203b622c-9e6d-4ac7-a3fa-9f9c82ef3108/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:47:41 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-dd22a66c-5e48-4f49-8a88-58d4a82d2838 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Lock "/opt/stack/data/nova/instances/203b622c-9e6d-4ac7-a3fa-9f9c82ef3108/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:47:41 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-dd22a66c-5e48-4f49-8a88-58d4a82d2838 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:47:41 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b767f1b-e97e-497c-8c70-8806203c76ae/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:47:41 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4abb549-8f36-40c5-971f-8accbb14ff86/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:47:41 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-749df4c9-936e-4b4e-a727-35fc33e58450 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.550s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 10:47:41 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-749df4c9-936e-4b4e-a727-35fc33e58450 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] <== connect_volume: return (1554ms) {'type': 'block', 'scsi_wwn': '23661376633333532', 'path': '/dev/sdd'} {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 10:47:41 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-749df4c9-936e-4b4e-a727-35fc33e58450 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23661376633333532', 'path': '/dev/sdd'} {{(pid=71509) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 10:47:41 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-dd22a66c-5e48-4f49-8a88-58d4a82d2838 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json" returned: 0 in 0.195s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:47:41 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-dd22a66c-5e48-4f49-8a88-58d4a82d2838 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Acquiring lock "5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:47:41 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-dd22a66c-5e48-4f49-8a88-58d4a82d2838 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Lock "5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:47:41 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-dd22a66c-5e48-4f49-8a88-58d4a82d2838 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:47:41 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-749df4c9-936e-4b4e-a727-35fc33e58450 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T10:43:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1022992671',display_name='tempest-TestShelveInstance-server-1022992671',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1022992671',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-261961953',keypairs=<?>,launch_index=0,launched_at=2023-04-14T10:44:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='340e1e1695464eb5ad8a8c881cf24611',ramdisk_id='',reservation_id='r-ejwha0rq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1930659141',owner_user_name='tempest-TestShelveInstance-1930659141-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T10:47:30Z,user_data=None,user_id='15c4ab86a8d244c4be5889b4ac47561a',uuid=39586d44-1d8e-4607-ab4d-c03a7d841606,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "6099437e-5607-4a06-abcb-15d465c7ecf8", "address": "fa:16:3e:4b:6c:e7", "network": {"id": "69274626-4a94-46d8-be28-534a98fb6817", "bridge": "br-int", "label": "tempest-TestShelveInstance-480849665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "340e1e1695464eb5ad8a8c881cf24611", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6099437e-56", "ovs_interfaceid": "6099437e-5607-4a06-abcb-15d465c7ecf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71509) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 10:47:41 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-749df4c9-936e-4b4e-a727-35fc33e58450 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Converting VIF {"id": "6099437e-5607-4a06-abcb-15d465c7ecf8", "address": "fa:16:3e:4b:6c:e7", "network": {"id": "69274626-4a94-46d8-be28-534a98fb6817", "bridge": "br-int", "label": "tempest-TestShelveInstance-480849665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "340e1e1695464eb5ad8a8c881cf24611", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6099437e-56", "ovs_interfaceid": "6099437e-5607-4a06-abcb-15d465c7ecf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:47:41 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-749df4c9-936e-4b4e-a727-35fc33e58450 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:6c:e7,bridge_name='br-int',has_traffic_filtering=True,id=6099437e-5607-4a06-abcb-15d465c7ecf8,network=Network(69274626-4a94-46d8-be28-534a98fb6817),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6099437e-56') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:47:41 user nova-compute[71509]: DEBUG nova.objects.instance [None req-749df4c9-936e-4b4e-a727-35fc33e58450 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Lazy-loading 'pci_devices' on Instance uuid 39586d44-1d8e-4607-ab4d-c03a7d841606 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:47:41 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-749df4c9-936e-4b4e-a727-35fc33e58450 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] End _get_guest_xml xml=<domain type="kvm">
Apr 14 10:47:41 user nova-compute[71509]:   <uuid>39586d44-1d8e-4607-ab4d-c03a7d841606</uuid>
Apr 14 10:47:41 user nova-compute[71509]:   <name>instance-0000000a</name>
Apr 14 10:47:41 user nova-compute[71509]:   <memory>131072</memory>
Apr 14 10:47:41 user nova-compute[71509]:   <vcpu>1</vcpu>
Apr 14 10:47:41 user nova-compute[71509]:   <metadata>
Apr 14 10:47:41 user nova-compute[71509]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 10:47:41 user nova-compute[71509]:       <nova:package version="0.0.0"/>
Apr 14 10:47:41 user nova-compute[71509]:       <nova:name>tempest-TestShelveInstance-server-1022992671</nova:name>
Apr 14 10:47:41 user nova-compute[71509]:       <nova:creationTime>2023-04-14 10:47:39</nova:creationTime>
Apr 14 10:47:41 user nova-compute[71509]:       <nova:flavor name="m1.nano">
Apr 14 10:47:41 user nova-compute[71509]:         <nova:memory>128</nova:memory>
Apr 14 10:47:41 user nova-compute[71509]:         <nova:disk>1</nova:disk>
Apr 14 10:47:41 user nova-compute[71509]:         <nova:swap>0</nova:swap>
Apr 14 10:47:41 user nova-compute[71509]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 10:47:41 user nova-compute[71509]:         <nova:vcpus>1</nova:vcpus>
Apr 14 10:47:41 user nova-compute[71509]:       </nova:flavor>
Apr 14 10:47:41 user nova-compute[71509]:       <nova:owner>
Apr 14 10:47:41 user nova-compute[71509]:         <nova:user uuid="15c4ab86a8d244c4be5889b4ac47561a">tempest-TestShelveInstance-1930659141-project-member</nova:user>
Apr 14 10:47:41 user nova-compute[71509]:         <nova:project uuid="340e1e1695464eb5ad8a8c881cf24611">tempest-TestShelveInstance-1930659141</nova:project>
Apr 14 10:47:41 user nova-compute[71509]:       </nova:owner>
Apr 14 10:47:41 user nova-compute[71509]:       <nova:ports>
Apr 14 10:47:41 user nova-compute[71509]:         <nova:port uuid="6099437e-5607-4a06-abcb-15d465c7ecf8">
Apr 14 10:47:41 user nova-compute[71509]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 14 10:47:41 user nova-compute[71509]:         </nova:port>
Apr 14 10:47:41 user nova-compute[71509]:       </nova:ports>
Apr 14 10:47:41 user nova-compute[71509]:     </nova:instance>
Apr 14 10:47:41 user nova-compute[71509]:   </metadata>
Apr 14 10:47:41 user nova-compute[71509]:   <sysinfo type="smbios">
Apr 14 10:47:41 user nova-compute[71509]:     <system>
Apr 14 10:47:41 user nova-compute[71509]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 10:47:41 user nova-compute[71509]:       <entry name="product">OpenStack Nova</entry>
Apr 14 10:47:41 user nova-compute[71509]:       <entry name="version">0.0.0</entry>
Apr 14 10:47:41 user nova-compute[71509]:       <entry name="serial">39586d44-1d8e-4607-ab4d-c03a7d841606</entry>
Apr 14 10:47:41 user nova-compute[71509]:       <entry name="uuid">39586d44-1d8e-4607-ab4d-c03a7d841606</entry>
Apr 14 10:47:41 user nova-compute[71509]:       <entry name="family">Virtual Machine</entry>
Apr 14 10:47:41 user nova-compute[71509]:     </system>
Apr 14 10:47:41 user nova-compute[71509]:   </sysinfo>
Apr 14 10:47:41 user nova-compute[71509]:   <os>
Apr 14 10:47:41 user nova-compute[71509]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 10:47:41 user nova-compute[71509]:     <boot dev="hd"/>
Apr 14 10:47:41 user nova-compute[71509]:     <smbios mode="sysinfo"/>
Apr 14 10:47:41 user nova-compute[71509]:   </os>
Apr 14 10:47:41 user nova-compute[71509]:   <features>
Apr 14 10:47:41 user nova-compute[71509]:     <acpi/>
Apr 14 10:47:41 user nova-compute[71509]:     <apic/>
Apr 14 10:47:41 user nova-compute[71509]:     <vmcoreinfo/>
Apr 14 10:47:41 user nova-compute[71509]:   </features>
Apr 14 10:47:41 user nova-compute[71509]:   <clock offset="utc">
Apr 14 10:47:41 user nova-compute[71509]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 10:47:41 user nova-compute[71509]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 10:47:41 user nova-compute[71509]:     <timer name="hpet" present="no"/>
Apr 14 10:47:41 user nova-compute[71509]:   </clock>
Apr 14 10:47:41 user nova-compute[71509]:   <cpu mode="custom" match="exact">
Apr 14 10:47:41 user nova-compute[71509]:     <model>Nehalem</model>
Apr 14 10:47:41 user nova-compute[71509]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 10:47:41 user nova-compute[71509]:   </cpu>
Apr 14 10:47:41 user nova-compute[71509]:   <devices>
Apr 14 10:47:41 user nova-compute[71509]:     <disk type="block" device="disk">
Apr 14 10:47:41 user nova-compute[71509]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 10:47:41 user nova-compute[71509]:       <source dev="/dev/sdd"/>
Apr 14 10:47:41 user nova-compute[71509]:       <target dev="vda" bus="virtio"/>
Apr 14 10:47:41 user nova-compute[71509]:       <serial>5647685a-aec6-4498-b1b4-372602a4c7ee</serial>
Apr 14 10:47:41 user nova-compute[71509]:     </disk>
Apr 14 10:47:41 user nova-compute[71509]:     <interface type="ethernet">
Apr 14 10:47:41 user nova-compute[71509]:       <mac address="fa:16:3e:4b:6c:e7"/>
Apr 14 10:47:41 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 10:47:41 user nova-compute[71509]:       <mtu size="1442"/>
Apr 14 10:47:41 user nova-compute[71509]:       <target dev="tap6099437e-56"/>
Apr 14 10:47:41 user nova-compute[71509]:     </interface>
Apr 14 10:47:41 user nova-compute[71509]:     <serial type="pty">
Apr 14 10:47:41 user nova-compute[71509]:       <log file="/opt/stack/data/nova/instances/39586d44-1d8e-4607-ab4d-c03a7d841606/console.log" append="off"/>
Apr 14 10:47:41 user nova-compute[71509]:     </serial>
Apr 14 10:47:41 user nova-compute[71509]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 10:47:41 user nova-compute[71509]:     <video>
Apr 14 10:47:41 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 10:47:41 user nova-compute[71509]:     </video>
Apr 14 10:47:41 user nova-compute[71509]:     <rng model="virtio">
Apr 14 10:47:41 user nova-compute[71509]:       <backend model="random">/dev/urandom</backend>
Apr 14 10:47:41 user nova-compute[71509]:     </rng>
Apr 14 10:47:41 user nova-compute[71509]:     <controller type="usb" index="0" model="none"/>
Apr 14 10:47:41 user nova-compute[71509]:     <memballoon model="virtio">
Apr 14 10:47:41 user nova-compute[71509]:       <stats period="10"/>
Apr 14 10:47:41 user nova-compute[71509]:     </memballoon>
Apr 14 10:47:41 user nova-compute[71509]:   </devices>
Apr 14 10:47:41 user nova-compute[71509]: </domain>
Apr 14 10:47:41 user nova-compute[71509]:  {{(pid=71509) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 10:47:41 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-749df4c9-936e-4b4e-a727-35fc33e58450 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T10:43:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1022992671',display_name='tempest-TestShelveInstance-server-1022992671',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1022992671',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-261961953',keypairs=<?>,launch_index=0,launched_at=2023-04-14T10:44:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='340e1e1695464eb5ad8a8c881cf24611',ramdisk_id='',reservation_id='r-ejwha0rq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1930659141',owner_user_name='tempest-TestShelveInstance-1930659141-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T10:47:30Z,user_data=None,user_id='15c4ab86a8d244c4be5889b4ac47561a',uuid=39586d44-1d8e-4607-ab4d-c03a7d841606,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "6099437e-5607-4a06-abcb-15d465c7ecf8", "address": "fa:16:3e:4b:6c:e7", "network": {"id": "69274626-4a94-46d8-be28-534a98fb6817", "bridge": "br-int", "label": "tempest-TestShelveInstance-480849665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "340e1e1695464eb5ad8a8c881cf24611", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6099437e-56", "ovs_interfaceid": "6099437e-5607-4a06-abcb-15d465c7ecf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 10:47:41 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-749df4c9-936e-4b4e-a727-35fc33e58450 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Converting VIF {"id": "6099437e-5607-4a06-abcb-15d465c7ecf8", "address": "fa:16:3e:4b:6c:e7", "network": {"id": "69274626-4a94-46d8-be28-534a98fb6817", "bridge": "br-int", "label": "tempest-TestShelveInstance-480849665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "340e1e1695464eb5ad8a8c881cf24611", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6099437e-56", "ovs_interfaceid": "6099437e-5607-4a06-abcb-15d465c7ecf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:47:41 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-749df4c9-936e-4b4e-a727-35fc33e58450 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:6c:e7,bridge_name='br-int',has_traffic_filtering=True,id=6099437e-5607-4a06-abcb-15d465c7ecf8,network=Network(69274626-4a94-46d8-be28-534a98fb6817),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6099437e-56') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:47:41 user nova-compute[71509]: DEBUG os_vif [None req-749df4c9-936e-4b4e-a727-35fc33e58450 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:6c:e7,bridge_name='br-int',has_traffic_filtering=True,id=6099437e-5607-4a06-abcb-15d465c7ecf8,network=Network(69274626-4a94-46d8-be28-534a98fb6817),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6099437e-56') {{(pid=71509) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 10:47:41 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:47:41 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:47:41 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 10:47:41 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4abb549-8f36-40c5-971f-8accbb14ff86/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:47:41 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4abb549-8f36-40c5-971f-8accbb14ff86/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:47:41 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:47:41 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6099437e-56, may_exist=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:47:41 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6099437e-56, col_values=(('external_ids', {'iface-id': '6099437e-5607-4a06-abcb-15d465c7ecf8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4b:6c:e7', 'vm-uuid': '39586d44-1d8e-4607-ab4d-c03a7d841606'}),)) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:47:41 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:47:41 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 10:47:41 user nova-compute[71509]: INFO os_vif [None req-749df4c9-936e-4b4e-a727-35fc33e58450 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:6c:e7,bridge_name='br-int',has_traffic_filtering=True,id=6099437e-5607-4a06-abcb-15d465c7ecf8,network=Network(69274626-4a94-46d8-be28-534a98fb6817),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6099437e-56')
Apr 14 10:47:41 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-dd22a66c-5e48-4f49-8a88-58d4a82d2838 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json" returned: 0 in 0.186s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:47:41 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-dd22a66c-5e48-4f49-8a88-58d4a82d2838 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18,backing_fmt=raw /opt/stack/data/nova/instances/203b622c-9e6d-4ac7-a3fa-9f9c82ef3108/disk 1073741824 {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:47:41 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4abb549-8f36-40c5-971f-8accbb14ff86/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:47:41 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71509) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 10:47:41 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8586a70e-9855-4177-ac1b-cf707a4df871/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:47:41 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8586a70e-9855-4177-ac1b-cf707a4df871/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:47:41 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8586a70e-9855-4177-ac1b-cf707a4df871/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:47:41 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-dd22a66c-5e48-4f49-8a88-58d4a82d2838 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18,backing_fmt=raw /opt/stack/data/nova/instances/203b622c-9e6d-4ac7-a3fa-9f9c82ef3108/disk 1073741824" returned: 0 in 0.390s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:47:41 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-dd22a66c-5e48-4f49-8a88-58d4a82d2838 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Lock "5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.583s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:47:41 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-dd22a66c-5e48-4f49-8a88-58d4a82d2838 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:47:41 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-749df4c9-936e-4b4e-a727-35fc33e58450 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] No BDM found with device name vda, not building metadata. {{(pid=71509) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 10:47:41 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-749df4c9-936e-4b4e-a727-35fc33e58450 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] No VIF found with MAC fa:16:3e:4b:6c:e7, not building metadata {{(pid=71509) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 10:47:41 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-dd22a66c-5e48-4f49-8a88-58d4a82d2838 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json" returned: 0 in 0.140s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:47:41 user nova-compute[71509]: DEBUG nova.virt.disk.api [None req-dd22a66c-5e48-4f49-8a88-58d4a82d2838 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Checking if we can resize image /opt/stack/data/nova/instances/203b622c-9e6d-4ac7-a3fa-9f9c82ef3108/disk. size=1073741824 {{(pid=71509) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 10:47:41 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-dd22a66c-5e48-4f49-8a88-58d4a82d2838 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/203b622c-9e6d-4ac7-a3fa-9f9c82ef3108/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:47:41 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8586a70e-9855-4177-ac1b-cf707a4df871/disk --force-share --output=json" returned: 0 in 0.276s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:47:42 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-dd22a66c-5e48-4f49-8a88-58d4a82d2838 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/203b622c-9e6d-4ac7-a3fa-9f9c82ef3108/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:47:42 user nova-compute[71509]: DEBUG nova.virt.disk.api [None req-dd22a66c-5e48-4f49-8a88-58d4a82d2838 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Cannot resize image /opt/stack/data/nova/instances/203b622c-9e6d-4ac7-a3fa-9f9c82ef3108/disk to a smaller size. {{(pid=71509) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 10:47:42 user nova-compute[71509]: DEBUG nova.objects.instance [None req-dd22a66c-5e48-4f49-8a88-58d4a82d2838 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Lazy-loading 'migration_context' on Instance uuid 203b622c-9e6d-4ac7-a3fa-9f9c82ef3108 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:47:42 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-dd22a66c-5e48-4f49-8a88-58d4a82d2838 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] [instance: 203b622c-9e6d-4ac7-a3fa-9f9c82ef3108] Created local disks {{(pid=71509) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 10:47:42 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-dd22a66c-5e48-4f49-8a88-58d4a82d2838 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] [instance: 203b622c-9e6d-4ac7-a3fa-9f9c82ef3108] Ensure instance console log exists: /opt/stack/data/nova/instances/203b622c-9e6d-4ac7-a3fa-9f9c82ef3108/console.log {{(pid=71509) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 10:47:42 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-dd22a66c-5e48-4f49-8a88-58d4a82d2838 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:47:42 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-dd22a66c-5e48-4f49-8a88-58d4a82d2838 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:47:42 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-dd22a66c-5e48-4f49-8a88-58d4a82d2838 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:47:42 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55178126-9766-4875-9122-39dcc87ce82c/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:47:42 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55178126-9766-4875-9122-39dcc87ce82c/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:47:42 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55178126-9766-4875-9122-39dcc87ce82c/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:47:42 user nova-compute[71509]: DEBUG nova.network.neutron [None req-dd22a66c-5e48-4f49-8a88-58d4a82d2838 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] [instance: 203b622c-9e6d-4ac7-a3fa-9f9c82ef3108] Successfully created port: 01a9c136-4a03-464b-bc37-e95ab62f6f1a {{(pid=71509) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 10:47:42 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55178126-9766-4875-9122-39dcc87ce82c/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:47:42 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e479154a-acd6-47aa-9a5b-43c6e0feda07/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:47:42 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:47:42 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e479154a-acd6-47aa-9a5b-43c6e0feda07/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:47:42 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e479154a-acd6-47aa-9a5b-43c6e0feda07/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:47:42 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e479154a-acd6-47aa-9a5b-43c6e0feda07/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:47:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e6c800c-9b35-4e35-969e-c40367056dce/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:47:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e6c800c-9b35-4e35-969e-c40367056dce/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:47:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e6c800c-9b35-4e35-969e-c40367056dce/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:47:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e6c800c-9b35-4e35-969e-c40367056dce/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:47:43 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71509) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 10:47:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e6c800c-9b35-4e35-969e-c40367056dce/disk.rescue --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:47:43 user nova-compute[71509]: DEBUG nova.network.neutron [None req-dd22a66c-5e48-4f49-8a88-58d4a82d2838 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] [instance: 203b622c-9e6d-4ac7-a3fa-9f9c82ef3108] Successfully updated port: 01a9c136-4a03-464b-bc37-e95ab62f6f1a {{(pid=71509) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 10:47:43 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-dd22a66c-5e48-4f49-8a88-58d4a82d2838 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Acquiring lock "refresh_cache-203b622c-9e6d-4ac7-a3fa-9f9c82ef3108" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:47:43 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-dd22a66c-5e48-4f49-8a88-58d4a82d2838 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Acquired lock "refresh_cache-203b622c-9e6d-4ac7-a3fa-9f9c82ef3108" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:47:43 user nova-compute[71509]: DEBUG nova.network.neutron [None req-dd22a66c-5e48-4f49-8a88-58d4a82d2838 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] [instance: 203b622c-9e6d-4ac7-a3fa-9f9c82ef3108] Building network info cache for instance {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 10:47:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e6c800c-9b35-4e35-969e-c40367056dce/disk.rescue --force-share --output=json" returned: 0 in 0.162s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:47:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e6c800c-9b35-4e35-969e-c40367056dce/disk.rescue --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:47:43 user nova-compute[71509]: DEBUG nova.compute.manager [req-207045a8-ba8b-42c0-aec5-0ed173f6d3fe req-3e00c79e-a348-4a28-9a3e-d3effb3fb8e5 service nova] [instance: 203b622c-9e6d-4ac7-a3fa-9f9c82ef3108] Received event network-changed-01a9c136-4a03-464b-bc37-e95ab62f6f1a {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:47:43 user nova-compute[71509]: DEBUG nova.compute.manager [req-207045a8-ba8b-42c0-aec5-0ed173f6d3fe req-3e00c79e-a348-4a28-9a3e-d3effb3fb8e5 service nova] [instance: 203b622c-9e6d-4ac7-a3fa-9f9c82ef3108] Refreshing instance network info cache due to event network-changed-01a9c136-4a03-464b-bc37-e95ab62f6f1a. {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 10:47:43 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-207045a8-ba8b-42c0-aec5-0ed173f6d3fe req-3e00c79e-a348-4a28-9a3e-d3effb3fb8e5 service nova] Acquiring lock "refresh_cache-203b622c-9e6d-4ac7-a3fa-9f9c82ef3108" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:47:43 user nova-compute[71509]: DEBUG nova.network.neutron [None req-dd22a66c-5e48-4f49-8a88-58d4a82d2838 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] [instance: 203b622c-9e6d-4ac7-a3fa-9f9c82ef3108] Instance cache missing network info. {{(pid=71509) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 10:47:43 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:47:43 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:47:43 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:47:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e6c800c-9b35-4e35-969e-c40367056dce/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:47:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97f20661-8b60-439e-b7af-2fc2013c5ade/disk.rescue --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:47:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97f20661-8b60-439e-b7af-2fc2013c5ade/disk.rescue --force-share --output=json" returned: 0 in 0.217s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:47:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97f20661-8b60-439e-b7af-2fc2013c5ade/disk.rescue --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:47:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97f20661-8b60-439e-b7af-2fc2013c5ade/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:47:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97f20661-8b60-439e-b7af-2fc2013c5ade/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:47:44 user nova-compute[71509]: DEBUG nova.network.neutron [None req-dd22a66c-5e48-4f49-8a88-58d4a82d2838 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] [instance: 203b622c-9e6d-4ac7-a3fa-9f9c82ef3108] Updating instance_info_cache with network_info: [{"id": "01a9c136-4a03-464b-bc37-e95ab62f6f1a", "address": "fa:16:3e:a8:8f:1c", "network": {"id": "4efde76c-8493-4902-a655-f10faee002a4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1588457316-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "a84a2fac4604454982dc018b36440b00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01a9c136-4a", "ovs_interfaceid": "01a9c136-4a03-464b-bc37-e95ab62f6f1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:47:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97f20661-8b60-439e-b7af-2fc2013c5ade/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:47:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97f20661-8b60-439e-b7af-2fc2013c5ade/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:47:44 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-dd22a66c-5e48-4f49-8a88-58d4a82d2838 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Releasing lock "refresh_cache-203b622c-9e6d-4ac7-a3fa-9f9c82ef3108" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:47:44 user nova-compute[71509]: DEBUG nova.compute.manager [None req-dd22a66c-5e48-4f49-8a88-58d4a82d2838 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] [instance: 203b622c-9e6d-4ac7-a3fa-9f9c82ef3108] Instance network_info: |[{"id": "01a9c136-4a03-464b-bc37-e95ab62f6f1a", "address": "fa:16:3e:a8:8f:1c", "network": {"id": "4efde76c-8493-4902-a655-f10faee002a4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1588457316-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "a84a2fac4604454982dc018b36440b00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01a9c136-4a", "ovs_interfaceid": "01a9c136-4a03-464b-bc37-e95ab62f6f1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71509) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 10:47:44 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-207045a8-ba8b-42c0-aec5-0ed173f6d3fe req-3e00c79e-a348-4a28-9a3e-d3effb3fb8e5 service nova] Acquired lock "refresh_cache-203b622c-9e6d-4ac7-a3fa-9f9c82ef3108" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:47:44 user nova-compute[71509]: DEBUG nova.network.neutron [req-207045a8-ba8b-42c0-aec5-0ed173f6d3fe req-3e00c79e-a348-4a28-9a3e-d3effb3fb8e5 service nova] [instance: 203b622c-9e6d-4ac7-a3fa-9f9c82ef3108] Refreshing network info cache for port 01a9c136-4a03-464b-bc37-e95ab62f6f1a {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 10:47:44 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-dd22a66c-5e48-4f49-8a88-58d4a82d2838 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] [instance: 203b622c-9e6d-4ac7-a3fa-9f9c82ef3108] Start _get_guest_xml network_info=[{"id": "01a9c136-4a03-464b-bc37-e95ab62f6f1a", "address": "fa:16:3e:a8:8f:1c", "network": {"id": "4efde76c-8493-4902-a655-f10faee002a4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1588457316-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "a84a2fac4604454982dc018b36440b00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01a9c136-4a", "ovs_interfaceid": "01a9c136-4a03-464b-bc37-e95ab62f6f1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T10:38:55Z,direct_url=<?>,disk_format='qcow2',id=048ec0ee-0465-448d-8b4c-f072acb101dc,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='9742d6ad20cf48d9bab0fdbcc9491db9',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T10:38:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '048ec0ee-0465-448d-8b4c-f072acb101dc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71509) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 10:47:44 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-dd22a66c-5e48-4f49-8a88-58d4a82d2838 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:47:44 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-dd22a66c-5e48-4f49-8a88-58d4a82d2838 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:47:44 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-dd22a66c-5e48-4f49-8a88-58d4a82d2838 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71509) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 10:47:44 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-dd22a66c-5e48-4f49-8a88-58d4a82d2838 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T10:40:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T10:38:55Z,direct_url=<?>,disk_format='qcow2',id=048ec0ee-0465-448d-8b4c-f072acb101dc,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='9742d6ad20cf48d9bab0fdbcc9491db9',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T10:38:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 10:47:44 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-dd22a66c-5e48-4f49-8a88-58d4a82d2838 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Flavor limits 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 10:47:44 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-dd22a66c-5e48-4f49-8a88-58d4a82d2838 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Image limits 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 10:47:44 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-dd22a66c-5e48-4f49-8a88-58d4a82d2838 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Flavor pref 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 10:47:44 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-dd22a66c-5e48-4f49-8a88-58d4a82d2838 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Image pref 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 10:47:44 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-dd22a66c-5e48-4f49-8a88-58d4a82d2838 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 10:47:44 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-dd22a66c-5e48-4f49-8a88-58d4a82d2838 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 10:47:44 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-dd22a66c-5e48-4f49-8a88-58d4a82d2838 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71509) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 10:47:44 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-dd22a66c-5e48-4f49-8a88-58d4a82d2838 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Got 1 possible topologies {{(pid=71509) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 10:47:44 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-dd22a66c-5e48-4f49-8a88-58d4a82d2838 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 10:47:44 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-dd22a66c-5e48-4f49-8a88-58d4a82d2838 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 10:47:44 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-dd22a66c-5e48-4f49-8a88-58d4a82d2838 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T10:47:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-942407433',display_name='tempest-VolumesSnapshotTestJSON-instance-942407433',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-942407433',id=17,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a84a2fac4604454982dc018b36440b00',ramdisk_id='',reservation_id='r-q2b52nme',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-685456681',owner_user_name='tempest-VolumesSnapshotTestJSON-685456681-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T10:47:41Z,user_data=None,user_id='ac498c56dae543cf9e64fbb61ad50df3',uuid=203b622c-9e6d-4ac7-a3fa-9f9c82ef3108,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "01a9c136-4a03-464b-bc37-e95ab62f6f1a", "address": "fa:16:3e:a8:8f:1c", "network": {"id": "4efde76c-8493-4902-a655-f10faee002a4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1588457316-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "a84a2fac4604454982dc018b36440b00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01a9c136-4a", "ovs_interfaceid": "01a9c136-4a03-464b-bc37-e95ab62f6f1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71509) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 10:47:44 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-dd22a66c-5e48-4f49-8a88-58d4a82d2838 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Converting VIF {"id": "01a9c136-4a03-464b-bc37-e95ab62f6f1a", "address": "fa:16:3e:a8:8f:1c", "network": {"id": "4efde76c-8493-4902-a655-f10faee002a4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1588457316-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "a84a2fac4604454982dc018b36440b00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01a9c136-4a", "ovs_interfaceid": "01a9c136-4a03-464b-bc37-e95ab62f6f1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:47:44 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-dd22a66c-5e48-4f49-8a88-58d4a82d2838 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:8f:1c,bridge_name='br-int',has_traffic_filtering=True,id=01a9c136-4a03-464b-bc37-e95ab62f6f1a,network=Network(4efde76c-8493-4902-a655-f10faee002a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01a9c136-4a') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:47:44 user nova-compute[71509]: DEBUG nova.objects.instance [None req-dd22a66c-5e48-4f49-8a88-58d4a82d2838 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Lazy-loading 'pci_devices' on Instance uuid 203b622c-9e6d-4ac7-a3fa-9f9c82ef3108 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:47:44 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-dd22a66c-5e48-4f49-8a88-58d4a82d2838 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] [instance: 203b622c-9e6d-4ac7-a3fa-9f9c82ef3108] End _get_guest_xml xml=<domain type="kvm">
Apr 14 10:47:44 user nova-compute[71509]:   <uuid>203b622c-9e6d-4ac7-a3fa-9f9c82ef3108</uuid>
Apr 14 10:47:44 user nova-compute[71509]:   <name>instance-00000011</name>
Apr 14 10:47:44 user nova-compute[71509]:   <memory>131072</memory>
Apr 14 10:47:44 user nova-compute[71509]:   <vcpu>1</vcpu>
Apr 14 10:47:44 user nova-compute[71509]:   <metadata>
Apr 14 10:47:44 user nova-compute[71509]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 10:47:44 user nova-compute[71509]:       <nova:package version="0.0.0"/>
Apr 14 10:47:44 user nova-compute[71509]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-942407433</nova:name>
Apr 14 10:47:44 user nova-compute[71509]:       <nova:creationTime>2023-04-14 10:47:44</nova:creationTime>
Apr 14 10:47:44 user nova-compute[71509]:       <nova:flavor name="m1.nano">
Apr 14 10:47:44 user nova-compute[71509]:         <nova:memory>128</nova:memory>
Apr 14 10:47:44 user nova-compute[71509]:         <nova:disk>1</nova:disk>
Apr 14 10:47:44 user nova-compute[71509]:         <nova:swap>0</nova:swap>
Apr 14 10:47:44 user nova-compute[71509]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 10:47:44 user nova-compute[71509]:         <nova:vcpus>1</nova:vcpus>
Apr 14 10:47:44 user nova-compute[71509]:       </nova:flavor>
Apr 14 10:47:44 user nova-compute[71509]:       <nova:owner>
Apr 14 10:47:44 user nova-compute[71509]:         <nova:user uuid="ac498c56dae543cf9e64fbb61ad50df3">tempest-VolumesSnapshotTestJSON-685456681-project-member</nova:user>
Apr 14 10:47:44 user nova-compute[71509]:         <nova:project uuid="a84a2fac4604454982dc018b36440b00">tempest-VolumesSnapshotTestJSON-685456681</nova:project>
Apr 14 10:47:44 user nova-compute[71509]:       </nova:owner>
Apr 14 10:47:44 user nova-compute[71509]:       <nova:root type="image" uuid="048ec0ee-0465-448d-8b4c-f072acb101dc"/>
Apr 14 10:47:44 user nova-compute[71509]:       <nova:ports>
Apr 14 10:47:44 user nova-compute[71509]:         <nova:port uuid="01a9c136-4a03-464b-bc37-e95ab62f6f1a">
Apr 14 10:47:44 user nova-compute[71509]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 14 10:47:44 user nova-compute[71509]:         </nova:port>
Apr 14 10:47:44 user nova-compute[71509]:       </nova:ports>
Apr 14 10:47:44 user nova-compute[71509]:     </nova:instance>
Apr 14 10:47:44 user nova-compute[71509]:   </metadata>
Apr 14 10:47:44 user nova-compute[71509]:   <sysinfo type="smbios">
Apr 14 10:47:44 user nova-compute[71509]:     <system>
Apr 14 10:47:44 user nova-compute[71509]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 10:47:44 user nova-compute[71509]:       <entry name="product">OpenStack Nova</entry>
Apr 14 10:47:44 user nova-compute[71509]:       <entry name="version">0.0.0</entry>
Apr 14 10:47:44 user nova-compute[71509]:       <entry name="serial">203b622c-9e6d-4ac7-a3fa-9f9c82ef3108</entry>
Apr 14 10:47:44 user nova-compute[71509]:       <entry name="uuid">203b622c-9e6d-4ac7-a3fa-9f9c82ef3108</entry>
Apr 14 10:47:44 user nova-compute[71509]:       <entry name="family">Virtual Machine</entry>
Apr 14 10:47:44 user nova-compute[71509]:     </system>
Apr 14 10:47:44 user nova-compute[71509]:   </sysinfo>
Apr 14 10:47:44 user nova-compute[71509]:   <os>
Apr 14 10:47:44 user nova-compute[71509]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 10:47:44 user nova-compute[71509]:     <boot dev="hd"/>
Apr 14 10:47:44 user nova-compute[71509]:     <smbios mode="sysinfo"/>
Apr 14 10:47:44 user nova-compute[71509]:   </os>
Apr 14 10:47:44 user nova-compute[71509]:   <features>
Apr 14 10:47:44 user nova-compute[71509]:     <acpi/>
Apr 14 10:47:44 user nova-compute[71509]:     <apic/>
Apr 14 10:47:44 user nova-compute[71509]:     <vmcoreinfo/>
Apr 14 10:47:44 user nova-compute[71509]:   </features>
Apr 14 10:47:44 user nova-compute[71509]:   <clock offset="utc">
Apr 14 10:47:44 user nova-compute[71509]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 10:47:44 user nova-compute[71509]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 10:47:44 user nova-compute[71509]:     <timer name="hpet" present="no"/>
Apr 14 10:47:44 user nova-compute[71509]:   </clock>
Apr 14 10:47:44 user nova-compute[71509]:   <cpu mode="custom" match="exact">
Apr 14 10:47:44 user nova-compute[71509]:     <model>Nehalem</model>
Apr 14 10:47:44 user nova-compute[71509]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 10:47:44 user nova-compute[71509]:   </cpu>
Apr 14 10:47:44 user nova-compute[71509]:   <devices>
Apr 14 10:47:44 user nova-compute[71509]:     <disk type="file" device="disk">
Apr 14 10:47:44 user nova-compute[71509]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 10:47:44 user nova-compute[71509]:       <source file="/opt/stack/data/nova/instances/203b622c-9e6d-4ac7-a3fa-9f9c82ef3108/disk"/>
Apr 14 10:47:44 user nova-compute[71509]:       <target dev="vda" bus="virtio"/>
Apr 14 10:47:44 user nova-compute[71509]:     </disk>
Apr 14 10:47:44 user nova-compute[71509]:     <interface type="ethernet">
Apr 14 10:47:44 user nova-compute[71509]:       <mac address="fa:16:3e:a8:8f:1c"/>
Apr 14 10:47:44 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 10:47:44 user nova-compute[71509]:       <mtu size="1442"/>
Apr 14 10:47:44 user nova-compute[71509]:       <target dev="tap01a9c136-4a"/>
Apr 14 10:47:44 user nova-compute[71509]:     </interface>
Apr 14 10:47:44 user nova-compute[71509]:     <serial type="pty">
Apr 14 10:47:44 user nova-compute[71509]:       <log file="/opt/stack/data/nova/instances/203b622c-9e6d-4ac7-a3fa-9f9c82ef3108/console.log" append="off"/>
Apr 14 10:47:44 user nova-compute[71509]:     </serial>
Apr 14 10:47:44 user nova-compute[71509]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 10:47:44 user nova-compute[71509]:     <video>
Apr 14 10:47:44 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 10:47:44 user nova-compute[71509]:     </video>
Apr 14 10:47:44 user nova-compute[71509]:     <rng model="virtio">
Apr 14 10:47:44 user nova-compute[71509]:       <backend model="random">/dev/urandom</backend>
Apr 14 10:47:44 user nova-compute[71509]:     </rng>
Apr 14 10:47:44 user nova-compute[71509]:     <controller type="usb" index="0" model="none"/>
Apr 14 10:47:44 user nova-compute[71509]:     <memballoon model="virtio">
Apr 14 10:47:44 user nova-compute[71509]:       <stats period="10"/>
Apr 14 10:47:44 user nova-compute[71509]:     </memballoon>
Apr 14 10:47:44 user nova-compute[71509]:   </devices>
Apr 14 10:47:44 user nova-compute[71509]: </domain>
Apr 14 10:47:44 user nova-compute[71509]:  {{(pid=71509) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 10:47:44 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-dd22a66c-5e48-4f49-8a88-58d4a82d2838 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T10:47:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-942407433',display_name='tempest-VolumesSnapshotTestJSON-instance-942407433',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-942407433',id=17,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a84a2fac4604454982dc018b36440b00',ramdisk_id='',reservation_id='r-q2b52nme',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-685456681',owner_user_name='tempest-VolumesSnapshotTestJSON-685456681-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T10:47:41Z,user_data=None,user_id='ac498c56dae543cf9e64fbb61ad50df3',uuid=203b622c-9e6d-4ac7-a3fa-9f9c82ef3108,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "01a9c136-4a03-464b-bc37-e95ab62f6f1a", "address": "fa:16:3e:a8:8f:1c", "network": {"id": "4efde76c-8493-4902-a655-f10faee002a4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1588457316-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "a84a2fac4604454982dc018b36440b00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01a9c136-4a", "ovs_interfaceid": "01a9c136-4a03-464b-bc37-e95ab62f6f1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 10:47:44 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-dd22a66c-5e48-4f49-8a88-58d4a82d2838 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Converting VIF {"id": "01a9c136-4a03-464b-bc37-e95ab62f6f1a", "address": "fa:16:3e:a8:8f:1c", "network": {"id": "4efde76c-8493-4902-a655-f10faee002a4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1588457316-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "a84a2fac4604454982dc018b36440b00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01a9c136-4a", "ovs_interfaceid": "01a9c136-4a03-464b-bc37-e95ab62f6f1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:47:44 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-dd22a66c-5e48-4f49-8a88-58d4a82d2838 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:8f:1c,bridge_name='br-int',has_traffic_filtering=True,id=01a9c136-4a03-464b-bc37-e95ab62f6f1a,network=Network(4efde76c-8493-4902-a655-f10faee002a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01a9c136-4a') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:47:44 user nova-compute[71509]: DEBUG os_vif [None req-dd22a66c-5e48-4f49-8a88-58d4a82d2838 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:8f:1c,bridge_name='br-int',has_traffic_filtering=True,id=01a9c136-4a03-464b-bc37-e95ab62f6f1a,network=Network(4efde76c-8493-4902-a655-f10faee002a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01a9c136-4a') {{(pid=71509) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 10:47:44 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:47:44 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:47:44 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 10:47:44 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:47:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97f20661-8b60-439e-b7af-2fc2013c5ade/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:47:44 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:47:44 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap01a9c136-4a, may_exist=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:47:44 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap01a9c136-4a, col_values=(('external_ids', {'iface-id': '01a9c136-4a03-464b-bc37-e95ab62f6f1a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a8:8f:1c', 'vm-uuid': '203b622c-9e6d-4ac7-a3fa-9f9c82ef3108'}),)) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:47:44 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:47:44 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 10:47:44 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:47:44 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:47:44 user nova-compute[71509]: INFO os_vif [None req-dd22a66c-5e48-4f49-8a88-58d4a82d2838 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:8f:1c,bridge_name='br-int',has_traffic_filtering=True,id=01a9c136-4a03-464b-bc37-e95ab62f6f1a,network=Network(4efde76c-8493-4902-a655-f10faee002a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01a9c136-4a')
Apr 14 10:47:45 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:47:45 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:47:45 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Hypervisor/Node resource view: name=user free_ram=7647MB free_disk=26.211299896240234GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71509) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 10:47:45 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:47:45 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:47:45 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-dd22a66c-5e48-4f49-8a88-58d4a82d2838 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] No BDM found with device name vda, not building metadata. {{(pid=71509) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 10:47:45 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-dd22a66c-5e48-4f49-8a88-58d4a82d2838 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] No VIF found with MAC fa:16:3e:a8:8f:1c, not building metadata {{(pid=71509) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 10:47:45 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 97f20661-8b60-439e-b7af-2fc2013c5ade actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:47:45 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 97820f17-22d1-4ec3-9721-1edadccc794a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:47:45 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance b4abb549-8f36-40c5-971f-8accbb14ff86 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:47:45 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 0e6c800c-9b35-4e35-969e-c40367056dce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:47:45 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 55178126-9766-4875-9122-39dcc87ce82c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:47:45 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 4b767f1b-e97e-497c-8c70-8806203c76ae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:47:45 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance e479154a-acd6-47aa-9a5b-43c6e0feda07 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:47:45 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 8586a70e-9855-4177-ac1b-cf707a4df871 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:47:45 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Instance with task_state "spawning" is not being actively managed by this compute host but has allocations referencing this compute node (52209f7e-594e-4cf4-9018-18636056cd6b): {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. Skipping heal of allocations during the task state transition. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1705}}
Apr 14 10:47:45 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 203b622c-9e6d-4ac7-a3fa-9f9c82ef3108 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:47:45 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=71509) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 10:47:45 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Final resource view: name=user phys_ram=16023MB used_ram=1664MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=71509) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 10:47:45 user nova-compute[71509]: DEBUG nova.compute.manager [req-efd9417f-1da0-4478-a9d9-743a25670c55 req-3737a6be-ca5b-4c83-9200-61091c741f57 service nova] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Received event network-vif-plugged-6099437e-5607-4a06-abcb-15d465c7ecf8 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:47:45 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-efd9417f-1da0-4478-a9d9-743a25670c55 req-3737a6be-ca5b-4c83-9200-61091c741f57 service nova] Acquiring lock "39586d44-1d8e-4607-ab4d-c03a7d841606-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:47:45 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-efd9417f-1da0-4478-a9d9-743a25670c55 req-3737a6be-ca5b-4c83-9200-61091c741f57 service nova] Lock "39586d44-1d8e-4607-ab4d-c03a7d841606-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:47:45 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-efd9417f-1da0-4478-a9d9-743a25670c55 req-3737a6be-ca5b-4c83-9200-61091c741f57 service nova] Lock "39586d44-1d8e-4607-ab4d-c03a7d841606-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:47:45 user nova-compute[71509]: DEBUG nova.compute.manager [req-efd9417f-1da0-4478-a9d9-743a25670c55 req-3737a6be-ca5b-4c83-9200-61091c741f57 service nova] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] No waiting events found dispatching network-vif-plugged-6099437e-5607-4a06-abcb-15d465c7ecf8 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:47:45 user nova-compute[71509]: WARNING nova.compute.manager [req-efd9417f-1da0-4478-a9d9-743a25670c55 req-3737a6be-ca5b-4c83-9200-61091c741f57 service nova] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Received unexpected event network-vif-plugged-6099437e-5607-4a06-abcb-15d465c7ecf8 for instance with vm_state shelved_offloaded and task_state spawning.
Apr 14 10:47:45 user nova-compute[71509]: DEBUG nova.compute.manager [req-efd9417f-1da0-4478-a9d9-743a25670c55 req-3737a6be-ca5b-4c83-9200-61091c741f57 service nova] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Received event network-vif-plugged-6099437e-5607-4a06-abcb-15d465c7ecf8 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:47:45 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-efd9417f-1da0-4478-a9d9-743a25670c55 req-3737a6be-ca5b-4c83-9200-61091c741f57 service nova] Acquiring lock "39586d44-1d8e-4607-ab4d-c03a7d841606-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:47:45 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-efd9417f-1da0-4478-a9d9-743a25670c55 req-3737a6be-ca5b-4c83-9200-61091c741f57 service nova] Lock "39586d44-1d8e-4607-ab4d-c03a7d841606-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:47:45 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-efd9417f-1da0-4478-a9d9-743a25670c55 req-3737a6be-ca5b-4c83-9200-61091c741f57 service nova] Lock "39586d44-1d8e-4607-ab4d-c03a7d841606-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:47:45 user nova-compute[71509]: DEBUG nova.compute.manager [req-efd9417f-1da0-4478-a9d9-743a25670c55 req-3737a6be-ca5b-4c83-9200-61091c741f57 service nova] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] No waiting events found dispatching network-vif-plugged-6099437e-5607-4a06-abcb-15d465c7ecf8 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:47:45 user nova-compute[71509]: WARNING nova.compute.manager [req-efd9417f-1da0-4478-a9d9-743a25670c55 req-3737a6be-ca5b-4c83-9200-61091c741f57 service nova] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Received unexpected event network-vif-plugged-6099437e-5607-4a06-abcb-15d465c7ecf8 for instance with vm_state shelved_offloaded and task_state spawning.
Apr 14 10:47:45 user nova-compute[71509]: DEBUG nova.network.neutron [req-207045a8-ba8b-42c0-aec5-0ed173f6d3fe req-3e00c79e-a348-4a28-9a3e-d3effb3fb8e5 service nova] [instance: 203b622c-9e6d-4ac7-a3fa-9f9c82ef3108] Updated VIF entry in instance network info cache for port 01a9c136-4a03-464b-bc37-e95ab62f6f1a. {{(pid=71509) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 10:47:45 user nova-compute[71509]: DEBUG nova.network.neutron [req-207045a8-ba8b-42c0-aec5-0ed173f6d3fe req-3e00c79e-a348-4a28-9a3e-d3effb3fb8e5 service nova] [instance: 203b622c-9e6d-4ac7-a3fa-9f9c82ef3108] Updating instance_info_cache with network_info: [{"id": "01a9c136-4a03-464b-bc37-e95ab62f6f1a", "address": "fa:16:3e:a8:8f:1c", "network": {"id": "4efde76c-8493-4902-a655-f10faee002a4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1588457316-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "a84a2fac4604454982dc018b36440b00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01a9c136-4a", "ovs_interfaceid": "01a9c136-4a03-464b-bc37-e95ab62f6f1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:47:45 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-207045a8-ba8b-42c0-aec5-0ed173f6d3fe req-3e00c79e-a348-4a28-9a3e-d3effb3fb8e5 service nova] Releasing lock "refresh_cache-203b622c-9e6d-4ac7-a3fa-9f9c82ef3108" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:47:46 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 10:47:46 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:47:46 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 10:47:46 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Compute_service record updated for user:user {{(pid=71509) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 10:47:46 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.840s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:47:46 user nova-compute[71509]: DEBUG nova.compute.manager [None req-749df4c9-936e-4b4e-a727-35fc33e58450 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Instance event wait completed in 0 seconds for  {{(pid=71509) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 10:47:46 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-749df4c9-936e-4b4e-a727-35fc33e58450 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Guest created on hypervisor {{(pid=71509) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 10:47:46 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681469266.7119415, 39586d44-1d8e-4607-ab4d-c03a7d841606 => Resumed> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 10:47:46 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] VM Resumed (Lifecycle Event)
Apr 14 10:47:46 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:47:46 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Instance spawned successfully.
Apr 14 10:47:46 user nova-compute[71509]: DEBUG nova.compute.manager [None req-749df4c9-936e-4b4e-a727-35fc33e58450 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:47:46 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 10:47:47 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:47:47 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 10:47:47 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681469266.721597, 39586d44-1d8e-4607-ab4d-c03a7d841606 => Started> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 10:47:47 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] VM Started (Lifecycle Event)
Apr 14 10:47:47 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:47:47 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:47:47 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:47:47 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 10:47:47 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 10:47:47 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-749df4c9-936e-4b4e-a727-35fc33e58450 tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Lock "39586d44-1d8e-4607-ab4d-c03a7d841606" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 17.006s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:47:47 user nova-compute[71509]: DEBUG nova.compute.manager [req-1a52c538-a62f-409c-a2d5-beebb2833b19 req-820696e0-31e9-402a-9177-117a3abefce1 service nova] [instance: 203b622c-9e6d-4ac7-a3fa-9f9c82ef3108] Received event network-vif-plugged-01a9c136-4a03-464b-bc37-e95ab62f6f1a {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:47:47 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-1a52c538-a62f-409c-a2d5-beebb2833b19 req-820696e0-31e9-402a-9177-117a3abefce1 service nova] Acquiring lock "203b622c-9e6d-4ac7-a3fa-9f9c82ef3108-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:47:47 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-1a52c538-a62f-409c-a2d5-beebb2833b19 req-820696e0-31e9-402a-9177-117a3abefce1 service nova] Lock "203b622c-9e6d-4ac7-a3fa-9f9c82ef3108-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:47:47 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-1a52c538-a62f-409c-a2d5-beebb2833b19 req-820696e0-31e9-402a-9177-117a3abefce1 service nova] Lock "203b622c-9e6d-4ac7-a3fa-9f9c82ef3108-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:47:47 user nova-compute[71509]: DEBUG nova.compute.manager [req-1a52c538-a62f-409c-a2d5-beebb2833b19 req-820696e0-31e9-402a-9177-117a3abefce1 service nova] [instance: 203b622c-9e6d-4ac7-a3fa-9f9c82ef3108] No waiting events found dispatching network-vif-plugged-01a9c136-4a03-464b-bc37-e95ab62f6f1a {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:47:47 user nova-compute[71509]: WARNING nova.compute.manager [req-1a52c538-a62f-409c-a2d5-beebb2833b19 req-820696e0-31e9-402a-9177-117a3abefce1 service nova] [instance: 203b622c-9e6d-4ac7-a3fa-9f9c82ef3108] Received unexpected event network-vif-plugged-01a9c136-4a03-464b-bc37-e95ab62f6f1a for instance with vm_state building and task_state spawning.
Apr 14 10:47:47 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:47:49 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:47:49 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681469269.6899402, 203b622c-9e6d-4ac7-a3fa-9f9c82ef3108 => Resumed> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 10:47:49 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 203b622c-9e6d-4ac7-a3fa-9f9c82ef3108] VM Resumed (Lifecycle Event)
Apr 14 10:47:49 user nova-compute[71509]: DEBUG nova.compute.manager [None req-dd22a66c-5e48-4f49-8a88-58d4a82d2838 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] [instance: 203b622c-9e6d-4ac7-a3fa-9f9c82ef3108] Instance event wait completed in 0 seconds for  {{(pid=71509) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 10:47:49 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-dd22a66c-5e48-4f49-8a88-58d4a82d2838 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] [instance: 203b622c-9e6d-4ac7-a3fa-9f9c82ef3108] Guest created on hypervisor {{(pid=71509) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 10:47:49 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 203b622c-9e6d-4ac7-a3fa-9f9c82ef3108] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:47:49 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: 203b622c-9e6d-4ac7-a3fa-9f9c82ef3108] Instance spawned successfully.
Apr 14 10:47:49 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-dd22a66c-5e48-4f49-8a88-58d4a82d2838 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] [instance: 203b622c-9e6d-4ac7-a3fa-9f9c82ef3108] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 10:47:49 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 203b622c-9e6d-4ac7-a3fa-9f9c82ef3108] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 10:47:49 user nova-compute[71509]: DEBUG nova.compute.manager [req-20fb5f82-819e-4f60-b634-e1da08f364fe req-71a2c226-05af-4edb-a872-6e69c88fbbbc service nova] [instance: 203b622c-9e6d-4ac7-a3fa-9f9c82ef3108] Received event network-vif-plugged-01a9c136-4a03-464b-bc37-e95ab62f6f1a {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:47:49 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-20fb5f82-819e-4f60-b634-e1da08f364fe req-71a2c226-05af-4edb-a872-6e69c88fbbbc service nova] Acquiring lock "203b622c-9e6d-4ac7-a3fa-9f9c82ef3108-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:47:49 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-20fb5f82-819e-4f60-b634-e1da08f364fe req-71a2c226-05af-4edb-a872-6e69c88fbbbc service nova] Lock "203b622c-9e6d-4ac7-a3fa-9f9c82ef3108-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:47:49 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-20fb5f82-819e-4f60-b634-e1da08f364fe req-71a2c226-05af-4edb-a872-6e69c88fbbbc service nova] Lock "203b622c-9e6d-4ac7-a3fa-9f9c82ef3108-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:47:49 user nova-compute[71509]: DEBUG nova.compute.manager [req-20fb5f82-819e-4f60-b634-e1da08f364fe req-71a2c226-05af-4edb-a872-6e69c88fbbbc service nova] [instance: 203b622c-9e6d-4ac7-a3fa-9f9c82ef3108] No waiting events found dispatching network-vif-plugged-01a9c136-4a03-464b-bc37-e95ab62f6f1a {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:47:49 user nova-compute[71509]: WARNING nova.compute.manager [req-20fb5f82-819e-4f60-b634-e1da08f364fe req-71a2c226-05af-4edb-a872-6e69c88fbbbc service nova] [instance: 203b622c-9e6d-4ac7-a3fa-9f9c82ef3108] Received unexpected event network-vif-plugged-01a9c136-4a03-464b-bc37-e95ab62f6f1a for instance with vm_state building and task_state spawning.
Apr 14 10:47:49 user nova-compute[71509]: DEBUG nova.compute.manager [req-20fb5f82-819e-4f60-b634-e1da08f364fe req-71a2c226-05af-4edb-a872-6e69c88fbbbc service nova] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Received event network-changed-8d8a356d-c198-4e13-a489-5c626fbd025c {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:47:49 user nova-compute[71509]: DEBUG nova.compute.manager [req-20fb5f82-819e-4f60-b634-e1da08f364fe req-71a2c226-05af-4edb-a872-6e69c88fbbbc service nova] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Refreshing instance network info cache due to event network-changed-8d8a356d-c198-4e13-a489-5c626fbd025c. {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 10:47:49 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-20fb5f82-819e-4f60-b634-e1da08f364fe req-71a2c226-05af-4edb-a872-6e69c88fbbbc service nova] Acquiring lock "refresh_cache-4b767f1b-e97e-497c-8c70-8806203c76ae" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:47:49 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-20fb5f82-819e-4f60-b634-e1da08f364fe req-71a2c226-05af-4edb-a872-6e69c88fbbbc service nova] Acquired lock "refresh_cache-4b767f1b-e97e-497c-8c70-8806203c76ae" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:47:49 user nova-compute[71509]: DEBUG nova.network.neutron [req-20fb5f82-819e-4f60-b634-e1da08f364fe req-71a2c226-05af-4edb-a872-6e69c88fbbbc service nova] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Refreshing network info cache for port 8d8a356d-c198-4e13-a489-5c626fbd025c {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 10:47:49 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-dd22a66c-5e48-4f49-8a88-58d4a82d2838 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] [instance: 203b622c-9e6d-4ac7-a3fa-9f9c82ef3108] Found default for hw_cdrom_bus of ide {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:47:49 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-dd22a66c-5e48-4f49-8a88-58d4a82d2838 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] [instance: 203b622c-9e6d-4ac7-a3fa-9f9c82ef3108] Found default for hw_disk_bus of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:47:49 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-dd22a66c-5e48-4f49-8a88-58d4a82d2838 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] [instance: 203b622c-9e6d-4ac7-a3fa-9f9c82ef3108] Found default for hw_input_bus of None {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:47:49 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-dd22a66c-5e48-4f49-8a88-58d4a82d2838 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] [instance: 203b622c-9e6d-4ac7-a3fa-9f9c82ef3108] Found default for hw_pointer_model of None {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:47:49 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-dd22a66c-5e48-4f49-8a88-58d4a82d2838 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] [instance: 203b622c-9e6d-4ac7-a3fa-9f9c82ef3108] Found default for hw_video_model of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:47:49 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-dd22a66c-5e48-4f49-8a88-58d4a82d2838 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] [instance: 203b622c-9e6d-4ac7-a3fa-9f9c82ef3108] Found default for hw_vif_model of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:47:49 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 203b622c-9e6d-4ac7-a3fa-9f9c82ef3108] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 10:47:49 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681469269.6907182, 203b622c-9e6d-4ac7-a3fa-9f9c82ef3108 => Started> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 10:47:49 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 203b622c-9e6d-4ac7-a3fa-9f9c82ef3108] VM Started (Lifecycle Event)
Apr 14 10:47:49 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 203b622c-9e6d-4ac7-a3fa-9f9c82ef3108] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:47:49 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 203b622c-9e6d-4ac7-a3fa-9f9c82ef3108] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 10:47:49 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 203b622c-9e6d-4ac7-a3fa-9f9c82ef3108] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 10:47:49 user nova-compute[71509]: INFO nova.compute.manager [None req-dd22a66c-5e48-4f49-8a88-58d4a82d2838 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] [instance: 203b622c-9e6d-4ac7-a3fa-9f9c82ef3108] Took 8.88 seconds to spawn the instance on the hypervisor.
Apr 14 10:47:49 user nova-compute[71509]: DEBUG nova.compute.manager [None req-dd22a66c-5e48-4f49-8a88-58d4a82d2838 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] [instance: 203b622c-9e6d-4ac7-a3fa-9f9c82ef3108] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:47:49 user nova-compute[71509]: INFO nova.compute.manager [None req-dd22a66c-5e48-4f49-8a88-58d4a82d2838 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] [instance: 203b622c-9e6d-4ac7-a3fa-9f9c82ef3108] Took 10.34 seconds to build instance.
Apr 14 10:47:50 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-dd22a66c-5e48-4f49-8a88-58d4a82d2838 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Lock "203b622c-9e6d-4ac7-a3fa-9f9c82ef3108" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.492s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:47:50 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:47:50 user nova-compute[71509]: DEBUG nova.network.neutron [req-20fb5f82-819e-4f60-b634-e1da08f364fe req-71a2c226-05af-4edb-a872-6e69c88fbbbc service nova] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Updated VIF entry in instance network info cache for port 8d8a356d-c198-4e13-a489-5c626fbd025c. {{(pid=71509) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 10:47:50 user nova-compute[71509]: DEBUG nova.network.neutron [req-20fb5f82-819e-4f60-b634-e1da08f364fe req-71a2c226-05af-4edb-a872-6e69c88fbbbc service nova] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Updating instance_info_cache with network_info: [{"id": "8d8a356d-c198-4e13-a489-5c626fbd025c", "address": "fa:16:3e:c6:af:76", "network": {"id": "1cb09253-66a4-4c81-82d0-c6d948e0aed4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1557121746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8a9941095d445f48d70df26d8c90e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d8a356d-c1", "ovs_interfaceid": "8d8a356d-c198-4e13-a489-5c626fbd025c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:47:50 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-20fb5f82-819e-4f60-b634-e1da08f364fe req-71a2c226-05af-4edb-a872-6e69c88fbbbc service nova] Releasing lock "refresh_cache-4b767f1b-e97e-497c-8c70-8806203c76ae" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:47:52 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-4aec4f82-4f20-45fa-883d-73b02e7a5323 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Acquiring lock "4b767f1b-e97e-497c-8c70-8806203c76ae" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:47:52 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-4aec4f82-4f20-45fa-883d-73b02e7a5323 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "4b767f1b-e97e-497c-8c70-8806203c76ae" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:47:52 user nova-compute[71509]: INFO nova.compute.manager [None req-4aec4f82-4f20-45fa-883d-73b02e7a5323 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Shelving
Apr 14 10:47:52 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:47:52 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:47:52 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:47:52 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:47:52 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:47:52 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:47:53 user nova-compute[71509]: DEBUG nova.compute.manager [req-416acc21-0680-4a0b-9e9c-bc401580570e req-e19831c4-35cb-4579-9031-5735bef3137a service nova] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Received event network-vif-unplugged-8d8a356d-c198-4e13-a489-5c626fbd025c {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:47:53 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-416acc21-0680-4a0b-9e9c-bc401580570e req-e19831c4-35cb-4579-9031-5735bef3137a service nova] Acquiring lock "4b767f1b-e97e-497c-8c70-8806203c76ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:47:53 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-416acc21-0680-4a0b-9e9c-bc401580570e req-e19831c4-35cb-4579-9031-5735bef3137a service nova] Lock "4b767f1b-e97e-497c-8c70-8806203c76ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:47:53 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-416acc21-0680-4a0b-9e9c-bc401580570e req-e19831c4-35cb-4579-9031-5735bef3137a service nova] Lock "4b767f1b-e97e-497c-8c70-8806203c76ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:47:53 user nova-compute[71509]: DEBUG nova.compute.manager [req-416acc21-0680-4a0b-9e9c-bc401580570e req-e19831c4-35cb-4579-9031-5735bef3137a service nova] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] No waiting events found dispatching network-vif-unplugged-8d8a356d-c198-4e13-a489-5c626fbd025c {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:47:53 user nova-compute[71509]: WARNING nova.compute.manager [req-416acc21-0680-4a0b-9e9c-bc401580570e req-e19831c4-35cb-4579-9031-5735bef3137a service nova] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Received unexpected event network-vif-unplugged-8d8a356d-c198-4e13-a489-5c626fbd025c for instance with vm_state active and task_state shelving.
Apr 14 10:47:53 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Instance destroyed successfully.
Apr 14 10:47:53 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-4aec4f82-4f20-45fa-883d-73b02e7a5323 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Beginning cold snapshot process
Apr 14 10:47:53 user nova-compute[71509]: DEBUG nova.privsep.utils [None req-4aec4f82-4f20-45fa-883d-73b02e7a5323 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71509) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 10:47:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-4aec4f82-4f20-45fa-883d-73b02e7a5323 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/4b767f1b-e97e-497c-8c70-8806203c76ae/disk /opt/stack/data/nova/instances/snapshots/tmp72dx4yo0/c59f880cf62841f9880aac0b07e5a99a {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:47:54 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-4aec4f82-4f20-45fa-883d-73b02e7a5323 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/4b767f1b-e97e-497c-8c70-8806203c76ae/disk /opt/stack/data/nova/instances/snapshots/tmp72dx4yo0/c59f880cf62841f9880aac0b07e5a99a" returned: 0 in 0.647s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:47:54 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-4aec4f82-4f20-45fa-883d-73b02e7a5323 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Snapshot extracted, beginning image upload
Apr 14 10:47:54 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:47:55 user nova-compute[71509]: DEBUG nova.compute.manager [req-2c97cba6-17ef-4fc1-a4e4-ce6282a74dc1 req-8b76026c-3d63-4122-9c7d-a38e8a394873 service nova] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Received event network-vif-plugged-8d8a356d-c198-4e13-a489-5c626fbd025c {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:47:55 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-2c97cba6-17ef-4fc1-a4e4-ce6282a74dc1 req-8b76026c-3d63-4122-9c7d-a38e8a394873 service nova] Acquiring lock "4b767f1b-e97e-497c-8c70-8806203c76ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:47:55 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-2c97cba6-17ef-4fc1-a4e4-ce6282a74dc1 req-8b76026c-3d63-4122-9c7d-a38e8a394873 service nova] Lock "4b767f1b-e97e-497c-8c70-8806203c76ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:47:55 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-2c97cba6-17ef-4fc1-a4e4-ce6282a74dc1 req-8b76026c-3d63-4122-9c7d-a38e8a394873 service nova] Lock "4b767f1b-e97e-497c-8c70-8806203c76ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:47:55 user nova-compute[71509]: DEBUG nova.compute.manager [req-2c97cba6-17ef-4fc1-a4e4-ce6282a74dc1 req-8b76026c-3d63-4122-9c7d-a38e8a394873 service nova] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] No waiting events found dispatching network-vif-plugged-8d8a356d-c198-4e13-a489-5c626fbd025c {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:47:55 user nova-compute[71509]: WARNING nova.compute.manager [req-2c97cba6-17ef-4fc1-a4e4-ce6282a74dc1 req-8b76026c-3d63-4122-9c7d-a38e8a394873 service nova] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Received unexpected event network-vif-plugged-8d8a356d-c198-4e13-a489-5c626fbd025c for instance with vm_state active and task_state shelving_image_uploading.
Apr 14 10:47:56 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-4aec4f82-4f20-45fa-883d-73b02e7a5323 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Snapshot image upload complete
Apr 14 10:47:56 user nova-compute[71509]: DEBUG nova.compute.manager [None req-4aec4f82-4f20-45fa-883d-73b02e7a5323 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:47:57 user nova-compute[71509]: INFO nova.compute.manager [None req-4aec4f82-4f20-45fa-883d-73b02e7a5323 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Shelve offloading
Apr 14 10:47:57 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Instance destroyed successfully.
Apr 14 10:47:57 user nova-compute[71509]: DEBUG nova.compute.manager [None req-4aec4f82-4f20-45fa-883d-73b02e7a5323 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:47:57 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-4aec4f82-4f20-45fa-883d-73b02e7a5323 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Acquiring lock "refresh_cache-4b767f1b-e97e-497c-8c70-8806203c76ae" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:47:57 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-4aec4f82-4f20-45fa-883d-73b02e7a5323 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Acquired lock "refresh_cache-4b767f1b-e97e-497c-8c70-8806203c76ae" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:47:57 user nova-compute[71509]: DEBUG nova.network.neutron [None req-4aec4f82-4f20-45fa-883d-73b02e7a5323 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Building network info cache for instance {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 10:47:57 user nova-compute[71509]: DEBUG nova.network.neutron [None req-4aec4f82-4f20-45fa-883d-73b02e7a5323 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Updating instance_info_cache with network_info: [{"id": "8d8a356d-c198-4e13-a489-5c626fbd025c", "address": "fa:16:3e:c6:af:76", "network": {"id": "1cb09253-66a4-4c81-82d0-c6d948e0aed4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1557121746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8a9941095d445f48d70df26d8c90e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d8a356d-c1", "ovs_interfaceid": "8d8a356d-c198-4e13-a489-5c626fbd025c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:47:57 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-4aec4f82-4f20-45fa-883d-73b02e7a5323 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Releasing lock "refresh_cache-4b767f1b-e97e-497c-8c70-8806203c76ae" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:47:57 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:47:58 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:47:59 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Instance destroyed successfully.
Apr 14 10:47:59 user nova-compute[71509]: DEBUG nova.objects.instance [None req-4aec4f82-4f20-45fa-883d-73b02e7a5323 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lazy-loading 'resources' on Instance uuid 4b767f1b-e97e-497c-8c70-8806203c76ae {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:47:59 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-4aec4f82-4f20-45fa-883d-73b02e7a5323 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T10:45:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1779641770',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1779641770',id=14,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ+BJG2hs5u25cAKxVjcO06DHIw9v85rt9ybRTOcJ5Z2J6Lwyi75EbIt/XGY4FaiJAg302gOYYve73U7hVGmBbLP+TE/GpIu0YYFEbftUPUQVwIX7wT/hvM2WJymZnJdhQ==',key_name='tempest-keypair-1533515584',keypairs=<?>,launch_index=0,launched_at=2023-04-14T10:46:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='f8a9941095d445f48d70df26d8c90e6c',ramdisk_id='',reservation_id='r-8ce8ejer',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1250068675',owner_user_name='tempest-AttachVolumeShelveTestJSON-1250068675-project-member',shelved_at='2023-04-14T10:47:56.933472',shelved_host='user',shelved_image_id='d5409cc7-1961-4704-bc0a-b1e3cf81bdac'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T10:47:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5afd3930d3a14aff8124a4782ec79870',uuid=4b767f1b-e97e-497c-8c70-8806203c76ae,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "8d8a356d-c198-4e13-a489-5c626fbd025c", "address": "fa:16:3e:c6:af:76", "network": {"id": "1cb09253-66a4-4c81-82d0-c6d948e0aed4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1557121746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8a9941095d445f48d70df26d8c90e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d8a356d-c1", "ovs_interfaceid": "8d8a356d-c198-4e13-a489-5c626fbd025c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 10:47:59 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-4aec4f82-4f20-45fa-883d-73b02e7a5323 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Converting VIF {"id": "8d8a356d-c198-4e13-a489-5c626fbd025c", "address": "fa:16:3e:c6:af:76", "network": {"id": "1cb09253-66a4-4c81-82d0-c6d948e0aed4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1557121746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8a9941095d445f48d70df26d8c90e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d8a356d-c1", "ovs_interfaceid": "8d8a356d-c198-4e13-a489-5c626fbd025c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:47:59 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-4aec4f82-4f20-45fa-883d-73b02e7a5323 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:af:76,bridge_name='br-int',has_traffic_filtering=True,id=8d8a356d-c198-4e13-a489-5c626fbd025c,network=Network(1cb09253-66a4-4c81-82d0-c6d948e0aed4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d8a356d-c1') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:47:59 user nova-compute[71509]: DEBUG os_vif [None req-4aec4f82-4f20-45fa-883d-73b02e7a5323 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:af:76,bridge_name='br-int',has_traffic_filtering=True,id=8d8a356d-c198-4e13-a489-5c626fbd025c,network=Network(1cb09253-66a4-4c81-82d0-c6d948e0aed4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d8a356d-c1') {{(pid=71509) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 10:47:59 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:47:59 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8d8a356d-c1, bridge=br-int, if_exists=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:47:59 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:47:59 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 10:47:59 user nova-compute[71509]: INFO os_vif [None req-4aec4f82-4f20-45fa-883d-73b02e7a5323 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:af:76,bridge_name='br-int',has_traffic_filtering=True,id=8d8a356d-c198-4e13-a489-5c626fbd025c,network=Network(1cb09253-66a4-4c81-82d0-c6d948e0aed4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d8a356d-c1')
Apr 14 10:47:59 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-4aec4f82-4f20-45fa-883d-73b02e7a5323 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Deleting instance files /opt/stack/data/nova/instances/4b767f1b-e97e-497c-8c70-8806203c76ae_del
Apr 14 10:47:59 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-4aec4f82-4f20-45fa-883d-73b02e7a5323 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Deletion of /opt/stack/data/nova/instances/4b767f1b-e97e-497c-8c70-8806203c76ae_del complete
Apr 14 10:47:59 user nova-compute[71509]: INFO nova.scheduler.client.report [None req-4aec4f82-4f20-45fa-883d-73b02e7a5323 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Deleted allocations for instance 4b767f1b-e97e-497c-8c70-8806203c76ae
Apr 14 10:47:59 user nova-compute[71509]: DEBUG nova.compute.manager [req-4d5e231d-3bd3-48fa-b3d7-85568e319b24 req-b8f0a6ff-ec3d-4f17-b960-8a88ecfea41c service nova] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Received event network-changed-8d8a356d-c198-4e13-a489-5c626fbd025c {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:47:59 user nova-compute[71509]: DEBUG nova.compute.manager [req-4d5e231d-3bd3-48fa-b3d7-85568e319b24 req-b8f0a6ff-ec3d-4f17-b960-8a88ecfea41c service nova] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Refreshing instance network info cache due to event network-changed-8d8a356d-c198-4e13-a489-5c626fbd025c. {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 10:47:59 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-4d5e231d-3bd3-48fa-b3d7-85568e319b24 req-b8f0a6ff-ec3d-4f17-b960-8a88ecfea41c service nova] Acquiring lock "refresh_cache-4b767f1b-e97e-497c-8c70-8806203c76ae" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:47:59 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-4d5e231d-3bd3-48fa-b3d7-85568e319b24 req-b8f0a6ff-ec3d-4f17-b960-8a88ecfea41c service nova] Acquired lock "refresh_cache-4b767f1b-e97e-497c-8c70-8806203c76ae" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:47:59 user nova-compute[71509]: DEBUG nova.network.neutron [req-4d5e231d-3bd3-48fa-b3d7-85568e319b24 req-b8f0a6ff-ec3d-4f17-b960-8a88ecfea41c service nova] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Refreshing network info cache for port 8d8a356d-c198-4e13-a489-5c626fbd025c {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 10:47:59 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-4aec4f82-4f20-45fa-883d-73b02e7a5323 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:47:59 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-4aec4f82-4f20-45fa-883d-73b02e7a5323 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:47:59 user nova-compute[71509]: DEBUG nova.objects.instance [None req-4aec4f82-4f20-45fa-883d-73b02e7a5323 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lazy-loading 'numa_topology' on Instance uuid 4b767f1b-e97e-497c-8c70-8806203c76ae {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:47:59 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-4aec4f82-4f20-45fa-883d-73b02e7a5323 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 10:47:59 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-4aec4f82-4f20-45fa-883d-73b02e7a5323 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 10:48:00 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-4aec4f82-4f20-45fa-883d-73b02e7a5323 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.849s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:48:00 user nova-compute[71509]: DEBUG nova.network.neutron [req-4d5e231d-3bd3-48fa-b3d7-85568e319b24 req-b8f0a6ff-ec3d-4f17-b960-8a88ecfea41c service nova] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Updated VIF entry in instance network info cache for port 8d8a356d-c198-4e13-a489-5c626fbd025c. {{(pid=71509) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 10:48:00 user nova-compute[71509]: DEBUG nova.network.neutron [req-4d5e231d-3bd3-48fa-b3d7-85568e319b24 req-b8f0a6ff-ec3d-4f17-b960-8a88ecfea41c service nova] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Updating instance_info_cache with network_info: [{"id": "8d8a356d-c198-4e13-a489-5c626fbd025c", "address": "fa:16:3e:c6:af:76", "network": {"id": "1cb09253-66a4-4c81-82d0-c6d948e0aed4", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1557121746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8a9941095d445f48d70df26d8c90e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap8d8a356d-c1", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:48:00 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-4d5e231d-3bd3-48fa-b3d7-85568e319b24 req-b8f0a6ff-ec3d-4f17-b960-8a88ecfea41c service nova] Releasing lock "refresh_cache-4b767f1b-e97e-497c-8c70-8806203c76ae" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:48:00 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-4aec4f82-4f20-45fa-883d-73b02e7a5323 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "4b767f1b-e97e-497c-8c70-8806203c76ae" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 8.109s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:48:02 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:48:02 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:48:04 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:48:07 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:48:07 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:48:08 user nova-compute[71509]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681469273.399534, 4b767f1b-e97e-497c-8c70-8806203c76ae => Stopped> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 10:48:08 user nova-compute[71509]: INFO nova.compute.manager [-] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] VM Stopped (Lifecycle Event)
Apr 14 10:48:08 user nova-compute[71509]: DEBUG nova.compute.manager [None req-af673220-f032-4eb1-9d20-9666ea613301 None None] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:48:09 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:48:09 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:48:12 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-3f7133c9-45d5-4734-aec2-5fe15dc3c471 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Acquiring lock "f3245b74-dbe8-4b8b-83b6-58a4811fdba9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:48:12 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-3f7133c9-45d5-4734-aec2-5fe15dc3c471 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Lock "f3245b74-dbe8-4b8b-83b6-58a4811fdba9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:48:12 user nova-compute[71509]: DEBUG nova.compute.manager [None req-3f7133c9-45d5-4734-aec2-5fe15dc3c471 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] [instance: f3245b74-dbe8-4b8b-83b6-58a4811fdba9] Starting instance... {{(pid=71509) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 10:48:12 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-3f7133c9-45d5-4734-aec2-5fe15dc3c471 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:48:12 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-3f7133c9-45d5-4734-aec2-5fe15dc3c471 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:48:12 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-3f7133c9-45d5-4734-aec2-5fe15dc3c471 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71509) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 10:48:12 user nova-compute[71509]: INFO nova.compute.claims [None req-3f7133c9-45d5-4734-aec2-5fe15dc3c471 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] [instance: f3245b74-dbe8-4b8b-83b6-58a4811fdba9] Claim successful on node user
Apr 14 10:48:12 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:48:12 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-3f7133c9-45d5-4734-aec2-5fe15dc3c471 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 10:48:13 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-3f7133c9-45d5-4734-aec2-5fe15dc3c471 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 10:48:13 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-3f7133c9-45d5-4734-aec2-5fe15dc3c471 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.425s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:48:13 user nova-compute[71509]: DEBUG nova.compute.manager [None req-3f7133c9-45d5-4734-aec2-5fe15dc3c471 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] [instance: f3245b74-dbe8-4b8b-83b6-58a4811fdba9] Start building networks asynchronously for instance. {{(pid=71509) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 10:48:13 user nova-compute[71509]: DEBUG nova.compute.manager [None req-3f7133c9-45d5-4734-aec2-5fe15dc3c471 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] [instance: f3245b74-dbe8-4b8b-83b6-58a4811fdba9] Allocating IP information in the background. {{(pid=71509) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 10:48:13 user nova-compute[71509]: DEBUG nova.network.neutron [None req-3f7133c9-45d5-4734-aec2-5fe15dc3c471 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] [instance: f3245b74-dbe8-4b8b-83b6-58a4811fdba9] allocate_for_instance() {{(pid=71509) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 10:48:13 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-3f7133c9-45d5-4734-aec2-5fe15dc3c471 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] [instance: f3245b74-dbe8-4b8b-83b6-58a4811fdba9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 10:48:13 user nova-compute[71509]: DEBUG nova.compute.manager [None req-3f7133c9-45d5-4734-aec2-5fe15dc3c471 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] [instance: f3245b74-dbe8-4b8b-83b6-58a4811fdba9] Start building block device mappings for instance. {{(pid=71509) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 10:48:13 user nova-compute[71509]: DEBUG nova.policy [None req-3f7133c9-45d5-4734-aec2-5fe15dc3c471 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6adefa90332c42c79a1372258a7be5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aca26975e5ad4524b4b1b1ec4335802f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71509) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 10:48:13 user nova-compute[71509]: DEBUG nova.compute.manager [None req-3f7133c9-45d5-4734-aec2-5fe15dc3c471 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] [instance: f3245b74-dbe8-4b8b-83b6-58a4811fdba9] Start spawning the instance on the hypervisor. {{(pid=71509) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 10:48:13 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-3f7133c9-45d5-4734-aec2-5fe15dc3c471 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] [instance: f3245b74-dbe8-4b8b-83b6-58a4811fdba9] Creating instance directory {{(pid=71509) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 10:48:13 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-3f7133c9-45d5-4734-aec2-5fe15dc3c471 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] [instance: f3245b74-dbe8-4b8b-83b6-58a4811fdba9] Creating image(s)
Apr 14 10:48:13 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-3f7133c9-45d5-4734-aec2-5fe15dc3c471 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Acquiring lock "/opt/stack/data/nova/instances/f3245b74-dbe8-4b8b-83b6-58a4811fdba9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:48:13 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-3f7133c9-45d5-4734-aec2-5fe15dc3c471 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Lock "/opt/stack/data/nova/instances/f3245b74-dbe8-4b8b-83b6-58a4811fdba9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.003s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:48:13 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-3f7133c9-45d5-4734-aec2-5fe15dc3c471 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Lock "/opt/stack/data/nova/instances/f3245b74-dbe8-4b8b-83b6-58a4811fdba9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.014s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:48:13 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-3f7133c9-45d5-4734-aec2-5fe15dc3c471 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:48:13 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-3f7133c9-45d5-4734-aec2-5fe15dc3c471 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json" returned: 0 in 0.193s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:48:13 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-3f7133c9-45d5-4734-aec2-5fe15dc3c471 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Acquiring lock "5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:48:13 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-3f7133c9-45d5-4734-aec2-5fe15dc3c471 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Lock "5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:48:13 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-3f7133c9-45d5-4734-aec2-5fe15dc3c471 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:48:13 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-3f7133c9-45d5-4734-aec2-5fe15dc3c471 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json" returned: 0 in 0.144s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:48:13 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-3f7133c9-45d5-4734-aec2-5fe15dc3c471 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18,backing_fmt=raw /opt/stack/data/nova/instances/f3245b74-dbe8-4b8b-83b6-58a4811fdba9/disk 1073741824 {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:48:13 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-3f7133c9-45d5-4734-aec2-5fe15dc3c471 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18,backing_fmt=raw /opt/stack/data/nova/instances/f3245b74-dbe8-4b8b-83b6-58a4811fdba9/disk 1073741824" returned: 0 in 0.056s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:48:13 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-3f7133c9-45d5-4734-aec2-5fe15dc3c471 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Lock "5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.207s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:48:13 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-3f7133c9-45d5-4734-aec2-5fe15dc3c471 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:48:13 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-3f7133c9-45d5-4734-aec2-5fe15dc3c471 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json" returned: 0 in 0.154s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:48:13 user nova-compute[71509]: DEBUG nova.virt.disk.api [None req-3f7133c9-45d5-4734-aec2-5fe15dc3c471 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f3245b74-dbe8-4b8b-83b6-58a4811fdba9/disk. size=1073741824 {{(pid=71509) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 10:48:13 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-3f7133c9-45d5-4734-aec2-5fe15dc3c471 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3245b74-dbe8-4b8b-83b6-58a4811fdba9/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:48:14 user nova-compute[71509]: DEBUG nova.network.neutron [None req-3f7133c9-45d5-4734-aec2-5fe15dc3c471 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] [instance: f3245b74-dbe8-4b8b-83b6-58a4811fdba9] Successfully created port: 9abeb28a-35f1-4e16-a152-ed2578e8a678 {{(pid=71509) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 10:48:14 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:48:14 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-3f7133c9-45d5-4734-aec2-5fe15dc3c471 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3245b74-dbe8-4b8b-83b6-58a4811fdba9/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:48:14 user nova-compute[71509]: DEBUG nova.virt.disk.api [None req-3f7133c9-45d5-4734-aec2-5fe15dc3c471 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Cannot resize image /opt/stack/data/nova/instances/f3245b74-dbe8-4b8b-83b6-58a4811fdba9/disk to a smaller size. {{(pid=71509) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 10:48:14 user nova-compute[71509]: DEBUG nova.objects.instance [None req-3f7133c9-45d5-4734-aec2-5fe15dc3c471 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Lazy-loading 'migration_context' on Instance uuid f3245b74-dbe8-4b8b-83b6-58a4811fdba9 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:48:14 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-3f7133c9-45d5-4734-aec2-5fe15dc3c471 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] [instance: f3245b74-dbe8-4b8b-83b6-58a4811fdba9] Created local disks {{(pid=71509) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 10:48:14 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-3f7133c9-45d5-4734-aec2-5fe15dc3c471 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] [instance: f3245b74-dbe8-4b8b-83b6-58a4811fdba9] Ensure instance console log exists: /opt/stack/data/nova/instances/f3245b74-dbe8-4b8b-83b6-58a4811fdba9/console.log {{(pid=71509) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 10:48:14 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-3f7133c9-45d5-4734-aec2-5fe15dc3c471 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:48:14 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-3f7133c9-45d5-4734-aec2-5fe15dc3c471 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:48:14 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-3f7133c9-45d5-4734-aec2-5fe15dc3c471 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:48:14 user nova-compute[71509]: DEBUG nova.network.neutron [None req-3f7133c9-45d5-4734-aec2-5fe15dc3c471 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] [instance: f3245b74-dbe8-4b8b-83b6-58a4811fdba9] Successfully updated port: 9abeb28a-35f1-4e16-a152-ed2578e8a678 {{(pid=71509) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 10:48:15 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-3f7133c9-45d5-4734-aec2-5fe15dc3c471 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Acquiring lock "refresh_cache-f3245b74-dbe8-4b8b-83b6-58a4811fdba9" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:48:15 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-3f7133c9-45d5-4734-aec2-5fe15dc3c471 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Acquired lock "refresh_cache-f3245b74-dbe8-4b8b-83b6-58a4811fdba9" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:48:15 user nova-compute[71509]: DEBUG nova.network.neutron [None req-3f7133c9-45d5-4734-aec2-5fe15dc3c471 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] [instance: f3245b74-dbe8-4b8b-83b6-58a4811fdba9] Building network info cache for instance {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 10:48:15 user nova-compute[71509]: DEBUG nova.compute.manager [req-b2c9e270-42d2-42fe-a72c-eaf1495822e1 req-e70d6ccc-797b-45a2-b4b6-66a17c51ede1 service nova] [instance: f3245b74-dbe8-4b8b-83b6-58a4811fdba9] Received event network-changed-9abeb28a-35f1-4e16-a152-ed2578e8a678 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:48:15 user nova-compute[71509]: DEBUG nova.compute.manager [req-b2c9e270-42d2-42fe-a72c-eaf1495822e1 req-e70d6ccc-797b-45a2-b4b6-66a17c51ede1 service nova] [instance: f3245b74-dbe8-4b8b-83b6-58a4811fdba9] Refreshing instance network info cache due to event network-changed-9abeb28a-35f1-4e16-a152-ed2578e8a678. {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 10:48:15 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-b2c9e270-42d2-42fe-a72c-eaf1495822e1 req-e70d6ccc-797b-45a2-b4b6-66a17c51ede1 service nova] Acquiring lock "refresh_cache-f3245b74-dbe8-4b8b-83b6-58a4811fdba9" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:48:15 user nova-compute[71509]: DEBUG nova.network.neutron [None req-3f7133c9-45d5-4734-aec2-5fe15dc3c471 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] [instance: f3245b74-dbe8-4b8b-83b6-58a4811fdba9] Instance cache missing network info. {{(pid=71509) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 10:48:15 user nova-compute[71509]: DEBUG nova.network.neutron [None req-3f7133c9-45d5-4734-aec2-5fe15dc3c471 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] [instance: f3245b74-dbe8-4b8b-83b6-58a4811fdba9] Updating instance_info_cache with network_info: [{"id": "9abeb28a-35f1-4e16-a152-ed2578e8a678", "address": "fa:16:3e:54:9b:f3", "network": {"id": "36ccc911-348d-426a-ba7b-a49a0bfb0f97", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-256080753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aca26975e5ad4524b4b1b1ec4335802f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9abeb28a-35", "ovs_interfaceid": "9abeb28a-35f1-4e16-a152-ed2578e8a678", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:48:15 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-3f7133c9-45d5-4734-aec2-5fe15dc3c471 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Releasing lock "refresh_cache-f3245b74-dbe8-4b8b-83b6-58a4811fdba9" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:48:15 user nova-compute[71509]: DEBUG nova.compute.manager [None req-3f7133c9-45d5-4734-aec2-5fe15dc3c471 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] [instance: f3245b74-dbe8-4b8b-83b6-58a4811fdba9] Instance network_info: |[{"id": "9abeb28a-35f1-4e16-a152-ed2578e8a678", "address": "fa:16:3e:54:9b:f3", "network": {"id": "36ccc911-348d-426a-ba7b-a49a0bfb0f97", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-256080753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aca26975e5ad4524b4b1b1ec4335802f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9abeb28a-35", "ovs_interfaceid": "9abeb28a-35f1-4e16-a152-ed2578e8a678", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71509) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 10:48:15 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-b2c9e270-42d2-42fe-a72c-eaf1495822e1 req-e70d6ccc-797b-45a2-b4b6-66a17c51ede1 service nova] Acquired lock "refresh_cache-f3245b74-dbe8-4b8b-83b6-58a4811fdba9" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:48:15 user nova-compute[71509]: DEBUG nova.network.neutron [req-b2c9e270-42d2-42fe-a72c-eaf1495822e1 req-e70d6ccc-797b-45a2-b4b6-66a17c51ede1 service nova] [instance: f3245b74-dbe8-4b8b-83b6-58a4811fdba9] Refreshing network info cache for port 9abeb28a-35f1-4e16-a152-ed2578e8a678 {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 10:48:15 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-3f7133c9-45d5-4734-aec2-5fe15dc3c471 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] [instance: f3245b74-dbe8-4b8b-83b6-58a4811fdba9] Start _get_guest_xml network_info=[{"id": "9abeb28a-35f1-4e16-a152-ed2578e8a678", "address": "fa:16:3e:54:9b:f3", "network": {"id": "36ccc911-348d-426a-ba7b-a49a0bfb0f97", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-256080753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aca26975e5ad4524b4b1b1ec4335802f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9abeb28a-35", "ovs_interfaceid": "9abeb28a-35f1-4e16-a152-ed2578e8a678", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T10:38:55Z,direct_url=<?>,disk_format='qcow2',id=048ec0ee-0465-448d-8b4c-f072acb101dc,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='9742d6ad20cf48d9bab0fdbcc9491db9',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T10:38:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '048ec0ee-0465-448d-8b4c-f072acb101dc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71509) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 10:48:15 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-3f7133c9-45d5-4734-aec2-5fe15dc3c471 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:48:15 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-3f7133c9-45d5-4734-aec2-5fe15dc3c471 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:48:15 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-3f7133c9-45d5-4734-aec2-5fe15dc3c471 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71509) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 10:48:15 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-3f7133c9-45d5-4734-aec2-5fe15dc3c471 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T10:40:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T10:38:55Z,direct_url=<?>,disk_format='qcow2',id=048ec0ee-0465-448d-8b4c-f072acb101dc,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='9742d6ad20cf48d9bab0fdbcc9491db9',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T10:38:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 10:48:15 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-3f7133c9-45d5-4734-aec2-5fe15dc3c471 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Flavor limits 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 10:48:15 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-3f7133c9-45d5-4734-aec2-5fe15dc3c471 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Image limits 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 10:48:15 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-3f7133c9-45d5-4734-aec2-5fe15dc3c471 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Flavor pref 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 10:48:15 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-3f7133c9-45d5-4734-aec2-5fe15dc3c471 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Image pref 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 10:48:15 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-3f7133c9-45d5-4734-aec2-5fe15dc3c471 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 10:48:15 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-3f7133c9-45d5-4734-aec2-5fe15dc3c471 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 10:48:15 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-3f7133c9-45d5-4734-aec2-5fe15dc3c471 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71509) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 10:48:15 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-3f7133c9-45d5-4734-aec2-5fe15dc3c471 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Got 1 possible topologies {{(pid=71509) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 10:48:15 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-3f7133c9-45d5-4734-aec2-5fe15dc3c471 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 10:48:15 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-3f7133c9-45d5-4734-aec2-5fe15dc3c471 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 10:48:15 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-3f7133c9-45d5-4734-aec2-5fe15dc3c471 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T10:48:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-186982469',display_name='tempest-VolumesAdminNegativeTest-server-186982469',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-186982469',id=18,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC4n7cCmjQrFnx0jG2LyeLXh4VwIGx2PxO0+r8zAKj/Oj2f/50NTGIkyw35hqehB4Xb7vkg33UPXB0dq8gJQe8S7XSS6kQN94P7QD6GPEDoWU9GDCzvMWJoK2JE5ox6/6w==',key_name='tempest-keypair-685259735',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aca26975e5ad4524b4b1b1ec4335802f',ramdisk_id='',reservation_id='r-b60q9ed9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-5408590',owner_user_name='tempest-VolumesAdminNegativeTest-5408590-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T10:48:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6adefa90332c42c79a1372258a7be5ab',uuid=f3245b74-dbe8-4b8b-83b6-58a4811fdba9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9abeb28a-35f1-4e16-a152-ed2578e8a678", "address": "fa:16:3e:54:9b:f3", "network": {"id": "36ccc911-348d-426a-ba7b-a49a0bfb0f97", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-256080753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aca26975e5ad4524b4b1b1ec4335802f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9abeb28a-35", "ovs_interfaceid": "9abeb28a-35f1-4e16-a152-ed2578e8a678", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71509) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 10:48:15 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-3f7133c9-45d5-4734-aec2-5fe15dc3c471 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Converting VIF {"id": "9abeb28a-35f1-4e16-a152-ed2578e8a678", "address": "fa:16:3e:54:9b:f3", "network": {"id": "36ccc911-348d-426a-ba7b-a49a0bfb0f97", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-256080753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aca26975e5ad4524b4b1b1ec4335802f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9abeb28a-35", "ovs_interfaceid": "9abeb28a-35f1-4e16-a152-ed2578e8a678", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:48:15 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-3f7133c9-45d5-4734-aec2-5fe15dc3c471 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:9b:f3,bridge_name='br-int',has_traffic_filtering=True,id=9abeb28a-35f1-4e16-a152-ed2578e8a678,network=Network(36ccc911-348d-426a-ba7b-a49a0bfb0f97),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9abeb28a-35') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:48:15 user nova-compute[71509]: DEBUG nova.objects.instance [None req-3f7133c9-45d5-4734-aec2-5fe15dc3c471 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Lazy-loading 'pci_devices' on Instance uuid f3245b74-dbe8-4b8b-83b6-58a4811fdba9 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:48:15 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-3f7133c9-45d5-4734-aec2-5fe15dc3c471 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] [instance: f3245b74-dbe8-4b8b-83b6-58a4811fdba9] End _get_guest_xml xml=<domain type="kvm">
Apr 14 10:48:15 user nova-compute[71509]:   <uuid>f3245b74-dbe8-4b8b-83b6-58a4811fdba9</uuid>
Apr 14 10:48:15 user nova-compute[71509]:   <name>instance-00000012</name>
Apr 14 10:48:15 user nova-compute[71509]:   <memory>131072</memory>
Apr 14 10:48:15 user nova-compute[71509]:   <vcpu>1</vcpu>
Apr 14 10:48:15 user nova-compute[71509]:   <metadata>
Apr 14 10:48:15 user nova-compute[71509]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 10:48:15 user nova-compute[71509]:       <nova:package version="0.0.0"/>
Apr 14 10:48:15 user nova-compute[71509]:       <nova:name>tempest-VolumesAdminNegativeTest-server-186982469</nova:name>
Apr 14 10:48:15 user nova-compute[71509]:       <nova:creationTime>2023-04-14 10:48:15</nova:creationTime>
Apr 14 10:48:15 user nova-compute[71509]:       <nova:flavor name="m1.nano">
Apr 14 10:48:15 user nova-compute[71509]:         <nova:memory>128</nova:memory>
Apr 14 10:48:15 user nova-compute[71509]:         <nova:disk>1</nova:disk>
Apr 14 10:48:15 user nova-compute[71509]:         <nova:swap>0</nova:swap>
Apr 14 10:48:15 user nova-compute[71509]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 10:48:15 user nova-compute[71509]:         <nova:vcpus>1</nova:vcpus>
Apr 14 10:48:15 user nova-compute[71509]:       </nova:flavor>
Apr 14 10:48:15 user nova-compute[71509]:       <nova:owner>
Apr 14 10:48:15 user nova-compute[71509]:         <nova:user uuid="6adefa90332c42c79a1372258a7be5ab">tempest-VolumesAdminNegativeTest-5408590-project-member</nova:user>
Apr 14 10:48:15 user nova-compute[71509]:         <nova:project uuid="aca26975e5ad4524b4b1b1ec4335802f">tempest-VolumesAdminNegativeTest-5408590</nova:project>
Apr 14 10:48:15 user nova-compute[71509]:       </nova:owner>
Apr 14 10:48:15 user nova-compute[71509]:       <nova:root type="image" uuid="048ec0ee-0465-448d-8b4c-f072acb101dc"/>
Apr 14 10:48:15 user nova-compute[71509]:       <nova:ports>
Apr 14 10:48:15 user nova-compute[71509]:         <nova:port uuid="9abeb28a-35f1-4e16-a152-ed2578e8a678">
Apr 14 10:48:15 user nova-compute[71509]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 14 10:48:15 user nova-compute[71509]:         </nova:port>
Apr 14 10:48:15 user nova-compute[71509]:       </nova:ports>
Apr 14 10:48:15 user nova-compute[71509]:     </nova:instance>
Apr 14 10:48:15 user nova-compute[71509]:   </metadata>
Apr 14 10:48:15 user nova-compute[71509]:   <sysinfo type="smbios">
Apr 14 10:48:15 user nova-compute[71509]:     <system>
Apr 14 10:48:15 user nova-compute[71509]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 10:48:15 user nova-compute[71509]:       <entry name="product">OpenStack Nova</entry>
Apr 14 10:48:15 user nova-compute[71509]:       <entry name="version">0.0.0</entry>
Apr 14 10:48:15 user nova-compute[71509]:       <entry name="serial">f3245b74-dbe8-4b8b-83b6-58a4811fdba9</entry>
Apr 14 10:48:15 user nova-compute[71509]:       <entry name="uuid">f3245b74-dbe8-4b8b-83b6-58a4811fdba9</entry>
Apr 14 10:48:15 user nova-compute[71509]:       <entry name="family">Virtual Machine</entry>
Apr 14 10:48:15 user nova-compute[71509]:     </system>
Apr 14 10:48:15 user nova-compute[71509]:   </sysinfo>
Apr 14 10:48:15 user nova-compute[71509]:   <os>
Apr 14 10:48:15 user nova-compute[71509]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 10:48:15 user nova-compute[71509]:     <boot dev="hd"/>
Apr 14 10:48:15 user nova-compute[71509]:     <smbios mode="sysinfo"/>
Apr 14 10:48:15 user nova-compute[71509]:   </os>
Apr 14 10:48:15 user nova-compute[71509]:   <features>
Apr 14 10:48:15 user nova-compute[71509]:     <acpi/>
Apr 14 10:48:15 user nova-compute[71509]:     <apic/>
Apr 14 10:48:15 user nova-compute[71509]:     <vmcoreinfo/>
Apr 14 10:48:15 user nova-compute[71509]:   </features>
Apr 14 10:48:15 user nova-compute[71509]:   <clock offset="utc">
Apr 14 10:48:15 user nova-compute[71509]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 10:48:15 user nova-compute[71509]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 10:48:15 user nova-compute[71509]:     <timer name="hpet" present="no"/>
Apr 14 10:48:15 user nova-compute[71509]:   </clock>
Apr 14 10:48:15 user nova-compute[71509]:   <cpu mode="custom" match="exact">
Apr 14 10:48:15 user nova-compute[71509]:     <model>Nehalem</model>
Apr 14 10:48:15 user nova-compute[71509]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 10:48:15 user nova-compute[71509]:   </cpu>
Apr 14 10:48:15 user nova-compute[71509]:   <devices>
Apr 14 10:48:15 user nova-compute[71509]:     <disk type="file" device="disk">
Apr 14 10:48:15 user nova-compute[71509]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 10:48:15 user nova-compute[71509]:       <source file="/opt/stack/data/nova/instances/f3245b74-dbe8-4b8b-83b6-58a4811fdba9/disk"/>
Apr 14 10:48:15 user nova-compute[71509]:       <target dev="vda" bus="virtio"/>
Apr 14 10:48:15 user nova-compute[71509]:     </disk>
Apr 14 10:48:15 user nova-compute[71509]:     <interface type="ethernet">
Apr 14 10:48:15 user nova-compute[71509]:       <mac address="fa:16:3e:54:9b:f3"/>
Apr 14 10:48:15 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 10:48:15 user nova-compute[71509]:       <mtu size="1442"/>
Apr 14 10:48:15 user nova-compute[71509]:       <target dev="tap9abeb28a-35"/>
Apr 14 10:48:15 user nova-compute[71509]:     </interface>
Apr 14 10:48:15 user nova-compute[71509]:     <serial type="pty">
Apr 14 10:48:15 user nova-compute[71509]:       <log file="/opt/stack/data/nova/instances/f3245b74-dbe8-4b8b-83b6-58a4811fdba9/console.log" append="off"/>
Apr 14 10:48:15 user nova-compute[71509]:     </serial>
Apr 14 10:48:15 user nova-compute[71509]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 10:48:15 user nova-compute[71509]:     <video>
Apr 14 10:48:15 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 10:48:15 user nova-compute[71509]:     </video>
Apr 14 10:48:15 user nova-compute[71509]:     <rng model="virtio">
Apr 14 10:48:15 user nova-compute[71509]:       <backend model="random">/dev/urandom</backend>
Apr 14 10:48:15 user nova-compute[71509]:     </rng>
Apr 14 10:48:15 user nova-compute[71509]:     <controller type="usb" index="0" model="none"/>
Apr 14 10:48:15 user nova-compute[71509]:     <memballoon model="virtio">
Apr 14 10:48:15 user nova-compute[71509]:       <stats period="10"/>
Apr 14 10:48:15 user nova-compute[71509]:     </memballoon>
Apr 14 10:48:15 user nova-compute[71509]:   </devices>
Apr 14 10:48:15 user nova-compute[71509]: </domain>
Apr 14 10:48:15 user nova-compute[71509]:  {{(pid=71509) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 10:48:15 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-3f7133c9-45d5-4734-aec2-5fe15dc3c471 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T10:48:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-186982469',display_name='tempest-VolumesAdminNegativeTest-server-186982469',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-186982469',id=18,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC4n7cCmjQrFnx0jG2LyeLXh4VwIGx2PxO0+r8zAKj/Oj2f/50NTGIkyw35hqehB4Xb7vkg33UPXB0dq8gJQe8S7XSS6kQN94P7QD6GPEDoWU9GDCzvMWJoK2JE5ox6/6w==',key_name='tempest-keypair-685259735',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aca26975e5ad4524b4b1b1ec4335802f',ramdisk_id='',reservation_id='r-b60q9ed9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-5408590',owner_user_name='tempest-VolumesAdminNegativeTest-5408590-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T10:48:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6adefa90332c42c79a1372258a7be5ab',uuid=f3245b74-dbe8-4b8b-83b6-58a4811fdba9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9abeb28a-35f1-4e16-a152-ed2578e8a678", "address": "fa:16:3e:54:9b:f3", "network": {"id": "36ccc911-348d-426a-ba7b-a49a0bfb0f97", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-256080753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aca26975e5ad4524b4b1b1ec4335802f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9abeb28a-35", "ovs_interfaceid": "9abeb28a-35f1-4e16-a152-ed2578e8a678", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 10:48:15 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-3f7133c9-45d5-4734-aec2-5fe15dc3c471 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Converting VIF {"id": "9abeb28a-35f1-4e16-a152-ed2578e8a678", "address": "fa:16:3e:54:9b:f3", "network": {"id": "36ccc911-348d-426a-ba7b-a49a0bfb0f97", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-256080753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aca26975e5ad4524b4b1b1ec4335802f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9abeb28a-35", "ovs_interfaceid": "9abeb28a-35f1-4e16-a152-ed2578e8a678", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:48:15 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-3f7133c9-45d5-4734-aec2-5fe15dc3c471 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:9b:f3,bridge_name='br-int',has_traffic_filtering=True,id=9abeb28a-35f1-4e16-a152-ed2578e8a678,network=Network(36ccc911-348d-426a-ba7b-a49a0bfb0f97),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9abeb28a-35') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:48:15 user nova-compute[71509]: DEBUG os_vif [None req-3f7133c9-45d5-4734-aec2-5fe15dc3c471 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:9b:f3,bridge_name='br-int',has_traffic_filtering=True,id=9abeb28a-35f1-4e16-a152-ed2578e8a678,network=Network(36ccc911-348d-426a-ba7b-a49a0bfb0f97),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9abeb28a-35') {{(pid=71509) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 10:48:15 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:48:15 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:48:15 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 10:48:15 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:48:15 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9abeb28a-35, may_exist=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:48:15 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9abeb28a-35, col_values=(('external_ids', {'iface-id': '9abeb28a-35f1-4e16-a152-ed2578e8a678', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:54:9b:f3', 'vm-uuid': 'f3245b74-dbe8-4b8b-83b6-58a4811fdba9'}),)) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:48:15 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:48:15 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 10:48:15 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:48:15 user nova-compute[71509]: INFO os_vif [None req-3f7133c9-45d5-4734-aec2-5fe15dc3c471 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:9b:f3,bridge_name='br-int',has_traffic_filtering=True,id=9abeb28a-35f1-4e16-a152-ed2578e8a678,network=Network(36ccc911-348d-426a-ba7b-a49a0bfb0f97),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9abeb28a-35')
Apr 14 10:48:15 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-3f7133c9-45d5-4734-aec2-5fe15dc3c471 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] No BDM found with device name vda, not building metadata. {{(pid=71509) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 10:48:15 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-3f7133c9-45d5-4734-aec2-5fe15dc3c471 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] No VIF found with MAC fa:16:3e:54:9b:f3, not building metadata {{(pid=71509) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 10:48:16 user nova-compute[71509]: DEBUG nova.network.neutron [req-b2c9e270-42d2-42fe-a72c-eaf1495822e1 req-e70d6ccc-797b-45a2-b4b6-66a17c51ede1 service nova] [instance: f3245b74-dbe8-4b8b-83b6-58a4811fdba9] Updated VIF entry in instance network info cache for port 9abeb28a-35f1-4e16-a152-ed2578e8a678. {{(pid=71509) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 10:48:16 user nova-compute[71509]: DEBUG nova.network.neutron [req-b2c9e270-42d2-42fe-a72c-eaf1495822e1 req-e70d6ccc-797b-45a2-b4b6-66a17c51ede1 service nova] [instance: f3245b74-dbe8-4b8b-83b6-58a4811fdba9] Updating instance_info_cache with network_info: [{"id": "9abeb28a-35f1-4e16-a152-ed2578e8a678", "address": "fa:16:3e:54:9b:f3", "network": {"id": "36ccc911-348d-426a-ba7b-a49a0bfb0f97", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-256080753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aca26975e5ad4524b4b1b1ec4335802f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9abeb28a-35", "ovs_interfaceid": "9abeb28a-35f1-4e16-a152-ed2578e8a678", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:48:16 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-b2c9e270-42d2-42fe-a72c-eaf1495822e1 req-e70d6ccc-797b-45a2-b4b6-66a17c51ede1 service nova] Releasing lock "refresh_cache-f3245b74-dbe8-4b8b-83b6-58a4811fdba9" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:48:16 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-06e4cf91-40fa-41a3-be68-61a95ce69568 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Acquiring lock "55178126-9766-4875-9122-39dcc87ce82c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:48:16 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-06e4cf91-40fa-41a3-be68-61a95ce69568 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "55178126-9766-4875-9122-39dcc87ce82c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:48:16 user nova-compute[71509]: DEBUG nova.objects.instance [None req-06e4cf91-40fa-41a3-be68-61a95ce69568 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lazy-loading 'flavor' on Instance uuid 55178126-9766-4875-9122-39dcc87ce82c {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:48:16 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-06e4cf91-40fa-41a3-be68-61a95ce69568 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "55178126-9766-4875-9122-39dcc87ce82c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.076s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:48:16 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-06e4cf91-40fa-41a3-be68-61a95ce69568 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Acquiring lock "55178126-9766-4875-9122-39dcc87ce82c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:48:16 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-06e4cf91-40fa-41a3-be68-61a95ce69568 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "55178126-9766-4875-9122-39dcc87ce82c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:48:16 user nova-compute[71509]: INFO nova.compute.manager [None req-06e4cf91-40fa-41a3-be68-61a95ce69568 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] [instance: 55178126-9766-4875-9122-39dcc87ce82c] Attaching volume fa52f0fe-627e-4b45-aa2b-0c85864afcaf to /dev/vdb
Apr 14 10:48:16 user nova-compute[71509]: DEBUG os_brick.utils [None req-06e4cf91-40fa-41a3-be68-61a95ce69568 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 10:48:16 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:48:16 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:48:16 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cf1a270-00d2-4ff0-b22a-1ebb6b6b400a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50119df3c417\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:48:16 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:48:16 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:48:16 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[17514e8b-88b2-4513-8981-5b79a43c507c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:48:16 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:48:16 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:48:16 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c90ca98-dd15-4879-9394-daad1a09a3e6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:48:16 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[b541705d-68ef-4d10-97d4-f366717e7cd4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:48:16 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-06e4cf91-40fa-41a3-be68-61a95ce69568 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Running cmd (subprocess): nvme version {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:48:16 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-06e4cf91-40fa-41a3-be68-61a95ce69568 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] 'nvme version' failed. Not Retrying. {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 10:48:16 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.nvmeof [None req-06e4cf91-40fa-41a3-be68-61a95ce69568 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] nvme not present on system {{(pid=71509) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 10:48:16 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:48:17 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 10:48:17 user nova-compute[71509]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 10:48:17 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc00ca0d-854a-4df0-83c3-03c7b223c53c]: (4, '') {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:48:17 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-06e4cf91-40fa-41a3-be68-61a95ce69568 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71509) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 10:48:17 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-06e4cf91-40fa-41a3-be68-61a95ce69568 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71509) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 10:48:17 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-06e4cf91-40fa-41a3-be68-61a95ce69568 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] LIGHTOS: no hostnqn found. {{(pid=71509) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 10:48:17 user nova-compute[71509]: DEBUG os_brick.utils [None req-06e4cf91-40fa-41a3-be68-61a95ce69568 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50119df3c417', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 10:48:17 user nova-compute[71509]: DEBUG nova.virt.block_device [None req-06e4cf91-40fa-41a3-be68-61a95ce69568 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] [instance: 55178126-9766-4875-9122-39dcc87ce82c] Updating existing volume attachment record: c1095176-6905-4b2e-a1eb-ea3191c5f635 {{(pid=71509) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 10:48:17 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:48:17 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:48:17 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:48:17 user nova-compute[71509]: DEBUG nova.compute.manager [req-3b655055-4c37-4cd9-9eff-5876a0102f0f req-cc13c7b4-dbe5-4d82-9f2e-e2e7dd05cda6 service nova] [instance: f3245b74-dbe8-4b8b-83b6-58a4811fdba9] Received event network-vif-plugged-9abeb28a-35f1-4e16-a152-ed2578e8a678 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:48:17 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-3b655055-4c37-4cd9-9eff-5876a0102f0f req-cc13c7b4-dbe5-4d82-9f2e-e2e7dd05cda6 service nova] Acquiring lock "f3245b74-dbe8-4b8b-83b6-58a4811fdba9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:48:17 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-3b655055-4c37-4cd9-9eff-5876a0102f0f req-cc13c7b4-dbe5-4d82-9f2e-e2e7dd05cda6 service nova] Lock "f3245b74-dbe8-4b8b-83b6-58a4811fdba9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:48:17 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-3b655055-4c37-4cd9-9eff-5876a0102f0f req-cc13c7b4-dbe5-4d82-9f2e-e2e7dd05cda6 service nova] Lock "f3245b74-dbe8-4b8b-83b6-58a4811fdba9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:48:17 user nova-compute[71509]: DEBUG nova.compute.manager [req-3b655055-4c37-4cd9-9eff-5876a0102f0f req-cc13c7b4-dbe5-4d82-9f2e-e2e7dd05cda6 service nova] [instance: f3245b74-dbe8-4b8b-83b6-58a4811fdba9] No waiting events found dispatching network-vif-plugged-9abeb28a-35f1-4e16-a152-ed2578e8a678 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:48:17 user nova-compute[71509]: WARNING nova.compute.manager [req-3b655055-4c37-4cd9-9eff-5876a0102f0f req-cc13c7b4-dbe5-4d82-9f2e-e2e7dd05cda6 service nova] [instance: f3245b74-dbe8-4b8b-83b6-58a4811fdba9] Received unexpected event network-vif-plugged-9abeb28a-35f1-4e16-a152-ed2578e8a678 for instance with vm_state building and task_state spawning.
Apr 14 10:48:17 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:48:17 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:48:17 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:48:19 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681469299.3791783, f3245b74-dbe8-4b8b-83b6-58a4811fdba9 => Resumed> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 10:48:19 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: f3245b74-dbe8-4b8b-83b6-58a4811fdba9] VM Resumed (Lifecycle Event)
Apr 14 10:48:19 user nova-compute[71509]: DEBUG nova.compute.manager [None req-3f7133c9-45d5-4734-aec2-5fe15dc3c471 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] [instance: f3245b74-dbe8-4b8b-83b6-58a4811fdba9] Instance event wait completed in 0 seconds for  {{(pid=71509) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 10:48:19 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-3f7133c9-45d5-4734-aec2-5fe15dc3c471 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] [instance: f3245b74-dbe8-4b8b-83b6-58a4811fdba9] Guest created on hypervisor {{(pid=71509) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 10:48:19 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: f3245b74-dbe8-4b8b-83b6-58a4811fdba9] Instance spawned successfully.
Apr 14 10:48:19 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-3f7133c9-45d5-4734-aec2-5fe15dc3c471 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] [instance: f3245b74-dbe8-4b8b-83b6-58a4811fdba9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 10:48:19 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: f3245b74-dbe8-4b8b-83b6-58a4811fdba9] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:48:19 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: f3245b74-dbe8-4b8b-83b6-58a4811fdba9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 10:48:19 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-3f7133c9-45d5-4734-aec2-5fe15dc3c471 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] [instance: f3245b74-dbe8-4b8b-83b6-58a4811fdba9] Found default for hw_cdrom_bus of ide {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:48:19 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-3f7133c9-45d5-4734-aec2-5fe15dc3c471 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] [instance: f3245b74-dbe8-4b8b-83b6-58a4811fdba9] Found default for hw_disk_bus of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:48:19 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-3f7133c9-45d5-4734-aec2-5fe15dc3c471 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] [instance: f3245b74-dbe8-4b8b-83b6-58a4811fdba9] Found default for hw_input_bus of None {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:48:19 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-3f7133c9-45d5-4734-aec2-5fe15dc3c471 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] [instance: f3245b74-dbe8-4b8b-83b6-58a4811fdba9] Found default for hw_pointer_model of None {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:48:19 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-3f7133c9-45d5-4734-aec2-5fe15dc3c471 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] [instance: f3245b74-dbe8-4b8b-83b6-58a4811fdba9] Found default for hw_video_model of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:48:19 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-3f7133c9-45d5-4734-aec2-5fe15dc3c471 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] [instance: f3245b74-dbe8-4b8b-83b6-58a4811fdba9] Found default for hw_vif_model of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:48:19 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: f3245b74-dbe8-4b8b-83b6-58a4811fdba9] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 10:48:19 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681469299.3849995, f3245b74-dbe8-4b8b-83b6-58a4811fdba9 => Started> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 10:48:19 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: f3245b74-dbe8-4b8b-83b6-58a4811fdba9] VM Started (Lifecycle Event)
Apr 14 10:48:19 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: f3245b74-dbe8-4b8b-83b6-58a4811fdba9] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:48:19 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: f3245b74-dbe8-4b8b-83b6-58a4811fdba9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 10:48:19 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: f3245b74-dbe8-4b8b-83b6-58a4811fdba9] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 10:48:19 user nova-compute[71509]: INFO nova.compute.manager [None req-3f7133c9-45d5-4734-aec2-5fe15dc3c471 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] [instance: f3245b74-dbe8-4b8b-83b6-58a4811fdba9] Took 6.19 seconds to spawn the instance on the hypervisor.
Apr 14 10:48:19 user nova-compute[71509]: DEBUG nova.compute.manager [None req-3f7133c9-45d5-4734-aec2-5fe15dc3c471 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] [instance: f3245b74-dbe8-4b8b-83b6-58a4811fdba9] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:48:19 user nova-compute[71509]: DEBUG nova.compute.manager [req-e759d5b1-817f-42d8-bf55-a66c947028b8 req-8681a99a-4f3a-496a-9ed6-f4eec38b6507 service nova] [instance: f3245b74-dbe8-4b8b-83b6-58a4811fdba9] Received event network-vif-plugged-9abeb28a-35f1-4e16-a152-ed2578e8a678 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:48:19 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-e759d5b1-817f-42d8-bf55-a66c947028b8 req-8681a99a-4f3a-496a-9ed6-f4eec38b6507 service nova] Acquiring lock "f3245b74-dbe8-4b8b-83b6-58a4811fdba9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:48:19 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-e759d5b1-817f-42d8-bf55-a66c947028b8 req-8681a99a-4f3a-496a-9ed6-f4eec38b6507 service nova] Lock "f3245b74-dbe8-4b8b-83b6-58a4811fdba9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:48:19 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-e759d5b1-817f-42d8-bf55-a66c947028b8 req-8681a99a-4f3a-496a-9ed6-f4eec38b6507 service nova] Lock "f3245b74-dbe8-4b8b-83b6-58a4811fdba9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:48:19 user nova-compute[71509]: DEBUG nova.compute.manager [req-e759d5b1-817f-42d8-bf55-a66c947028b8 req-8681a99a-4f3a-496a-9ed6-f4eec38b6507 service nova] [instance: f3245b74-dbe8-4b8b-83b6-58a4811fdba9] No waiting events found dispatching network-vif-plugged-9abeb28a-35f1-4e16-a152-ed2578e8a678 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:48:19 user nova-compute[71509]: WARNING nova.compute.manager [req-e759d5b1-817f-42d8-bf55-a66c947028b8 req-8681a99a-4f3a-496a-9ed6-f4eec38b6507 service nova] [instance: f3245b74-dbe8-4b8b-83b6-58a4811fdba9] Received unexpected event network-vif-plugged-9abeb28a-35f1-4e16-a152-ed2578e8a678 for instance with vm_state building and task_state spawning.
Apr 14 10:48:19 user nova-compute[71509]: INFO nova.compute.manager [None req-3f7133c9-45d5-4734-aec2-5fe15dc3c471 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] [instance: f3245b74-dbe8-4b8b-83b6-58a4811fdba9] Took 6.97 seconds to build instance.
Apr 14 10:48:19 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-3f7133c9-45d5-4734-aec2-5fe15dc3c471 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Lock "f3245b74-dbe8-4b8b-83b6-58a4811fdba9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.066s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:48:20 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:48:21 user nova-compute[71509]: DEBUG nova.compute.manager [None req-80a27386-cbac-4571-b690-2b4b6ff8cadb tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: e479154a-acd6-47aa-9a5b-43c6e0feda07] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:48:21 user nova-compute[71509]: INFO nova.compute.manager [None req-80a27386-cbac-4571-b690-2b4b6ff8cadb tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: e479154a-acd6-47aa-9a5b-43c6e0feda07] instance snapshotting
Apr 14 10:48:21 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-80a27386-cbac-4571-b690-2b4b6ff8cadb tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: e479154a-acd6-47aa-9a5b-43c6e0feda07] Beginning live snapshot process
Apr 14 10:48:21 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-80a27386-cbac-4571-b690-2b4b6ff8cadb tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e479154a-acd6-47aa-9a5b-43c6e0feda07/disk --force-share --output=json -f qcow2 {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:48:21 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-80a27386-cbac-4571-b690-2b4b6ff8cadb tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e479154a-acd6-47aa-9a5b-43c6e0feda07/disk --force-share --output=json -f qcow2" returned: 0 in 0.146s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:48:21 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-80a27386-cbac-4571-b690-2b4b6ff8cadb tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e479154a-acd6-47aa-9a5b-43c6e0feda07/disk --force-share --output=json -f qcow2 {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:48:21 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-06e4cf91-40fa-41a3-be68-61a95ce69568 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] [instance: 55178126-9766-4875-9122-39dcc87ce82c] Calling os-brick to attach iSCSI Volume {{(pid=71509) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 10:48:21 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-06e4cf91-40fa-41a3-be68-61a95ce69568 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0bf0749390>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fa52f0fe-627e-4b45-aa2b-0c85864afcaf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VqKhfkGs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 10:48:21 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-06e4cf91-40fa-41a3-be68-61a95ce69568 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 10:48:21 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-06e4cf91-40fa-41a3-be68-61a95ce69568 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 10:48:21 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-06e4cf91-40fa-41a3-be68-61a95ce69568 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 10:48:21 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-06e4cf91-40fa-41a3-be68-61a95ce69568 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 10:48:21 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-06e4cf91-40fa-41a3-be68-61a95ce69568 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa52f0fe-627e-4b45-aa2b-0c85864afcaf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 10:48:21 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-06e4cf91-40fa-41a3-be68-61a95ce69568 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa52f0fe-627e-4b45-aa2b-0c85864afcaf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 10:48:21 user nova-compute[71509]: INFO os_brick.initiator.connectors.iscsi [None req-06e4cf91-40fa-41a3-be68-61a95ce69568 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 10:48:21 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa52f0fe-627e-4b45-aa2b-0c85864afcaf -p 172.16.0.220:3260 {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:48:21 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa52f0fe-627e-4b45-aa2b-0c85864afcaf -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:48:21 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6db1b18-ce47-49be-ab44-0f35a596c387]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:48:21 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-06e4cf91-40fa-41a3-be68-61a95ce69568 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 10:48:21 user nova-compute[71509]:  {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:48:21 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa52f0fe-627e-4b45-aa2b-0c85864afcaf -p 172.16.0.220:3260 --interface default --op new {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:48:21 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa52f0fe-627e-4b45-aa2b-0c85864afcaf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:48:21 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[60eea207-2c6e-4381-844c-56024f44dca7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fa52f0fe-627e-4b45-aa2b-0c85864afcaf] added\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:48:21 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-06e4cf91-40fa-41a3-be68-61a95ce69568 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fa52f0fe-627e-4b45-aa2b-0c85864afcaf] added
Apr 14 10:48:21 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:48:21 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa52f0fe-627e-4b45-aa2b-0c85864afcaf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:48:21 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-80a27386-cbac-4571-b690-2b4b6ff8cadb tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e479154a-acd6-47aa-9a5b-43c6e0feda07/disk --force-share --output=json -f qcow2" returned: 0 in 0.147s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:48:21 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-80a27386-cbac-4571-b690-2b4b6ff8cadb tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:48:21 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa52f0fe-627e-4b45-aa2b-0c85864afcaf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:48:21 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[f975edb3-aeab-426d-a52a-cf1ee34f9b25]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:48:21 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-06e4cf91-40fa-41a3-be68-61a95ce69568 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:48:21 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa52f0fe-627e-4b45-aa2b-0c85864afcaf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:48:21 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa52f0fe-627e-4b45-aa2b-0c85864afcaf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:48:21 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bcf8031-e1d0-4c15-b50c-85be79987d94]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:48:21 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-06e4cf91-40fa-41a3-be68-61a95ce69568 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:48:21 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa52f0fe-627e-4b45-aa2b-0c85864afcaf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VqKhfkGs {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:48:21 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa52f0fe-627e-4b45-aa2b-0c85864afcaf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VqKhfkGs" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:48:21 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[10a99405-f40e-41ee-a520-43809d4ef5da]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:48:21 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-06e4cf91-40fa-41a3-be68-61a95ce69568 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VqKhfkGs'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:48:21 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa52f0fe-627e-4b45-aa2b-0c85864afcaf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:48:21 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa52f0fe-627e-4b45-aa2b-0c85864afcaf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:48:21 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cb9e1e2-6e62-4c3b-a230-6dbf107d5f22]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:48:21 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-06e4cf91-40fa-41a3-be68-61a95ce69568 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:48:21 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:48:21 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-80a27386-cbac-4571-b690-2b4b6ff8cadb tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json" returned: 0 in 0.135s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:48:21 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-80a27386-cbac-4571-b690-2b4b6ff8cadb tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp2uvomcjt/8c61d7c67b274fe4938438a75dc9003c.delta 1073741824 {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:48:21 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:48:21 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cea5b82-460d-4646-b879-b6eca1a0614d]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4116efc6-988f-40cf-af06-2abf9c6cd44a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:48:21 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-06e4cf91-40fa-41a3-be68-61a95ce69568 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4116efc6-988f-40cf-af06-2abf9c6cd44a (non-flash)
Apr 14 10:48:21 user nova-compute[71509]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d (non-flash)
Apr 14 10:48:21 user nova-compute[71509]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee (non-flash)
Apr 14 10:48:21 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:48:21 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-06e4cf91-40fa-41a3-be68-61a95ce69568 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4116efc6-988f-40cf-af06-2abf9c6cd44a (non-flash)
Apr 14 10:48:21 user nova-compute[71509]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d (non-flash)
Apr 14 10:48:21 user nova-compute[71509]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee (non-flash)
Apr 14 10:48:21 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 10:48:21 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa52f0fe-627e-4b45-aa2b-0c85864afcaf -p 172.16.0.220:3260 --login {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:48:21 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-80a27386-cbac-4571-b690-2b4b6ff8cadb tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp2uvomcjt/8c61d7c67b274fe4938438a75dc9003c.delta 1073741824" returned: 0 in 0.049s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:48:21 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-80a27386-cbac-4571-b690-2b4b6ff8cadb tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: e479154a-acd6-47aa-9a5b-43c6e0feda07] Quiescing instance not available: QEMU guest agent is not enabled.
Apr 14 10:48:22 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa52f0fe-627e-4b45-aa2b-0c85864afcaf -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:48:22 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eec28ad-8210-4a0d-8d58-d3e1a892b6ee]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fa52f0fe-627e-4b45-aa2b-0c85864afcaf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fa52f0fe-627e-4b45-aa2b-0c85864afcaf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:48:22 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-06e4cf91-40fa-41a3-be68-61a95ce69568 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fa52f0fe-627e-4b45-aa2b-0c85864afcaf, portal: 172.16.0.220,3260]
Apr 14 10:48:22 user nova-compute[71509]: Login to [iface: default, target: iqn.2010-10.org.openstack:fa52f0fe-627e-4b45-aa2b-0c85864afcaf, portal: 172.16.0.220,3260] successful.
Apr 14 10:48:22 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:48:22 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa52f0fe-627e-4b45-aa2b-0c85864afcaf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:48:22 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa52f0fe-627e-4b45-aa2b-0c85864afcaf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:48:22 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[90b8eda8-4d35-4713-99f2-4e94aadd1860]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:48:22 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-06e4cf91-40fa-41a3-be68-61a95ce69568 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:48:22 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:48:22 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:48:22 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aa92622-0330-49d4-911b-89624b4a59ec]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4116efc6-988f-40cf-af06-2abf9c6cd44a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa52f0fe-627e-4b45-aa2b-0c85864afcaf (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:48:22 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-06e4cf91-40fa-41a3-be68-61a95ce69568 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4116efc6-988f-40cf-af06-2abf9c6cd44a (non-flash)
Apr 14 10:48:22 user nova-compute[71509]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d (non-flash)
Apr 14 10:48:22 user nova-compute[71509]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee (non-flash)
Apr 14 10:48:22 user nova-compute[71509]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa52f0fe-627e-4b45-aa2b-0c85864afcaf (non-flash)
Apr 14 10:48:22 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:48:22 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-06e4cf91-40fa-41a3-be68-61a95ce69568 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4116efc6-988f-40cf-af06-2abf9c6cd44a (non-flash)
Apr 14 10:48:22 user nova-compute[71509]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d (non-flash)
Apr 14 10:48:22 user nova-compute[71509]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee (non-flash)
Apr 14 10:48:22 user nova-compute[71509]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa52f0fe-627e-4b45-aa2b-0c85864afcaf (non-flash)
Apr 14 10:48:22 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 10:48:22 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-06e4cf91-40fa-41a3-be68-61a95ce69568 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa52f0fe-627e-4b45-aa2b-0c85864afcaf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.368s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 10:48:22 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-06e4cf91-40fa-41a3-be68-61a95ce69568 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Connected to 172.16.0.220:3260 {{(pid=71509) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 10:48:22 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-06e4cf91-40fa-41a3-be68-61a95ce69568 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] HCTL ('36', '-', '-', 0) found on session 21 with lun 0 {{(pid=71509) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 10:48:22 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-06e4cf91-40fa-41a3-be68-61a95ce69568 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71509) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 10:48:22 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:48:22 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:48:22 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2db7ece-f8e3-4ee3-8308-63e7d5268880]: (4, ('- - 0', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:48:22 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-06e4cf91-40fa-41a3-be68-61a95ce69568 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Searching for a device in session 21 and hctl ['36', '*', '*', 0] yield: None {{(pid=71509) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 10:48:22 user nova-compute[71509]: DEBUG nova.virt.libvirt.guest [None req-80a27386-cbac-4571-b690-2b4b6ff8cadb tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] COPY block job progress, current cursor: 0 final cursor: 43778048 {{(pid=71509) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 10:48:22 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:48:23 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-06e4cf91-40fa-41a3-be68-61a95ce69568 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Searching for a device in session 21 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71509) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 10:48:23 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-06e4cf91-40fa-41a3-be68-61a95ce69568 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:fa52f0fe-627e-4b45-aa2b-0c85864afcaf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VqKhfkGs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71509) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 10:48:23 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-06e4cf91-40fa-41a3-be68-61a95ce69568 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.402s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 10:48:23 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-06e4cf91-40fa-41a3-be68-61a95ce69568 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] <== connect_volume: return (1404ms) {'type': 'block', 'scsi_wwn': '23931656564373132', 'path': '/dev/sde'} {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 10:48:23 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-06e4cf91-40fa-41a3-be68-61a95ce69568 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] [instance: 55178126-9766-4875-9122-39dcc87ce82c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23931656564373132', 'path': '/dev/sde'} {{(pid=71509) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 10:48:23 user nova-compute[71509]: DEBUG nova.objects.instance [None req-06e4cf91-40fa-41a3-be68-61a95ce69568 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lazy-loading 'flavor' on Instance uuid 55178126-9766-4875-9122-39dcc87ce82c {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:48:23 user nova-compute[71509]: DEBUG nova.virt.libvirt.guest [None req-06e4cf91-40fa-41a3-be68-61a95ce69568 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 10:48:23 user nova-compute[71509]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 10:48:23 user nova-compute[71509]:   <source dev="/dev/sde"/>
Apr 14 10:48:23 user nova-compute[71509]:   <target dev="vdb" bus="virtio"/>
Apr 14 10:48:23 user nova-compute[71509]:   <serial>fa52f0fe-627e-4b45-aa2b-0c85864afcaf</serial>
Apr 14 10:48:23 user nova-compute[71509]: </disk>
Apr 14 10:48:23 user nova-compute[71509]:  {{(pid=71509) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 10:48:23 user nova-compute[71509]: DEBUG nova.virt.libvirt.guest [None req-80a27386-cbac-4571-b690-2b4b6ff8cadb tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] COPY block job progress, current cursor: 43778048 final cursor: 43778048 {{(pid=71509) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 10:48:23 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-80a27386-cbac-4571-b690-2b4b6ff8cadb tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: e479154a-acd6-47aa-9a5b-43c6e0feda07] Skipping quiescing instance: QEMU guest agent is not enabled.
Apr 14 10:48:23 user nova-compute[71509]: DEBUG nova.privsep.utils [None req-80a27386-cbac-4571-b690-2b4b6ff8cadb tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71509) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 10:48:23 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-80a27386-cbac-4571-b690-2b4b6ff8cadb tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp2uvomcjt/8c61d7c67b274fe4938438a75dc9003c.delta /opt/stack/data/nova/instances/snapshots/tmp2uvomcjt/8c61d7c67b274fe4938438a75dc9003c {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:48:23 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-06e4cf91-40fa-41a3-be68-61a95ce69568 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] No BDM found with device name vda, not building metadata. {{(pid=71509) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 10:48:23 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-06e4cf91-40fa-41a3-be68-61a95ce69568 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71509) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 10:48:23 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-06e4cf91-40fa-41a3-be68-61a95ce69568 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] No VIF found with MAC fa:16:3e:85:23:c1, not building metadata {{(pid=71509) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 10:48:23 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-80a27386-cbac-4571-b690-2b4b6ff8cadb tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp2uvomcjt/8c61d7c67b274fe4938438a75dc9003c.delta /opt/stack/data/nova/instances/snapshots/tmp2uvomcjt/8c61d7c67b274fe4938438a75dc9003c" returned: 0 in 0.208s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:48:23 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-80a27386-cbac-4571-b690-2b4b6ff8cadb tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: e479154a-acd6-47aa-9a5b-43c6e0feda07] Snapshot extracted, beginning image upload
Apr 14 10:48:23 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-06e4cf91-40fa-41a3-be68-61a95ce69568 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "55178126-9766-4875-9122-39dcc87ce82c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.990s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:48:25 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-a53b81c2-b896-4b42-b79c-a8b1be6daa22 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Acquiring lock "55178126-9766-4875-9122-39dcc87ce82c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:48:25 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-a53b81c2-b896-4b42-b79c-a8b1be6daa22 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "55178126-9766-4875-9122-39dcc87ce82c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:48:25 user nova-compute[71509]: INFO nova.compute.manager [None req-a53b81c2-b896-4b42-b79c-a8b1be6daa22 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] [instance: 55178126-9766-4875-9122-39dcc87ce82c] Detaching volume fa52f0fe-627e-4b45-aa2b-0c85864afcaf
Apr 14 10:48:25 user nova-compute[71509]: INFO nova.virt.block_device [None req-a53b81c2-b896-4b42-b79c-a8b1be6daa22 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] [instance: 55178126-9766-4875-9122-39dcc87ce82c] Attempting to driver detach volume fa52f0fe-627e-4b45-aa2b-0c85864afcaf from mountpoint /dev/vdb
Apr 14 10:48:25 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-a53b81c2-b896-4b42-b79c-a8b1be6daa22 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Attempting to detach device vdb from instance 55178126-9766-4875-9122-39dcc87ce82c from the persistent domain config. {{(pid=71509) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 10:48:25 user nova-compute[71509]: DEBUG nova.virt.libvirt.guest [None req-a53b81c2-b896-4b42-b79c-a8b1be6daa22 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 10:48:25 user nova-compute[71509]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 10:48:25 user nova-compute[71509]:   <source dev="/dev/sde"/>
Apr 14 10:48:25 user nova-compute[71509]:   <target dev="vdb" bus="virtio"/>
Apr 14 10:48:25 user nova-compute[71509]:   <serial>fa52f0fe-627e-4b45-aa2b-0c85864afcaf</serial>
Apr 14 10:48:25 user nova-compute[71509]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 10:48:25 user nova-compute[71509]: </disk>
Apr 14 10:48:25 user nova-compute[71509]:  {{(pid=71509) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 10:48:25 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-a53b81c2-b896-4b42-b79c-a8b1be6daa22 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Successfully detached device vdb from instance 55178126-9766-4875-9122-39dcc87ce82c from the persistent domain config.
Apr 14 10:48:25 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-a53b81c2-b896-4b42-b79c-a8b1be6daa22 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 55178126-9766-4875-9122-39dcc87ce82c from the live domain config. {{(pid=71509) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 10:48:25 user nova-compute[71509]: DEBUG nova.virt.libvirt.guest [None req-a53b81c2-b896-4b42-b79c-a8b1be6daa22 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 10:48:25 user nova-compute[71509]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 10:48:25 user nova-compute[71509]:   <source dev="/dev/sde"/>
Apr 14 10:48:25 user nova-compute[71509]:   <target dev="vdb" bus="virtio"/>
Apr 14 10:48:25 user nova-compute[71509]:   <serial>fa52f0fe-627e-4b45-aa2b-0c85864afcaf</serial>
Apr 14 10:48:25 user nova-compute[71509]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 10:48:25 user nova-compute[71509]: </disk>
Apr 14 10:48:25 user nova-compute[71509]:  {{(pid=71509) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 10:48:25 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:48:25 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Received event <DeviceRemovedEvent: 1681469305.7754207, 55178126-9766-4875-9122-39dcc87ce82c => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71509) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 10:48:25 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-a53b81c2-b896-4b42-b79c-a8b1be6daa22 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 55178126-9766-4875-9122-39dcc87ce82c {{(pid=71509) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 10:48:25 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-a53b81c2-b896-4b42-b79c-a8b1be6daa22 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Successfully detached device vdb from instance 55178126-9766-4875-9122-39dcc87ce82c from the live domain config.
Apr 14 10:48:25 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a53b81c2-b896-4b42-b79c-a8b1be6daa22 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] [instance: 55178126-9766-4875-9122-39dcc87ce82c] calling os-brick to detach iSCSI Volume {{(pid=71509) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 10:48:25 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-a53b81c2-b896-4b42-b79c-a8b1be6daa22 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0bf0749390>, {'target_iqn': 'iqn.2010-10.org.openstack:fa52f0fe-627e-4b45-aa2b-0c85864afcaf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VqKhfkGs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 10:48:25 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-a53b81c2-b896-4b42-b79c-a8b1be6daa22 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 10:48:25 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-a53b81c2-b896-4b42-b79c-a8b1be6daa22 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 10:48:25 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-a53b81c2-b896-4b42-b79c-a8b1be6daa22 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 10:48:25 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:48:25 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:48:25 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c8ea016-550f-480a-911d-9cb845a82d87]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4116efc6-988f-40cf-af06-2abf9c6cd44a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa52f0fe-627e-4b45-aa2b-0c85864afcaf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:48:25 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-a53b81c2-b896-4b42-b79c-a8b1be6daa22 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 10:48:25 user nova-compute[71509]: No targets found.
Apr 14 10:48:25 user nova-compute[71509]: iSNS:
Apr 14 10:48:25 user nova-compute[71509]: No targets found.
Apr 14 10:48:25 user nova-compute[71509]: STATIC:
Apr 14 10:48:25 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:4116efc6-988f-40cf-af06-2abf9c6cd44a
Apr 14 10:48:25 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:48:25 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:48:25 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee
Apr 14 10:48:25 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:48:25 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:48:25 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d
Apr 14 10:48:25 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:48:25 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:48:25 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:fa52f0fe-627e-4b45-aa2b-0c85864afcaf
Apr 14 10:48:25 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:48:25 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:48:25 user nova-compute[71509]: FIRMWARE:
Apr 14 10:48:25 user nova-compute[71509]: No targets found.
Apr 14 10:48:25 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:48:25 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-a53b81c2-b896-4b42-b79c-a8b1be6daa22 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 10:48:25 user nova-compute[71509]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 10:48:25 user nova-compute[71509]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71509) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 10:48:25 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-a53b81c2-b896-4b42-b79c-a8b1be6daa22 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa52f0fe-627e-4b45-aa2b-0c85864afcaf', 0)] {{(pid=71509) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 10:48:25 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:48:25 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:48:25 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c941406-f5ab-4e53-9297-5b701314d009]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4116efc6-988f-40cf-af06-2abf9c6cd44a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa52f0fe-627e-4b45-aa2b-0c85864afcaf\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:48:25 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:48:25 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:48:25 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[c155040d-3d93-4019-a58c-119979d59be9]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4116efc6-988f-40cf-af06-2abf9c6cd44a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa52f0fe-627e-4b45-aa2b-0c85864afcaf (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:48:25 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-a53b81c2-b896-4b42-b79c-a8b1be6daa22 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4116efc6-988f-40cf-af06-2abf9c6cd44a (non-flash)
Apr 14 10:48:25 user nova-compute[71509]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d (non-flash)
Apr 14 10:48:25 user nova-compute[71509]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee (non-flash)
Apr 14 10:48:25 user nova-compute[71509]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa52f0fe-627e-4b45-aa2b-0c85864afcaf (non-flash)
Apr 14 10:48:25 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:48:25 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-a53b81c2-b896-4b42-b79c-a8b1be6daa22 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4116efc6-988f-40cf-af06-2abf9c6cd44a (non-flash)
Apr 14 10:48:25 user nova-compute[71509]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d (non-flash)
Apr 14 10:48:25 user nova-compute[71509]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee (non-flash)
Apr 14 10:48:25 user nova-compute[71509]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa52f0fe-627e-4b45-aa2b-0c85864afcaf (non-flash)
Apr 14 10:48:25 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 10:48:25 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-a53b81c2-b896-4b42-b79c-a8b1be6daa22 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0bf06abd90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa52f0fe-627e-4b45-aa2b-0c85864afcaf'): ({'sde'}, set())}) {{(pid=71509) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 10:48:25 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-a53b81c2-b896-4b42-b79c-a8b1be6daa22 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Removing single pathed devices sde {{(pid=71509) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 10:48:25 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:48:25 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:48:25 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[7167171f-f7fb-47e5-9ba9-0eaf55528ea2]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:48:25 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:48:25 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.026s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:48:25 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[eab5f733-eb13-42b0-809f-7ca9294c5b0d]: (4, ('ok\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:48:25 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-a53b81c2-b896-4b42-b79c-a8b1be6daa22 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Flushing IO for device /dev/sde {{(pid=71509) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 10:48:25 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:48:25 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.020s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:48:25 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d4132f3-c65d-49f6-853e-8bd2c018f5ea]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:48:25 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-a53b81c2-b896-4b42-b79c-a8b1be6daa22 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71509) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 10:48:25 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:48:26 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.052s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:48:26 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[e863a711-2dc6-4921-8cd9-4231ee055277]: (4, ('1', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:48:26 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-a53b81c2-b896-4b42-b79c-a8b1be6daa22 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71509) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 10:48:26 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-a53b81c2-b896-4b42-b79c-a8b1be6daa22 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] SCSI volumes sde have been removed. {{(pid=71509) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 10:48:26 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-a53b81c2-b896-4b42-b79c-a8b1be6daa22 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa52f0fe-627e-4b45-aa2b-0c85864afcaf')] {{(pid=71509) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 10:48:26 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa52f0fe-627e-4b45-aa2b-0c85864afcaf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:48:26 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa52f0fe-627e-4b45-aa2b-0c85864afcaf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.033s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:48:26 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[dda8f117-cf12-4273-af63-800d2af6a801]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:48:26 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-a53b81c2-b896-4b42-b79c-a8b1be6daa22 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:48:26 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa52f0fe-627e-4b45-aa2b-0c85864afcaf -p 172.16.0.220:3260 --logout {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:48:26 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa52f0fe-627e-4b45-aa2b-0c85864afcaf -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:48:26 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3d95791-636f-4e10-80d7-eabee2168931]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:fa52f0fe-627e-4b45-aa2b-0c85864afcaf, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:fa52f0fe-627e-4b45-aa2b-0c85864afcaf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:48:26 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-a53b81c2-b896-4b42-b79c-a8b1be6daa22 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:fa52f0fe-627e-4b45-aa2b-0c85864afcaf, portal: 172.16.0.220,3260]
Apr 14 10:48:26 user nova-compute[71509]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:fa52f0fe-627e-4b45-aa2b-0c85864afcaf, portal: 172.16.0.220,3260] successful.
Apr 14 10:48:26 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:48:26 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa52f0fe-627e-4b45-aa2b-0c85864afcaf -p 172.16.0.220:3260 --op delete {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:48:26 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa52f0fe-627e-4b45-aa2b-0c85864afcaf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:48:26 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c7a5572-1195-47c6-bd56-d02a84ccfd03]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:48:26 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-a53b81c2-b896-4b42-b79c-a8b1be6daa22 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:48:26 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-a53b81c2-b896-4b42-b79c-a8b1be6daa22 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.388s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 10:48:26 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-a53b81c2-b896-4b42-b79c-a8b1be6daa22 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] <== disconnect_volume: return (390ms) None {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 10:48:26 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a53b81c2-b896-4b42-b79c-a8b1be6daa22 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] [instance: 55178126-9766-4875-9122-39dcc87ce82c] Disconnected iSCSI Volume {{(pid=71509) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 10:48:26 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-80a27386-cbac-4571-b690-2b4b6ff8cadb tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: e479154a-acd6-47aa-9a5b-43c6e0feda07] Snapshot image upload complete
Apr 14 10:48:26 user nova-compute[71509]: INFO nova.compute.manager [None req-80a27386-cbac-4571-b690-2b4b6ff8cadb tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: e479154a-acd6-47aa-9a5b-43c6e0feda07] Took 5.18 seconds to snapshot the instance on the hypervisor.
Apr 14 10:48:26 user nova-compute[71509]: DEBUG nova.objects.instance [None req-a53b81c2-b896-4b42-b79c-a8b1be6daa22 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lazy-loading 'flavor' on Instance uuid 55178126-9766-4875-9122-39dcc87ce82c {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:48:27 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-a53b81c2-b896-4b42-b79c-a8b1be6daa22 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "55178126-9766-4875-9122-39dcc87ce82c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.830s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:48:27 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:48:28 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:48:28 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Cleaning up deleted instances {{(pid=71509) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 14 10:48:28 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] There are 0 instances to clean {{(pid=71509) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 14 10:48:30 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:48:31 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:48:31 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:48:31 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71509) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 10:48:31 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:48:31 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71509) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 14 10:48:32 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:48:32 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:48:32 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:48:33 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:48:35 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:48:35 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:48:36 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:48:36 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Starting heal instance info cache {{(pid=71509) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 10:48:36 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Didn't find any instances for network info cache update. {{(pid=71509) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 14 10:48:36 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:48:37 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:48:37 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:48:37 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:48:38 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:48:39 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:48:39 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:48:39 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:48:39 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:48:39 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Auditing locally available compute resources for user (node: user) {{(pid=71509) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 10:48:39 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97820f17-22d1-4ec3-9721-1edadccc794a/disk.rescue --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:48:39 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97820f17-22d1-4ec3-9721-1edadccc794a/disk.rescue --force-share --output=json" returned: 0 in 0.144s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:48:39 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97820f17-22d1-4ec3-9721-1edadccc794a/disk.rescue --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:48:39 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97820f17-22d1-4ec3-9721-1edadccc794a/disk.rescue --force-share --output=json" returned: 0 in 0.143s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:48:39 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97820f17-22d1-4ec3-9721-1edadccc794a/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:48:40 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97820f17-22d1-4ec3-9721-1edadccc794a/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:48:40 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97820f17-22d1-4ec3-9721-1edadccc794a/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:48:40 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97820f17-22d1-4ec3-9721-1edadccc794a/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:48:40 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3245b74-dbe8-4b8b-83b6-58a4811fdba9/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:48:40 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3245b74-dbe8-4b8b-83b6-58a4811fdba9/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:48:40 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3245b74-dbe8-4b8b-83b6-58a4811fdba9/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:48:40 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3245b74-dbe8-4b8b-83b6-58a4811fdba9/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:48:40 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4abb549-8f36-40c5-971f-8accbb14ff86/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:48:40 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:48:40 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4abb549-8f36-40c5-971f-8accbb14ff86/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:48:40 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4abb549-8f36-40c5-971f-8accbb14ff86/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:48:40 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4abb549-8f36-40c5-971f-8accbb14ff86/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:48:40 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71509) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 10:48:40 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8586a70e-9855-4177-ac1b-cf707a4df871/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:48:40 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8586a70e-9855-4177-ac1b-cf707a4df871/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:48:40 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8586a70e-9855-4177-ac1b-cf707a4df871/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:48:41 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8586a70e-9855-4177-ac1b-cf707a4df871/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:48:41 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55178126-9766-4875-9122-39dcc87ce82c/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:48:41 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55178126-9766-4875-9122-39dcc87ce82c/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:48:41 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55178126-9766-4875-9122-39dcc87ce82c/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:48:41 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55178126-9766-4875-9122-39dcc87ce82c/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:48:41 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e479154a-acd6-47aa-9a5b-43c6e0feda07/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:48:41 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e479154a-acd6-47aa-9a5b-43c6e0feda07/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:48:41 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e479154a-acd6-47aa-9a5b-43c6e0feda07/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:48:41 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e479154a-acd6-47aa-9a5b-43c6e0feda07/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:48:41 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e6c800c-9b35-4e35-969e-c40367056dce/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:48:41 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e6c800c-9b35-4e35-969e-c40367056dce/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:48:41 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e6c800c-9b35-4e35-969e-c40367056dce/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:48:41 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e6c800c-9b35-4e35-969e-c40367056dce/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:48:41 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71509) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 10:48:41 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e6c800c-9b35-4e35-969e-c40367056dce/disk.rescue --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:48:42 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e6c800c-9b35-4e35-969e-c40367056dce/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:48:42 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e6c800c-9b35-4e35-969e-c40367056dce/disk.rescue --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:48:42 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e6c800c-9b35-4e35-969e-c40367056dce/disk.rescue --force-share --output=json" returned: 0 in 0.158s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:48:42 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97f20661-8b60-439e-b7af-2fc2013c5ade/disk.rescue --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:48:42 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97f20661-8b60-439e-b7af-2fc2013c5ade/disk.rescue --force-share --output=json" returned: 0 in 0.161s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:48:42 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97f20661-8b60-439e-b7af-2fc2013c5ade/disk.rescue --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:48:42 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97f20661-8b60-439e-b7af-2fc2013c5ade/disk.rescue --force-share --output=json" returned: 0 in 0.129s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:48:42 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97f20661-8b60-439e-b7af-2fc2013c5ade/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:48:42 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97f20661-8b60-439e-b7af-2fc2013c5ade/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:48:42 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97f20661-8b60-439e-b7af-2fc2013c5ade/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:48:42 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97f20661-8b60-439e-b7af-2fc2013c5ade/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:48:42 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71509) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 10:48:42 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:48:42 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/203b622c-9e6d-4ac7-a3fa-9f9c82ef3108/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:48:42 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/203b622c-9e6d-4ac7-a3fa-9f9c82ef3108/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:48:42 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/203b622c-9e6d-4ac7-a3fa-9f9c82ef3108/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:48:43 user nova-compute[71509]: INFO nova.compute.manager [None req-800af31e-be0b-4ff1-9492-e55cb7b37c66 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Unrescuing
Apr 14 10:48:43 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-800af31e-be0b-4ff1-9492-e55cb7b37c66 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Acquiring lock "refresh_cache-0e6c800c-9b35-4e35-969e-c40367056dce" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:48:43 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-800af31e-be0b-4ff1-9492-e55cb7b37c66 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Acquired lock "refresh_cache-0e6c800c-9b35-4e35-969e-c40367056dce" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:48:43 user nova-compute[71509]: DEBUG nova.network.neutron [None req-800af31e-be0b-4ff1-9492-e55cb7b37c66 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Building network info cache for instance {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 10:48:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/203b622c-9e6d-4ac7-a3fa-9f9c82ef3108/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:48:43 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:48:43 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:48:43 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Hypervisor/Node resource view: name=user free_ram=7424MB free_disk=26.051231384277344GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71509) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 10:48:43 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:48:43 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:48:43 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 97f20661-8b60-439e-b7af-2fc2013c5ade actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:48:43 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 97820f17-22d1-4ec3-9721-1edadccc794a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:48:43 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance b4abb549-8f36-40c5-971f-8accbb14ff86 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:48:43 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 0e6c800c-9b35-4e35-969e-c40367056dce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:48:43 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 55178126-9766-4875-9122-39dcc87ce82c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:48:43 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance e479154a-acd6-47aa-9a5b-43c6e0feda07 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:48:43 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 8586a70e-9855-4177-ac1b-cf707a4df871 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:48:43 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 39586d44-1d8e-4607-ab4d-c03a7d841606 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:48:43 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 203b622c-9e6d-4ac7-a3fa-9f9c82ef3108 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:48:43 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance f3245b74-dbe8-4b8b-83b6-58a4811fdba9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:48:43 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=71509) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 10:48:43 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Final resource view: name=user phys_ram=16023MB used_ram=1792MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=71509) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 10:48:43 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Refreshing inventories for resource provider 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 14 10:48:43 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Updating ProviderTree inventory for provider 52209f7e-594e-4cf4-9018-18636056cd6b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 14 10:48:43 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Updating inventory in ProviderTree for provider 52209f7e-594e-4cf4-9018-18636056cd6b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 14 10:48:43 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Refreshing aggregate associations for resource provider 52209f7e-594e-4cf4-9018-18636056cd6b, aggregates: None {{(pid=71509) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 14 10:48:43 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Refreshing trait associations for resource provider 52209f7e-594e-4cf4-9018-18636056cd6b, traits: COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE42,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_SATA {{(pid=71509) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 14 10:48:44 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 10:48:44 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 10:48:44 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Compute_service record updated for user:user {{(pid=71509) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 10:48:44 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.717s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:48:44 user nova-compute[71509]: DEBUG nova.network.neutron [None req-800af31e-be0b-4ff1-9492-e55cb7b37c66 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Updating instance_info_cache with network_info: [{"id": "49978689-84ce-4422-add9-9bb12f628c37", "address": "fa:16:3e:a6:47:fc", "network": {"id": "9040ebc7-4d6b-4fd2-8543-f22ca3fb249c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2098664740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "482809b9148e408b84b156802a21a225", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49978689-84", "ovs_interfaceid": "49978689-84ce-4422-add9-9bb12f628c37", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:48:44 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-800af31e-be0b-4ff1-9492-e55cb7b37c66 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Releasing lock "refresh_cache-0e6c800c-9b35-4e35-969e-c40367056dce" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:48:44 user nova-compute[71509]: DEBUG nova.objects.instance [None req-800af31e-be0b-4ff1-9492-e55cb7b37c66 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Lazy-loading 'flavor' on Instance uuid 0e6c800c-9b35-4e35-969e-c40367056dce {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:48:44 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:48:44 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:48:44 user nova-compute[71509]: DEBUG nova.compute.manager [req-3ac766d7-0c41-4c50-9251-bc332ed25ca6 req-df7fb19c-d20d-4317-9afb-9c6c48cfd414 service nova] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Received event network-changed-49978689-84ce-4422-add9-9bb12f628c37 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:48:44 user nova-compute[71509]: DEBUG nova.compute.manager [req-3ac766d7-0c41-4c50-9251-bc332ed25ca6 req-df7fb19c-d20d-4317-9afb-9c6c48cfd414 service nova] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Refreshing instance network info cache due to event network-changed-49978689-84ce-4422-add9-9bb12f628c37. {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 10:48:44 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-3ac766d7-0c41-4c50-9251-bc332ed25ca6 req-df7fb19c-d20d-4317-9afb-9c6c48cfd414 service nova] Acquiring lock "refresh_cache-0e6c800c-9b35-4e35-969e-c40367056dce" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:48:44 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-3ac766d7-0c41-4c50-9251-bc332ed25ca6 req-df7fb19c-d20d-4317-9afb-9c6c48cfd414 service nova] Acquired lock "refresh_cache-0e6c800c-9b35-4e35-969e-c40367056dce" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:48:44 user nova-compute[71509]: DEBUG nova.network.neutron [req-3ac766d7-0c41-4c50-9251-bc332ed25ca6 req-df7fb19c-d20d-4317-9afb-9c6c48cfd414 service nova] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Refreshing network info cache for port 49978689-84ce-4422-add9-9bb12f628c37 {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 10:48:44 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:48:44 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:48:44 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:48:44 user nova-compute[71509]: DEBUG nova.compute.manager [req-50716bde-b6c8-4760-aa04-36af06c4bc41 req-b5947834-5b13-4bc7-b2f3-df40a5ee9bd5 service nova] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Received event network-vif-unplugged-49978689-84ce-4422-add9-9bb12f628c37 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:48:44 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-50716bde-b6c8-4760-aa04-36af06c4bc41 req-b5947834-5b13-4bc7-b2f3-df40a5ee9bd5 service nova] Acquiring lock "0e6c800c-9b35-4e35-969e-c40367056dce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:48:44 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-50716bde-b6c8-4760-aa04-36af06c4bc41 req-b5947834-5b13-4bc7-b2f3-df40a5ee9bd5 service nova] Lock "0e6c800c-9b35-4e35-969e-c40367056dce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:48:44 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-50716bde-b6c8-4760-aa04-36af06c4bc41 req-b5947834-5b13-4bc7-b2f3-df40a5ee9bd5 service nova] Lock "0e6c800c-9b35-4e35-969e-c40367056dce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:48:44 user nova-compute[71509]: DEBUG nova.compute.manager [req-50716bde-b6c8-4760-aa04-36af06c4bc41 req-b5947834-5b13-4bc7-b2f3-df40a5ee9bd5 service nova] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] No waiting events found dispatching network-vif-unplugged-49978689-84ce-4422-add9-9bb12f628c37 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:48:44 user nova-compute[71509]: WARNING nova.compute.manager [req-50716bde-b6c8-4760-aa04-36af06c4bc41 req-b5947834-5b13-4bc7-b2f3-df40a5ee9bd5 service nova] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Received unexpected event network-vif-unplugged-49978689-84ce-4422-add9-9bb12f628c37 for instance with vm_state rescued and task_state unrescuing.
Apr 14 10:48:45 user nova-compute[71509]: DEBUG nova.network.neutron [req-3ac766d7-0c41-4c50-9251-bc332ed25ca6 req-df7fb19c-d20d-4317-9afb-9c6c48cfd414 service nova] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Updated VIF entry in instance network info cache for port 49978689-84ce-4422-add9-9bb12f628c37. {{(pid=71509) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 10:48:45 user nova-compute[71509]: DEBUG nova.network.neutron [req-3ac766d7-0c41-4c50-9251-bc332ed25ca6 req-df7fb19c-d20d-4317-9afb-9c6c48cfd414 service nova] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Updating instance_info_cache with network_info: [{"id": "49978689-84ce-4422-add9-9bb12f628c37", "address": "fa:16:3e:a6:47:fc", "network": {"id": "9040ebc7-4d6b-4fd2-8543-f22ca3fb249c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2098664740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "482809b9148e408b84b156802a21a225", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49978689-84", "ovs_interfaceid": "49978689-84ce-4422-add9-9bb12f628c37", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:48:45 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-3ac766d7-0c41-4c50-9251-bc332ed25ca6 req-df7fb19c-d20d-4317-9afb-9c6c48cfd414 service nova] Releasing lock "refresh_cache-0e6c800c-9b35-4e35-969e-c40367056dce" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:48:45 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Instance destroyed successfully.
Apr 14 10:48:45 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:48:46 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:48:46 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:48:46 user nova-compute[71509]: DEBUG nova.compute.manager [req-1929364d-8316-44dc-9c3e-4dfb01f55793 req-2079ff8e-da65-43ef-9078-149fd6e9d70f service nova] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Received event network-changed-49978689-84ce-4422-add9-9bb12f628c37 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:48:46 user nova-compute[71509]: DEBUG nova.compute.manager [req-1929364d-8316-44dc-9c3e-4dfb01f55793 req-2079ff8e-da65-43ef-9078-149fd6e9d70f service nova] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Refreshing instance network info cache due to event network-changed-49978689-84ce-4422-add9-9bb12f628c37. {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 10:48:46 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-1929364d-8316-44dc-9c3e-4dfb01f55793 req-2079ff8e-da65-43ef-9078-149fd6e9d70f service nova] Acquiring lock "refresh_cache-0e6c800c-9b35-4e35-969e-c40367056dce" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:48:46 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-1929364d-8316-44dc-9c3e-4dfb01f55793 req-2079ff8e-da65-43ef-9078-149fd6e9d70f service nova] Acquired lock "refresh_cache-0e6c800c-9b35-4e35-969e-c40367056dce" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:48:46 user nova-compute[71509]: DEBUG nova.network.neutron [req-1929364d-8316-44dc-9c3e-4dfb01f55793 req-2079ff8e-da65-43ef-9078-149fd6e9d70f service nova] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Refreshing network info cache for port 49978689-84ce-4422-add9-9bb12f628c37 {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 10:48:46 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:48:46 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:48:46 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:48:46 user nova-compute[71509]: DEBUG nova.compute.manager [req-a2859ae2-9fb0-4a35-b848-c5d1f23df7ad req-179c0f67-84f8-40ba-be03-8c341d7b7619 service nova] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Received event network-vif-plugged-49978689-84ce-4422-add9-9bb12f628c37 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:48:46 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-a2859ae2-9fb0-4a35-b848-c5d1f23df7ad req-179c0f67-84f8-40ba-be03-8c341d7b7619 service nova] Acquiring lock "0e6c800c-9b35-4e35-969e-c40367056dce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:48:46 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-a2859ae2-9fb0-4a35-b848-c5d1f23df7ad req-179c0f67-84f8-40ba-be03-8c341d7b7619 service nova] Lock "0e6c800c-9b35-4e35-969e-c40367056dce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:48:46 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-a2859ae2-9fb0-4a35-b848-c5d1f23df7ad req-179c0f67-84f8-40ba-be03-8c341d7b7619 service nova] Lock "0e6c800c-9b35-4e35-969e-c40367056dce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:48:46 user nova-compute[71509]: DEBUG nova.compute.manager [req-a2859ae2-9fb0-4a35-b848-c5d1f23df7ad req-179c0f67-84f8-40ba-be03-8c341d7b7619 service nova] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] No waiting events found dispatching network-vif-plugged-49978689-84ce-4422-add9-9bb12f628c37 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:48:46 user nova-compute[71509]: WARNING nova.compute.manager [req-a2859ae2-9fb0-4a35-b848-c5d1f23df7ad req-179c0f67-84f8-40ba-be03-8c341d7b7619 service nova] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Received unexpected event network-vif-plugged-49978689-84ce-4422-add9-9bb12f628c37 for instance with vm_state rescued and task_state unrescuing.
Apr 14 10:48:46 user nova-compute[71509]: DEBUG nova.compute.manager [req-a2859ae2-9fb0-4a35-b848-c5d1f23df7ad req-179c0f67-84f8-40ba-be03-8c341d7b7619 service nova] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Received event network-vif-plugged-49978689-84ce-4422-add9-9bb12f628c37 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:48:46 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-a2859ae2-9fb0-4a35-b848-c5d1f23df7ad req-179c0f67-84f8-40ba-be03-8c341d7b7619 service nova] Acquiring lock "0e6c800c-9b35-4e35-969e-c40367056dce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:48:46 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-a2859ae2-9fb0-4a35-b848-c5d1f23df7ad req-179c0f67-84f8-40ba-be03-8c341d7b7619 service nova] Lock "0e6c800c-9b35-4e35-969e-c40367056dce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:48:46 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-a2859ae2-9fb0-4a35-b848-c5d1f23df7ad req-179c0f67-84f8-40ba-be03-8c341d7b7619 service nova] Lock "0e6c800c-9b35-4e35-969e-c40367056dce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:48:46 user nova-compute[71509]: DEBUG nova.compute.manager [req-a2859ae2-9fb0-4a35-b848-c5d1f23df7ad req-179c0f67-84f8-40ba-be03-8c341d7b7619 service nova] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] No waiting events found dispatching network-vif-plugged-49978689-84ce-4422-add9-9bb12f628c37 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:48:46 user nova-compute[71509]: WARNING nova.compute.manager [req-a2859ae2-9fb0-4a35-b848-c5d1f23df7ad req-179c0f67-84f8-40ba-be03-8c341d7b7619 service nova] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Received unexpected event network-vif-plugged-49978689-84ce-4422-add9-9bb12f628c37 for instance with vm_state rescued and task_state unrescuing.
Apr 14 10:48:47 user nova-compute[71509]: DEBUG nova.network.neutron [req-1929364d-8316-44dc-9c3e-4dfb01f55793 req-2079ff8e-da65-43ef-9078-149fd6e9d70f service nova] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Updated VIF entry in instance network info cache for port 49978689-84ce-4422-add9-9bb12f628c37. {{(pid=71509) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 10:48:47 user nova-compute[71509]: DEBUG nova.network.neutron [req-1929364d-8316-44dc-9c3e-4dfb01f55793 req-2079ff8e-da65-43ef-9078-149fd6e9d70f service nova] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Updating instance_info_cache with network_info: [{"id": "49978689-84ce-4422-add9-9bb12f628c37", "address": "fa:16:3e:a6:47:fc", "network": {"id": "9040ebc7-4d6b-4fd2-8543-f22ca3fb249c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2098664740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "482809b9148e408b84b156802a21a225", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49978689-84", "ovs_interfaceid": "49978689-84ce-4422-add9-9bb12f628c37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:48:47 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-1929364d-8316-44dc-9c3e-4dfb01f55793 req-2079ff8e-da65-43ef-9078-149fd6e9d70f service nova] Releasing lock "refresh_cache-0e6c800c-9b35-4e35-969e-c40367056dce" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:48:47 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:48:47 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:48:47 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:48:47 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:48:49 user nova-compute[71509]: DEBUG nova.compute.manager [None req-800af31e-be0b-4ff1-9492-e55cb7b37c66 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:48:49 user nova-compute[71509]: DEBUG nova.virt.libvirt.host [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Removed pending event for 0e6c800c-9b35-4e35-969e-c40367056dce due to event {{(pid=71509) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 10:48:49 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681469329.0148969, 0e6c800c-9b35-4e35-969e-c40367056dce => Resumed> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 10:48:49 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] VM Resumed (Lifecycle Event)
Apr 14 10:48:49 user nova-compute[71509]: DEBUG nova.compute.manager [req-b4fe009f-94e4-48d0-98c6-22232469cb69 req-3deab8c7-a8ae-4ce4-ac89-343fb4fb1e4c service nova] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Received event network-vif-plugged-49978689-84ce-4422-add9-9bb12f628c37 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:48:49 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-b4fe009f-94e4-48d0-98c6-22232469cb69 req-3deab8c7-a8ae-4ce4-ac89-343fb4fb1e4c service nova] Acquiring lock "0e6c800c-9b35-4e35-969e-c40367056dce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:48:49 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-b4fe009f-94e4-48d0-98c6-22232469cb69 req-3deab8c7-a8ae-4ce4-ac89-343fb4fb1e4c service nova] Lock "0e6c800c-9b35-4e35-969e-c40367056dce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:48:49 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-b4fe009f-94e4-48d0-98c6-22232469cb69 req-3deab8c7-a8ae-4ce4-ac89-343fb4fb1e4c service nova] Lock "0e6c800c-9b35-4e35-969e-c40367056dce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:48:49 user nova-compute[71509]: DEBUG nova.compute.manager [req-b4fe009f-94e4-48d0-98c6-22232469cb69 req-3deab8c7-a8ae-4ce4-ac89-343fb4fb1e4c service nova] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] No waiting events found dispatching network-vif-plugged-49978689-84ce-4422-add9-9bb12f628c37 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:48:49 user nova-compute[71509]: WARNING nova.compute.manager [req-b4fe009f-94e4-48d0-98c6-22232469cb69 req-3deab8c7-a8ae-4ce4-ac89-343fb4fb1e4c service nova] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Received unexpected event network-vif-plugged-49978689-84ce-4422-add9-9bb12f628c37 for instance with vm_state rescued and task_state unrescuing.
Apr 14 10:48:49 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:48:49 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 10:48:49 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 14 10:48:49 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681469329.015016, 0e6c800c-9b35-4e35-969e-c40367056dce => Started> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 10:48:49 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] VM Started (Lifecycle Event)
Apr 14 10:48:49 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:48:49 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 10:48:49 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 14 10:48:50 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:48:52 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:48:55 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:48:57 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:49:00 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:49:02 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:49:05 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:49:07 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:49:10 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:49:12 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:49:13 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._sync_power_states {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:49:13 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Triggering sync for uuid 97f20661-8b60-439e-b7af-2fc2013c5ade {{(pid=71509) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 10:49:13 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Triggering sync for uuid 97820f17-22d1-4ec3-9721-1edadccc794a {{(pid=71509) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 10:49:13 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Triggering sync for uuid 0e6c800c-9b35-4e35-969e-c40367056dce {{(pid=71509) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 10:49:13 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Triggering sync for uuid 55178126-9766-4875-9122-39dcc87ce82c {{(pid=71509) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 10:49:13 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Triggering sync for uuid e479154a-acd6-47aa-9a5b-43c6e0feda07 {{(pid=71509) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 10:49:13 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Triggering sync for uuid 8586a70e-9855-4177-ac1b-cf707a4df871 {{(pid=71509) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 10:49:13 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Triggering sync for uuid 203b622c-9e6d-4ac7-a3fa-9f9c82ef3108 {{(pid=71509) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 10:49:13 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Triggering sync for uuid f3245b74-dbe8-4b8b-83b6-58a4811fdba9 {{(pid=71509) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 10:49:13 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Triggering sync for uuid b4abb549-8f36-40c5-971f-8accbb14ff86 {{(pid=71509) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 10:49:13 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Triggering sync for uuid 39586d44-1d8e-4607-ab4d-c03a7d841606 {{(pid=71509) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 10:49:13 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "97f20661-8b60-439e-b7af-2fc2013c5ade" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:49:13 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "97f20661-8b60-439e-b7af-2fc2013c5ade" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:49:13 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "97820f17-22d1-4ec3-9721-1edadccc794a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:49:13 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "97820f17-22d1-4ec3-9721-1edadccc794a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:49:13 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "0e6c800c-9b35-4e35-969e-c40367056dce" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:49:13 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "0e6c800c-9b35-4e35-969e-c40367056dce" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:49:13 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "55178126-9766-4875-9122-39dcc87ce82c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:49:13 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "55178126-9766-4875-9122-39dcc87ce82c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:49:13 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "e479154a-acd6-47aa-9a5b-43c6e0feda07" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:49:13 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "e479154a-acd6-47aa-9a5b-43c6e0feda07" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:49:13 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "8586a70e-9855-4177-ac1b-cf707a4df871" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:49:13 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "8586a70e-9855-4177-ac1b-cf707a4df871" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:49:13 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "203b622c-9e6d-4ac7-a3fa-9f9c82ef3108" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:49:13 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "203b622c-9e6d-4ac7-a3fa-9f9c82ef3108" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:49:13 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "f3245b74-dbe8-4b8b-83b6-58a4811fdba9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:49:13 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "f3245b74-dbe8-4b8b-83b6-58a4811fdba9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:49:13 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "b4abb549-8f36-40c5-971f-8accbb14ff86" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:49:13 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "b4abb549-8f36-40c5-971f-8accbb14ff86" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:49:13 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "39586d44-1d8e-4607-ab4d-c03a7d841606" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:49:13 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "39586d44-1d8e-4607-ab4d-c03a7d841606" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:49:13 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "97f20661-8b60-439e-b7af-2fc2013c5ade" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.077s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:49:13 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "97820f17-22d1-4ec3-9721-1edadccc794a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.077s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:49:13 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "0e6c800c-9b35-4e35-969e-c40367056dce" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.077s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:49:13 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "f3245b74-dbe8-4b8b-83b6-58a4811fdba9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.075s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:49:13 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "55178126-9766-4875-9122-39dcc87ce82c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.079s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:49:13 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "e479154a-acd6-47aa-9a5b-43c6e0feda07" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.079s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:49:13 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "203b622c-9e6d-4ac7-a3fa-9f9c82ef3108" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.080s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:49:13 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "8586a70e-9855-4177-ac1b-cf707a4df871" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.082s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:49:13 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "b4abb549-8f36-40c5-971f-8accbb14ff86" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.089s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:49:13 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "39586d44-1d8e-4607-ab4d-c03a7d841606" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.090s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:49:15 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:49:16 user nova-compute[71509]: DEBUG nova.compute.manager [req-8948854c-63af-4abe-8d84-4bb46ebfc21e req-98dfa048-a948-47df-a5cc-74b9546b73b5 service nova] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Received event network-changed-473d9af8-25a0-4e5a-9afb-7a0c843115cc {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:49:16 user nova-compute[71509]: DEBUG nova.compute.manager [req-8948854c-63af-4abe-8d84-4bb46ebfc21e req-98dfa048-a948-47df-a5cc-74b9546b73b5 service nova] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Refreshing instance network info cache due to event network-changed-473d9af8-25a0-4e5a-9afb-7a0c843115cc. {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 10:49:16 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-8948854c-63af-4abe-8d84-4bb46ebfc21e req-98dfa048-a948-47df-a5cc-74b9546b73b5 service nova] Acquiring lock "refresh_cache-8586a70e-9855-4177-ac1b-cf707a4df871" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:49:16 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-8948854c-63af-4abe-8d84-4bb46ebfc21e req-98dfa048-a948-47df-a5cc-74b9546b73b5 service nova] Acquired lock "refresh_cache-8586a70e-9855-4177-ac1b-cf707a4df871" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:49:16 user nova-compute[71509]: DEBUG nova.network.neutron [req-8948854c-63af-4abe-8d84-4bb46ebfc21e req-98dfa048-a948-47df-a5cc-74b9546b73b5 service nova] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Refreshing network info cache for port 473d9af8-25a0-4e5a-9afb-7a0c843115cc {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 10:49:16 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-9cd7a8a7-fb62-4101-9e59-ff4f0372e802 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Acquiring lock "0e6c800c-9b35-4e35-969e-c40367056dce" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:49:16 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-9cd7a8a7-fb62-4101-9e59-ff4f0372e802 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Lock "0e6c800c-9b35-4e35-969e-c40367056dce" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:49:16 user nova-compute[71509]: INFO nova.compute.manager [None req-9cd7a8a7-fb62-4101-9e59-ff4f0372e802 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Detaching volume 4116efc6-988f-40cf-af06-2abf9c6cd44a
Apr 14 10:49:16 user nova-compute[71509]: INFO nova.virt.block_device [None req-9cd7a8a7-fb62-4101-9e59-ff4f0372e802 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Attempting to driver detach volume 4116efc6-988f-40cf-af06-2abf9c6cd44a from mountpoint /dev/vdb
Apr 14 10:49:16 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-9cd7a8a7-fb62-4101-9e59-ff4f0372e802 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Attempting to detach device vdb from instance 0e6c800c-9b35-4e35-969e-c40367056dce from the persistent domain config. {{(pid=71509) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 10:49:16 user nova-compute[71509]: DEBUG nova.virt.libvirt.guest [None req-9cd7a8a7-fb62-4101-9e59-ff4f0372e802 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 10:49:16 user nova-compute[71509]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 10:49:16 user nova-compute[71509]:   <source dev="/dev/sdc"/>
Apr 14 10:49:16 user nova-compute[71509]:   <target dev="vdb" bus="virtio"/>
Apr 14 10:49:16 user nova-compute[71509]:   <serial>4116efc6-988f-40cf-af06-2abf9c6cd44a</serial>
Apr 14 10:49:16 user nova-compute[71509]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 10:49:16 user nova-compute[71509]: </disk>
Apr 14 10:49:16 user nova-compute[71509]:  {{(pid=71509) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 10:49:16 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-9cd7a8a7-fb62-4101-9e59-ff4f0372e802 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Successfully detached device vdb from instance 0e6c800c-9b35-4e35-969e-c40367056dce from the persistent domain config.
Apr 14 10:49:16 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-9cd7a8a7-fb62-4101-9e59-ff4f0372e802 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0e6c800c-9b35-4e35-969e-c40367056dce from the live domain config. {{(pid=71509) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 10:49:16 user nova-compute[71509]: DEBUG nova.virt.libvirt.guest [None req-9cd7a8a7-fb62-4101-9e59-ff4f0372e802 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 10:49:16 user nova-compute[71509]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 10:49:16 user nova-compute[71509]:   <source dev="/dev/sdc"/>
Apr 14 10:49:16 user nova-compute[71509]:   <target dev="vdb" bus="virtio"/>
Apr 14 10:49:16 user nova-compute[71509]:   <serial>4116efc6-988f-40cf-af06-2abf9c6cd44a</serial>
Apr 14 10:49:16 user nova-compute[71509]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 10:49:16 user nova-compute[71509]: </disk>
Apr 14 10:49:16 user nova-compute[71509]:  {{(pid=71509) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 10:49:16 user nova-compute[71509]: DEBUG nova.network.neutron [req-8948854c-63af-4abe-8d84-4bb46ebfc21e req-98dfa048-a948-47df-a5cc-74b9546b73b5 service nova] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Updated VIF entry in instance network info cache for port 473d9af8-25a0-4e5a-9afb-7a0c843115cc. {{(pid=71509) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 10:49:16 user nova-compute[71509]: DEBUG nova.network.neutron [req-8948854c-63af-4abe-8d84-4bb46ebfc21e req-98dfa048-a948-47df-a5cc-74b9546b73b5 service nova] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Updating instance_info_cache with network_info: [{"id": "473d9af8-25a0-4e5a-9afb-7a0c843115cc", "address": "fa:16:3e:b0:12:bf", "network": {"id": "653f0c81-1afd-4ca6-9639-675ead1a6127", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-932652547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb9b9fc4f2e244879502006bb844761c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap473d9af8-25", "ovs_interfaceid": "473d9af8-25a0-4e5a-9afb-7a0c843115cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:49:16 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-8948854c-63af-4abe-8d84-4bb46ebfc21e req-98dfa048-a948-47df-a5cc-74b9546b73b5 service nova] Releasing lock "refresh_cache-8586a70e-9855-4177-ac1b-cf707a4df871" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:49:17 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Received event <DeviceRemovedEvent: 1681469357.0202565, 0e6c800c-9b35-4e35-969e-c40367056dce => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71509) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 10:49:17 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-9cd7a8a7-fb62-4101-9e59-ff4f0372e802 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0e6c800c-9b35-4e35-969e-c40367056dce {{(pid=71509) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 10:49:17 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-9cd7a8a7-fb62-4101-9e59-ff4f0372e802 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Successfully detached device vdb from instance 0e6c800c-9b35-4e35-969e-c40367056dce from the live domain config.
Apr 14 10:49:17 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9cd7a8a7-fb62-4101-9e59-ff4f0372e802 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] calling os-brick to detach iSCSI Volume {{(pid=71509) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 10:49:17 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cd7a8a7-fb62-4101-9e59-ff4f0372e802 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0bf0749390>, {'target_iqn': 'iqn.2010-10.org.openstack:4116efc6-988f-40cf-af06-2abf9c6cd44a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GJNowkDY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 10:49:17 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-9cd7a8a7-fb62-4101-9e59-ff4f0372e802 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 10:49:17 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-9cd7a8a7-fb62-4101-9e59-ff4f0372e802 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 10:49:17 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-9cd7a8a7-fb62-4101-9e59-ff4f0372e802 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 10:49:17 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:17 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:49:17 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[17ecb62f-99e2-4bbe-a577-40bfca8edb39]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4116efc6-988f-40cf-af06-2abf9c6cd44a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:49:17 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cd7a8a7-fb62-4101-9e59-ff4f0372e802 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 10:49:17 user nova-compute[71509]: No targets found.
Apr 14 10:49:17 user nova-compute[71509]: iSNS:
Apr 14 10:49:17 user nova-compute[71509]: No targets found.
Apr 14 10:49:17 user nova-compute[71509]: STATIC:
Apr 14 10:49:17 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:4116efc6-988f-40cf-af06-2abf9c6cd44a
Apr 14 10:49:17 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:49:17 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:49:17 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee
Apr 14 10:49:17 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:49:17 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:49:17 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d
Apr 14 10:49:17 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:49:17 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:49:17 user nova-compute[71509]: FIRMWARE:
Apr 14 10:49:17 user nova-compute[71509]: No targets found.
Apr 14 10:49:17 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:49:17 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cd7a8a7-fb62-4101-9e59-ff4f0372e802 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 10:49:17 user nova-compute[71509]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 10:49:17 user nova-compute[71509]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71509) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 10:49:17 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cd7a8a7-fb62-4101-9e59-ff4f0372e802 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4116efc6-988f-40cf-af06-2abf9c6cd44a', 0)] {{(pid=71509) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 10:49:17 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:17 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:49:17 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fa89190-14a1-4b01-89f7-dd45e727eec7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4116efc6-988f-40cf-af06-2abf9c6cd44a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:49:17 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:17 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:49:17 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab6da263-74f1-4e27-8df5-8c96d5670931]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4116efc6-988f-40cf-af06-2abf9c6cd44a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:49:17 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cd7a8a7-fb62-4101-9e59-ff4f0372e802 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4116efc6-988f-40cf-af06-2abf9c6cd44a (non-flash)
Apr 14 10:49:17 user nova-compute[71509]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d (non-flash)
Apr 14 10:49:17 user nova-compute[71509]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee (non-flash)
Apr 14 10:49:17 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:49:17 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cd7a8a7-fb62-4101-9e59-ff4f0372e802 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4116efc6-988f-40cf-af06-2abf9c6cd44a (non-flash)
Apr 14 10:49:17 user nova-compute[71509]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d (non-flash)
Apr 14 10:49:17 user nova-compute[71509]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee (non-flash)
Apr 14 10:49:17 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 10:49:17 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cd7a8a7-fb62-4101-9e59-ff4f0372e802 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0c3a715ea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4116efc6-988f-40cf-af06-2abf9c6cd44a'): ({'sdc'}, set())}) {{(pid=71509) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 10:49:17 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-9cd7a8a7-fb62-4101-9e59-ff4f0372e802 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Removing single pathed devices sdc {{(pid=71509) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 10:49:17 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:17 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:49:17 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[a63c4899-53de-4d83-911c-db9065af7679]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:49:17 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:17 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:49:17 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[083084b2-5aab-4548-8f5e-f61517b9ca84]: (4, ('ok\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:49:17 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-9cd7a8a7-fb62-4101-9e59-ff4f0372e802 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Flushing IO for device /dev/sdc {{(pid=71509) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 10:49:17 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:17 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:49:17 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[9324240a-7a56-4cf6-a671-c6bb5964b7b1]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:49:17 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-9cd7a8a7-fb62-4101-9e59-ff4f0372e802 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71509) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 10:49:17 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:17 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.036s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:49:17 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c1cf89e-dd00-4f26-aba7-e7a9464e6859]: (4, ('1', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:49:17 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-9cd7a8a7-fb62-4101-9e59-ff4f0372e802 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71509) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 10:49:17 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-9cd7a8a7-fb62-4101-9e59-ff4f0372e802 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] SCSI volumes sdc have been removed. {{(pid=71509) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 10:49:17 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cd7a8a7-fb62-4101-9e59-ff4f0372e802 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4116efc6-988f-40cf-af06-2abf9c6cd44a')] {{(pid=71509) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 10:49:17 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4116efc6-988f-40cf-af06-2abf9c6cd44a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:17 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4116efc6-988f-40cf-af06-2abf9c6cd44a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:49:17 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ae6bb9a-068c-4e08-b23f-ab1138b0ddcf]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:49:17 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cd7a8a7-fb62-4101-9e59-ff4f0372e802 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:49:17 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4116efc6-988f-40cf-af06-2abf9c6cd44a -p 172.16.0.220:3260 --logout {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:17 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4116efc6-988f-40cf-af06-2abf9c6cd44a -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:49:17 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc8ec2f0-628d-439f-8b19-f3e7d70f0247]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:4116efc6-988f-40cf-af06-2abf9c6cd44a, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:4116efc6-988f-40cf-af06-2abf9c6cd44a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:49:17 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cd7a8a7-fb62-4101-9e59-ff4f0372e802 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:4116efc6-988f-40cf-af06-2abf9c6cd44a, portal: 172.16.0.220,3260]
Apr 14 10:49:17 user nova-compute[71509]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:4116efc6-988f-40cf-af06-2abf9c6cd44a, portal: 172.16.0.220,3260] successful.
Apr 14 10:49:17 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:49:17 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4116efc6-988f-40cf-af06-2abf9c6cd44a -p 172.16.0.220:3260 --op delete {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:17 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4116efc6-988f-40cf-af06-2abf9c6cd44a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:49:17 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b801cb7-89d8-453b-81a0-afbade1726b3]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:49:17 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cd7a8a7-fb62-4101-9e59-ff4f0372e802 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:49:17 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-9cd7a8a7-fb62-4101-9e59-ff4f0372e802 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 10:49:17 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cd7a8a7-fb62-4101-9e59-ff4f0372e802 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] <== disconnect_volume: return (316ms) None {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 10:49:17 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9cd7a8a7-fb62-4101-9e59-ff4f0372e802 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Disconnected iSCSI Volume {{(pid=71509) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 10:49:17 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:49:18 user nova-compute[71509]: INFO nova.compute.manager [None req-81314060-f37e-4eb5-ab1d-81790bb0f4b2 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] Unrescuing
Apr 14 10:49:18 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-81314060-f37e-4eb5-ab1d-81790bb0f4b2 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Acquiring lock "refresh_cache-97f20661-8b60-439e-b7af-2fc2013c5ade" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:49:18 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-81314060-f37e-4eb5-ab1d-81790bb0f4b2 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Acquired lock "refresh_cache-97f20661-8b60-439e-b7af-2fc2013c5ade" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:49:18 user nova-compute[71509]: DEBUG nova.network.neutron [None req-81314060-f37e-4eb5-ab1d-81790bb0f4b2 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] Building network info cache for instance {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 10:49:18 user nova-compute[71509]: DEBUG nova.objects.instance [None req-9cd7a8a7-fb62-4101-9e59-ff4f0372e802 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Lazy-loading 'flavor' on Instance uuid 0e6c800c-9b35-4e35-969e-c40367056dce {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:49:18 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-9cd7a8a7-fb62-4101-9e59-ff4f0372e802 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Lock "0e6c800c-9b35-4e35-969e-c40367056dce" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:49:19 user nova-compute[71509]: DEBUG nova.network.neutron [None req-81314060-f37e-4eb5-ab1d-81790bb0f4b2 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] Updating instance_info_cache with network_info: [{"id": "270b85b0-1832-4118-a8b0-ff784587b58a", "address": "fa:16:3e:75:ba:ae", "network": {"id": "22eb5f87-be4d-447d-bafe-25e0284ea3ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-787804772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf93e5dac50342d0b65ef09711401e99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap270b85b0-18", "ovs_interfaceid": "270b85b0-1832-4118-a8b0-ff784587b58a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:49:19 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-81314060-f37e-4eb5-ab1d-81790bb0f4b2 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Releasing lock "refresh_cache-97f20661-8b60-439e-b7af-2fc2013c5ade" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:49:19 user nova-compute[71509]: DEBUG nova.objects.instance [None req-81314060-f37e-4eb5-ab1d-81790bb0f4b2 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lazy-loading 'flavor' on Instance uuid 97f20661-8b60-439e-b7af-2fc2013c5ade {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:49:19 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-590a2c0a-4bdb-4b8d-badf-f356ac5be205 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Acquiring lock "8586a70e-9855-4177-ac1b-cf707a4df871" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:49:19 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-590a2c0a-4bdb-4b8d-badf-f356ac5be205 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "8586a70e-9855-4177-ac1b-cf707a4df871" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:49:19 user nova-compute[71509]: DEBUG nova.objects.instance [None req-590a2c0a-4bdb-4b8d-badf-f356ac5be205 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lazy-loading 'flavor' on Instance uuid 8586a70e-9855-4177-ac1b-cf707a4df871 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:49:19 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-590a2c0a-4bdb-4b8d-badf-f356ac5be205 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "8586a70e-9855-4177-ac1b-cf707a4df871" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:49:19 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:49:19 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-590a2c0a-4bdb-4b8d-badf-f356ac5be205 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Acquiring lock "8586a70e-9855-4177-ac1b-cf707a4df871" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:49:19 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-590a2c0a-4bdb-4b8d-badf-f356ac5be205 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "8586a70e-9855-4177-ac1b-cf707a4df871" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:49:19 user nova-compute[71509]: INFO nova.compute.manager [None req-590a2c0a-4bdb-4b8d-badf-f356ac5be205 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Attaching volume 64fbf5f9-3b53-42b6-8eb9-34688db256a2 to /dev/vdb
Apr 14 10:49:19 user nova-compute[71509]: DEBUG os_brick.utils [None req-590a2c0a-4bdb-4b8d-badf-f356ac5be205 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 10:49:19 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:49:19 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:19 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:49:19 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:49:19 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dbf6a41-38f0-444f-9056-5815767e9110]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50119df3c417\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:49:19 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:19 user nova-compute[71509]: DEBUG nova.compute.manager [req-4554a73c-15e6-4a64-a750-96c9d25b630d req-500ef23d-b2bc-4ef6-9d22-38b1b60acfd2 service nova] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] Received event network-vif-unplugged-270b85b0-1832-4118-a8b0-ff784587b58a {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:49:19 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-4554a73c-15e6-4a64-a750-96c9d25b630d req-500ef23d-b2bc-4ef6-9d22-38b1b60acfd2 service nova] Acquiring lock "97f20661-8b60-439e-b7af-2fc2013c5ade-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:49:19 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-4554a73c-15e6-4a64-a750-96c9d25b630d req-500ef23d-b2bc-4ef6-9d22-38b1b60acfd2 service nova] Lock "97f20661-8b60-439e-b7af-2fc2013c5ade-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:49:19 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-4554a73c-15e6-4a64-a750-96c9d25b630d req-500ef23d-b2bc-4ef6-9d22-38b1b60acfd2 service nova] Lock "97f20661-8b60-439e-b7af-2fc2013c5ade-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:49:19 user nova-compute[71509]: DEBUG nova.compute.manager [req-4554a73c-15e6-4a64-a750-96c9d25b630d req-500ef23d-b2bc-4ef6-9d22-38b1b60acfd2 service nova] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] No waiting events found dispatching network-vif-unplugged-270b85b0-1832-4118-a8b0-ff784587b58a {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:49:19 user nova-compute[71509]: WARNING nova.compute.manager [req-4554a73c-15e6-4a64-a750-96c9d25b630d req-500ef23d-b2bc-4ef6-9d22-38b1b60acfd2 service nova] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] Received unexpected event network-vif-unplugged-270b85b0-1832-4118-a8b0-ff784587b58a for instance with vm_state rescued and task_state unrescuing.
Apr 14 10:49:19 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:49:19 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e4ca6f1-8507-4943-96b5-749f818e08cb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:49:19 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:19 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:49:19 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd7412df-033a-4bc1-8da9-d5bb914bb3d3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:49:19 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[66dd59af-a465-4a37-82ee-41bbcb4370ab]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:49:19 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-590a2c0a-4bdb-4b8d-badf-f356ac5be205 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Running cmd (subprocess): nvme version {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:19 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-590a2c0a-4bdb-4b8d-badf-f356ac5be205 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] 'nvme version' failed. Not Retrying. {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 10:49:19 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.nvmeof [None req-590a2c0a-4bdb-4b8d-badf-f356ac5be205 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] nvme not present on system {{(pid=71509) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 10:49:19 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:19 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 10:49:19 user nova-compute[71509]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 10:49:19 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c52c1e3-965c-4db4-923e-a3c65bfb6ac5]: (4, '') {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:49:19 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-590a2c0a-4bdb-4b8d-badf-f356ac5be205 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71509) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 10:49:19 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-590a2c0a-4bdb-4b8d-badf-f356ac5be205 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71509) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 10:49:19 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-590a2c0a-4bdb-4b8d-badf-f356ac5be205 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] LIGHTOS: no hostnqn found. {{(pid=71509) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 10:49:19 user nova-compute[71509]: DEBUG os_brick.utils [None req-590a2c0a-4bdb-4b8d-badf-f356ac5be205 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50119df3c417', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 10:49:19 user nova-compute[71509]: DEBUG nova.virt.block_device [None req-590a2c0a-4bdb-4b8d-badf-f356ac5be205 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Updating existing volume attachment record: 129e52c7-c683-4bd6-80e9-7ce701f3821d {{(pid=71509) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 10:49:19 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] Instance destroyed successfully.
Apr 14 10:49:20 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-478571c1-9ca7-413f-a1f1-29e05438ff53 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Acquiring lock "55178126-9766-4875-9122-39dcc87ce82c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:49:20 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-478571c1-9ca7-413f-a1f1-29e05438ff53 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "55178126-9766-4875-9122-39dcc87ce82c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:49:20 user nova-compute[71509]: DEBUG nova.objects.instance [None req-478571c1-9ca7-413f-a1f1-29e05438ff53 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lazy-loading 'flavor' on Instance uuid 55178126-9766-4875-9122-39dcc87ce82c {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:49:20 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-478571c1-9ca7-413f-a1f1-29e05438ff53 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "55178126-9766-4875-9122-39dcc87ce82c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:49:20 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:49:20 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-478571c1-9ca7-413f-a1f1-29e05438ff53 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Acquiring lock "55178126-9766-4875-9122-39dcc87ce82c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:49:20 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-478571c1-9ca7-413f-a1f1-29e05438ff53 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "55178126-9766-4875-9122-39dcc87ce82c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:49:20 user nova-compute[71509]: INFO nova.compute.manager [None req-478571c1-9ca7-413f-a1f1-29e05438ff53 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] [instance: 55178126-9766-4875-9122-39dcc87ce82c] Attaching volume 98928234-b030-42db-89fd-9b21352606dc to /dev/vdb
Apr 14 10:49:20 user nova-compute[71509]: DEBUG os_brick.utils [None req-478571c1-9ca7-413f-a1f1-29e05438ff53 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 10:49:20 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:20 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:49:20 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a414e0c-587b-462d-bb0b-23ada03c7ace]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50119df3c417\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:49:20 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:20 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:49:20 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[40c4267d-1c91-472c-9cf8-aa8c28845772]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:49:20 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:20 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:49:20 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[02d36ca7-9327-4d6f-8e85-119783974190]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:49:20 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d191a9b-2918-4207-8c18-d8a8cb595fd1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:49:20 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-478571c1-9ca7-413f-a1f1-29e05438ff53 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Running cmd (subprocess): nvme version {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:20 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-478571c1-9ca7-413f-a1f1-29e05438ff53 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] 'nvme version' failed. Not Retrying. {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 10:49:20 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.nvmeof [None req-478571c1-9ca7-413f-a1f1-29e05438ff53 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] nvme not present on system {{(pid=71509) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 10:49:20 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:20 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 10:49:20 user nova-compute[71509]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 10:49:20 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd248571-2ca4-4f68-bdf3-c281419b3f04]: (4, '') {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:49:20 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-478571c1-9ca7-413f-a1f1-29e05438ff53 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71509) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 10:49:20 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-478571c1-9ca7-413f-a1f1-29e05438ff53 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71509) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 10:49:20 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-478571c1-9ca7-413f-a1f1-29e05438ff53 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] LIGHTOS: no hostnqn found. {{(pid=71509) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 10:49:20 user nova-compute[71509]: DEBUG os_brick.utils [None req-478571c1-9ca7-413f-a1f1-29e05438ff53 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50119df3c417', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 10:49:20 user nova-compute[71509]: DEBUG nova.virt.block_device [None req-478571c1-9ca7-413f-a1f1-29e05438ff53 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] [instance: 55178126-9766-4875-9122-39dcc87ce82c] Updating existing volume attachment record: 77ebd0c0-84f9-4140-96c2-47cc58559e74 {{(pid=71509) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 10:49:21 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:49:21 user nova-compute[71509]: DEBUG nova.compute.manager [req-9a734b39-b307-4d1d-9eaa-2a43c4b47164 req-d0a56118-fc4c-4a5d-bc0d-d7f2d39ffadc service nova] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Received event network-changed-6099437e-5607-4a06-abcb-15d465c7ecf8 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:49:21 user nova-compute[71509]: DEBUG nova.compute.manager [req-9a734b39-b307-4d1d-9eaa-2a43c4b47164 req-d0a56118-fc4c-4a5d-bc0d-d7f2d39ffadc service nova] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Refreshing instance network info cache due to event network-changed-6099437e-5607-4a06-abcb-15d465c7ecf8. {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 10:49:21 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-9a734b39-b307-4d1d-9eaa-2a43c4b47164 req-d0a56118-fc4c-4a5d-bc0d-d7f2d39ffadc service nova] Acquiring lock "refresh_cache-39586d44-1d8e-4607-ab4d-c03a7d841606" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:49:21 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-9a734b39-b307-4d1d-9eaa-2a43c4b47164 req-d0a56118-fc4c-4a5d-bc0d-d7f2d39ffadc service nova] Acquired lock "refresh_cache-39586d44-1d8e-4607-ab4d-c03a7d841606" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:49:21 user nova-compute[71509]: DEBUG nova.network.neutron [req-9a734b39-b307-4d1d-9eaa-2a43c4b47164 req-d0a56118-fc4c-4a5d-bc0d-d7f2d39ffadc service nova] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Refreshing network info cache for port 6099437e-5607-4a06-abcb-15d465c7ecf8 {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 10:49:21 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:49:21 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:49:21 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-825c857b-2d5a-4fd6-8f87-c976772f152d tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Acquiring lock "39586d44-1d8e-4607-ab4d-c03a7d841606" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:49:21 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-825c857b-2d5a-4fd6-8f87-c976772f152d tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Lock "39586d44-1d8e-4607-ab4d-c03a7d841606" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:49:21 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-825c857b-2d5a-4fd6-8f87-c976772f152d tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Acquiring lock "39586d44-1d8e-4607-ab4d-c03a7d841606-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:49:21 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-825c857b-2d5a-4fd6-8f87-c976772f152d tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Lock "39586d44-1d8e-4607-ab4d-c03a7d841606-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:49:21 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-825c857b-2d5a-4fd6-8f87-c976772f152d tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Lock "39586d44-1d8e-4607-ab4d-c03a7d841606-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:49:21 user nova-compute[71509]: INFO nova.compute.manager [None req-825c857b-2d5a-4fd6-8f87-c976772f152d tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Terminating instance
Apr 14 10:49:21 user nova-compute[71509]: DEBUG nova.compute.manager [None req-825c857b-2d5a-4fd6-8f87-c976772f152d tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Start destroying the instance on the hypervisor. {{(pid=71509) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 10:49:21 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:49:21 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:49:21 user nova-compute[71509]: DEBUG nova.compute.manager [req-be3e3f4b-03d5-447c-89da-40d70c9f4842 req-93350680-b1d5-4a74-8ae1-d999559b7422 service nova] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] Received event network-vif-plugged-270b85b0-1832-4118-a8b0-ff784587b58a {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:49:21 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-be3e3f4b-03d5-447c-89da-40d70c9f4842 req-93350680-b1d5-4a74-8ae1-d999559b7422 service nova] Acquiring lock "97f20661-8b60-439e-b7af-2fc2013c5ade-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:49:21 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-be3e3f4b-03d5-447c-89da-40d70c9f4842 req-93350680-b1d5-4a74-8ae1-d999559b7422 service nova] Lock "97f20661-8b60-439e-b7af-2fc2013c5ade-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:49:21 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-be3e3f4b-03d5-447c-89da-40d70c9f4842 req-93350680-b1d5-4a74-8ae1-d999559b7422 service nova] Lock "97f20661-8b60-439e-b7af-2fc2013c5ade-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:49:21 user nova-compute[71509]: DEBUG nova.compute.manager [req-be3e3f4b-03d5-447c-89da-40d70c9f4842 req-93350680-b1d5-4a74-8ae1-d999559b7422 service nova] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] No waiting events found dispatching network-vif-plugged-270b85b0-1832-4118-a8b0-ff784587b58a {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:49:21 user nova-compute[71509]: WARNING nova.compute.manager [req-be3e3f4b-03d5-447c-89da-40d70c9f4842 req-93350680-b1d5-4a74-8ae1-d999559b7422 service nova] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] Received unexpected event network-vif-plugged-270b85b0-1832-4118-a8b0-ff784587b58a for instance with vm_state rescued and task_state unrescuing.
Apr 14 10:49:21 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:49:21 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:49:21 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:49:22 user nova-compute[71509]: DEBUG nova.network.neutron [req-9a734b39-b307-4d1d-9eaa-2a43c4b47164 req-d0a56118-fc4c-4a5d-bc0d-d7f2d39ffadc service nova] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Updated VIF entry in instance network info cache for port 6099437e-5607-4a06-abcb-15d465c7ecf8. {{(pid=71509) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 10:49:22 user nova-compute[71509]: DEBUG nova.network.neutron [req-9a734b39-b307-4d1d-9eaa-2a43c4b47164 req-d0a56118-fc4c-4a5d-bc0d-d7f2d39ffadc service nova] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Updating instance_info_cache with network_info: [{"id": "6099437e-5607-4a06-abcb-15d465c7ecf8", "address": "fa:16:3e:4b:6c:e7", "network": {"id": "69274626-4a94-46d8-be28-534a98fb6817", "bridge": "br-int", "label": "tempest-TestShelveInstance-480849665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "340e1e1695464eb5ad8a8c881cf24611", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6099437e-56", "ovs_interfaceid": "6099437e-5607-4a06-abcb-15d465c7ecf8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:49:22 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Instance destroyed successfully.
Apr 14 10:49:22 user nova-compute[71509]: DEBUG nova.objects.instance [None req-825c857b-2d5a-4fd6-8f87-c976772f152d tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Lazy-loading 'resources' on Instance uuid 39586d44-1d8e-4607-ab4d-c03a7d841606 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:49:22 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-9a734b39-b307-4d1d-9eaa-2a43c4b47164 req-d0a56118-fc4c-4a5d-bc0d-d7f2d39ffadc service nova] Releasing lock "refresh_cache-39586d44-1d8e-4607-ab4d-c03a7d841606" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:49:22 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-825c857b-2d5a-4fd6-8f87-c976772f152d tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T10:43:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1022992671',display_name='tempest-TestShelveInstance-server-1022992671',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1022992671',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE3ZHmXOyTBTmz/eyfbYxzCGMRdCEyszErL9xPCKFdEiRsMyb95B0M7mgiLexh904XoCh1bLLkQyrJ5ED+7iDH16ePICxxSDKO7GY80QCmCqc5cAXakERyNUFb4hTkOeQA==',key_name='tempest-TestShelveInstance-261961953',keypairs=<?>,launch_index=0,launched_at=2023-04-14T10:47:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='340e1e1695464eb5ad8a8c881cf24611',ramdisk_id='',reservation_id='r-ejwha0rq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1930659141',owner_user_name='tempest-TestShelveInstance-1930659141-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T10:47:47Z,user_data=None,user_id='15c4ab86a8d244c4be5889b4ac47561a',uuid=39586d44-1d8e-4607-ab4d-c03a7d841606,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6099437e-5607-4a06-abcb-15d465c7ecf8", "address": "fa:16:3e:4b:6c:e7", "network": {"id": "69274626-4a94-46d8-be28-534a98fb6817", "bridge": "br-int", "label": "tempest-TestShelveInstance-480849665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "340e1e1695464eb5ad8a8c881cf24611", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6099437e-56", "ovs_interfaceid": "6099437e-5607-4a06-abcb-15d465c7ecf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 10:49:22 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-825c857b-2d5a-4fd6-8f87-c976772f152d tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Converting VIF {"id": "6099437e-5607-4a06-abcb-15d465c7ecf8", "address": "fa:16:3e:4b:6c:e7", "network": {"id": "69274626-4a94-46d8-be28-534a98fb6817", "bridge": "br-int", "label": "tempest-TestShelveInstance-480849665-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "340e1e1695464eb5ad8a8c881cf24611", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6099437e-56", "ovs_interfaceid": "6099437e-5607-4a06-abcb-15d465c7ecf8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:49:22 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-825c857b-2d5a-4fd6-8f87-c976772f152d tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:6c:e7,bridge_name='br-int',has_traffic_filtering=True,id=6099437e-5607-4a06-abcb-15d465c7ecf8,network=Network(69274626-4a94-46d8-be28-534a98fb6817),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6099437e-56') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:49:22 user nova-compute[71509]: DEBUG os_vif [None req-825c857b-2d5a-4fd6-8f87-c976772f152d tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:6c:e7,bridge_name='br-int',has_traffic_filtering=True,id=6099437e-5607-4a06-abcb-15d465c7ecf8,network=Network(69274626-4a94-46d8-be28-534a98fb6817),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6099437e-56') {{(pid=71509) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 10:49:22 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:49:22 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6099437e-56, bridge=br-int, if_exists=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:49:22 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:49:22 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 10:49:22 user nova-compute[71509]: INFO os_vif [None req-825c857b-2d5a-4fd6-8f87-c976772f152d tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:6c:e7,bridge_name='br-int',has_traffic_filtering=True,id=6099437e-5607-4a06-abcb-15d465c7ecf8,network=Network(69274626-4a94-46d8-be28-534a98fb6817),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6099437e-56')
Apr 14 10:49:22 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-825c857b-2d5a-4fd6-8f87-c976772f152d tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] calling os-brick to detach iSCSI Volume {{(pid=71509) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 10:49:22 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-825c857b-2d5a-4fd6-8f87-c976772f152d tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0bf0749390>, {'target_iqn': 'iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xzHUpiIh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 10:49:22 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-825c857b-2d5a-4fd6-8f87-c976772f152d tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 10:49:22 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-825c857b-2d5a-4fd6-8f87-c976772f152d tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 10:49:22 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-825c857b-2d5a-4fd6-8f87-c976772f152d tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 10:49:22 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:22 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:49:22 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[57c7da81-4df5-407e-8e70-2e6c7db65db7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:49:22 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-825c857b-2d5a-4fd6-8f87-c976772f152d tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 10:49:22 user nova-compute[71509]: No targets found.
Apr 14 10:49:22 user nova-compute[71509]: iSNS:
Apr 14 10:49:22 user nova-compute[71509]: No targets found.
Apr 14 10:49:22 user nova-compute[71509]: STATIC:
Apr 14 10:49:22 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee
Apr 14 10:49:22 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:49:22 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:49:22 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d
Apr 14 10:49:22 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:49:22 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:49:22 user nova-compute[71509]: FIRMWARE:
Apr 14 10:49:22 user nova-compute[71509]: No targets found.
Apr 14 10:49:22 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:49:22 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-825c857b-2d5a-4fd6-8f87-c976772f152d tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 10:49:22 user nova-compute[71509]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 10:49:22 user nova-compute[71509]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71509) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 10:49:22 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-825c857b-2d5a-4fd6-8f87-c976772f152d tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee', 0)] {{(pid=71509) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 10:49:22 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:22 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:49:22 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[84156452-a285-4e85-918a-d02a810d255b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:49:22 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:22 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:49:22 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aa4bf54-9651-4446-8116-9ff59f52c8c2]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:49:22 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-825c857b-2d5a-4fd6-8f87-c976772f152d tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d (non-flash)
Apr 14 10:49:22 user nova-compute[71509]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee (non-flash)
Apr 14 10:49:22 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:49:22 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-825c857b-2d5a-4fd6-8f87-c976772f152d tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d (non-flash)
Apr 14 10:49:22 user nova-compute[71509]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee (non-flash)
Apr 14 10:49:22 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 10:49:22 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-825c857b-2d5a-4fd6-8f87-c976772f152d tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0c3a75e8c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee'): ({'sdd'}, set())}) {{(pid=71509) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 10:49:22 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-825c857b-2d5a-4fd6-8f87-c976772f152d tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Removing single pathed devices sdd {{(pid=71509) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 10:49:22 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:22 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:49:22 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6b67fd5-51c0-45bb-87b3-f181f83a17d1]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:49:22 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:22 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:49:22 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ebb9778-a0d9-47fd-8ac5-19f64774f90f]: (4, ('ok\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:49:22 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-825c857b-2d5a-4fd6-8f87-c976772f152d tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Flushing IO for device /dev/sdd {{(pid=71509) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 10:49:22 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:22 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:49:22 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[1349587c-6182-4fd2-9af8-9848e7481b09]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:49:22 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-825c857b-2d5a-4fd6-8f87-c976772f152d tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71509) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 10:49:22 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:22 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.061s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:49:22 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[128184f5-1e23-44f0-bc2a-ecb9483e00d9]: (4, ('1', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:49:22 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-825c857b-2d5a-4fd6-8f87-c976772f152d tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71509) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 10:49:22 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-825c857b-2d5a-4fd6-8f87-c976772f152d tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] SCSI volumes sdd have been removed. {{(pid=71509) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 10:49:22 user nova-compute[71509]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23661376633333532', '/dev/disk/by-id/scsi-1SCST_BIO8089ee98-6a7f3352f8840094', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_8089ee98') {{(pid=82281) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 14 10:49:22 user nova-compute[71509]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23661376633333532
Apr 14 10:49:22 user nova-compute[71509]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO8089ee98-6a7f3352f8840094
Apr 14 10:49:22 user nova-compute[71509]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_8089ee98
Apr 14 10:49:22 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1d45fad-65f7-460b-ac94-28ecc89e9e66]: (4, None) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:49:22 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-825c857b-2d5a-4fd6-8f87-c976772f152d tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee')] {{(pid=71509) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 10:49:22 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:22 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:49:22 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[54b56691-aec4-425f-8f43-dbc529481950]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:49:22 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-825c857b-2d5a-4fd6-8f87-c976772f152d tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:49:22 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee -p 172.16.0.220:3260 --logout {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:22 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:49:22 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[247e5c7a-5356-4d22-a4c4-48eee1603be0]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:49:22 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-825c857b-2d5a-4fd6-8f87-c976772f152d tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee, portal: 172.16.0.220,3260]
Apr 14 10:49:22 user nova-compute[71509]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee, portal: 172.16.0.220,3260] successful.
Apr 14 10:49:22 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:49:22 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee -p 172.16.0.220:3260 --op delete {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:22 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5647685a-aec6-4498-b1b4-372602a4c7ee -p 172.16.0.220:3260 --op delete" returned: 0 in 0.056s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:49:22 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[34f8ae25-e7f0-4ff1-920f-e2a8ec7c9375]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:49:22 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-825c857b-2d5a-4fd6-8f87-c976772f152d tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:49:22 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-825c857b-2d5a-4fd6-8f87-c976772f152d tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.391s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 10:49:22 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-825c857b-2d5a-4fd6-8f87-c976772f152d tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] <== disconnect_volume: return (393ms) None {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 10:49:22 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-825c857b-2d5a-4fd6-8f87-c976772f152d tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Disconnected iSCSI Volume {{(pid=71509) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 10:49:22 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-825c857b-2d5a-4fd6-8f87-c976772f152d tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Deleting instance files /opt/stack/data/nova/instances/39586d44-1d8e-4607-ab4d-c03a7d841606_del
Apr 14 10:49:22 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-825c857b-2d5a-4fd6-8f87-c976772f152d tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Deletion of /opt/stack/data/nova/instances/39586d44-1d8e-4607-ab4d-c03a7d841606_del complete
Apr 14 10:49:22 user nova-compute[71509]: INFO nova.compute.manager [None req-825c857b-2d5a-4fd6-8f87-c976772f152d tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Took 1.31 seconds to destroy the instance on the hypervisor.
Apr 14 10:49:22 user nova-compute[71509]: DEBUG oslo.service.loopingcall [None req-825c857b-2d5a-4fd6-8f87-c976772f152d tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71509) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 10:49:22 user nova-compute[71509]: DEBUG nova.compute.manager [-] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Deallocating network for instance {{(pid=71509) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 10:49:22 user nova-compute[71509]: DEBUG nova.network.neutron [-] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] deallocate_for_instance() {{(pid=71509) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 10:49:22 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:49:23 user nova-compute[71509]: DEBUG nova.network.neutron [-] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Updating instance_info_cache with network_info: [] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:49:23 user nova-compute[71509]: INFO nova.compute.manager [-] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Took 0.58 seconds to deallocate network for instance.
Apr 14 10:49:23 user nova-compute[71509]: DEBUG nova.compute.manager [req-d005a712-fc0a-45c5-a31f-7a3c7518c250 req-bc5a31cd-ea1c-427f-998e-41119df7f9ab service nova] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] Received event network-vif-plugged-270b85b0-1832-4118-a8b0-ff784587b58a {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:49:23 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-d005a712-fc0a-45c5-a31f-7a3c7518c250 req-bc5a31cd-ea1c-427f-998e-41119df7f9ab service nova] Acquiring lock "97f20661-8b60-439e-b7af-2fc2013c5ade-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:49:23 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-d005a712-fc0a-45c5-a31f-7a3c7518c250 req-bc5a31cd-ea1c-427f-998e-41119df7f9ab service nova] Lock "97f20661-8b60-439e-b7af-2fc2013c5ade-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:49:23 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-d005a712-fc0a-45c5-a31f-7a3c7518c250 req-bc5a31cd-ea1c-427f-998e-41119df7f9ab service nova] Lock "97f20661-8b60-439e-b7af-2fc2013c5ade-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:49:23 user nova-compute[71509]: DEBUG nova.compute.manager [req-d005a712-fc0a-45c5-a31f-7a3c7518c250 req-bc5a31cd-ea1c-427f-998e-41119df7f9ab service nova] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] No waiting events found dispatching network-vif-plugged-270b85b0-1832-4118-a8b0-ff784587b58a {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:49:23 user nova-compute[71509]: WARNING nova.compute.manager [req-d005a712-fc0a-45c5-a31f-7a3c7518c250 req-bc5a31cd-ea1c-427f-998e-41119df7f9ab service nova] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] Received unexpected event network-vif-plugged-270b85b0-1832-4118-a8b0-ff784587b58a for instance with vm_state rescued and task_state unrescuing.
Apr 14 10:49:23 user nova-compute[71509]: DEBUG nova.compute.manager [req-d005a712-fc0a-45c5-a31f-7a3c7518c250 req-bc5a31cd-ea1c-427f-998e-41119df7f9ab service nova] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] Received event network-vif-plugged-270b85b0-1832-4118-a8b0-ff784587b58a {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:49:23 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-d005a712-fc0a-45c5-a31f-7a3c7518c250 req-bc5a31cd-ea1c-427f-998e-41119df7f9ab service nova] Acquiring lock "97f20661-8b60-439e-b7af-2fc2013c5ade-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:49:23 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-d005a712-fc0a-45c5-a31f-7a3c7518c250 req-bc5a31cd-ea1c-427f-998e-41119df7f9ab service nova] Lock "97f20661-8b60-439e-b7af-2fc2013c5ade-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:49:23 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-d005a712-fc0a-45c5-a31f-7a3c7518c250 req-bc5a31cd-ea1c-427f-998e-41119df7f9ab service nova] Lock "97f20661-8b60-439e-b7af-2fc2013c5ade-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:49:23 user nova-compute[71509]: DEBUG nova.compute.manager [req-d005a712-fc0a-45c5-a31f-7a3c7518c250 req-bc5a31cd-ea1c-427f-998e-41119df7f9ab service nova] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] No waiting events found dispatching network-vif-plugged-270b85b0-1832-4118-a8b0-ff784587b58a {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:49:23 user nova-compute[71509]: WARNING nova.compute.manager [req-d005a712-fc0a-45c5-a31f-7a3c7518c250 req-bc5a31cd-ea1c-427f-998e-41119df7f9ab service nova] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] Received unexpected event network-vif-plugged-270b85b0-1832-4118-a8b0-ff784587b58a for instance with vm_state rescued and task_state unrescuing.
Apr 14 10:49:23 user nova-compute[71509]: DEBUG nova.compute.manager [req-d005a712-fc0a-45c5-a31f-7a3c7518c250 req-bc5a31cd-ea1c-427f-998e-41119df7f9ab service nova] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Received event network-vif-unplugged-6099437e-5607-4a06-abcb-15d465c7ecf8 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:49:23 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-d005a712-fc0a-45c5-a31f-7a3c7518c250 req-bc5a31cd-ea1c-427f-998e-41119df7f9ab service nova] Acquiring lock "39586d44-1d8e-4607-ab4d-c03a7d841606-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:49:23 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-d005a712-fc0a-45c5-a31f-7a3c7518c250 req-bc5a31cd-ea1c-427f-998e-41119df7f9ab service nova] Lock "39586d44-1d8e-4607-ab4d-c03a7d841606-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:49:23 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-d005a712-fc0a-45c5-a31f-7a3c7518c250 req-bc5a31cd-ea1c-427f-998e-41119df7f9ab service nova] Lock "39586d44-1d8e-4607-ab4d-c03a7d841606-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:49:23 user nova-compute[71509]: DEBUG nova.compute.manager [req-d005a712-fc0a-45c5-a31f-7a3c7518c250 req-bc5a31cd-ea1c-427f-998e-41119df7f9ab service nova] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] No waiting events found dispatching network-vif-unplugged-6099437e-5607-4a06-abcb-15d465c7ecf8 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:49:23 user nova-compute[71509]: DEBUG nova.compute.manager [req-d005a712-fc0a-45c5-a31f-7a3c7518c250 req-bc5a31cd-ea1c-427f-998e-41119df7f9ab service nova] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Received event network-vif-unplugged-6099437e-5607-4a06-abcb-15d465c7ecf8 for instance with task_state deleting. {{(pid=71509) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 10:49:23 user nova-compute[71509]: DEBUG nova.compute.manager [req-d005a712-fc0a-45c5-a31f-7a3c7518c250 req-bc5a31cd-ea1c-427f-998e-41119df7f9ab service nova] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Received event network-vif-plugged-6099437e-5607-4a06-abcb-15d465c7ecf8 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:49:23 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-d005a712-fc0a-45c5-a31f-7a3c7518c250 req-bc5a31cd-ea1c-427f-998e-41119df7f9ab service nova] Acquiring lock "39586d44-1d8e-4607-ab4d-c03a7d841606-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:49:23 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-d005a712-fc0a-45c5-a31f-7a3c7518c250 req-bc5a31cd-ea1c-427f-998e-41119df7f9ab service nova] Lock "39586d44-1d8e-4607-ab4d-c03a7d841606-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:49:23 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-d005a712-fc0a-45c5-a31f-7a3c7518c250 req-bc5a31cd-ea1c-427f-998e-41119df7f9ab service nova] Lock "39586d44-1d8e-4607-ab4d-c03a7d841606-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:49:23 user nova-compute[71509]: DEBUG nova.compute.manager [req-d005a712-fc0a-45c5-a31f-7a3c7518c250 req-bc5a31cd-ea1c-427f-998e-41119df7f9ab service nova] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] No waiting events found dispatching network-vif-plugged-6099437e-5607-4a06-abcb-15d465c7ecf8 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:49:23 user nova-compute[71509]: WARNING nova.compute.manager [req-d005a712-fc0a-45c5-a31f-7a3c7518c250 req-bc5a31cd-ea1c-427f-998e-41119df7f9ab service nova] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Received unexpected event network-vif-plugged-6099437e-5607-4a06-abcb-15d465c7ecf8 for instance with vm_state active and task_state deleting.
Apr 14 10:49:23 user nova-compute[71509]: DEBUG nova.compute.manager [req-d005a712-fc0a-45c5-a31f-7a3c7518c250 req-bc5a31cd-ea1c-427f-998e-41119df7f9ab service nova] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Received event network-vif-deleted-6099437e-5607-4a06-abcb-15d465c7ecf8 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:49:23 user nova-compute[71509]: DEBUG nova.virt.libvirt.host [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Removed pending event for 97f20661-8b60-439e-b7af-2fc2013c5ade due to event {{(pid=71509) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 10:49:23 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681469363.6577406, 97f20661-8b60-439e-b7af-2fc2013c5ade => Resumed> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 10:49:23 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] VM Resumed (Lifecycle Event)
Apr 14 10:49:23 user nova-compute[71509]: DEBUG nova.compute.manager [None req-81314060-f37e-4eb5-ab1d-81790bb0f4b2 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:49:23 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:49:23 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 10:49:23 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 14 10:49:23 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681469363.66217, 97f20661-8b60-439e-b7af-2fc2013c5ade => Started> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 10:49:23 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] VM Started (Lifecycle Event)
Apr 14 10:49:23 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:49:23 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 10:49:23 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 14 10:49:24 user nova-compute[71509]: INFO nova.compute.manager [None req-825c857b-2d5a-4fd6-8f87-c976772f152d tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Took 0.84 seconds to detach 1 volumes for instance.
Apr 14 10:49:24 user nova-compute[71509]: DEBUG nova.compute.manager [None req-825c857b-2d5a-4fd6-8f87-c976772f152d tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Deleting volume: 5647685a-aec6-4498-b1b4-372602a4c7ee {{(pid=71509) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 14 10:49:24 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-825c857b-2d5a-4fd6-8f87-c976772f152d tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:49:24 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-825c857b-2d5a-4fd6-8f87-c976772f152d tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:49:24 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-825c857b-2d5a-4fd6-8f87-c976772f152d tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 10:49:24 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-825c857b-2d5a-4fd6-8f87-c976772f152d tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 10:49:24 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-825c857b-2d5a-4fd6-8f87-c976772f152d tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.367s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:49:24 user nova-compute[71509]: INFO nova.scheduler.client.report [None req-825c857b-2d5a-4fd6-8f87-c976772f152d tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Deleted allocations for instance 39586d44-1d8e-4607-ab4d-c03a7d841606
Apr 14 10:49:24 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-825c857b-2d5a-4fd6-8f87-c976772f152d tempest-TestShelveInstance-1930659141 tempest-TestShelveInstance-1930659141-project-member] Lock "39586d44-1d8e-4607-ab4d-c03a7d841606" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.459s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:49:27 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:49:27 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-590a2c0a-4bdb-4b8d-badf-f356ac5be205 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Calling os-brick to attach iSCSI Volume {{(pid=71509) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 10:49:27 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-590a2c0a-4bdb-4b8d-badf-f356ac5be205 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0bf0749390>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yctQbvEP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 10:49:27 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-590a2c0a-4bdb-4b8d-badf-f356ac5be205 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 10:49:27 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-590a2c0a-4bdb-4b8d-badf-f356ac5be205 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 10:49:27 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-590a2c0a-4bdb-4b8d-badf-f356ac5be205 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 10:49:27 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-590a2c0a-4bdb-4b8d-badf-f356ac5be205 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 10:49:27 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-590a2c0a-4bdb-4b8d-badf-f356ac5be205 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 10:49:27 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-590a2c0a-4bdb-4b8d-badf-f356ac5be205 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 10:49:27 user nova-compute[71509]: INFO os_brick.initiator.connectors.iscsi [None req-590a2c0a-4bdb-4b8d-badf-f356ac5be205 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 10:49:27 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2 -p 172.16.0.220:3260 {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:27 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:49:27 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e9be37b-d2a4-426c-baf4-f3aa5aee4b1d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:49:27 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-590a2c0a-4bdb-4b8d-badf-f356ac5be205 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 10:49:27 user nova-compute[71509]:  {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:49:27 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2 -p 172.16.0.220:3260 --interface default --op new {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:27 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:49:27 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[738cb97c-0c81-4a26-a403-18b51ed06fe7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2] added\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:49:27 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-590a2c0a-4bdb-4b8d-badf-f356ac5be205 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2] added
Apr 14 10:49:27 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:49:27 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:27 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:49:27 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[5316bb0d-d41d-4110-ba1a-aced2f3d4ec1]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:49:27 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-590a2c0a-4bdb-4b8d-badf-f356ac5be205 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:49:27 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:27 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:49:27 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[389622df-77d1-403b-b31a-0fdb3ef755b5]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:49:27 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-590a2c0a-4bdb-4b8d-badf-f356ac5be205 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:49:27 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yctQbvEP {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:27 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yctQbvEP" returned: 0 in 0.032s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:49:27 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[49a1c240-7f41-4c75-ab95-8c636c5d3a52]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:49:27 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-590a2c0a-4bdb-4b8d-badf-f356ac5be205 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yctQbvEP'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:49:27 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:27 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:49:27 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c3de410-b401-49a0-b0d9-f99defeef07b]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:49:27 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-590a2c0a-4bdb-4b8d-badf-f356ac5be205 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:49:27 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:27 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:49:27 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[6892ffbc-e43b-4ee3-b9b2-32cbabab1caf]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:49:27 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-590a2c0a-4bdb-4b8d-badf-f356ac5be205 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d (non-flash)
Apr 14 10:49:27 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:49:27 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-590a2c0a-4bdb-4b8d-badf-f356ac5be205 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d (non-flash)
Apr 14 10:49:27 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 10:49:27 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2 -p 172.16.0.220:3260 --login {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:27 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:49:27 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[372fea1e-30dd-4ef2-a8be-0827c6d9a3d1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:49:27 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-590a2c0a-4bdb-4b8d-badf-f356ac5be205 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2, portal: 172.16.0.220,3260]
Apr 14 10:49:27 user nova-compute[71509]: Login to [iface: default, target: iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2, portal: 172.16.0.220,3260] successful.
Apr 14 10:49:27 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:49:27 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:27 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:49:27 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f7313c6-e62b-42e4-81a2-ed9650238f86]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:49:27 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-590a2c0a-4bdb-4b8d-badf-f356ac5be205 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:49:27 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:27 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:49:27 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c4ea4bd-8196-4de6-ab86-e01951753d27]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2 (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:49:27 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-590a2c0a-4bdb-4b8d-badf-f356ac5be205 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d (non-flash)
Apr 14 10:49:27 user nova-compute[71509]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2 (non-flash)
Apr 14 10:49:27 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:49:27 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-590a2c0a-4bdb-4b8d-badf-f356ac5be205 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d (non-flash)
Apr 14 10:49:27 user nova-compute[71509]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2 (non-flash)
Apr 14 10:49:27 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 10:49:27 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-590a2c0a-4bdb-4b8d-badf-f356ac5be205 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.321s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 10:49:27 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-590a2c0a-4bdb-4b8d-badf-f356ac5be205 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Connected to 172.16.0.220:3260 {{(pid=71509) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 10:49:27 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-590a2c0a-4bdb-4b8d-badf-f356ac5be205 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] HCTL ('34', '-', '-', 0) found on session 22 with lun 0 {{(pid=71509) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 10:49:27 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-590a2c0a-4bdb-4b8d-badf-f356ac5be205 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71509) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 10:49:27 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:27 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:49:27 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[57b88d17-153c-4da8-b301-958a09aba5a5]: (4, ('- - 0', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:49:27 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-590a2c0a-4bdb-4b8d-badf-f356ac5be205 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Searching for a device in session 22 and hctl ['34', '*', '*', 0] yield: None {{(pid=71509) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 10:49:27 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:49:28 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-590a2c0a-4bdb-4b8d-badf-f356ac5be205 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Searching for a device in session 22 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71509) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 10:49:28 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-590a2c0a-4bdb-4b8d-badf-f356ac5be205 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yctQbvEP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71509) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 10:49:28 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-590a2c0a-4bdb-4b8d-badf-f356ac5be205 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.354s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 10:49:28 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-590a2c0a-4bdb-4b8d-badf-f356ac5be205 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] <== connect_volume: return (1356ms) {'type': 'block', 'scsi_wwn': '26535643432366237', 'path': '/dev/sdc'} {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 10:49:28 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-590a2c0a-4bdb-4b8d-badf-f356ac5be205 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26535643432366237', 'path': '/dev/sdc'} {{(pid=71509) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 10:49:28 user nova-compute[71509]: DEBUG nova.objects.instance [None req-590a2c0a-4bdb-4b8d-badf-f356ac5be205 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lazy-loading 'flavor' on Instance uuid 8586a70e-9855-4177-ac1b-cf707a4df871 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:49:28 user nova-compute[71509]: DEBUG nova.virt.libvirt.guest [None req-590a2c0a-4bdb-4b8d-badf-f356ac5be205 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 10:49:28 user nova-compute[71509]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 10:49:28 user nova-compute[71509]:   <source dev="/dev/sdc"/>
Apr 14 10:49:28 user nova-compute[71509]:   <target dev="vdb" bus="virtio"/>
Apr 14 10:49:28 user nova-compute[71509]:   <serial>64fbf5f9-3b53-42b6-8eb9-34688db256a2</serial>
Apr 14 10:49:28 user nova-compute[71509]: </disk>
Apr 14 10:49:28 user nova-compute[71509]:  {{(pid=71509) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 10:49:28 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-478571c1-9ca7-413f-a1f1-29e05438ff53 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] [instance: 55178126-9766-4875-9122-39dcc87ce82c] Calling os-brick to attach iSCSI Volume {{(pid=71509) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 10:49:28 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-478571c1-9ca7-413f-a1f1-29e05438ff53 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0bf0749390>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:98928234-b030-42db-89fd-9b21352606dc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aNzKuWRr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 10:49:28 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-478571c1-9ca7-413f-a1f1-29e05438ff53 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 10:49:28 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-478571c1-9ca7-413f-a1f1-29e05438ff53 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 10:49:28 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-478571c1-9ca7-413f-a1f1-29e05438ff53 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 10:49:28 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-478571c1-9ca7-413f-a1f1-29e05438ff53 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 10:49:28 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-478571c1-9ca7-413f-a1f1-29e05438ff53 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:98928234-b030-42db-89fd-9b21352606dc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 10:49:28 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-478571c1-9ca7-413f-a1f1-29e05438ff53 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:98928234-b030-42db-89fd-9b21352606dc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 10:49:28 user nova-compute[71509]: INFO os_brick.initiator.connectors.iscsi [None req-478571c1-9ca7-413f-a1f1-29e05438ff53 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 10:49:28 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98928234-b030-42db-89fd-9b21352606dc -p 172.16.0.220:3260 {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:28 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98928234-b030-42db-89fd-9b21352606dc -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:49:28 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[e22f0103-f67c-4117-9dc1-24fb4d93c717]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:49:28 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-478571c1-9ca7-413f-a1f1-29e05438ff53 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 10:49:28 user nova-compute[71509]:  {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:49:28 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98928234-b030-42db-89fd-9b21352606dc -p 172.16.0.220:3260 --interface default --op new {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:29 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98928234-b030-42db-89fd-9b21352606dc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:49:29 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[a85d8ce6-ba60-4542-9bff-08bb41983cfe]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:98928234-b030-42db-89fd-9b21352606dc] added\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:49:29 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-478571c1-9ca7-413f-a1f1-29e05438ff53 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:98928234-b030-42db-89fd-9b21352606dc] added
Apr 14 10:49:29 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:49:29 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98928234-b030-42db-89fd-9b21352606dc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:29 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98928234-b030-42db-89fd-9b21352606dc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:49:29 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b435fce-7326-487b-a42d-90fcdc9456a4]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:49:29 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-478571c1-9ca7-413f-a1f1-29e05438ff53 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:49:29 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98928234-b030-42db-89fd-9b21352606dc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:29 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98928234-b030-42db-89fd-9b21352606dc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:49:29 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8215dcb-02f6-4ac9-81ca-c73c2275695c]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:49:29 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-478571c1-9ca7-413f-a1f1-29e05438ff53 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:49:29 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98928234-b030-42db-89fd-9b21352606dc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aNzKuWRr {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:29 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98928234-b030-42db-89fd-9b21352606dc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aNzKuWRr" returned: 0 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:49:29 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4893d26-c5cb-42c1-a6a1-bb4de93623a0]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:49:29 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-478571c1-9ca7-413f-a1f1-29e05438ff53 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aNzKuWRr'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:49:29 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98928234-b030-42db-89fd-9b21352606dc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:29 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98928234-b030-42db-89fd-9b21352606dc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:49:29 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6fa1890-a1c6-4554-90cb-d39f93fc9c7b]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:49:29 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-478571c1-9ca7-413f-a1f1-29e05438ff53 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:49:29 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:29 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:49:29 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[93ee1a9f-f82a-41be-a380-9d5f973edbe2]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2 (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:49:29 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-478571c1-9ca7-413f-a1f1-29e05438ff53 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d (non-flash)
Apr 14 10:49:29 user nova-compute[71509]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2 (non-flash)
Apr 14 10:49:29 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:49:29 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-478571c1-9ca7-413f-a1f1-29e05438ff53 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d (non-flash)
Apr 14 10:49:29 user nova-compute[71509]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2 (non-flash)
Apr 14 10:49:29 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 10:49:29 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98928234-b030-42db-89fd-9b21352606dc -p 172.16.0.220:3260 --login {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:29 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98928234-b030-42db-89fd-9b21352606dc -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:49:29 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[440bce24-4a8a-47b3-8da3-4baf08ed9b1a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:98928234-b030-42db-89fd-9b21352606dc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:98928234-b030-42db-89fd-9b21352606dc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:49:29 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-478571c1-9ca7-413f-a1f1-29e05438ff53 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:98928234-b030-42db-89fd-9b21352606dc, portal: 172.16.0.220,3260]
Apr 14 10:49:29 user nova-compute[71509]: Login to [iface: default, target: iqn.2010-10.org.openstack:98928234-b030-42db-89fd-9b21352606dc, portal: 172.16.0.220,3260] successful.
Apr 14 10:49:29 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:49:29 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98928234-b030-42db-89fd-9b21352606dc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:29 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98928234-b030-42db-89fd-9b21352606dc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:49:29 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[e11f74ef-4492-4514-8e7d-9c9fc464f39d]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:49:29 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-478571c1-9ca7-413f-a1f1-29e05438ff53 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:49:29 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:29 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:49:29 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7f80f8e-6934-404a-80ae-cfd86e744569]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98928234-b030-42db-89fd-9b21352606dc (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:49:29 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-478571c1-9ca7-413f-a1f1-29e05438ff53 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d (non-flash)
Apr 14 10:49:29 user nova-compute[71509]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2 (non-flash)
Apr 14 10:49:29 user nova-compute[71509]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98928234-b030-42db-89fd-9b21352606dc (non-flash)
Apr 14 10:49:29 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:49:29 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-478571c1-9ca7-413f-a1f1-29e05438ff53 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d (non-flash)
Apr 14 10:49:29 user nova-compute[71509]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2 (non-flash)
Apr 14 10:49:29 user nova-compute[71509]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98928234-b030-42db-89fd-9b21352606dc (non-flash)
Apr 14 10:49:29 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 10:49:29 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-478571c1-9ca7-413f-a1f1-29e05438ff53 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:98928234-b030-42db-89fd-9b21352606dc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 10:49:29 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-478571c1-9ca7-413f-a1f1-29e05438ff53 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Connected to 172.16.0.220:3260 {{(pid=71509) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 10:49:29 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-478571c1-9ca7-413f-a1f1-29e05438ff53 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] HCTL ('35', '-', '-', 0) found on session 23 with lun 0 {{(pid=71509) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 10:49:29 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-478571c1-9ca7-413f-a1f1-29e05438ff53 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71509) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 10:49:29 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:29 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-590a2c0a-4bdb-4b8d-badf-f356ac5be205 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] No BDM found with device name vda, not building metadata. {{(pid=71509) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 10:49:29 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-590a2c0a-4bdb-4b8d-badf-f356ac5be205 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71509) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 10:49:29 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-590a2c0a-4bdb-4b8d-badf-f356ac5be205 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] No VIF found with MAC fa:16:3e:b0:12:bf, not building metadata {{(pid=71509) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 10:49:29 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.033s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:49:29 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eba6fda-8ea5-46bf-85a7-163a4a6c17ee]: (4, ('- - 0', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:49:29 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-478571c1-9ca7-413f-a1f1-29e05438ff53 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Searching for a device in session 23 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71509) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 10:49:29 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-478571c1-9ca7-413f-a1f1-29e05438ff53 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:98928234-b030-42db-89fd-9b21352606dc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aNzKuWRr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71509) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 10:49:29 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-38f0d569-cea6-40f1-8c72-0f6b972253d5 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Acquiring lock "203b622c-9e6d-4ac7-a3fa-9f9c82ef3108" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:49:29 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-38f0d569-cea6-40f1-8c72-0f6b972253d5 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Lock "203b622c-9e6d-4ac7-a3fa-9f9c82ef3108" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:49:29 user nova-compute[71509]: DEBUG nova.objects.instance [None req-38f0d569-cea6-40f1-8c72-0f6b972253d5 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Lazy-loading 'flavor' on Instance uuid 203b622c-9e6d-4ac7-a3fa-9f9c82ef3108 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:49:29 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-38f0d569-cea6-40f1-8c72-0f6b972253d5 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] [instance: 203b622c-9e6d-4ac7-a3fa-9f9c82ef3108] Ignoring supplied device name: /dev/vdb
Apr 14 10:49:29 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-38f0d569-cea6-40f1-8c72-0f6b972253d5 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Lock "203b622c-9e6d-4ac7-a3fa-9f9c82ef3108" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.080s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:49:29 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-590a2c0a-4bdb-4b8d-badf-f356ac5be205 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "8586a70e-9855-4177-ac1b-cf707a4df871" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.092s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:49:29 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-38f0d569-cea6-40f1-8c72-0f6b972253d5 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Acquiring lock "203b622c-9e6d-4ac7-a3fa-9f9c82ef3108" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:49:29 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-38f0d569-cea6-40f1-8c72-0f6b972253d5 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Lock "203b622c-9e6d-4ac7-a3fa-9f9c82ef3108" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:49:29 user nova-compute[71509]: INFO nova.compute.manager [None req-38f0d569-cea6-40f1-8c72-0f6b972253d5 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] [instance: 203b622c-9e6d-4ac7-a3fa-9f9c82ef3108] Attaching volume ec6269ad-4a21-4afb-b769-a969d5e3c92f to /dev/vdb
Apr 14 10:49:29 user nova-compute[71509]: DEBUG os_brick.utils [None req-38f0d569-cea6-40f1-8c72-0f6b972253d5 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 10:49:29 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:29 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:49:29 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd32c611-b321-485b-9007-1e093ce6f699]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50119df3c417\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:49:29 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:29 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:49:29 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[262a018f-b94c-468d-94cb-3eae09b43f5f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:49:29 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:29 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:49:29 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7dd8513-bd76-43dd-adf7-b245665a7c13]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:49:29 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd47d02a-e528-4285-8ab3-a9740db45102]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:49:29 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-38f0d569-cea6-40f1-8c72-0f6b972253d5 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Running cmd (subprocess): nvme version {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:29 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-38f0d569-cea6-40f1-8c72-0f6b972253d5 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] 'nvme version' failed. Not Retrying. {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 10:49:29 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.nvmeof [None req-38f0d569-cea6-40f1-8c72-0f6b972253d5 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] nvme not present on system {{(pid=71509) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 10:49:29 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:29 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 10:49:29 user nova-compute[71509]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 10:49:29 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[47bf4268-b45e-451a-abaa-6c4bffdd8ae0]: (4, '') {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:49:29 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-38f0d569-cea6-40f1-8c72-0f6b972253d5 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71509) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 10:49:29 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-38f0d569-cea6-40f1-8c72-0f6b972253d5 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71509) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 10:49:29 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-38f0d569-cea6-40f1-8c72-0f6b972253d5 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] LIGHTOS: no hostnqn found. {{(pid=71509) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 10:49:29 user nova-compute[71509]: DEBUG os_brick.utils [None req-38f0d569-cea6-40f1-8c72-0f6b972253d5 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50119df3c417', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 10:49:29 user nova-compute[71509]: DEBUG nova.virt.block_device [None req-38f0d569-cea6-40f1-8c72-0f6b972253d5 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] [instance: 203b622c-9e6d-4ac7-a3fa-9f9c82ef3108] Updating existing volume attachment record: 4a3cf159-b790-40d4-9ed0-6cab5df86308 {{(pid=71509) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 10:49:29 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-bfde89d5-f629-4b7c-b77a-49c3e8bbd3df tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Acquiring lock "8586a70e-9855-4177-ac1b-cf707a4df871" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:49:29 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-bfde89d5-f629-4b7c-b77a-49c3e8bbd3df tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "8586a70e-9855-4177-ac1b-cf707a4df871" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:49:29 user nova-compute[71509]: DEBUG nova.compute.manager [None req-bfde89d5-f629-4b7c-b77a-49c3e8bbd3df tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:49:29 user nova-compute[71509]: DEBUG nova.compute.manager [None req-bfde89d5-f629-4b7c-b77a-49c3e8bbd3df tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=71509) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3323}}
Apr 14 10:49:29 user nova-compute[71509]: DEBUG nova.objects.instance [None req-bfde89d5-f629-4b7c-b77a-49c3e8bbd3df tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lazy-loading 'flavor' on Instance uuid 8586a70e-9855-4177-ac1b-cf707a4df871 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:49:29 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:49:30 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:49:30 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:49:30 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:49:30 user nova-compute[71509]: DEBUG nova.compute.manager [req-54af982e-30de-45e6-a4c7-4931823e0a3c req-a6c0147d-9ac9-47c0-8091-71414d8df011 service nova] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Received event network-vif-unplugged-473d9af8-25a0-4e5a-9afb-7a0c843115cc {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:49:30 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-54af982e-30de-45e6-a4c7-4931823e0a3c req-a6c0147d-9ac9-47c0-8091-71414d8df011 service nova] Acquiring lock "8586a70e-9855-4177-ac1b-cf707a4df871-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:49:30 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-54af982e-30de-45e6-a4c7-4931823e0a3c req-a6c0147d-9ac9-47c0-8091-71414d8df011 service nova] Lock "8586a70e-9855-4177-ac1b-cf707a4df871-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:49:30 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-54af982e-30de-45e6-a4c7-4931823e0a3c req-a6c0147d-9ac9-47c0-8091-71414d8df011 service nova] Lock "8586a70e-9855-4177-ac1b-cf707a4df871-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:49:30 user nova-compute[71509]: DEBUG nova.compute.manager [req-54af982e-30de-45e6-a4c7-4931823e0a3c req-a6c0147d-9ac9-47c0-8091-71414d8df011 service nova] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] No waiting events found dispatching network-vif-unplugged-473d9af8-25a0-4e5a-9afb-7a0c843115cc {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:49:30 user nova-compute[71509]: WARNING nova.compute.manager [req-54af982e-30de-45e6-a4c7-4931823e0a3c req-a6c0147d-9ac9-47c0-8091-71414d8df011 service nova] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Received unexpected event network-vif-unplugged-473d9af8-25a0-4e5a-9afb-7a0c843115cc for instance with vm_state active and task_state powering-off.
Apr 14 10:49:30 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-478571c1-9ca7-413f-a1f1-29e05438ff53 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.326s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 10:49:30 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-478571c1-9ca7-413f-a1f1-29e05438ff53 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] <== connect_volume: return (1328ms) {'type': 'block', 'scsi_wwn': '23434643636396363', 'path': '/dev/sdd'} {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 10:49:30 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-478571c1-9ca7-413f-a1f1-29e05438ff53 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] [instance: 55178126-9766-4875-9122-39dcc87ce82c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23434643636396363', 'path': '/dev/sdd'} {{(pid=71509) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 10:49:30 user nova-compute[71509]: DEBUG nova.objects.instance [None req-478571c1-9ca7-413f-a1f1-29e05438ff53 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lazy-loading 'flavor' on Instance uuid 55178126-9766-4875-9122-39dcc87ce82c {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:49:30 user nova-compute[71509]: DEBUG nova.virt.libvirt.guest [None req-478571c1-9ca7-413f-a1f1-29e05438ff53 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 10:49:30 user nova-compute[71509]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 10:49:30 user nova-compute[71509]:   <source dev="/dev/sdd"/>
Apr 14 10:49:30 user nova-compute[71509]:   <target dev="vdb" bus="virtio"/>
Apr 14 10:49:30 user nova-compute[71509]:   <serial>98928234-b030-42db-89fd-9b21352606dc</serial>
Apr 14 10:49:30 user nova-compute[71509]: </disk>
Apr 14 10:49:30 user nova-compute[71509]:  {{(pid=71509) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 10:49:30 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:49:30 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:49:30 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:49:30 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Instance destroyed successfully.
Apr 14 10:49:30 user nova-compute[71509]: DEBUG nova.compute.manager [None req-bfde89d5-f629-4b7c-b77a-49c3e8bbd3df tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:49:31 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-478571c1-9ca7-413f-a1f1-29e05438ff53 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] No BDM found with device name vda, not building metadata. {{(pid=71509) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 10:49:31 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-478571c1-9ca7-413f-a1f1-29e05438ff53 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71509) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 10:49:31 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-478571c1-9ca7-413f-a1f1-29e05438ff53 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] No VIF found with MAC fa:16:3e:85:23:c1, not building metadata {{(pid=71509) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 10:49:31 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-bfde89d5-f629-4b7c-b77a-49c3e8bbd3df tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "8586a70e-9855-4177-ac1b-cf707a4df871" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.190s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:49:31 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-478571c1-9ca7-413f-a1f1-29e05438ff53 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "55178126-9766-4875-9122-39dcc87ce82c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.528s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:49:31 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:49:31 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71509) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 10:49:32 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:49:32 user nova-compute[71509]: DEBUG nova.compute.manager [req-4358c04e-0be5-4753-870c-2c78cbb30f18 req-b0fa3df2-07ba-433f-b40d-d08d297a68a9 service nova] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Received event network-vif-plugged-473d9af8-25a0-4e5a-9afb-7a0c843115cc {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:49:32 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-4358c04e-0be5-4753-870c-2c78cbb30f18 req-b0fa3df2-07ba-433f-b40d-d08d297a68a9 service nova] Acquiring lock "8586a70e-9855-4177-ac1b-cf707a4df871-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:49:32 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-4358c04e-0be5-4753-870c-2c78cbb30f18 req-b0fa3df2-07ba-433f-b40d-d08d297a68a9 service nova] Lock "8586a70e-9855-4177-ac1b-cf707a4df871-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:49:32 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-4358c04e-0be5-4753-870c-2c78cbb30f18 req-b0fa3df2-07ba-433f-b40d-d08d297a68a9 service nova] Lock "8586a70e-9855-4177-ac1b-cf707a4df871-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:49:32 user nova-compute[71509]: DEBUG nova.compute.manager [req-4358c04e-0be5-4753-870c-2c78cbb30f18 req-b0fa3df2-07ba-433f-b40d-d08d297a68a9 service nova] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] No waiting events found dispatching network-vif-plugged-473d9af8-25a0-4e5a-9afb-7a0c843115cc {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:49:32 user nova-compute[71509]: WARNING nova.compute.manager [req-4358c04e-0be5-4753-870c-2c78cbb30f18 req-b0fa3df2-07ba-433f-b40d-d08d297a68a9 service nova] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Received unexpected event network-vif-plugged-473d9af8-25a0-4e5a-9afb-7a0c843115cc for instance with vm_state stopped and task_state None.
Apr 14 10:49:32 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:49:32 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:49:32 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-2d046296-1cf9-432f-94ed-daac5684fe31 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Acquiring lock "55178126-9766-4875-9122-39dcc87ce82c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:49:32 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-2d046296-1cf9-432f-94ed-daac5684fe31 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "55178126-9766-4875-9122-39dcc87ce82c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:49:32 user nova-compute[71509]: INFO nova.compute.manager [None req-2d046296-1cf9-432f-94ed-daac5684fe31 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] [instance: 55178126-9766-4875-9122-39dcc87ce82c] Detaching volume 98928234-b030-42db-89fd-9b21352606dc
Apr 14 10:49:32 user nova-compute[71509]: INFO nova.virt.block_device [None req-2d046296-1cf9-432f-94ed-daac5684fe31 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] [instance: 55178126-9766-4875-9122-39dcc87ce82c] Attempting to driver detach volume 98928234-b030-42db-89fd-9b21352606dc from mountpoint /dev/vdb
Apr 14 10:49:32 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-2d046296-1cf9-432f-94ed-daac5684fe31 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Attempting to detach device vdb from instance 55178126-9766-4875-9122-39dcc87ce82c from the persistent domain config. {{(pid=71509) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 10:49:32 user nova-compute[71509]: DEBUG nova.virt.libvirt.guest [None req-2d046296-1cf9-432f-94ed-daac5684fe31 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 10:49:32 user nova-compute[71509]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 10:49:32 user nova-compute[71509]:   <source dev="/dev/sdd"/>
Apr 14 10:49:32 user nova-compute[71509]:   <target dev="vdb" bus="virtio"/>
Apr 14 10:49:32 user nova-compute[71509]:   <serial>98928234-b030-42db-89fd-9b21352606dc</serial>
Apr 14 10:49:32 user nova-compute[71509]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 10:49:32 user nova-compute[71509]: </disk>
Apr 14 10:49:32 user nova-compute[71509]:  {{(pid=71509) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 10:49:32 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-2d046296-1cf9-432f-94ed-daac5684fe31 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Successfully detached device vdb from instance 55178126-9766-4875-9122-39dcc87ce82c from the persistent domain config.
Apr 14 10:49:32 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-2d046296-1cf9-432f-94ed-daac5684fe31 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 55178126-9766-4875-9122-39dcc87ce82c from the live domain config. {{(pid=71509) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 10:49:32 user nova-compute[71509]: DEBUG nova.virt.libvirt.guest [None req-2d046296-1cf9-432f-94ed-daac5684fe31 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 10:49:32 user nova-compute[71509]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 10:49:32 user nova-compute[71509]:   <source dev="/dev/sdd"/>
Apr 14 10:49:32 user nova-compute[71509]:   <target dev="vdb" bus="virtio"/>
Apr 14 10:49:32 user nova-compute[71509]:   <serial>98928234-b030-42db-89fd-9b21352606dc</serial>
Apr 14 10:49:32 user nova-compute[71509]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 10:49:32 user nova-compute[71509]: </disk>
Apr 14 10:49:32 user nova-compute[71509]:  {{(pid=71509) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 10:49:32 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:49:33 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Received event <DeviceRemovedEvent: 1681469373.0056922, 55178126-9766-4875-9122-39dcc87ce82c => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71509) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 10:49:33 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-2d046296-1cf9-432f-94ed-daac5684fe31 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 55178126-9766-4875-9122-39dcc87ce82c {{(pid=71509) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 10:49:33 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-2d046296-1cf9-432f-94ed-daac5684fe31 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Successfully detached device vdb from instance 55178126-9766-4875-9122-39dcc87ce82c from the live domain config.
Apr 14 10:49:33 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d046296-1cf9-432f-94ed-daac5684fe31 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] [instance: 55178126-9766-4875-9122-39dcc87ce82c] calling os-brick to detach iSCSI Volume {{(pid=71509) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 10:49:33 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d046296-1cf9-432f-94ed-daac5684fe31 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0bf0749390>, {'target_iqn': 'iqn.2010-10.org.openstack:98928234-b030-42db-89fd-9b21352606dc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aNzKuWRr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 10:49:33 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-2d046296-1cf9-432f-94ed-daac5684fe31 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 10:49:33 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-2d046296-1cf9-432f-94ed-daac5684fe31 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 10:49:33 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-2d046296-1cf9-432f-94ed-daac5684fe31 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 10:49:33 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:33 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:49:33 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[36dcacde-7ba0-479d-869d-3eeee482acad]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:98928234-b030-42db-89fd-9b21352606dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:49:33 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d046296-1cf9-432f-94ed-daac5684fe31 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 10:49:33 user nova-compute[71509]: No targets found.
Apr 14 10:49:33 user nova-compute[71509]: iSNS:
Apr 14 10:49:33 user nova-compute[71509]: No targets found.
Apr 14 10:49:33 user nova-compute[71509]: STATIC:
Apr 14 10:49:33 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:98928234-b030-42db-89fd-9b21352606dc
Apr 14 10:49:33 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:49:33 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:49:33 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d
Apr 14 10:49:33 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:49:33 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:49:33 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2
Apr 14 10:49:33 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:49:33 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:49:33 user nova-compute[71509]: FIRMWARE:
Apr 14 10:49:33 user nova-compute[71509]: No targets found.
Apr 14 10:49:33 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:49:33 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d046296-1cf9-432f-94ed-daac5684fe31 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 10:49:33 user nova-compute[71509]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 10:49:33 user nova-compute[71509]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71509) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 10:49:33 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d046296-1cf9-432f-94ed-daac5684fe31 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:98928234-b030-42db-89fd-9b21352606dc', 0)] {{(pid=71509) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 10:49:33 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:33 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:49:33 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0d27237-bbc0-4fbd-8d7a-8a7a8a9490a4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:98928234-b030-42db-89fd-9b21352606dc\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:49:33 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:33 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:49:33 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[074d5b44-aeb3-4542-a8aa-35f1ff18ec43]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98928234-b030-42db-89fd-9b21352606dc (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:49:33 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d046296-1cf9-432f-94ed-daac5684fe31 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d (non-flash)
Apr 14 10:49:33 user nova-compute[71509]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2 (non-flash)
Apr 14 10:49:33 user nova-compute[71509]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98928234-b030-42db-89fd-9b21352606dc (non-flash)
Apr 14 10:49:33 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:49:33 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d046296-1cf9-432f-94ed-daac5684fe31 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d (non-flash)
Apr 14 10:49:33 user nova-compute[71509]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2 (non-flash)
Apr 14 10:49:33 user nova-compute[71509]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98928234-b030-42db-89fd-9b21352606dc (non-flash)
Apr 14 10:49:33 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 10:49:33 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d046296-1cf9-432f-94ed-daac5684fe31 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0bf06a8160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:98928234-b030-42db-89fd-9b21352606dc'): ({'sdd'}, set())}) {{(pid=71509) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 10:49:33 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-2d046296-1cf9-432f-94ed-daac5684fe31 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Removing single pathed devices sdd {{(pid=71509) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 10:49:33 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:33 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:49:33 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bb3bcdb-6206-4378-853b-456dd0228cbd]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:49:33 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:33 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:49:33 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[162b8e39-4521-40bf-855e-4faf5242943d]: (4, ('ok\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:49:33 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-2d046296-1cf9-432f-94ed-daac5684fe31 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Flushing IO for device /dev/sdd {{(pid=71509) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 10:49:33 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:33 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:49:33 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdc4fdf5-f09a-4495-a07f-e37943aa494f]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:49:33 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-2d046296-1cf9-432f-94ed-daac5684fe31 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71509) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 10:49:33 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:33 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.050s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:49:33 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8577a26-154d-464c-8597-b36f603ca216]: (4, ('1', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:49:33 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-2d046296-1cf9-432f-94ed-daac5684fe31 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71509) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 10:49:33 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-2d046296-1cf9-432f-94ed-daac5684fe31 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] SCSI volumes sdd have been removed. {{(pid=71509) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 10:49:33 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d046296-1cf9-432f-94ed-daac5684fe31 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:98928234-b030-42db-89fd-9b21352606dc')] {{(pid=71509) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 10:49:33 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98928234-b030-42db-89fd-9b21352606dc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:33 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98928234-b030-42db-89fd-9b21352606dc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:49:33 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[0306e899-1bf0-4da2-bfc6-fd488c65b182]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:49:33 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d046296-1cf9-432f-94ed-daac5684fe31 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:49:33 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98928234-b030-42db-89fd-9b21352606dc -p 172.16.0.220:3260 --logout {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:33 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98928234-b030-42db-89fd-9b21352606dc -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:49:33 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a9f1748-c0f9-4dc5-b34b-d8dfbe29da6a]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:98928234-b030-42db-89fd-9b21352606dc, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:98928234-b030-42db-89fd-9b21352606dc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:49:33 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d046296-1cf9-432f-94ed-daac5684fe31 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:98928234-b030-42db-89fd-9b21352606dc, portal: 172.16.0.220,3260]
Apr 14 10:49:33 user nova-compute[71509]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:98928234-b030-42db-89fd-9b21352606dc, portal: 172.16.0.220,3260] successful.
Apr 14 10:49:33 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:49:33 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98928234-b030-42db-89fd-9b21352606dc -p 172.16.0.220:3260 --op delete {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:33 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98928234-b030-42db-89fd-9b21352606dc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:49:33 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[f60e191a-bdf1-4a63-9f18-ec423fb613ac]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:49:33 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d046296-1cf9-432f-94ed-daac5684fe31 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:49:33 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-2d046296-1cf9-432f-94ed-daac5684fe31 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 10:49:33 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d046296-1cf9-432f-94ed-daac5684fe31 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] <== disconnect_volume: return (320ms) None {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 10:49:33 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d046296-1cf9-432f-94ed-daac5684fe31 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] [instance: 55178126-9766-4875-9122-39dcc87ce82c] Disconnected iSCSI Volume {{(pid=71509) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 10:49:34 user nova-compute[71509]: DEBUG nova.objects.instance [None req-2d046296-1cf9-432f-94ed-daac5684fe31 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lazy-loading 'flavor' on Instance uuid 55178126-9766-4875-9122-39dcc87ce82c {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:49:34 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-2d046296-1cf9-432f-94ed-daac5684fe31 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "55178126-9766-4875-9122-39dcc87ce82c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.904s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:49:34 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:49:34 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38f0d569-cea6-40f1-8c72-0f6b972253d5 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] [instance: 203b622c-9e6d-4ac7-a3fa-9f9c82ef3108] Calling os-brick to attach iSCSI Volume {{(pid=71509) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 10:49:34 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-38f0d569-cea6-40f1-8c72-0f6b972253d5 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0bf0749390>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ec6269ad-4a21-4afb-b769-a969d5e3c92f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qLoetIZK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 10:49:34 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-38f0d569-cea6-40f1-8c72-0f6b972253d5 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 10:49:34 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-38f0d569-cea6-40f1-8c72-0f6b972253d5 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 10:49:34 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-38f0d569-cea6-40f1-8c72-0f6b972253d5 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 10:49:34 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-38f0d569-cea6-40f1-8c72-0f6b972253d5 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 10:49:34 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-38f0d569-cea6-40f1-8c72-0f6b972253d5 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ec6269ad-4a21-4afb-b769-a969d5e3c92f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 10:49:34 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-38f0d569-cea6-40f1-8c72-0f6b972253d5 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ec6269ad-4a21-4afb-b769-a969d5e3c92f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 10:49:34 user nova-compute[71509]: INFO os_brick.initiator.connectors.iscsi [None req-38f0d569-cea6-40f1-8c72-0f6b972253d5 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 10:49:34 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec6269ad-4a21-4afb-b769-a969d5e3c92f -p 172.16.0.220:3260 {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:34 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec6269ad-4a21-4afb-b769-a969d5e3c92f -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:49:34 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[a14f74a9-e8fc-4bf2-95c8-a873cf553bb2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:49:34 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-38f0d569-cea6-40f1-8c72-0f6b972253d5 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 10:49:34 user nova-compute[71509]:  {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:49:34 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec6269ad-4a21-4afb-b769-a969d5e3c92f -p 172.16.0.220:3260 --interface default --op new {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:34 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec6269ad-4a21-4afb-b769-a969d5e3c92f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:49:34 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[a39a4e9c-8dfd-459c-9e51-c7b90b9cf8cf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ec6269ad-4a21-4afb-b769-a969d5e3c92f] added\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:49:34 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-38f0d569-cea6-40f1-8c72-0f6b972253d5 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ec6269ad-4a21-4afb-b769-a969d5e3c92f] added
Apr 14 10:49:34 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:49:34 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec6269ad-4a21-4afb-b769-a969d5e3c92f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:34 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec6269ad-4a21-4afb-b769-a969d5e3c92f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:49:34 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cd956bf-d88d-47be-a3e8-30c35eabd21a]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:49:34 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-38f0d569-cea6-40f1-8c72-0f6b972253d5 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:49:34 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec6269ad-4a21-4afb-b769-a969d5e3c92f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:34 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec6269ad-4a21-4afb-b769-a969d5e3c92f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:49:34 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f2efe4c-c59f-42cd-bb4e-1fc399a8d7ca]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:49:34 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-38f0d569-cea6-40f1-8c72-0f6b972253d5 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:49:34 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec6269ad-4a21-4afb-b769-a969d5e3c92f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qLoetIZK {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:34 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec6269ad-4a21-4afb-b769-a969d5e3c92f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qLoetIZK" returned: 0 in 0.025s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:49:34 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[12abdb80-959e-4071-a25a-13cdb5590e44]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:49:34 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-38f0d569-cea6-40f1-8c72-0f6b972253d5 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qLoetIZK'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:49:34 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec6269ad-4a21-4afb-b769-a969d5e3c92f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:34 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec6269ad-4a21-4afb-b769-a969d5e3c92f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:49:34 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d4a2a50-de7e-47bf-aee6-c05c49856647]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:49:34 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-38f0d569-cea6-40f1-8c72-0f6b972253d5 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:49:34 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:34 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:49:34 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fe3cdb2-7404-4bf7-83cd-f162faeb3c0a]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2 (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:49:34 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-38f0d569-cea6-40f1-8c72-0f6b972253d5 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d (non-flash)
Apr 14 10:49:34 user nova-compute[71509]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2 (non-flash)
Apr 14 10:49:34 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:49:34 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-38f0d569-cea6-40f1-8c72-0f6b972253d5 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d (non-flash)
Apr 14 10:49:34 user nova-compute[71509]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2 (non-flash)
Apr 14 10:49:34 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 10:49:34 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec6269ad-4a21-4afb-b769-a969d5e3c92f -p 172.16.0.220:3260 --login {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:34 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec6269ad-4a21-4afb-b769-a969d5e3c92f -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:49:34 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[833b9db2-cb50-463f-9a5b-c7fdf288140c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ec6269ad-4a21-4afb-b769-a969d5e3c92f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ec6269ad-4a21-4afb-b769-a969d5e3c92f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:49:34 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-38f0d569-cea6-40f1-8c72-0f6b972253d5 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ec6269ad-4a21-4afb-b769-a969d5e3c92f, portal: 172.16.0.220,3260]
Apr 14 10:49:34 user nova-compute[71509]: Login to [iface: default, target: iqn.2010-10.org.openstack:ec6269ad-4a21-4afb-b769-a969d5e3c92f, portal: 172.16.0.220,3260] successful.
Apr 14 10:49:34 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:49:34 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec6269ad-4a21-4afb-b769-a969d5e3c92f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:34 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec6269ad-4a21-4afb-b769-a969d5e3c92f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:49:34 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[511f13e7-c456-4af6-95db-bc1168b2b8d3]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:49:34 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-38f0d569-cea6-40f1-8c72-0f6b972253d5 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:49:34 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:34 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:49:34 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[9471c8ad-446f-4047-853f-14f299eaed37]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec6269ad-4a21-4afb-b769-a969d5e3c92f (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:49:34 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-38f0d569-cea6-40f1-8c72-0f6b972253d5 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d (non-flash)
Apr 14 10:49:34 user nova-compute[71509]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2 (non-flash)
Apr 14 10:49:34 user nova-compute[71509]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec6269ad-4a21-4afb-b769-a969d5e3c92f (non-flash)
Apr 14 10:49:34 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:49:34 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-38f0d569-cea6-40f1-8c72-0f6b972253d5 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d (non-flash)
Apr 14 10:49:34 user nova-compute[71509]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2 (non-flash)
Apr 14 10:49:34 user nova-compute[71509]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec6269ad-4a21-4afb-b769-a969d5e3c92f (non-flash)
Apr 14 10:49:34 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 10:49:34 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-38f0d569-cea6-40f1-8c72-0f6b972253d5 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ec6269ad-4a21-4afb-b769-a969d5e3c92f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.374s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 10:49:34 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-38f0d569-cea6-40f1-8c72-0f6b972253d5 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Connected to 172.16.0.220:3260 {{(pid=71509) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 10:49:34 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-38f0d569-cea6-40f1-8c72-0f6b972253d5 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] HCTL ('35', '-', '-', 0) found on session 24 with lun 0 {{(pid=71509) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 10:49:34 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-38f0d569-cea6-40f1-8c72-0f6b972253d5 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71509) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 10:49:34 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:35 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.022s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:49:35 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecc1d9fe-a836-4360-8773-86253e31fcce]: (4, ('- - 0', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:49:35 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-38f0d569-cea6-40f1-8c72-0f6b972253d5 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Searching for a device in session 24 and hctl ['35', '*', '*', 0] yield: None {{(pid=71509) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 10:49:35 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:49:36 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-38f0d569-cea6-40f1-8c72-0f6b972253d5 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Searching for a device in session 24 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71509) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 10:49:36 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-38f0d569-cea6-40f1-8c72-0f6b972253d5 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:ec6269ad-4a21-4afb-b769-a969d5e3c92f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qLoetIZK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71509) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 10:49:36 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-38f0d569-cea6-40f1-8c72-0f6b972253d5 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.418s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 10:49:36 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-38f0d569-cea6-40f1-8c72-0f6b972253d5 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] <== connect_volume: return (1420ms) {'type': 'block', 'scsi_wwn': '26335653631353234', 'path': '/dev/sdd'} {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 10:49:36 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38f0d569-cea6-40f1-8c72-0f6b972253d5 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] [instance: 203b622c-9e6d-4ac7-a3fa-9f9c82ef3108] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26335653631353234', 'path': '/dev/sdd'} {{(pid=71509) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 10:49:36 user nova-compute[71509]: DEBUG nova.objects.instance [None req-38f0d569-cea6-40f1-8c72-0f6b972253d5 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Lazy-loading 'flavor' on Instance uuid 203b622c-9e6d-4ac7-a3fa-9f9c82ef3108 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:49:36 user nova-compute[71509]: DEBUG nova.virt.libvirt.guest [None req-38f0d569-cea6-40f1-8c72-0f6b972253d5 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 10:49:36 user nova-compute[71509]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 10:49:36 user nova-compute[71509]:   <source dev="/dev/sdd"/>
Apr 14 10:49:36 user nova-compute[71509]:   <target dev="vdb" bus="virtio"/>
Apr 14 10:49:36 user nova-compute[71509]:   <serial>ec6269ad-4a21-4afb-b769-a969d5e3c92f</serial>
Apr 14 10:49:36 user nova-compute[71509]: </disk>
Apr 14 10:49:36 user nova-compute[71509]:  {{(pid=71509) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 10:49:36 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-38f0d569-cea6-40f1-8c72-0f6b972253d5 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] No BDM found with device name vda, not building metadata. {{(pid=71509) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 10:49:36 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-38f0d569-cea6-40f1-8c72-0f6b972253d5 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71509) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 10:49:36 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-38f0d569-cea6-40f1-8c72-0f6b972253d5 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] No VIF found with MAC fa:16:3e:a8:8f:1c, not building metadata {{(pid=71509) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 10:49:36 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-38f0d569-cea6-40f1-8c72-0f6b972253d5 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Lock "203b622c-9e6d-4ac7-a3fa-9f9c82ef3108" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.123s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:49:37 user nova-compute[71509]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681469362.2435887, 39586d44-1d8e-4607-ab4d-c03a7d841606 => Stopped> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 10:49:37 user nova-compute[71509]: INFO nova.compute.manager [-] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] VM Stopped (Lifecycle Event)
Apr 14 10:49:37 user nova-compute[71509]: DEBUG nova.compute.manager [None req-caf731b5-1700-4853-893f-5143b405361a None None] [instance: 39586d44-1d8e-4607-ab4d-c03a7d841606] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:49:37 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:49:37 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:49:37 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Starting heal instance info cache {{(pid=71509) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 10:49:37 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Rebuilding the list of instances to heal {{(pid=71509) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 10:49:37 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "refresh_cache-97f20661-8b60-439e-b7af-2fc2013c5ade" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:49:37 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquired lock "refresh_cache-97f20661-8b60-439e-b7af-2fc2013c5ade" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:49:37 user nova-compute[71509]: DEBUG nova.network.neutron [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] Forcefully refreshing network info cache for instance {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 10:49:37 user nova-compute[71509]: DEBUG nova.objects.instance [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lazy-loading 'info_cache' on Instance uuid 97f20661-8b60-439e-b7af-2fc2013c5ade {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:49:37 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:49:37 user nova-compute[71509]: DEBUG nova.network.neutron [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] Updating instance_info_cache with network_info: [{"id": "270b85b0-1832-4118-a8b0-ff784587b58a", "address": "fa:16:3e:75:ba:ae", "network": {"id": "22eb5f87-be4d-447d-bafe-25e0284ea3ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-787804772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf93e5dac50342d0b65ef09711401e99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap270b85b0-18", "ovs_interfaceid": "270b85b0-1832-4118-a8b0-ff784587b58a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:49:38 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Releasing lock "refresh_cache-97f20661-8b60-439e-b7af-2fc2013c5ade" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:49:38 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] Updated the network info_cache for instance {{(pid=71509) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 10:49:38 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:49:39 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:49:39 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-2eef5588-5686-455d-b149-4007ef3c03d5 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "b4abb549-8f36-40c5-971f-8accbb14ff86" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:49:39 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-2eef5588-5686-455d-b149-4007ef3c03d5 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "b4abb549-8f36-40c5-971f-8accbb14ff86" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:49:39 user nova-compute[71509]: INFO nova.compute.manager [None req-2eef5588-5686-455d-b149-4007ef3c03d5 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Detaching volume 2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d
Apr 14 10:49:39 user nova-compute[71509]: INFO nova.virt.block_device [None req-2eef5588-5686-455d-b149-4007ef3c03d5 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Attempting to driver detach volume 2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d from mountpoint /dev/vdb
Apr 14 10:49:39 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-2eef5588-5686-455d-b149-4007ef3c03d5 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Attempting to detach device vdb from instance b4abb549-8f36-40c5-971f-8accbb14ff86 from the persistent domain config. {{(pid=71509) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 10:49:39 user nova-compute[71509]: DEBUG nova.virt.libvirt.guest [None req-2eef5588-5686-455d-b149-4007ef3c03d5 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 10:49:39 user nova-compute[71509]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 10:49:39 user nova-compute[71509]:   <source dev="/dev/sdb"/>
Apr 14 10:49:39 user nova-compute[71509]:   <target dev="vdb" bus="virtio"/>
Apr 14 10:49:39 user nova-compute[71509]:   <serial>2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d</serial>
Apr 14 10:49:39 user nova-compute[71509]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 14 10:49:39 user nova-compute[71509]: </disk>
Apr 14 10:49:39 user nova-compute[71509]:  {{(pid=71509) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 10:49:39 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-2eef5588-5686-455d-b149-4007ef3c03d5 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Successfully detached device vdb from instance b4abb549-8f36-40c5-971f-8accbb14ff86 from the persistent domain config.
Apr 14 10:49:39 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-2eef5588-5686-455d-b149-4007ef3c03d5 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b4abb549-8f36-40c5-971f-8accbb14ff86 from the live domain config. {{(pid=71509) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 10:49:39 user nova-compute[71509]: DEBUG nova.virt.libvirt.guest [None req-2eef5588-5686-455d-b149-4007ef3c03d5 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 10:49:39 user nova-compute[71509]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 10:49:39 user nova-compute[71509]:   <source dev="/dev/sdb"/>
Apr 14 10:49:39 user nova-compute[71509]:   <target dev="vdb" bus="virtio"/>
Apr 14 10:49:39 user nova-compute[71509]:   <serial>2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d</serial>
Apr 14 10:49:39 user nova-compute[71509]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 14 10:49:39 user nova-compute[71509]: </disk>
Apr 14 10:49:39 user nova-compute[71509]:  {{(pid=71509) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 10:49:39 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Received event <DeviceRemovedEvent: 1681469379.9954977, b4abb549-8f36-40c5-971f-8accbb14ff86 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71509) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 10:49:40 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-2eef5588-5686-455d-b149-4007ef3c03d5 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b4abb549-8f36-40c5-971f-8accbb14ff86 {{(pid=71509) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 10:49:40 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-2eef5588-5686-455d-b149-4007ef3c03d5 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Successfully detached device vdb from instance b4abb549-8f36-40c5-971f-8accbb14ff86 from the live domain config.
Apr 14 10:49:40 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2eef5588-5686-455d-b149-4007ef3c03d5 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] calling os-brick to detach iSCSI Volume {{(pid=71509) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 10:49:40 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eef5588-5686-455d-b149-4007ef3c03d5 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0bf0749390>, {'target_iqn': 'iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZWfaEHNS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 10:49:40 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-2eef5588-5686-455d-b149-4007ef3c03d5 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 10:49:40 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-2eef5588-5686-455d-b149-4007ef3c03d5 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 10:49:40 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-2eef5588-5686-455d-b149-4007ef3c03d5 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 10:49:40 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:40 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:49:40 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[e37459d6-79dd-4a61-9ef7-3b693e56f980]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ec6269ad-4a21-4afb-b769-a969d5e3c92f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:49:40 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eef5588-5686-455d-b149-4007ef3c03d5 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 10:49:40 user nova-compute[71509]: No targets found.
Apr 14 10:49:40 user nova-compute[71509]: iSNS:
Apr 14 10:49:40 user nova-compute[71509]: No targets found.
Apr 14 10:49:40 user nova-compute[71509]: STATIC:
Apr 14 10:49:40 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d
Apr 14 10:49:40 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:49:40 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:49:40 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2
Apr 14 10:49:40 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:49:40 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:49:40 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:ec6269ad-4a21-4afb-b769-a969d5e3c92f
Apr 14 10:49:40 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:49:40 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:49:40 user nova-compute[71509]: FIRMWARE:
Apr 14 10:49:40 user nova-compute[71509]: No targets found.
Apr 14 10:49:40 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:49:40 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eef5588-5686-455d-b149-4007ef3c03d5 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 10:49:40 user nova-compute[71509]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 10:49:40 user nova-compute[71509]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71509) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 10:49:40 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eef5588-5686-455d-b149-4007ef3c03d5 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d', 0)] {{(pid=71509) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 10:49:40 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:40 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:49:40 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[34237d3a-1a24-4ab1-bcc0-b75b6276a8b3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ec6269ad-4a21-4afb-b769-a969d5e3c92f\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:49:40 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:40 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:49:40 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[d27c7c44-11b1-4dff-a257-50b0fbfa6762]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec6269ad-4a21-4afb-b769-a969d5e3c92f (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:49:40 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eef5588-5686-455d-b149-4007ef3c03d5 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d (non-flash)
Apr 14 10:49:40 user nova-compute[71509]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2 (non-flash)
Apr 14 10:49:40 user nova-compute[71509]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec6269ad-4a21-4afb-b769-a969d5e3c92f (non-flash)
Apr 14 10:49:40 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:49:40 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eef5588-5686-455d-b149-4007ef3c03d5 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d (non-flash)
Apr 14 10:49:40 user nova-compute[71509]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2 (non-flash)
Apr 14 10:49:40 user nova-compute[71509]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec6269ad-4a21-4afb-b769-a969d5e3c92f (non-flash)
Apr 14 10:49:40 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 10:49:40 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eef5588-5686-455d-b149-4007ef3c03d5 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0bf06ab490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d'): ({'sdb'}, set())}) {{(pid=71509) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 10:49:40 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-2eef5588-5686-455d-b149-4007ef3c03d5 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Removing single pathed devices sdb {{(pid=71509) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 10:49:40 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:40 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:49:40 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[76430a34-b0e8-4cad-aecb-092ad00e66e1]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:49:40 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:40 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:49:40 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[b498867a-6fff-4864-ad83-885e8775b8a9]: (4, ('ok\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:49:40 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-2eef5588-5686-455d-b149-4007ef3c03d5 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Flushing IO for device /dev/sdb {{(pid=71509) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 10:49:40 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:40 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:49:40 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bf05ad8-f3bd-4733-bf81-bcb61da3cbdc]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:49:40 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-2eef5588-5686-455d-b149-4007ef3c03d5 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71509) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 10:49:40 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:40 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.035s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:49:40 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[09957020-8b0f-46a8-9369-ed7f4523c2f6]: (4, ('1', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:49:40 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-2eef5588-5686-455d-b149-4007ef3c03d5 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71509) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 10:49:40 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-2eef5588-5686-455d-b149-4007ef3c03d5 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] SCSI volumes sdb have been removed. {{(pid=71509) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 10:49:40 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eef5588-5686-455d-b149-4007ef3c03d5 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d')] {{(pid=71509) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 10:49:40 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:40 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:49:40 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[e777f779-0223-408a-83ae-da411649970d]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:49:40 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eef5588-5686-455d-b149-4007ef3c03d5 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:49:40 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d -p 172.16.0.220:3260 --logout {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:40 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:49:40 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[1042f1f5-222a-4ef0-90e1-396213c11183]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:49:40 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eef5588-5686-455d-b149-4007ef3c03d5 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d, portal: 172.16.0.220,3260]
Apr 14 10:49:40 user nova-compute[71509]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d, portal: 172.16.0.220,3260] successful.
Apr 14 10:49:40 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:49:40 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d -p 172.16.0.220:3260 --op delete {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:40 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dc826ff-d006-44b0-9cc8-7cc57d6e0c3d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:49:40 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[a78c7595-13b7-4c58-955d-69f9e8a66eb8]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:49:40 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eef5588-5686-455d-b149-4007ef3c03d5 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:49:40 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-2eef5588-5686-455d-b149-4007ef3c03d5 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.281s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 10:49:40 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-2eef5588-5686-455d-b149-4007ef3c03d5 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] <== disconnect_volume: return (281ms) None {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 10:49:40 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2eef5588-5686-455d-b149-4007ef3c03d5 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Disconnected iSCSI Volume {{(pid=71509) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 10:49:40 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:49:40 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:49:40 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:49:40 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:49:40 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Auditing locally available compute resources for user (node: user) {{(pid=71509) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 10:49:40 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97820f17-22d1-4ec3-9721-1edadccc794a/disk.rescue --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:40 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97820f17-22d1-4ec3-9721-1edadccc794a/disk.rescue --force-share --output=json" returned: 0 in 0.142s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:49:40 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97820f17-22d1-4ec3-9721-1edadccc794a/disk.rescue --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:40 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97820f17-22d1-4ec3-9721-1edadccc794a/disk.rescue --force-share --output=json" returned: 0 in 0.140s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:49:40 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97820f17-22d1-4ec3-9721-1edadccc794a/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:41 user nova-compute[71509]: DEBUG nova.objects.instance [None req-2eef5588-5686-455d-b149-4007ef3c03d5 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lazy-loading 'flavor' on Instance uuid b4abb549-8f36-40c5-971f-8accbb14ff86 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:49:41 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97820f17-22d1-4ec3-9721-1edadccc794a/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:49:41 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97820f17-22d1-4ec3-9721-1edadccc794a/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:41 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-2eef5588-5686-455d-b149-4007ef3c03d5 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "b4abb549-8f36-40c5-971f-8accbb14ff86" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.685s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:49:41 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97820f17-22d1-4ec3-9721-1edadccc794a/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:49:41 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3245b74-dbe8-4b8b-83b6-58a4811fdba9/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:41 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3245b74-dbe8-4b8b-83b6-58a4811fdba9/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:49:41 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3245b74-dbe8-4b8b-83b6-58a4811fdba9/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:41 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3245b74-dbe8-4b8b-83b6-58a4811fdba9/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:49:41 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4abb549-8f36-40c5-971f-8accbb14ff86/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:41 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4abb549-8f36-40c5-971f-8accbb14ff86/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:49:41 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4abb549-8f36-40c5-971f-8accbb14ff86/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:41 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4abb549-8f36-40c5-971f-8accbb14ff86/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:49:41 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8586a70e-9855-4177-ac1b-cf707a4df871/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:41 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8586a70e-9855-4177-ac1b-cf707a4df871/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:49:41 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8586a70e-9855-4177-ac1b-cf707a4df871/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:42 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8586a70e-9855-4177-ac1b-cf707a4df871/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:49:42 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71509) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 10:49:42 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55178126-9766-4875-9122-39dcc87ce82c/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:42 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55178126-9766-4875-9122-39dcc87ce82c/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:49:42 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55178126-9766-4875-9122-39dcc87ce82c/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:42 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:49:42 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55178126-9766-4875-9122-39dcc87ce82c/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:49:42 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e479154a-acd6-47aa-9a5b-43c6e0feda07/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:42 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e479154a-acd6-47aa-9a5b-43c6e0feda07/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:49:42 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e479154a-acd6-47aa-9a5b-43c6e0feda07/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:42 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e479154a-acd6-47aa-9a5b-43c6e0feda07/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:49:42 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e6c800c-9b35-4e35-969e-c40367056dce/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:42 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e6c800c-9b35-4e35-969e-c40367056dce/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:49:42 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e6c800c-9b35-4e35-969e-c40367056dce/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:42 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:49:42 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0e6c800c-9b35-4e35-969e-c40367056dce/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:49:42 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97f20661-8b60-439e-b7af-2fc2013c5ade/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97f20661-8b60-439e-b7af-2fc2013c5ade/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:49:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97f20661-8b60-439e-b7af-2fc2013c5ade/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97f20661-8b60-439e-b7af-2fc2013c5ade/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:49:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/203b622c-9e6d-4ac7-a3fa-9f9c82ef3108/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/203b622c-9e6d-4ac7-a3fa-9f9c82ef3108/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:49:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/203b622c-9e6d-4ac7-a3fa-9f9c82ef3108/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/203b622c-9e6d-4ac7-a3fa-9f9c82ef3108/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:49:43 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=71509) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 10:49:43 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:49:43 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:49:43 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Hypervisor/Node resource view: name=user free_ram=7649MB free_disk=26.06637191772461GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71509) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 10:49:43 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:49:43 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:49:44 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 97f20661-8b60-439e-b7af-2fc2013c5ade actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:49:44 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 97820f17-22d1-4ec3-9721-1edadccc794a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:49:44 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance b4abb549-8f36-40c5-971f-8accbb14ff86 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:49:44 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 0e6c800c-9b35-4e35-969e-c40367056dce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:49:44 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 55178126-9766-4875-9122-39dcc87ce82c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:49:44 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance e479154a-acd6-47aa-9a5b-43c6e0feda07 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:49:44 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 8586a70e-9855-4177-ac1b-cf707a4df871 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:49:44 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 203b622c-9e6d-4ac7-a3fa-9f9c82ef3108 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:49:44 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance f3245b74-dbe8-4b8b-83b6-58a4811fdba9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:49:44 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=71509) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 10:49:44 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Final resource view: name=user phys_ram=16023MB used_ram=1664MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=71509) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 10:49:44 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Acquiring lock "4b767f1b-e97e-497c-8c70-8806203c76ae" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:49:44 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "4b767f1b-e97e-497c-8c70-8806203c76ae" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.002s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:49:44 user nova-compute[71509]: INFO nova.compute.manager [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Unshelving
Apr 14 10:49:44 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 10:49:44 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 10:49:44 user nova-compute[71509]: INFO nova.virt.block_device [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Booting with volume e6828770-fda7-4cd5-b857-c4d2599299a7 at /dev/vdc
Apr 14 10:49:44 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Compute_service record updated for user:user {{(pid=71509) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 10:49:44 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.502s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:49:44 user nova-compute[71509]: DEBUG os_brick.utils [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 10:49:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:49:44 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[fafcd575-5b45-4fd7-9384-ed23034256f2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50119df3c417\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:49:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:49:44 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[f94f6d85-da8b-45d4-b4d2-62a425144e40]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:49:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:49:44 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cff7739-7e1a-4258-9128-570195bc353a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:49:44 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[45c1810b-6c13-4807-bb68-8222a87a6f8f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:49:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Running cmd (subprocess): nvme version {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] 'nvme version' failed. Not Retrying. {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 10:49:44 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] nvme not present on system {{(pid=71509) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 10:49:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 10:49:44 user nova-compute[71509]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 10:49:44 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8744ba7-a02b-4db7-b009-4419990c80e0]: (4, '') {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:49:44 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71509) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 10:49:44 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71509) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 10:49:44 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] LIGHTOS: no hostnqn found. {{(pid=71509) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 10:49:44 user nova-compute[71509]: DEBUG os_brick.utils [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50119df3c417', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 10:49:44 user nova-compute[71509]: DEBUG nova.virt.block_device [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Updating existing volume attachment record: 8b877fd4-6619-438d-8ceb-a4a5197d1367 {{(pid=71509) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 10:49:45 user nova-compute[71509]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681469370.97398, 8586a70e-9855-4177-ac1b-cf707a4df871 => Stopped> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 10:49:45 user nova-compute[71509]: INFO nova.compute.manager [-] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] VM Stopped (Lifecycle Event)
Apr 14 10:49:46 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1db21112-a619-44e8-a42a-a209b9e38f70 None None] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:49:46 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1db21112-a619-44e8-a42a-a209b9e38f70 None None] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 10:49:47 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:49:47 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:49:49 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:49:49 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:49:49 user nova-compute[71509]: DEBUG nova.objects.instance [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lazy-loading 'pci_requests' on Instance uuid 4b767f1b-e97e-497c-8c70-8806203c76ae {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:49:49 user nova-compute[71509]: DEBUG nova.objects.instance [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lazy-loading 'numa_topology' on Instance uuid 4b767f1b-e97e-497c-8c70-8806203c76ae {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:49:49 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71509) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 10:49:49 user nova-compute[71509]: INFO nova.compute.claims [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Claim successful on node user
Apr 14 10:49:49 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 10:49:49 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 10:49:49 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.432s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:49:49 user nova-compute[71509]: INFO nova.network.neutron [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Updating port 8d8a356d-c198-4e13-a489-5c626fbd025c with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Apr 14 10:49:50 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Acquiring lock "refresh_cache-4b767f1b-e97e-497c-8c70-8806203c76ae" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:49:50 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Acquired lock "refresh_cache-4b767f1b-e97e-497c-8c70-8806203c76ae" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:49:50 user nova-compute[71509]: DEBUG nova.network.neutron [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Building network info cache for instance {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 10:49:51 user nova-compute[71509]: DEBUG nova.compute.manager [req-ccf87390-2abd-4ce2-ad44-c72c2ab1be13 req-7677bfe0-9073-481d-be61-3219f61e472c service nova] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Received event network-changed-8d8a356d-c198-4e13-a489-5c626fbd025c {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:49:51 user nova-compute[71509]: DEBUG nova.compute.manager [req-ccf87390-2abd-4ce2-ad44-c72c2ab1be13 req-7677bfe0-9073-481d-be61-3219f61e472c service nova] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Refreshing instance network info cache due to event network-changed-8d8a356d-c198-4e13-a489-5c626fbd025c. {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 10:49:51 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-ccf87390-2abd-4ce2-ad44-c72c2ab1be13 req-7677bfe0-9073-481d-be61-3219f61e472c service nova] Acquiring lock "refresh_cache-4b767f1b-e97e-497c-8c70-8806203c76ae" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:49:51 user nova-compute[71509]: DEBUG nova.network.neutron [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Updating instance_info_cache with network_info: [{"id": "8d8a356d-c198-4e13-a489-5c626fbd025c", "address": "fa:16:3e:c6:af:76", "network": {"id": "1cb09253-66a4-4c81-82d0-c6d948e0aed4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1557121746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8a9941095d445f48d70df26d8c90e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d8a356d-c1", "ovs_interfaceid": "8d8a356d-c198-4e13-a489-5c626fbd025c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:49:51 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Releasing lock "refresh_cache-4b767f1b-e97e-497c-8c70-8806203c76ae" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:49:51 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Creating instance directory {{(pid=71509) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 10:49:51 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Creating image(s)
Apr 14 10:49:51 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Acquiring lock "/opt/stack/data/nova/instances/4b767f1b-e97e-497c-8c70-8806203c76ae/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:49:51 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "/opt/stack/data/nova/instances/4b767f1b-e97e-497c-8c70-8806203c76ae/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:49:51 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "/opt/stack/data/nova/instances/4b767f1b-e97e-497c-8c70-8806203c76ae/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.010s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:49:51 user nova-compute[71509]: DEBUG nova.objects.instance [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lazy-loading 'trusted_certs' on Instance uuid 4b767f1b-e97e-497c-8c70-8806203c76ae {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:49:51 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-ccf87390-2abd-4ce2-ad44-c72c2ab1be13 req-7677bfe0-9073-481d-be61-3219f61e472c service nova] Acquired lock "refresh_cache-4b767f1b-e97e-497c-8c70-8806203c76ae" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:49:51 user nova-compute[71509]: DEBUG nova.network.neutron [req-ccf87390-2abd-4ce2-ad44-c72c2ab1be13 req-7677bfe0-9073-481d-be61-3219f61e472c service nova] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Refreshing network info cache for port 8d8a356d-c198-4e13-a489-5c626fbd025c {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 10:49:51 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Acquiring lock "e0f320e80a641e533196ffd150f539057568ffff" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:49:51 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "e0f320e80a641e533196ffd150f539057568ffff" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:49:52 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0f320e80a641e533196ffd150f539057568ffff.part --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:52 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:49:52 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0f320e80a641e533196ffd150f539057568ffff.part --force-share --output=json" returned: 0 in 0.158s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:49:52 user nova-compute[71509]: DEBUG nova.virt.images [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] d5409cc7-1961-4704-bc0a-b1e3cf81bdac was qcow2, converting to raw {{(pid=71509) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 14 10:49:52 user nova-compute[71509]: DEBUG nova.privsep.utils [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71509) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 10:49:52 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e0f320e80a641e533196ffd150f539057568ffff.part /opt/stack/data/nova/instances/_base/e0f320e80a641e533196ffd150f539057568ffff.converted {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:52 user nova-compute[71509]: DEBUG nova.network.neutron [req-ccf87390-2abd-4ce2-ad44-c72c2ab1be13 req-7677bfe0-9073-481d-be61-3219f61e472c service nova] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Updated VIF entry in instance network info cache for port 8d8a356d-c198-4e13-a489-5c626fbd025c. {{(pid=71509) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 10:49:52 user nova-compute[71509]: DEBUG nova.network.neutron [req-ccf87390-2abd-4ce2-ad44-c72c2ab1be13 req-7677bfe0-9073-481d-be61-3219f61e472c service nova] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Updating instance_info_cache with network_info: [{"id": "8d8a356d-c198-4e13-a489-5c626fbd025c", "address": "fa:16:3e:c6:af:76", "network": {"id": "1cb09253-66a4-4c81-82d0-c6d948e0aed4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1557121746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8a9941095d445f48d70df26d8c90e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d8a356d-c1", "ovs_interfaceid": "8d8a356d-c198-4e13-a489-5c626fbd025c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:49:52 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e0f320e80a641e533196ffd150f539057568ffff.part /opt/stack/data/nova/instances/_base/e0f320e80a641e533196ffd150f539057568ffff.converted" returned: 0 in 0.258s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:49:52 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0f320e80a641e533196ffd150f539057568ffff.converted --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:52 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-ccf87390-2abd-4ce2-ad44-c72c2ab1be13 req-7677bfe0-9073-481d-be61-3219f61e472c service nova] Releasing lock "refresh_cache-4b767f1b-e97e-497c-8c70-8806203c76ae" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:49:52 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0f320e80a641e533196ffd150f539057568ffff.converted --force-share --output=json" returned: 0 in 0.153s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:49:52 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "e0f320e80a641e533196ffd150f539057568ffff" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.393s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:49:52 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0f320e80a641e533196ffd150f539057568ffff --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:52 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:49:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0f320e80a641e533196ffd150f539057568ffff --force-share --output=json" returned: 0 in 0.147s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:49:53 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Acquiring lock "e0f320e80a641e533196ffd150f539057568ffff" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:49:53 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "e0f320e80a641e533196ffd150f539057568ffff" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:49:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0f320e80a641e533196ffd150f539057568ffff --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0f320e80a641e533196ffd150f539057568ffff --force-share --output=json" returned: 0 in 0.133s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:49:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0f320e80a641e533196ffd150f539057568ffff,backing_fmt=raw /opt/stack/data/nova/instances/4b767f1b-e97e-497c-8c70-8806203c76ae/disk 1073741824 {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0f320e80a641e533196ffd150f539057568ffff,backing_fmt=raw /opt/stack/data/nova/instances/4b767f1b-e97e-497c-8c70-8806203c76ae/disk 1073741824" returned: 0 in 0.048s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:49:53 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "e0f320e80a641e533196ffd150f539057568ffff" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.188s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:49:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0f320e80a641e533196ffd150f539057568ffff --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0f320e80a641e533196ffd150f539057568ffff --force-share --output=json" returned: 0 in 0.166s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:49:53 user nova-compute[71509]: DEBUG nova.objects.instance [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lazy-loading 'migration_context' on Instance uuid 4b767f1b-e97e-497c-8c70-8806203c76ae {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:49:53 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Rebasing disk image.
Apr 14 10:49:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json" returned: 0 in 0.131s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:49:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 -F raw /opt/stack/data/nova/instances/4b767f1b-e97e-497c-8c70-8806203c76ae/disk {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:55 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 -F raw /opt/stack/data/nova/instances/4b767f1b-e97e-497c-8c70-8806203c76ae/disk" returned: 0 in 1.916s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:49:55 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Created local disks {{(pid=71509) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 10:49:55 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Ensure instance console log exists: /opt/stack/data/nova/instances/4b767f1b-e97e-497c-8c70-8806203c76ae/console.log {{(pid=71509) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 10:49:55 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:49:55 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:49:55 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:49:55 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Start _get_guest_xml network_info=[{"id": "8d8a356d-c198-4e13-a489-5c626fbd025c", "address": "fa:16:3e:c6:af:76", "network": {"id": "1cb09253-66a4-4c81-82d0-c6d948e0aed4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1557121746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8a9941095d445f48d70df26d8c90e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d8a356d-c1", "ovs_interfaceid": "8d8a356d-c198-4e13-a489-5c626fbd025c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='3f3cc9cd185da9115d344fa95f3624aa',container_format='bare',created_at=2023-04-14T10:47:52Z,direct_url=<?>,disk_format='qcow2',id=d5409cc7-1961-4704-bc0a-b1e3cf81bdac,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1779641770-shelved',owner='f8a9941095d445f48d70df26d8c90e6c',properties=ImageMetaProps,protected=<?>,size=38600704,status='active',tags=<?>,updated_at=2023-04-14T10:47:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '048ec0ee-0465-448d-8b4c-f072acb101dc'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vdc', 'boot_index': None, 'device_type': 'disk', 'attachment_id': '8b877fd4-6619-438d-8ceb-a4a5197d1367', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e6828770-fda7-4cd5-b857-c4d2599299a7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gjqOXaNU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '4b767f1b-e97e-497c-8c70-8806203c76ae', 'attached_at': '', 'detached_at': '', 'volume_id': 'e6828770-fda7-4cd5-b857-c4d2599299a7', 'serial': 'e6828770-fda7-4cd5-b857-c4d2599299a7'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'volume_type': None} {{(pid=71509) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 10:49:55 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:49:55 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:49:55 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71509) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 10:49:55 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T10:40:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='3f3cc9cd185da9115d344fa95f3624aa',container_format='bare',created_at=2023-04-14T10:47:52Z,direct_url=<?>,disk_format='qcow2',id=d5409cc7-1961-4704-bc0a-b1e3cf81bdac,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1779641770-shelved',owner='f8a9941095d445f48d70df26d8c90e6c',properties=ImageMetaProps,protected=<?>,size=38600704,status='active',tags=<?>,updated_at=2023-04-14T10:47:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 10:49:55 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Flavor limits 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 10:49:55 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Image limits 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 10:49:55 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Flavor pref 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 10:49:55 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Image pref 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 10:49:55 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 10:49:55 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 10:49:55 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71509) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 10:49:55 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Got 1 possible topologies {{(pid=71509) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 10:49:55 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 10:49:55 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 10:49:55 user nova-compute[71509]: DEBUG nova.objects.instance [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4b767f1b-e97e-497c-8c70-8806203c76ae {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:49:55 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Calling os-brick to attach iSCSI Volume {{(pid=71509) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 10:49:55 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0bf0749390>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e6828770-fda7-4cd5-b857-c4d2599299a7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gjqOXaNU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 10:49:55 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 10:49:55 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 10:49:55 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 10:49:55 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 10:49:55 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e6828770-fda7-4cd5-b857-c4d2599299a7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 10:49:55 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e6828770-fda7-4cd5-b857-c4d2599299a7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 10:49:55 user nova-compute[71509]: INFO os_brick.initiator.connectors.iscsi [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 10:49:55 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6828770-fda7-4cd5-b857-c4d2599299a7 -p 172.16.0.220:3260 {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:55 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6828770-fda7-4cd5-b857-c4d2599299a7 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:49:55 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fdbd816-a502-4d0a-9fc5-90f8210c777e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:49:55 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 10:49:55 user nova-compute[71509]:  {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:49:55 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6828770-fda7-4cd5-b857-c4d2599299a7 -p 172.16.0.220:3260 --interface default --op new {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:55 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6828770-fda7-4cd5-b857-c4d2599299a7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:49:55 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a669b12-7ed5-4eda-9f98-b9a3c01a1889]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e6828770-fda7-4cd5-b857-c4d2599299a7] added\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:49:55 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e6828770-fda7-4cd5-b857-c4d2599299a7] added
Apr 14 10:49:55 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:49:55 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6828770-fda7-4cd5-b857-c4d2599299a7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:55 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6828770-fda7-4cd5-b857-c4d2599299a7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.047s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:49:55 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a57f9f7-44a3-465a-96dd-cc5a5e0e646a]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:49:55 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:49:55 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6828770-fda7-4cd5-b857-c4d2599299a7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:55 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6828770-fda7-4cd5-b857-c4d2599299a7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:49:55 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[53a53f3e-e6e3-4892-a298-ac76fd70b4ac]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:49:55 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:49:55 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6828770-fda7-4cd5-b857-c4d2599299a7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gjqOXaNU {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:55 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6828770-fda7-4cd5-b857-c4d2599299a7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gjqOXaNU" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:49:55 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8dfbbcb-a97e-47e7-ab50-c335cd58c719]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:49:55 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gjqOXaNU'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:49:55 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6828770-fda7-4cd5-b857-c4d2599299a7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:55 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6828770-fda7-4cd5-b857-c4d2599299a7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:49:55 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[9583c561-7d12-4c8b-9abd-280b61af4abb]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:49:55 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:49:55 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:55 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:49:55 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[f253bc71-c4af-4243-8c4c-fd60616600a6]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec6269ad-4a21-4afb-b769-a969d5e3c92f (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:49:55 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2 (non-flash)
Apr 14 10:49:55 user nova-compute[71509]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec6269ad-4a21-4afb-b769-a969d5e3c92f (non-flash)
Apr 14 10:49:55 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:49:55 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2 (non-flash)
Apr 14 10:49:55 user nova-compute[71509]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec6269ad-4a21-4afb-b769-a969d5e3c92f (non-flash)
Apr 14 10:49:55 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 10:49:55 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6828770-fda7-4cd5-b857-c4d2599299a7 -p 172.16.0.220:3260 --login {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:55 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6828770-fda7-4cd5-b857-c4d2599299a7 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:49:55 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9dd87ef-e4a7-4b47-b343-8d6942ee5fc4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e6828770-fda7-4cd5-b857-c4d2599299a7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e6828770-fda7-4cd5-b857-c4d2599299a7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:49:55 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e6828770-fda7-4cd5-b857-c4d2599299a7, portal: 172.16.0.220,3260]
Apr 14 10:49:55 user nova-compute[71509]: Login to [iface: default, target: iqn.2010-10.org.openstack:e6828770-fda7-4cd5-b857-c4d2599299a7, portal: 172.16.0.220,3260] successful.
Apr 14 10:49:55 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:49:55 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6828770-fda7-4cd5-b857-c4d2599299a7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:55 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6828770-fda7-4cd5-b857-c4d2599299a7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:49:55 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[50e59495-43a3-406e-bb08-0b4815fd6454]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:49:55 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:49:55 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:55 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:49:55 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e16aea4-54f8-4049-9862-43041443049f]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec6269ad-4a21-4afb-b769-a969d5e3c92f (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6828770-fda7-4cd5-b857-c4d2599299a7 (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:49:55 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2 (non-flash)
Apr 14 10:49:55 user nova-compute[71509]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec6269ad-4a21-4afb-b769-a969d5e3c92f (non-flash)
Apr 14 10:49:55 user nova-compute[71509]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6828770-fda7-4cd5-b857-c4d2599299a7 (non-flash)
Apr 14 10:49:55 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:49:55 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2 (non-flash)
Apr 14 10:49:55 user nova-compute[71509]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec6269ad-4a21-4afb-b769-a969d5e3c92f (non-flash)
Apr 14 10:49:55 user nova-compute[71509]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6828770-fda7-4cd5-b857-c4d2599299a7 (non-flash)
Apr 14 10:49:55 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 10:49:55 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e6828770-fda7-4cd5-b857-c4d2599299a7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.299s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 10:49:55 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Connected to 172.16.0.220:3260 {{(pid=71509) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 10:49:55 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] HCTL ('33', '-', '-', 0) found on session 25 with lun 0 {{(pid=71509) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 10:49:55 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71509) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 10:49:55 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:55 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:49:55 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f01cdcc-491f-4d06-96c6-91c2b0180665]: (4, ('- - 0', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:49:55 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Searching for a device in session 25 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71509) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 10:49:55 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e6828770-fda7-4cd5-b857-c4d2599299a7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gjqOXaNU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71509) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 10:49:56 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.334s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 10:49:56 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '26462643135323364', 'path': '/dev/sdb'} {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 10:49:56 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26462643135323364', 'path': '/dev/sdb'} {{(pid=71509) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 10:49:56 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T10:45:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1779641770',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1779641770',id=14,image_ref='d5409cc7-1961-4704-bc0a-b1e3cf81bdac',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-1533515584',keypairs=<?>,launch_index=0,launched_at=2023-04-14T10:46:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='f8a9941095d445f48d70df26d8c90e6c',ramdisk_id='',reservation_id='r-8ce8ejer',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1250068675',owner_user_name='tempest-AttachVolumeShelveTestJSON-1250068675-project-member',shelved_at='2023-04-14T10:47:56.933472',shelved_host='user',shelved_image_id='d5409cc7-1961-4704-bc0a-b1e3cf81bdac'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T10:49:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5afd3930d3a14aff8124a4782ec79870',uuid=4b767f1b-e97e-497c-8c70-8806203c76ae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "8d8a356d-c198-4e13-a489-5c626fbd025c", "address": "fa:16:3e:c6:af:76", "network": {"id": "1cb09253-66a4-4c81-82d0-c6d948e0aed4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1557121746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8a9941095d445f48d70df26d8c90e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d8a356d-c1", "ovs_interfaceid": "8d8a356d-c198-4e13-a489-5c626fbd025c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71509) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 10:49:56 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Converting VIF {"id": "8d8a356d-c198-4e13-a489-5c626fbd025c", "address": "fa:16:3e:c6:af:76", "network": {"id": "1cb09253-66a4-4c81-82d0-c6d948e0aed4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1557121746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8a9941095d445f48d70df26d8c90e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d8a356d-c1", "ovs_interfaceid": "8d8a356d-c198-4e13-a489-5c626fbd025c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:49:56 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:af:76,bridge_name='br-int',has_traffic_filtering=True,id=8d8a356d-c198-4e13-a489-5c626fbd025c,network=Network(1cb09253-66a4-4c81-82d0-c6d948e0aed4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d8a356d-c1') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:49:56 user nova-compute[71509]: DEBUG nova.objects.instance [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lazy-loading 'pci_devices' on Instance uuid 4b767f1b-e97e-497c-8c70-8806203c76ae {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:49:56 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] End _get_guest_xml xml=<domain type="kvm">
Apr 14 10:49:56 user nova-compute[71509]:   <uuid>4b767f1b-e97e-497c-8c70-8806203c76ae</uuid>
Apr 14 10:49:56 user nova-compute[71509]:   <name>instance-0000000e</name>
Apr 14 10:49:56 user nova-compute[71509]:   <memory>131072</memory>
Apr 14 10:49:56 user nova-compute[71509]:   <vcpu>1</vcpu>
Apr 14 10:49:56 user nova-compute[71509]:   <metadata>
Apr 14 10:49:56 user nova-compute[71509]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 10:49:56 user nova-compute[71509]:       <nova:package version="0.0.0"/>
Apr 14 10:49:56 user nova-compute[71509]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1779641770</nova:name>
Apr 14 10:49:56 user nova-compute[71509]:       <nova:creationTime>2023-04-14 10:49:55</nova:creationTime>
Apr 14 10:49:56 user nova-compute[71509]:       <nova:flavor name="m1.nano">
Apr 14 10:49:56 user nova-compute[71509]:         <nova:memory>128</nova:memory>
Apr 14 10:49:56 user nova-compute[71509]:         <nova:disk>1</nova:disk>
Apr 14 10:49:56 user nova-compute[71509]:         <nova:swap>0</nova:swap>
Apr 14 10:49:56 user nova-compute[71509]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 10:49:56 user nova-compute[71509]:         <nova:vcpus>1</nova:vcpus>
Apr 14 10:49:56 user nova-compute[71509]:       </nova:flavor>
Apr 14 10:49:56 user nova-compute[71509]:       <nova:owner>
Apr 14 10:49:56 user nova-compute[71509]:         <nova:user uuid="5afd3930d3a14aff8124a4782ec79870">tempest-AttachVolumeShelveTestJSON-1250068675-project-member</nova:user>
Apr 14 10:49:56 user nova-compute[71509]:         <nova:project uuid="f8a9941095d445f48d70df26d8c90e6c">tempest-AttachVolumeShelveTestJSON-1250068675</nova:project>
Apr 14 10:49:56 user nova-compute[71509]:       </nova:owner>
Apr 14 10:49:56 user nova-compute[71509]:       <nova:root type="image" uuid="d5409cc7-1961-4704-bc0a-b1e3cf81bdac"/>
Apr 14 10:49:56 user nova-compute[71509]:       <nova:ports>
Apr 14 10:49:56 user nova-compute[71509]:         <nova:port uuid="8d8a356d-c198-4e13-a489-5c626fbd025c">
Apr 14 10:49:56 user nova-compute[71509]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 14 10:49:56 user nova-compute[71509]:         </nova:port>
Apr 14 10:49:56 user nova-compute[71509]:       </nova:ports>
Apr 14 10:49:56 user nova-compute[71509]:     </nova:instance>
Apr 14 10:49:56 user nova-compute[71509]:   </metadata>
Apr 14 10:49:56 user nova-compute[71509]:   <sysinfo type="smbios">
Apr 14 10:49:56 user nova-compute[71509]:     <system>
Apr 14 10:49:56 user nova-compute[71509]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 10:49:56 user nova-compute[71509]:       <entry name="product">OpenStack Nova</entry>
Apr 14 10:49:56 user nova-compute[71509]:       <entry name="version">0.0.0</entry>
Apr 14 10:49:56 user nova-compute[71509]:       <entry name="serial">4b767f1b-e97e-497c-8c70-8806203c76ae</entry>
Apr 14 10:49:56 user nova-compute[71509]:       <entry name="uuid">4b767f1b-e97e-497c-8c70-8806203c76ae</entry>
Apr 14 10:49:56 user nova-compute[71509]:       <entry name="family">Virtual Machine</entry>
Apr 14 10:49:56 user nova-compute[71509]:     </system>
Apr 14 10:49:56 user nova-compute[71509]:   </sysinfo>
Apr 14 10:49:56 user nova-compute[71509]:   <os>
Apr 14 10:49:56 user nova-compute[71509]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 10:49:56 user nova-compute[71509]:     <boot dev="hd"/>
Apr 14 10:49:56 user nova-compute[71509]:     <smbios mode="sysinfo"/>
Apr 14 10:49:56 user nova-compute[71509]:   </os>
Apr 14 10:49:56 user nova-compute[71509]:   <features>
Apr 14 10:49:56 user nova-compute[71509]:     <acpi/>
Apr 14 10:49:56 user nova-compute[71509]:     <apic/>
Apr 14 10:49:56 user nova-compute[71509]:     <vmcoreinfo/>
Apr 14 10:49:56 user nova-compute[71509]:   </features>
Apr 14 10:49:56 user nova-compute[71509]:   <clock offset="utc">
Apr 14 10:49:56 user nova-compute[71509]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 10:49:56 user nova-compute[71509]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 10:49:56 user nova-compute[71509]:     <timer name="hpet" present="no"/>
Apr 14 10:49:56 user nova-compute[71509]:   </clock>
Apr 14 10:49:56 user nova-compute[71509]:   <cpu mode="custom" match="exact">
Apr 14 10:49:56 user nova-compute[71509]:     <model>Nehalem</model>
Apr 14 10:49:56 user nova-compute[71509]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 10:49:56 user nova-compute[71509]:   </cpu>
Apr 14 10:49:56 user nova-compute[71509]:   <devices>
Apr 14 10:49:56 user nova-compute[71509]:     <disk type="file" device="disk">
Apr 14 10:49:56 user nova-compute[71509]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 10:49:56 user nova-compute[71509]:       <source file="/opt/stack/data/nova/instances/4b767f1b-e97e-497c-8c70-8806203c76ae/disk"/>
Apr 14 10:49:56 user nova-compute[71509]:       <target dev="vda" bus="virtio"/>
Apr 14 10:49:56 user nova-compute[71509]:     </disk>
Apr 14 10:49:56 user nova-compute[71509]:     <disk type="block" device="disk">
Apr 14 10:49:56 user nova-compute[71509]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 10:49:56 user nova-compute[71509]:       <source dev="/dev/sdb"/>
Apr 14 10:49:56 user nova-compute[71509]:       <target dev="vdc" bus="virtio"/>
Apr 14 10:49:56 user nova-compute[71509]:       <serial>e6828770-fda7-4cd5-b857-c4d2599299a7</serial>
Apr 14 10:49:56 user nova-compute[71509]:     </disk>
Apr 14 10:49:56 user nova-compute[71509]:     <interface type="ethernet">
Apr 14 10:49:56 user nova-compute[71509]:       <mac address="fa:16:3e:c6:af:76"/>
Apr 14 10:49:56 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 10:49:56 user nova-compute[71509]:       <mtu size="1442"/>
Apr 14 10:49:56 user nova-compute[71509]:       <target dev="tap8d8a356d-c1"/>
Apr 14 10:49:56 user nova-compute[71509]:     </interface>
Apr 14 10:49:56 user nova-compute[71509]:     <serial type="pty">
Apr 14 10:49:56 user nova-compute[71509]:       <log file="/opt/stack/data/nova/instances/4b767f1b-e97e-497c-8c70-8806203c76ae/console.log" append="off"/>
Apr 14 10:49:56 user nova-compute[71509]:     </serial>
Apr 14 10:49:56 user nova-compute[71509]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 10:49:56 user nova-compute[71509]:     <video>
Apr 14 10:49:56 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 10:49:56 user nova-compute[71509]:     </video>
Apr 14 10:49:56 user nova-compute[71509]:     <rng model="virtio">
Apr 14 10:49:56 user nova-compute[71509]:       <backend model="random">/dev/urandom</backend>
Apr 14 10:49:56 user nova-compute[71509]:     </rng>
Apr 14 10:49:56 user nova-compute[71509]:     <controller type="usb" index="0" model="none"/>
Apr 14 10:49:56 user nova-compute[71509]:     <memballoon model="virtio">
Apr 14 10:49:56 user nova-compute[71509]:       <stats period="10"/>
Apr 14 10:49:56 user nova-compute[71509]:     </memballoon>
Apr 14 10:49:56 user nova-compute[71509]:   </devices>
Apr 14 10:49:56 user nova-compute[71509]: </domain>
Apr 14 10:49:56 user nova-compute[71509]:  {{(pid=71509) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 10:49:56 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T10:45:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1779641770',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1779641770',id=14,image_ref='d5409cc7-1961-4704-bc0a-b1e3cf81bdac',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-1533515584',keypairs=<?>,launch_index=0,launched_at=2023-04-14T10:46:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='f8a9941095d445f48d70df26d8c90e6c',ramdisk_id='',reservation_id='r-8ce8ejer',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1250068675',owner_user_name='tempest-AttachVolumeShelveTestJSON-1250068675-project-member',shelved_at='2023-04-14T10:47:56.933472',shelved_host='user',shelved_image_id='d5409cc7-1961-4704-bc0a-b1e3cf81bdac'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T10:49:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5afd3930d3a14aff8124a4782ec79870',uuid=4b767f1b-e97e-497c-8c70-8806203c76ae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "8d8a356d-c198-4e13-a489-5c626fbd025c", "address": "fa:16:3e:c6:af:76", "network": {"id": "1cb09253-66a4-4c81-82d0-c6d948e0aed4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1557121746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8a9941095d445f48d70df26d8c90e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d8a356d-c1", "ovs_interfaceid": "8d8a356d-c198-4e13-a489-5c626fbd025c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 10:49:56 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Converting VIF {"id": "8d8a356d-c198-4e13-a489-5c626fbd025c", "address": "fa:16:3e:c6:af:76", "network": {"id": "1cb09253-66a4-4c81-82d0-c6d948e0aed4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1557121746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8a9941095d445f48d70df26d8c90e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d8a356d-c1", "ovs_interfaceid": "8d8a356d-c198-4e13-a489-5c626fbd025c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:49:56 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:af:76,bridge_name='br-int',has_traffic_filtering=True,id=8d8a356d-c198-4e13-a489-5c626fbd025c,network=Network(1cb09253-66a4-4c81-82d0-c6d948e0aed4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d8a356d-c1') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:49:56 user nova-compute[71509]: DEBUG os_vif [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:af:76,bridge_name='br-int',has_traffic_filtering=True,id=8d8a356d-c198-4e13-a489-5c626fbd025c,network=Network(1cb09253-66a4-4c81-82d0-c6d948e0aed4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d8a356d-c1') {{(pid=71509) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 10:49:56 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:49:56 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:49:56 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 10:49:56 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:49:56 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8d8a356d-c1, may_exist=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:49:56 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8d8a356d-c1, col_values=(('external_ids', {'iface-id': '8d8a356d-c198-4e13-a489-5c626fbd025c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c6:af:76', 'vm-uuid': '4b767f1b-e97e-497c-8c70-8806203c76ae'}),)) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:49:56 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:49:56 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 10:49:56 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:49:56 user nova-compute[71509]: INFO os_vif [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:af:76,bridge_name='br-int',has_traffic_filtering=True,id=8d8a356d-c198-4e13-a489-5c626fbd025c,network=Network(1cb09253-66a4-4c81-82d0-c6d948e0aed4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d8a356d-c1')
Apr 14 10:49:57 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] No BDM found with device name vda, not building metadata. {{(pid=71509) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 10:49:57 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71509) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 10:49:57 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] No VIF found with MAC fa:16:3e:c6:af:76, not building metadata {{(pid=71509) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 10:49:57 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-ecb6645e-2ed4-4501-b83d-e1058a092731 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Acquiring lock "203b622c-9e6d-4ac7-a3fa-9f9c82ef3108" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:49:57 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-ecb6645e-2ed4-4501-b83d-e1058a092731 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Lock "203b622c-9e6d-4ac7-a3fa-9f9c82ef3108" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:49:57 user nova-compute[71509]: INFO nova.compute.manager [None req-ecb6645e-2ed4-4501-b83d-e1058a092731 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] [instance: 203b622c-9e6d-4ac7-a3fa-9f9c82ef3108] Detaching volume ec6269ad-4a21-4afb-b769-a969d5e3c92f
Apr 14 10:49:57 user nova-compute[71509]: INFO nova.virt.block_device [None req-ecb6645e-2ed4-4501-b83d-e1058a092731 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] [instance: 203b622c-9e6d-4ac7-a3fa-9f9c82ef3108] Attempting to driver detach volume ec6269ad-4a21-4afb-b769-a969d5e3c92f from mountpoint /dev/vdb
Apr 14 10:49:57 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-ecb6645e-2ed4-4501-b83d-e1058a092731 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Attempting to detach device vdb from instance 203b622c-9e6d-4ac7-a3fa-9f9c82ef3108 from the persistent domain config. {{(pid=71509) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 10:49:57 user nova-compute[71509]: DEBUG nova.virt.libvirt.guest [None req-ecb6645e-2ed4-4501-b83d-e1058a092731 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 10:49:57 user nova-compute[71509]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 10:49:57 user nova-compute[71509]:   <source dev="/dev/sdd"/>
Apr 14 10:49:57 user nova-compute[71509]:   <target dev="vdb" bus="virtio"/>
Apr 14 10:49:57 user nova-compute[71509]:   <serial>ec6269ad-4a21-4afb-b769-a969d5e3c92f</serial>
Apr 14 10:49:57 user nova-compute[71509]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 10:49:57 user nova-compute[71509]: </disk>
Apr 14 10:49:57 user nova-compute[71509]:  {{(pid=71509) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 10:49:57 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-ecb6645e-2ed4-4501-b83d-e1058a092731 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Successfully detached device vdb from instance 203b622c-9e6d-4ac7-a3fa-9f9c82ef3108 from the persistent domain config.
Apr 14 10:49:57 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-ecb6645e-2ed4-4501-b83d-e1058a092731 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 203b622c-9e6d-4ac7-a3fa-9f9c82ef3108 from the live domain config. {{(pid=71509) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 10:49:57 user nova-compute[71509]: DEBUG nova.virt.libvirt.guest [None req-ecb6645e-2ed4-4501-b83d-e1058a092731 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 10:49:57 user nova-compute[71509]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 10:49:57 user nova-compute[71509]:   <source dev="/dev/sdd"/>
Apr 14 10:49:57 user nova-compute[71509]:   <target dev="vdb" bus="virtio"/>
Apr 14 10:49:57 user nova-compute[71509]:   <serial>ec6269ad-4a21-4afb-b769-a969d5e3c92f</serial>
Apr 14 10:49:57 user nova-compute[71509]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 10:49:57 user nova-compute[71509]: </disk>
Apr 14 10:49:57 user nova-compute[71509]:  {{(pid=71509) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 10:49:57 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-315486a5-5dc6-4d84-97a7-79ebefc5f2ef tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Acquiring lock "203b622c-9e6d-4ac7-a3fa-9f9c82ef3108" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:49:57 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Received event <DeviceRemovedEvent: 1681469397.990827, 203b622c-9e6d-4ac7-a3fa-9f9c82ef3108 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71509) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 10:49:57 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-ecb6645e-2ed4-4501-b83d-e1058a092731 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 203b622c-9e6d-4ac7-a3fa-9f9c82ef3108 {{(pid=71509) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 10:49:58 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-ecb6645e-2ed4-4501-b83d-e1058a092731 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Successfully detached device vdb from instance 203b622c-9e6d-4ac7-a3fa-9f9c82ef3108 from the live domain config.
Apr 14 10:49:58 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ecb6645e-2ed4-4501-b83d-e1058a092731 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] [instance: 203b622c-9e6d-4ac7-a3fa-9f9c82ef3108] calling os-brick to detach iSCSI Volume {{(pid=71509) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 10:49:58 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecb6645e-2ed4-4501-b83d-e1058a092731 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0bf0749390>, {'target_iqn': 'iqn.2010-10.org.openstack:ec6269ad-4a21-4afb-b769-a969d5e3c92f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qLoetIZK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 10:49:58 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-ecb6645e-2ed4-4501-b83d-e1058a092731 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 10:49:58 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-ecb6645e-2ed4-4501-b83d-e1058a092731 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 10:49:58 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-ecb6645e-2ed4-4501-b83d-e1058a092731 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 10:49:58 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:58 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:49:58 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[3989d8ca-f023-4c71-a9fc-55e98e625c5a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e6828770-fda7-4cd5-b857-c4d2599299a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ec6269ad-4a21-4afb-b769-a969d5e3c92f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:49:58 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecb6645e-2ed4-4501-b83d-e1058a092731 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 10:49:58 user nova-compute[71509]: No targets found.
Apr 14 10:49:58 user nova-compute[71509]: iSNS:
Apr 14 10:49:58 user nova-compute[71509]: No targets found.
Apr 14 10:49:58 user nova-compute[71509]: STATIC:
Apr 14 10:49:58 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:e6828770-fda7-4cd5-b857-c4d2599299a7
Apr 14 10:49:58 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:49:58 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:49:58 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2
Apr 14 10:49:58 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:49:58 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:49:58 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:ec6269ad-4a21-4afb-b769-a969d5e3c92f
Apr 14 10:49:58 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:49:58 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:49:58 user nova-compute[71509]: FIRMWARE:
Apr 14 10:49:58 user nova-compute[71509]: No targets found.
Apr 14 10:49:58 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:49:58 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecb6645e-2ed4-4501-b83d-e1058a092731 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 10:49:58 user nova-compute[71509]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 10:49:58 user nova-compute[71509]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71509) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 10:49:58 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecb6645e-2ed4-4501-b83d-e1058a092731 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ec6269ad-4a21-4afb-b769-a969d5e3c92f', 0)] {{(pid=71509) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 10:49:58 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:58 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:49:58 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[b24ee64d-52c4-4cbc-a9f8-0cea67400464]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6828770-fda7-4cd5-b857-c4d2599299a7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ec6269ad-4a21-4afb-b769-a969d5e3c92f\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:49:58 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:58 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:49:58 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c263c91-9ce6-414e-88f2-2d6365f3a09c]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec6269ad-4a21-4afb-b769-a969d5e3c92f (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6828770-fda7-4cd5-b857-c4d2599299a7 (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:49:58 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecb6645e-2ed4-4501-b83d-e1058a092731 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2 (non-flash)
Apr 14 10:49:58 user nova-compute[71509]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec6269ad-4a21-4afb-b769-a969d5e3c92f (non-flash)
Apr 14 10:49:58 user nova-compute[71509]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6828770-fda7-4cd5-b857-c4d2599299a7 (non-flash)
Apr 14 10:49:58 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:49:58 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecb6645e-2ed4-4501-b83d-e1058a092731 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2 (non-flash)
Apr 14 10:49:58 user nova-compute[71509]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ec6269ad-4a21-4afb-b769-a969d5e3c92f (non-flash)
Apr 14 10:49:58 user nova-compute[71509]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6828770-fda7-4cd5-b857-c4d2599299a7 (non-flash)
Apr 14 10:49:58 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 10:49:58 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecb6645e-2ed4-4501-b83d-e1058a092731 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0c367c7520>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ec6269ad-4a21-4afb-b769-a969d5e3c92f'): ({'sdd'}, set())}) {{(pid=71509) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 10:49:58 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-ecb6645e-2ed4-4501-b83d-e1058a092731 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Removing single pathed devices sdd {{(pid=71509) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 10:49:58 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:58 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:49:58 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[aef10e93-90cf-409a-a5b6-6ccca85b3246]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:49:58 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:58 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:49:58 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfef9c5f-77c2-43db-a838-bd8eca568bc6]: (4, ('ok\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:49:58 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-ecb6645e-2ed4-4501-b83d-e1058a092731 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Flushing IO for device /dev/sdd {{(pid=71509) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 10:49:58 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:58 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:49:58 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[018856f6-bb4e-4032-b55e-4e6ec2797f67]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:49:58 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-ecb6645e-2ed4-4501-b83d-e1058a092731 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71509) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 10:49:58 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:58 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.054s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:49:58 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[a698503d-f622-43bd-95d6-63e4f1847eea]: (4, ('1', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:49:58 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-ecb6645e-2ed4-4501-b83d-e1058a092731 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71509) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 10:49:58 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-ecb6645e-2ed4-4501-b83d-e1058a092731 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] SCSI volumes sdd have been removed. {{(pid=71509) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 10:49:58 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecb6645e-2ed4-4501-b83d-e1058a092731 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ec6269ad-4a21-4afb-b769-a969d5e3c92f')] {{(pid=71509) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 10:49:58 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec6269ad-4a21-4afb-b769-a969d5e3c92f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:58 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec6269ad-4a21-4afb-b769-a969d5e3c92f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:49:58 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe8212be-3048-44e8-a5de-3d2ce3d2774c]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:49:58 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecb6645e-2ed4-4501-b83d-e1058a092731 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:49:58 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec6269ad-4a21-4afb-b769-a969d5e3c92f -p 172.16.0.220:3260 --logout {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:58 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec6269ad-4a21-4afb-b769-a969d5e3c92f -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:49:58 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfa989ae-3bb1-42b2-8926-e2f37eb23424]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:ec6269ad-4a21-4afb-b769-a969d5e3c92f, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:ec6269ad-4a21-4afb-b769-a969d5e3c92f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:49:58 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecb6645e-2ed4-4501-b83d-e1058a092731 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:ec6269ad-4a21-4afb-b769-a969d5e3c92f, portal: 172.16.0.220,3260]
Apr 14 10:49:58 user nova-compute[71509]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:ec6269ad-4a21-4afb-b769-a969d5e3c92f, portal: 172.16.0.220,3260] successful.
Apr 14 10:49:58 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:49:58 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ec6269ad-4a21-4afb-b769-a969d5e3c92f -p 172.16.0.220:3260 --op delete {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:49:58 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ec6269ad-4a21-4afb-b769-a969d5e3c92f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:49:58 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[46d7f867-b483-48e3-9a60-148bc9644ed1]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:49:58 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecb6645e-2ed4-4501-b83d-e1058a092731 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:49:58 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-ecb6645e-2ed4-4501-b83d-e1058a092731 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 10:49:58 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecb6645e-2ed4-4501-b83d-e1058a092731 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] <== disconnect_volume: return (321ms) None {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 10:49:58 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ecb6645e-2ed4-4501-b83d-e1058a092731 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] [instance: 203b622c-9e6d-4ac7-a3fa-9f9c82ef3108] Disconnected iSCSI Volume {{(pid=71509) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 10:49:58 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:49:58 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:49:58 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:49:58 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:49:59 user nova-compute[71509]: DEBUG nova.compute.manager [req-f1d96268-7f98-4eae-b2c7-c1c1d794a30a req-071cd083-f4f3-44d8-8364-debb1b622005 service nova] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Received event network-vif-plugged-8d8a356d-c198-4e13-a489-5c626fbd025c {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:49:59 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-f1d96268-7f98-4eae-b2c7-c1c1d794a30a req-071cd083-f4f3-44d8-8364-debb1b622005 service nova] Acquiring lock "4b767f1b-e97e-497c-8c70-8806203c76ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:49:59 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-f1d96268-7f98-4eae-b2c7-c1c1d794a30a req-071cd083-f4f3-44d8-8364-debb1b622005 service nova] Lock "4b767f1b-e97e-497c-8c70-8806203c76ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:49:59 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-f1d96268-7f98-4eae-b2c7-c1c1d794a30a req-071cd083-f4f3-44d8-8364-debb1b622005 service nova] Lock "4b767f1b-e97e-497c-8c70-8806203c76ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:49:59 user nova-compute[71509]: DEBUG nova.compute.manager [req-f1d96268-7f98-4eae-b2c7-c1c1d794a30a req-071cd083-f4f3-44d8-8364-debb1b622005 service nova] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] No waiting events found dispatching network-vif-plugged-8d8a356d-c198-4e13-a489-5c626fbd025c {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:49:59 user nova-compute[71509]: WARNING nova.compute.manager [req-f1d96268-7f98-4eae-b2c7-c1c1d794a30a req-071cd083-f4f3-44d8-8364-debb1b622005 service nova] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Received unexpected event network-vif-plugged-8d8a356d-c198-4e13-a489-5c626fbd025c for instance with vm_state shelved_offloaded and task_state spawning.
Apr 14 10:49:59 user nova-compute[71509]: DEBUG nova.objects.instance [None req-ecb6645e-2ed4-4501-b83d-e1058a092731 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Lazy-loading 'flavor' on Instance uuid 203b622c-9e6d-4ac7-a3fa-9f9c82ef3108 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:49:59 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-ecb6645e-2ed4-4501-b83d-e1058a092731 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Lock "203b622c-9e6d-4ac7-a3fa-9f9c82ef3108" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.249s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:49:59 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-315486a5-5dc6-4d84-97a7-79ebefc5f2ef tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Lock "203b622c-9e6d-4ac7-a3fa-9f9c82ef3108" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 2.129s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:49:59 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-315486a5-5dc6-4d84-97a7-79ebefc5f2ef tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Acquiring lock "203b622c-9e6d-4ac7-a3fa-9f9c82ef3108-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:49:59 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-315486a5-5dc6-4d84-97a7-79ebefc5f2ef tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Lock "203b622c-9e6d-4ac7-a3fa-9f9c82ef3108-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:49:59 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-315486a5-5dc6-4d84-97a7-79ebefc5f2ef tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Lock "203b622c-9e6d-4ac7-a3fa-9f9c82ef3108-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:49:59 user nova-compute[71509]: INFO nova.compute.manager [None req-315486a5-5dc6-4d84-97a7-79ebefc5f2ef tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] [instance: 203b622c-9e6d-4ac7-a3fa-9f9c82ef3108] Terminating instance
Apr 14 10:49:59 user nova-compute[71509]: DEBUG nova.compute.manager [None req-315486a5-5dc6-4d84-97a7-79ebefc5f2ef tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] [instance: 203b622c-9e6d-4ac7-a3fa-9f9c82ef3108] Start destroying the instance on the hypervisor. {{(pid=71509) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 10:49:59 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:49:59 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:49:59 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:49:59 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:49:59 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:49:59 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:49:59 user nova-compute[71509]: DEBUG nova.compute.manager [req-9fb92039-e123-4ac7-8f99-3eafe49a89a7 req-47b4fe2d-f494-4bbc-9f9c-5bfa7a3dff5a service nova] [instance: 203b622c-9e6d-4ac7-a3fa-9f9c82ef3108] Received event network-vif-unplugged-01a9c136-4a03-464b-bc37-e95ab62f6f1a {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:49:59 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-9fb92039-e123-4ac7-8f99-3eafe49a89a7 req-47b4fe2d-f494-4bbc-9f9c-5bfa7a3dff5a service nova] Acquiring lock "203b622c-9e6d-4ac7-a3fa-9f9c82ef3108-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:49:59 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-9fb92039-e123-4ac7-8f99-3eafe49a89a7 req-47b4fe2d-f494-4bbc-9f9c-5bfa7a3dff5a service nova] Lock "203b622c-9e6d-4ac7-a3fa-9f9c82ef3108-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:49:59 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-9fb92039-e123-4ac7-8f99-3eafe49a89a7 req-47b4fe2d-f494-4bbc-9f9c-5bfa7a3dff5a service nova] Lock "203b622c-9e6d-4ac7-a3fa-9f9c82ef3108-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:49:59 user nova-compute[71509]: DEBUG nova.compute.manager [req-9fb92039-e123-4ac7-8f99-3eafe49a89a7 req-47b4fe2d-f494-4bbc-9f9c-5bfa7a3dff5a service nova] [instance: 203b622c-9e6d-4ac7-a3fa-9f9c82ef3108] No waiting events found dispatching network-vif-unplugged-01a9c136-4a03-464b-bc37-e95ab62f6f1a {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:49:59 user nova-compute[71509]: DEBUG nova.compute.manager [req-9fb92039-e123-4ac7-8f99-3eafe49a89a7 req-47b4fe2d-f494-4bbc-9f9c-5bfa7a3dff5a service nova] [instance: 203b622c-9e6d-4ac7-a3fa-9f9c82ef3108] Received event network-vif-unplugged-01a9c136-4a03-464b-bc37-e95ab62f6f1a for instance with task_state deleting. {{(pid=71509) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 10:50:00 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: 203b622c-9e6d-4ac7-a3fa-9f9c82ef3108] Instance destroyed successfully.
Apr 14 10:50:00 user nova-compute[71509]: DEBUG nova.objects.instance [None req-315486a5-5dc6-4d84-97a7-79ebefc5f2ef tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Lazy-loading 'resources' on Instance uuid 203b622c-9e6d-4ac7-a3fa-9f9c82ef3108 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:50:00 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-315486a5-5dc6-4d84-97a7-79ebefc5f2ef tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T10:47:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-942407433',display_name='tempest-VolumesSnapshotTestJSON-instance-942407433',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-942407433',id=17,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T10:47:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a84a2fac4604454982dc018b36440b00',ramdisk_id='',reservation_id='r-q2b52nme',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-685456681',owner_user_name='tempest-VolumesSnapshotTestJSON-685456681-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T10:47:50Z,user_data=None,user_id='ac498c56dae543cf9e64fbb61ad50df3',uuid=203b622c-9e6d-4ac7-a3fa-9f9c82ef3108,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "01a9c136-4a03-464b-bc37-e95ab62f6f1a", "address": "fa:16:3e:a8:8f:1c", "network": {"id": "4efde76c-8493-4902-a655-f10faee002a4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1588457316-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "a84a2fac4604454982dc018b36440b00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01a9c136-4a", "ovs_interfaceid": "01a9c136-4a03-464b-bc37-e95ab62f6f1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 10:50:00 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-315486a5-5dc6-4d84-97a7-79ebefc5f2ef tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Converting VIF {"id": "01a9c136-4a03-464b-bc37-e95ab62f6f1a", "address": "fa:16:3e:a8:8f:1c", "network": {"id": "4efde76c-8493-4902-a655-f10faee002a4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1588457316-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "a84a2fac4604454982dc018b36440b00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01a9c136-4a", "ovs_interfaceid": "01a9c136-4a03-464b-bc37-e95ab62f6f1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:50:00 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-315486a5-5dc6-4d84-97a7-79ebefc5f2ef tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:8f:1c,bridge_name='br-int',has_traffic_filtering=True,id=01a9c136-4a03-464b-bc37-e95ab62f6f1a,network=Network(4efde76c-8493-4902-a655-f10faee002a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01a9c136-4a') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:50:00 user nova-compute[71509]: DEBUG os_vif [None req-315486a5-5dc6-4d84-97a7-79ebefc5f2ef tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:8f:1c,bridge_name='br-int',has_traffic_filtering=True,id=01a9c136-4a03-464b-bc37-e95ab62f6f1a,network=Network(4efde76c-8493-4902-a655-f10faee002a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01a9c136-4a') {{(pid=71509) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 10:50:00 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:50:00 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap01a9c136-4a, bridge=br-int, if_exists=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:50:00 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:50:00 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 10:50:00 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:50:00 user nova-compute[71509]: INFO os_vif [None req-315486a5-5dc6-4d84-97a7-79ebefc5f2ef tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:8f:1c,bridge_name='br-int',has_traffic_filtering=True,id=01a9c136-4a03-464b-bc37-e95ab62f6f1a,network=Network(4efde76c-8493-4902-a655-f10faee002a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01a9c136-4a')
Apr 14 10:50:00 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-315486a5-5dc6-4d84-97a7-79ebefc5f2ef tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] [instance: 203b622c-9e6d-4ac7-a3fa-9f9c82ef3108] calling os-brick to detach iSCSI Volume {{(pid=71509) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 10:50:00 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-315486a5-5dc6-4d84-97a7-79ebefc5f2ef tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0bf0749390>, {'target_iqn': 'iqn.2010-10.org.openstack:ec6269ad-4a21-4afb-b769-a969d5e3c92f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qLoetIZK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 10:50:00 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-315486a5-5dc6-4d84-97a7-79ebefc5f2ef tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 10:50:00 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-315486a5-5dc6-4d84-97a7-79ebefc5f2ef tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 10:50:00 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-315486a5-5dc6-4d84-97a7-79ebefc5f2ef tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 10:50:00 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:50:00 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:50:00 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8af7ba6-4721-46b1-a56f-00351d563a1c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e6828770-fda7-4cd5-b857-c4d2599299a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:50:00 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-315486a5-5dc6-4d84-97a7-79ebefc5f2ef tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 10:50:00 user nova-compute[71509]: No targets found.
Apr 14 10:50:00 user nova-compute[71509]: iSNS:
Apr 14 10:50:00 user nova-compute[71509]: No targets found.
Apr 14 10:50:00 user nova-compute[71509]: STATIC:
Apr 14 10:50:00 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:e6828770-fda7-4cd5-b857-c4d2599299a7
Apr 14 10:50:00 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:50:00 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:50:00 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2
Apr 14 10:50:00 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:50:00 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:50:00 user nova-compute[71509]: FIRMWARE:
Apr 14 10:50:00 user nova-compute[71509]: No targets found.
Apr 14 10:50:00 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:50:00 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-315486a5-5dc6-4d84-97a7-79ebefc5f2ef tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 10:50:00 user nova-compute[71509]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 10:50:00 user nova-compute[71509]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71509) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 10:50:00 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-315486a5-5dc6-4d84-97a7-79ebefc5f2ef tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ec6269ad-4a21-4afb-b769-a969d5e3c92f', 0)] {{(pid=71509) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 10:50:00 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:50:00 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:50:00 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb87efd6-1eba-4236-af79-f59fff5badba]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6828770-fda7-4cd5-b857-c4d2599299a7\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:50:00 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:50:00 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:50:00 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[e68e8561-a63d-4ca7-b033-07bcf839dbb1]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6828770-fda7-4cd5-b857-c4d2599299a7 (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:50:00 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-315486a5-5dc6-4d84-97a7-79ebefc5f2ef tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2 (non-flash)
Apr 14 10:50:00 user nova-compute[71509]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6828770-fda7-4cd5-b857-c4d2599299a7 (non-flash)
Apr 14 10:50:00 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:50:00 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-315486a5-5dc6-4d84-97a7-79ebefc5f2ef tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2 (non-flash)
Apr 14 10:50:00 user nova-compute[71509]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6828770-fda7-4cd5-b857-c4d2599299a7 (non-flash)
Apr 14 10:50:00 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 10:50:00 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-315486a5-5dc6-4d84-97a7-79ebefc5f2ef tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0c3a716d40>, {}) {{(pid=71509) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 10:50:00 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-315486a5-5dc6-4d84-97a7-79ebefc5f2ef tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Disconnecting from: [] {{(pid=71509) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 10:50:00 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-315486a5-5dc6-4d84-97a7-79ebefc5f2ef tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.085s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 10:50:00 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-315486a5-5dc6-4d84-97a7-79ebefc5f2ef tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] <== disconnect_volume: return (87ms) None {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 10:50:00 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-315486a5-5dc6-4d84-97a7-79ebefc5f2ef tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] [instance: 203b622c-9e6d-4ac7-a3fa-9f9c82ef3108] Disconnected iSCSI Volume {{(pid=71509) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 10:50:00 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-315486a5-5dc6-4d84-97a7-79ebefc5f2ef tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] [instance: 203b622c-9e6d-4ac7-a3fa-9f9c82ef3108] Deleting instance files /opt/stack/data/nova/instances/203b622c-9e6d-4ac7-a3fa-9f9c82ef3108_del
Apr 14 10:50:00 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-315486a5-5dc6-4d84-97a7-79ebefc5f2ef tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] [instance: 203b622c-9e6d-4ac7-a3fa-9f9c82ef3108] Deletion of /opt/stack/data/nova/instances/203b622c-9e6d-4ac7-a3fa-9f9c82ef3108_del complete
Apr 14 10:50:00 user nova-compute[71509]: INFO nova.compute.manager [None req-315486a5-5dc6-4d84-97a7-79ebefc5f2ef tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] [instance: 203b622c-9e6d-4ac7-a3fa-9f9c82ef3108] Took 0.96 seconds to destroy the instance on the hypervisor.
Apr 14 10:50:00 user nova-compute[71509]: DEBUG oslo.service.loopingcall [None req-315486a5-5dc6-4d84-97a7-79ebefc5f2ef tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71509) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 10:50:00 user nova-compute[71509]: DEBUG nova.compute.manager [-] [instance: 203b622c-9e6d-4ac7-a3fa-9f9c82ef3108] Deallocating network for instance {{(pid=71509) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 10:50:00 user nova-compute[71509]: DEBUG nova.network.neutron [-] [instance: 203b622c-9e6d-4ac7-a3fa-9f9c82ef3108] deallocate_for_instance() {{(pid=71509) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 10:50:00 user nova-compute[71509]: DEBUG nova.network.neutron [-] [instance: 203b622c-9e6d-4ac7-a3fa-9f9c82ef3108] Updating instance_info_cache with network_info: [] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:50:00 user nova-compute[71509]: INFO nova.compute.manager [-] [instance: 203b622c-9e6d-4ac7-a3fa-9f9c82ef3108] Took 0.56 seconds to deallocate network for instance.
Apr 14 10:50:00 user nova-compute[71509]: DEBUG nova.compute.manager [req-63f08869-db84-407f-81fe-cdeae3fbd2c3 req-8b01a20f-f377-49fe-9cfd-0d9d2957f41d service nova] [instance: 203b622c-9e6d-4ac7-a3fa-9f9c82ef3108] Received event network-vif-deleted-01a9c136-4a03-464b-bc37-e95ab62f6f1a {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:50:00 user nova-compute[71509]: WARNING nova.volume.cinder [None req-315486a5-5dc6-4d84-97a7-79ebefc5f2ef tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Attachment 4a3cf159-b790-40d4-9ed0-6cab5df86308 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 4a3cf159-b790-40d4-9ed0-6cab5df86308. (HTTP 404) (Request-ID: req-45bd4f29-4723-483e-a902-a1f3363eada5)
Apr 14 10:50:00 user nova-compute[71509]: INFO nova.compute.manager [None req-315486a5-5dc6-4d84-97a7-79ebefc5f2ef tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] [instance: 203b622c-9e6d-4ac7-a3fa-9f9c82ef3108] Took 0.03 seconds to detach 1 volumes for instance.
Apr 14 10:50:01 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-315486a5-5dc6-4d84-97a7-79ebefc5f2ef tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:50:01 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-315486a5-5dc6-4d84-97a7-79ebefc5f2ef tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:50:01 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681469401.0800242, 4b767f1b-e97e-497c-8c70-8806203c76ae => Resumed> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 10:50:01 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] VM Resumed (Lifecycle Event)
Apr 14 10:50:01 user nova-compute[71509]: DEBUG nova.compute.manager [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Instance event wait completed in 0 seconds for  {{(pid=71509) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 10:50:01 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Guest created on hypervisor {{(pid=71509) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 10:50:01 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Instance spawned successfully.
Apr 14 10:50:01 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:50:01 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 10:50:01 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 10:50:01 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681469401.082749, 4b767f1b-e97e-497c-8c70-8806203c76ae => Started> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 10:50:01 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] VM Started (Lifecycle Event)
Apr 14 10:50:01 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:50:01 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 10:50:01 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 10:50:01 user nova-compute[71509]: DEBUG nova.compute.manager [req-04bb5fe3-2315-447c-b91f-27ad1c1bc42f req-a66e377a-6cdd-437a-8208-e7b137dc41a9 service nova] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Received event network-vif-plugged-8d8a356d-c198-4e13-a489-5c626fbd025c {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:50:01 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-04bb5fe3-2315-447c-b91f-27ad1c1bc42f req-a66e377a-6cdd-437a-8208-e7b137dc41a9 service nova] Acquiring lock "4b767f1b-e97e-497c-8c70-8806203c76ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:50:01 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-04bb5fe3-2315-447c-b91f-27ad1c1bc42f req-a66e377a-6cdd-437a-8208-e7b137dc41a9 service nova] Lock "4b767f1b-e97e-497c-8c70-8806203c76ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:50:01 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-04bb5fe3-2315-447c-b91f-27ad1c1bc42f req-a66e377a-6cdd-437a-8208-e7b137dc41a9 service nova] Lock "4b767f1b-e97e-497c-8c70-8806203c76ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:50:01 user nova-compute[71509]: DEBUG nova.compute.manager [req-04bb5fe3-2315-447c-b91f-27ad1c1bc42f req-a66e377a-6cdd-437a-8208-e7b137dc41a9 service nova] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] No waiting events found dispatching network-vif-plugged-8d8a356d-c198-4e13-a489-5c626fbd025c {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:50:01 user nova-compute[71509]: WARNING nova.compute.manager [req-04bb5fe3-2315-447c-b91f-27ad1c1bc42f req-a66e377a-6cdd-437a-8208-e7b137dc41a9 service nova] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Received unexpected event network-vif-plugged-8d8a356d-c198-4e13-a489-5c626fbd025c for instance with vm_state shelved_offloaded and task_state spawning.
Apr 14 10:50:01 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-315486a5-5dc6-4d84-97a7-79ebefc5f2ef tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 10:50:01 user nova-compute[71509]: DEBUG nova.compute.manager [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:50:01 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-315486a5-5dc6-4d84-97a7-79ebefc5f2ef tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 10:50:01 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-315486a5-5dc6-4d84-97a7-79ebefc5f2ef tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.362s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:50:01 user nova-compute[71509]: INFO nova.scheduler.client.report [None req-315486a5-5dc6-4d84-97a7-79ebefc5f2ef tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Deleted allocations for instance 203b622c-9e6d-4ac7-a3fa-9f9c82ef3108
Apr 14 10:50:01 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-fd70279f-edd4-49f1-9750-03b6e9d5a5cb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "4b767f1b-e97e-497c-8c70-8806203c76ae" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 17.096s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:50:01 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-315486a5-5dc6-4d84-97a7-79ebefc5f2ef tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Lock "203b622c-9e6d-4ac7-a3fa-9f9c82ef3108" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.098s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:50:01 user nova-compute[71509]: DEBUG nova.compute.manager [req-af96be9f-8d76-48d5-b201-34f868e78bdc req-110cbb01-98ec-4b98-9538-d64925c5ebfc service nova] [instance: 203b622c-9e6d-4ac7-a3fa-9f9c82ef3108] Received event network-vif-plugged-01a9c136-4a03-464b-bc37-e95ab62f6f1a {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:50:01 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-af96be9f-8d76-48d5-b201-34f868e78bdc req-110cbb01-98ec-4b98-9538-d64925c5ebfc service nova] Acquiring lock "203b622c-9e6d-4ac7-a3fa-9f9c82ef3108-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:50:01 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-af96be9f-8d76-48d5-b201-34f868e78bdc req-110cbb01-98ec-4b98-9538-d64925c5ebfc service nova] Lock "203b622c-9e6d-4ac7-a3fa-9f9c82ef3108-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:50:01 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-af96be9f-8d76-48d5-b201-34f868e78bdc req-110cbb01-98ec-4b98-9538-d64925c5ebfc service nova] Lock "203b622c-9e6d-4ac7-a3fa-9f9c82ef3108-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:50:01 user nova-compute[71509]: DEBUG nova.compute.manager [req-af96be9f-8d76-48d5-b201-34f868e78bdc req-110cbb01-98ec-4b98-9538-d64925c5ebfc service nova] [instance: 203b622c-9e6d-4ac7-a3fa-9f9c82ef3108] No waiting events found dispatching network-vif-plugged-01a9c136-4a03-464b-bc37-e95ab62f6f1a {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:50:01 user nova-compute[71509]: WARNING nova.compute.manager [req-af96be9f-8d76-48d5-b201-34f868e78bdc req-110cbb01-98ec-4b98-9538-d64925c5ebfc service nova] [instance: 203b622c-9e6d-4ac7-a3fa-9f9c82ef3108] Received unexpected event network-vif-plugged-01a9c136-4a03-464b-bc37-e95ab62f6f1a for instance with vm_state deleted and task_state None.
Apr 14 10:50:02 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:50:03 user nova-compute[71509]: DEBUG nova.compute.manager [req-4e6d127b-aa69-4a29-adec-375628fd527a req-333cd5b6-fdbb-47d0-bc8f-497d2130774d service nova] [instance: f3245b74-dbe8-4b8b-83b6-58a4811fdba9] Received event network-changed-9abeb28a-35f1-4e16-a152-ed2578e8a678 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:50:03 user nova-compute[71509]: DEBUG nova.compute.manager [req-4e6d127b-aa69-4a29-adec-375628fd527a req-333cd5b6-fdbb-47d0-bc8f-497d2130774d service nova] [instance: f3245b74-dbe8-4b8b-83b6-58a4811fdba9] Refreshing instance network info cache due to event network-changed-9abeb28a-35f1-4e16-a152-ed2578e8a678. {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 10:50:03 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-4e6d127b-aa69-4a29-adec-375628fd527a req-333cd5b6-fdbb-47d0-bc8f-497d2130774d service nova] Acquiring lock "refresh_cache-f3245b74-dbe8-4b8b-83b6-58a4811fdba9" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:50:03 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-4e6d127b-aa69-4a29-adec-375628fd527a req-333cd5b6-fdbb-47d0-bc8f-497d2130774d service nova] Acquired lock "refresh_cache-f3245b74-dbe8-4b8b-83b6-58a4811fdba9" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:50:03 user nova-compute[71509]: DEBUG nova.network.neutron [req-4e6d127b-aa69-4a29-adec-375628fd527a req-333cd5b6-fdbb-47d0-bc8f-497d2130774d service nova] [instance: f3245b74-dbe8-4b8b-83b6-58a4811fdba9] Refreshing network info cache for port 9abeb28a-35f1-4e16-a152-ed2578e8a678 {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 10:50:03 user nova-compute[71509]: DEBUG nova.network.neutron [req-4e6d127b-aa69-4a29-adec-375628fd527a req-333cd5b6-fdbb-47d0-bc8f-497d2130774d service nova] [instance: f3245b74-dbe8-4b8b-83b6-58a4811fdba9] Updated VIF entry in instance network info cache for port 9abeb28a-35f1-4e16-a152-ed2578e8a678. {{(pid=71509) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 10:50:03 user nova-compute[71509]: DEBUG nova.network.neutron [req-4e6d127b-aa69-4a29-adec-375628fd527a req-333cd5b6-fdbb-47d0-bc8f-497d2130774d service nova] [instance: f3245b74-dbe8-4b8b-83b6-58a4811fdba9] Updating instance_info_cache with network_info: [{"id": "9abeb28a-35f1-4e16-a152-ed2578e8a678", "address": "fa:16:3e:54:9b:f3", "network": {"id": "36ccc911-348d-426a-ba7b-a49a0bfb0f97", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-256080753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aca26975e5ad4524b4b1b1ec4335802f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9abeb28a-35", "ovs_interfaceid": "9abeb28a-35f1-4e16-a152-ed2578e8a678", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:50:03 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-4e6d127b-aa69-4a29-adec-375628fd527a req-333cd5b6-fdbb-47d0-bc8f-497d2130774d service nova] Releasing lock "refresh_cache-f3245b74-dbe8-4b8b-83b6-58a4811fdba9" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:50:05 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:50:06 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-e52a58fc-4693-495e-a691-65af5850e08c tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Acquiring lock "f3245b74-dbe8-4b8b-83b6-58a4811fdba9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:50:06 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-e52a58fc-4693-495e-a691-65af5850e08c tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Lock "f3245b74-dbe8-4b8b-83b6-58a4811fdba9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:50:06 user nova-compute[71509]: DEBUG nova.objects.instance [None req-e52a58fc-4693-495e-a691-65af5850e08c tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Lazy-loading 'flavor' on Instance uuid f3245b74-dbe8-4b8b-83b6-58a4811fdba9 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:50:06 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-e52a58fc-4693-495e-a691-65af5850e08c tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Lock "f3245b74-dbe8-4b8b-83b6-58a4811fdba9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:50:06 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-e52a58fc-4693-495e-a691-65af5850e08c tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Acquiring lock "f3245b74-dbe8-4b8b-83b6-58a4811fdba9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:50:06 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-e52a58fc-4693-495e-a691-65af5850e08c tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Lock "f3245b74-dbe8-4b8b-83b6-58a4811fdba9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:50:06 user nova-compute[71509]: INFO nova.compute.manager [None req-e52a58fc-4693-495e-a691-65af5850e08c tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] [instance: f3245b74-dbe8-4b8b-83b6-58a4811fdba9] Attaching volume 3d9a98d6-ea02-4e9e-8af7-d744d734e3e9 to /dev/vdb
Apr 14 10:50:06 user nova-compute[71509]: DEBUG os_brick.utils [None req-e52a58fc-4693-495e-a691-65af5850e08c tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 10:50:06 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:50:06 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:50:06 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeeb207b-de1a-4cc2-9c66-91042832dee1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50119df3c417\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:50:06 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:50:06 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:50:06 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f65450a-7f0f-4b71-8c7b-93fb86bd8ab7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:50:06 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:50:06 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.034s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:50:06 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fe095c6-040c-49aa-a815-60d5fc11584c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:50:06 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b84db2a-3645-4661-8719-60d4655c2c96]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:50:06 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-e52a58fc-4693-495e-a691-65af5850e08c tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Running cmd (subprocess): nvme version {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:50:06 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-e52a58fc-4693-495e-a691-65af5850e08c tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] 'nvme version' failed. Not Retrying. {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 10:50:06 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e52a58fc-4693-495e-a691-65af5850e08c tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] nvme not present on system {{(pid=71509) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 10:50:06 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:50:06 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 10:50:06 user nova-compute[71509]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 10:50:06 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[63048af3-686c-4d7e-8a99-271ab85e48f3]: (4, '') {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:50:06 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-e52a58fc-4693-495e-a691-65af5850e08c tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71509) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 10:50:06 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-e52a58fc-4693-495e-a691-65af5850e08c tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71509) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 10:50:06 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-e52a58fc-4693-495e-a691-65af5850e08c tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] LIGHTOS: no hostnqn found. {{(pid=71509) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 10:50:06 user nova-compute[71509]: DEBUG os_brick.utils [None req-e52a58fc-4693-495e-a691-65af5850e08c tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50119df3c417', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 10:50:06 user nova-compute[71509]: DEBUG nova.virt.block_device [None req-e52a58fc-4693-495e-a691-65af5850e08c tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] [instance: f3245b74-dbe8-4b8b-83b6-58a4811fdba9] Updating existing volume attachment record: c0bd7df1-e6fa-4474-b03a-09b56669cf70 {{(pid=71509) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 10:50:07 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:50:10 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:50:10 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e52a58fc-4693-495e-a691-65af5850e08c tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] [instance: f3245b74-dbe8-4b8b-83b6-58a4811fdba9] Calling os-brick to attach iSCSI Volume {{(pid=71509) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 10:50:10 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-e52a58fc-4693-495e-a691-65af5850e08c tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0bf0749390>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3d9a98d6-ea02-4e9e-8af7-d744d734e3e9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mHziNKMS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 10:50:10 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-e52a58fc-4693-495e-a691-65af5850e08c tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 10:50:10 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-e52a58fc-4693-495e-a691-65af5850e08c tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 10:50:10 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-e52a58fc-4693-495e-a691-65af5850e08c tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 10:50:10 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-e52a58fc-4693-495e-a691-65af5850e08c tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 10:50:10 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-e52a58fc-4693-495e-a691-65af5850e08c tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d9a98d6-ea02-4e9e-8af7-d744d734e3e9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 10:50:10 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-e52a58fc-4693-495e-a691-65af5850e08c tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d9a98d6-ea02-4e9e-8af7-d744d734e3e9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 10:50:10 user nova-compute[71509]: INFO os_brick.initiator.connectors.iscsi [None req-e52a58fc-4693-495e-a691-65af5850e08c tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 10:50:10 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d9a98d6-ea02-4e9e-8af7-d744d734e3e9 -p 172.16.0.220:3260 {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:50:10 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d9a98d6-ea02-4e9e-8af7-d744d734e3e9 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:50:10 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa7d3267-38e2-461f-a224-e0e972e3c6bb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:50:10 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-e52a58fc-4693-495e-a691-65af5850e08c tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 10:50:10 user nova-compute[71509]:  {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:50:10 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d9a98d6-ea02-4e9e-8af7-d744d734e3e9 -p 172.16.0.220:3260 --interface default --op new {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:50:11 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d9a98d6-ea02-4e9e-8af7-d744d734e3e9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:50:11 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[35564989-a6e0-4788-8b5f-6b06302f9a47]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3d9a98d6-ea02-4e9e-8af7-d744d734e3e9] added\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:50:11 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-e52a58fc-4693-495e-a691-65af5850e08c tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3d9a98d6-ea02-4e9e-8af7-d744d734e3e9] added
Apr 14 10:50:11 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:50:11 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d9a98d6-ea02-4e9e-8af7-d744d734e3e9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:50:11 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d9a98d6-ea02-4e9e-8af7-d744d734e3e9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:50:11 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[46ea1e3b-5082-478a-92e1-76f618eda045]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:50:11 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-e52a58fc-4693-495e-a691-65af5850e08c tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:50:11 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d9a98d6-ea02-4e9e-8af7-d744d734e3e9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:50:11 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d9a98d6-ea02-4e9e-8af7-d744d734e3e9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:50:11 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[827154a1-cb84-4e01-8b7d-d0d15708ec2b]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:50:11 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-e52a58fc-4693-495e-a691-65af5850e08c tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:50:11 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d9a98d6-ea02-4e9e-8af7-d744d734e3e9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mHziNKMS {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:50:11 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d9a98d6-ea02-4e9e-8af7-d744d734e3e9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mHziNKMS" returned: 0 in 0.021s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:50:11 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[49d173c8-1088-4f76-adce-b02e12abc149]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:50:11 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-e52a58fc-4693-495e-a691-65af5850e08c tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mHziNKMS'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:50:11 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d9a98d6-ea02-4e9e-8af7-d744d734e3e9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:50:11 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d9a98d6-ea02-4e9e-8af7-d744d734e3e9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:50:11 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c8f3671-2ec9-498a-bfa0-e05298ba8049]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:50:11 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-e52a58fc-4693-495e-a691-65af5850e08c tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:50:11 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:50:11 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:50:11 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[52b60f72-4449-4629-a18d-63718bbca41c]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6828770-fda7-4cd5-b857-c4d2599299a7 (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:50:11 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-e52a58fc-4693-495e-a691-65af5850e08c tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2 (non-flash)
Apr 14 10:50:11 user nova-compute[71509]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6828770-fda7-4cd5-b857-c4d2599299a7 (non-flash)
Apr 14 10:50:11 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:50:11 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-e52a58fc-4693-495e-a691-65af5850e08c tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2 (non-flash)
Apr 14 10:50:11 user nova-compute[71509]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6828770-fda7-4cd5-b857-c4d2599299a7 (non-flash)
Apr 14 10:50:11 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 10:50:11 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d9a98d6-ea02-4e9e-8af7-d744d734e3e9 -p 172.16.0.220:3260 --login {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:50:11 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d9a98d6-ea02-4e9e-8af7-d744d734e3e9 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:50:11 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dc6da30-b6a2-46e8-a3aa-34c63cbcbec6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3d9a98d6-ea02-4e9e-8af7-d744d734e3e9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3d9a98d6-ea02-4e9e-8af7-d744d734e3e9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:50:11 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-e52a58fc-4693-495e-a691-65af5850e08c tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3d9a98d6-ea02-4e9e-8af7-d744d734e3e9, portal: 172.16.0.220,3260]
Apr 14 10:50:11 user nova-compute[71509]: Login to [iface: default, target: iqn.2010-10.org.openstack:3d9a98d6-ea02-4e9e-8af7-d744d734e3e9, portal: 172.16.0.220,3260] successful.
Apr 14 10:50:11 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:50:11 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d9a98d6-ea02-4e9e-8af7-d744d734e3e9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:50:11 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d9a98d6-ea02-4e9e-8af7-d744d734e3e9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:50:11 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[f586ec0d-9a66-4eca-979c-9ed1387d724c]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:50:11 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-e52a58fc-4693-495e-a691-65af5850e08c tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:50:11 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:50:11 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:50:11 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[a122cdb8-aa5c-410d-8427-047e224b8aee]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6828770-fda7-4cd5-b857-c4d2599299a7 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d9a98d6-ea02-4e9e-8af7-d744d734e3e9 (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:50:11 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-e52a58fc-4693-495e-a691-65af5850e08c tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2 (non-flash)
Apr 14 10:50:11 user nova-compute[71509]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6828770-fda7-4cd5-b857-c4d2599299a7 (non-flash)
Apr 14 10:50:11 user nova-compute[71509]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d9a98d6-ea02-4e9e-8af7-d744d734e3e9 (non-flash)
Apr 14 10:50:11 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:50:11 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-e52a58fc-4693-495e-a691-65af5850e08c tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2 (non-flash)
Apr 14 10:50:11 user nova-compute[71509]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6828770-fda7-4cd5-b857-c4d2599299a7 (non-flash)
Apr 14 10:50:11 user nova-compute[71509]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d9a98d6-ea02-4e9e-8af7-d744d734e3e9 (non-flash)
Apr 14 10:50:11 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 10:50:11 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-e52a58fc-4693-495e-a691-65af5850e08c tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d9a98d6-ea02-4e9e-8af7-d744d734e3e9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.272s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 10:50:11 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-e52a58fc-4693-495e-a691-65af5850e08c tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Connected to 172.16.0.220:3260 {{(pid=71509) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 10:50:11 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-e52a58fc-4693-495e-a691-65af5850e08c tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] HCTL ('35', '-', '-', 0) found on session 26 with lun 0 {{(pid=71509) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 10:50:11 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-e52a58fc-4693-495e-a691-65af5850e08c tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71509) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 10:50:11 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:50:11 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:50:11 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[72bdabb8-aacc-4a19-9700-28f46fc7596f]: (4, ('- - 0', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:50:11 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-e52a58fc-4693-495e-a691-65af5850e08c tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Searching for a device in session 26 and hctl ['35', '*', '*', 0] yield: None {{(pid=71509) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 10:50:12 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-e52a58fc-4693-495e-a691-65af5850e08c tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Searching for a device in session 26 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71509) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 10:50:12 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-e52a58fc-4693-495e-a691-65af5850e08c tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:3d9a98d6-ea02-4e9e-8af7-d744d734e3e9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mHziNKMS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71509) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 10:50:12 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-e52a58fc-4693-495e-a691-65af5850e08c tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.302s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 10:50:12 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-e52a58fc-4693-495e-a691-65af5850e08c tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] <== connect_volume: return (1304ms) {'type': 'block', 'scsi_wwn': '23733376165656336', 'path': '/dev/sdd'} {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 10:50:12 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e52a58fc-4693-495e-a691-65af5850e08c tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] [instance: f3245b74-dbe8-4b8b-83b6-58a4811fdba9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23733376165656336', 'path': '/dev/sdd'} {{(pid=71509) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 10:50:12 user nova-compute[71509]: DEBUG nova.objects.instance [None req-e52a58fc-4693-495e-a691-65af5850e08c tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Lazy-loading 'flavor' on Instance uuid f3245b74-dbe8-4b8b-83b6-58a4811fdba9 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:50:12 user nova-compute[71509]: DEBUG nova.virt.libvirt.guest [None req-e52a58fc-4693-495e-a691-65af5850e08c tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 10:50:12 user nova-compute[71509]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 10:50:12 user nova-compute[71509]:   <source dev="/dev/sdd"/>
Apr 14 10:50:12 user nova-compute[71509]:   <target dev="vdb" bus="virtio"/>
Apr 14 10:50:12 user nova-compute[71509]:   <serial>3d9a98d6-ea02-4e9e-8af7-d744d734e3e9</serial>
Apr 14 10:50:12 user nova-compute[71509]: </disk>
Apr 14 10:50:12 user nova-compute[71509]:  {{(pid=71509) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 10:50:12 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-e52a58fc-4693-495e-a691-65af5850e08c tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] No BDM found with device name vda, not building metadata. {{(pid=71509) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 10:50:12 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-e52a58fc-4693-495e-a691-65af5850e08c tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71509) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 10:50:12 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-e52a58fc-4693-495e-a691-65af5850e08c tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] No VIF found with MAC fa:16:3e:54:9b:f3, not building metadata {{(pid=71509) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 10:50:12 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:50:12 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-e52a58fc-4693-495e-a691-65af5850e08c tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Lock "f3245b74-dbe8-4b8b-83b6-58a4811fdba9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.764s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:50:14 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-890923fc-1889-428e-9617-fa2daa46b171 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Acquiring lock "f3245b74-dbe8-4b8b-83b6-58a4811fdba9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:50:14 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-890923fc-1889-428e-9617-fa2daa46b171 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Lock "f3245b74-dbe8-4b8b-83b6-58a4811fdba9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:50:14 user nova-compute[71509]: INFO nova.compute.manager [None req-890923fc-1889-428e-9617-fa2daa46b171 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] [instance: f3245b74-dbe8-4b8b-83b6-58a4811fdba9] Detaching volume 3d9a98d6-ea02-4e9e-8af7-d744d734e3e9
Apr 14 10:50:14 user nova-compute[71509]: INFO nova.virt.block_device [None req-890923fc-1889-428e-9617-fa2daa46b171 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] [instance: f3245b74-dbe8-4b8b-83b6-58a4811fdba9] Attempting to driver detach volume 3d9a98d6-ea02-4e9e-8af7-d744d734e3e9 from mountpoint /dev/vdb
Apr 14 10:50:14 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:50:14 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-890923fc-1889-428e-9617-fa2daa46b171 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Attempting to detach device vdb from instance f3245b74-dbe8-4b8b-83b6-58a4811fdba9 from the persistent domain config. {{(pid=71509) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 10:50:14 user nova-compute[71509]: DEBUG nova.virt.libvirt.guest [None req-890923fc-1889-428e-9617-fa2daa46b171 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 10:50:14 user nova-compute[71509]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 10:50:14 user nova-compute[71509]:   <source dev="/dev/sdd"/>
Apr 14 10:50:14 user nova-compute[71509]:   <target dev="vdb" bus="virtio"/>
Apr 14 10:50:14 user nova-compute[71509]:   <serial>3d9a98d6-ea02-4e9e-8af7-d744d734e3e9</serial>
Apr 14 10:50:14 user nova-compute[71509]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 10:50:14 user nova-compute[71509]: </disk>
Apr 14 10:50:14 user nova-compute[71509]:  {{(pid=71509) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 10:50:14 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-890923fc-1889-428e-9617-fa2daa46b171 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Successfully detached device vdb from instance f3245b74-dbe8-4b8b-83b6-58a4811fdba9 from the persistent domain config.
Apr 14 10:50:14 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-890923fc-1889-428e-9617-fa2daa46b171 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f3245b74-dbe8-4b8b-83b6-58a4811fdba9 from the live domain config. {{(pid=71509) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 10:50:14 user nova-compute[71509]: DEBUG nova.virt.libvirt.guest [None req-890923fc-1889-428e-9617-fa2daa46b171 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 10:50:14 user nova-compute[71509]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 10:50:14 user nova-compute[71509]:   <source dev="/dev/sdd"/>
Apr 14 10:50:14 user nova-compute[71509]:   <target dev="vdb" bus="virtio"/>
Apr 14 10:50:14 user nova-compute[71509]:   <serial>3d9a98d6-ea02-4e9e-8af7-d744d734e3e9</serial>
Apr 14 10:50:14 user nova-compute[71509]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 10:50:14 user nova-compute[71509]: </disk>
Apr 14 10:50:14 user nova-compute[71509]:  {{(pid=71509) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 10:50:14 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-32d78913-bc7f-486d-bcaf-ffec35840388 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Acquiring lock "0e6c800c-9b35-4e35-969e-c40367056dce" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:50:14 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-32d78913-bc7f-486d-bcaf-ffec35840388 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Lock "0e6c800c-9b35-4e35-969e-c40367056dce" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:50:14 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-32d78913-bc7f-486d-bcaf-ffec35840388 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Acquiring lock "0e6c800c-9b35-4e35-969e-c40367056dce-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:50:14 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-32d78913-bc7f-486d-bcaf-ffec35840388 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Lock "0e6c800c-9b35-4e35-969e-c40367056dce-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:50:14 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-32d78913-bc7f-486d-bcaf-ffec35840388 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Lock "0e6c800c-9b35-4e35-969e-c40367056dce-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:50:14 user nova-compute[71509]: INFO nova.compute.manager [None req-32d78913-bc7f-486d-bcaf-ffec35840388 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Terminating instance
Apr 14 10:50:14 user nova-compute[71509]: DEBUG nova.compute.manager [None req-32d78913-bc7f-486d-bcaf-ffec35840388 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Start destroying the instance on the hypervisor. {{(pid=71509) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 10:50:14 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:50:14 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:50:14 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:50:14 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:50:15 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Received event <DeviceRemovedEvent: 1681469414.9993749, f3245b74-dbe8-4b8b-83b6-58a4811fdba9 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71509) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 10:50:15 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-890923fc-1889-428e-9617-fa2daa46b171 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f3245b74-dbe8-4b8b-83b6-58a4811fdba9 {{(pid=71509) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 10:50:15 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-890923fc-1889-428e-9617-fa2daa46b171 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Successfully detached device vdb from instance f3245b74-dbe8-4b8b-83b6-58a4811fdba9 from the live domain config.
Apr 14 10:50:15 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-890923fc-1889-428e-9617-fa2daa46b171 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] [instance: f3245b74-dbe8-4b8b-83b6-58a4811fdba9] calling os-brick to detach iSCSI Volume {{(pid=71509) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 10:50:15 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-890923fc-1889-428e-9617-fa2daa46b171 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0bf0749390>, {'target_iqn': 'iqn.2010-10.org.openstack:3d9a98d6-ea02-4e9e-8af7-d744d734e3e9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mHziNKMS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 10:50:15 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-890923fc-1889-428e-9617-fa2daa46b171 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 10:50:15 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-890923fc-1889-428e-9617-fa2daa46b171 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 10:50:15 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-890923fc-1889-428e-9617-fa2daa46b171 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 10:50:15 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:50:15 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:50:15 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[826fe610-1435-4681-b011-a84e33c14fb2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e6828770-fda7-4cd5-b857-c4d2599299a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3d9a98d6-ea02-4e9e-8af7-d744d734e3e9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:50:15 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-890923fc-1889-428e-9617-fa2daa46b171 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 10:50:15 user nova-compute[71509]: No targets found.
Apr 14 10:50:15 user nova-compute[71509]: iSNS:
Apr 14 10:50:15 user nova-compute[71509]: No targets found.
Apr 14 10:50:15 user nova-compute[71509]: STATIC:
Apr 14 10:50:15 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:e6828770-fda7-4cd5-b857-c4d2599299a7
Apr 14 10:50:15 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:50:15 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:50:15 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2
Apr 14 10:50:15 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:50:15 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:50:15 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:3d9a98d6-ea02-4e9e-8af7-d744d734e3e9
Apr 14 10:50:15 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:50:15 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:50:15 user nova-compute[71509]: FIRMWARE:
Apr 14 10:50:15 user nova-compute[71509]: No targets found.
Apr 14 10:50:15 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:50:15 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-890923fc-1889-428e-9617-fa2daa46b171 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 10:50:15 user nova-compute[71509]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 10:50:15 user nova-compute[71509]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71509) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 10:50:15 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-890923fc-1889-428e-9617-fa2daa46b171 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d9a98d6-ea02-4e9e-8af7-d744d734e3e9', 0)] {{(pid=71509) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 10:50:15 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:50:15 user nova-compute[71509]: DEBUG nova.compute.manager [req-328586b9-b096-498a-8dd9-49db297cc260 req-5bdd6b15-8d52-4d67-bb4c-0464f8455c0a service nova] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Received event network-vif-unplugged-49978689-84ce-4422-add9-9bb12f628c37 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:50:15 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-328586b9-b096-498a-8dd9-49db297cc260 req-5bdd6b15-8d52-4d67-bb4c-0464f8455c0a service nova] Acquiring lock "0e6c800c-9b35-4e35-969e-c40367056dce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:50:15 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-328586b9-b096-498a-8dd9-49db297cc260 req-5bdd6b15-8d52-4d67-bb4c-0464f8455c0a service nova] Lock "0e6c800c-9b35-4e35-969e-c40367056dce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:50:15 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-328586b9-b096-498a-8dd9-49db297cc260 req-5bdd6b15-8d52-4d67-bb4c-0464f8455c0a service nova] Lock "0e6c800c-9b35-4e35-969e-c40367056dce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:50:15 user nova-compute[71509]: DEBUG nova.compute.manager [req-328586b9-b096-498a-8dd9-49db297cc260 req-5bdd6b15-8d52-4d67-bb4c-0464f8455c0a service nova] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] No waiting events found dispatching network-vif-unplugged-49978689-84ce-4422-add9-9bb12f628c37 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:50:15 user nova-compute[71509]: DEBUG nova.compute.manager [req-328586b9-b096-498a-8dd9-49db297cc260 req-5bdd6b15-8d52-4d67-bb4c-0464f8455c0a service nova] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Received event network-vif-unplugged-49978689-84ce-4422-add9-9bb12f628c37 for instance with task_state deleting. {{(pid=71509) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 10:50:15 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:50:15 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad29ddb2-ffef-4c58-b49e-33ff089e7600]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d9a98d6-ea02-4e9e-8af7-d744d734e3e9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6828770-fda7-4cd5-b857-c4d2599299a7\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:50:15 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:50:15 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:50:15 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[c81a305d-188e-4060-bc83-20f320da0751]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6828770-fda7-4cd5-b857-c4d2599299a7 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d9a98d6-ea02-4e9e-8af7-d744d734e3e9 (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:50:15 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-890923fc-1889-428e-9617-fa2daa46b171 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2 (non-flash)
Apr 14 10:50:15 user nova-compute[71509]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6828770-fda7-4cd5-b857-c4d2599299a7 (non-flash)
Apr 14 10:50:15 user nova-compute[71509]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d9a98d6-ea02-4e9e-8af7-d744d734e3e9 (non-flash)
Apr 14 10:50:15 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:50:15 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-890923fc-1889-428e-9617-fa2daa46b171 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2 (non-flash)
Apr 14 10:50:15 user nova-compute[71509]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6828770-fda7-4cd5-b857-c4d2599299a7 (non-flash)
Apr 14 10:50:15 user nova-compute[71509]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d9a98d6-ea02-4e9e-8af7-d744d734e3e9 (non-flash)
Apr 14 10:50:15 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 10:50:15 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-890923fc-1889-428e-9617-fa2daa46b171 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0bf06a8820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d9a98d6-ea02-4e9e-8af7-d744d734e3e9'): ({'sdd'}, set())}) {{(pid=71509) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 10:50:15 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-890923fc-1889-428e-9617-fa2daa46b171 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Removing single pathed devices sdd {{(pid=71509) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 10:50:15 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:50:15 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:50:15 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[35bd06cf-3d61-4c71-9821-55ac21b9c9de]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:50:15 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:50:15 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:50:15 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[7218ae6e-a231-4b62-a337-00518a6bae9a]: (4, ('ok\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:50:15 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-890923fc-1889-428e-9617-fa2daa46b171 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Flushing IO for device /dev/sdd {{(pid=71509) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 10:50:15 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:50:15 user nova-compute[71509]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681469400.1723268, 203b622c-9e6d-4ac7-a3fa-9f9c82ef3108 => Stopped> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 10:50:15 user nova-compute[71509]: INFO nova.compute.manager [-] [instance: 203b622c-9e6d-4ac7-a3fa-9f9c82ef3108] VM Stopped (Lifecycle Event)
Apr 14 10:50:15 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:50:15 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[31e65db7-3a44-487c-af62-7f4064559b1a]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:50:15 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-890923fc-1889-428e-9617-fa2daa46b171 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71509) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 10:50:15 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:50:15 user nova-compute[71509]: DEBUG nova.compute.manager [None req-8767811f-8eb9-412d-971f-89be3fa3b5b6 None None] [instance: 203b622c-9e6d-4ac7-a3fa-9f9c82ef3108] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:50:15 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:50:15 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.047s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:50:15 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[86c761ce-c11c-41e3-841f-bc87449496d9]: (4, ('1', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:50:15 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-890923fc-1889-428e-9617-fa2daa46b171 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71509) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 10:50:15 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-890923fc-1889-428e-9617-fa2daa46b171 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] SCSI volumes sdd have been removed. {{(pid=71509) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 10:50:15 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-890923fc-1889-428e-9617-fa2daa46b171 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d9a98d6-ea02-4e9e-8af7-d744d734e3e9')] {{(pid=71509) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 10:50:15 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d9a98d6-ea02-4e9e-8af7-d744d734e3e9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:50:15 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d9a98d6-ea02-4e9e-8af7-d744d734e3e9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:50:15 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[d54db1a6-2d20-4839-9f79-219c2a239f94]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:50:15 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-890923fc-1889-428e-9617-fa2daa46b171 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:50:15 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d9a98d6-ea02-4e9e-8af7-d744d734e3e9 -p 172.16.0.220:3260 --logout {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:50:15 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d9a98d6-ea02-4e9e-8af7-d744d734e3e9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:50:15 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[365e385b-c379-495e-bdfb-c9cb7da80b95]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:3d9a98d6-ea02-4e9e-8af7-d744d734e3e9, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:3d9a98d6-ea02-4e9e-8af7-d744d734e3e9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:50:15 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-890923fc-1889-428e-9617-fa2daa46b171 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:3d9a98d6-ea02-4e9e-8af7-d744d734e3e9, portal: 172.16.0.220,3260]
Apr 14 10:50:15 user nova-compute[71509]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:3d9a98d6-ea02-4e9e-8af7-d744d734e3e9, portal: 172.16.0.220,3260] successful.
Apr 14 10:50:15 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:50:15 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d9a98d6-ea02-4e9e-8af7-d744d734e3e9 -p 172.16.0.220:3260 --op delete {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:50:15 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d9a98d6-ea02-4e9e-8af7-d744d734e3e9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:50:15 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[68d6a568-fdbd-4c6a-b85e-bea61c02970a]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:50:15 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-890923fc-1889-428e-9617-fa2daa46b171 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:50:15 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-890923fc-1889-428e-9617-fa2daa46b171 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.348s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 10:50:15 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-890923fc-1889-428e-9617-fa2daa46b171 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] <== disconnect_volume: return (349ms) None {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 10:50:15 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-890923fc-1889-428e-9617-fa2daa46b171 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] [instance: f3245b74-dbe8-4b8b-83b6-58a4811fdba9] Disconnected iSCSI Volume {{(pid=71509) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 10:50:15 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Instance destroyed successfully.
Apr 14 10:50:15 user nova-compute[71509]: DEBUG nova.objects.instance [None req-32d78913-bc7f-486d-bcaf-ffec35840388 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Lazy-loading 'resources' on Instance uuid 0e6c800c-9b35-4e35-969e-c40367056dce {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:50:15 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-32d78913-bc7f-486d-bcaf-ffec35840388 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T10:42:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-715949836',display_name='tempest-ServerStableDeviceRescueTest-server-715949836',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-715949836',id=5,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJw5z6VaHRNlxDN06wTJu5Wi0bke1xDu+QHMTsTYS+v80iCfFQaOubP6JBaY/P1b1NeL45VzvxaEoBY4znewTkoI5fdIZ/AucgMjWw1BB8Bl59D4DxJIt+KUZTUDjHw3Lg==',key_name='tempest-keypair-882808316',keypairs=<?>,launch_index=0,launched_at=2023-04-14T10:47:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='482809b9148e408b84b156802a21a225',ramdisk_id='',reservation_id='r-ipx61qut',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1396047341',owner_user_name='tempest-ServerStableDeviceRescueTest-1396047341-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T10:48:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7212c3fe50ef465c99a0eefec4cbd753',uuid=0e6c800c-9b35-4e35-969e-c40367056dce,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "49978689-84ce-4422-add9-9bb12f628c37", "address": "fa:16:3e:a6:47:fc", "network": {"id": "9040ebc7-4d6b-4fd2-8543-f22ca3fb249c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2098664740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "482809b9148e408b84b156802a21a225", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49978689-84", "ovs_interfaceid": "49978689-84ce-4422-add9-9bb12f628c37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 10:50:15 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-32d78913-bc7f-486d-bcaf-ffec35840388 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Converting VIF {"id": "49978689-84ce-4422-add9-9bb12f628c37", "address": "fa:16:3e:a6:47:fc", "network": {"id": "9040ebc7-4d6b-4fd2-8543-f22ca3fb249c", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2098664740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "482809b9148e408b84b156802a21a225", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap49978689-84", "ovs_interfaceid": "49978689-84ce-4422-add9-9bb12f628c37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:50:15 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-32d78913-bc7f-486d-bcaf-ffec35840388 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:47:fc,bridge_name='br-int',has_traffic_filtering=True,id=49978689-84ce-4422-add9-9bb12f628c37,network=Network(9040ebc7-4d6b-4fd2-8543-f22ca3fb249c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49978689-84') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:50:15 user nova-compute[71509]: DEBUG os_vif [None req-32d78913-bc7f-486d-bcaf-ffec35840388 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:47:fc,bridge_name='br-int',has_traffic_filtering=True,id=49978689-84ce-4422-add9-9bb12f628c37,network=Network(9040ebc7-4d6b-4fd2-8543-f22ca3fb249c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49978689-84') {{(pid=71509) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 10:50:15 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:50:15 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap49978689-84, bridge=br-int, if_exists=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:50:15 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:50:15 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 10:50:15 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:50:15 user nova-compute[71509]: INFO os_vif [None req-32d78913-bc7f-486d-bcaf-ffec35840388 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:47:fc,bridge_name='br-int',has_traffic_filtering=True,id=49978689-84ce-4422-add9-9bb12f628c37,network=Network(9040ebc7-4d6b-4fd2-8543-f22ca3fb249c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49978689-84')
Apr 14 10:50:15 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-32d78913-bc7f-486d-bcaf-ffec35840388 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Deleting instance files /opt/stack/data/nova/instances/0e6c800c-9b35-4e35-969e-c40367056dce_del
Apr 14 10:50:15 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-32d78913-bc7f-486d-bcaf-ffec35840388 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Deletion of /opt/stack/data/nova/instances/0e6c800c-9b35-4e35-969e-c40367056dce_del complete
Apr 14 10:50:15 user nova-compute[71509]: INFO nova.compute.manager [None req-32d78913-bc7f-486d-bcaf-ffec35840388 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Took 0.89 seconds to destroy the instance on the hypervisor.
Apr 14 10:50:15 user nova-compute[71509]: DEBUG oslo.service.loopingcall [None req-32d78913-bc7f-486d-bcaf-ffec35840388 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71509) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 10:50:15 user nova-compute[71509]: DEBUG nova.compute.manager [-] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Deallocating network for instance {{(pid=71509) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 10:50:15 user nova-compute[71509]: DEBUG nova.network.neutron [-] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] deallocate_for_instance() {{(pid=71509) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 10:50:16 user nova-compute[71509]: DEBUG nova.objects.instance [None req-890923fc-1889-428e-9617-fa2daa46b171 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Lazy-loading 'flavor' on Instance uuid f3245b74-dbe8-4b8b-83b6-58a4811fdba9 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:50:16 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-890923fc-1889-428e-9617-fa2daa46b171 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Lock "f3245b74-dbe8-4b8b-83b6-58a4811fdba9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.792s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:50:17 user nova-compute[71509]: DEBUG nova.compute.manager [req-2bba90a6-f16e-4cf0-9c92-3ef64bd77bbd req-e5786353-c4a5-4615-8f67-01c9f7d2eb06 service nova] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Received event network-vif-plugged-49978689-84ce-4422-add9-9bb12f628c37 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:50:17 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-2bba90a6-f16e-4cf0-9c92-3ef64bd77bbd req-e5786353-c4a5-4615-8f67-01c9f7d2eb06 service nova] Acquiring lock "0e6c800c-9b35-4e35-969e-c40367056dce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:50:17 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-2bba90a6-f16e-4cf0-9c92-3ef64bd77bbd req-e5786353-c4a5-4615-8f67-01c9f7d2eb06 service nova] Lock "0e6c800c-9b35-4e35-969e-c40367056dce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:50:17 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-2bba90a6-f16e-4cf0-9c92-3ef64bd77bbd req-e5786353-c4a5-4615-8f67-01c9f7d2eb06 service nova] Lock "0e6c800c-9b35-4e35-969e-c40367056dce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:50:17 user nova-compute[71509]: DEBUG nova.compute.manager [req-2bba90a6-f16e-4cf0-9c92-3ef64bd77bbd req-e5786353-c4a5-4615-8f67-01c9f7d2eb06 service nova] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] No waiting events found dispatching network-vif-plugged-49978689-84ce-4422-add9-9bb12f628c37 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:50:17 user nova-compute[71509]: WARNING nova.compute.manager [req-2bba90a6-f16e-4cf0-9c92-3ef64bd77bbd req-e5786353-c4a5-4615-8f67-01c9f7d2eb06 service nova] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Received unexpected event network-vif-plugged-49978689-84ce-4422-add9-9bb12f628c37 for instance with vm_state active and task_state deleting.
Apr 14 10:50:17 user nova-compute[71509]: DEBUG nova.network.neutron [-] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Updating instance_info_cache with network_info: [] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:50:17 user nova-compute[71509]: INFO nova.compute.manager [-] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Took 1.64 seconds to deallocate network for instance.
Apr 14 10:50:17 user nova-compute[71509]: DEBUG nova.compute.manager [req-557a5089-3068-4a17-8d9f-147b9edb050f req-5d32ae89-a870-40b3-8c82-66b75f47703a service nova] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Received event network-vif-deleted-49978689-84ce-4422-add9-9bb12f628c37 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:50:17 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-32d78913-bc7f-486d-bcaf-ffec35840388 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:50:17 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-32d78913-bc7f-486d-bcaf-ffec35840388 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:50:17 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-32d78913-bc7f-486d-bcaf-ffec35840388 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 10:50:17 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-32d78913-bc7f-486d-bcaf-ffec35840388 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 10:50:17 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-32d78913-bc7f-486d-bcaf-ffec35840388 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.293s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:50:17 user nova-compute[71509]: INFO nova.scheduler.client.report [None req-32d78913-bc7f-486d-bcaf-ffec35840388 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Deleted allocations for instance 0e6c800c-9b35-4e35-969e-c40367056dce
Apr 14 10:50:17 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-32d78913-bc7f-486d-bcaf-ffec35840388 tempest-ServerStableDeviceRescueTest-1396047341 tempest-ServerStableDeviceRescueTest-1396047341-project-member] Lock "0e6c800c-9b35-4e35-969e-c40367056dce" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.008s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:50:17 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:50:18 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-4a2d60e3-b75d-4868-ab0b-84a60eab1022 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Acquiring lock "6cae9f61-763f-4671-a873-d15f01384416" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:50:18 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-4a2d60e3-b75d-4868-ab0b-84a60eab1022 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "6cae9f61-763f-4671-a873-d15f01384416" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:50:18 user nova-compute[71509]: DEBUG nova.compute.manager [None req-4a2d60e3-b75d-4868-ab0b-84a60eab1022 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: 6cae9f61-763f-4671-a873-d15f01384416] Starting instance... {{(pid=71509) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 10:50:18 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-4a2d60e3-b75d-4868-ab0b-84a60eab1022 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:50:18 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-4a2d60e3-b75d-4868-ab0b-84a60eab1022 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:50:18 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-4a2d60e3-b75d-4868-ab0b-84a60eab1022 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71509) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 10:50:18 user nova-compute[71509]: INFO nova.compute.claims [None req-4a2d60e3-b75d-4868-ab0b-84a60eab1022 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: 6cae9f61-763f-4671-a873-d15f01384416] Claim successful on node user
Apr 14 10:50:18 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-4a2d60e3-b75d-4868-ab0b-84a60eab1022 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 10:50:18 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-4a2d60e3-b75d-4868-ab0b-84a60eab1022 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 10:50:18 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:50:18 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-4a2d60e3-b75d-4868-ab0b-84a60eab1022 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.367s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:50:18 user nova-compute[71509]: DEBUG nova.compute.manager [None req-4a2d60e3-b75d-4868-ab0b-84a60eab1022 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: 6cae9f61-763f-4671-a873-d15f01384416] Start building networks asynchronously for instance. {{(pid=71509) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 10:50:18 user nova-compute[71509]: DEBUG nova.compute.manager [None req-4a2d60e3-b75d-4868-ab0b-84a60eab1022 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: 6cae9f61-763f-4671-a873-d15f01384416] Allocating IP information in the background. {{(pid=71509) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 10:50:18 user nova-compute[71509]: DEBUG nova.network.neutron [None req-4a2d60e3-b75d-4868-ab0b-84a60eab1022 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: 6cae9f61-763f-4671-a873-d15f01384416] allocate_for_instance() {{(pid=71509) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 10:50:18 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-4a2d60e3-b75d-4868-ab0b-84a60eab1022 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: 6cae9f61-763f-4671-a873-d15f01384416] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 10:50:18 user nova-compute[71509]: DEBUG nova.compute.manager [None req-4a2d60e3-b75d-4868-ab0b-84a60eab1022 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: 6cae9f61-763f-4671-a873-d15f01384416] Start building block device mappings for instance. {{(pid=71509) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 10:50:18 user nova-compute[71509]: INFO nova.virt.block_device [None req-4a2d60e3-b75d-4868-ab0b-84a60eab1022 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: 6cae9f61-763f-4671-a873-d15f01384416] Booting with blank volume at /dev/vda
Apr 14 10:50:18 user nova-compute[71509]: DEBUG nova.policy [None req-4a2d60e3-b75d-4868-ab0b-84a60eab1022 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '395bc9d7007c4e01ac7effd418bcea19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71289f80a05141f482cb538dac3d7b38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71509) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 10:50:19 user nova-compute[71509]: DEBUG nova.network.neutron [None req-4a2d60e3-b75d-4868-ab0b-84a60eab1022 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: 6cae9f61-763f-4671-a873-d15f01384416] Successfully created port: 30d57100-3321-41fe-9335-d53c8c5e291c {{(pid=71509) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 10:50:20 user nova-compute[71509]: DEBUG nova.network.neutron [None req-4a2d60e3-b75d-4868-ab0b-84a60eab1022 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: 6cae9f61-763f-4671-a873-d15f01384416] Successfully updated port: 30d57100-3321-41fe-9335-d53c8c5e291c {{(pid=71509) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 10:50:20 user nova-compute[71509]: DEBUG nova.compute.manager [req-667819f2-e475-4cde-a630-d91f5236db9c req-26e2f80c-a952-486e-829f-b49416653396 service nova] [instance: 6cae9f61-763f-4671-a873-d15f01384416] Received event network-changed-30d57100-3321-41fe-9335-d53c8c5e291c {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:50:20 user nova-compute[71509]: DEBUG nova.compute.manager [req-667819f2-e475-4cde-a630-d91f5236db9c req-26e2f80c-a952-486e-829f-b49416653396 service nova] [instance: 6cae9f61-763f-4671-a873-d15f01384416] Refreshing instance network info cache due to event network-changed-30d57100-3321-41fe-9335-d53c8c5e291c. {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 10:50:20 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-667819f2-e475-4cde-a630-d91f5236db9c req-26e2f80c-a952-486e-829f-b49416653396 service nova] Acquiring lock "refresh_cache-6cae9f61-763f-4671-a873-d15f01384416" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:50:20 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-667819f2-e475-4cde-a630-d91f5236db9c req-26e2f80c-a952-486e-829f-b49416653396 service nova] Acquired lock "refresh_cache-6cae9f61-763f-4671-a873-d15f01384416" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:50:20 user nova-compute[71509]: DEBUG nova.network.neutron [req-667819f2-e475-4cde-a630-d91f5236db9c req-26e2f80c-a952-486e-829f-b49416653396 service nova] [instance: 6cae9f61-763f-4671-a873-d15f01384416] Refreshing network info cache for port 30d57100-3321-41fe-9335-d53c8c5e291c {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 10:50:20 user nova-compute[71509]: DEBUG nova.network.neutron [req-667819f2-e475-4cde-a630-d91f5236db9c req-26e2f80c-a952-486e-829f-b49416653396 service nova] [instance: 6cae9f61-763f-4671-a873-d15f01384416] Instance cache missing network info. {{(pid=71509) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 10:50:20 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-4a2d60e3-b75d-4868-ab0b-84a60eab1022 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Acquiring lock "refresh_cache-6cae9f61-763f-4671-a873-d15f01384416" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:50:20 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:50:20 user nova-compute[71509]: DEBUG nova.network.neutron [req-667819f2-e475-4cde-a630-d91f5236db9c req-26e2f80c-a952-486e-829f-b49416653396 service nova] [instance: 6cae9f61-763f-4671-a873-d15f01384416] Updating instance_info_cache with network_info: [] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:50:20 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-667819f2-e475-4cde-a630-d91f5236db9c req-26e2f80c-a952-486e-829f-b49416653396 service nova] Releasing lock "refresh_cache-6cae9f61-763f-4671-a873-d15f01384416" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:50:20 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-4a2d60e3-b75d-4868-ab0b-84a60eab1022 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Acquired lock "refresh_cache-6cae9f61-763f-4671-a873-d15f01384416" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:50:20 user nova-compute[71509]: DEBUG nova.network.neutron [None req-4a2d60e3-b75d-4868-ab0b-84a60eab1022 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: 6cae9f61-763f-4671-a873-d15f01384416] Building network info cache for instance {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 10:50:20 user nova-compute[71509]: DEBUG nova.network.neutron [None req-4a2d60e3-b75d-4868-ab0b-84a60eab1022 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: 6cae9f61-763f-4671-a873-d15f01384416] Instance cache missing network info. {{(pid=71509) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 10:50:20 user nova-compute[71509]: DEBUG nova.network.neutron [None req-4a2d60e3-b75d-4868-ab0b-84a60eab1022 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: 6cae9f61-763f-4671-a873-d15f01384416] Updating instance_info_cache with network_info: [{"id": "30d57100-3321-41fe-9335-d53c8c5e291c", "address": "fa:16:3e:57:7d:4b", "network": {"id": "07f1f39e-292a-4e73-b4ed-99e5799d6fa8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1339551596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71289f80a05141f482cb538dac3d7b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30d57100-33", "ovs_interfaceid": "30d57100-3321-41fe-9335-d53c8c5e291c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:50:20 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-4a2d60e3-b75d-4868-ab0b-84a60eab1022 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Releasing lock "refresh_cache-6cae9f61-763f-4671-a873-d15f01384416" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:50:20 user nova-compute[71509]: DEBUG nova.compute.manager [None req-4a2d60e3-b75d-4868-ab0b-84a60eab1022 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: 6cae9f61-763f-4671-a873-d15f01384416] Instance network_info: |[{"id": "30d57100-3321-41fe-9335-d53c8c5e291c", "address": "fa:16:3e:57:7d:4b", "network": {"id": "07f1f39e-292a-4e73-b4ed-99e5799d6fa8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1339551596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71289f80a05141f482cb538dac3d7b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30d57100-33", "ovs_interfaceid": "30d57100-3321-41fe-9335-d53c8c5e291c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71509) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 10:50:22 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:50:24 user nova-compute[71509]: DEBUG os_brick.utils [None req-4a2d60e3-b75d-4868-ab0b-84a60eab1022 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 10:50:24 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:50:24 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:50:24 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[198d4d3c-62fa-474d-9c5d-1df4b8cdd7bc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50119df3c417\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:50:24 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:50:24 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:50:24 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[a77f6a86-fb41-4848-9477-5ee5e33609e3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:50:24 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:50:24 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:50:24 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4119d6e-969e-46af-941a-8c825f4f425e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:50:24 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7e6ab1c-3932-49d5-aea4-feeaf18e0f38]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:50:24 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-4a2d60e3-b75d-4868-ab0b-84a60eab1022 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Running cmd (subprocess): nvme version {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:50:24 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-4a2d60e3-b75d-4868-ab0b-84a60eab1022 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] 'nvme version' failed. Not Retrying. {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 10:50:24 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4a2d60e3-b75d-4868-ab0b-84a60eab1022 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] nvme not present on system {{(pid=71509) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 10:50:24 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:50:24 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 10:50:24 user nova-compute[71509]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 10:50:24 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[070d4f13-9ff1-4770-9832-a0fecce3e6bb]: (4, '') {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:50:24 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-4a2d60e3-b75d-4868-ab0b-84a60eab1022 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71509) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 10:50:24 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-4a2d60e3-b75d-4868-ab0b-84a60eab1022 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71509) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 10:50:24 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-4a2d60e3-b75d-4868-ab0b-84a60eab1022 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] LIGHTOS: no hostnqn found. {{(pid=71509) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 10:50:24 user nova-compute[71509]: DEBUG os_brick.utils [None req-4a2d60e3-b75d-4868-ab0b-84a60eab1022 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50119df3c417', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 10:50:24 user nova-compute[71509]: DEBUG nova.virt.block_device [None req-4a2d60e3-b75d-4868-ab0b-84a60eab1022 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: 6cae9f61-763f-4671-a873-d15f01384416] Updating existing volume attachment record: a3b176db-d7c9-482c-af93-711eea02e4dd {{(pid=71509) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 10:50:25 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:50:27 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:50:30 user nova-compute[71509]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681469415.4467564, 0e6c800c-9b35-4e35-969e-c40367056dce => Stopped> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 10:50:30 user nova-compute[71509]: INFO nova.compute.manager [-] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] VM Stopped (Lifecycle Event)
Apr 14 10:50:30 user nova-compute[71509]: DEBUG nova.compute.manager [None req-37beea07-c9d9-49e1-93f4-c68528a8c276 None None] [instance: 0e6c800c-9b35-4e35-969e-c40367056dce] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:50:30 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:50:30 user nova-compute[71509]: DEBUG nova.compute.manager [None req-4a2d60e3-b75d-4868-ab0b-84a60eab1022 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: 6cae9f61-763f-4671-a873-d15f01384416] Start spawning the instance on the hypervisor. {{(pid=71509) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 10:50:30 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-4a2d60e3-b75d-4868-ab0b-84a60eab1022 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: 6cae9f61-763f-4671-a873-d15f01384416] Creating instance directory {{(pid=71509) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 10:50:30 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-4a2d60e3-b75d-4868-ab0b-84a60eab1022 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: 6cae9f61-763f-4671-a873-d15f01384416] Creating image(s)
Apr 14 10:50:30 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-4a2d60e3-b75d-4868-ab0b-84a60eab1022 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: 6cae9f61-763f-4671-a873-d15f01384416] Did not create local disks {{(pid=71509) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 10:50:30 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-4a2d60e3-b75d-4868-ab0b-84a60eab1022 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: 6cae9f61-763f-4671-a873-d15f01384416] Ensure instance console log exists: /opt/stack/data/nova/instances/6cae9f61-763f-4671-a873-d15f01384416/console.log {{(pid=71509) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 10:50:30 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-4a2d60e3-b75d-4868-ab0b-84a60eab1022 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:50:30 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-4a2d60e3-b75d-4868-ab0b-84a60eab1022 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:50:30 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-4a2d60e3-b75d-4868-ab0b-84a60eab1022 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:50:30 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-4a2d60e3-b75d-4868-ab0b-84a60eab1022 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: 6cae9f61-763f-4671-a873-d15f01384416] Start _get_guest_xml network_info=[{"id": "30d57100-3321-41fe-9335-d53c8c5e291c", "address": "fa:16:3e:57:7d:4b", "network": {"id": "07f1f39e-292a-4e73-b4ed-99e5799d6fa8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1339551596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71289f80a05141f482cb538dac3d7b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30d57100-33", "ovs_interfaceid": "30d57100-3321-41fe-9335-d53c8c5e291c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T10:38:55Z,direct_url=<?>,disk_format='qcow2',id=048ec0ee-0465-448d-8b4c-f072acb101dc,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='9742d6ad20cf48d9bab0fdbcc9491db9',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T10:38:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'attachment_id': 'a3b176db-d7c9-482c-af93-711eea02e4dd', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BvhFzdPu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6cae9f61-763f-4671-a873-d15f01384416', 'attached_at': '', 'detached_at': '', 'volume_id': '00c6dcaa-8222-45d7-a3a2-c110834bd178', 'serial': '00c6dcaa-8222-45d7-a3a2-c110834bd178'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'volume_type': None} {{(pid=71509) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 10:50:30 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-4a2d60e3-b75d-4868-ab0b-84a60eab1022 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:50:30 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-4a2d60e3-b75d-4868-ab0b-84a60eab1022 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:50:30 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-4a2d60e3-b75d-4868-ab0b-84a60eab1022 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71509) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 10:50:30 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-4a2d60e3-b75d-4868-ab0b-84a60eab1022 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T10:40:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T10:38:55Z,direct_url=<?>,disk_format='qcow2',id=048ec0ee-0465-448d-8b4c-f072acb101dc,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='9742d6ad20cf48d9bab0fdbcc9491db9',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T10:38:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 10:50:30 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-4a2d60e3-b75d-4868-ab0b-84a60eab1022 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Flavor limits 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 10:50:30 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-4a2d60e3-b75d-4868-ab0b-84a60eab1022 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Image limits 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 10:50:30 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-4a2d60e3-b75d-4868-ab0b-84a60eab1022 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Flavor pref 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 10:50:30 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-4a2d60e3-b75d-4868-ab0b-84a60eab1022 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Image pref 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 10:50:30 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-4a2d60e3-b75d-4868-ab0b-84a60eab1022 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 10:50:30 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-4a2d60e3-b75d-4868-ab0b-84a60eab1022 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 10:50:30 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-4a2d60e3-b75d-4868-ab0b-84a60eab1022 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71509) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 10:50:30 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-4a2d60e3-b75d-4868-ab0b-84a60eab1022 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Got 1 possible topologies {{(pid=71509) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 10:50:30 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-4a2d60e3-b75d-4868-ab0b-84a60eab1022 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 10:50:30 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-4a2d60e3-b75d-4868-ab0b-84a60eab1022 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 10:50:30 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a2d60e3-b75d-4868-ab0b-84a60eab1022 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: 6cae9f61-763f-4671-a873-d15f01384416] Calling os-brick to attach iSCSI Volume {{(pid=71509) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 10:50:30 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a2d60e3-b75d-4868-ab0b-84a60eab1022 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0bf0749390>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BvhFzdPu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 10:50:30 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-4a2d60e3-b75d-4868-ab0b-84a60eab1022 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 10:50:30 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-4a2d60e3-b75d-4868-ab0b-84a60eab1022 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 10:50:30 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-4a2d60e3-b75d-4868-ab0b-84a60eab1022 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 10:50:30 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-4a2d60e3-b75d-4868-ab0b-84a60eab1022 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 10:50:30 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-4a2d60e3-b75d-4868-ab0b-84a60eab1022 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 10:50:30 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-4a2d60e3-b75d-4868-ab0b-84a60eab1022 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 10:50:30 user nova-compute[71509]: INFO os_brick.initiator.connectors.iscsi [None req-4a2d60e3-b75d-4868-ab0b-84a60eab1022 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 10:50:30 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 -p 172.16.0.220:3260 {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:50:30 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:50:30 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[0561033c-4488-4739-81f4-db89cde86283]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:50:30 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a2d60e3-b75d-4868-ab0b-84a60eab1022 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 10:50:30 user nova-compute[71509]:  {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:50:30 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 -p 172.16.0.220:3260 --interface default --op new {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:50:30 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:50:30 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[06e20c73-a41b-447c-be01-d58a400b766c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178] added\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:50:30 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a2d60e3-b75d-4868-ab0b-84a60eab1022 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178] added
Apr 14 10:50:30 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:50:30 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:50:30 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:50:30 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[16572d53-ada2-4c2b-acc8-1fadd4d40177]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:50:30 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a2d60e3-b75d-4868-ab0b-84a60eab1022 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:50:30 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:50:30 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:50:30 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[1928a460-baf0-4685-af06-05ad90994aed]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:50:30 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a2d60e3-b75d-4868-ab0b-84a60eab1022 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:50:30 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BvhFzdPu {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:50:30 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BvhFzdPu" returned: 0 in 0.024s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:50:30 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[3430bb31-01d6-4208-98d6-823ee71f9881]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:50:30 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a2d60e3-b75d-4868-ab0b-84a60eab1022 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BvhFzdPu'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:50:30 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:50:31 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:50:31 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cdc9bce-7dca-4466-8d2d-8db1fef481ed]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:50:31 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a2d60e3-b75d-4868-ab0b-84a60eab1022 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:50:31 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:50:31 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:50:31 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[a135496a-0121-46f4-9212-392c163070fb]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6828770-fda7-4cd5-b857-c4d2599299a7 (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:50:31 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a2d60e3-b75d-4868-ab0b-84a60eab1022 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2 (non-flash)
Apr 14 10:50:31 user nova-compute[71509]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6828770-fda7-4cd5-b857-c4d2599299a7 (non-flash)
Apr 14 10:50:31 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:50:31 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a2d60e3-b75d-4868-ab0b-84a60eab1022 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2 (non-flash)
Apr 14 10:50:31 user nova-compute[71509]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6828770-fda7-4cd5-b857-c4d2599299a7 (non-flash)
Apr 14 10:50:31 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 10:50:31 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 -p 172.16.0.220:3260 --login {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:50:31 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:50:31 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd21493b-c791-438d-84ee-e29ca3d6fa35]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:50:31 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a2d60e3-b75d-4868-ab0b-84a60eab1022 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178, portal: 172.16.0.220,3260]
Apr 14 10:50:31 user nova-compute[71509]: Login to [iface: default, target: iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178, portal: 172.16.0.220,3260] successful.
Apr 14 10:50:31 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:50:31 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:50:31 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:50:31 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0481b46-4d67-4c60-8391-46a67af5eba6]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:50:31 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a2d60e3-b75d-4868-ab0b-84a60eab1022 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:50:31 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:50:31 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:50:31 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[117051ea-201d-48b8-b61f-581007cb63d3]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6828770-fda7-4cd5-b857-c4d2599299a7 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:50:31 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a2d60e3-b75d-4868-ab0b-84a60eab1022 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2 (non-flash)
Apr 14 10:50:31 user nova-compute[71509]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6828770-fda7-4cd5-b857-c4d2599299a7 (non-flash)
Apr 14 10:50:31 user nova-compute[71509]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)
Apr 14 10:50:31 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:50:31 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a2d60e3-b75d-4868-ab0b-84a60eab1022 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2 (non-flash)
Apr 14 10:50:31 user nova-compute[71509]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6828770-fda7-4cd5-b857-c4d2599299a7 (non-flash)
Apr 14 10:50:31 user nova-compute[71509]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)
Apr 14 10:50:31 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 10:50:31 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-4a2d60e3-b75d-4868-ab0b-84a60eab1022 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 10:50:31 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a2d60e3-b75d-4868-ab0b-84a60eab1022 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Connected to 172.16.0.220:3260 {{(pid=71509) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 10:50:31 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-4a2d60e3-b75d-4868-ab0b-84a60eab1022 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] HCTL ('35', '-', '-', 0) found on session 27 with lun 0 {{(pid=71509) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 10:50:31 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-4a2d60e3-b75d-4868-ab0b-84a60eab1022 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=71509) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 10:50:31 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:50:31 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:50:31 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f2bde31-5b09-44e6-9976-80c0160e1748]: (4, ('- - 0', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:50:31 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-4a2d60e3-b75d-4868-ab0b-84a60eab1022 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Searching for a device in session 27 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=71509) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 10:50:31 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a2d60e3-b75d-4868-ab0b-84a60eab1022 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BvhFzdPu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71509) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 10:50:32 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-4a2d60e3-b75d-4868-ab0b-84a60eab1022 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.316s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 10:50:32 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a2d60e3-b75d-4868-ab0b-84a60eab1022 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] <== connect_volume: return (1318ms) {'type': 'block', 'scsi_wwn': '26364363737393437', 'path': '/dev/sdd'} {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 10:50:32 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a2d60e3-b75d-4868-ab0b-84a60eab1022 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: 6cae9f61-763f-4671-a873-d15f01384416] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26364363737393437', 'path': '/dev/sdd'} {{(pid=71509) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 10:50:32 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-4a2d60e3-b75d-4868-ab0b-84a60eab1022 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T10:50:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-632123778',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-632123778',id=19,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='71289f80a05141f482cb538dac3d7b38',ramdisk_id='',reservation_id='r-07afy9z0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2130542140',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T10:50:19Z,user_data=None,user_id='395bc9d7007c4e01ac7effd418bcea19',uuid=6cae9f61-763f-4671-a873-d15f01384416,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "30d57100-3321-41fe-9335-d53c8c5e291c", "address": "fa:16:3e:57:7d:4b", "network": {"id": "07f1f39e-292a-4e73-b4ed-99e5799d6fa8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1339551596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71289f80a05141f482cb538dac3d7b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30d57100-33", "ovs_interfaceid": "30d57100-3321-41fe-9335-d53c8c5e291c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71509) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 10:50:32 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-4a2d60e3-b75d-4868-ab0b-84a60eab1022 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Converting VIF {"id": "30d57100-3321-41fe-9335-d53c8c5e291c", "address": "fa:16:3e:57:7d:4b", "network": {"id": "07f1f39e-292a-4e73-b4ed-99e5799d6fa8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1339551596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71289f80a05141f482cb538dac3d7b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30d57100-33", "ovs_interfaceid": "30d57100-3321-41fe-9335-d53c8c5e291c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:50:32 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-4a2d60e3-b75d-4868-ab0b-84a60eab1022 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:7d:4b,bridge_name='br-int',has_traffic_filtering=True,id=30d57100-3321-41fe-9335-d53c8c5e291c,network=Network(07f1f39e-292a-4e73-b4ed-99e5799d6fa8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30d57100-33') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:50:32 user nova-compute[71509]: DEBUG nova.objects.instance [None req-4a2d60e3-b75d-4868-ab0b-84a60eab1022 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lazy-loading 'pci_devices' on Instance uuid 6cae9f61-763f-4671-a873-d15f01384416 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:50:32 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-4a2d60e3-b75d-4868-ab0b-84a60eab1022 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: 6cae9f61-763f-4671-a873-d15f01384416] End _get_guest_xml xml=<domain type="kvm">
Apr 14 10:50:32 user nova-compute[71509]:   <uuid>6cae9f61-763f-4671-a873-d15f01384416</uuid>
Apr 14 10:50:32 user nova-compute[71509]:   <name>instance-00000013</name>
Apr 14 10:50:32 user nova-compute[71509]:   <memory>131072</memory>
Apr 14 10:50:32 user nova-compute[71509]:   <vcpu>1</vcpu>
Apr 14 10:50:32 user nova-compute[71509]:   <metadata>
Apr 14 10:50:32 user nova-compute[71509]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 10:50:32 user nova-compute[71509]:       <nova:package version="0.0.0"/>
Apr 14 10:50:32 user nova-compute[71509]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-632123778</nova:name>
Apr 14 10:50:32 user nova-compute[71509]:       <nova:creationTime>2023-04-14 10:50:30</nova:creationTime>
Apr 14 10:50:32 user nova-compute[71509]:       <nova:flavor name="m1.nano">
Apr 14 10:50:32 user nova-compute[71509]:         <nova:memory>128</nova:memory>
Apr 14 10:50:32 user nova-compute[71509]:         <nova:disk>1</nova:disk>
Apr 14 10:50:32 user nova-compute[71509]:         <nova:swap>0</nova:swap>
Apr 14 10:50:32 user nova-compute[71509]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 10:50:32 user nova-compute[71509]:         <nova:vcpus>1</nova:vcpus>
Apr 14 10:50:32 user nova-compute[71509]:       </nova:flavor>
Apr 14 10:50:32 user nova-compute[71509]:       <nova:owner>
Apr 14 10:50:32 user nova-compute[71509]:         <nova:user uuid="395bc9d7007c4e01ac7effd418bcea19">tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member</nova:user>
Apr 14 10:50:32 user nova-compute[71509]:         <nova:project uuid="71289f80a05141f482cb538dac3d7b38">tempest-ServerBootFromVolumeStableRescueTest-2130542140</nova:project>
Apr 14 10:50:32 user nova-compute[71509]:       </nova:owner>
Apr 14 10:50:32 user nova-compute[71509]:       <nova:root type="image" uuid="048ec0ee-0465-448d-8b4c-f072acb101dc"/>
Apr 14 10:50:32 user nova-compute[71509]:       <nova:ports>
Apr 14 10:50:32 user nova-compute[71509]:         <nova:port uuid="30d57100-3321-41fe-9335-d53c8c5e291c">
Apr 14 10:50:32 user nova-compute[71509]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 14 10:50:32 user nova-compute[71509]:         </nova:port>
Apr 14 10:50:32 user nova-compute[71509]:       </nova:ports>
Apr 14 10:50:32 user nova-compute[71509]:     </nova:instance>
Apr 14 10:50:32 user nova-compute[71509]:   </metadata>
Apr 14 10:50:32 user nova-compute[71509]:   <sysinfo type="smbios">
Apr 14 10:50:32 user nova-compute[71509]:     <system>
Apr 14 10:50:32 user nova-compute[71509]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 10:50:32 user nova-compute[71509]:       <entry name="product">OpenStack Nova</entry>
Apr 14 10:50:32 user nova-compute[71509]:       <entry name="version">0.0.0</entry>
Apr 14 10:50:32 user nova-compute[71509]:       <entry name="serial">6cae9f61-763f-4671-a873-d15f01384416</entry>
Apr 14 10:50:32 user nova-compute[71509]:       <entry name="uuid">6cae9f61-763f-4671-a873-d15f01384416</entry>
Apr 14 10:50:32 user nova-compute[71509]:       <entry name="family">Virtual Machine</entry>
Apr 14 10:50:32 user nova-compute[71509]:     </system>
Apr 14 10:50:32 user nova-compute[71509]:   </sysinfo>
Apr 14 10:50:32 user nova-compute[71509]:   <os>
Apr 14 10:50:32 user nova-compute[71509]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 10:50:32 user nova-compute[71509]:     <boot dev="hd"/>
Apr 14 10:50:32 user nova-compute[71509]:     <smbios mode="sysinfo"/>
Apr 14 10:50:32 user nova-compute[71509]:   </os>
Apr 14 10:50:32 user nova-compute[71509]:   <features>
Apr 14 10:50:32 user nova-compute[71509]:     <acpi/>
Apr 14 10:50:32 user nova-compute[71509]:     <apic/>
Apr 14 10:50:32 user nova-compute[71509]:     <vmcoreinfo/>
Apr 14 10:50:32 user nova-compute[71509]:   </features>
Apr 14 10:50:32 user nova-compute[71509]:   <clock offset="utc">
Apr 14 10:50:32 user nova-compute[71509]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 10:50:32 user nova-compute[71509]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 10:50:32 user nova-compute[71509]:     <timer name="hpet" present="no"/>
Apr 14 10:50:32 user nova-compute[71509]:   </clock>
Apr 14 10:50:32 user nova-compute[71509]:   <cpu mode="custom" match="exact">
Apr 14 10:50:32 user nova-compute[71509]:     <model>Nehalem</model>
Apr 14 10:50:32 user nova-compute[71509]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 10:50:32 user nova-compute[71509]:   </cpu>
Apr 14 10:50:32 user nova-compute[71509]:   <devices>
Apr 14 10:50:32 user nova-compute[71509]:     <disk type="block" device="disk">
Apr 14 10:50:32 user nova-compute[71509]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 10:50:32 user nova-compute[71509]:       <source dev="/dev/sdd"/>
Apr 14 10:50:32 user nova-compute[71509]:       <target dev="vda" bus="virtio"/>
Apr 14 10:50:32 user nova-compute[71509]:       <serial>00c6dcaa-8222-45d7-a3a2-c110834bd178</serial>
Apr 14 10:50:32 user nova-compute[71509]:     </disk>
Apr 14 10:50:32 user nova-compute[71509]:     <interface type="ethernet">
Apr 14 10:50:32 user nova-compute[71509]:       <mac address="fa:16:3e:57:7d:4b"/>
Apr 14 10:50:32 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 10:50:32 user nova-compute[71509]:       <mtu size="1442"/>
Apr 14 10:50:32 user nova-compute[71509]:       <target dev="tap30d57100-33"/>
Apr 14 10:50:32 user nova-compute[71509]:     </interface>
Apr 14 10:50:32 user nova-compute[71509]:     <serial type="pty">
Apr 14 10:50:32 user nova-compute[71509]:       <log file="/opt/stack/data/nova/instances/6cae9f61-763f-4671-a873-d15f01384416/console.log" append="off"/>
Apr 14 10:50:32 user nova-compute[71509]:     </serial>
Apr 14 10:50:32 user nova-compute[71509]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 10:50:32 user nova-compute[71509]:     <video>
Apr 14 10:50:32 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 10:50:32 user nova-compute[71509]:     </video>
Apr 14 10:50:32 user nova-compute[71509]:     <rng model="virtio">
Apr 14 10:50:32 user nova-compute[71509]:       <backend model="random">/dev/urandom</backend>
Apr 14 10:50:32 user nova-compute[71509]:     </rng>
Apr 14 10:50:32 user nova-compute[71509]:     <controller type="usb" index="0" model="none"/>
Apr 14 10:50:32 user nova-compute[71509]:     <memballoon model="virtio">
Apr 14 10:50:32 user nova-compute[71509]:       <stats period="10"/>
Apr 14 10:50:32 user nova-compute[71509]:     </memballoon>
Apr 14 10:50:32 user nova-compute[71509]:   </devices>
Apr 14 10:50:32 user nova-compute[71509]: </domain>
Apr 14 10:50:32 user nova-compute[71509]:  {{(pid=71509) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 10:50:32 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-4a2d60e3-b75d-4868-ab0b-84a60eab1022 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T10:50:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-632123778',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-632123778',id=19,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='71289f80a05141f482cb538dac3d7b38',ramdisk_id='',reservation_id='r-07afy9z0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2130542140',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T10:50:19Z,user_data=None,user_id='395bc9d7007c4e01ac7effd418bcea19',uuid=6cae9f61-763f-4671-a873-d15f01384416,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "30d57100-3321-41fe-9335-d53c8c5e291c", "address": "fa:16:3e:57:7d:4b", "network": {"id": "07f1f39e-292a-4e73-b4ed-99e5799d6fa8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1339551596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71289f80a05141f482cb538dac3d7b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30d57100-33", "ovs_interfaceid": "30d57100-3321-41fe-9335-d53c8c5e291c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 10:50:32 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-4a2d60e3-b75d-4868-ab0b-84a60eab1022 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Converting VIF {"id": "30d57100-3321-41fe-9335-d53c8c5e291c", "address": "fa:16:3e:57:7d:4b", "network": {"id": "07f1f39e-292a-4e73-b4ed-99e5799d6fa8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1339551596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71289f80a05141f482cb538dac3d7b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30d57100-33", "ovs_interfaceid": "30d57100-3321-41fe-9335-d53c8c5e291c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:50:32 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-4a2d60e3-b75d-4868-ab0b-84a60eab1022 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:7d:4b,bridge_name='br-int',has_traffic_filtering=True,id=30d57100-3321-41fe-9335-d53c8c5e291c,network=Network(07f1f39e-292a-4e73-b4ed-99e5799d6fa8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30d57100-33') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:50:32 user nova-compute[71509]: DEBUG os_vif [None req-4a2d60e3-b75d-4868-ab0b-84a60eab1022 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:7d:4b,bridge_name='br-int',has_traffic_filtering=True,id=30d57100-3321-41fe-9335-d53c8c5e291c,network=Network(07f1f39e-292a-4e73-b4ed-99e5799d6fa8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30d57100-33') {{(pid=71509) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 10:50:32 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:50:32 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:50:32 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 10:50:32 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:50:32 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap30d57100-33, may_exist=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:50:32 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap30d57100-33, col_values=(('external_ids', {'iface-id': '30d57100-3321-41fe-9335-d53c8c5e291c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:57:7d:4b', 'vm-uuid': '6cae9f61-763f-4671-a873-d15f01384416'}),)) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:50:32 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 10:50:32 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:50:32 user nova-compute[71509]: INFO os_vif [None req-4a2d60e3-b75d-4868-ab0b-84a60eab1022 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:7d:4b,bridge_name='br-int',has_traffic_filtering=True,id=30d57100-3321-41fe-9335-d53c8c5e291c,network=Network(07f1f39e-292a-4e73-b4ed-99e5799d6fa8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30d57100-33')
Apr 14 10:50:32 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-4a2d60e3-b75d-4868-ab0b-84a60eab1022 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] No BDM found with device name vda, not building metadata. {{(pid=71509) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 10:50:32 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-4a2d60e3-b75d-4868-ab0b-84a60eab1022 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] No VIF found with MAC fa:16:3e:57:7d:4b, not building metadata {{(pid=71509) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 10:50:33 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:50:33 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:50:33 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:50:33 user nova-compute[71509]: DEBUG nova.compute.manager [req-cda71c00-b088-4e3d-8576-32eba60207d7 req-b39c46ab-c8cb-497f-9db2-86e4905b3903 service nova] [instance: 6cae9f61-763f-4671-a873-d15f01384416] Received event network-vif-plugged-30d57100-3321-41fe-9335-d53c8c5e291c {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:50:33 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-cda71c00-b088-4e3d-8576-32eba60207d7 req-b39c46ab-c8cb-497f-9db2-86e4905b3903 service nova] Acquiring lock "6cae9f61-763f-4671-a873-d15f01384416-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:50:33 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-cda71c00-b088-4e3d-8576-32eba60207d7 req-b39c46ab-c8cb-497f-9db2-86e4905b3903 service nova] Lock "6cae9f61-763f-4671-a873-d15f01384416-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:50:33 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-cda71c00-b088-4e3d-8576-32eba60207d7 req-b39c46ab-c8cb-497f-9db2-86e4905b3903 service nova] Lock "6cae9f61-763f-4671-a873-d15f01384416-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:50:33 user nova-compute[71509]: DEBUG nova.compute.manager [req-cda71c00-b088-4e3d-8576-32eba60207d7 req-b39c46ab-c8cb-497f-9db2-86e4905b3903 service nova] [instance: 6cae9f61-763f-4671-a873-d15f01384416] No waiting events found dispatching network-vif-plugged-30d57100-3321-41fe-9335-d53c8c5e291c {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:50:33 user nova-compute[71509]: WARNING nova.compute.manager [req-cda71c00-b088-4e3d-8576-32eba60207d7 req-b39c46ab-c8cb-497f-9db2-86e4905b3903 service nova] [instance: 6cae9f61-763f-4671-a873-d15f01384416] Received unexpected event network-vif-plugged-30d57100-3321-41fe-9335-d53c8c5e291c for instance with vm_state building and task_state spawning.
Apr 14 10:50:33 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:50:33 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:50:34 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:50:35 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:50:35 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:50:35 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:50:35 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:50:35 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71509) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 10:50:35 user nova-compute[71509]: DEBUG nova.compute.manager [req-1b837f95-7f1e-45b7-ad93-d5c5499cc99e req-a57215a4-c2b7-48fd-ba1f-451b04f8cd89 service nova] [instance: 6cae9f61-763f-4671-a873-d15f01384416] Received event network-vif-plugged-30d57100-3321-41fe-9335-d53c8c5e291c {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:50:35 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-1b837f95-7f1e-45b7-ad93-d5c5499cc99e req-a57215a4-c2b7-48fd-ba1f-451b04f8cd89 service nova] Acquiring lock "6cae9f61-763f-4671-a873-d15f01384416-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:50:35 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-1b837f95-7f1e-45b7-ad93-d5c5499cc99e req-a57215a4-c2b7-48fd-ba1f-451b04f8cd89 service nova] Lock "6cae9f61-763f-4671-a873-d15f01384416-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:50:35 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-1b837f95-7f1e-45b7-ad93-d5c5499cc99e req-a57215a4-c2b7-48fd-ba1f-451b04f8cd89 service nova] Lock "6cae9f61-763f-4671-a873-d15f01384416-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:50:35 user nova-compute[71509]: DEBUG nova.compute.manager [req-1b837f95-7f1e-45b7-ad93-d5c5499cc99e req-a57215a4-c2b7-48fd-ba1f-451b04f8cd89 service nova] [instance: 6cae9f61-763f-4671-a873-d15f01384416] No waiting events found dispatching network-vif-plugged-30d57100-3321-41fe-9335-d53c8c5e291c {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:50:35 user nova-compute[71509]: WARNING nova.compute.manager [req-1b837f95-7f1e-45b7-ad93-d5c5499cc99e req-a57215a4-c2b7-48fd-ba1f-451b04f8cd89 service nova] [instance: 6cae9f61-763f-4671-a873-d15f01384416] Received unexpected event network-vif-plugged-30d57100-3321-41fe-9335-d53c8c5e291c for instance with vm_state building and task_state spawning.
Apr 14 10:50:36 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681469436.1988544, 6cae9f61-763f-4671-a873-d15f01384416 => Resumed> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 10:50:36 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 6cae9f61-763f-4671-a873-d15f01384416] VM Resumed (Lifecycle Event)
Apr 14 10:50:36 user nova-compute[71509]: DEBUG nova.compute.manager [None req-4a2d60e3-b75d-4868-ab0b-84a60eab1022 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: 6cae9f61-763f-4671-a873-d15f01384416] Instance event wait completed in 0 seconds for  {{(pid=71509) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 10:50:36 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-4a2d60e3-b75d-4868-ab0b-84a60eab1022 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: 6cae9f61-763f-4671-a873-d15f01384416] Guest created on hypervisor {{(pid=71509) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 10:50:36 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: 6cae9f61-763f-4671-a873-d15f01384416] Instance spawned successfully.
Apr 14 10:50:36 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-4a2d60e3-b75d-4868-ab0b-84a60eab1022 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: 6cae9f61-763f-4671-a873-d15f01384416] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 10:50:36 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 6cae9f61-763f-4671-a873-d15f01384416] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:50:36 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 6cae9f61-763f-4671-a873-d15f01384416] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 10:50:36 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-4a2d60e3-b75d-4868-ab0b-84a60eab1022 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: 6cae9f61-763f-4671-a873-d15f01384416] Found default for hw_cdrom_bus of ide {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:50:36 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-4a2d60e3-b75d-4868-ab0b-84a60eab1022 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: 6cae9f61-763f-4671-a873-d15f01384416] Found default for hw_disk_bus of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:50:36 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-4a2d60e3-b75d-4868-ab0b-84a60eab1022 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: 6cae9f61-763f-4671-a873-d15f01384416] Found default for hw_input_bus of None {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:50:36 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-4a2d60e3-b75d-4868-ab0b-84a60eab1022 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: 6cae9f61-763f-4671-a873-d15f01384416] Found default for hw_pointer_model of None {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:50:36 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-4a2d60e3-b75d-4868-ab0b-84a60eab1022 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: 6cae9f61-763f-4671-a873-d15f01384416] Found default for hw_video_model of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:50:36 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-4a2d60e3-b75d-4868-ab0b-84a60eab1022 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: 6cae9f61-763f-4671-a873-d15f01384416] Found default for hw_vif_model of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:50:36 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 6cae9f61-763f-4671-a873-d15f01384416] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 10:50:36 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681469436.2065892, 6cae9f61-763f-4671-a873-d15f01384416 => Started> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 10:50:36 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 6cae9f61-763f-4671-a873-d15f01384416] VM Started (Lifecycle Event)
Apr 14 10:50:36 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 6cae9f61-763f-4671-a873-d15f01384416] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:50:36 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 6cae9f61-763f-4671-a873-d15f01384416] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 10:50:36 user nova-compute[71509]: INFO nova.compute.manager [None req-4a2d60e3-b75d-4868-ab0b-84a60eab1022 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: 6cae9f61-763f-4671-a873-d15f01384416] Took 5.52 seconds to spawn the instance on the hypervisor.
Apr 14 10:50:36 user nova-compute[71509]: DEBUG nova.compute.manager [None req-4a2d60e3-b75d-4868-ab0b-84a60eab1022 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: 6cae9f61-763f-4671-a873-d15f01384416] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:50:36 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 6cae9f61-763f-4671-a873-d15f01384416] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 10:50:36 user nova-compute[71509]: INFO nova.compute.manager [None req-4a2d60e3-b75d-4868-ab0b-84a60eab1022 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: 6cae9f61-763f-4671-a873-d15f01384416] Took 18.27 seconds to build instance.
Apr 14 10:50:36 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-4a2d60e3-b75d-4868-ab0b-84a60eab1022 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "6cae9f61-763f-4671-a873-d15f01384416" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.365s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:50:37 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:50:37 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:50:37 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:50:38 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:50:39 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:50:39 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Starting heal instance info cache {{(pid=71509) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 10:50:39 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "refresh_cache-97820f17-22d1-4ec3-9721-1edadccc794a" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:50:39 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquired lock "refresh_cache-97820f17-22d1-4ec3-9721-1edadccc794a" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:50:39 user nova-compute[71509]: DEBUG nova.network.neutron [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] [instance: 97820f17-22d1-4ec3-9721-1edadccc794a] Forcefully refreshing network info cache for instance {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 10:50:39 user nova-compute[71509]: DEBUG nova.network.neutron [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] [instance: 97820f17-22d1-4ec3-9721-1edadccc794a] Updating instance_info_cache with network_info: [{"id": "dea3830d-9f49-4d5e-953b-eec2ee969b02", "address": "fa:16:3e:77:58:9a", "network": {"id": "22eb5f87-be4d-447d-bafe-25e0284ea3ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-787804772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf93e5dac50342d0b65ef09711401e99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdea3830d-9f", "ovs_interfaceid": "dea3830d-9f49-4d5e-953b-eec2ee969b02", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:50:39 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Releasing lock "refresh_cache-97820f17-22d1-4ec3-9721-1edadccc794a" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:50:39 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] [instance: 97820f17-22d1-4ec3-9721-1edadccc794a] Updated the network info_cache for instance {{(pid=71509) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 10:50:41 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:50:42 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:50:42 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:50:42 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:50:42 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:50:42 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:50:42 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Auditing locally available compute resources for user (node: user) {{(pid=71509) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 10:50:42 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97820f17-22d1-4ec3-9721-1edadccc794a/disk.rescue --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:50:42 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97820f17-22d1-4ec3-9721-1edadccc794a/disk.rescue --force-share --output=json" returned: 0 in 0.154s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:50:42 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97820f17-22d1-4ec3-9721-1edadccc794a/disk.rescue --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:50:42 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:50:42 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97820f17-22d1-4ec3-9721-1edadccc794a/disk.rescue --force-share --output=json" returned: 0 in 0.146s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:50:42 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97820f17-22d1-4ec3-9721-1edadccc794a/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:50:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97820f17-22d1-4ec3-9721-1edadccc794a/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:50:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97820f17-22d1-4ec3-9721-1edadccc794a/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:50:43 user nova-compute[71509]: DEBUG nova.compute.manager [req-d059d75c-d14a-4ba0-b520-b38e8364f18b req-ec4fc498-da02-4903-8c93-f7503bf9c7bc service nova] [instance: 55178126-9766-4875-9122-39dcc87ce82c] Received event network-changed-578e84c9-8c30-41bb-b61d-8fdeaa0c3a3f {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:50:43 user nova-compute[71509]: DEBUG nova.compute.manager [req-d059d75c-d14a-4ba0-b520-b38e8364f18b req-ec4fc498-da02-4903-8c93-f7503bf9c7bc service nova] [instance: 55178126-9766-4875-9122-39dcc87ce82c] Refreshing instance network info cache due to event network-changed-578e84c9-8c30-41bb-b61d-8fdeaa0c3a3f. {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 10:50:43 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-d059d75c-d14a-4ba0-b520-b38e8364f18b req-ec4fc498-da02-4903-8c93-f7503bf9c7bc service nova] Acquiring lock "refresh_cache-55178126-9766-4875-9122-39dcc87ce82c" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:50:43 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-d059d75c-d14a-4ba0-b520-b38e8364f18b req-ec4fc498-da02-4903-8c93-f7503bf9c7bc service nova] Acquired lock "refresh_cache-55178126-9766-4875-9122-39dcc87ce82c" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:50:43 user nova-compute[71509]: DEBUG nova.network.neutron [req-d059d75c-d14a-4ba0-b520-b38e8364f18b req-ec4fc498-da02-4903-8c93-f7503bf9c7bc service nova] [instance: 55178126-9766-4875-9122-39dcc87ce82c] Refreshing network info cache for port 578e84c9-8c30-41bb-b61d-8fdeaa0c3a3f {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 10:50:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97820f17-22d1-4ec3-9721-1edadccc794a/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:50:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3245b74-dbe8-4b8b-83b6-58a4811fdba9/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:50:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3245b74-dbe8-4b8b-83b6-58a4811fdba9/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:50:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3245b74-dbe8-4b8b-83b6-58a4811fdba9/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:50:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3245b74-dbe8-4b8b-83b6-58a4811fdba9/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:50:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4abb549-8f36-40c5-971f-8accbb14ff86/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:50:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4abb549-8f36-40c5-971f-8accbb14ff86/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:50:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4abb549-8f36-40c5-971f-8accbb14ff86/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:50:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4abb549-8f36-40c5-971f-8accbb14ff86/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:50:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8586a70e-9855-4177-ac1b-cf707a4df871/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:50:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8586a70e-9855-4177-ac1b-cf707a4df871/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:50:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8586a70e-9855-4177-ac1b-cf707a4df871/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:50:44 user nova-compute[71509]: DEBUG nova.network.neutron [req-d059d75c-d14a-4ba0-b520-b38e8364f18b req-ec4fc498-da02-4903-8c93-f7503bf9c7bc service nova] [instance: 55178126-9766-4875-9122-39dcc87ce82c] Updated VIF entry in instance network info cache for port 578e84c9-8c30-41bb-b61d-8fdeaa0c3a3f. {{(pid=71509) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 10:50:44 user nova-compute[71509]: DEBUG nova.network.neutron [req-d059d75c-d14a-4ba0-b520-b38e8364f18b req-ec4fc498-da02-4903-8c93-f7503bf9c7bc service nova] [instance: 55178126-9766-4875-9122-39dcc87ce82c] Updating instance_info_cache with network_info: [{"id": "578e84c9-8c30-41bb-b61d-8fdeaa0c3a3f", "address": "fa:16:3e:85:23:c1", "network": {"id": "cec30aec-4cbb-4cff-8aae-6ecdfe8dfdbd", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1777093386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1696bf804b2e4d7f86162513015c8e52", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap578e84c9-8c", "ovs_interfaceid": "578e84c9-8c30-41bb-b61d-8fdeaa0c3a3f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:50:44 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-d059d75c-d14a-4ba0-b520-b38e8364f18b req-ec4fc498-da02-4903-8c93-f7503bf9c7bc service nova] Releasing lock "refresh_cache-55178126-9766-4875-9122-39dcc87ce82c" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:50:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8586a70e-9855-4177-ac1b-cf707a4df871/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:50:44 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71509) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 10:50:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55178126-9766-4875-9122-39dcc87ce82c/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:50:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55178126-9766-4875-9122-39dcc87ce82c/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:50:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55178126-9766-4875-9122-39dcc87ce82c/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:50:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55178126-9766-4875-9122-39dcc87ce82c/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:50:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e479154a-acd6-47aa-9a5b-43c6e0feda07/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:50:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e479154a-acd6-47aa-9a5b-43c6e0feda07/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:50:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e479154a-acd6-47aa-9a5b-43c6e0feda07/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:50:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e479154a-acd6-47aa-9a5b-43c6e0feda07/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:50:44 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71509) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 10:50:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97f20661-8b60-439e-b7af-2fc2013c5ade/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:50:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97f20661-8b60-439e-b7af-2fc2013c5ade/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:50:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97f20661-8b60-439e-b7af-2fc2013c5ade/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:50:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97f20661-8b60-439e-b7af-2fc2013c5ade/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:50:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b767f1b-e97e-497c-8c70-8806203c76ae/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:50:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b767f1b-e97e-497c-8c70-8806203c76ae/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:50:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b767f1b-e97e-497c-8c70-8806203c76ae/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:50:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b767f1b-e97e-497c-8c70-8806203c76ae/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:50:45 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] skipping disk /dev/sdb (vdc) as it is a volume {{(pid=71509) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 10:50:45 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:50:45 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:50:45 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Hypervisor/Node resource view: name=user free_ram=7817MB free_disk=26.14635467529297GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71509) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 10:50:45 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:50:45 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:50:46 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 97f20661-8b60-439e-b7af-2fc2013c5ade actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:50:46 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 97820f17-22d1-4ec3-9721-1edadccc794a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:50:46 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance b4abb549-8f36-40c5-971f-8accbb14ff86 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:50:46 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 55178126-9766-4875-9122-39dcc87ce82c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:50:46 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance e479154a-acd6-47aa-9a5b-43c6e0feda07 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:50:46 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 8586a70e-9855-4177-ac1b-cf707a4df871 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:50:46 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance f3245b74-dbe8-4b8b-83b6-58a4811fdba9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:50:46 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 4b767f1b-e97e-497c-8c70-8806203c76ae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:50:46 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 6cae9f61-763f-4671-a873-d15f01384416 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:50:46 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=71509) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 10:50:46 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Final resource view: name=user phys_ram=16023MB used_ram=1664MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=71509) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 10:50:46 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 10:50:46 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 10:50:46 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Compute_service record updated for user:user {{(pid=71509) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 10:50:46 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.501s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:50:46 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-7e37ae50-d444-465e-99f5-7d35f3944311 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Acquiring lock "55178126-9766-4875-9122-39dcc87ce82c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:50:46 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-7e37ae50-d444-465e-99f5-7d35f3944311 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "55178126-9766-4875-9122-39dcc87ce82c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:50:46 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-7e37ae50-d444-465e-99f5-7d35f3944311 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Acquiring lock "55178126-9766-4875-9122-39dcc87ce82c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:50:46 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-7e37ae50-d444-465e-99f5-7d35f3944311 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "55178126-9766-4875-9122-39dcc87ce82c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:50:46 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-7e37ae50-d444-465e-99f5-7d35f3944311 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "55178126-9766-4875-9122-39dcc87ce82c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:50:46 user nova-compute[71509]: INFO nova.compute.manager [None req-7e37ae50-d444-465e-99f5-7d35f3944311 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] [instance: 55178126-9766-4875-9122-39dcc87ce82c] Terminating instance
Apr 14 10:50:46 user nova-compute[71509]: DEBUG nova.compute.manager [None req-7e37ae50-d444-465e-99f5-7d35f3944311 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] [instance: 55178126-9766-4875-9122-39dcc87ce82c] Start destroying the instance on the hypervisor. {{(pid=71509) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 10:50:46 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:50:46 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:50:46 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:50:47 user nova-compute[71509]: DEBUG nova.compute.manager [req-3687208b-0054-4721-b4b3-8f83fa78e835 req-eb6e7dba-0b63-4f05-b1f7-4a4648116485 service nova] [instance: 55178126-9766-4875-9122-39dcc87ce82c] Received event network-vif-unplugged-578e84c9-8c30-41bb-b61d-8fdeaa0c3a3f {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:50:47 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-3687208b-0054-4721-b4b3-8f83fa78e835 req-eb6e7dba-0b63-4f05-b1f7-4a4648116485 service nova] Acquiring lock "55178126-9766-4875-9122-39dcc87ce82c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:50:47 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-3687208b-0054-4721-b4b3-8f83fa78e835 req-eb6e7dba-0b63-4f05-b1f7-4a4648116485 service nova] Lock "55178126-9766-4875-9122-39dcc87ce82c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:50:47 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-3687208b-0054-4721-b4b3-8f83fa78e835 req-eb6e7dba-0b63-4f05-b1f7-4a4648116485 service nova] Lock "55178126-9766-4875-9122-39dcc87ce82c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:50:47 user nova-compute[71509]: DEBUG nova.compute.manager [req-3687208b-0054-4721-b4b3-8f83fa78e835 req-eb6e7dba-0b63-4f05-b1f7-4a4648116485 service nova] [instance: 55178126-9766-4875-9122-39dcc87ce82c] No waiting events found dispatching network-vif-unplugged-578e84c9-8c30-41bb-b61d-8fdeaa0c3a3f {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:50:47 user nova-compute[71509]: DEBUG nova.compute.manager [req-3687208b-0054-4721-b4b3-8f83fa78e835 req-eb6e7dba-0b63-4f05-b1f7-4a4648116485 service nova] [instance: 55178126-9766-4875-9122-39dcc87ce82c] Received event network-vif-unplugged-578e84c9-8c30-41bb-b61d-8fdeaa0c3a3f for instance with task_state deleting. {{(pid=71509) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 10:50:47 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:50:47 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:50:47 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:50:47 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:50:47 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:50:47 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: 55178126-9766-4875-9122-39dcc87ce82c] Instance destroyed successfully.
Apr 14 10:50:47 user nova-compute[71509]: DEBUG nova.objects.instance [None req-7e37ae50-d444-465e-99f5-7d35f3944311 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lazy-loading 'resources' on Instance uuid 55178126-9766-4875-9122-39dcc87ce82c {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:50:47 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-7e37ae50-d444-465e-99f5-7d35f3944311 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T10:44:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-36028895',display_name='tempest-SnapshotDataIntegrityTests-server-36028895',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-36028895',id=13,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPSZXoy0ZdK7cT5ThMrTCya3wT94LWqxCTxtoLlDfoPgpqTWYvxs++wU1EdRWtZGKR5gH7hqEFS1U5I74nJs0Y4cHLUyVecAGHi5EkH+m7SY22DQORJXW8M8RwAfpcYDAg==',key_name='tempest-SnapshotDataIntegrityTests-1664538954',keypairs=<?>,launch_index=0,launched_at=2023-04-14T10:44:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1696bf804b2e4d7f86162513015c8e52',ramdisk_id='',reservation_id='r-ht86tqdk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1747462102',owner_user_name='tempest-SnapshotDataIntegrityTests-1747462102-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T10:44:14Z,user_data=None,user_id='09ed4663d8984fe7b5d95616281bfbfc',uuid=55178126-9766-4875-9122-39dcc87ce82c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "578e84c9-8c30-41bb-b61d-8fdeaa0c3a3f", "address": "fa:16:3e:85:23:c1", "network": {"id": "cec30aec-4cbb-4cff-8aae-6ecdfe8dfdbd", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1777093386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1696bf804b2e4d7f86162513015c8e52", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap578e84c9-8c", "ovs_interfaceid": "578e84c9-8c30-41bb-b61d-8fdeaa0c3a3f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 10:50:47 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-7e37ae50-d444-465e-99f5-7d35f3944311 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Converting VIF {"id": "578e84c9-8c30-41bb-b61d-8fdeaa0c3a3f", "address": "fa:16:3e:85:23:c1", "network": {"id": "cec30aec-4cbb-4cff-8aae-6ecdfe8dfdbd", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1777093386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1696bf804b2e4d7f86162513015c8e52", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap578e84c9-8c", "ovs_interfaceid": "578e84c9-8c30-41bb-b61d-8fdeaa0c3a3f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:50:47 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-7e37ae50-d444-465e-99f5-7d35f3944311 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:85:23:c1,bridge_name='br-int',has_traffic_filtering=True,id=578e84c9-8c30-41bb-b61d-8fdeaa0c3a3f,network=Network(cec30aec-4cbb-4cff-8aae-6ecdfe8dfdbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap578e84c9-8c') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:50:47 user nova-compute[71509]: DEBUG os_vif [None req-7e37ae50-d444-465e-99f5-7d35f3944311 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:85:23:c1,bridge_name='br-int',has_traffic_filtering=True,id=578e84c9-8c30-41bb-b61d-8fdeaa0c3a3f,network=Network(cec30aec-4cbb-4cff-8aae-6ecdfe8dfdbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap578e84c9-8c') {{(pid=71509) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 10:50:47 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:50:47 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap578e84c9-8c, bridge=br-int, if_exists=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:50:47 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:50:47 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 10:50:47 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:50:47 user nova-compute[71509]: INFO os_vif [None req-7e37ae50-d444-465e-99f5-7d35f3944311 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:85:23:c1,bridge_name='br-int',has_traffic_filtering=True,id=578e84c9-8c30-41bb-b61d-8fdeaa0c3a3f,network=Network(cec30aec-4cbb-4cff-8aae-6ecdfe8dfdbd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap578e84c9-8c')
Apr 14 10:50:47 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-7e37ae50-d444-465e-99f5-7d35f3944311 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] [instance: 55178126-9766-4875-9122-39dcc87ce82c] Deleting instance files /opt/stack/data/nova/instances/55178126-9766-4875-9122-39dcc87ce82c_del
Apr 14 10:50:47 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-7e37ae50-d444-465e-99f5-7d35f3944311 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] [instance: 55178126-9766-4875-9122-39dcc87ce82c] Deletion of /opt/stack/data/nova/instances/55178126-9766-4875-9122-39dcc87ce82c_del complete
Apr 14 10:50:47 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:50:47 user nova-compute[71509]: INFO nova.compute.manager [None req-7e37ae50-d444-465e-99f5-7d35f3944311 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] [instance: 55178126-9766-4875-9122-39dcc87ce82c] Took 0.97 seconds to destroy the instance on the hypervisor.
Apr 14 10:50:47 user nova-compute[71509]: DEBUG oslo.service.loopingcall [None req-7e37ae50-d444-465e-99f5-7d35f3944311 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71509) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 10:50:47 user nova-compute[71509]: DEBUG nova.compute.manager [-] [instance: 55178126-9766-4875-9122-39dcc87ce82c] Deallocating network for instance {{(pid=71509) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 10:50:47 user nova-compute[71509]: DEBUG nova.network.neutron [-] [instance: 55178126-9766-4875-9122-39dcc87ce82c] deallocate_for_instance() {{(pid=71509) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 10:50:48 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:50:48 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:50:48 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:50:48 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:50:48 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:50:48 user nova-compute[71509]: DEBUG nova.network.neutron [-] [instance: 55178126-9766-4875-9122-39dcc87ce82c] Updating instance_info_cache with network_info: [] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:50:48 user nova-compute[71509]: INFO nova.compute.manager [-] [instance: 55178126-9766-4875-9122-39dcc87ce82c] Took 0.54 seconds to deallocate network for instance.
Apr 14 10:50:48 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:50:48 user nova-compute[71509]: DEBUG nova.compute.manager [req-d4441180-ab1a-40d4-821e-3ce74d69c86e req-5a6b3913-c913-4481-9210-79543576173b service nova] [instance: 55178126-9766-4875-9122-39dcc87ce82c] Received event network-vif-deleted-578e84c9-8c30-41bb-b61d-8fdeaa0c3a3f {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:50:48 user nova-compute[71509]: INFO nova.compute.manager [req-d4441180-ab1a-40d4-821e-3ce74d69c86e req-5a6b3913-c913-4481-9210-79543576173b service nova] [instance: 55178126-9766-4875-9122-39dcc87ce82c] Neutron deleted interface 578e84c9-8c30-41bb-b61d-8fdeaa0c3a3f; detaching it from the instance and deleting it from the info cache
Apr 14 10:50:48 user nova-compute[71509]: DEBUG nova.network.neutron [req-d4441180-ab1a-40d4-821e-3ce74d69c86e req-5a6b3913-c913-4481-9210-79543576173b service nova] [instance: 55178126-9766-4875-9122-39dcc87ce82c] Updating instance_info_cache with network_info: [] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:50:48 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:50:48 user nova-compute[71509]: DEBUG nova.compute.manager [req-d4441180-ab1a-40d4-821e-3ce74d69c86e req-5a6b3913-c913-4481-9210-79543576173b service nova] [instance: 55178126-9766-4875-9122-39dcc87ce82c] Detach interface failed, port_id=578e84c9-8c30-41bb-b61d-8fdeaa0c3a3f, reason: Instance 55178126-9766-4875-9122-39dcc87ce82c could not be found. {{(pid=71509) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 10:50:48 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-7e37ae50-d444-465e-99f5-7d35f3944311 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:50:48 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-7e37ae50-d444-465e-99f5-7d35f3944311 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:50:48 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-7e37ae50-d444-465e-99f5-7d35f3944311 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 10:50:48 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-7e37ae50-d444-465e-99f5-7d35f3944311 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 10:50:48 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-7e37ae50-d444-465e-99f5-7d35f3944311 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.347s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:50:48 user nova-compute[71509]: INFO nova.scheduler.client.report [None req-7e37ae50-d444-465e-99f5-7d35f3944311 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Deleted allocations for instance 55178126-9766-4875-9122-39dcc87ce82c
Apr 14 10:50:48 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-7e37ae50-d444-465e-99f5-7d35f3944311 tempest-SnapshotDataIntegrityTests-1747462102 tempest-SnapshotDataIntegrityTests-1747462102-project-member] Lock "55178126-9766-4875-9122-39dcc87ce82c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.058s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:50:49 user nova-compute[71509]: DEBUG nova.compute.manager [req-d44b7f14-f8a0-41f2-b67e-9b5cf9743ab5 req-b9cfc56c-6001-4f0b-9d1c-9d5691064da0 service nova] [instance: 55178126-9766-4875-9122-39dcc87ce82c] Received event network-vif-plugged-578e84c9-8c30-41bb-b61d-8fdeaa0c3a3f {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:50:49 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-d44b7f14-f8a0-41f2-b67e-9b5cf9743ab5 req-b9cfc56c-6001-4f0b-9d1c-9d5691064da0 service nova] Acquiring lock "55178126-9766-4875-9122-39dcc87ce82c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:50:49 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-d44b7f14-f8a0-41f2-b67e-9b5cf9743ab5 req-b9cfc56c-6001-4f0b-9d1c-9d5691064da0 service nova] Lock "55178126-9766-4875-9122-39dcc87ce82c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:50:49 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-d44b7f14-f8a0-41f2-b67e-9b5cf9743ab5 req-b9cfc56c-6001-4f0b-9d1c-9d5691064da0 service nova] Lock "55178126-9766-4875-9122-39dcc87ce82c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:50:49 user nova-compute[71509]: DEBUG nova.compute.manager [req-d44b7f14-f8a0-41f2-b67e-9b5cf9743ab5 req-b9cfc56c-6001-4f0b-9d1c-9d5691064da0 service nova] [instance: 55178126-9766-4875-9122-39dcc87ce82c] No waiting events found dispatching network-vif-plugged-578e84c9-8c30-41bb-b61d-8fdeaa0c3a3f {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:50:49 user nova-compute[71509]: WARNING nova.compute.manager [req-d44b7f14-f8a0-41f2-b67e-9b5cf9743ab5 req-b9cfc56c-6001-4f0b-9d1c-9d5691064da0 service nova] [instance: 55178126-9766-4875-9122-39dcc87ce82c] Received unexpected event network-vif-plugged-578e84c9-8c30-41bb-b61d-8fdeaa0c3a3f for instance with vm_state deleted and task_state None.
Apr 14 10:50:49 user nova-compute[71509]: DEBUG nova.compute.manager [req-d44b7f14-f8a0-41f2-b67e-9b5cf9743ab5 req-b9cfc56c-6001-4f0b-9d1c-9d5691064da0 service nova] [instance: 55178126-9766-4875-9122-39dcc87ce82c] Received event network-vif-plugged-578e84c9-8c30-41bb-b61d-8fdeaa0c3a3f {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:50:49 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-d44b7f14-f8a0-41f2-b67e-9b5cf9743ab5 req-b9cfc56c-6001-4f0b-9d1c-9d5691064da0 service nova] Acquiring lock "55178126-9766-4875-9122-39dcc87ce82c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:50:49 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-d44b7f14-f8a0-41f2-b67e-9b5cf9743ab5 req-b9cfc56c-6001-4f0b-9d1c-9d5691064da0 service nova] Lock "55178126-9766-4875-9122-39dcc87ce82c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:50:49 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-d44b7f14-f8a0-41f2-b67e-9b5cf9743ab5 req-b9cfc56c-6001-4f0b-9d1c-9d5691064da0 service nova] Lock "55178126-9766-4875-9122-39dcc87ce82c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:50:49 user nova-compute[71509]: DEBUG nova.compute.manager [req-d44b7f14-f8a0-41f2-b67e-9b5cf9743ab5 req-b9cfc56c-6001-4f0b-9d1c-9d5691064da0 service nova] [instance: 55178126-9766-4875-9122-39dcc87ce82c] No waiting events found dispatching network-vif-plugged-578e84c9-8c30-41bb-b61d-8fdeaa0c3a3f {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:50:49 user nova-compute[71509]: WARNING nova.compute.manager [req-d44b7f14-f8a0-41f2-b67e-9b5cf9743ab5 req-b9cfc56c-6001-4f0b-9d1c-9d5691064da0 service nova] [instance: 55178126-9766-4875-9122-39dcc87ce82c] Received unexpected event network-vif-plugged-578e84c9-8c30-41bb-b61d-8fdeaa0c3a3f for instance with vm_state deleted and task_state None.
Apr 14 10:50:49 user nova-compute[71509]: DEBUG nova.compute.manager [req-d44b7f14-f8a0-41f2-b67e-9b5cf9743ab5 req-b9cfc56c-6001-4f0b-9d1c-9d5691064da0 service nova] [instance: 55178126-9766-4875-9122-39dcc87ce82c] Received event network-vif-plugged-578e84c9-8c30-41bb-b61d-8fdeaa0c3a3f {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:50:49 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-d44b7f14-f8a0-41f2-b67e-9b5cf9743ab5 req-b9cfc56c-6001-4f0b-9d1c-9d5691064da0 service nova] Acquiring lock "55178126-9766-4875-9122-39dcc87ce82c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:50:49 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-d44b7f14-f8a0-41f2-b67e-9b5cf9743ab5 req-b9cfc56c-6001-4f0b-9d1c-9d5691064da0 service nova] Lock "55178126-9766-4875-9122-39dcc87ce82c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:50:49 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-d44b7f14-f8a0-41f2-b67e-9b5cf9743ab5 req-b9cfc56c-6001-4f0b-9d1c-9d5691064da0 service nova] Lock "55178126-9766-4875-9122-39dcc87ce82c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:50:49 user nova-compute[71509]: DEBUG nova.compute.manager [req-d44b7f14-f8a0-41f2-b67e-9b5cf9743ab5 req-b9cfc56c-6001-4f0b-9d1c-9d5691064da0 service nova] [instance: 55178126-9766-4875-9122-39dcc87ce82c] No waiting events found dispatching network-vif-plugged-578e84c9-8c30-41bb-b61d-8fdeaa0c3a3f {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:50:49 user nova-compute[71509]: WARNING nova.compute.manager [req-d44b7f14-f8a0-41f2-b67e-9b5cf9743ab5 req-b9cfc56c-6001-4f0b-9d1c-9d5691064da0 service nova] [instance: 55178126-9766-4875-9122-39dcc87ce82c] Received unexpected event network-vif-plugged-578e84c9-8c30-41bb-b61d-8fdeaa0c3a3f for instance with vm_state deleted and task_state None.
Apr 14 10:50:49 user nova-compute[71509]: DEBUG nova.compute.manager [req-d44b7f14-f8a0-41f2-b67e-9b5cf9743ab5 req-b9cfc56c-6001-4f0b-9d1c-9d5691064da0 service nova] [instance: 55178126-9766-4875-9122-39dcc87ce82c] Received event network-vif-plugged-578e84c9-8c30-41bb-b61d-8fdeaa0c3a3f {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:50:49 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-d44b7f14-f8a0-41f2-b67e-9b5cf9743ab5 req-b9cfc56c-6001-4f0b-9d1c-9d5691064da0 service nova] Acquiring lock "55178126-9766-4875-9122-39dcc87ce82c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:50:49 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-d44b7f14-f8a0-41f2-b67e-9b5cf9743ab5 req-b9cfc56c-6001-4f0b-9d1c-9d5691064da0 service nova] Lock "55178126-9766-4875-9122-39dcc87ce82c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:50:49 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-d44b7f14-f8a0-41f2-b67e-9b5cf9743ab5 req-b9cfc56c-6001-4f0b-9d1c-9d5691064da0 service nova] Lock "55178126-9766-4875-9122-39dcc87ce82c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:50:49 user nova-compute[71509]: DEBUG nova.compute.manager [req-d44b7f14-f8a0-41f2-b67e-9b5cf9743ab5 req-b9cfc56c-6001-4f0b-9d1c-9d5691064da0 service nova] [instance: 55178126-9766-4875-9122-39dcc87ce82c] No waiting events found dispatching network-vif-plugged-578e84c9-8c30-41bb-b61d-8fdeaa0c3a3f {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:50:49 user nova-compute[71509]: WARNING nova.compute.manager [req-d44b7f14-f8a0-41f2-b67e-9b5cf9743ab5 req-b9cfc56c-6001-4f0b-9d1c-9d5691064da0 service nova] [instance: 55178126-9766-4875-9122-39dcc87ce82c] Received unexpected event network-vif-plugged-578e84c9-8c30-41bb-b61d-8fdeaa0c3a3f for instance with vm_state deleted and task_state None.
Apr 14 10:50:52 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:50:57 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 10:51:02 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-fd333215-eee7-48aa-bf5a-2320f9d2dbc2 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Acquiring lock "3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:51:02 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-fd333215-eee7-48aa-bf5a-2320f9d2dbc2 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Lock "3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:51:02 user nova-compute[71509]: DEBUG nova.compute.manager [None req-fd333215-eee7-48aa-bf5a-2320f9d2dbc2 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] [instance: 3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d] Starting instance... {{(pid=71509) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 10:51:02 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-fd333215-eee7-48aa-bf5a-2320f9d2dbc2 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:51:02 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-fd333215-eee7-48aa-bf5a-2320f9d2dbc2 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:51:02 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-fd333215-eee7-48aa-bf5a-2320f9d2dbc2 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71509) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 10:51:02 user nova-compute[71509]: INFO nova.compute.claims [None req-fd333215-eee7-48aa-bf5a-2320f9d2dbc2 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] [instance: 3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d] Claim successful on node user
Apr 14 10:51:02 user nova-compute[71509]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681469447.5243046, 55178126-9766-4875-9122-39dcc87ce82c => Stopped> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 10:51:02 user nova-compute[71509]: INFO nova.compute.manager [-] [instance: 55178126-9766-4875-9122-39dcc87ce82c] VM Stopped (Lifecycle Event)
Apr 14 10:51:02 user nova-compute[71509]: DEBUG nova.compute.manager [None req-8a892a2c-1726-4401-825f-d9c6a1f77924 None None] [instance: 55178126-9766-4875-9122-39dcc87ce82c] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:51:02 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-fd333215-eee7-48aa-bf5a-2320f9d2dbc2 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 10:51:02 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 10:51:02 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:51:02 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71509) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 10:51:02 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71509) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 10:51:02 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71509) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 10:51:02 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:51:02 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-fd333215-eee7-48aa-bf5a-2320f9d2dbc2 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 10:51:02 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-fd333215-eee7-48aa-bf5a-2320f9d2dbc2 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.404s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:51:02 user nova-compute[71509]: DEBUG nova.compute.manager [None req-fd333215-eee7-48aa-bf5a-2320f9d2dbc2 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] [instance: 3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d] Start building networks asynchronously for instance. {{(pid=71509) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 10:51:02 user nova-compute[71509]: DEBUG nova.compute.manager [None req-fd333215-eee7-48aa-bf5a-2320f9d2dbc2 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] [instance: 3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d] Allocating IP information in the background. {{(pid=71509) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 10:51:02 user nova-compute[71509]: DEBUG nova.network.neutron [None req-fd333215-eee7-48aa-bf5a-2320f9d2dbc2 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] [instance: 3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d] allocate_for_instance() {{(pid=71509) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 10:51:02 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-fd333215-eee7-48aa-bf5a-2320f9d2dbc2 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] [instance: 3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 10:51:02 user nova-compute[71509]: DEBUG nova.compute.manager [None req-fd333215-eee7-48aa-bf5a-2320f9d2dbc2 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] [instance: 3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d] Start building block device mappings for instance. {{(pid=71509) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 10:51:02 user nova-compute[71509]: DEBUG nova.compute.manager [None req-fd333215-eee7-48aa-bf5a-2320f9d2dbc2 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] [instance: 3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d] Start spawning the instance on the hypervisor. {{(pid=71509) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 10:51:02 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-fd333215-eee7-48aa-bf5a-2320f9d2dbc2 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] [instance: 3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d] Creating instance directory {{(pid=71509) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 10:51:02 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-fd333215-eee7-48aa-bf5a-2320f9d2dbc2 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] [instance: 3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d] Creating image(s)
Apr 14 10:51:02 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-fd333215-eee7-48aa-bf5a-2320f9d2dbc2 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Acquiring lock "/opt/stack/data/nova/instances/3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:51:02 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-fd333215-eee7-48aa-bf5a-2320f9d2dbc2 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Lock "/opt/stack/data/nova/instances/3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:51:02 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-fd333215-eee7-48aa-bf5a-2320f9d2dbc2 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Lock "/opt/stack/data/nova/instances/3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.035s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:51:02 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-fd333215-eee7-48aa-bf5a-2320f9d2dbc2 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:51:02 user nova-compute[71509]: DEBUG nova.policy [None req-fd333215-eee7-48aa-bf5a-2320f9d2dbc2 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ac498c56dae543cf9e64fbb61ad50df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84a2fac4604454982dc018b36440b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71509) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 10:51:02 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:51:03 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-fd333215-eee7-48aa-bf5a-2320f9d2dbc2 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json" returned: 0 in 0.129s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:51:03 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-fd333215-eee7-48aa-bf5a-2320f9d2dbc2 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Acquiring lock "5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:51:03 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-fd333215-eee7-48aa-bf5a-2320f9d2dbc2 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Lock "5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:51:03 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-fd333215-eee7-48aa-bf5a-2320f9d2dbc2 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:51:03 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-fd333215-eee7-48aa-bf5a-2320f9d2dbc2 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json" returned: 0 in 0.129s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:51:03 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-fd333215-eee7-48aa-bf5a-2320f9d2dbc2 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18,backing_fmt=raw /opt/stack/data/nova/instances/3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d/disk 1073741824 {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:51:03 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-fd333215-eee7-48aa-bf5a-2320f9d2dbc2 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18,backing_fmt=raw /opt/stack/data/nova/instances/3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d/disk 1073741824" returned: 0 in 0.045s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:51:03 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-fd333215-eee7-48aa-bf5a-2320f9d2dbc2 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Lock "5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.182s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:51:03 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-fd333215-eee7-48aa-bf5a-2320f9d2dbc2 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:51:03 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-fd333215-eee7-48aa-bf5a-2320f9d2dbc2 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json" returned: 0 in 0.126s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:51:03 user nova-compute[71509]: DEBUG nova.virt.disk.api [None req-fd333215-eee7-48aa-bf5a-2320f9d2dbc2 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d/disk. size=1073741824 {{(pid=71509) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 10:51:03 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-fd333215-eee7-48aa-bf5a-2320f9d2dbc2 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:51:03 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-fd333215-eee7-48aa-bf5a-2320f9d2dbc2 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:51:03 user nova-compute[71509]: DEBUG nova.virt.disk.api [None req-fd333215-eee7-48aa-bf5a-2320f9d2dbc2 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Cannot resize image /opt/stack/data/nova/instances/3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d/disk to a smaller size. {{(pid=71509) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 10:51:03 user nova-compute[71509]: DEBUG nova.objects.instance [None req-fd333215-eee7-48aa-bf5a-2320f9d2dbc2 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Lazy-loading 'migration_context' on Instance uuid 3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:51:03 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-fd333215-eee7-48aa-bf5a-2320f9d2dbc2 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] [instance: 3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d] Created local disks {{(pid=71509) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 10:51:03 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-fd333215-eee7-48aa-bf5a-2320f9d2dbc2 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] [instance: 3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d] Ensure instance console log exists: /opt/stack/data/nova/instances/3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d/console.log {{(pid=71509) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 10:51:03 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-fd333215-eee7-48aa-bf5a-2320f9d2dbc2 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:51:03 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-fd333215-eee7-48aa-bf5a-2320f9d2dbc2 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:51:03 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-fd333215-eee7-48aa-bf5a-2320f9d2dbc2 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:51:03 user nova-compute[71509]: DEBUG nova.network.neutron [None req-fd333215-eee7-48aa-bf5a-2320f9d2dbc2 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] [instance: 3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d] Successfully created port: ff9ac514-2d14-4580-8d6a-2c525b72a5db {{(pid=71509) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 10:51:04 user nova-compute[71509]: DEBUG nova.network.neutron [None req-fd333215-eee7-48aa-bf5a-2320f9d2dbc2 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] [instance: 3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d] Successfully updated port: ff9ac514-2d14-4580-8d6a-2c525b72a5db {{(pid=71509) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 10:51:04 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-fd333215-eee7-48aa-bf5a-2320f9d2dbc2 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Acquiring lock "refresh_cache-3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:51:04 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-fd333215-eee7-48aa-bf5a-2320f9d2dbc2 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Acquired lock "refresh_cache-3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:51:04 user nova-compute[71509]: DEBUG nova.network.neutron [None req-fd333215-eee7-48aa-bf5a-2320f9d2dbc2 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] [instance: 3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d] Building network info cache for instance {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 10:51:04 user nova-compute[71509]: DEBUG nova.compute.manager [req-621adf82-ec9b-4f68-9410-609ab1e7a048 req-51fec49a-ea17-4318-8b06-82ae1d640bff service nova] [instance: 3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d] Received event network-changed-ff9ac514-2d14-4580-8d6a-2c525b72a5db {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:51:04 user nova-compute[71509]: DEBUG nova.compute.manager [req-621adf82-ec9b-4f68-9410-609ab1e7a048 req-51fec49a-ea17-4318-8b06-82ae1d640bff service nova] [instance: 3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d] Refreshing instance network info cache due to event network-changed-ff9ac514-2d14-4580-8d6a-2c525b72a5db. {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 10:51:04 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-621adf82-ec9b-4f68-9410-609ab1e7a048 req-51fec49a-ea17-4318-8b06-82ae1d640bff service nova] Acquiring lock "refresh_cache-3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:51:04 user nova-compute[71509]: DEBUG nova.network.neutron [None req-fd333215-eee7-48aa-bf5a-2320f9d2dbc2 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] [instance: 3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d] Instance cache missing network info. {{(pid=71509) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 10:51:04 user nova-compute[71509]: DEBUG nova.network.neutron [None req-fd333215-eee7-48aa-bf5a-2320f9d2dbc2 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] [instance: 3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d] Updating instance_info_cache with network_info: [{"id": "ff9ac514-2d14-4580-8d6a-2c525b72a5db", "address": "fa:16:3e:29:66:56", "network": {"id": "4efde76c-8493-4902-a655-f10faee002a4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1588457316-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "a84a2fac4604454982dc018b36440b00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff9ac514-2d", "ovs_interfaceid": "ff9ac514-2d14-4580-8d6a-2c525b72a5db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:51:04 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-fd333215-eee7-48aa-bf5a-2320f9d2dbc2 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Releasing lock "refresh_cache-3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:51:04 user nova-compute[71509]: DEBUG nova.compute.manager [None req-fd333215-eee7-48aa-bf5a-2320f9d2dbc2 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] [instance: 3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d] Instance network_info: |[{"id": "ff9ac514-2d14-4580-8d6a-2c525b72a5db", "address": "fa:16:3e:29:66:56", "network": {"id": "4efde76c-8493-4902-a655-f10faee002a4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1588457316-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "a84a2fac4604454982dc018b36440b00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff9ac514-2d", "ovs_interfaceid": "ff9ac514-2d14-4580-8d6a-2c525b72a5db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71509) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 10:51:04 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-621adf82-ec9b-4f68-9410-609ab1e7a048 req-51fec49a-ea17-4318-8b06-82ae1d640bff service nova] Acquired lock "refresh_cache-3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:51:04 user nova-compute[71509]: DEBUG nova.network.neutron [req-621adf82-ec9b-4f68-9410-609ab1e7a048 req-51fec49a-ea17-4318-8b06-82ae1d640bff service nova] [instance: 3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d] Refreshing network info cache for port ff9ac514-2d14-4580-8d6a-2c525b72a5db {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 10:51:04 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-fd333215-eee7-48aa-bf5a-2320f9d2dbc2 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] [instance: 3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d] Start _get_guest_xml network_info=[{"id": "ff9ac514-2d14-4580-8d6a-2c525b72a5db", "address": "fa:16:3e:29:66:56", "network": {"id": "4efde76c-8493-4902-a655-f10faee002a4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1588457316-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "a84a2fac4604454982dc018b36440b00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff9ac514-2d", "ovs_interfaceid": "ff9ac514-2d14-4580-8d6a-2c525b72a5db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T10:38:55Z,direct_url=<?>,disk_format='qcow2',id=048ec0ee-0465-448d-8b4c-f072acb101dc,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='9742d6ad20cf48d9bab0fdbcc9491db9',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T10:38:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '048ec0ee-0465-448d-8b4c-f072acb101dc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71509) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 10:51:04 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-fd333215-eee7-48aa-bf5a-2320f9d2dbc2 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:51:04 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-fd333215-eee7-48aa-bf5a-2320f9d2dbc2 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:51:04 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-fd333215-eee7-48aa-bf5a-2320f9d2dbc2 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71509) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 10:51:04 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-fd333215-eee7-48aa-bf5a-2320f9d2dbc2 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T10:40:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T10:38:55Z,direct_url=<?>,disk_format='qcow2',id=048ec0ee-0465-448d-8b4c-f072acb101dc,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='9742d6ad20cf48d9bab0fdbcc9491db9',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T10:38:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 10:51:04 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-fd333215-eee7-48aa-bf5a-2320f9d2dbc2 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Flavor limits 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 10:51:04 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-fd333215-eee7-48aa-bf5a-2320f9d2dbc2 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Image limits 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 10:51:04 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-fd333215-eee7-48aa-bf5a-2320f9d2dbc2 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Flavor pref 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 10:51:04 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-fd333215-eee7-48aa-bf5a-2320f9d2dbc2 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Image pref 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 10:51:04 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-fd333215-eee7-48aa-bf5a-2320f9d2dbc2 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 10:51:04 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-fd333215-eee7-48aa-bf5a-2320f9d2dbc2 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 10:51:04 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-fd333215-eee7-48aa-bf5a-2320f9d2dbc2 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71509) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 10:51:04 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-fd333215-eee7-48aa-bf5a-2320f9d2dbc2 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Got 1 possible topologies {{(pid=71509) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 10:51:04 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-fd333215-eee7-48aa-bf5a-2320f9d2dbc2 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 10:51:04 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-fd333215-eee7-48aa-bf5a-2320f9d2dbc2 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 10:51:04 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-fd333215-eee7-48aa-bf5a-2320f9d2dbc2 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T10:51:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1661573828',display_name='tempest-VolumesSnapshotTestJSON-instance-1661573828',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1661573828',id=20,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a84a2fac4604454982dc018b36440b00',ramdisk_id='',reservation_id='r-4ki40nsj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-685456681',owner_user_name='tempest-VolumesSnapshotTestJSON-685456681-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T10:51:03Z,user_data=None,user_id='ac498c56dae543cf9e64fbb61ad50df3',uuid=3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ff9ac514-2d14-4580-8d6a-2c525b72a5db", "address": "fa:16:3e:29:66:56", "network": {"id": "4efde76c-8493-4902-a655-f10faee002a4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1588457316-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "a84a2fac4604454982dc018b36440b00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff9ac514-2d", "ovs_interfaceid": "ff9ac514-2d14-4580-8d6a-2c525b72a5db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71509) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 10:51:04 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-fd333215-eee7-48aa-bf5a-2320f9d2dbc2 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Converting VIF {"id": "ff9ac514-2d14-4580-8d6a-2c525b72a5db", "address": "fa:16:3e:29:66:56", "network": {"id": "4efde76c-8493-4902-a655-f10faee002a4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1588457316-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "a84a2fac4604454982dc018b36440b00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff9ac514-2d", "ovs_interfaceid": "ff9ac514-2d14-4580-8d6a-2c525b72a5db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:51:04 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-fd333215-eee7-48aa-bf5a-2320f9d2dbc2 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:66:56,bridge_name='br-int',has_traffic_filtering=True,id=ff9ac514-2d14-4580-8d6a-2c525b72a5db,network=Network(4efde76c-8493-4902-a655-f10faee002a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff9ac514-2d') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:51:04 user nova-compute[71509]: DEBUG nova.objects.instance [None req-fd333215-eee7-48aa-bf5a-2320f9d2dbc2 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Lazy-loading 'pci_devices' on Instance uuid 3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:51:04 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-fd333215-eee7-48aa-bf5a-2320f9d2dbc2 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] [instance: 3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d] End _get_guest_xml xml=<domain type="kvm">
Apr 14 10:51:04 user nova-compute[71509]:   <uuid>3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d</uuid>
Apr 14 10:51:04 user nova-compute[71509]:   <name>instance-00000014</name>
Apr 14 10:51:04 user nova-compute[71509]:   <memory>131072</memory>
Apr 14 10:51:04 user nova-compute[71509]:   <vcpu>1</vcpu>
Apr 14 10:51:04 user nova-compute[71509]:   <metadata>
Apr 14 10:51:04 user nova-compute[71509]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 10:51:04 user nova-compute[71509]:       <nova:package version="0.0.0"/>
Apr 14 10:51:04 user nova-compute[71509]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1661573828</nova:name>
Apr 14 10:51:04 user nova-compute[71509]:       <nova:creationTime>2023-04-14 10:51:04</nova:creationTime>
Apr 14 10:51:04 user nova-compute[71509]:       <nova:flavor name="m1.nano">
Apr 14 10:51:04 user nova-compute[71509]:         <nova:memory>128</nova:memory>
Apr 14 10:51:04 user nova-compute[71509]:         <nova:disk>1</nova:disk>
Apr 14 10:51:04 user nova-compute[71509]:         <nova:swap>0</nova:swap>
Apr 14 10:51:04 user nova-compute[71509]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 10:51:04 user nova-compute[71509]:         <nova:vcpus>1</nova:vcpus>
Apr 14 10:51:04 user nova-compute[71509]:       </nova:flavor>
Apr 14 10:51:04 user nova-compute[71509]:       <nova:owner>
Apr 14 10:51:04 user nova-compute[71509]:         <nova:user uuid="ac498c56dae543cf9e64fbb61ad50df3">tempest-VolumesSnapshotTestJSON-685456681-project-member</nova:user>
Apr 14 10:51:04 user nova-compute[71509]:         <nova:project uuid="a84a2fac4604454982dc018b36440b00">tempest-VolumesSnapshotTestJSON-685456681</nova:project>
Apr 14 10:51:04 user nova-compute[71509]:       </nova:owner>
Apr 14 10:51:04 user nova-compute[71509]:       <nova:root type="image" uuid="048ec0ee-0465-448d-8b4c-f072acb101dc"/>
Apr 14 10:51:04 user nova-compute[71509]:       <nova:ports>
Apr 14 10:51:04 user nova-compute[71509]:         <nova:port uuid="ff9ac514-2d14-4580-8d6a-2c525b72a5db">
Apr 14 10:51:04 user nova-compute[71509]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 14 10:51:04 user nova-compute[71509]:         </nova:port>
Apr 14 10:51:04 user nova-compute[71509]:       </nova:ports>
Apr 14 10:51:04 user nova-compute[71509]:     </nova:instance>
Apr 14 10:51:04 user nova-compute[71509]:   </metadata>
Apr 14 10:51:04 user nova-compute[71509]:   <sysinfo type="smbios">
Apr 14 10:51:04 user nova-compute[71509]:     <system>
Apr 14 10:51:04 user nova-compute[71509]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 10:51:04 user nova-compute[71509]:       <entry name="product">OpenStack Nova</entry>
Apr 14 10:51:04 user nova-compute[71509]:       <entry name="version">0.0.0</entry>
Apr 14 10:51:04 user nova-compute[71509]:       <entry name="serial">3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d</entry>
Apr 14 10:51:04 user nova-compute[71509]:       <entry name="uuid">3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d</entry>
Apr 14 10:51:04 user nova-compute[71509]:       <entry name="family">Virtual Machine</entry>
Apr 14 10:51:04 user nova-compute[71509]:     </system>
Apr 14 10:51:04 user nova-compute[71509]:   </sysinfo>
Apr 14 10:51:04 user nova-compute[71509]:   <os>
Apr 14 10:51:04 user nova-compute[71509]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 10:51:04 user nova-compute[71509]:     <boot dev="hd"/>
Apr 14 10:51:04 user nova-compute[71509]:     <smbios mode="sysinfo"/>
Apr 14 10:51:04 user nova-compute[71509]:   </os>
Apr 14 10:51:04 user nova-compute[71509]:   <features>
Apr 14 10:51:04 user nova-compute[71509]:     <acpi/>
Apr 14 10:51:04 user nova-compute[71509]:     <apic/>
Apr 14 10:51:04 user nova-compute[71509]:     <vmcoreinfo/>
Apr 14 10:51:04 user nova-compute[71509]:   </features>
Apr 14 10:51:04 user nova-compute[71509]:   <clock offset="utc">
Apr 14 10:51:04 user nova-compute[71509]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 10:51:04 user nova-compute[71509]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 10:51:04 user nova-compute[71509]:     <timer name="hpet" present="no"/>
Apr 14 10:51:04 user nova-compute[71509]:   </clock>
Apr 14 10:51:04 user nova-compute[71509]:   <cpu mode="custom" match="exact">
Apr 14 10:51:04 user nova-compute[71509]:     <model>Nehalem</model>
Apr 14 10:51:04 user nova-compute[71509]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 10:51:04 user nova-compute[71509]:   </cpu>
Apr 14 10:51:04 user nova-compute[71509]:   <devices>
Apr 14 10:51:04 user nova-compute[71509]:     <disk type="file" device="disk">
Apr 14 10:51:04 user nova-compute[71509]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 10:51:04 user nova-compute[71509]:       <source file="/opt/stack/data/nova/instances/3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d/disk"/>
Apr 14 10:51:04 user nova-compute[71509]:       <target dev="vda" bus="virtio"/>
Apr 14 10:51:04 user nova-compute[71509]:     </disk>
Apr 14 10:51:04 user nova-compute[71509]:     <interface type="ethernet">
Apr 14 10:51:04 user nova-compute[71509]:       <mac address="fa:16:3e:29:66:56"/>
Apr 14 10:51:04 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 10:51:04 user nova-compute[71509]:       <mtu size="1442"/>
Apr 14 10:51:04 user nova-compute[71509]:       <target dev="tapff9ac514-2d"/>
Apr 14 10:51:04 user nova-compute[71509]:     </interface>
Apr 14 10:51:04 user nova-compute[71509]:     <serial type="pty">
Apr 14 10:51:04 user nova-compute[71509]:       <log file="/opt/stack/data/nova/instances/3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d/console.log" append="off"/>
Apr 14 10:51:04 user nova-compute[71509]:     </serial>
Apr 14 10:51:04 user nova-compute[71509]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 10:51:04 user nova-compute[71509]:     <video>
Apr 14 10:51:04 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 10:51:04 user nova-compute[71509]:     </video>
Apr 14 10:51:04 user nova-compute[71509]:     <rng model="virtio">
Apr 14 10:51:04 user nova-compute[71509]:       <backend model="random">/dev/urandom</backend>
Apr 14 10:51:04 user nova-compute[71509]:     </rng>
Apr 14 10:51:04 user nova-compute[71509]:     <controller type="usb" index="0" model="none"/>
Apr 14 10:51:04 user nova-compute[71509]:     <memballoon model="virtio">
Apr 14 10:51:04 user nova-compute[71509]:       <stats period="10"/>
Apr 14 10:51:04 user nova-compute[71509]:     </memballoon>
Apr 14 10:51:04 user nova-compute[71509]:   </devices>
Apr 14 10:51:04 user nova-compute[71509]: </domain>
Apr 14 10:51:04 user nova-compute[71509]:  {{(pid=71509) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 10:51:04 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-fd333215-eee7-48aa-bf5a-2320f9d2dbc2 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T10:51:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1661573828',display_name='tempest-VolumesSnapshotTestJSON-instance-1661573828',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1661573828',id=20,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a84a2fac4604454982dc018b36440b00',ramdisk_id='',reservation_id='r-4ki40nsj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-685456681',owner_user_name='tempest-VolumesSnapshotTestJSON-685456681-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T10:51:03Z,user_data=None,user_id='ac498c56dae543cf9e64fbb61ad50df3',uuid=3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ff9ac514-2d14-4580-8d6a-2c525b72a5db", "address": "fa:16:3e:29:66:56", "network": {"id": "4efde76c-8493-4902-a655-f10faee002a4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1588457316-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "a84a2fac4604454982dc018b36440b00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff9ac514-2d", "ovs_interfaceid": "ff9ac514-2d14-4580-8d6a-2c525b72a5db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 10:51:04 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-fd333215-eee7-48aa-bf5a-2320f9d2dbc2 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Converting VIF {"id": "ff9ac514-2d14-4580-8d6a-2c525b72a5db", "address": "fa:16:3e:29:66:56", "network": {"id": "4efde76c-8493-4902-a655-f10faee002a4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1588457316-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "a84a2fac4604454982dc018b36440b00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff9ac514-2d", "ovs_interfaceid": "ff9ac514-2d14-4580-8d6a-2c525b72a5db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:51:04 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-fd333215-eee7-48aa-bf5a-2320f9d2dbc2 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:66:56,bridge_name='br-int',has_traffic_filtering=True,id=ff9ac514-2d14-4580-8d6a-2c525b72a5db,network=Network(4efde76c-8493-4902-a655-f10faee002a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff9ac514-2d') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:51:04 user nova-compute[71509]: DEBUG os_vif [None req-fd333215-eee7-48aa-bf5a-2320f9d2dbc2 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:66:56,bridge_name='br-int',has_traffic_filtering=True,id=ff9ac514-2d14-4580-8d6a-2c525b72a5db,network=Network(4efde76c-8493-4902-a655-f10faee002a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff9ac514-2d') {{(pid=71509) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 10:51:04 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:51:04 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:51:04 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 10:51:04 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:51:04 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapff9ac514-2d, may_exist=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:51:04 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapff9ac514-2d, col_values=(('external_ids', {'iface-id': 'ff9ac514-2d14-4580-8d6a-2c525b72a5db', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:29:66:56', 'vm-uuid': '3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d'}),)) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:51:04 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:51:04 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 10:51:04 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:51:04 user nova-compute[71509]: INFO os_vif [None req-fd333215-eee7-48aa-bf5a-2320f9d2dbc2 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:66:56,bridge_name='br-int',has_traffic_filtering=True,id=ff9ac514-2d14-4580-8d6a-2c525b72a5db,network=Network(4efde76c-8493-4902-a655-f10faee002a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff9ac514-2d')
Apr 14 10:51:04 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-fd333215-eee7-48aa-bf5a-2320f9d2dbc2 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] No BDM found with device name vda, not building metadata. {{(pid=71509) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 10:51:04 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-fd333215-eee7-48aa-bf5a-2320f9d2dbc2 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] No VIF found with MAC fa:16:3e:29:66:56, not building metadata {{(pid=71509) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 10:51:05 user nova-compute[71509]: DEBUG nova.network.neutron [req-621adf82-ec9b-4f68-9410-609ab1e7a048 req-51fec49a-ea17-4318-8b06-82ae1d640bff service nova] [instance: 3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d] Updated VIF entry in instance network info cache for port ff9ac514-2d14-4580-8d6a-2c525b72a5db. {{(pid=71509) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 10:51:05 user nova-compute[71509]: DEBUG nova.network.neutron [req-621adf82-ec9b-4f68-9410-609ab1e7a048 req-51fec49a-ea17-4318-8b06-82ae1d640bff service nova] [instance: 3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d] Updating instance_info_cache with network_info: [{"id": "ff9ac514-2d14-4580-8d6a-2c525b72a5db", "address": "fa:16:3e:29:66:56", "network": {"id": "4efde76c-8493-4902-a655-f10faee002a4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1588457316-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "a84a2fac4604454982dc018b36440b00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff9ac514-2d", "ovs_interfaceid": "ff9ac514-2d14-4580-8d6a-2c525b72a5db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:51:05 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-621adf82-ec9b-4f68-9410-609ab1e7a048 req-51fec49a-ea17-4318-8b06-82ae1d640bff service nova] Releasing lock "refresh_cache-3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:51:05 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-35324608-42fb-44f4-a358-be97893a4b59 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Acquiring lock "3b4b6e3e-0743-4ee6-900c-3172b09eb0f2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:51:05 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-35324608-42fb-44f4-a358-be97893a4b59 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Lock "3b4b6e3e-0743-4ee6-900c-3172b09eb0f2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:51:05 user nova-compute[71509]: DEBUG nova.compute.manager [None req-35324608-42fb-44f4-a358-be97893a4b59 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] [instance: 3b4b6e3e-0743-4ee6-900c-3172b09eb0f2] Starting instance... {{(pid=71509) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 10:51:05 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-35324608-42fb-44f4-a358-be97893a4b59 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:51:05 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-35324608-42fb-44f4-a358-be97893a4b59 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:51:05 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-35324608-42fb-44f4-a358-be97893a4b59 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71509) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 10:51:05 user nova-compute[71509]: INFO nova.compute.claims [None req-35324608-42fb-44f4-a358-be97893a4b59 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] [instance: 3b4b6e3e-0743-4ee6-900c-3172b09eb0f2] Claim successful on node user
Apr 14 10:51:06 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-35324608-42fb-44f4-a358-be97893a4b59 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 10:51:06 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:51:06 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-35324608-42fb-44f4-a358-be97893a4b59 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 10:51:06 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-35324608-42fb-44f4-a358-be97893a4b59 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.442s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:51:06 user nova-compute[71509]: DEBUG nova.compute.manager [None req-35324608-42fb-44f4-a358-be97893a4b59 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] [instance: 3b4b6e3e-0743-4ee6-900c-3172b09eb0f2] Start building networks asynchronously for instance. {{(pid=71509) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 10:51:06 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:51:06 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:51:06 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:51:06 user nova-compute[71509]: DEBUG nova.compute.manager [None req-35324608-42fb-44f4-a358-be97893a4b59 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] [instance: 3b4b6e3e-0743-4ee6-900c-3172b09eb0f2] Allocating IP information in the background. {{(pid=71509) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 10:51:06 user nova-compute[71509]: DEBUG nova.network.neutron [None req-35324608-42fb-44f4-a358-be97893a4b59 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] [instance: 3b4b6e3e-0743-4ee6-900c-3172b09eb0f2] allocate_for_instance() {{(pid=71509) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 10:51:06 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-35324608-42fb-44f4-a358-be97893a4b59 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] [instance: 3b4b6e3e-0743-4ee6-900c-3172b09eb0f2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 10:51:06 user nova-compute[71509]: DEBUG nova.compute.manager [None req-35324608-42fb-44f4-a358-be97893a4b59 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] [instance: 3b4b6e3e-0743-4ee6-900c-3172b09eb0f2] Start building block device mappings for instance. {{(pid=71509) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 10:51:06 user nova-compute[71509]: DEBUG nova.policy [None req-35324608-42fb-44f4-a358-be97893a4b59 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6adefa90332c42c79a1372258a7be5ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aca26975e5ad4524b4b1b1ec4335802f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71509) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 10:51:06 user nova-compute[71509]: DEBUG nova.compute.manager [None req-35324608-42fb-44f4-a358-be97893a4b59 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] [instance: 3b4b6e3e-0743-4ee6-900c-3172b09eb0f2] Start spawning the instance on the hypervisor. {{(pid=71509) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 10:51:06 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-35324608-42fb-44f4-a358-be97893a4b59 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] [instance: 3b4b6e3e-0743-4ee6-900c-3172b09eb0f2] Creating instance directory {{(pid=71509) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 10:51:06 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-35324608-42fb-44f4-a358-be97893a4b59 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] [instance: 3b4b6e3e-0743-4ee6-900c-3172b09eb0f2] Creating image(s)
Apr 14 10:51:06 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-35324608-42fb-44f4-a358-be97893a4b59 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Acquiring lock "/opt/stack/data/nova/instances/3b4b6e3e-0743-4ee6-900c-3172b09eb0f2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:51:06 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-35324608-42fb-44f4-a358-be97893a4b59 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Lock "/opt/stack/data/nova/instances/3b4b6e3e-0743-4ee6-900c-3172b09eb0f2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:51:06 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-35324608-42fb-44f4-a358-be97893a4b59 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Lock "/opt/stack/data/nova/instances/3b4b6e3e-0743-4ee6-900c-3172b09eb0f2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:51:06 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-35324608-42fb-44f4-a358-be97893a4b59 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:51:06 user nova-compute[71509]: DEBUG nova.compute.manager [req-7800ccf9-ff6a-4605-a59e-c7b717897bb3 req-30c5477e-e14f-4046-a5ee-78ac9db065bd service nova] [instance: 3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d] Received event network-vif-plugged-ff9ac514-2d14-4580-8d6a-2c525b72a5db {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:51:06 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-7800ccf9-ff6a-4605-a59e-c7b717897bb3 req-30c5477e-e14f-4046-a5ee-78ac9db065bd service nova] Acquiring lock "3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:51:06 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-7800ccf9-ff6a-4605-a59e-c7b717897bb3 req-30c5477e-e14f-4046-a5ee-78ac9db065bd service nova] Lock "3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:51:06 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-7800ccf9-ff6a-4605-a59e-c7b717897bb3 req-30c5477e-e14f-4046-a5ee-78ac9db065bd service nova] Lock "3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:51:06 user nova-compute[71509]: DEBUG nova.compute.manager [req-7800ccf9-ff6a-4605-a59e-c7b717897bb3 req-30c5477e-e14f-4046-a5ee-78ac9db065bd service nova] [instance: 3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d] No waiting events found dispatching network-vif-plugged-ff9ac514-2d14-4580-8d6a-2c525b72a5db {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:51:06 user nova-compute[71509]: WARNING nova.compute.manager [req-7800ccf9-ff6a-4605-a59e-c7b717897bb3 req-30c5477e-e14f-4046-a5ee-78ac9db065bd service nova] [instance: 3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d] Received unexpected event network-vif-plugged-ff9ac514-2d14-4580-8d6a-2c525b72a5db for instance with vm_state building and task_state spawning.
Apr 14 10:51:06 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-35324608-42fb-44f4-a358-be97893a4b59 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json" returned: 0 in 0.163s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:51:06 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-35324608-42fb-44f4-a358-be97893a4b59 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Acquiring lock "5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:51:06 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-35324608-42fb-44f4-a358-be97893a4b59 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Lock "5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:51:06 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-35324608-42fb-44f4-a358-be97893a4b59 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:51:06 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-35324608-42fb-44f4-a358-be97893a4b59 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json" returned: 0 in 0.149s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:51:06 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-35324608-42fb-44f4-a358-be97893a4b59 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18,backing_fmt=raw /opt/stack/data/nova/instances/3b4b6e3e-0743-4ee6-900c-3172b09eb0f2/disk 1073741824 {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:51:06 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-35324608-42fb-44f4-a358-be97893a4b59 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18,backing_fmt=raw /opt/stack/data/nova/instances/3b4b6e3e-0743-4ee6-900c-3172b09eb0f2/disk 1073741824" returned: 0 in 0.051s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:51:06 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-35324608-42fb-44f4-a358-be97893a4b59 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Lock "5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.207s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:51:06 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-35324608-42fb-44f4-a358-be97893a4b59 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:51:07 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-35324608-42fb-44f4-a358-be97893a4b59 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json" returned: 0 in 0.140s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:51:07 user nova-compute[71509]: DEBUG nova.virt.disk.api [None req-35324608-42fb-44f4-a358-be97893a4b59 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3b4b6e3e-0743-4ee6-900c-3172b09eb0f2/disk. size=1073741824 {{(pid=71509) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 10:51:07 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-35324608-42fb-44f4-a358-be97893a4b59 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b4b6e3e-0743-4ee6-900c-3172b09eb0f2/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:51:07 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-35324608-42fb-44f4-a358-be97893a4b59 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b4b6e3e-0743-4ee6-900c-3172b09eb0f2/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:51:07 user nova-compute[71509]: DEBUG nova.virt.disk.api [None req-35324608-42fb-44f4-a358-be97893a4b59 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Cannot resize image /opt/stack/data/nova/instances/3b4b6e3e-0743-4ee6-900c-3172b09eb0f2/disk to a smaller size. {{(pid=71509) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 10:51:07 user nova-compute[71509]: DEBUG nova.objects.instance [None req-35324608-42fb-44f4-a358-be97893a4b59 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Lazy-loading 'migration_context' on Instance uuid 3b4b6e3e-0743-4ee6-900c-3172b09eb0f2 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:51:07 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-35324608-42fb-44f4-a358-be97893a4b59 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] [instance: 3b4b6e3e-0743-4ee6-900c-3172b09eb0f2] Created local disks {{(pid=71509) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 10:51:07 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-35324608-42fb-44f4-a358-be97893a4b59 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] [instance: 3b4b6e3e-0743-4ee6-900c-3172b09eb0f2] Ensure instance console log exists: /opt/stack/data/nova/instances/3b4b6e3e-0743-4ee6-900c-3172b09eb0f2/console.log {{(pid=71509) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 10:51:07 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-35324608-42fb-44f4-a358-be97893a4b59 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:51:07 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-35324608-42fb-44f4-a358-be97893a4b59 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:51:07 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-35324608-42fb-44f4-a358-be97893a4b59 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:51:07 user nova-compute[71509]: DEBUG nova.network.neutron [None req-35324608-42fb-44f4-a358-be97893a4b59 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] [instance: 3b4b6e3e-0743-4ee6-900c-3172b09eb0f2] Successfully created port: 2f4949b3-11d4-4970-878c-49a35c428147 {{(pid=71509) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 10:51:07 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:51:08 user nova-compute[71509]: DEBUG nova.network.neutron [None req-35324608-42fb-44f4-a358-be97893a4b59 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] [instance: 3b4b6e3e-0743-4ee6-900c-3172b09eb0f2] Successfully updated port: 2f4949b3-11d4-4970-878c-49a35c428147 {{(pid=71509) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 10:51:08 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-35324608-42fb-44f4-a358-be97893a4b59 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Acquiring lock "refresh_cache-3b4b6e3e-0743-4ee6-900c-3172b09eb0f2" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:51:08 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-35324608-42fb-44f4-a358-be97893a4b59 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Acquired lock "refresh_cache-3b4b6e3e-0743-4ee6-900c-3172b09eb0f2" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:51:08 user nova-compute[71509]: DEBUG nova.network.neutron [None req-35324608-42fb-44f4-a358-be97893a4b59 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] [instance: 3b4b6e3e-0743-4ee6-900c-3172b09eb0f2] Building network info cache for instance {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 10:51:08 user nova-compute[71509]: DEBUG nova.network.neutron [None req-35324608-42fb-44f4-a358-be97893a4b59 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] [instance: 3b4b6e3e-0743-4ee6-900c-3172b09eb0f2] Instance cache missing network info. {{(pid=71509) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 10:51:08 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681469468.3032477, 3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d => Resumed> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 10:51:08 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d] VM Resumed (Lifecycle Event)
Apr 14 10:51:08 user nova-compute[71509]: DEBUG nova.compute.manager [None req-fd333215-eee7-48aa-bf5a-2320f9d2dbc2 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] [instance: 3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d] Instance event wait completed in 0 seconds for  {{(pid=71509) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 10:51:08 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-fd333215-eee7-48aa-bf5a-2320f9d2dbc2 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] [instance: 3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d] Guest created on hypervisor {{(pid=71509) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 10:51:08 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: 3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d] Instance spawned successfully.
Apr 14 10:51:08 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-fd333215-eee7-48aa-bf5a-2320f9d2dbc2 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] [instance: 3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 10:51:08 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:51:08 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 10:51:08 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-fd333215-eee7-48aa-bf5a-2320f9d2dbc2 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] [instance: 3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d] Found default for hw_cdrom_bus of ide {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:51:08 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-fd333215-eee7-48aa-bf5a-2320f9d2dbc2 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] [instance: 3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d] Found default for hw_disk_bus of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:51:08 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-fd333215-eee7-48aa-bf5a-2320f9d2dbc2 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] [instance: 3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d] Found default for hw_input_bus of None {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:51:08 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-fd333215-eee7-48aa-bf5a-2320f9d2dbc2 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] [instance: 3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d] Found default for hw_pointer_model of None {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:51:08 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-fd333215-eee7-48aa-bf5a-2320f9d2dbc2 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] [instance: 3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d] Found default for hw_video_model of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:51:08 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-fd333215-eee7-48aa-bf5a-2320f9d2dbc2 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] [instance: 3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d] Found default for hw_vif_model of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:51:08 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 10:51:08 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681469468.3074646, 3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d => Started> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 10:51:08 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d] VM Started (Lifecycle Event)
Apr 14 10:51:08 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:51:08 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 10:51:08 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 10:51:08 user nova-compute[71509]: INFO nova.compute.manager [None req-fd333215-eee7-48aa-bf5a-2320f9d2dbc2 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] [instance: 3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d] Took 5.58 seconds to spawn the instance on the hypervisor.
Apr 14 10:51:08 user nova-compute[71509]: DEBUG nova.compute.manager [None req-fd333215-eee7-48aa-bf5a-2320f9d2dbc2 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] [instance: 3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:51:08 user nova-compute[71509]: DEBUG nova.network.neutron [None req-35324608-42fb-44f4-a358-be97893a4b59 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] [instance: 3b4b6e3e-0743-4ee6-900c-3172b09eb0f2] Updating instance_info_cache with network_info: [{"id": "2f4949b3-11d4-4970-878c-49a35c428147", "address": "fa:16:3e:26:93:bd", "network": {"id": "36ccc911-348d-426a-ba7b-a49a0bfb0f97", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-256080753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aca26975e5ad4524b4b1b1ec4335802f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f4949b3-11", "ovs_interfaceid": "2f4949b3-11d4-4970-878c-49a35c428147", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:51:08 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-35324608-42fb-44f4-a358-be97893a4b59 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Releasing lock "refresh_cache-3b4b6e3e-0743-4ee6-900c-3172b09eb0f2" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:51:08 user nova-compute[71509]: DEBUG nova.compute.manager [None req-35324608-42fb-44f4-a358-be97893a4b59 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] [instance: 3b4b6e3e-0743-4ee6-900c-3172b09eb0f2] Instance network_info: |[{"id": "2f4949b3-11d4-4970-878c-49a35c428147", "address": "fa:16:3e:26:93:bd", "network": {"id": "36ccc911-348d-426a-ba7b-a49a0bfb0f97", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-256080753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aca26975e5ad4524b4b1b1ec4335802f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f4949b3-11", "ovs_interfaceid": "2f4949b3-11d4-4970-878c-49a35c428147", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71509) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 10:51:08 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-35324608-42fb-44f4-a358-be97893a4b59 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] [instance: 3b4b6e3e-0743-4ee6-900c-3172b09eb0f2] Start _get_guest_xml network_info=[{"id": "2f4949b3-11d4-4970-878c-49a35c428147", "address": "fa:16:3e:26:93:bd", "network": {"id": "36ccc911-348d-426a-ba7b-a49a0bfb0f97", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-256080753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aca26975e5ad4524b4b1b1ec4335802f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f4949b3-11", "ovs_interfaceid": "2f4949b3-11d4-4970-878c-49a35c428147", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T10:38:55Z,direct_url=<?>,disk_format='qcow2',id=048ec0ee-0465-448d-8b4c-f072acb101dc,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='9742d6ad20cf48d9bab0fdbcc9491db9',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T10:38:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '048ec0ee-0465-448d-8b4c-f072acb101dc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71509) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 10:51:08 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:51:08 user nova-compute[71509]: INFO nova.compute.manager [None req-fd333215-eee7-48aa-bf5a-2320f9d2dbc2 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] [instance: 3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d] Took 6.34 seconds to build instance.
Apr 14 10:51:08 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-35324608-42fb-44f4-a358-be97893a4b59 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:51:08 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-35324608-42fb-44f4-a358-be97893a4b59 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:51:08 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-35324608-42fb-44f4-a358-be97893a4b59 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71509) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 10:51:08 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-35324608-42fb-44f4-a358-be97893a4b59 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T10:40:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T10:38:55Z,direct_url=<?>,disk_format='qcow2',id=048ec0ee-0465-448d-8b4c-f072acb101dc,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='9742d6ad20cf48d9bab0fdbcc9491db9',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T10:38:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 10:51:08 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-35324608-42fb-44f4-a358-be97893a4b59 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Flavor limits 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 10:51:08 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-35324608-42fb-44f4-a358-be97893a4b59 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Image limits 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 10:51:08 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-35324608-42fb-44f4-a358-be97893a4b59 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Flavor pref 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 10:51:08 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-35324608-42fb-44f4-a358-be97893a4b59 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Image pref 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 10:51:08 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-35324608-42fb-44f4-a358-be97893a4b59 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 10:51:08 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-35324608-42fb-44f4-a358-be97893a4b59 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 10:51:08 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-35324608-42fb-44f4-a358-be97893a4b59 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71509) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 10:51:08 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-35324608-42fb-44f4-a358-be97893a4b59 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Got 1 possible topologies {{(pid=71509) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 10:51:08 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-35324608-42fb-44f4-a358-be97893a4b59 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 10:51:08 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-35324608-42fb-44f4-a358-be97893a4b59 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 10:51:08 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-35324608-42fb-44f4-a358-be97893a4b59 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T10:51:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1788483212',display_name='tempest-VolumesAdminNegativeTest-server-1788483212',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1788483212',id=21,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aca26975e5ad4524b4b1b1ec4335802f',ramdisk_id='',reservation_id='r-d8jhzy5t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-5408590',owner_user_name='tempest-VolumesAdminNegativeTest-5408590-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T10:51:06Z,user_data=None,user_id='6adefa90332c42c79a1372258a7be5ab',uuid=3b4b6e3e-0743-4ee6-900c-3172b09eb0f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2f4949b3-11d4-4970-878c-49a35c428147", "address": "fa:16:3e:26:93:bd", "network": {"id": "36ccc911-348d-426a-ba7b-a49a0bfb0f97", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-256080753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aca26975e5ad4524b4b1b1ec4335802f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f4949b3-11", "ovs_interfaceid": "2f4949b3-11d4-4970-878c-49a35c428147", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71509) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 10:51:08 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-35324608-42fb-44f4-a358-be97893a4b59 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Converting VIF {"id": "2f4949b3-11d4-4970-878c-49a35c428147", "address": "fa:16:3e:26:93:bd", "network": {"id": "36ccc911-348d-426a-ba7b-a49a0bfb0f97", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-256080753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aca26975e5ad4524b4b1b1ec4335802f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f4949b3-11", "ovs_interfaceid": "2f4949b3-11d4-4970-878c-49a35c428147", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:51:08 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-35324608-42fb-44f4-a358-be97893a4b59 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:93:bd,bridge_name='br-int',has_traffic_filtering=True,id=2f4949b3-11d4-4970-878c-49a35c428147,network=Network(36ccc911-348d-426a-ba7b-a49a0bfb0f97),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f4949b3-11') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:51:08 user nova-compute[71509]: DEBUG nova.objects.instance [None req-35324608-42fb-44f4-a358-be97893a4b59 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Lazy-loading 'pci_devices' on Instance uuid 3b4b6e3e-0743-4ee6-900c-3172b09eb0f2 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:51:08 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-fd333215-eee7-48aa-bf5a-2320f9d2dbc2 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Lock "3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.459s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:51:08 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-35324608-42fb-44f4-a358-be97893a4b59 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] [instance: 3b4b6e3e-0743-4ee6-900c-3172b09eb0f2] End _get_guest_xml xml=<domain type="kvm">
Apr 14 10:51:08 user nova-compute[71509]:   <uuid>3b4b6e3e-0743-4ee6-900c-3172b09eb0f2</uuid>
Apr 14 10:51:08 user nova-compute[71509]:   <name>instance-00000015</name>
Apr 14 10:51:08 user nova-compute[71509]:   <memory>131072</memory>
Apr 14 10:51:08 user nova-compute[71509]:   <vcpu>1</vcpu>
Apr 14 10:51:08 user nova-compute[71509]:   <metadata>
Apr 14 10:51:08 user nova-compute[71509]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 10:51:08 user nova-compute[71509]:       <nova:package version="0.0.0"/>
Apr 14 10:51:08 user nova-compute[71509]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1788483212</nova:name>
Apr 14 10:51:08 user nova-compute[71509]:       <nova:creationTime>2023-04-14 10:51:08</nova:creationTime>
Apr 14 10:51:08 user nova-compute[71509]:       <nova:flavor name="m1.nano">
Apr 14 10:51:08 user nova-compute[71509]:         <nova:memory>128</nova:memory>
Apr 14 10:51:08 user nova-compute[71509]:         <nova:disk>1</nova:disk>
Apr 14 10:51:08 user nova-compute[71509]:         <nova:swap>0</nova:swap>
Apr 14 10:51:08 user nova-compute[71509]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 10:51:08 user nova-compute[71509]:         <nova:vcpus>1</nova:vcpus>
Apr 14 10:51:08 user nova-compute[71509]:       </nova:flavor>
Apr 14 10:51:08 user nova-compute[71509]:       <nova:owner>
Apr 14 10:51:08 user nova-compute[71509]:         <nova:user uuid="6adefa90332c42c79a1372258a7be5ab">tempest-VolumesAdminNegativeTest-5408590-project-member</nova:user>
Apr 14 10:51:08 user nova-compute[71509]:         <nova:project uuid="aca26975e5ad4524b4b1b1ec4335802f">tempest-VolumesAdminNegativeTest-5408590</nova:project>
Apr 14 10:51:08 user nova-compute[71509]:       </nova:owner>
Apr 14 10:51:08 user nova-compute[71509]:       <nova:root type="image" uuid="048ec0ee-0465-448d-8b4c-f072acb101dc"/>
Apr 14 10:51:08 user nova-compute[71509]:       <nova:ports>
Apr 14 10:51:08 user nova-compute[71509]:         <nova:port uuid="2f4949b3-11d4-4970-878c-49a35c428147">
Apr 14 10:51:08 user nova-compute[71509]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 14 10:51:08 user nova-compute[71509]:         </nova:port>
Apr 14 10:51:08 user nova-compute[71509]:       </nova:ports>
Apr 14 10:51:08 user nova-compute[71509]:     </nova:instance>
Apr 14 10:51:08 user nova-compute[71509]:   </metadata>
Apr 14 10:51:08 user nova-compute[71509]:   <sysinfo type="smbios">
Apr 14 10:51:08 user nova-compute[71509]:     <system>
Apr 14 10:51:08 user nova-compute[71509]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 10:51:08 user nova-compute[71509]:       <entry name="product">OpenStack Nova</entry>
Apr 14 10:51:08 user nova-compute[71509]:       <entry name="version">0.0.0</entry>
Apr 14 10:51:08 user nova-compute[71509]:       <entry name="serial">3b4b6e3e-0743-4ee6-900c-3172b09eb0f2</entry>
Apr 14 10:51:08 user nova-compute[71509]:       <entry name="uuid">3b4b6e3e-0743-4ee6-900c-3172b09eb0f2</entry>
Apr 14 10:51:08 user nova-compute[71509]:       <entry name="family">Virtual Machine</entry>
Apr 14 10:51:08 user nova-compute[71509]:     </system>
Apr 14 10:51:08 user nova-compute[71509]:   </sysinfo>
Apr 14 10:51:08 user nova-compute[71509]:   <os>
Apr 14 10:51:08 user nova-compute[71509]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 10:51:08 user nova-compute[71509]:     <boot dev="hd"/>
Apr 14 10:51:08 user nova-compute[71509]:     <smbios mode="sysinfo"/>
Apr 14 10:51:08 user nova-compute[71509]:   </os>
Apr 14 10:51:08 user nova-compute[71509]:   <features>
Apr 14 10:51:08 user nova-compute[71509]:     <acpi/>
Apr 14 10:51:08 user nova-compute[71509]:     <apic/>
Apr 14 10:51:08 user nova-compute[71509]:     <vmcoreinfo/>
Apr 14 10:51:08 user nova-compute[71509]:   </features>
Apr 14 10:51:08 user nova-compute[71509]:   <clock offset="utc">
Apr 14 10:51:08 user nova-compute[71509]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 10:51:08 user nova-compute[71509]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 10:51:08 user nova-compute[71509]:     <timer name="hpet" present="no"/>
Apr 14 10:51:08 user nova-compute[71509]:   </clock>
Apr 14 10:51:08 user nova-compute[71509]:   <cpu mode="custom" match="exact">
Apr 14 10:51:08 user nova-compute[71509]:     <model>Nehalem</model>
Apr 14 10:51:08 user nova-compute[71509]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 10:51:08 user nova-compute[71509]:   </cpu>
Apr 14 10:51:08 user nova-compute[71509]:   <devices>
Apr 14 10:51:08 user nova-compute[71509]:     <disk type="file" device="disk">
Apr 14 10:51:08 user nova-compute[71509]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 10:51:08 user nova-compute[71509]:       <source file="/opt/stack/data/nova/instances/3b4b6e3e-0743-4ee6-900c-3172b09eb0f2/disk"/>
Apr 14 10:51:08 user nova-compute[71509]:       <target dev="vda" bus="virtio"/>
Apr 14 10:51:08 user nova-compute[71509]:     </disk>
Apr 14 10:51:08 user nova-compute[71509]:     <interface type="ethernet">
Apr 14 10:51:08 user nova-compute[71509]:       <mac address="fa:16:3e:26:93:bd"/>
Apr 14 10:51:08 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 10:51:08 user nova-compute[71509]:       <mtu size="1442"/>
Apr 14 10:51:08 user nova-compute[71509]:       <target dev="tap2f4949b3-11"/>
Apr 14 10:51:08 user nova-compute[71509]:     </interface>
Apr 14 10:51:08 user nova-compute[71509]:     <serial type="pty">
Apr 14 10:51:08 user nova-compute[71509]:       <log file="/opt/stack/data/nova/instances/3b4b6e3e-0743-4ee6-900c-3172b09eb0f2/console.log" append="off"/>
Apr 14 10:51:08 user nova-compute[71509]:     </serial>
Apr 14 10:51:08 user nova-compute[71509]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 10:51:08 user nova-compute[71509]:     <video>
Apr 14 10:51:08 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 10:51:08 user nova-compute[71509]:     </video>
Apr 14 10:51:08 user nova-compute[71509]:     <rng model="virtio">
Apr 14 10:51:08 user nova-compute[71509]:       <backend model="random">/dev/urandom</backend>
Apr 14 10:51:08 user nova-compute[71509]:     </rng>
Apr 14 10:51:08 user nova-compute[71509]:     <controller type="usb" index="0" model="none"/>
Apr 14 10:51:08 user nova-compute[71509]:     <memballoon model="virtio">
Apr 14 10:51:08 user nova-compute[71509]:       <stats period="10"/>
Apr 14 10:51:08 user nova-compute[71509]:     </memballoon>
Apr 14 10:51:08 user nova-compute[71509]:   </devices>
Apr 14 10:51:08 user nova-compute[71509]: </domain>
Apr 14 10:51:08 user nova-compute[71509]:  {{(pid=71509) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 10:51:08 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-35324608-42fb-44f4-a358-be97893a4b59 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T10:51:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1788483212',display_name='tempest-VolumesAdminNegativeTest-server-1788483212',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1788483212',id=21,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aca26975e5ad4524b4b1b1ec4335802f',ramdisk_id='',reservation_id='r-d8jhzy5t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-5408590',owner_user_name='tempest-VolumesAdminNegativeTest-5408590-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T10:51:06Z,user_data=None,user_id='6adefa90332c42c79a1372258a7be5ab',uuid=3b4b6e3e-0743-4ee6-900c-3172b09eb0f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2f4949b3-11d4-4970-878c-49a35c428147", "address": "fa:16:3e:26:93:bd", "network": {"id": "36ccc911-348d-426a-ba7b-a49a0bfb0f97", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-256080753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aca26975e5ad4524b4b1b1ec4335802f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f4949b3-11", "ovs_interfaceid": "2f4949b3-11d4-4970-878c-49a35c428147", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 10:51:08 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-35324608-42fb-44f4-a358-be97893a4b59 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Converting VIF {"id": "2f4949b3-11d4-4970-878c-49a35c428147", "address": "fa:16:3e:26:93:bd", "network": {"id": "36ccc911-348d-426a-ba7b-a49a0bfb0f97", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-256080753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aca26975e5ad4524b4b1b1ec4335802f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f4949b3-11", "ovs_interfaceid": "2f4949b3-11d4-4970-878c-49a35c428147", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:51:08 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-35324608-42fb-44f4-a358-be97893a4b59 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:93:bd,bridge_name='br-int',has_traffic_filtering=True,id=2f4949b3-11d4-4970-878c-49a35c428147,network=Network(36ccc911-348d-426a-ba7b-a49a0bfb0f97),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f4949b3-11') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:51:08 user nova-compute[71509]: DEBUG os_vif [None req-35324608-42fb-44f4-a358-be97893a4b59 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:93:bd,bridge_name='br-int',has_traffic_filtering=True,id=2f4949b3-11d4-4970-878c-49a35c428147,network=Network(36ccc911-348d-426a-ba7b-a49a0bfb0f97),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f4949b3-11') {{(pid=71509) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 10:51:08 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:51:08 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:51:08 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 10:51:08 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:51:08 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2f4949b3-11, may_exist=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:51:08 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2f4949b3-11, col_values=(('external_ids', {'iface-id': '2f4949b3-11d4-4970-878c-49a35c428147', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:26:93:bd', 'vm-uuid': '3b4b6e3e-0743-4ee6-900c-3172b09eb0f2'}),)) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:51:08 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:51:08 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 10:51:08 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:51:08 user nova-compute[71509]: INFO os_vif [None req-35324608-42fb-44f4-a358-be97893a4b59 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:93:bd,bridge_name='br-int',has_traffic_filtering=True,id=2f4949b3-11d4-4970-878c-49a35c428147,network=Network(36ccc911-348d-426a-ba7b-a49a0bfb0f97),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f4949b3-11')
Apr 14 10:51:08 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-35324608-42fb-44f4-a358-be97893a4b59 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] No BDM found with device name vda, not building metadata. {{(pid=71509) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 10:51:08 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-35324608-42fb-44f4-a358-be97893a4b59 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] No VIF found with MAC fa:16:3e:26:93:bd, not building metadata {{(pid=71509) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 10:51:08 user nova-compute[71509]: DEBUG nova.compute.manager [req-c286fa07-1ac3-432b-9a4a-16d4ddd18ed3 req-4b2d5ef6-ef46-424d-b10b-cc0901614aa2 service nova] [instance: 3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d] Received event network-vif-plugged-ff9ac514-2d14-4580-8d6a-2c525b72a5db {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:51:08 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-c286fa07-1ac3-432b-9a4a-16d4ddd18ed3 req-4b2d5ef6-ef46-424d-b10b-cc0901614aa2 service nova] Acquiring lock "3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:51:08 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-c286fa07-1ac3-432b-9a4a-16d4ddd18ed3 req-4b2d5ef6-ef46-424d-b10b-cc0901614aa2 service nova] Lock "3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:51:08 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-c286fa07-1ac3-432b-9a4a-16d4ddd18ed3 req-4b2d5ef6-ef46-424d-b10b-cc0901614aa2 service nova] Lock "3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:51:08 user nova-compute[71509]: DEBUG nova.compute.manager [req-c286fa07-1ac3-432b-9a4a-16d4ddd18ed3 req-4b2d5ef6-ef46-424d-b10b-cc0901614aa2 service nova] [instance: 3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d] No waiting events found dispatching network-vif-plugged-ff9ac514-2d14-4580-8d6a-2c525b72a5db {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:51:08 user nova-compute[71509]: WARNING nova.compute.manager [req-c286fa07-1ac3-432b-9a4a-16d4ddd18ed3 req-4b2d5ef6-ef46-424d-b10b-cc0901614aa2 service nova] [instance: 3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d] Received unexpected event network-vif-plugged-ff9ac514-2d14-4580-8d6a-2c525b72a5db for instance with vm_state active and task_state None.
Apr 14 10:51:08 user nova-compute[71509]: DEBUG nova.compute.manager [req-c286fa07-1ac3-432b-9a4a-16d4ddd18ed3 req-4b2d5ef6-ef46-424d-b10b-cc0901614aa2 service nova] [instance: 3b4b6e3e-0743-4ee6-900c-3172b09eb0f2] Received event network-changed-2f4949b3-11d4-4970-878c-49a35c428147 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:51:08 user nova-compute[71509]: DEBUG nova.compute.manager [req-c286fa07-1ac3-432b-9a4a-16d4ddd18ed3 req-4b2d5ef6-ef46-424d-b10b-cc0901614aa2 service nova] [instance: 3b4b6e3e-0743-4ee6-900c-3172b09eb0f2] Refreshing instance network info cache due to event network-changed-2f4949b3-11d4-4970-878c-49a35c428147. {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 10:51:08 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-c286fa07-1ac3-432b-9a4a-16d4ddd18ed3 req-4b2d5ef6-ef46-424d-b10b-cc0901614aa2 service nova] Acquiring lock "refresh_cache-3b4b6e3e-0743-4ee6-900c-3172b09eb0f2" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:51:08 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-c286fa07-1ac3-432b-9a4a-16d4ddd18ed3 req-4b2d5ef6-ef46-424d-b10b-cc0901614aa2 service nova] Acquired lock "refresh_cache-3b4b6e3e-0743-4ee6-900c-3172b09eb0f2" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:51:08 user nova-compute[71509]: DEBUG nova.network.neutron [req-c286fa07-1ac3-432b-9a4a-16d4ddd18ed3 req-4b2d5ef6-ef46-424d-b10b-cc0901614aa2 service nova] [instance: 3b4b6e3e-0743-4ee6-900c-3172b09eb0f2] Refreshing network info cache for port 2f4949b3-11d4-4970-878c-49a35c428147 {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 10:51:09 user nova-compute[71509]: DEBUG nova.network.neutron [req-c286fa07-1ac3-432b-9a4a-16d4ddd18ed3 req-4b2d5ef6-ef46-424d-b10b-cc0901614aa2 service nova] [instance: 3b4b6e3e-0743-4ee6-900c-3172b09eb0f2] Updated VIF entry in instance network info cache for port 2f4949b3-11d4-4970-878c-49a35c428147. {{(pid=71509) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 10:51:09 user nova-compute[71509]: DEBUG nova.network.neutron [req-c286fa07-1ac3-432b-9a4a-16d4ddd18ed3 req-4b2d5ef6-ef46-424d-b10b-cc0901614aa2 service nova] [instance: 3b4b6e3e-0743-4ee6-900c-3172b09eb0f2] Updating instance_info_cache with network_info: [{"id": "2f4949b3-11d4-4970-878c-49a35c428147", "address": "fa:16:3e:26:93:bd", "network": {"id": "36ccc911-348d-426a-ba7b-a49a0bfb0f97", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-256080753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aca26975e5ad4524b4b1b1ec4335802f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f4949b3-11", "ovs_interfaceid": "2f4949b3-11d4-4970-878c-49a35c428147", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:51:09 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-c286fa07-1ac3-432b-9a4a-16d4ddd18ed3 req-4b2d5ef6-ef46-424d-b10b-cc0901614aa2 service nova] Releasing lock "refresh_cache-3b4b6e3e-0743-4ee6-900c-3172b09eb0f2" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:51:10 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:51:10 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:51:10 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:51:10 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:51:10 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:51:10 user nova-compute[71509]: DEBUG nova.compute.manager [req-fcca6ae2-599a-40b0-b663-6cb6437a7dad req-07ff7769-3960-46c5-8b09-fb3730c8cf66 service nova] [instance: 3b4b6e3e-0743-4ee6-900c-3172b09eb0f2] Received event network-vif-plugged-2f4949b3-11d4-4970-878c-49a35c428147 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:51:10 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-fcca6ae2-599a-40b0-b663-6cb6437a7dad req-07ff7769-3960-46c5-8b09-fb3730c8cf66 service nova] Acquiring lock "3b4b6e3e-0743-4ee6-900c-3172b09eb0f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:51:10 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-fcca6ae2-599a-40b0-b663-6cb6437a7dad req-07ff7769-3960-46c5-8b09-fb3730c8cf66 service nova] Lock "3b4b6e3e-0743-4ee6-900c-3172b09eb0f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:51:10 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-fcca6ae2-599a-40b0-b663-6cb6437a7dad req-07ff7769-3960-46c5-8b09-fb3730c8cf66 service nova] Lock "3b4b6e3e-0743-4ee6-900c-3172b09eb0f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:51:10 user nova-compute[71509]: DEBUG nova.compute.manager [req-fcca6ae2-599a-40b0-b663-6cb6437a7dad req-07ff7769-3960-46c5-8b09-fb3730c8cf66 service nova] [instance: 3b4b6e3e-0743-4ee6-900c-3172b09eb0f2] No waiting events found dispatching network-vif-plugged-2f4949b3-11d4-4970-878c-49a35c428147 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:51:10 user nova-compute[71509]: WARNING nova.compute.manager [req-fcca6ae2-599a-40b0-b663-6cb6437a7dad req-07ff7769-3960-46c5-8b09-fb3730c8cf66 service nova] [instance: 3b4b6e3e-0743-4ee6-900c-3172b09eb0f2] Received unexpected event network-vif-plugged-2f4949b3-11d4-4970-878c-49a35c428147 for instance with vm_state building and task_state spawning.
Apr 14 10:51:10 user nova-compute[71509]: DEBUG nova.compute.manager [req-fcca6ae2-599a-40b0-b663-6cb6437a7dad req-07ff7769-3960-46c5-8b09-fb3730c8cf66 service nova] [instance: 3b4b6e3e-0743-4ee6-900c-3172b09eb0f2] Received event network-vif-plugged-2f4949b3-11d4-4970-878c-49a35c428147 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:51:10 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-fcca6ae2-599a-40b0-b663-6cb6437a7dad req-07ff7769-3960-46c5-8b09-fb3730c8cf66 service nova] Acquiring lock "3b4b6e3e-0743-4ee6-900c-3172b09eb0f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:51:10 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-fcca6ae2-599a-40b0-b663-6cb6437a7dad req-07ff7769-3960-46c5-8b09-fb3730c8cf66 service nova] Lock "3b4b6e3e-0743-4ee6-900c-3172b09eb0f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:51:10 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-fcca6ae2-599a-40b0-b663-6cb6437a7dad req-07ff7769-3960-46c5-8b09-fb3730c8cf66 service nova] Lock "3b4b6e3e-0743-4ee6-900c-3172b09eb0f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:51:10 user nova-compute[71509]: DEBUG nova.compute.manager [req-fcca6ae2-599a-40b0-b663-6cb6437a7dad req-07ff7769-3960-46c5-8b09-fb3730c8cf66 service nova] [instance: 3b4b6e3e-0743-4ee6-900c-3172b09eb0f2] No waiting events found dispatching network-vif-plugged-2f4949b3-11d4-4970-878c-49a35c428147 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:51:10 user nova-compute[71509]: WARNING nova.compute.manager [req-fcca6ae2-599a-40b0-b663-6cb6437a7dad req-07ff7769-3960-46c5-8b09-fb3730c8cf66 service nova] [instance: 3b4b6e3e-0743-4ee6-900c-3172b09eb0f2] Received unexpected event network-vif-plugged-2f4949b3-11d4-4970-878c-49a35c428147 for instance with vm_state building and task_state spawning.
Apr 14 10:51:12 user nova-compute[71509]: DEBUG nova.compute.manager [None req-35324608-42fb-44f4-a358-be97893a4b59 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] [instance: 3b4b6e3e-0743-4ee6-900c-3172b09eb0f2] Instance event wait completed in 0 seconds for  {{(pid=71509) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 10:51:12 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-35324608-42fb-44f4-a358-be97893a4b59 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] [instance: 3b4b6e3e-0743-4ee6-900c-3172b09eb0f2] Guest created on hypervisor {{(pid=71509) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 10:51:12 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681469472.5635343, 3b4b6e3e-0743-4ee6-900c-3172b09eb0f2 => Resumed> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 10:51:12 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 3b4b6e3e-0743-4ee6-900c-3172b09eb0f2] VM Resumed (Lifecycle Event)
Apr 14 10:51:12 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: 3b4b6e3e-0743-4ee6-900c-3172b09eb0f2] Instance spawned successfully.
Apr 14 10:51:12 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-35324608-42fb-44f4-a358-be97893a4b59 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] [instance: 3b4b6e3e-0743-4ee6-900c-3172b09eb0f2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 10:51:12 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 3b4b6e3e-0743-4ee6-900c-3172b09eb0f2] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:51:12 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 3b4b6e3e-0743-4ee6-900c-3172b09eb0f2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 10:51:12 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-35324608-42fb-44f4-a358-be97893a4b59 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] [instance: 3b4b6e3e-0743-4ee6-900c-3172b09eb0f2] Found default for hw_cdrom_bus of ide {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:51:12 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-35324608-42fb-44f4-a358-be97893a4b59 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] [instance: 3b4b6e3e-0743-4ee6-900c-3172b09eb0f2] Found default for hw_disk_bus of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:51:12 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-35324608-42fb-44f4-a358-be97893a4b59 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] [instance: 3b4b6e3e-0743-4ee6-900c-3172b09eb0f2] Found default for hw_input_bus of None {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:51:12 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-35324608-42fb-44f4-a358-be97893a4b59 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] [instance: 3b4b6e3e-0743-4ee6-900c-3172b09eb0f2] Found default for hw_pointer_model of None {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:51:12 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-35324608-42fb-44f4-a358-be97893a4b59 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] [instance: 3b4b6e3e-0743-4ee6-900c-3172b09eb0f2] Found default for hw_video_model of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:51:12 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-35324608-42fb-44f4-a358-be97893a4b59 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] [instance: 3b4b6e3e-0743-4ee6-900c-3172b09eb0f2] Found default for hw_vif_model of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:51:12 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 3b4b6e3e-0743-4ee6-900c-3172b09eb0f2] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 10:51:12 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681469472.5637748, 3b4b6e3e-0743-4ee6-900c-3172b09eb0f2 => Started> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 10:51:12 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 3b4b6e3e-0743-4ee6-900c-3172b09eb0f2] VM Started (Lifecycle Event)
Apr 14 10:51:12 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 3b4b6e3e-0743-4ee6-900c-3172b09eb0f2] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:51:12 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 3b4b6e3e-0743-4ee6-900c-3172b09eb0f2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 10:51:12 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 3b4b6e3e-0743-4ee6-900c-3172b09eb0f2] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 10:51:12 user nova-compute[71509]: INFO nova.compute.manager [None req-35324608-42fb-44f4-a358-be97893a4b59 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] [instance: 3b4b6e3e-0743-4ee6-900c-3172b09eb0f2] Took 6.20 seconds to spawn the instance on the hypervisor.
Apr 14 10:51:12 user nova-compute[71509]: DEBUG nova.compute.manager [None req-35324608-42fb-44f4-a358-be97893a4b59 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] [instance: 3b4b6e3e-0743-4ee6-900c-3172b09eb0f2] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:51:12 user nova-compute[71509]: INFO nova.compute.manager [None req-35324608-42fb-44f4-a358-be97893a4b59 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] [instance: 3b4b6e3e-0743-4ee6-900c-3172b09eb0f2] Took 7.03 seconds to build instance.
Apr 14 10:51:12 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-35324608-42fb-44f4-a358-be97893a4b59 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Lock "3b4b6e3e-0743-4ee6-900c-3172b09eb0f2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.134s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:51:12 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:51:13 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:51:14 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-8c974780-032a-46e9-984e-ef53b757a747 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Acquiring lock "d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:51:14 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-8c974780-032a-46e9-984e-ef53b757a747 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:51:14 user nova-compute[71509]: DEBUG nova.compute.manager [None req-8c974780-032a-46e9-984e-ef53b757a747 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Starting instance... {{(pid=71509) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 10:51:14 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-8c974780-032a-46e9-984e-ef53b757a747 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:51:14 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-8c974780-032a-46e9-984e-ef53b757a747 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:51:14 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-8c974780-032a-46e9-984e-ef53b757a747 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71509) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 10:51:14 user nova-compute[71509]: INFO nova.compute.claims [None req-8c974780-032a-46e9-984e-ef53b757a747 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Claim successful on node user
Apr 14 10:51:15 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-8c974780-032a-46e9-984e-ef53b757a747 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 10:51:15 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-8c974780-032a-46e9-984e-ef53b757a747 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 10:51:15 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-8c974780-032a-46e9-984e-ef53b757a747 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.452s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:51:15 user nova-compute[71509]: DEBUG nova.compute.manager [None req-8c974780-032a-46e9-984e-ef53b757a747 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Start building networks asynchronously for instance. {{(pid=71509) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 10:51:15 user nova-compute[71509]: DEBUG nova.compute.manager [None req-8c974780-032a-46e9-984e-ef53b757a747 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Allocating IP information in the background. {{(pid=71509) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 10:51:15 user nova-compute[71509]: DEBUG nova.network.neutron [None req-8c974780-032a-46e9-984e-ef53b757a747 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] allocate_for_instance() {{(pid=71509) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 10:51:15 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-8c974780-032a-46e9-984e-ef53b757a747 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 10:51:15 user nova-compute[71509]: DEBUG nova.compute.manager [None req-8c974780-032a-46e9-984e-ef53b757a747 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Start building block device mappings for instance. {{(pid=71509) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 10:51:15 user nova-compute[71509]: DEBUG nova.policy [None req-8c974780-032a-46e9-984e-ef53b757a747 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e359578dcbb24755a216415053d415ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf93e5dac50342d0b65ef09711401e99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71509) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 10:51:15 user nova-compute[71509]: DEBUG nova.compute.manager [None req-8c974780-032a-46e9-984e-ef53b757a747 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Start spawning the instance on the hypervisor. {{(pid=71509) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 10:51:15 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-8c974780-032a-46e9-984e-ef53b757a747 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Creating instance directory {{(pid=71509) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 10:51:15 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-8c974780-032a-46e9-984e-ef53b757a747 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Creating image(s)
Apr 14 10:51:15 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-8c974780-032a-46e9-984e-ef53b757a747 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Acquiring lock "/opt/stack/data/nova/instances/d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:51:15 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-8c974780-032a-46e9-984e-ef53b757a747 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "/opt/stack/data/nova/instances/d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:51:15 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-8c974780-032a-46e9-984e-ef53b757a747 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "/opt/stack/data/nova/instances/d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:51:15 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-8c974780-032a-46e9-984e-ef53b757a747 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:51:15 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-8c974780-032a-46e9-984e-ef53b757a747 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json" returned: 0 in 0.167s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:51:15 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-8c974780-032a-46e9-984e-ef53b757a747 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Acquiring lock "5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:51:15 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-8c974780-032a-46e9-984e-ef53b757a747 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:51:15 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-8c974780-032a-46e9-984e-ef53b757a747 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:51:15 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:51:15 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-8c974780-032a-46e9-984e-ef53b757a747 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json" returned: 0 in 0.162s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:51:15 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-8c974780-032a-46e9-984e-ef53b757a747 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18,backing_fmt=raw /opt/stack/data/nova/instances/d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5/disk 1073741824 {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:51:15 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-8c974780-032a-46e9-984e-ef53b757a747 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18,backing_fmt=raw /opt/stack/data/nova/instances/d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5/disk 1073741824" returned: 0 in 0.051s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:51:15 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-8c974780-032a-46e9-984e-ef53b757a747 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.219s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:51:15 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-8c974780-032a-46e9-984e-ef53b757a747 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:51:15 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-8c974780-032a-46e9-984e-ef53b757a747 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json" returned: 0 in 0.146s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:51:15 user nova-compute[71509]: DEBUG nova.virt.disk.api [None req-8c974780-032a-46e9-984e-ef53b757a747 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5/disk. size=1073741824 {{(pid=71509) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 10:51:15 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-8c974780-032a-46e9-984e-ef53b757a747 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:51:16 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-8c974780-032a-46e9-984e-ef53b757a747 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:51:16 user nova-compute[71509]: DEBUG nova.virt.disk.api [None req-8c974780-032a-46e9-984e-ef53b757a747 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Cannot resize image /opt/stack/data/nova/instances/d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5/disk to a smaller size. {{(pid=71509) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 10:51:16 user nova-compute[71509]: DEBUG nova.objects.instance [None req-8c974780-032a-46e9-984e-ef53b757a747 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lazy-loading 'migration_context' on Instance uuid d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:51:16 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-8c974780-032a-46e9-984e-ef53b757a747 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Created local disks {{(pid=71509) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 10:51:16 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-8c974780-032a-46e9-984e-ef53b757a747 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Ensure instance console log exists: /opt/stack/data/nova/instances/d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5/console.log {{(pid=71509) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 10:51:16 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-8c974780-032a-46e9-984e-ef53b757a747 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:51:16 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-8c974780-032a-46e9-984e-ef53b757a747 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:51:16 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-8c974780-032a-46e9-984e-ef53b757a747 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:51:16 user nova-compute[71509]: DEBUG nova.network.neutron [None req-8c974780-032a-46e9-984e-ef53b757a747 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Successfully created port: f2196ef3-aada-48d6-b524-5e9cef6a9eda {{(pid=71509) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 10:51:17 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:51:18 user nova-compute[71509]: DEBUG nova.network.neutron [None req-8c974780-032a-46e9-984e-ef53b757a747 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Successfully updated port: f2196ef3-aada-48d6-b524-5e9cef6a9eda {{(pid=71509) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 10:51:18 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-8c974780-032a-46e9-984e-ef53b757a747 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Acquiring lock "refresh_cache-d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:51:18 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-8c974780-032a-46e9-984e-ef53b757a747 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Acquired lock "refresh_cache-d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:51:18 user nova-compute[71509]: DEBUG nova.network.neutron [None req-8c974780-032a-46e9-984e-ef53b757a747 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Building network info cache for instance {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 10:51:18 user nova-compute[71509]: DEBUG nova.compute.manager [req-7046207a-fa65-42ae-a1f4-5b5a9c6cb134 req-e619fcbb-8fb2-451d-944f-2fc4ebb6c5cb service nova] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Received event network-changed-f2196ef3-aada-48d6-b524-5e9cef6a9eda {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:51:18 user nova-compute[71509]: DEBUG nova.compute.manager [req-7046207a-fa65-42ae-a1f4-5b5a9c6cb134 req-e619fcbb-8fb2-451d-944f-2fc4ebb6c5cb service nova] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Refreshing instance network info cache due to event network-changed-f2196ef3-aada-48d6-b524-5e9cef6a9eda. {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 10:51:18 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-7046207a-fa65-42ae-a1f4-5b5a9c6cb134 req-e619fcbb-8fb2-451d-944f-2fc4ebb6c5cb service nova] Acquiring lock "refresh_cache-d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:51:18 user nova-compute[71509]: DEBUG nova.network.neutron [None req-8c974780-032a-46e9-984e-ef53b757a747 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Instance cache missing network info. {{(pid=71509) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 10:51:18 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:51:18 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:51:18 user nova-compute[71509]: DEBUG nova.network.neutron [None req-8c974780-032a-46e9-984e-ef53b757a747 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Updating instance_info_cache with network_info: [{"id": "f2196ef3-aada-48d6-b524-5e9cef6a9eda", "address": "fa:16:3e:e7:31:44", "network": {"id": "22eb5f87-be4d-447d-bafe-25e0284ea3ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-787804772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf93e5dac50342d0b65ef09711401e99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2196ef3-aa", "ovs_interfaceid": "f2196ef3-aada-48d6-b524-5e9cef6a9eda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:51:18 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-8c974780-032a-46e9-984e-ef53b757a747 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Releasing lock "refresh_cache-d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:51:18 user nova-compute[71509]: DEBUG nova.compute.manager [None req-8c974780-032a-46e9-984e-ef53b757a747 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Instance network_info: |[{"id": "f2196ef3-aada-48d6-b524-5e9cef6a9eda", "address": "fa:16:3e:e7:31:44", "network": {"id": "22eb5f87-be4d-447d-bafe-25e0284ea3ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-787804772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf93e5dac50342d0b65ef09711401e99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2196ef3-aa", "ovs_interfaceid": "f2196ef3-aada-48d6-b524-5e9cef6a9eda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71509) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 10:51:18 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-7046207a-fa65-42ae-a1f4-5b5a9c6cb134 req-e619fcbb-8fb2-451d-944f-2fc4ebb6c5cb service nova] Acquired lock "refresh_cache-d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:51:18 user nova-compute[71509]: DEBUG nova.network.neutron [req-7046207a-fa65-42ae-a1f4-5b5a9c6cb134 req-e619fcbb-8fb2-451d-944f-2fc4ebb6c5cb service nova] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Refreshing network info cache for port f2196ef3-aada-48d6-b524-5e9cef6a9eda {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 10:51:18 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-8c974780-032a-46e9-984e-ef53b757a747 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Start _get_guest_xml network_info=[{"id": "f2196ef3-aada-48d6-b524-5e9cef6a9eda", "address": "fa:16:3e:e7:31:44", "network": {"id": "22eb5f87-be4d-447d-bafe-25e0284ea3ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-787804772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf93e5dac50342d0b65ef09711401e99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2196ef3-aa", "ovs_interfaceid": "f2196ef3-aada-48d6-b524-5e9cef6a9eda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T10:38:55Z,direct_url=<?>,disk_format='qcow2',id=048ec0ee-0465-448d-8b4c-f072acb101dc,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='9742d6ad20cf48d9bab0fdbcc9491db9',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T10:38:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '048ec0ee-0465-448d-8b4c-f072acb101dc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71509) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 10:51:18 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-8c974780-032a-46e9-984e-ef53b757a747 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:51:18 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-8c974780-032a-46e9-984e-ef53b757a747 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:51:18 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-8c974780-032a-46e9-984e-ef53b757a747 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71509) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 10:51:18 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-8c974780-032a-46e9-984e-ef53b757a747 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T10:40:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T10:38:55Z,direct_url=<?>,disk_format='qcow2',id=048ec0ee-0465-448d-8b4c-f072acb101dc,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='9742d6ad20cf48d9bab0fdbcc9491db9',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T10:38:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 10:51:18 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-8c974780-032a-46e9-984e-ef53b757a747 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Flavor limits 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 10:51:18 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-8c974780-032a-46e9-984e-ef53b757a747 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Image limits 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 10:51:18 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-8c974780-032a-46e9-984e-ef53b757a747 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Flavor pref 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 10:51:18 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-8c974780-032a-46e9-984e-ef53b757a747 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Image pref 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 10:51:18 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-8c974780-032a-46e9-984e-ef53b757a747 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 10:51:18 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-8c974780-032a-46e9-984e-ef53b757a747 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 10:51:18 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-8c974780-032a-46e9-984e-ef53b757a747 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71509) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 10:51:18 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-8c974780-032a-46e9-984e-ef53b757a747 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Got 1 possible topologies {{(pid=71509) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 10:51:18 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-8c974780-032a-46e9-984e-ef53b757a747 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 10:51:18 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-8c974780-032a-46e9-984e-ef53b757a747 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 10:51:18 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-8c974780-032a-46e9-984e-ef53b757a747 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T10:51:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1793508079',display_name='tempest-ServerRescueNegativeTestJSON-server-1793508079',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1793508079',id=22,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPCWcovyJGJoU2VVqBXHmxw2WqzQwe3JweQ4DFCyMODxzU7SfyIb92ARO4ehF+n8xN2UWQPLSSsVS3f1Va86nHzHvrj9cePHzTOq5SnHeWVBXyUULcZytrQgbP7FG6mgKQ==',key_name='tempest-keypair-1550009007',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bf93e5dac50342d0b65ef09711401e99',ramdisk_id='',reservation_id='r-qz8mgt4t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-563868574',owner_user_name='tempest-ServerRescueNegativeTestJSON-563868574-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T10:51:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e359578dcbb24755a216415053d415ef',uuid=d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f2196ef3-aada-48d6-b524-5e9cef6a9eda", "address": "fa:16:3e:e7:31:44", "network": {"id": "22eb5f87-be4d-447d-bafe-25e0284ea3ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-787804772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf93e5dac50342d0b65ef09711401e99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2196ef3-aa", "ovs_interfaceid": "f2196ef3-aada-48d6-b524-5e9cef6a9eda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71509) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 10:51:18 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-8c974780-032a-46e9-984e-ef53b757a747 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Converting VIF {"id": "f2196ef3-aada-48d6-b524-5e9cef6a9eda", "address": "fa:16:3e:e7:31:44", "network": {"id": "22eb5f87-be4d-447d-bafe-25e0284ea3ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-787804772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf93e5dac50342d0b65ef09711401e99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2196ef3-aa", "ovs_interfaceid": "f2196ef3-aada-48d6-b524-5e9cef6a9eda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:51:18 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-8c974780-032a-46e9-984e-ef53b757a747 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:31:44,bridge_name='br-int',has_traffic_filtering=True,id=f2196ef3-aada-48d6-b524-5e9cef6a9eda,network=Network(22eb5f87-be4d-447d-bafe-25e0284ea3ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2196ef3-aa') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:51:18 user nova-compute[71509]: DEBUG nova.objects.instance [None req-8c974780-032a-46e9-984e-ef53b757a747 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lazy-loading 'pci_devices' on Instance uuid d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:51:18 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-8c974780-032a-46e9-984e-ef53b757a747 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] End _get_guest_xml xml=<domain type="kvm">
Apr 14 10:51:18 user nova-compute[71509]:   <uuid>d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5</uuid>
Apr 14 10:51:18 user nova-compute[71509]:   <name>instance-00000016</name>
Apr 14 10:51:18 user nova-compute[71509]:   <memory>131072</memory>
Apr 14 10:51:18 user nova-compute[71509]:   <vcpu>1</vcpu>
Apr 14 10:51:18 user nova-compute[71509]:   <metadata>
Apr 14 10:51:18 user nova-compute[71509]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 10:51:18 user nova-compute[71509]:       <nova:package version="0.0.0"/>
Apr 14 10:51:18 user nova-compute[71509]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1793508079</nova:name>
Apr 14 10:51:18 user nova-compute[71509]:       <nova:creationTime>2023-04-14 10:51:18</nova:creationTime>
Apr 14 10:51:18 user nova-compute[71509]:       <nova:flavor name="m1.nano">
Apr 14 10:51:18 user nova-compute[71509]:         <nova:memory>128</nova:memory>
Apr 14 10:51:18 user nova-compute[71509]:         <nova:disk>1</nova:disk>
Apr 14 10:51:18 user nova-compute[71509]:         <nova:swap>0</nova:swap>
Apr 14 10:51:18 user nova-compute[71509]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 10:51:18 user nova-compute[71509]:         <nova:vcpus>1</nova:vcpus>
Apr 14 10:51:18 user nova-compute[71509]:       </nova:flavor>
Apr 14 10:51:18 user nova-compute[71509]:       <nova:owner>
Apr 14 10:51:18 user nova-compute[71509]:         <nova:user uuid="e359578dcbb24755a216415053d415ef">tempest-ServerRescueNegativeTestJSON-563868574-project-member</nova:user>
Apr 14 10:51:18 user nova-compute[71509]:         <nova:project uuid="bf93e5dac50342d0b65ef09711401e99">tempest-ServerRescueNegativeTestJSON-563868574</nova:project>
Apr 14 10:51:18 user nova-compute[71509]:       </nova:owner>
Apr 14 10:51:18 user nova-compute[71509]:       <nova:root type="image" uuid="048ec0ee-0465-448d-8b4c-f072acb101dc"/>
Apr 14 10:51:18 user nova-compute[71509]:       <nova:ports>
Apr 14 10:51:18 user nova-compute[71509]:         <nova:port uuid="f2196ef3-aada-48d6-b524-5e9cef6a9eda">
Apr 14 10:51:18 user nova-compute[71509]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 14 10:51:18 user nova-compute[71509]:         </nova:port>
Apr 14 10:51:18 user nova-compute[71509]:       </nova:ports>
Apr 14 10:51:18 user nova-compute[71509]:     </nova:instance>
Apr 14 10:51:18 user nova-compute[71509]:   </metadata>
Apr 14 10:51:18 user nova-compute[71509]:   <sysinfo type="smbios">
Apr 14 10:51:18 user nova-compute[71509]:     <system>
Apr 14 10:51:18 user nova-compute[71509]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 10:51:18 user nova-compute[71509]:       <entry name="product">OpenStack Nova</entry>
Apr 14 10:51:18 user nova-compute[71509]:       <entry name="version">0.0.0</entry>
Apr 14 10:51:18 user nova-compute[71509]:       <entry name="serial">d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5</entry>
Apr 14 10:51:18 user nova-compute[71509]:       <entry name="uuid">d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5</entry>
Apr 14 10:51:18 user nova-compute[71509]:       <entry name="family">Virtual Machine</entry>
Apr 14 10:51:18 user nova-compute[71509]:     </system>
Apr 14 10:51:18 user nova-compute[71509]:   </sysinfo>
Apr 14 10:51:18 user nova-compute[71509]:   <os>
Apr 14 10:51:18 user nova-compute[71509]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 10:51:18 user nova-compute[71509]:     <boot dev="hd"/>
Apr 14 10:51:18 user nova-compute[71509]:     <smbios mode="sysinfo"/>
Apr 14 10:51:18 user nova-compute[71509]:   </os>
Apr 14 10:51:18 user nova-compute[71509]:   <features>
Apr 14 10:51:18 user nova-compute[71509]:     <acpi/>
Apr 14 10:51:18 user nova-compute[71509]:     <apic/>
Apr 14 10:51:18 user nova-compute[71509]:     <vmcoreinfo/>
Apr 14 10:51:18 user nova-compute[71509]:   </features>
Apr 14 10:51:18 user nova-compute[71509]:   <clock offset="utc">
Apr 14 10:51:18 user nova-compute[71509]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 10:51:18 user nova-compute[71509]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 10:51:18 user nova-compute[71509]:     <timer name="hpet" present="no"/>
Apr 14 10:51:18 user nova-compute[71509]:   </clock>
Apr 14 10:51:18 user nova-compute[71509]:   <cpu mode="custom" match="exact">
Apr 14 10:51:18 user nova-compute[71509]:     <model>Nehalem</model>
Apr 14 10:51:18 user nova-compute[71509]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 10:51:18 user nova-compute[71509]:   </cpu>
Apr 14 10:51:18 user nova-compute[71509]:   <devices>
Apr 14 10:51:18 user nova-compute[71509]:     <disk type="file" device="disk">
Apr 14 10:51:18 user nova-compute[71509]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 10:51:18 user nova-compute[71509]:       <source file="/opt/stack/data/nova/instances/d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5/disk"/>
Apr 14 10:51:18 user nova-compute[71509]:       <target dev="vda" bus="virtio"/>
Apr 14 10:51:18 user nova-compute[71509]:     </disk>
Apr 14 10:51:18 user nova-compute[71509]:     <interface type="ethernet">
Apr 14 10:51:18 user nova-compute[71509]:       <mac address="fa:16:3e:e7:31:44"/>
Apr 14 10:51:18 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 10:51:18 user nova-compute[71509]:       <mtu size="1442"/>
Apr 14 10:51:18 user nova-compute[71509]:       <target dev="tapf2196ef3-aa"/>
Apr 14 10:51:18 user nova-compute[71509]:     </interface>
Apr 14 10:51:18 user nova-compute[71509]:     <serial type="pty">
Apr 14 10:51:18 user nova-compute[71509]:       <log file="/opt/stack/data/nova/instances/d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5/console.log" append="off"/>
Apr 14 10:51:18 user nova-compute[71509]:     </serial>
Apr 14 10:51:18 user nova-compute[71509]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 10:51:18 user nova-compute[71509]:     <video>
Apr 14 10:51:18 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 10:51:18 user nova-compute[71509]:     </video>
Apr 14 10:51:18 user nova-compute[71509]:     <rng model="virtio">
Apr 14 10:51:18 user nova-compute[71509]:       <backend model="random">/dev/urandom</backend>
Apr 14 10:51:18 user nova-compute[71509]:     </rng>
Apr 14 10:51:18 user nova-compute[71509]:     <controller type="usb" index="0" model="none"/>
Apr 14 10:51:18 user nova-compute[71509]:     <memballoon model="virtio">
Apr 14 10:51:18 user nova-compute[71509]:       <stats period="10"/>
Apr 14 10:51:18 user nova-compute[71509]:     </memballoon>
Apr 14 10:51:18 user nova-compute[71509]:   </devices>
Apr 14 10:51:18 user nova-compute[71509]: </domain>
Apr 14 10:51:18 user nova-compute[71509]:  {{(pid=71509) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 10:51:18 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-8c974780-032a-46e9-984e-ef53b757a747 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T10:51:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1793508079',display_name='tempest-ServerRescueNegativeTestJSON-server-1793508079',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1793508079',id=22,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPCWcovyJGJoU2VVqBXHmxw2WqzQwe3JweQ4DFCyMODxzU7SfyIb92ARO4ehF+n8xN2UWQPLSSsVS3f1Va86nHzHvrj9cePHzTOq5SnHeWVBXyUULcZytrQgbP7FG6mgKQ==',key_name='tempest-keypair-1550009007',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bf93e5dac50342d0b65ef09711401e99',ramdisk_id='',reservation_id='r-qz8mgt4t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-563868574',owner_user_name='tempest-ServerRescueNegativeTestJSON-563868574-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T10:51:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e359578dcbb24755a216415053d415ef',uuid=d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f2196ef3-aada-48d6-b524-5e9cef6a9eda", "address": "fa:16:3e:e7:31:44", "network": {"id": "22eb5f87-be4d-447d-bafe-25e0284ea3ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-787804772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf93e5dac50342d0b65ef09711401e99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2196ef3-aa", "ovs_interfaceid": "f2196ef3-aada-48d6-b524-5e9cef6a9eda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 10:51:18 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-8c974780-032a-46e9-984e-ef53b757a747 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Converting VIF {"id": "f2196ef3-aada-48d6-b524-5e9cef6a9eda", "address": "fa:16:3e:e7:31:44", "network": {"id": "22eb5f87-be4d-447d-bafe-25e0284ea3ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-787804772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf93e5dac50342d0b65ef09711401e99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2196ef3-aa", "ovs_interfaceid": "f2196ef3-aada-48d6-b524-5e9cef6a9eda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:51:18 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-8c974780-032a-46e9-984e-ef53b757a747 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:31:44,bridge_name='br-int',has_traffic_filtering=True,id=f2196ef3-aada-48d6-b524-5e9cef6a9eda,network=Network(22eb5f87-be4d-447d-bafe-25e0284ea3ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2196ef3-aa') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:51:18 user nova-compute[71509]: DEBUG os_vif [None req-8c974780-032a-46e9-984e-ef53b757a747 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:31:44,bridge_name='br-int',has_traffic_filtering=True,id=f2196ef3-aada-48d6-b524-5e9cef6a9eda,network=Network(22eb5f87-be4d-447d-bafe-25e0284ea3ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2196ef3-aa') {{(pid=71509) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 10:51:18 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:51:18 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:51:18 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 10:51:18 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:51:18 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf2196ef3-aa, may_exist=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:51:18 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf2196ef3-aa, col_values=(('external_ids', {'iface-id': 'f2196ef3-aada-48d6-b524-5e9cef6a9eda', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e7:31:44', 'vm-uuid': 'd8e00388-b9f1-4c73-ad0a-3a1c8e0207d5'}),)) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:51:18 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:51:18 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 10:51:18 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:51:18 user nova-compute[71509]: INFO os_vif [None req-8c974780-032a-46e9-984e-ef53b757a747 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:31:44,bridge_name='br-int',has_traffic_filtering=True,id=f2196ef3-aada-48d6-b524-5e9cef6a9eda,network=Network(22eb5f87-be4d-447d-bafe-25e0284ea3ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2196ef3-aa')
Apr 14 10:51:18 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-8c974780-032a-46e9-984e-ef53b757a747 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] No BDM found with device name vda, not building metadata. {{(pid=71509) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 10:51:18 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-8c974780-032a-46e9-984e-ef53b757a747 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] No VIF found with MAC fa:16:3e:e7:31:44, not building metadata {{(pid=71509) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 10:51:19 user nova-compute[71509]: DEBUG nova.network.neutron [req-7046207a-fa65-42ae-a1f4-5b5a9c6cb134 req-e619fcbb-8fb2-451d-944f-2fc4ebb6c5cb service nova] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Updated VIF entry in instance network info cache for port f2196ef3-aada-48d6-b524-5e9cef6a9eda. {{(pid=71509) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 10:51:19 user nova-compute[71509]: DEBUG nova.network.neutron [req-7046207a-fa65-42ae-a1f4-5b5a9c6cb134 req-e619fcbb-8fb2-451d-944f-2fc4ebb6c5cb service nova] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Updating instance_info_cache with network_info: [{"id": "f2196ef3-aada-48d6-b524-5e9cef6a9eda", "address": "fa:16:3e:e7:31:44", "network": {"id": "22eb5f87-be4d-447d-bafe-25e0284ea3ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-787804772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf93e5dac50342d0b65ef09711401e99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2196ef3-aa", "ovs_interfaceid": "f2196ef3-aada-48d6-b524-5e9cef6a9eda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:51:19 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-7046207a-fa65-42ae-a1f4-5b5a9c6cb134 req-e619fcbb-8fb2-451d-944f-2fc4ebb6c5cb service nova] Releasing lock "refresh_cache-d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:51:20 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:51:20 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:51:20 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:51:20 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:51:20 user nova-compute[71509]: DEBUG nova.compute.manager [req-6623a330-cd93-493b-925a-ab7200b9d902 req-c8c0cbf0-ca57-4bad-b37e-58841c6f26c9 service nova] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Received event network-vif-plugged-f2196ef3-aada-48d6-b524-5e9cef6a9eda {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:51:20 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-6623a330-cd93-493b-925a-ab7200b9d902 req-c8c0cbf0-ca57-4bad-b37e-58841c6f26c9 service nova] Acquiring lock "d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:51:20 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-6623a330-cd93-493b-925a-ab7200b9d902 req-c8c0cbf0-ca57-4bad-b37e-58841c6f26c9 service nova] Lock "d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:51:20 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-6623a330-cd93-493b-925a-ab7200b9d902 req-c8c0cbf0-ca57-4bad-b37e-58841c6f26c9 service nova] Lock "d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:51:20 user nova-compute[71509]: DEBUG nova.compute.manager [req-6623a330-cd93-493b-925a-ab7200b9d902 req-c8c0cbf0-ca57-4bad-b37e-58841c6f26c9 service nova] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] No waiting events found dispatching network-vif-plugged-f2196ef3-aada-48d6-b524-5e9cef6a9eda {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:51:20 user nova-compute[71509]: WARNING nova.compute.manager [req-6623a330-cd93-493b-925a-ab7200b9d902 req-c8c0cbf0-ca57-4bad-b37e-58841c6f26c9 service nova] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Received unexpected event network-vif-plugged-f2196ef3-aada-48d6-b524-5e9cef6a9eda for instance with vm_state building and task_state spawning.
Apr 14 10:51:20 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:51:20 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:51:20 user nova-compute[71509]: DEBUG nova.objects.instance [None req-d5230438-ed07-43dd-bd83-93fd4697ec41 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lazy-loading 'flavor' on Instance uuid 8586a70e-9855-4177-ac1b-cf707a4df871 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:51:20 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-d5230438-ed07-43dd-bd83-93fd4697ec41 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Acquiring lock "refresh_cache-8586a70e-9855-4177-ac1b-cf707a4df871" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:51:20 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-d5230438-ed07-43dd-bd83-93fd4697ec41 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Acquired lock "refresh_cache-8586a70e-9855-4177-ac1b-cf707a4df871" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:51:20 user nova-compute[71509]: DEBUG nova.network.neutron [None req-d5230438-ed07-43dd-bd83-93fd4697ec41 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Building network info cache for instance {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 10:51:20 user nova-compute[71509]: DEBUG nova.objects.instance [None req-d5230438-ed07-43dd-bd83-93fd4697ec41 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lazy-loading 'info_cache' on Instance uuid 8586a70e-9855-4177-ac1b-cf707a4df871 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:51:21 user nova-compute[71509]: DEBUG nova.network.neutron [None req-d5230438-ed07-43dd-bd83-93fd4697ec41 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Updating instance_info_cache with network_info: [{"id": "473d9af8-25a0-4e5a-9afb-7a0c843115cc", "address": "fa:16:3e:b0:12:bf", "network": {"id": "653f0c81-1afd-4ca6-9639-675ead1a6127", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-932652547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb9b9fc4f2e244879502006bb844761c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap473d9af8-25", "ovs_interfaceid": "473d9af8-25a0-4e5a-9afb-7a0c843115cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:51:21 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-d5230438-ed07-43dd-bd83-93fd4697ec41 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Releasing lock "refresh_cache-8586a70e-9855-4177-ac1b-cf707a4df871" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:51:21 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-ddfa5ee2-efad-450e-b53d-7997f8e7cab1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "cd661ae0-c4bb-4117-847d-ef7e85d062fb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:51:21 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-ddfa5ee2-efad-450e-b53d-7997f8e7cab1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "cd661ae0-c4bb-4117-847d-ef7e85d062fb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:51:21 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Instance destroyed successfully.
Apr 14 10:51:21 user nova-compute[71509]: DEBUG nova.objects.instance [None req-d5230438-ed07-43dd-bd83-93fd4697ec41 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lazy-loading 'resources' on Instance uuid 8586a70e-9855-4177-ac1b-cf707a4df871 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:51:21 user nova-compute[71509]: DEBUG nova.compute.manager [None req-ddfa5ee2-efad-450e-b53d-7997f8e7cab1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: cd661ae0-c4bb-4117-847d-ef7e85d062fb] Starting instance... {{(pid=71509) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 10:51:21 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-d5230438-ed07-43dd-bd83-93fd4697ec41 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T10:47:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1909620947',display_name='tempest-AttachVolumeTestJSON-server-1909620947',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1909620947',id=16,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB8cubhYj6kalSkwto2AOwwQ8SwXu5MQ/cjSK0TQBgPs7qiNcfKtpFOEItZcvi+VTwGeXlKnu4SiqcBNrbUUIw9hxThGtWyniX5k6WeMBHziH1L0bIiIvkr1gDZ6mYbTMQ==',key_name='tempest-keypair-1352311307',keypairs=<?>,launch_index=0,launched_at=2023-04-14T10:47:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='eb9b9fc4f2e244879502006bb844761c',ramdisk_id='',reservation_id='r-043k765a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-821788322',owner_user_name='tempest-AttachVolumeTestJSON-821788322-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T10:49:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11cb4a1e78d447dbb18cde5453fe499c',uuid=8586a70e-9855-4177-ac1b-cf707a4df871,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "473d9af8-25a0-4e5a-9afb-7a0c843115cc", "address": "fa:16:3e:b0:12:bf", "network": {"id": "653f0c81-1afd-4ca6-9639-675ead1a6127", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-932652547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb9b9fc4f2e244879502006bb844761c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap473d9af8-25", "ovs_interfaceid": "473d9af8-25a0-4e5a-9afb-7a0c843115cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 10:51:21 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-d5230438-ed07-43dd-bd83-93fd4697ec41 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Converting VIF {"id": "473d9af8-25a0-4e5a-9afb-7a0c843115cc", "address": "fa:16:3e:b0:12:bf", "network": {"id": "653f0c81-1afd-4ca6-9639-675ead1a6127", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-932652547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb9b9fc4f2e244879502006bb844761c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap473d9af8-25", "ovs_interfaceid": "473d9af8-25a0-4e5a-9afb-7a0c843115cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:51:21 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-d5230438-ed07-43dd-bd83-93fd4697ec41 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:12:bf,bridge_name='br-int',has_traffic_filtering=True,id=473d9af8-25a0-4e5a-9afb-7a0c843115cc,network=Network(653f0c81-1afd-4ca6-9639-675ead1a6127),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap473d9af8-25') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:51:21 user nova-compute[71509]: DEBUG os_vif [None req-d5230438-ed07-43dd-bd83-93fd4697ec41 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:12:bf,bridge_name='br-int',has_traffic_filtering=True,id=473d9af8-25a0-4e5a-9afb-7a0c843115cc,network=Network(653f0c81-1afd-4ca6-9639-675ead1a6127),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap473d9af8-25') {{(pid=71509) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 10:51:21 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:51:21 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap473d9af8-25, bridge=br-int, if_exists=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:51:21 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:51:21 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 10:51:21 user nova-compute[71509]: INFO os_vif [None req-d5230438-ed07-43dd-bd83-93fd4697ec41 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:12:bf,bridge_name='br-int',has_traffic_filtering=True,id=473d9af8-25a0-4e5a-9afb-7a0c843115cc,network=Network(653f0c81-1afd-4ca6-9639-675ead1a6127),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap473d9af8-25')
Apr 14 10:51:21 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5230438-ed07-43dd-bd83-93fd4697ec41 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] calling os-brick to detach iSCSI Volume {{(pid=71509) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 10:51:21 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5230438-ed07-43dd-bd83-93fd4697ec41 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0bf0749390>, {'target_iqn': 'iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yctQbvEP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 10:51:21 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-d5230438-ed07-43dd-bd83-93fd4697ec41 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 10:51:21 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-d5230438-ed07-43dd-bd83-93fd4697ec41 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 10:51:21 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-d5230438-ed07-43dd-bd83-93fd4697ec41 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 10:51:21 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:51:21 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:51:21 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c06b469-0913-4202-b718-63c272a3c374]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e6828770-fda7-4cd5-b857-c4d2599299a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:51:21 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5230438-ed07-43dd-bd83-93fd4697ec41 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 10:51:21 user nova-compute[71509]: No targets found.
Apr 14 10:51:21 user nova-compute[71509]: iSNS:
Apr 14 10:51:21 user nova-compute[71509]: No targets found.
Apr 14 10:51:21 user nova-compute[71509]: STATIC:
Apr 14 10:51:21 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:e6828770-fda7-4cd5-b857-c4d2599299a7
Apr 14 10:51:21 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:51:21 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:51:21 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2
Apr 14 10:51:21 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:51:21 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:51:21 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178
Apr 14 10:51:21 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:51:21 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:51:21 user nova-compute[71509]: FIRMWARE:
Apr 14 10:51:21 user nova-compute[71509]: No targets found.
Apr 14 10:51:21 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:51:21 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5230438-ed07-43dd-bd83-93fd4697ec41 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 10:51:21 user nova-compute[71509]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 10:51:21 user nova-compute[71509]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71509) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 10:51:21 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5230438-ed07-43dd-bd83-93fd4697ec41 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2', 0)] {{(pid=71509) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 10:51:21 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:51:21 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:51:21 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7695669-0daf-408b-b6bb-d50326542b4c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6828770-fda7-4cd5-b857-c4d2599299a7\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:51:21 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:51:21 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-ddfa5ee2-efad-450e-b53d-7997f8e7cab1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:51:21 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-ddfa5ee2-efad-450e-b53d-7997f8e7cab1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:51:21 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-ddfa5ee2-efad-450e-b53d-7997f8e7cab1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71509) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 10:51:21 user nova-compute[71509]: INFO nova.compute.claims [None req-ddfa5ee2-efad-450e-b53d-7997f8e7cab1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: cd661ae0-c4bb-4117-847d-ef7e85d062fb] Claim successful on node user
Apr 14 10:51:21 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:51:21 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[e890bc0d-0c4b-459a-9ceb-3481e054b440]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6828770-fda7-4cd5-b857-c4d2599299a7 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:51:21 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5230438-ed07-43dd-bd83-93fd4697ec41 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2 (non-flash)
Apr 14 10:51:21 user nova-compute[71509]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6828770-fda7-4cd5-b857-c4d2599299a7 (non-flash)
Apr 14 10:51:21 user nova-compute[71509]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)
Apr 14 10:51:21 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:51:21 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5230438-ed07-43dd-bd83-93fd4697ec41 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2 (non-flash)
Apr 14 10:51:21 user nova-compute[71509]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6828770-fda7-4cd5-b857-c4d2599299a7 (non-flash)
Apr 14 10:51:21 user nova-compute[71509]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)
Apr 14 10:51:21 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 10:51:21 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5230438-ed07-43dd-bd83-93fd4697ec41 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0c2c351bd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2'): ({'sdc'}, set())}) {{(pid=71509) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 10:51:21 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-d5230438-ed07-43dd-bd83-93fd4697ec41 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Removing single pathed devices sdc {{(pid=71509) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 10:51:21 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:51:21 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:51:21 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[50ae71e8-1214-4d54-8e43-1220508dc527]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:51:21 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:51:21 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:51:21 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a6c3c87-93be-497d-ba00-fcd621ea6927]: (4, ('ok\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:51:21 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-d5230438-ed07-43dd-bd83-93fd4697ec41 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Flushing IO for device /dev/sdc {{(pid=71509) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 10:51:21 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:51:21 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:51:21 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[09079877-cfe4-46fc-9f73-38daddc9f4ba]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:51:21 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-d5230438-ed07-43dd-bd83-93fd4697ec41 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71509) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 10:51:21 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:51:22 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.345s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:51:22 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[94f9c24b-6271-4fab-91e2-241cb3d97d5d]: (4, ('1', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:51:22 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-d5230438-ed07-43dd-bd83-93fd4697ec41 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71509) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 10:51:22 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-d5230438-ed07-43dd-bd83-93fd4697ec41 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] SCSI volumes sdc have been removed. {{(pid=71509) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 10:51:22 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5230438-ed07-43dd-bd83-93fd4697ec41 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2')] {{(pid=71509) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 10:51:22 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:51:22 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:51:22 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[840df5c7-e2a0-4174-8695-4b834d069317]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:51:22 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5230438-ed07-43dd-bd83-93fd4697ec41 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:51:22 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2 -p 172.16.0.220:3260 --logout {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:51:22 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:51:22 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[1af291f0-83c0-4b57-a7d4-2fdf6b3382aa]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:51:22 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5230438-ed07-43dd-bd83-93fd4697ec41 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2, portal: 172.16.0.220,3260]
Apr 14 10:51:22 user nova-compute[71509]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2, portal: 172.16.0.220,3260] successful.
Apr 14 10:51:22 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:51:22 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2 -p 172.16.0.220:3260 --op delete {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:51:22 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-ddfa5ee2-efad-450e-b53d-7997f8e7cab1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 10:51:22 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:51:22 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[65be2ddf-8345-488e-81da-9e92541f6bdb]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:51:22 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5230438-ed07-43dd-bd83-93fd4697ec41 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:51:22 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-d5230438-ed07-43dd-bd83-93fd4697ec41 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.623s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 10:51:22 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5230438-ed07-43dd-bd83-93fd4697ec41 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] <== disconnect_volume: return (624ms) None {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 10:51:22 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5230438-ed07-43dd-bd83-93fd4697ec41 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Disconnected iSCSI Volume {{(pid=71509) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 10:51:22 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-ddfa5ee2-efad-450e-b53d-7997f8e7cab1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 10:51:22 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-d5230438-ed07-43dd-bd83-93fd4697ec41 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Start _get_guest_xml network_info=[{"id": "473d9af8-25a0-4e5a-9afb-7a0c843115cc", "address": "fa:16:3e:b0:12:bf", "network": {"id": "653f0c81-1afd-4ca6-9639-675ead1a6127", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-932652547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb9b9fc4f2e244879502006bb844761c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap473d9af8-25", "ovs_interfaceid": "473d9af8-25a0-4e5a-9afb-7a0c843115cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=048ec0ee-0465-448d-8b4c-f072acb101dc,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '048ec0ee-0465-448d-8b4c-f072acb101dc'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vdb', 'boot_index': None, 'device_type': 'disk', 'attachment_id': '129e52c7-c683-4bd6-80e9-7ce701f3821d', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yctQbvEP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '8586a70e-9855-4177-ac1b-cf707a4df871', 'attached_at': '', 'detached_at': '', 'volume_id': '64fbf5f9-3b53-42b6-8eb9-34688db256a2', 'serial': '64fbf5f9-3b53-42b6-8eb9-34688db256a2'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'volume_type': None} {{(pid=71509) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 10:51:22 user nova-compute[71509]: DEBUG nova.objects.instance [None req-d5230438-ed07-43dd-bd83-93fd4697ec41 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lazy-loading 'numa_topology' on Instance uuid 8586a70e-9855-4177-ac1b-cf707a4df871 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:51:22 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-ddfa5ee2-efad-450e-b53d-7997f8e7cab1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.611s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:51:22 user nova-compute[71509]: DEBUG nova.compute.manager [None req-ddfa5ee2-efad-450e-b53d-7997f8e7cab1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: cd661ae0-c4bb-4117-847d-ef7e85d062fb] Start building networks asynchronously for instance. {{(pid=71509) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 10:51:22 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-d5230438-ed07-43dd-bd83-93fd4697ec41 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:51:22 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-d5230438-ed07-43dd-bd83-93fd4697ec41 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:51:22 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-d5230438-ed07-43dd-bd83-93fd4697ec41 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71509) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 10:51:22 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-d5230438-ed07-43dd-bd83-93fd4697ec41 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T10:40:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=048ec0ee-0465-448d-8b4c-f072acb101dc,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 10:51:22 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-d5230438-ed07-43dd-bd83-93fd4697ec41 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Flavor limits 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 10:51:22 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-d5230438-ed07-43dd-bd83-93fd4697ec41 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Image limits 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 10:51:22 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-d5230438-ed07-43dd-bd83-93fd4697ec41 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Flavor pref 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 10:51:22 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-d5230438-ed07-43dd-bd83-93fd4697ec41 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Image pref 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 10:51:22 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-d5230438-ed07-43dd-bd83-93fd4697ec41 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 10:51:22 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-d5230438-ed07-43dd-bd83-93fd4697ec41 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 10:51:22 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-d5230438-ed07-43dd-bd83-93fd4697ec41 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71509) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 10:51:22 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-d5230438-ed07-43dd-bd83-93fd4697ec41 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Got 1 possible topologies {{(pid=71509) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 10:51:22 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-d5230438-ed07-43dd-bd83-93fd4697ec41 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 10:51:22 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-d5230438-ed07-43dd-bd83-93fd4697ec41 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 10:51:22 user nova-compute[71509]: DEBUG nova.objects.instance [None req-d5230438-ed07-43dd-bd83-93fd4697ec41 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8586a70e-9855-4177-ac1b-cf707a4df871 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:51:22 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5230438-ed07-43dd-bd83-93fd4697ec41 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Calling os-brick to attach iSCSI Volume {{(pid=71509) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 10:51:22 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5230438-ed07-43dd-bd83-93fd4697ec41 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0bf0749390>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yctQbvEP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 10:51:22 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-d5230438-ed07-43dd-bd83-93fd4697ec41 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 10:51:22 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-d5230438-ed07-43dd-bd83-93fd4697ec41 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 10:51:22 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-d5230438-ed07-43dd-bd83-93fd4697ec41 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 10:51:22 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-d5230438-ed07-43dd-bd83-93fd4697ec41 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 10:51:22 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-d5230438-ed07-43dd-bd83-93fd4697ec41 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 10:51:22 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-d5230438-ed07-43dd-bd83-93fd4697ec41 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 10:51:22 user nova-compute[71509]: INFO os_brick.initiator.connectors.iscsi [None req-d5230438-ed07-43dd-bd83-93fd4697ec41 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 10:51:22 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2 -p 172.16.0.220:3260 {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:51:22 user nova-compute[71509]: DEBUG nova.compute.manager [None req-ddfa5ee2-efad-450e-b53d-7997f8e7cab1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: cd661ae0-c4bb-4117-847d-ef7e85d062fb] Allocating IP information in the background. {{(pid=71509) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 10:51:22 user nova-compute[71509]: DEBUG nova.network.neutron [None req-ddfa5ee2-efad-450e-b53d-7997f8e7cab1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: cd661ae0-c4bb-4117-847d-ef7e85d062fb] allocate_for_instance() {{(pid=71509) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 10:51:22 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:51:22 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dd2d8b8-909c-4fc8-8b06-e4ac0278beb8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:51:22 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5230438-ed07-43dd-bd83-93fd4697ec41 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 10:51:22 user nova-compute[71509]:  {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:51:22 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-ddfa5ee2-efad-450e-b53d-7997f8e7cab1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: cd661ae0-c4bb-4117-847d-ef7e85d062fb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 10:51:22 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2 -p 172.16.0.220:3260 --interface default --op new {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:51:22 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:51:22 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e7b02c4-3a0e-472a-94c5-add319566756]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2] added\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:51:22 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5230438-ed07-43dd-bd83-93fd4697ec41 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2] added
Apr 14 10:51:22 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:51:22 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:51:22 user nova-compute[71509]: DEBUG nova.compute.manager [None req-ddfa5ee2-efad-450e-b53d-7997f8e7cab1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: cd661ae0-c4bb-4117-847d-ef7e85d062fb] Start building block device mappings for instance. {{(pid=71509) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 10:51:22 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:51:22 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfbc80c8-ba22-4966-bcba-d20cbc854b83]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:51:22 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5230438-ed07-43dd-bd83-93fd4697ec41 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:51:22 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:51:22 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:51:22 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[da106c52-84a9-4e5d-a4e4-aca333cb2fbd]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:51:22 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5230438-ed07-43dd-bd83-93fd4697ec41 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:51:22 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yctQbvEP {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:51:22 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yctQbvEP" returned: 0 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:51:22 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[236c405f-d3b6-4267-ad65-0e33b5985806]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:51:22 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5230438-ed07-43dd-bd83-93fd4697ec41 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yctQbvEP'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:51:22 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:51:22 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:51:22 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f63377f-21b2-46e2-a1a8-4a7c621c5d8c]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:51:22 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5230438-ed07-43dd-bd83-93fd4697ec41 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:51:22 user nova-compute[71509]: DEBUG nova.policy [None req-ddfa5ee2-efad-450e-b53d-7997f8e7cab1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '78adbbdcd10e446daddde754e46309b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8f294f957f4c74ae959c1e9f238427', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71509) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 10:51:22 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:51:22 user nova-compute[71509]: DEBUG nova.compute.manager [None req-ddfa5ee2-efad-450e-b53d-7997f8e7cab1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: cd661ae0-c4bb-4117-847d-ef7e85d062fb] Start spawning the instance on the hypervisor. {{(pid=71509) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 10:51:22 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-ddfa5ee2-efad-450e-b53d-7997f8e7cab1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: cd661ae0-c4bb-4117-847d-ef7e85d062fb] Creating instance directory {{(pid=71509) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 10:51:22 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-ddfa5ee2-efad-450e-b53d-7997f8e7cab1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: cd661ae0-c4bb-4117-847d-ef7e85d062fb] Creating image(s)
Apr 14 10:51:22 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-ddfa5ee2-efad-450e-b53d-7997f8e7cab1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "/opt/stack/data/nova/instances/cd661ae0-c4bb-4117-847d-ef7e85d062fb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:51:22 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-ddfa5ee2-efad-450e-b53d-7997f8e7cab1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "/opt/stack/data/nova/instances/cd661ae0-c4bb-4117-847d-ef7e85d062fb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:51:22 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-ddfa5ee2-efad-450e-b53d-7997f8e7cab1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "/opt/stack/data/nova/instances/cd661ae0-c4bb-4117-847d-ef7e85d062fb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:51:22 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:51:22 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[88ebe5d5-c582-41b8-843b-23ad7a8ae96d]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6828770-fda7-4cd5-b857-c4d2599299a7 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:51:22 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5230438-ed07-43dd-bd83-93fd4697ec41 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6828770-fda7-4cd5-b857-c4d2599299a7 (non-flash)
Apr 14 10:51:22 user nova-compute[71509]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)
Apr 14 10:51:22 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:51:22 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5230438-ed07-43dd-bd83-93fd4697ec41 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6828770-fda7-4cd5-b857-c4d2599299a7 (non-flash)
Apr 14 10:51:22 user nova-compute[71509]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)
Apr 14 10:51:22 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 10:51:22 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-ddfa5ee2-efad-450e-b53d-7997f8e7cab1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:51:22 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2 -p 172.16.0.220:3260 --login {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:51:22 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:51:22 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ae7bb67-e3f4-4e42-a633-32dbb1fc31ae]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:51:22 user nova-compute[71509]: DEBUG nova.compute.manager [req-d1bee4ff-8b79-43a2-801e-197208daa3b6 req-7f4092b7-6ad9-45bd-85f5-bb7a9a8f18fd service nova] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Received event network-vif-plugged-f2196ef3-aada-48d6-b524-5e9cef6a9eda {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:51:22 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-d1bee4ff-8b79-43a2-801e-197208daa3b6 req-7f4092b7-6ad9-45bd-85f5-bb7a9a8f18fd service nova] Acquiring lock "d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:51:22 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-d1bee4ff-8b79-43a2-801e-197208daa3b6 req-7f4092b7-6ad9-45bd-85f5-bb7a9a8f18fd service nova] Lock "d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:51:22 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-d1bee4ff-8b79-43a2-801e-197208daa3b6 req-7f4092b7-6ad9-45bd-85f5-bb7a9a8f18fd service nova] Lock "d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:51:22 user nova-compute[71509]: DEBUG nova.compute.manager [req-d1bee4ff-8b79-43a2-801e-197208daa3b6 req-7f4092b7-6ad9-45bd-85f5-bb7a9a8f18fd service nova] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] No waiting events found dispatching network-vif-plugged-f2196ef3-aada-48d6-b524-5e9cef6a9eda {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:51:22 user nova-compute[71509]: WARNING nova.compute.manager [req-d1bee4ff-8b79-43a2-801e-197208daa3b6 req-7f4092b7-6ad9-45bd-85f5-bb7a9a8f18fd service nova] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Received unexpected event network-vif-plugged-f2196ef3-aada-48d6-b524-5e9cef6a9eda for instance with vm_state building and task_state spawning.
Apr 14 10:51:22 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5230438-ed07-43dd-bd83-93fd4697ec41 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2, portal: 172.16.0.220,3260]
Apr 14 10:51:22 user nova-compute[71509]: Login to [iface: default, target: iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2, portal: 172.16.0.220,3260] successful.
Apr 14 10:51:22 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:51:22 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681469482.6643763, d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5 => Resumed> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 10:51:22 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] VM Resumed (Lifecycle Event)
Apr 14 10:51:22 user nova-compute[71509]: DEBUG nova.compute.manager [None req-8c974780-032a-46e9-984e-ef53b757a747 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Instance event wait completed in 0 seconds for  {{(pid=71509) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 10:51:22 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-8c974780-032a-46e9-984e-ef53b757a747 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Guest created on hypervisor {{(pid=71509) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 10:51:22 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:51:22 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:51:22 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd168edd-0816-47c6-a4b6-2b1b7a527d5c]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:51:22 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5230438-ed07-43dd-bd83-93fd4697ec41 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:51:22 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:51:22 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:51:22 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Instance spawned successfully.
Apr 14 10:51:22 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-8c974780-032a-46e9-984e-ef53b757a747 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 10:51:22 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:51:22 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ca7f48e-2110-4a0e-9bd5-71a7d1701e3f]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6828770-fda7-4cd5-b857-c4d2599299a7 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2 (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:51:22 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 10:51:22 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5230438-ed07-43dd-bd83-93fd4697ec41 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6828770-fda7-4cd5-b857-c4d2599299a7 (non-flash)
Apr 14 10:51:22 user nova-compute[71509]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)
Apr 14 10:51:22 user nova-compute[71509]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2 (non-flash)
Apr 14 10:51:22 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:51:22 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5230438-ed07-43dd-bd83-93fd4697ec41 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6828770-fda7-4cd5-b857-c4d2599299a7 (non-flash)
Apr 14 10:51:22 user nova-compute[71509]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)
Apr 14 10:51:22 user nova-compute[71509]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2 (non-flash)
Apr 14 10:51:22 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 10:51:22 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-d5230438-ed07-43dd-bd83-93fd4697ec41 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.348s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 10:51:22 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5230438-ed07-43dd-bd83-93fd4697ec41 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Connected to 172.16.0.220:3260 {{(pid=71509) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 10:51:22 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-d5230438-ed07-43dd-bd83-93fd4697ec41 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] HCTL ('34', '-', '-', 0) found on session 29 with lun 0 {{(pid=71509) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 10:51:22 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-d5230438-ed07-43dd-bd83-93fd4697ec41 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71509) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 10:51:22 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:51:22 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-8c974780-032a-46e9-984e-ef53b757a747 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Found default for hw_cdrom_bus of ide {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:51:22 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-8c974780-032a-46e9-984e-ef53b757a747 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Found default for hw_disk_bus of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:51:22 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-8c974780-032a-46e9-984e-ef53b757a747 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Found default for hw_input_bus of None {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:51:22 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-8c974780-032a-46e9-984e-ef53b757a747 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Found default for hw_pointer_model of None {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:51:22 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-8c974780-032a-46e9-984e-ef53b757a747 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Found default for hw_video_model of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:51:22 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-8c974780-032a-46e9-984e-ef53b757a747 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Found default for hw_vif_model of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:51:22 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:51:22 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[6be37a36-e945-494f-8f59-07e310fc0bce]: (4, ('- - 0', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:51:22 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 10:51:22 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681469482.667343, d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5 => Started> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 10:51:22 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] VM Started (Lifecycle Event)
Apr 14 10:51:22 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-d5230438-ed07-43dd-bd83-93fd4697ec41 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Searching for a device in session 29 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71509) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 10:51:22 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5230438-ed07-43dd-bd83-93fd4697ec41 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yctQbvEP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71509) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 10:51:22 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:51:22 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-ddfa5ee2-efad-450e-b53d-7997f8e7cab1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json" returned: 0 in 0.214s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:51:22 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-ddfa5ee2-efad-450e-b53d-7997f8e7cab1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:51:22 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-ddfa5ee2-efad-450e-b53d-7997f8e7cab1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:51:22 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-ddfa5ee2-efad-450e-b53d-7997f8e7cab1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:51:22 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 10:51:22 user nova-compute[71509]: INFO nova.compute.manager [None req-8c974780-032a-46e9-984e-ef53b757a747 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Took 7.51 seconds to spawn the instance on the hypervisor.
Apr 14 10:51:22 user nova-compute[71509]: DEBUG nova.compute.manager [None req-8c974780-032a-46e9-984e-ef53b757a747 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:51:22 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 10:51:22 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:51:22 user nova-compute[71509]: INFO nova.compute.manager [None req-8c974780-032a-46e9-984e-ef53b757a747 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Took 8.34 seconds to build instance.
Apr 14 10:51:22 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-8c974780-032a-46e9-984e-ef53b757a747 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.445s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:51:22 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-ddfa5ee2-efad-450e-b53d-7997f8e7cab1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json" returned: 0 in 0.166s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:51:22 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-ddfa5ee2-efad-450e-b53d-7997f8e7cab1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18,backing_fmt=raw /opt/stack/data/nova/instances/cd661ae0-c4bb-4117-847d-ef7e85d062fb/disk 1073741824 {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:51:23 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-ddfa5ee2-efad-450e-b53d-7997f8e7cab1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18,backing_fmt=raw /opt/stack/data/nova/instances/cd661ae0-c4bb-4117-847d-ef7e85d062fb/disk 1073741824" returned: 0 in 0.062s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:51:23 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-ddfa5ee2-efad-450e-b53d-7997f8e7cab1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:51:23 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-ddfa5ee2-efad-450e-b53d-7997f8e7cab1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:51:23 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-ddfa5ee2-efad-450e-b53d-7997f8e7cab1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json" returned: 0 in 0.142s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:51:23 user nova-compute[71509]: DEBUG nova.virt.disk.api [None req-ddfa5ee2-efad-450e-b53d-7997f8e7cab1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cd661ae0-c4bb-4117-847d-ef7e85d062fb/disk. size=1073741824 {{(pid=71509) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 10:51:23 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-ddfa5ee2-efad-450e-b53d-7997f8e7cab1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd661ae0-c4bb-4117-847d-ef7e85d062fb/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:51:23 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-ddfa5ee2-efad-450e-b53d-7997f8e7cab1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd661ae0-c4bb-4117-847d-ef7e85d062fb/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:51:23 user nova-compute[71509]: DEBUG nova.virt.disk.api [None req-ddfa5ee2-efad-450e-b53d-7997f8e7cab1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Cannot resize image /opt/stack/data/nova/instances/cd661ae0-c4bb-4117-847d-ef7e85d062fb/disk to a smaller size. {{(pid=71509) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 10:51:23 user nova-compute[71509]: DEBUG nova.objects.instance [None req-ddfa5ee2-efad-450e-b53d-7997f8e7cab1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lazy-loading 'migration_context' on Instance uuid cd661ae0-c4bb-4117-847d-ef7e85d062fb {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:51:23 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-ddfa5ee2-efad-450e-b53d-7997f8e7cab1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: cd661ae0-c4bb-4117-847d-ef7e85d062fb] Created local disks {{(pid=71509) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 10:51:23 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-ddfa5ee2-efad-450e-b53d-7997f8e7cab1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: cd661ae0-c4bb-4117-847d-ef7e85d062fb] Ensure instance console log exists: /opt/stack/data/nova/instances/cd661ae0-c4bb-4117-847d-ef7e85d062fb/console.log {{(pid=71509) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 10:51:23 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-ddfa5ee2-efad-450e-b53d-7997f8e7cab1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:51:23 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-ddfa5ee2-efad-450e-b53d-7997f8e7cab1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:51:23 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-ddfa5ee2-efad-450e-b53d-7997f8e7cab1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:51:23 user nova-compute[71509]: DEBUG nova.network.neutron [None req-ddfa5ee2-efad-450e-b53d-7997f8e7cab1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: cd661ae0-c4bb-4117-847d-ef7e85d062fb] Successfully created port: e2fa8ebc-482c-460c-924a-26111123a1d5 {{(pid=71509) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 10:51:23 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-d5230438-ed07-43dd-bd83-93fd4697ec41 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.398s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 10:51:23 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5230438-ed07-43dd-bd83-93fd4697ec41 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] <== connect_volume: return (1400ms) {'type': 'block', 'scsi_wwn': '26535643432366237', 'path': '/dev/sdc'} {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 10:51:23 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5230438-ed07-43dd-bd83-93fd4697ec41 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26535643432366237', 'path': '/dev/sdc'} {{(pid=71509) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 10:51:23 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-d5230438-ed07-43dd-bd83-93fd4697ec41 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T10:47:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1909620947',display_name='tempest-AttachVolumeTestJSON-server-1909620947',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1909620947',id=16,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB8cubhYj6kalSkwto2AOwwQ8SwXu5MQ/cjSK0TQBgPs7qiNcfKtpFOEItZcvi+VTwGeXlKnu4SiqcBNrbUUIw9hxThGtWyniX5k6WeMBHziH1L0bIiIvkr1gDZ6mYbTMQ==',key_name='tempest-keypair-1352311307',keypairs=<?>,launch_index=0,launched_at=2023-04-14T10:47:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='eb9b9fc4f2e244879502006bb844761c',ramdisk_id='',reservation_id='r-043k765a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-821788322',owner_user_name='tempest-AttachVolumeTestJSON-821788322-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T10:49:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11cb4a1e78d447dbb18cde5453fe499c',uuid=8586a70e-9855-4177-ac1b-cf707a4df871,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "473d9af8-25a0-4e5a-9afb-7a0c843115cc", "address": "fa:16:3e:b0:12:bf", "network": {"id": "653f0c81-1afd-4ca6-9639-675ead1a6127", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-932652547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb9b9fc4f2e244879502006bb844761c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap473d9af8-25", "ovs_interfaceid": "473d9af8-25a0-4e5a-9afb-7a0c843115cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71509) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 10:51:23 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-d5230438-ed07-43dd-bd83-93fd4697ec41 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Converting VIF {"id": "473d9af8-25a0-4e5a-9afb-7a0c843115cc", "address": "fa:16:3e:b0:12:bf", "network": {"id": "653f0c81-1afd-4ca6-9639-675ead1a6127", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-932652547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb9b9fc4f2e244879502006bb844761c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap473d9af8-25", "ovs_interfaceid": "473d9af8-25a0-4e5a-9afb-7a0c843115cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:51:23 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-d5230438-ed07-43dd-bd83-93fd4697ec41 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:12:bf,bridge_name='br-int',has_traffic_filtering=True,id=473d9af8-25a0-4e5a-9afb-7a0c843115cc,network=Network(653f0c81-1afd-4ca6-9639-675ead1a6127),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap473d9af8-25') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:51:23 user nova-compute[71509]: DEBUG nova.objects.instance [None req-d5230438-ed07-43dd-bd83-93fd4697ec41 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lazy-loading 'pci_devices' on Instance uuid 8586a70e-9855-4177-ac1b-cf707a4df871 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:51:23 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-d5230438-ed07-43dd-bd83-93fd4697ec41 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] End _get_guest_xml xml=<domain type="kvm">
Apr 14 10:51:23 user nova-compute[71509]:   <uuid>8586a70e-9855-4177-ac1b-cf707a4df871</uuid>
Apr 14 10:51:23 user nova-compute[71509]:   <name>instance-00000010</name>
Apr 14 10:51:23 user nova-compute[71509]:   <memory>131072</memory>
Apr 14 10:51:23 user nova-compute[71509]:   <vcpu>1</vcpu>
Apr 14 10:51:23 user nova-compute[71509]:   <metadata>
Apr 14 10:51:23 user nova-compute[71509]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 10:51:23 user nova-compute[71509]:       <nova:package version="0.0.0"/>
Apr 14 10:51:23 user nova-compute[71509]:       <nova:name>tempest-AttachVolumeTestJSON-server-1909620947</nova:name>
Apr 14 10:51:23 user nova-compute[71509]:       <nova:creationTime>2023-04-14 10:51:22</nova:creationTime>
Apr 14 10:51:23 user nova-compute[71509]:       <nova:flavor name="m1.nano">
Apr 14 10:51:23 user nova-compute[71509]:         <nova:memory>128</nova:memory>
Apr 14 10:51:23 user nova-compute[71509]:         <nova:disk>1</nova:disk>
Apr 14 10:51:23 user nova-compute[71509]:         <nova:swap>0</nova:swap>
Apr 14 10:51:23 user nova-compute[71509]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 10:51:23 user nova-compute[71509]:         <nova:vcpus>1</nova:vcpus>
Apr 14 10:51:23 user nova-compute[71509]:       </nova:flavor>
Apr 14 10:51:23 user nova-compute[71509]:       <nova:owner>
Apr 14 10:51:23 user nova-compute[71509]:         <nova:user uuid="11cb4a1e78d447dbb18cde5453fe499c">tempest-AttachVolumeTestJSON-821788322-project-member</nova:user>
Apr 14 10:51:23 user nova-compute[71509]:         <nova:project uuid="eb9b9fc4f2e244879502006bb844761c">tempest-AttachVolumeTestJSON-821788322</nova:project>
Apr 14 10:51:23 user nova-compute[71509]:       </nova:owner>
Apr 14 10:51:23 user nova-compute[71509]:       <nova:root type="image" uuid="048ec0ee-0465-448d-8b4c-f072acb101dc"/>
Apr 14 10:51:23 user nova-compute[71509]:       <nova:ports>
Apr 14 10:51:23 user nova-compute[71509]:         <nova:port uuid="473d9af8-25a0-4e5a-9afb-7a0c843115cc">
Apr 14 10:51:23 user nova-compute[71509]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 14 10:51:23 user nova-compute[71509]:         </nova:port>
Apr 14 10:51:23 user nova-compute[71509]:       </nova:ports>
Apr 14 10:51:23 user nova-compute[71509]:     </nova:instance>
Apr 14 10:51:23 user nova-compute[71509]:   </metadata>
Apr 14 10:51:23 user nova-compute[71509]:   <sysinfo type="smbios">
Apr 14 10:51:23 user nova-compute[71509]:     <system>
Apr 14 10:51:23 user nova-compute[71509]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 10:51:23 user nova-compute[71509]:       <entry name="product">OpenStack Nova</entry>
Apr 14 10:51:23 user nova-compute[71509]:       <entry name="version">0.0.0</entry>
Apr 14 10:51:23 user nova-compute[71509]:       <entry name="serial">8586a70e-9855-4177-ac1b-cf707a4df871</entry>
Apr 14 10:51:23 user nova-compute[71509]:       <entry name="uuid">8586a70e-9855-4177-ac1b-cf707a4df871</entry>
Apr 14 10:51:23 user nova-compute[71509]:       <entry name="family">Virtual Machine</entry>
Apr 14 10:51:23 user nova-compute[71509]:     </system>
Apr 14 10:51:23 user nova-compute[71509]:   </sysinfo>
Apr 14 10:51:23 user nova-compute[71509]:   <os>
Apr 14 10:51:23 user nova-compute[71509]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 10:51:23 user nova-compute[71509]:     <boot dev="hd"/>
Apr 14 10:51:23 user nova-compute[71509]:     <smbios mode="sysinfo"/>
Apr 14 10:51:23 user nova-compute[71509]:   </os>
Apr 14 10:51:23 user nova-compute[71509]:   <features>
Apr 14 10:51:23 user nova-compute[71509]:     <acpi/>
Apr 14 10:51:23 user nova-compute[71509]:     <apic/>
Apr 14 10:51:23 user nova-compute[71509]:     <vmcoreinfo/>
Apr 14 10:51:23 user nova-compute[71509]:   </features>
Apr 14 10:51:23 user nova-compute[71509]:   <clock offset="utc">
Apr 14 10:51:23 user nova-compute[71509]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 10:51:23 user nova-compute[71509]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 10:51:23 user nova-compute[71509]:     <timer name="hpet" present="no"/>
Apr 14 10:51:23 user nova-compute[71509]:   </clock>
Apr 14 10:51:23 user nova-compute[71509]:   <cpu mode="custom" match="exact">
Apr 14 10:51:23 user nova-compute[71509]:     <model>Nehalem</model>
Apr 14 10:51:23 user nova-compute[71509]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 10:51:23 user nova-compute[71509]:   </cpu>
Apr 14 10:51:23 user nova-compute[71509]:   <devices>
Apr 14 10:51:23 user nova-compute[71509]:     <disk type="file" device="disk">
Apr 14 10:51:23 user nova-compute[71509]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 10:51:23 user nova-compute[71509]:       <source file="/opt/stack/data/nova/instances/8586a70e-9855-4177-ac1b-cf707a4df871/disk"/>
Apr 14 10:51:23 user nova-compute[71509]:       <target dev="vda" bus="virtio"/>
Apr 14 10:51:23 user nova-compute[71509]:     </disk>
Apr 14 10:51:23 user nova-compute[71509]:     <disk type="block" device="disk">
Apr 14 10:51:23 user nova-compute[71509]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 10:51:23 user nova-compute[71509]:       <source dev="/dev/sdc"/>
Apr 14 10:51:23 user nova-compute[71509]:       <target dev="vdb" bus="virtio"/>
Apr 14 10:51:23 user nova-compute[71509]:       <serial>64fbf5f9-3b53-42b6-8eb9-34688db256a2</serial>
Apr 14 10:51:23 user nova-compute[71509]:     </disk>
Apr 14 10:51:23 user nova-compute[71509]:     <interface type="ethernet">
Apr 14 10:51:23 user nova-compute[71509]:       <mac address="fa:16:3e:b0:12:bf"/>
Apr 14 10:51:23 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 10:51:23 user nova-compute[71509]:       <mtu size="1442"/>
Apr 14 10:51:23 user nova-compute[71509]:       <target dev="tap473d9af8-25"/>
Apr 14 10:51:23 user nova-compute[71509]:     </interface>
Apr 14 10:51:23 user nova-compute[71509]:     <serial type="pty">
Apr 14 10:51:23 user nova-compute[71509]:       <log file="/opt/stack/data/nova/instances/8586a70e-9855-4177-ac1b-cf707a4df871/console.log" append="off"/>
Apr 14 10:51:23 user nova-compute[71509]:     </serial>
Apr 14 10:51:23 user nova-compute[71509]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 10:51:23 user nova-compute[71509]:     <video>
Apr 14 10:51:23 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 10:51:23 user nova-compute[71509]:     </video>
Apr 14 10:51:23 user nova-compute[71509]:     <rng model="virtio">
Apr 14 10:51:23 user nova-compute[71509]:       <backend model="random">/dev/urandom</backend>
Apr 14 10:51:23 user nova-compute[71509]:     </rng>
Apr 14 10:51:23 user nova-compute[71509]:     <controller type="usb" index="0" model="none"/>
Apr 14 10:51:23 user nova-compute[71509]:     <memballoon model="virtio">
Apr 14 10:51:23 user nova-compute[71509]:       <stats period="10"/>
Apr 14 10:51:23 user nova-compute[71509]:     </memballoon>
Apr 14 10:51:23 user nova-compute[71509]:   </devices>
Apr 14 10:51:23 user nova-compute[71509]: </domain>
Apr 14 10:51:23 user nova-compute[71509]:  {{(pid=71509) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 10:51:23 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-d5230438-ed07-43dd-bd83-93fd4697ec41 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8586a70e-9855-4177-ac1b-cf707a4df871/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:51:23 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-d5230438-ed07-43dd-bd83-93fd4697ec41 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8586a70e-9855-4177-ac1b-cf707a4df871/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:51:23 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-d5230438-ed07-43dd-bd83-93fd4697ec41 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8586a70e-9855-4177-ac1b-cf707a4df871/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:51:24 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-d5230438-ed07-43dd-bd83-93fd4697ec41 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8586a70e-9855-4177-ac1b-cf707a4df871/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:51:24 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-d5230438-ed07-43dd-bd83-93fd4697ec41 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71509) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 10:51:24 user nova-compute[71509]: DEBUG nova.objects.instance [None req-d5230438-ed07-43dd-bd83-93fd4697ec41 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lazy-loading 'trusted_certs' on Instance uuid 8586a70e-9855-4177-ac1b-cf707a4df871 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:51:24 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-d5230438-ed07-43dd-bd83-93fd4697ec41 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:51:24 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-d5230438-ed07-43dd-bd83-93fd4697ec41 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json" returned: 0 in 0.138s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:51:24 user nova-compute[71509]: DEBUG nova.virt.disk.api [None req-d5230438-ed07-43dd-bd83-93fd4697ec41 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8586a70e-9855-4177-ac1b-cf707a4df871/disk. size=1073741824 {{(pid=71509) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 10:51:24 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-d5230438-ed07-43dd-bd83-93fd4697ec41 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8586a70e-9855-4177-ac1b-cf707a4df871/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:51:24 user nova-compute[71509]: DEBUG nova.network.neutron [None req-ddfa5ee2-efad-450e-b53d-7997f8e7cab1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: cd661ae0-c4bb-4117-847d-ef7e85d062fb] Successfully updated port: e2fa8ebc-482c-460c-924a-26111123a1d5 {{(pid=71509) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 10:51:24 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-ddfa5ee2-efad-450e-b53d-7997f8e7cab1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "refresh_cache-cd661ae0-c4bb-4117-847d-ef7e85d062fb" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:51:24 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-ddfa5ee2-efad-450e-b53d-7997f8e7cab1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquired lock "refresh_cache-cd661ae0-c4bb-4117-847d-ef7e85d062fb" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:51:24 user nova-compute[71509]: DEBUG nova.network.neutron [None req-ddfa5ee2-efad-450e-b53d-7997f8e7cab1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: cd661ae0-c4bb-4117-847d-ef7e85d062fb] Building network info cache for instance {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 10:51:24 user nova-compute[71509]: DEBUG nova.compute.manager [req-ea2c5c21-784b-479b-8dc5-e9cde9ca15e6 req-c7d32161-e00a-4aaa-a667-c0f1305d6a7e service nova] [instance: cd661ae0-c4bb-4117-847d-ef7e85d062fb] Received event network-changed-e2fa8ebc-482c-460c-924a-26111123a1d5 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:51:24 user nova-compute[71509]: DEBUG nova.compute.manager [req-ea2c5c21-784b-479b-8dc5-e9cde9ca15e6 req-c7d32161-e00a-4aaa-a667-c0f1305d6a7e service nova] [instance: cd661ae0-c4bb-4117-847d-ef7e85d062fb] Refreshing instance network info cache due to event network-changed-e2fa8ebc-482c-460c-924a-26111123a1d5. {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 10:51:24 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-ea2c5c21-784b-479b-8dc5-e9cde9ca15e6 req-c7d32161-e00a-4aaa-a667-c0f1305d6a7e service nova] Acquiring lock "refresh_cache-cd661ae0-c4bb-4117-847d-ef7e85d062fb" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:51:24 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-d5230438-ed07-43dd-bd83-93fd4697ec41 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8586a70e-9855-4177-ac1b-cf707a4df871/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:51:24 user nova-compute[71509]: DEBUG nova.virt.disk.api [None req-d5230438-ed07-43dd-bd83-93fd4697ec41 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Cannot resize image /opt/stack/data/nova/instances/8586a70e-9855-4177-ac1b-cf707a4df871/disk to a smaller size. {{(pid=71509) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 10:51:24 user nova-compute[71509]: DEBUG nova.objects.instance [None req-d5230438-ed07-43dd-bd83-93fd4697ec41 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lazy-loading 'migration_context' on Instance uuid 8586a70e-9855-4177-ac1b-cf707a4df871 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:51:24 user nova-compute[71509]: DEBUG nova.network.neutron [None req-ddfa5ee2-efad-450e-b53d-7997f8e7cab1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: cd661ae0-c4bb-4117-847d-ef7e85d062fb] Instance cache missing network info. {{(pid=71509) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 10:51:24 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-d5230438-ed07-43dd-bd83-93fd4697ec41 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T10:47:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1909620947',display_name='tempest-AttachVolumeTestJSON-server-1909620947',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1909620947',id=16,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB8cubhYj6kalSkwto2AOwwQ8SwXu5MQ/cjSK0TQBgPs7qiNcfKtpFOEItZcvi+VTwGeXlKnu4SiqcBNrbUUIw9hxThGtWyniX5k6WeMBHziH1L0bIiIvkr1gDZ6mYbTMQ==',key_name='tempest-keypair-1352311307',keypairs=<?>,launch_index=0,launched_at=2023-04-14T10:47:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='eb9b9fc4f2e244879502006bb844761c',ramdisk_id='',reservation_id='r-043k765a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-821788322',owner_user_name='tempest-AttachVolumeTestJSON-821788322-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T10:49:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11cb4a1e78d447dbb18cde5453fe499c',uuid=8586a70e-9855-4177-ac1b-cf707a4df871,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "473d9af8-25a0-4e5a-9afb-7a0c843115cc", "address": "fa:16:3e:b0:12:bf", "network": {"id": "653f0c81-1afd-4ca6-9639-675ead1a6127", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-932652547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb9b9fc4f2e244879502006bb844761c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap473d9af8-25", "ovs_interfaceid": "473d9af8-25a0-4e5a-9afb-7a0c843115cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 10:51:24 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-d5230438-ed07-43dd-bd83-93fd4697ec41 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Converting VIF {"id": "473d9af8-25a0-4e5a-9afb-7a0c843115cc", "address": "fa:16:3e:b0:12:bf", "network": {"id": "653f0c81-1afd-4ca6-9639-675ead1a6127", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-932652547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb9b9fc4f2e244879502006bb844761c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap473d9af8-25", "ovs_interfaceid": "473d9af8-25a0-4e5a-9afb-7a0c843115cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:51:24 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-d5230438-ed07-43dd-bd83-93fd4697ec41 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:12:bf,bridge_name='br-int',has_traffic_filtering=True,id=473d9af8-25a0-4e5a-9afb-7a0c843115cc,network=Network(653f0c81-1afd-4ca6-9639-675ead1a6127),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap473d9af8-25') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:51:24 user nova-compute[71509]: DEBUG os_vif [None req-d5230438-ed07-43dd-bd83-93fd4697ec41 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:12:bf,bridge_name='br-int',has_traffic_filtering=True,id=473d9af8-25a0-4e5a-9afb-7a0c843115cc,network=Network(653f0c81-1afd-4ca6-9639-675ead1a6127),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap473d9af8-25') {{(pid=71509) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 10:51:24 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:51:24 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:51:24 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 10:51:24 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:51:24 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap473d9af8-25, may_exist=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:51:24 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap473d9af8-25, col_values=(('external_ids', {'iface-id': '473d9af8-25a0-4e5a-9afb-7a0c843115cc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b0:12:bf', 'vm-uuid': '8586a70e-9855-4177-ac1b-cf707a4df871'}),)) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:51:24 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:51:24 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 10:51:24 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:51:24 user nova-compute[71509]: INFO os_vif [None req-d5230438-ed07-43dd-bd83-93fd4697ec41 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:12:bf,bridge_name='br-int',has_traffic_filtering=True,id=473d9af8-25a0-4e5a-9afb-7a0c843115cc,network=Network(653f0c81-1afd-4ca6-9639-675ead1a6127),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap473d9af8-25')
Apr 14 10:51:24 user nova-compute[71509]: DEBUG nova.network.neutron [None req-ddfa5ee2-efad-450e-b53d-7997f8e7cab1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: cd661ae0-c4bb-4117-847d-ef7e85d062fb] Updating instance_info_cache with network_info: [{"id": "e2fa8ebc-482c-460c-924a-26111123a1d5", "address": "fa:16:3e:d2:b7:64", "network": {"id": "b639a68a-2b4e-435c-b98b-65b5b4981c73", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1070821894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb8f294f957f4c74ae959c1e9f238427", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2fa8ebc-48", "ovs_interfaceid": "e2fa8ebc-482c-460c-924a-26111123a1d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:51:24 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-ddfa5ee2-efad-450e-b53d-7997f8e7cab1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Releasing lock "refresh_cache-cd661ae0-c4bb-4117-847d-ef7e85d062fb" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:51:24 user nova-compute[71509]: DEBUG nova.compute.manager [None req-ddfa5ee2-efad-450e-b53d-7997f8e7cab1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: cd661ae0-c4bb-4117-847d-ef7e85d062fb] Instance network_info: |[{"id": "e2fa8ebc-482c-460c-924a-26111123a1d5", "address": "fa:16:3e:d2:b7:64", "network": {"id": "b639a68a-2b4e-435c-b98b-65b5b4981c73", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1070821894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb8f294f957f4c74ae959c1e9f238427", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2fa8ebc-48", "ovs_interfaceid": "e2fa8ebc-482c-460c-924a-26111123a1d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71509) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 10:51:24 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-ea2c5c21-784b-479b-8dc5-e9cde9ca15e6 req-c7d32161-e00a-4aaa-a667-c0f1305d6a7e service nova] Acquired lock "refresh_cache-cd661ae0-c4bb-4117-847d-ef7e85d062fb" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:51:24 user nova-compute[71509]: DEBUG nova.network.neutron [req-ea2c5c21-784b-479b-8dc5-e9cde9ca15e6 req-c7d32161-e00a-4aaa-a667-c0f1305d6a7e service nova] [instance: cd661ae0-c4bb-4117-847d-ef7e85d062fb] Refreshing network info cache for port e2fa8ebc-482c-460c-924a-26111123a1d5 {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 10:51:24 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-ddfa5ee2-efad-450e-b53d-7997f8e7cab1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: cd661ae0-c4bb-4117-847d-ef7e85d062fb] Start _get_guest_xml network_info=[{"id": "e2fa8ebc-482c-460c-924a-26111123a1d5", "address": "fa:16:3e:d2:b7:64", "network": {"id": "b639a68a-2b4e-435c-b98b-65b5b4981c73", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1070821894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb8f294f957f4c74ae959c1e9f238427", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2fa8ebc-48", "ovs_interfaceid": "e2fa8ebc-482c-460c-924a-26111123a1d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T10:38:55Z,direct_url=<?>,disk_format='qcow2',id=048ec0ee-0465-448d-8b4c-f072acb101dc,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='9742d6ad20cf48d9bab0fdbcc9491db9',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T10:38:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '048ec0ee-0465-448d-8b4c-f072acb101dc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71509) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 10:51:24 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-ddfa5ee2-efad-450e-b53d-7997f8e7cab1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:51:24 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-ddfa5ee2-efad-450e-b53d-7997f8e7cab1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:51:24 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-ddfa5ee2-efad-450e-b53d-7997f8e7cab1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71509) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 10:51:24 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-ddfa5ee2-efad-450e-b53d-7997f8e7cab1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T10:40:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T10:38:55Z,direct_url=<?>,disk_format='qcow2',id=048ec0ee-0465-448d-8b4c-f072acb101dc,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='9742d6ad20cf48d9bab0fdbcc9491db9',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T10:38:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 10:51:24 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-ddfa5ee2-efad-450e-b53d-7997f8e7cab1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Flavor limits 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 10:51:24 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-ddfa5ee2-efad-450e-b53d-7997f8e7cab1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Image limits 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 10:51:24 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-ddfa5ee2-efad-450e-b53d-7997f8e7cab1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Flavor pref 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 10:51:24 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-ddfa5ee2-efad-450e-b53d-7997f8e7cab1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Image pref 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 10:51:24 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-ddfa5ee2-efad-450e-b53d-7997f8e7cab1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 10:51:24 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-ddfa5ee2-efad-450e-b53d-7997f8e7cab1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 10:51:24 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-ddfa5ee2-efad-450e-b53d-7997f8e7cab1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71509) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 10:51:24 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-ddfa5ee2-efad-450e-b53d-7997f8e7cab1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Got 1 possible topologies {{(pid=71509) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 10:51:24 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-ddfa5ee2-efad-450e-b53d-7997f8e7cab1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 10:51:24 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-ddfa5ee2-efad-450e-b53d-7997f8e7cab1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 10:51:24 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-ddfa5ee2-efad-450e-b53d-7997f8e7cab1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T10:51:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-917305574',display_name='tempest-AttachVolumeNegativeTest-server-917305574',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-917305574',id=23,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNeYGYiTcJWVdyGLLXUUtNmeqpPAuLbYzcQtlw/K/cx7u5I+/z+BFqZ/Q85m4vszeUjxdAJi787/sHm5PWAgol4M4ijgjZBMAK6LdEVj2SxKBuOkTED+u+J8G5CKwgGGjA==',key_name='tempest-keypair-388083155',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cb8f294f957f4c74ae959c1e9f238427',ramdisk_id='',reservation_id='r-908kfe5a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-531644967',owner_user_name='tempest-AttachVolumeNegativeTest-531644967-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T10:51:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='78adbbdcd10e446daddde754e46309b2',uuid=cd661ae0-c4bb-4117-847d-ef7e85d062fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e2fa8ebc-482c-460c-924a-26111123a1d5", "address": "fa:16:3e:d2:b7:64", "network": {"id": "b639a68a-2b4e-435c-b98b-65b5b4981c73", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1070821894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb8f294f957f4c74ae959c1e9f238427", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2fa8ebc-48", "ovs_interfaceid": "e2fa8ebc-482c-460c-924a-26111123a1d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71509) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 10:51:24 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-ddfa5ee2-efad-450e-b53d-7997f8e7cab1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Converting VIF {"id": "e2fa8ebc-482c-460c-924a-26111123a1d5", "address": "fa:16:3e:d2:b7:64", "network": {"id": "b639a68a-2b4e-435c-b98b-65b5b4981c73", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1070821894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb8f294f957f4c74ae959c1e9f238427", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2fa8ebc-48", "ovs_interfaceid": "e2fa8ebc-482c-460c-924a-26111123a1d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:51:24 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-ddfa5ee2-efad-450e-b53d-7997f8e7cab1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:b7:64,bridge_name='br-int',has_traffic_filtering=True,id=e2fa8ebc-482c-460c-924a-26111123a1d5,network=Network(b639a68a-2b4e-435c-b98b-65b5b4981c73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2fa8ebc-48') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:51:24 user nova-compute[71509]: DEBUG nova.objects.instance [None req-ddfa5ee2-efad-450e-b53d-7997f8e7cab1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lazy-loading 'pci_devices' on Instance uuid cd661ae0-c4bb-4117-847d-ef7e85d062fb {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:51:24 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-ddfa5ee2-efad-450e-b53d-7997f8e7cab1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: cd661ae0-c4bb-4117-847d-ef7e85d062fb] End _get_guest_xml xml=<domain type="kvm">
Apr 14 10:51:24 user nova-compute[71509]:   <uuid>cd661ae0-c4bb-4117-847d-ef7e85d062fb</uuid>
Apr 14 10:51:24 user nova-compute[71509]:   <name>instance-00000017</name>
Apr 14 10:51:24 user nova-compute[71509]:   <memory>131072</memory>
Apr 14 10:51:24 user nova-compute[71509]:   <vcpu>1</vcpu>
Apr 14 10:51:24 user nova-compute[71509]:   <metadata>
Apr 14 10:51:24 user nova-compute[71509]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 10:51:24 user nova-compute[71509]:       <nova:package version="0.0.0"/>
Apr 14 10:51:24 user nova-compute[71509]:       <nova:name>tempest-AttachVolumeNegativeTest-server-917305574</nova:name>
Apr 14 10:51:24 user nova-compute[71509]:       <nova:creationTime>2023-04-14 10:51:24</nova:creationTime>
Apr 14 10:51:24 user nova-compute[71509]:       <nova:flavor name="m1.nano">
Apr 14 10:51:24 user nova-compute[71509]:         <nova:memory>128</nova:memory>
Apr 14 10:51:24 user nova-compute[71509]:         <nova:disk>1</nova:disk>
Apr 14 10:51:24 user nova-compute[71509]:         <nova:swap>0</nova:swap>
Apr 14 10:51:24 user nova-compute[71509]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 10:51:24 user nova-compute[71509]:         <nova:vcpus>1</nova:vcpus>
Apr 14 10:51:24 user nova-compute[71509]:       </nova:flavor>
Apr 14 10:51:24 user nova-compute[71509]:       <nova:owner>
Apr 14 10:51:24 user nova-compute[71509]:         <nova:user uuid="78adbbdcd10e446daddde754e46309b2">tempest-AttachVolumeNegativeTest-531644967-project-member</nova:user>
Apr 14 10:51:24 user nova-compute[71509]:         <nova:project uuid="cb8f294f957f4c74ae959c1e9f238427">tempest-AttachVolumeNegativeTest-531644967</nova:project>
Apr 14 10:51:24 user nova-compute[71509]:       </nova:owner>
Apr 14 10:51:24 user nova-compute[71509]:       <nova:root type="image" uuid="048ec0ee-0465-448d-8b4c-f072acb101dc"/>
Apr 14 10:51:24 user nova-compute[71509]:       <nova:ports>
Apr 14 10:51:24 user nova-compute[71509]:         <nova:port uuid="e2fa8ebc-482c-460c-924a-26111123a1d5">
Apr 14 10:51:24 user nova-compute[71509]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 14 10:51:24 user nova-compute[71509]:         </nova:port>
Apr 14 10:51:24 user nova-compute[71509]:       </nova:ports>
Apr 14 10:51:24 user nova-compute[71509]:     </nova:instance>
Apr 14 10:51:24 user nova-compute[71509]:   </metadata>
Apr 14 10:51:24 user nova-compute[71509]:   <sysinfo type="smbios">
Apr 14 10:51:24 user nova-compute[71509]:     <system>
Apr 14 10:51:24 user nova-compute[71509]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 10:51:24 user nova-compute[71509]:       <entry name="product">OpenStack Nova</entry>
Apr 14 10:51:24 user nova-compute[71509]:       <entry name="version">0.0.0</entry>
Apr 14 10:51:24 user nova-compute[71509]:       <entry name="serial">cd661ae0-c4bb-4117-847d-ef7e85d062fb</entry>
Apr 14 10:51:24 user nova-compute[71509]:       <entry name="uuid">cd661ae0-c4bb-4117-847d-ef7e85d062fb</entry>
Apr 14 10:51:24 user nova-compute[71509]:       <entry name="family">Virtual Machine</entry>
Apr 14 10:51:24 user nova-compute[71509]:     </system>
Apr 14 10:51:24 user nova-compute[71509]:   </sysinfo>
Apr 14 10:51:24 user nova-compute[71509]:   <os>
Apr 14 10:51:24 user nova-compute[71509]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 10:51:24 user nova-compute[71509]:     <boot dev="hd"/>
Apr 14 10:51:24 user nova-compute[71509]:     <smbios mode="sysinfo"/>
Apr 14 10:51:24 user nova-compute[71509]:   </os>
Apr 14 10:51:24 user nova-compute[71509]:   <features>
Apr 14 10:51:24 user nova-compute[71509]:     <acpi/>
Apr 14 10:51:24 user nova-compute[71509]:     <apic/>
Apr 14 10:51:24 user nova-compute[71509]:     <vmcoreinfo/>
Apr 14 10:51:24 user nova-compute[71509]:   </features>
Apr 14 10:51:24 user nova-compute[71509]:   <clock offset="utc">
Apr 14 10:51:24 user nova-compute[71509]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 10:51:24 user nova-compute[71509]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 10:51:24 user nova-compute[71509]:     <timer name="hpet" present="no"/>
Apr 14 10:51:24 user nova-compute[71509]:   </clock>
Apr 14 10:51:24 user nova-compute[71509]:   <cpu mode="custom" match="exact">
Apr 14 10:51:24 user nova-compute[71509]:     <model>Nehalem</model>
Apr 14 10:51:24 user nova-compute[71509]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 10:51:24 user nova-compute[71509]:   </cpu>
Apr 14 10:51:24 user nova-compute[71509]:   <devices>
Apr 14 10:51:24 user nova-compute[71509]:     <disk type="file" device="disk">
Apr 14 10:51:24 user nova-compute[71509]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 10:51:24 user nova-compute[71509]:       <source file="/opt/stack/data/nova/instances/cd661ae0-c4bb-4117-847d-ef7e85d062fb/disk"/>
Apr 14 10:51:24 user nova-compute[71509]:       <target dev="vda" bus="virtio"/>
Apr 14 10:51:24 user nova-compute[71509]:     </disk>
Apr 14 10:51:24 user nova-compute[71509]:     <interface type="ethernet">
Apr 14 10:51:24 user nova-compute[71509]:       <mac address="fa:16:3e:d2:b7:64"/>
Apr 14 10:51:24 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 10:51:24 user nova-compute[71509]:       <mtu size="1442"/>
Apr 14 10:51:24 user nova-compute[71509]:       <target dev="tape2fa8ebc-48"/>
Apr 14 10:51:24 user nova-compute[71509]:     </interface>
Apr 14 10:51:24 user nova-compute[71509]:     <serial type="pty">
Apr 14 10:51:24 user nova-compute[71509]:       <log file="/opt/stack/data/nova/instances/cd661ae0-c4bb-4117-847d-ef7e85d062fb/console.log" append="off"/>
Apr 14 10:51:24 user nova-compute[71509]:     </serial>
Apr 14 10:51:24 user nova-compute[71509]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 10:51:24 user nova-compute[71509]:     <video>
Apr 14 10:51:24 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 10:51:24 user nova-compute[71509]:     </video>
Apr 14 10:51:24 user nova-compute[71509]:     <rng model="virtio">
Apr 14 10:51:24 user nova-compute[71509]:       <backend model="random">/dev/urandom</backend>
Apr 14 10:51:24 user nova-compute[71509]:     </rng>
Apr 14 10:51:24 user nova-compute[71509]:     <controller type="usb" index="0" model="none"/>
Apr 14 10:51:24 user nova-compute[71509]:     <memballoon model="virtio">
Apr 14 10:51:24 user nova-compute[71509]:       <stats period="10"/>
Apr 14 10:51:24 user nova-compute[71509]:     </memballoon>
Apr 14 10:51:24 user nova-compute[71509]:   </devices>
Apr 14 10:51:24 user nova-compute[71509]: </domain>
Apr 14 10:51:24 user nova-compute[71509]:  {{(pid=71509) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 10:51:24 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-ddfa5ee2-efad-450e-b53d-7997f8e7cab1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T10:51:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-917305574',display_name='tempest-AttachVolumeNegativeTest-server-917305574',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-917305574',id=23,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNeYGYiTcJWVdyGLLXUUtNmeqpPAuLbYzcQtlw/K/cx7u5I+/z+BFqZ/Q85m4vszeUjxdAJi787/sHm5PWAgol4M4ijgjZBMAK6LdEVj2SxKBuOkTED+u+J8G5CKwgGGjA==',key_name='tempest-keypair-388083155',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cb8f294f957f4c74ae959c1e9f238427',ramdisk_id='',reservation_id='r-908kfe5a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-531644967',owner_user_name='tempest-AttachVolumeNegativeTest-531644967-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T10:51:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='78adbbdcd10e446daddde754e46309b2',uuid=cd661ae0-c4bb-4117-847d-ef7e85d062fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e2fa8ebc-482c-460c-924a-26111123a1d5", "address": "fa:16:3e:d2:b7:64", "network": {"id": "b639a68a-2b4e-435c-b98b-65b5b4981c73", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1070821894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb8f294f957f4c74ae959c1e9f238427", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2fa8ebc-48", "ovs_interfaceid": "e2fa8ebc-482c-460c-924a-26111123a1d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 10:51:24 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-ddfa5ee2-efad-450e-b53d-7997f8e7cab1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Converting VIF {"id": "e2fa8ebc-482c-460c-924a-26111123a1d5", "address": "fa:16:3e:d2:b7:64", "network": {"id": "b639a68a-2b4e-435c-b98b-65b5b4981c73", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1070821894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb8f294f957f4c74ae959c1e9f238427", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2fa8ebc-48", "ovs_interfaceid": "e2fa8ebc-482c-460c-924a-26111123a1d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:51:24 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-ddfa5ee2-efad-450e-b53d-7997f8e7cab1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:b7:64,bridge_name='br-int',has_traffic_filtering=True,id=e2fa8ebc-482c-460c-924a-26111123a1d5,network=Network(b639a68a-2b4e-435c-b98b-65b5b4981c73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2fa8ebc-48') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:51:24 user nova-compute[71509]: DEBUG os_vif [None req-ddfa5ee2-efad-450e-b53d-7997f8e7cab1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:b7:64,bridge_name='br-int',has_traffic_filtering=True,id=e2fa8ebc-482c-460c-924a-26111123a1d5,network=Network(b639a68a-2b4e-435c-b98b-65b5b4981c73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2fa8ebc-48') {{(pid=71509) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 10:51:24 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:51:24 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:51:24 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 10:51:24 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:51:24 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape2fa8ebc-48, may_exist=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:51:24 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape2fa8ebc-48, col_values=(('external_ids', {'iface-id': 'e2fa8ebc-482c-460c-924a-26111123a1d5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d2:b7:64', 'vm-uuid': 'cd661ae0-c4bb-4117-847d-ef7e85d062fb'}),)) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:51:24 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:51:25 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 10:51:25 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:51:25 user nova-compute[71509]: INFO os_vif [None req-ddfa5ee2-efad-450e-b53d-7997f8e7cab1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:b7:64,bridge_name='br-int',has_traffic_filtering=True,id=e2fa8ebc-482c-460c-924a-26111123a1d5,network=Network(b639a68a-2b4e-435c-b98b-65b5b4981c73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2fa8ebc-48')
Apr 14 10:51:25 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-ddfa5ee2-efad-450e-b53d-7997f8e7cab1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] No BDM found with device name vda, not building metadata. {{(pid=71509) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 10:51:25 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-ddfa5ee2-efad-450e-b53d-7997f8e7cab1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] No VIF found with MAC fa:16:3e:d2:b7:64, not building metadata {{(pid=71509) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 10:51:25 user nova-compute[71509]: DEBUG nova.network.neutron [req-ea2c5c21-784b-479b-8dc5-e9cde9ca15e6 req-c7d32161-e00a-4aaa-a667-c0f1305d6a7e service nova] [instance: cd661ae0-c4bb-4117-847d-ef7e85d062fb] Updated VIF entry in instance network info cache for port e2fa8ebc-482c-460c-924a-26111123a1d5. {{(pid=71509) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 10:51:25 user nova-compute[71509]: DEBUG nova.network.neutron [req-ea2c5c21-784b-479b-8dc5-e9cde9ca15e6 req-c7d32161-e00a-4aaa-a667-c0f1305d6a7e service nova] [instance: cd661ae0-c4bb-4117-847d-ef7e85d062fb] Updating instance_info_cache with network_info: [{"id": "e2fa8ebc-482c-460c-924a-26111123a1d5", "address": "fa:16:3e:d2:b7:64", "network": {"id": "b639a68a-2b4e-435c-b98b-65b5b4981c73", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1070821894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb8f294f957f4c74ae959c1e9f238427", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2fa8ebc-48", "ovs_interfaceid": "e2fa8ebc-482c-460c-924a-26111123a1d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:51:25 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-ea2c5c21-784b-479b-8dc5-e9cde9ca15e6 req-c7d32161-e00a-4aaa-a667-c0f1305d6a7e service nova] Releasing lock "refresh_cache-cd661ae0-c4bb-4117-847d-ef7e85d062fb" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:51:26 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:51:26 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:51:26 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:51:26 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:51:27 user nova-compute[71509]: DEBUG nova.compute.manager [req-846a3770-8152-4cc4-81f5-36d178677a51 req-5a319a02-ca86-4454-9f91-1855829b09b3 service nova] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Received event network-vif-plugged-473d9af8-25a0-4e5a-9afb-7a0c843115cc {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:51:27 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-846a3770-8152-4cc4-81f5-36d178677a51 req-5a319a02-ca86-4454-9f91-1855829b09b3 service nova] Acquiring lock "8586a70e-9855-4177-ac1b-cf707a4df871-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:51:27 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-846a3770-8152-4cc4-81f5-36d178677a51 req-5a319a02-ca86-4454-9f91-1855829b09b3 service nova] Lock "8586a70e-9855-4177-ac1b-cf707a4df871-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:51:27 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-846a3770-8152-4cc4-81f5-36d178677a51 req-5a319a02-ca86-4454-9f91-1855829b09b3 service nova] Lock "8586a70e-9855-4177-ac1b-cf707a4df871-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:51:27 user nova-compute[71509]: DEBUG nova.compute.manager [req-846a3770-8152-4cc4-81f5-36d178677a51 req-5a319a02-ca86-4454-9f91-1855829b09b3 service nova] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] No waiting events found dispatching network-vif-plugged-473d9af8-25a0-4e5a-9afb-7a0c843115cc {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:51:27 user nova-compute[71509]: WARNING nova.compute.manager [req-846a3770-8152-4cc4-81f5-36d178677a51 req-5a319a02-ca86-4454-9f91-1855829b09b3 service nova] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Received unexpected event network-vif-plugged-473d9af8-25a0-4e5a-9afb-7a0c843115cc for instance with vm_state stopped and task_state powering-on.
Apr 14 10:51:27 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:51:27 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:51:27 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:51:27 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:51:27 user nova-compute[71509]: DEBUG nova.compute.manager [req-466755f8-47f6-4d0e-aa27-a4492699e9a7 req-7aad4602-8d15-4647-b46d-098abc9ba20d service nova] [instance: cd661ae0-c4bb-4117-847d-ef7e85d062fb] Received event network-vif-plugged-e2fa8ebc-482c-460c-924a-26111123a1d5 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:51:27 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-466755f8-47f6-4d0e-aa27-a4492699e9a7 req-7aad4602-8d15-4647-b46d-098abc9ba20d service nova] Acquiring lock "cd661ae0-c4bb-4117-847d-ef7e85d062fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:51:27 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-466755f8-47f6-4d0e-aa27-a4492699e9a7 req-7aad4602-8d15-4647-b46d-098abc9ba20d service nova] Lock "cd661ae0-c4bb-4117-847d-ef7e85d062fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:51:27 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-466755f8-47f6-4d0e-aa27-a4492699e9a7 req-7aad4602-8d15-4647-b46d-098abc9ba20d service nova] Lock "cd661ae0-c4bb-4117-847d-ef7e85d062fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:51:27 user nova-compute[71509]: DEBUG nova.compute.manager [req-466755f8-47f6-4d0e-aa27-a4492699e9a7 req-7aad4602-8d15-4647-b46d-098abc9ba20d service nova] [instance: cd661ae0-c4bb-4117-847d-ef7e85d062fb] No waiting events found dispatching network-vif-plugged-e2fa8ebc-482c-460c-924a-26111123a1d5 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:51:27 user nova-compute[71509]: WARNING nova.compute.manager [req-466755f8-47f6-4d0e-aa27-a4492699e9a7 req-7aad4602-8d15-4647-b46d-098abc9ba20d service nova] [instance: cd661ae0-c4bb-4117-847d-ef7e85d062fb] Received unexpected event network-vif-plugged-e2fa8ebc-482c-460c-924a-26111123a1d5 for instance with vm_state building and task_state spawning.
Apr 14 10:51:27 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:51:27 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:51:27 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:51:27 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:51:28 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:51:28 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:51:28 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:51:29 user nova-compute[71509]: DEBUG nova.compute.manager [req-9d869a3e-d213-4af1-bd18-699a247f7664 req-0ee773bf-6407-4e05-8805-8dbd72870435 service nova] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Received event network-vif-plugged-473d9af8-25a0-4e5a-9afb-7a0c843115cc {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:51:29 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-9d869a3e-d213-4af1-bd18-699a247f7664 req-0ee773bf-6407-4e05-8805-8dbd72870435 service nova] Acquiring lock "8586a70e-9855-4177-ac1b-cf707a4df871-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:51:29 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-9d869a3e-d213-4af1-bd18-699a247f7664 req-0ee773bf-6407-4e05-8805-8dbd72870435 service nova] Lock "8586a70e-9855-4177-ac1b-cf707a4df871-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:51:29 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-9d869a3e-d213-4af1-bd18-699a247f7664 req-0ee773bf-6407-4e05-8805-8dbd72870435 service nova] Lock "8586a70e-9855-4177-ac1b-cf707a4df871-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:51:29 user nova-compute[71509]: DEBUG nova.compute.manager [req-9d869a3e-d213-4af1-bd18-699a247f7664 req-0ee773bf-6407-4e05-8805-8dbd72870435 service nova] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] No waiting events found dispatching network-vif-plugged-473d9af8-25a0-4e5a-9afb-7a0c843115cc {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:51:29 user nova-compute[71509]: WARNING nova.compute.manager [req-9d869a3e-d213-4af1-bd18-699a247f7664 req-0ee773bf-6407-4e05-8805-8dbd72870435 service nova] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Received unexpected event network-vif-plugged-473d9af8-25a0-4e5a-9afb-7a0c843115cc for instance with vm_state stopped and task_state powering-on.
Apr 14 10:51:29 user nova-compute[71509]: DEBUG nova.compute.manager [req-8f320317-eca9-4e06-98ba-571e9498a673 req-6aa1e786-321d-492a-8c62-7d3560bc3ee1 service nova] [instance: cd661ae0-c4bb-4117-847d-ef7e85d062fb] Received event network-vif-plugged-e2fa8ebc-482c-460c-924a-26111123a1d5 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:51:29 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-8f320317-eca9-4e06-98ba-571e9498a673 req-6aa1e786-321d-492a-8c62-7d3560bc3ee1 service nova] Acquiring lock "cd661ae0-c4bb-4117-847d-ef7e85d062fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:51:29 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-8f320317-eca9-4e06-98ba-571e9498a673 req-6aa1e786-321d-492a-8c62-7d3560bc3ee1 service nova] Lock "cd661ae0-c4bb-4117-847d-ef7e85d062fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:51:29 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-8f320317-eca9-4e06-98ba-571e9498a673 req-6aa1e786-321d-492a-8c62-7d3560bc3ee1 service nova] Lock "cd661ae0-c4bb-4117-847d-ef7e85d062fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:51:29 user nova-compute[71509]: DEBUG nova.compute.manager [req-8f320317-eca9-4e06-98ba-571e9498a673 req-6aa1e786-321d-492a-8c62-7d3560bc3ee1 service nova] [instance: cd661ae0-c4bb-4117-847d-ef7e85d062fb] No waiting events found dispatching network-vif-plugged-e2fa8ebc-482c-460c-924a-26111123a1d5 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:51:29 user nova-compute[71509]: WARNING nova.compute.manager [req-8f320317-eca9-4e06-98ba-571e9498a673 req-6aa1e786-321d-492a-8c62-7d3560bc3ee1 service nova] [instance: cd661ae0-c4bb-4117-847d-ef7e85d062fb] Received unexpected event network-vif-plugged-e2fa8ebc-482c-460c-924a-26111123a1d5 for instance with vm_state building and task_state spawning.
Apr 14 10:51:29 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681469489.6378531, cd661ae0-c4bb-4117-847d-ef7e85d062fb => Resumed> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 10:51:29 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: cd661ae0-c4bb-4117-847d-ef7e85d062fb] VM Resumed (Lifecycle Event)
Apr 14 10:51:29 user nova-compute[71509]: DEBUG nova.compute.manager [None req-ddfa5ee2-efad-450e-b53d-7997f8e7cab1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: cd661ae0-c4bb-4117-847d-ef7e85d062fb] Instance event wait completed in 0 seconds for  {{(pid=71509) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 10:51:29 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-ddfa5ee2-efad-450e-b53d-7997f8e7cab1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: cd661ae0-c4bb-4117-847d-ef7e85d062fb] Guest created on hypervisor {{(pid=71509) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 10:51:29 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: cd661ae0-c4bb-4117-847d-ef7e85d062fb] Instance spawned successfully.
Apr 14 10:51:29 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-ddfa5ee2-efad-450e-b53d-7997f8e7cab1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: cd661ae0-c4bb-4117-847d-ef7e85d062fb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 10:51:29 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: cd661ae0-c4bb-4117-847d-ef7e85d062fb] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:51:29 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: cd661ae0-c4bb-4117-847d-ef7e85d062fb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 10:51:29 user nova-compute[71509]: DEBUG nova.compute.manager [None req-d5230438-ed07-43dd-bd83-93fd4697ec41 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Instance event wait completed in 0 seconds for  {{(pid=71509) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 10:51:29 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-ddfa5ee2-efad-450e-b53d-7997f8e7cab1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: cd661ae0-c4bb-4117-847d-ef7e85d062fb] Found default for hw_cdrom_bus of ide {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:51:29 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-ddfa5ee2-efad-450e-b53d-7997f8e7cab1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: cd661ae0-c4bb-4117-847d-ef7e85d062fb] Found default for hw_disk_bus of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:51:29 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-ddfa5ee2-efad-450e-b53d-7997f8e7cab1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: cd661ae0-c4bb-4117-847d-ef7e85d062fb] Found default for hw_input_bus of None {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:51:29 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-ddfa5ee2-efad-450e-b53d-7997f8e7cab1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: cd661ae0-c4bb-4117-847d-ef7e85d062fb] Found default for hw_pointer_model of None {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:51:29 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-ddfa5ee2-efad-450e-b53d-7997f8e7cab1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: cd661ae0-c4bb-4117-847d-ef7e85d062fb] Found default for hw_video_model of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:51:29 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-ddfa5ee2-efad-450e-b53d-7997f8e7cab1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: cd661ae0-c4bb-4117-847d-ef7e85d062fb] Found default for hw_vif_model of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:51:29 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: cd661ae0-c4bb-4117-847d-ef7e85d062fb] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 10:51:29 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681469489.6429787, cd661ae0-c4bb-4117-847d-ef7e85d062fb => Started> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 10:51:29 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: cd661ae0-c4bb-4117-847d-ef7e85d062fb] VM Started (Lifecycle Event)
Apr 14 10:51:29 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Instance rebooted successfully.
Apr 14 10:51:29 user nova-compute[71509]: DEBUG nova.compute.manager [None req-d5230438-ed07-43dd-bd83-93fd4697ec41 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:51:29 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: cd661ae0-c4bb-4117-847d-ef7e85d062fb] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:51:29 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: cd661ae0-c4bb-4117-847d-ef7e85d062fb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 10:51:29 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: cd661ae0-c4bb-4117-847d-ef7e85d062fb] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 10:51:29 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681469489.669649, 8586a70e-9855-4177-ac1b-cf707a4df871 => Resumed> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 10:51:29 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] VM Resumed (Lifecycle Event)
Apr 14 10:51:29 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:51:29 user nova-compute[71509]: INFO nova.compute.manager [None req-ddfa5ee2-efad-450e-b53d-7997f8e7cab1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: cd661ae0-c4bb-4117-847d-ef7e85d062fb] Took 7.19 seconds to spawn the instance on the hypervisor.
Apr 14 10:51:29 user nova-compute[71509]: DEBUG nova.compute.manager [None req-ddfa5ee2-efad-450e-b53d-7997f8e7cab1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: cd661ae0-c4bb-4117-847d-ef7e85d062fb] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:51:29 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 10:51:29 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681469489.672077, 8586a70e-9855-4177-ac1b-cf707a4df871 => Started> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 10:51:29 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] VM Started (Lifecycle Event)
Apr 14 10:51:29 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:51:29 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 10:51:29 user nova-compute[71509]: INFO nova.compute.manager [None req-ddfa5ee2-efad-450e-b53d-7997f8e7cab1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: cd661ae0-c4bb-4117-847d-ef7e85d062fb] Took 8.14 seconds to build instance.
Apr 14 10:51:29 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-ddfa5ee2-efad-450e-b53d-7997f8e7cab1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "cd661ae0-c4bb-4117-847d-ef7e85d062fb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.224s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:51:29 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:51:32 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:51:33 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-d8714650-d94a-46d2-b0f8-8889d888c298 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "b4abb549-8f36-40c5-971f-8accbb14ff86" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:51:33 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-d8714650-d94a-46d2-b0f8-8889d888c298 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "b4abb549-8f36-40c5-971f-8accbb14ff86" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:51:33 user nova-compute[71509]: DEBUG nova.objects.instance [None req-d8714650-d94a-46d2-b0f8-8889d888c298 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lazy-loading 'flavor' on Instance uuid b4abb549-8f36-40c5-971f-8accbb14ff86 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:51:33 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-d8714650-d94a-46d2-b0f8-8889d888c298 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "b4abb549-8f36-40c5-971f-8accbb14ff86" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:51:33 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-d8714650-d94a-46d2-b0f8-8889d888c298 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "b4abb549-8f36-40c5-971f-8accbb14ff86" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:51:33 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-d8714650-d94a-46d2-b0f8-8889d888c298 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "b4abb549-8f36-40c5-971f-8accbb14ff86" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:51:33 user nova-compute[71509]: INFO nova.compute.manager [None req-d8714650-d94a-46d2-b0f8-8889d888c298 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Attaching volume 9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe to /dev/vdb
Apr 14 10:51:33 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:51:33 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71509) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 10:51:33 user nova-compute[71509]: DEBUG os_brick.utils [None req-d8714650-d94a-46d2-b0f8-8889d888c298 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 10:51:33 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:51:33 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:51:33 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb0dda81-cc1e-4197-8885-843cf2695570]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50119df3c417\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:51:33 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:51:33 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:51:33 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1d81094-0532-4a39-b384-d2a871dc9a6f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:51:33 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:51:33 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:51:33 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[20b97552-e225-44b7-8336-becf104ebdf1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:51:33 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[96f3a18e-109f-4dae-9271-3514ff3362ad]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:51:33 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-d8714650-d94a-46d2-b0f8-8889d888c298 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Running cmd (subprocess): nvme version {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:51:33 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-d8714650-d94a-46d2-b0f8-8889d888c298 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] 'nvme version' failed. Not Retrying. {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 10:51:33 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d8714650-d94a-46d2-b0f8-8889d888c298 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] nvme not present on system {{(pid=71509) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 10:51:33 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:51:33 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 10:51:33 user nova-compute[71509]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 10:51:33 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[a27cb1e2-2755-4a1f-b74e-2e1a6d709776]: (4, '') {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:51:33 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-d8714650-d94a-46d2-b0f8-8889d888c298 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71509) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 10:51:33 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-d8714650-d94a-46d2-b0f8-8889d888c298 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71509) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 10:51:33 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-d8714650-d94a-46d2-b0f8-8889d888c298 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] LIGHTOS: no hostnqn found. {{(pid=71509) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 10:51:33 user nova-compute[71509]: DEBUG os_brick.utils [None req-d8714650-d94a-46d2-b0f8-8889d888c298 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50119df3c417', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 10:51:33 user nova-compute[71509]: DEBUG nova.virt.block_device [None req-d8714650-d94a-46d2-b0f8-8889d888c298 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Updating existing volume attachment record: e052c358-312c-422d-89e6-5664762bb676 {{(pid=71509) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 10:51:35 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:51:35 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-9ec91bb4-f25d-479f-b945-3b5fd8919907 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Acquiring lock "4b767f1b-e97e-497c-8c70-8806203c76ae" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:51:35 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-9ec91bb4-f25d-479f-b945-3b5fd8919907 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "4b767f1b-e97e-497c-8c70-8806203c76ae" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:51:35 user nova-compute[71509]: INFO nova.compute.manager [None req-9ec91bb4-f25d-479f-b945-3b5fd8919907 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Detaching volume e6828770-fda7-4cd5-b857-c4d2599299a7
Apr 14 10:51:35 user nova-compute[71509]: INFO nova.virt.block_device [None req-9ec91bb4-f25d-479f-b945-3b5fd8919907 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Attempting to driver detach volume e6828770-fda7-4cd5-b857-c4d2599299a7 from mountpoint /dev/vdc
Apr 14 10:51:35 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-9ec91bb4-f25d-479f-b945-3b5fd8919907 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Attempting to detach device vdc from instance 4b767f1b-e97e-497c-8c70-8806203c76ae from the persistent domain config. {{(pid=71509) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 10:51:35 user nova-compute[71509]: DEBUG nova.virt.libvirt.guest [None req-9ec91bb4-f25d-479f-b945-3b5fd8919907 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 10:51:35 user nova-compute[71509]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 10:51:35 user nova-compute[71509]:   <source dev="/dev/sdb"/>
Apr 14 10:51:35 user nova-compute[71509]:   <target dev="vdc" bus="virtio"/>
Apr 14 10:51:35 user nova-compute[71509]:   <serial>e6828770-fda7-4cd5-b857-c4d2599299a7</serial>
Apr 14 10:51:35 user nova-compute[71509]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 14 10:51:35 user nova-compute[71509]: </disk>
Apr 14 10:51:35 user nova-compute[71509]:  {{(pid=71509) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 10:51:35 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-9ec91bb4-f25d-479f-b945-3b5fd8919907 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Successfully detached device vdc from instance 4b767f1b-e97e-497c-8c70-8806203c76ae from the persistent domain config.
Apr 14 10:51:35 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-9ec91bb4-f25d-479f-b945-3b5fd8919907 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 4b767f1b-e97e-497c-8c70-8806203c76ae from the live domain config. {{(pid=71509) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 10:51:35 user nova-compute[71509]: DEBUG nova.virt.libvirt.guest [None req-9ec91bb4-f25d-479f-b945-3b5fd8919907 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 10:51:35 user nova-compute[71509]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 10:51:35 user nova-compute[71509]:   <source dev="/dev/sdb"/>
Apr 14 10:51:35 user nova-compute[71509]:   <target dev="vdc" bus="virtio"/>
Apr 14 10:51:35 user nova-compute[71509]:   <serial>e6828770-fda7-4cd5-b857-c4d2599299a7</serial>
Apr 14 10:51:35 user nova-compute[71509]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 14 10:51:35 user nova-compute[71509]: </disk>
Apr 14 10:51:35 user nova-compute[71509]:  {{(pid=71509) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 10:51:35 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:51:35 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:51:35 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Received event <DeviceRemovedEvent: 1681469495.8686488, 4b767f1b-e97e-497c-8c70-8806203c76ae => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=71509) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 10:51:35 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-9ec91bb4-f25d-479f-b945-3b5fd8919907 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 4b767f1b-e97e-497c-8c70-8806203c76ae {{(pid=71509) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 10:51:35 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-9ec91bb4-f25d-479f-b945-3b5fd8919907 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Successfully detached device vdc from instance 4b767f1b-e97e-497c-8c70-8806203c76ae from the live domain config.
Apr 14 10:51:35 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ec91bb4-f25d-479f-b945-3b5fd8919907 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] calling os-brick to detach iSCSI Volume {{(pid=71509) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 10:51:35 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec91bb4-f25d-479f-b945-3b5fd8919907 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0bf0749390>, {'target_iqn': 'iqn.2010-10.org.openstack:e6828770-fda7-4cd5-b857-c4d2599299a7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gjqOXaNU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 10:51:35 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-9ec91bb4-f25d-479f-b945-3b5fd8919907 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 10:51:35 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-9ec91bb4-f25d-479f-b945-3b5fd8919907 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 10:51:35 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-9ec91bb4-f25d-479f-b945-3b5fd8919907 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 10:51:35 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:51:35 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:51:35 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee4913ca-3ab6-4569-8359-81976f001fc4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e6828770-fda7-4cd5-b857-c4d2599299a7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:51:35 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec91bb4-f25d-479f-b945-3b5fd8919907 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 10:51:35 user nova-compute[71509]: No targets found.
Apr 14 10:51:35 user nova-compute[71509]: iSNS:
Apr 14 10:51:35 user nova-compute[71509]: No targets found.
Apr 14 10:51:35 user nova-compute[71509]: STATIC:
Apr 14 10:51:35 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:e6828770-fda7-4cd5-b857-c4d2599299a7
Apr 14 10:51:35 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:51:35 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:51:35 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2
Apr 14 10:51:35 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:51:35 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:51:35 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178
Apr 14 10:51:35 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:51:35 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:51:35 user nova-compute[71509]: FIRMWARE:
Apr 14 10:51:35 user nova-compute[71509]: No targets found.
Apr 14 10:51:35 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:51:35 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec91bb4-f25d-479f-b945-3b5fd8919907 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 10:51:35 user nova-compute[71509]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 10:51:35 user nova-compute[71509]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71509) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 10:51:35 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec91bb4-f25d-479f-b945-3b5fd8919907 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e6828770-fda7-4cd5-b857-c4d2599299a7', 0)] {{(pid=71509) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 10:51:35 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:51:35 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:51:35 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[d59ffe98-9e92-4f4f-9b29-aa5deccda532]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6828770-fda7-4cd5-b857-c4d2599299a7\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:51:35 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:51:35 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:51:35 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[e738be77-ecc0-460c-a8fc-082161241801]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6828770-fda7-4cd5-b857-c4d2599299a7 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2 (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:51:35 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec91bb4-f25d-479f-b945-3b5fd8919907 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6828770-fda7-4cd5-b857-c4d2599299a7 (non-flash)
Apr 14 10:51:35 user nova-compute[71509]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)
Apr 14 10:51:35 user nova-compute[71509]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2 (non-flash)
Apr 14 10:51:35 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:51:35 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec91bb4-f25d-479f-b945-3b5fd8919907 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6828770-fda7-4cd5-b857-c4d2599299a7 (non-flash)
Apr 14 10:51:35 user nova-compute[71509]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)
Apr 14 10:51:35 user nova-compute[71509]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2 (non-flash)
Apr 14 10:51:35 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 10:51:35 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec91bb4-f25d-479f-b945-3b5fd8919907 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0c2c3cb370>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e6828770-fda7-4cd5-b857-c4d2599299a7'): ({'sdb'}, set())}) {{(pid=71509) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 10:51:35 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-9ec91bb4-f25d-479f-b945-3b5fd8919907 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Removing single pathed devices sdb {{(pid=71509) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 10:51:35 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:51:35 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:51:35 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf6ae829-7d21-4cc5-ab42-2edccfefc503]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:51:36 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:51:36 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:51:36 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[00a79d95-8d3e-4a82-b042-c7757e3d6b4f]: (4, ('ok\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:51:36 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-9ec91bb4-f25d-479f-b945-3b5fd8919907 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Flushing IO for device /dev/sdb {{(pid=71509) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 10:51:36 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:51:36 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:51:36 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac511b9b-2bf3-4521-90c9-3dee0a363ed6]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:51:36 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-9ec91bb4-f25d-479f-b945-3b5fd8919907 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71509) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 10:51:36 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:51:36 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:51:36 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a54b047-baa3-4dee-a6a4-13c2005aad1c]: (4, ('1', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:51:36 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-9ec91bb4-f25d-479f-b945-3b5fd8919907 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71509) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 10:51:36 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-9ec91bb4-f25d-479f-b945-3b5fd8919907 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] SCSI volumes sdb have been removed. {{(pid=71509) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 10:51:36 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec91bb4-f25d-479f-b945-3b5fd8919907 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e6828770-fda7-4cd5-b857-c4d2599299a7')] {{(pid=71509) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 10:51:36 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6828770-fda7-4cd5-b857-c4d2599299a7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:51:36 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6828770-fda7-4cd5-b857-c4d2599299a7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:51:36 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6e5b4cc-6a22-4b76-8a1c-b9292513cf74]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:51:36 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec91bb4-f25d-479f-b945-3b5fd8919907 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:51:36 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6828770-fda7-4cd5-b857-c4d2599299a7 -p 172.16.0.220:3260 --logout {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:51:36 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6828770-fda7-4cd5-b857-c4d2599299a7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:51:36 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac6b8cf1-24f6-4994-b75a-e14b108b5b7f]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:e6828770-fda7-4cd5-b857-c4d2599299a7, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:e6828770-fda7-4cd5-b857-c4d2599299a7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:51:36 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec91bb4-f25d-479f-b945-3b5fd8919907 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:e6828770-fda7-4cd5-b857-c4d2599299a7, portal: 172.16.0.220,3260]
Apr 14 10:51:36 user nova-compute[71509]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:e6828770-fda7-4cd5-b857-c4d2599299a7, portal: 172.16.0.220,3260] successful.
Apr 14 10:51:36 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:51:36 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6828770-fda7-4cd5-b857-c4d2599299a7 -p 172.16.0.220:3260 --op delete {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:51:36 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6828770-fda7-4cd5-b857-c4d2599299a7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:51:36 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0cdd309-6f5e-4a90-9bb6-ed761e1a09ad]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:51:36 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec91bb4-f25d-479f-b945-3b5fd8919907 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:51:36 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-9ec91bb4-f25d-479f-b945-3b5fd8919907 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 10:51:36 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ec91bb4-f25d-479f-b945-3b5fd8919907 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] <== disconnect_volume: return (336ms) None {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 10:51:36 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ec91bb4-f25d-479f-b945-3b5fd8919907 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Disconnected iSCSI Volume {{(pid=71509) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 10:51:36 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:51:37 user nova-compute[71509]: DEBUG nova.objects.instance [None req-9ec91bb4-f25d-479f-b945-3b5fd8919907 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lazy-loading 'flavor' on Instance uuid 4b767f1b-e97e-497c-8c70-8806203c76ae {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:51:37 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-9ec91bb4-f25d-479f-b945-3b5fd8919907 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "4b767f1b-e97e-497c-8c70-8806203c76ae" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.210s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:51:37 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:51:38 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d8714650-d94a-46d2-b0f8-8889d888c298 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Calling os-brick to attach iSCSI Volume {{(pid=71509) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 10:51:38 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8714650-d94a-46d2-b0f8-8889d888c298 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0bf0749390>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KDNjCusQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 10:51:38 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-d8714650-d94a-46d2-b0f8-8889d888c298 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 10:51:38 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-d8714650-d94a-46d2-b0f8-8889d888c298 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 10:51:38 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-d8714650-d94a-46d2-b0f8-8889d888c298 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 10:51:38 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-d8714650-d94a-46d2-b0f8-8889d888c298 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 10:51:38 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-d8714650-d94a-46d2-b0f8-8889d888c298 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 10:51:38 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-d8714650-d94a-46d2-b0f8-8889d888c298 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 10:51:38 user nova-compute[71509]: INFO os_brick.initiator.connectors.iscsi [None req-d8714650-d94a-46d2-b0f8-8889d888c298 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 10:51:38 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe -p 172.16.0.220:3260 {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:51:38 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:51:38 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[21e5e7d4-3095-4a7f-bd28-04c461c51aa9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:51:38 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8714650-d94a-46d2-b0f8-8889d888c298 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 10:51:38 user nova-compute[71509]:  {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:51:38 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe -p 172.16.0.220:3260 --interface default --op new {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:51:38 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:51:38 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f989ce3-3bf7-4c88-b0ee-0640a75f7a91]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe] added\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:51:38 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8714650-d94a-46d2-b0f8-8889d888c298 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe] added
Apr 14 10:51:38 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:51:38 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:51:38 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:51:38 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc6db4ee-5369-423f-b1fe-7212a9bcf363]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:51:38 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8714650-d94a-46d2-b0f8-8889d888c298 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:51:38 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:51:38 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:51:38 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e460d14-c0b6-4219-b4bf-243e40310182]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:51:38 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8714650-d94a-46d2-b0f8-8889d888c298 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:51:38 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KDNjCusQ {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:51:38 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KDNjCusQ" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:51:38 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c882fa1-b492-4558-8906-a858c7c28f69]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:51:38 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8714650-d94a-46d2-b0f8-8889d888c298 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KDNjCusQ'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:51:38 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:51:38 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:51:38 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3a425e4-c322-4663-bc5f-d759111aa7e9]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:51:38 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8714650-d94a-46d2-b0f8-8889d888c298 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:51:38 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:51:38 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:51:38 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[71046412-1aa6-4cbe-8530-6848c0fa41e5]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2 (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:51:38 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8714650-d94a-46d2-b0f8-8889d888c298 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)
Apr 14 10:51:38 user nova-compute[71509]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2 (non-flash)
Apr 14 10:51:38 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:51:38 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8714650-d94a-46d2-b0f8-8889d888c298 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)
Apr 14 10:51:38 user nova-compute[71509]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2 (non-flash)
Apr 14 10:51:38 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 10:51:38 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe -p 172.16.0.220:3260 --login {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:51:38 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:51:38 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaeffc06-45c5-42be-b789-5bce3610616e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:51:38 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8714650-d94a-46d2-b0f8-8889d888c298 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe, portal: 172.16.0.220,3260]
Apr 14 10:51:38 user nova-compute[71509]: Login to [iface: default, target: iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe, portal: 172.16.0.220,3260] successful.
Apr 14 10:51:38 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:51:38 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:51:38 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:51:38 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cd0d880-feed-42b2-b759-f934740f0bcc]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:51:38 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8714650-d94a-46d2-b0f8-8889d888c298 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:51:38 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:51:38 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:51:38 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[3895858d-f584-47c1-bab6-843add9ba7c0]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:51:38 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8714650-d94a-46d2-b0f8-8889d888c298 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)
Apr 14 10:51:38 user nova-compute[71509]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2 (non-flash)
Apr 14 10:51:38 user nova-compute[71509]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe (non-flash)
Apr 14 10:51:38 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:51:38 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8714650-d94a-46d2-b0f8-8889d888c298 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)
Apr 14 10:51:38 user nova-compute[71509]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2 (non-flash)
Apr 14 10:51:38 user nova-compute[71509]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe (non-flash)
Apr 14 10:51:38 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 10:51:38 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-d8714650-d94a-46d2-b0f8-8889d888c298 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.314s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 10:51:38 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8714650-d94a-46d2-b0f8-8889d888c298 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Connected to 172.16.0.220:3260 {{(pid=71509) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 10:51:38 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-d8714650-d94a-46d2-b0f8-8889d888c298 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] HCTL ('33', '-', '-', 0) found on session 30 with lun 0 {{(pid=71509) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 10:51:38 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-d8714650-d94a-46d2-b0f8-8889d888c298 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71509) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 10:51:38 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:51:39 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:51:39 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[240faf98-182b-4820-a206-78da914b41e2]: (4, ('- - 0', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:51:39 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-d8714650-d94a-46d2-b0f8-8889d888c298 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Searching for a device in session 30 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71509) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 10:51:39 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8714650-d94a-46d2-b0f8-8889d888c298 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KDNjCusQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71509) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 10:51:39 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:51:39 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:51:40 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:51:40 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-d8714650-d94a-46d2-b0f8-8889d888c298 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.355s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 10:51:40 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8714650-d94a-46d2-b0f8-8889d888c298 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] <== connect_volume: return (1356ms) {'type': 'block', 'scsi_wwn': '23530323537323431', 'path': '/dev/sdb'} {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 10:51:40 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d8714650-d94a-46d2-b0f8-8889d888c298 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23530323537323431', 'path': '/dev/sdb'} {{(pid=71509) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 10:51:40 user nova-compute[71509]: DEBUG nova.objects.instance [None req-d8714650-d94a-46d2-b0f8-8889d888c298 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lazy-loading 'flavor' on Instance uuid b4abb549-8f36-40c5-971f-8accbb14ff86 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:51:40 user nova-compute[71509]: DEBUG nova.virt.libvirt.guest [None req-d8714650-d94a-46d2-b0f8-8889d888c298 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 10:51:40 user nova-compute[71509]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 10:51:40 user nova-compute[71509]:   <source dev="/dev/sdb"/>
Apr 14 10:51:40 user nova-compute[71509]:   <target dev="vdb" bus="virtio"/>
Apr 14 10:51:40 user nova-compute[71509]:   <serial>9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe</serial>
Apr 14 10:51:40 user nova-compute[71509]: </disk>
Apr 14 10:51:40 user nova-compute[71509]:  {{(pid=71509) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 10:51:40 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:51:40 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-d8714650-d94a-46d2-b0f8-8889d888c298 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] No BDM found with device name vda, not building metadata. {{(pid=71509) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 10:51:40 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-d8714650-d94a-46d2-b0f8-8889d888c298 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71509) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 10:51:40 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-d8714650-d94a-46d2-b0f8-8889d888c298 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] No VIF found with MAC fa:16:3e:e4:f7:87, not building metadata {{(pid=71509) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 10:51:40 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-d8714650-d94a-46d2-b0f8-8889d888c298 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "b4abb549-8f36-40c5-971f-8accbb14ff86" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.298s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:51:41 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:51:41 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Starting heal instance info cache {{(pid=71509) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 10:51:41 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "refresh_cache-e479154a-acd6-47aa-9a5b-43c6e0feda07" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:51:41 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquired lock "refresh_cache-e479154a-acd6-47aa-9a5b-43c6e0feda07" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:51:41 user nova-compute[71509]: DEBUG nova.network.neutron [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] [instance: e479154a-acd6-47aa-9a5b-43c6e0feda07] Forcefully refreshing network info cache for instance {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 10:51:41 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:51:42 user nova-compute[71509]: DEBUG nova.network.neutron [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] [instance: e479154a-acd6-47aa-9a5b-43c6e0feda07] Updating instance_info_cache with network_info: [{"id": "2fbfd894-8e16-4039-b726-638e802602c5", "address": "fa:16:3e:4d:3b:0d", "network": {"id": "07f1f39e-292a-4e73-b4ed-99e5799d6fa8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1339551596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71289f80a05141f482cb538dac3d7b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fbfd894-8e", "ovs_interfaceid": "2fbfd894-8e16-4039-b726-638e802602c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:51:42 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Releasing lock "refresh_cache-e479154a-acd6-47aa-9a5b-43c6e0feda07" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:51:42 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] [instance: e479154a-acd6-47aa-9a5b-43c6e0feda07] Updated the network info_cache for instance {{(pid=71509) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 10:51:42 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:51:42 user nova-compute[71509]: DEBUG nova.compute.manager [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Stashing vm_state: active {{(pid=71509) _prep_resize /opt/stack/nova/nova/compute/manager.py:5499}}
Apr 14 10:51:42 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:51:42 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:51:42 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:51:42 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:51:42 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Auditing locally available compute resources for user (node: user) {{(pid=71509) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 10:51:42 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:51:42 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:51:42 user nova-compute[71509]: DEBUG nova.objects.instance [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lazy-loading 'pci_requests' on Instance uuid b4abb549-8f36-40c5-971f-8accbb14ff86 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:51:42 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71509) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 10:51:42 user nova-compute[71509]: INFO nova.compute.claims [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Claim successful on node user
Apr 14 10:51:42 user nova-compute[71509]: DEBUG nova.objects.instance [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lazy-loading 'resources' on Instance uuid b4abb549-8f36-40c5-971f-8accbb14ff86 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:51:42 user nova-compute[71509]: DEBUG nova.objects.instance [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lazy-loading 'pci_devices' on Instance uuid b4abb549-8f36-40c5-971f-8accbb14ff86 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:51:42 user nova-compute[71509]: INFO nova.compute.resource_tracker [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Updating resource usage from migration aec5f116-c76f-438a-bee3-2a98dbe64d04
Apr 14 10:51:42 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97820f17-22d1-4ec3-9721-1edadccc794a/disk.rescue --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:51:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97820f17-22d1-4ec3-9721-1edadccc794a/disk.rescue --force-share --output=json" returned: 0 in 0.203s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:51:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97820f17-22d1-4ec3-9721-1edadccc794a/disk.rescue --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:51:43 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:51:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97820f17-22d1-4ec3-9721-1edadccc794a/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:51:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97820f17-22d1-4ec3-9721-1edadccc794a/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:51:43 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 10:51:43 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 10:51:43 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.742s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:51:43 user nova-compute[71509]: INFO nova.compute.manager [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Migrating
Apr 14 10:51:43 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:51:43 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquired lock "compute-rpcapi-router" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:51:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97820f17-22d1-4ec3-9721-1edadccc794a/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:51:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97820f17-22d1-4ec3-9721-1edadccc794a/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:51:43 user nova-compute[71509]: INFO nova.compute.rpcapi [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Apr 14 10:51:43 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Releasing lock "compute-rpcapi-router" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:51:43 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "refresh_cache-b4abb549-8f36-40c5-971f-8accbb14ff86" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:51:43 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquired lock "refresh_cache-b4abb549-8f36-40c5-971f-8accbb14ff86" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:51:43 user nova-compute[71509]: DEBUG nova.network.neutron [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Building network info cache for instance {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 10:51:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97820f17-22d1-4ec3-9721-1edadccc794a/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:51:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3245b74-dbe8-4b8b-83b6-58a4811fdba9/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:51:43 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:51:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3245b74-dbe8-4b8b-83b6-58a4811fdba9/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:51:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3245b74-dbe8-4b8b-83b6-58a4811fdba9/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:51:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3245b74-dbe8-4b8b-83b6-58a4811fdba9/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:51:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4abb549-8f36-40c5-971f-8accbb14ff86/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:51:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4abb549-8f36-40c5-971f-8accbb14ff86/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:51:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4abb549-8f36-40c5-971f-8accbb14ff86/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:51:43 user nova-compute[71509]: DEBUG nova.network.neutron [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Updating instance_info_cache with network_info: [{"id": "608a2408-02df-474f-9006-260c8c97def1", "address": "fa:16:3e:e4:f7:87", "network": {"id": "18a91434-637b-4c19-a97b-736b32c1ea5a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1824162811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea2cb4dfa5b4a52b658efd8f5aefb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap608a2408-02", "ovs_interfaceid": "608a2408-02df-474f-9006-260c8c97def1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:51:43 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Releasing lock "refresh_cache-b4abb549-8f36-40c5-971f-8accbb14ff86" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:51:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4abb549-8f36-40c5-971f-8accbb14ff86/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:51:44 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71509) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 10:51:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8586a70e-9855-4177-ac1b-cf707a4df871/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:51:44 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Starting migrate_disk_and_power_off {{(pid=71509) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11460}}
Apr 14 10:51:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8586a70e-9855-4177-ac1b-cf707a4df871/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:51:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8586a70e-9855-4177-ac1b-cf707a4df871/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:51:44 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:51:44 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:51:44 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:51:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8586a70e-9855-4177-ac1b-cf707a4df871/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:51:44 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71509) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 10:51:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd661ae0-c4bb-4117-847d-ef7e85d062fb/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:51:44 user nova-compute[71509]: DEBUG nova.compute.manager [req-f2d8e897-76b4-4360-a934-8aca33616c1b req-78084dc2-deb5-4130-83d3-00aa87d21cd9 service nova] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Received event network-vif-unplugged-608a2408-02df-474f-9006-260c8c97def1 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:51:44 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-f2d8e897-76b4-4360-a934-8aca33616c1b req-78084dc2-deb5-4130-83d3-00aa87d21cd9 service nova] Acquiring lock "b4abb549-8f36-40c5-971f-8accbb14ff86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:51:44 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-f2d8e897-76b4-4360-a934-8aca33616c1b req-78084dc2-deb5-4130-83d3-00aa87d21cd9 service nova] Lock "b4abb549-8f36-40c5-971f-8accbb14ff86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:51:44 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-f2d8e897-76b4-4360-a934-8aca33616c1b req-78084dc2-deb5-4130-83d3-00aa87d21cd9 service nova] Lock "b4abb549-8f36-40c5-971f-8accbb14ff86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:51:44 user nova-compute[71509]: DEBUG nova.compute.manager [req-f2d8e897-76b4-4360-a934-8aca33616c1b req-78084dc2-deb5-4130-83d3-00aa87d21cd9 service nova] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] No waiting events found dispatching network-vif-unplugged-608a2408-02df-474f-9006-260c8c97def1 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:51:44 user nova-compute[71509]: WARNING nova.compute.manager [req-f2d8e897-76b4-4360-a934-8aca33616c1b req-78084dc2-deb5-4130-83d3-00aa87d21cd9 service nova] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Received unexpected event network-vif-unplugged-608a2408-02df-474f-9006-260c8c97def1 for instance with vm_state active and task_state resize_migrating.
Apr 14 10:51:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd661ae0-c4bb-4117-847d-ef7e85d062fb/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:51:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd661ae0-c4bb-4117-847d-ef7e85d062fb/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:51:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd661ae0-c4bb-4117-847d-ef7e85d062fb/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:51:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:51:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:51:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:51:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:51:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e479154a-acd6-47aa-9a5b-43c6e0feda07/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:51:45 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:51:45 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Instance destroyed successfully.
Apr 14 10:51:45 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T10:42:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-375061147',display_name='tempest-ServerActionsTestJSON-server-564468196',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-375061147',id=4,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNt/FyD1XXsxB5kJC+SJ1dgkjoXXHkL+KX0Cr5HvI72xTIz+DAtuVRPHeIpMNLt39mbbZ9KAoCJibRQza0Qbd8j8EEoV7QHombhWz2Mdusr+gJ2OYTqrrRzVbjIHACTFWw==',key_name='tempest-keypair-1544270235',keypairs=<?>,launch_index=0,launched_at=2023-04-14T10:47:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3ea2cb4dfa5b4a52b658efd8f5aefb36',ramdisk_id='',reservation_id='r-2qmryidz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-1923052090',owner_user_name='tempest-ServerActionsTestJSON-1923052090-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T10:51:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5873a358bf544691b12cd2979f5e36dc',uuid=b4abb549-8f36-40c5-971f-8accbb14ff86,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "608a2408-02df-474f-9006-260c8c97def1", "address": "fa:16:3e:e4:f7:87", "network": {"id": "18a91434-637b-4c19-a97b-736b32c1ea5a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1824162811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1824162811-network", "vif_mac": "fa:16:3e:e4:f7:87"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea2cb4dfa5b4a52b658efd8f5aefb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap608a2408-02", "ovs_interfaceid": "608a2408-02df-474f-9006-260c8c97def1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 10:51:45 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Converting VIF {"id": "608a2408-02df-474f-9006-260c8c97def1", "address": "fa:16:3e:e4:f7:87", "network": {"id": "18a91434-637b-4c19-a97b-736b32c1ea5a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1824162811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1824162811-network", "vif_mac": "fa:16:3e:e4:f7:87"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea2cb4dfa5b4a52b658efd8f5aefb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap608a2408-02", "ovs_interfaceid": "608a2408-02df-474f-9006-260c8c97def1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:51:45 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e4:f7:87,bridge_name='br-int',has_traffic_filtering=True,id=608a2408-02df-474f-9006-260c8c97def1,network=Network(18a91434-637b-4c19-a97b-736b32c1ea5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap608a2408-02') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:51:45 user nova-compute[71509]: DEBUG os_vif [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e4:f7:87,bridge_name='br-int',has_traffic_filtering=True,id=608a2408-02df-474f-9006-260c8c97def1,network=Network(18a91434-637b-4c19-a97b-736b32c1ea5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap608a2408-02') {{(pid=71509) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 10:51:45 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:51:45 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap608a2408-02, bridge=br-int, if_exists=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:51:45 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:51:45 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 10:51:45 user nova-compute[71509]: INFO os_vif [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e4:f7:87,bridge_name='br-int',has_traffic_filtering=True,id=608a2408-02df-474f-9006-260c8c97def1,network=Network(18a91434-637b-4c19-a97b-736b32c1ea5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap608a2408-02')
Apr 14 10:51:45 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] calling os-brick to detach iSCSI Volume {{(pid=71509) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 10:51:45 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0bf0749390>, {'target_iqn': 'iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KDNjCusQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 10:51:45 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 10:51:45 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 10:51:45 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 10:51:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:51:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:51:45 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[98f9f515-e404-44e4-b34c-0b869855201e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:51:45 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 10:51:45 user nova-compute[71509]: No targets found.
Apr 14 10:51:45 user nova-compute[71509]: iSNS:
Apr 14 10:51:45 user nova-compute[71509]: No targets found.
Apr 14 10:51:45 user nova-compute[71509]: STATIC:
Apr 14 10:51:45 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2
Apr 14 10:51:45 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:51:45 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:51:45 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe
Apr 14 10:51:45 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:51:45 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:51:45 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178
Apr 14 10:51:45 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:51:45 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:51:45 user nova-compute[71509]: FIRMWARE:
Apr 14 10:51:45 user nova-compute[71509]: No targets found.
Apr 14 10:51:45 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:51:45 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 10:51:45 user nova-compute[71509]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 10:51:45 user nova-compute[71509]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71509) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 10:51:45 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe', 0)] {{(pid=71509) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 10:51:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:51:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:51:45 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[a082776e-5b40-4c4c-a674-398362c17a3e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:51:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:51:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e479154a-acd6-47aa-9a5b-43c6e0feda07/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:51:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e479154a-acd6-47aa-9a5b-43c6e0feda07/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:51:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:51:45 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[cef87421-2eec-401e-85cf-d6628134c6a1]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:51:45 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)
Apr 14 10:51:45 user nova-compute[71509]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2 (non-flash)
Apr 14 10:51:45 user nova-compute[71509]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe (non-flash)
Apr 14 10:51:45 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:51:45 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)
Apr 14 10:51:45 user nova-compute[71509]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2 (non-flash)
Apr 14 10:51:45 user nova-compute[71509]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe (non-flash)
Apr 14 10:51:45 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 10:51:45 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0c2c3cb400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe'): ({'sdb'}, set())}) {{(pid=71509) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 10:51:45 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Removing single pathed devices sdb {{(pid=71509) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 10:51:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:51:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:51:45 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[466f1b2e-a5c3-42bb-9a41-47eb79c70f72]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:51:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:51:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:51:45 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[dafeb4a9-14e5-412b-a00f-2fa6123902e3]: (4, ('ok\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:51:45 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Flushing IO for device /dev/sdb {{(pid=71509) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 10:51:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:51:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:51:45 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5bbdf0b-6672-46ac-9f6f-cb6c536ba14b]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:51:45 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71509) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 10:51:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:51:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e479154a-acd6-47aa-9a5b-43c6e0feda07/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:51:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:51:45 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[791e0d9e-89d5-41b9-8bcf-a4af1b7b02ff]: (4, ('1', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:51:45 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71509) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 10:51:45 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] SCSI volumes sdb have been removed. {{(pid=71509) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 10:51:45 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe')] {{(pid=71509) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 10:51:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:51:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:51:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:51:45 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[7340e1db-74ec-4a0b-bbfb-cda484044d0b]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:51:45 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:51:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe -p 172.16.0.220:3260 --logout {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:51:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:51:45 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cbec11b-27bd-49c1-bdb9-236b50e0aa19]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:51:45 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe, portal: 172.16.0.220,3260]
Apr 14 10:51:45 user nova-compute[71509]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe, portal: 172.16.0.220,3260] successful.
Apr 14 10:51:45 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:51:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe -p 172.16.0.220:3260 --op delete {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:51:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:51:45 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[3253478d-17e3-4f99-b054-9bbf9706dba5]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:51:45 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:51:45 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.379s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 10:51:45 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] <== disconnect_volume: return (381ms) None {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 10:51:45 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Disconnected iSCSI Volume {{(pid=71509) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 10:51:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4abb549-8f36-40c5-971f-8accbb14ff86/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:51:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:51:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:51:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4abb549-8f36-40c5-971f-8accbb14ff86/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:51:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4abb549-8f36-40c5-971f-8accbb14ff86/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:51:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:51:45 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71509) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 10:51:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97f20661-8b60-439e-b7af-2fc2013c5ade/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:51:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4abb549-8f36-40c5-971f-8accbb14ff86/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:51:45 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71509) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 10:51:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/b4abb549-8f36-40c5-971f-8accbb14ff86_resize/disk /opt/stack/data/nova/instances/b4abb549-8f36-40c5-971f-8accbb14ff86/disk {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:51:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97f20661-8b60-439e-b7af-2fc2013c5ade/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:51:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97f20661-8b60-439e-b7af-2fc2013c5ade/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:51:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97f20661-8b60-439e-b7af-2fc2013c5ade/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:51:46 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b767f1b-e97e-497c-8c70-8806203c76ae/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:51:46 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] CMD "cp -r /opt/stack/data/nova/instances/b4abb549-8f36-40c5-971f-8accbb14ff86_resize/disk /opt/stack/data/nova/instances/b4abb549-8f36-40c5-971f-8accbb14ff86/disk" returned: 0 in 0.235s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:51:46 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/b4abb549-8f36-40c5-971f-8accbb14ff86_resize/disk.info /opt/stack/data/nova/instances/b4abb549-8f36-40c5-971f-8accbb14ff86/disk.info {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:51:46 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] CMD "cp -r /opt/stack/data/nova/instances/b4abb549-8f36-40c5-971f-8accbb14ff86_resize/disk.info /opt/stack/data/nova/instances/b4abb549-8f36-40c5-971f-8accbb14ff86/disk.info" returned: 0 in 0.036s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:51:46 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b767f1b-e97e-497c-8c70-8806203c76ae/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:51:46 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b767f1b-e97e-497c-8c70-8806203c76ae/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:51:46 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b767f1b-e97e-497c-8c70-8806203c76ae/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:51:46 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b4b6e3e-0743-4ee6-900c-3172b09eb0f2/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:51:46 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b4b6e3e-0743-4ee6-900c-3172b09eb0f2/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:51:46 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b4b6e3e-0743-4ee6-900c-3172b09eb0f2/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:51:46 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b4b6e3e-0743-4ee6-900c-3172b09eb0f2/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:51:46 user nova-compute[71509]: DEBUG nova.compute.manager [req-30f8addf-43d4-47d1-a61c-c714d90a74da req-6814dd18-77b3-4915-9ac7-a539d7a54bf4 service nova] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Received event network-vif-plugged-608a2408-02df-474f-9006-260c8c97def1 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:51:46 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-30f8addf-43d4-47d1-a61c-c714d90a74da req-6814dd18-77b3-4915-9ac7-a539d7a54bf4 service nova] Acquiring lock "b4abb549-8f36-40c5-971f-8accbb14ff86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:51:46 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-30f8addf-43d4-47d1-a61c-c714d90a74da req-6814dd18-77b3-4915-9ac7-a539d7a54bf4 service nova] Lock "b4abb549-8f36-40c5-971f-8accbb14ff86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:51:46 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-30f8addf-43d4-47d1-a61c-c714d90a74da req-6814dd18-77b3-4915-9ac7-a539d7a54bf4 service nova] Lock "b4abb549-8f36-40c5-971f-8accbb14ff86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:51:46 user nova-compute[71509]: DEBUG nova.compute.manager [req-30f8addf-43d4-47d1-a61c-c714d90a74da req-6814dd18-77b3-4915-9ac7-a539d7a54bf4 service nova] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] No waiting events found dispatching network-vif-plugged-608a2408-02df-474f-9006-260c8c97def1 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:51:46 user nova-compute[71509]: WARNING nova.compute.manager [req-30f8addf-43d4-47d1-a61c-c714d90a74da req-6814dd18-77b3-4915-9ac7-a539d7a54bf4 service nova] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Received unexpected event network-vif-plugged-608a2408-02df-474f-9006-260c8c97def1 for instance with vm_state active and task_state resize_migrating.
Apr 14 10:51:47 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:51:47 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:51:47 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Hypervisor/Node resource view: name=user free_ram=7429MB free_disk=26.091861724853516GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71509) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 10:51:47 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:51:47 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:51:47 user nova-compute[71509]: DEBUG nova.network.neutron [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Port 608a2408-02df-474f-9006-260c8c97def1 binding to destination host user is already ACTIVE {{(pid=71509) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3161}}
Apr 14 10:51:47 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Applying migration context for instance b4abb549-8f36-40c5-971f-8accbb14ff86 as it has an incoming, in-progress migration aec5f116-c76f-438a-bee3-2a98dbe64d04. Migration status is post-migrating {{(pid=71509) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:950}}
Apr 14 10:51:47 user nova-compute[71509]: INFO nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Updating resource usage from migration aec5f116-c76f-438a-bee3-2a98dbe64d04
Apr 14 10:51:47 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 97f20661-8b60-439e-b7af-2fc2013c5ade actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:51:47 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 97820f17-22d1-4ec3-9721-1edadccc794a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:51:47 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance e479154a-acd6-47aa-9a5b-43c6e0feda07 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:51:47 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 8586a70e-9855-4177-ac1b-cf707a4df871 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:51:47 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance f3245b74-dbe8-4b8b-83b6-58a4811fdba9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:51:47 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 4b767f1b-e97e-497c-8c70-8806203c76ae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:51:47 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 6cae9f61-763f-4671-a873-d15f01384416 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:51:47 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:51:47 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 3b4b6e3e-0743-4ee6-900c-3172b09eb0f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:51:47 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:51:47 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance cd661ae0-c4bb-4117-847d-ef7e85d062fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:51:47 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Migration aec5f116-c76f-438a-bee3-2a98dbe64d04 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1637}}
Apr 14 10:51:47 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance b4abb549-8f36-40c5-971f-8accbb14ff86 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:51:47 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=71509) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 10:51:47 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Final resource view: name=user phys_ram=16023MB used_ram=2240MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=71509) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 10:51:47 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "b4abb549-8f36-40c5-971f-8accbb14ff86-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:51:47 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "b4abb549-8f36-40c5-971f-8accbb14ff86-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:51:47 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "b4abb549-8f36-40c5-971f-8accbb14ff86-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:51:47 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "refresh_cache-b4abb549-8f36-40c5-971f-8accbb14ff86" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:51:47 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquired lock "refresh_cache-b4abb549-8f36-40c5-971f-8accbb14ff86" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:51:47 user nova-compute[71509]: DEBUG nova.network.neutron [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Building network info cache for instance {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 10:51:47 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 10:51:47 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 10:51:47 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Compute_service record updated for user:user {{(pid=71509) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 10:51:47 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.673s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:51:47 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:51:48 user nova-compute[71509]: DEBUG nova.network.neutron [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Updating instance_info_cache with network_info: [{"id": "608a2408-02df-474f-9006-260c8c97def1", "address": "fa:16:3e:e4:f7:87", "network": {"id": "18a91434-637b-4c19-a97b-736b32c1ea5a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1824162811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea2cb4dfa5b4a52b658efd8f5aefb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap608a2408-02", "ovs_interfaceid": "608a2408-02df-474f-9006-260c8c97def1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:51:48 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Releasing lock "refresh_cache-b4abb549-8f36-40c5-971f-8accbb14ff86" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:51:48 user nova-compute[71509]: DEBUG os_brick.utils [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 10:51:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:51:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:51:48 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[d43e206a-11cc-438f-9c7a-827adac04dd1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50119df3c417\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:51:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:51:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:51:48 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[4026b423-25cc-4204-879a-f45e681feede]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:51:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:51:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:51:48 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aa3ed3c-3653-4373-abb7-d2afbf82cb69]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:51:48 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c147acd-6073-4b85-a0ca-0822a2bf2dac]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:51:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Running cmd (subprocess): nvme version {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:51:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] 'nvme version' failed. Not Retrying. {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 10:51:48 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.nvmeof [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] nvme not present on system {{(pid=71509) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 10:51:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:51:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 10:51:48 user nova-compute[71509]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 10:51:48 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbd53f99-2fd7-4d0c-ae17-428f8530eac6]: (4, '') {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:51:48 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71509) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 10:51:48 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71509) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 10:51:48 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] LIGHTOS: no hostnqn found. {{(pid=71509) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 10:51:48 user nova-compute[71509]: DEBUG os_brick.utils [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50119df3c417', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 10:51:50 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:51:52 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:51:53 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Starting finish_migration {{(pid=71509) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11647}}
Apr 14 10:51:53 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Instance directory exists: not creating {{(pid=71509) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 14 10:51:53 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Creating image(s)
Apr 14 10:51:53 user nova-compute[71509]: DEBUG nova.objects.instance [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lazy-loading 'trusted_certs' on Instance uuid b4abb549-8f36-40c5-971f-8accbb14ff86 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:51:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:51:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json" returned: 0 in 0.132s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:51:53 user nova-compute[71509]: DEBUG nova.virt.disk.api [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b4abb549-8f36-40c5-971f-8accbb14ff86/disk. size=1073741824 {{(pid=71509) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 10:51:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4abb549-8f36-40c5-971f-8accbb14ff86/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:51:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4abb549-8f36-40c5-971f-8accbb14ff86/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:51:53 user nova-compute[71509]: DEBUG nova.virt.disk.api [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Cannot resize image /opt/stack/data/nova/instances/b4abb549-8f36-40c5-971f-8accbb14ff86/disk to a smaller size. {{(pid=71509) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 10:51:53 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Did not create local disks {{(pid=71509) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 10:51:53 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Ensure instance console log exists: /opt/stack/data/nova/instances/b4abb549-8f36-40c5-971f-8accbb14ff86/console.log {{(pid=71509) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 10:51:53 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:51:53 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:51:53 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:51:53 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Start _get_guest_xml network_info=[{"id": "608a2408-02df-474f-9006-260c8c97def1", "address": "fa:16:3e:e4:f7:87", "network": {"id": "18a91434-637b-4c19-a97b-736b32c1ea5a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1824162811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1824162811-network", "vif_mac": "fa:16:3e:e4:f7:87"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea2cb4dfa5b4a52b658efd8f5aefb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap608a2408-02", "ovs_interfaceid": "608a2408-02df-474f-9006-260c8c97def1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T10:38:55Z,direct_url=<?>,disk_format='qcow2',id=048ec0ee-0465-448d-8b4c-f072acb101dc,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='9742d6ad20cf48d9bab0fdbcc9491db9',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T10:38:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '048ec0ee-0465-448d-8b4c-f072acb101dc'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vdb', 'boot_index': None, 'device_type': 'disk', 'attachment_id': '27e762de-ae16-4c6e-a2e9-eacd6789e1cd', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KDNjCusQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'b4abb549-8f36-40c5-971f-8accbb14ff86', 'attached_at': '2023-04-14T10:51:53.000000', 'detached_at': '', 'volume_id': '9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe', 'serial': '9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'volume_type': None} {{(pid=71509) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 10:51:53 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:51:53 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:51:53 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71509) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 10:51:53 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T10:40:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=192,name='m1.micro',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T10:38:55Z,direct_url=<?>,disk_format='qcow2',id=048ec0ee-0465-448d-8b4c-f072acb101dc,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='9742d6ad20cf48d9bab0fdbcc9491db9',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T10:38:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 10:51:53 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Flavor limits 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 10:51:53 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Image limits 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 10:51:53 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Flavor pref 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 10:51:53 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Image pref 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 10:51:53 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 10:51:53 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 10:51:53 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71509) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 10:51:53 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Got 1 possible topologies {{(pid=71509) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 10:51:53 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 10:51:53 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 10:51:53 user nova-compute[71509]: DEBUG nova.objects.instance [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lazy-loading 'vcpu_model' on Instance uuid b4abb549-8f36-40c5-971f-8accbb14ff86 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:51:53 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Calling os-brick to attach iSCSI Volume {{(pid=71509) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 10:51:53 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0bf0749390>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KDNjCusQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 10:51:53 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 10:51:53 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 10:51:53 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 10:51:53 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 10:51:53 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 10:51:53 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 10:51:53 user nova-compute[71509]: INFO os_brick.initiator.connectors.iscsi [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 10:51:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe -p 172.16.0.220:3260 {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:51:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:51:53 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd01b945-0517-4a2b-b11a-d4bcd49a5d32]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:51:53 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 10:51:53 user nova-compute[71509]:  {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:51:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe -p 172.16.0.220:3260 --interface default --op new {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:51:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:51:53 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8e910cd-6f6d-43ea-9d5f-97d785b4bf63]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe] added\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:51:53 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe] added
Apr 14 10:51:53 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:51:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:51:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:51:53 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b473a61-3661-4ba8-8ee4-0613b363c101]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:51:53 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:51:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:51:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:51:53 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[23100eca-0fcb-4b6c-b249-1d14e15e8796]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:51:53 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:51:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KDNjCusQ {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:51:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KDNjCusQ" returned: 0 in 0.024s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:51:53 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[667779b9-dcf6-494e-bb3c-e975fd26bf7f]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:51:53 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KDNjCusQ'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:51:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:51:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:51:53 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[171b4bc0-feff-4f93-83ea-4b11f2dca0e1]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:51:53 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:51:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:51:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:51:53 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d300221-05df-4bdf-b4da-e6ebfce003e7]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2 (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:51:53 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)
Apr 14 10:51:53 user nova-compute[71509]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2 (non-flash)
Apr 14 10:51:53 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:51:53 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)
Apr 14 10:51:53 user nova-compute[71509]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2 (non-flash)
Apr 14 10:51:53 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 10:51:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe -p 172.16.0.220:3260 --login {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:51:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:51:53 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cf469dd-c3f4-4357-beb9-2736749d237d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:51:53 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe, portal: 172.16.0.220,3260]
Apr 14 10:51:53 user nova-compute[71509]: Login to [iface: default, target: iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe, portal: 172.16.0.220,3260] successful.
Apr 14 10:51:53 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:51:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:51:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:51:53 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[28c1022f-6dc8-46f0-bf0b-73d46c409a3b]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:51:53 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:51:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:51:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:51:53 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[f515552c-40a8-44f7-9816-88183082c9bd]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:51:53 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)
Apr 14 10:51:53 user nova-compute[71509]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2 (non-flash)
Apr 14 10:51:53 user nova-compute[71509]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe (non-flash)
Apr 14 10:51:53 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:51:53 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)
Apr 14 10:51:53 user nova-compute[71509]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2 (non-flash)
Apr 14 10:51:53 user nova-compute[71509]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe (non-flash)
Apr 14 10:51:53 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 10:51:53 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.285s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 10:51:53 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Connected to 172.16.0.220:3260 {{(pid=71509) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 10:51:53 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] HCTL ('33', '-', '-', 0) found on session 31 with lun 0 {{(pid=71509) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 10:51:53 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71509) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 10:51:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:51:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:51:53 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d7e36d6-5e23-4228-b718-4ee4a4db4670]: (4, ('- - 0', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:51:53 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Searching for a device in session 31 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71509) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 10:51:53 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KDNjCusQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71509) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 10:51:54 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 10:51:54 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] <== connect_volume: return (1325ms) {'type': 'block', 'scsi_wwn': '23530323537323431', 'path': '/dev/sdb'} {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 10:51:54 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23530323537323431', 'path': '/dev/sdb'} {{(pid=71509) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 10:51:54 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T10:42:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-375061147',display_name='tempest-ServerActionsTestJSON-server-564468196',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-375061147',id=4,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNt/FyD1XXsxB5kJC+SJ1dgkjoXXHkL+KX0Cr5HvI72xTIz+DAtuVRPHeIpMNLt39mbbZ9KAoCJibRQza0Qbd8j8EEoV7QHombhWz2Mdusr+gJ2OYTqrrRzVbjIHACTFWw==',key_name='tempest-keypair-1544270235',keypairs=<?>,launch_index=0,launched_at=2023-04-14T10:47:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3ea2cb4dfa5b4a52b658efd8f5aefb36',ramdisk_id='',reservation_id='r-2qmryidz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-1923052090',owner_user_name='tempest-ServerActionsTestJSON-1923052090-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T10:51:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5873a358bf544691b12cd2979f5e36dc',uuid=b4abb549-8f36-40c5-971f-8accbb14ff86,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "608a2408-02df-474f-9006-260c8c97def1", "address": "fa:16:3e:e4:f7:87", "network": {"id": "18a91434-637b-4c19-a97b-736b32c1ea5a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1824162811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1824162811-network", "vif_mac": "fa:16:3e:e4:f7:87"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea2cb4dfa5b4a52b658efd8f5aefb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap608a2408-02", "ovs_interfaceid": "608a2408-02df-474f-9006-260c8c97def1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71509) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 10:51:54 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Converting VIF {"id": "608a2408-02df-474f-9006-260c8c97def1", "address": "fa:16:3e:e4:f7:87", "network": {"id": "18a91434-637b-4c19-a97b-736b32c1ea5a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1824162811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1824162811-network", "vif_mac": "fa:16:3e:e4:f7:87"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea2cb4dfa5b4a52b658efd8f5aefb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap608a2408-02", "ovs_interfaceid": "608a2408-02df-474f-9006-260c8c97def1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:51:54 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:f7:87,bridge_name='br-int',has_traffic_filtering=True,id=608a2408-02df-474f-9006-260c8c97def1,network=Network(18a91434-637b-4c19-a97b-736b32c1ea5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap608a2408-02') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:51:54 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] End _get_guest_xml xml=<domain type="kvm">
Apr 14 10:51:54 user nova-compute[71509]:   <uuid>b4abb549-8f36-40c5-971f-8accbb14ff86</uuid>
Apr 14 10:51:54 user nova-compute[71509]:   <name>instance-00000004</name>
Apr 14 10:51:54 user nova-compute[71509]:   <memory>196608</memory>
Apr 14 10:51:54 user nova-compute[71509]:   <vcpu>1</vcpu>
Apr 14 10:51:54 user nova-compute[71509]:   <metadata>
Apr 14 10:51:54 user nova-compute[71509]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 10:51:54 user nova-compute[71509]:       <nova:package version="0.0.0"/>
Apr 14 10:51:54 user nova-compute[71509]:       <nova:name>tempest-ServerActionsTestJSON-server-564468196</nova:name>
Apr 14 10:51:54 user nova-compute[71509]:       <nova:creationTime>2023-04-14 10:51:53</nova:creationTime>
Apr 14 10:51:54 user nova-compute[71509]:       <nova:flavor name="m1.micro">
Apr 14 10:51:54 user nova-compute[71509]:         <nova:memory>192</nova:memory>
Apr 14 10:51:54 user nova-compute[71509]:         <nova:disk>1</nova:disk>
Apr 14 10:51:54 user nova-compute[71509]:         <nova:swap>0</nova:swap>
Apr 14 10:51:54 user nova-compute[71509]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 10:51:54 user nova-compute[71509]:         <nova:vcpus>1</nova:vcpus>
Apr 14 10:51:54 user nova-compute[71509]:       </nova:flavor>
Apr 14 10:51:54 user nova-compute[71509]:       <nova:owner>
Apr 14 10:51:54 user nova-compute[71509]:         <nova:user uuid="5873a358bf544691b12cd2979f5e36dc">tempest-ServerActionsTestJSON-1923052090-project-member</nova:user>
Apr 14 10:51:54 user nova-compute[71509]:         <nova:project uuid="3ea2cb4dfa5b4a52b658efd8f5aefb36">tempest-ServerActionsTestJSON-1923052090</nova:project>
Apr 14 10:51:54 user nova-compute[71509]:       </nova:owner>
Apr 14 10:51:54 user nova-compute[71509]:       <nova:root type="image" uuid="048ec0ee-0465-448d-8b4c-f072acb101dc"/>
Apr 14 10:51:54 user nova-compute[71509]:       <nova:ports>
Apr 14 10:51:54 user nova-compute[71509]:         <nova:port uuid="608a2408-02df-474f-9006-260c8c97def1">
Apr 14 10:51:54 user nova-compute[71509]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 14 10:51:54 user nova-compute[71509]:         </nova:port>
Apr 14 10:51:54 user nova-compute[71509]:       </nova:ports>
Apr 14 10:51:54 user nova-compute[71509]:     </nova:instance>
Apr 14 10:51:54 user nova-compute[71509]:   </metadata>
Apr 14 10:51:54 user nova-compute[71509]:   <sysinfo type="smbios">
Apr 14 10:51:54 user nova-compute[71509]:     <system>
Apr 14 10:51:54 user nova-compute[71509]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 10:51:54 user nova-compute[71509]:       <entry name="product">OpenStack Nova</entry>
Apr 14 10:51:54 user nova-compute[71509]:       <entry name="version">0.0.0</entry>
Apr 14 10:51:54 user nova-compute[71509]:       <entry name="serial">b4abb549-8f36-40c5-971f-8accbb14ff86</entry>
Apr 14 10:51:54 user nova-compute[71509]:       <entry name="uuid">b4abb549-8f36-40c5-971f-8accbb14ff86</entry>
Apr 14 10:51:54 user nova-compute[71509]:       <entry name="family">Virtual Machine</entry>
Apr 14 10:51:54 user nova-compute[71509]:     </system>
Apr 14 10:51:54 user nova-compute[71509]:   </sysinfo>
Apr 14 10:51:54 user nova-compute[71509]:   <os>
Apr 14 10:51:54 user nova-compute[71509]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 10:51:54 user nova-compute[71509]:     <boot dev="hd"/>
Apr 14 10:51:54 user nova-compute[71509]:     <smbios mode="sysinfo"/>
Apr 14 10:51:54 user nova-compute[71509]:   </os>
Apr 14 10:51:54 user nova-compute[71509]:   <features>
Apr 14 10:51:54 user nova-compute[71509]:     <acpi/>
Apr 14 10:51:54 user nova-compute[71509]:     <apic/>
Apr 14 10:51:54 user nova-compute[71509]:     <vmcoreinfo/>
Apr 14 10:51:54 user nova-compute[71509]:   </features>
Apr 14 10:51:54 user nova-compute[71509]:   <clock offset="utc">
Apr 14 10:51:54 user nova-compute[71509]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 10:51:54 user nova-compute[71509]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 10:51:54 user nova-compute[71509]:     <timer name="hpet" present="no"/>
Apr 14 10:51:54 user nova-compute[71509]:   </clock>
Apr 14 10:51:54 user nova-compute[71509]:   <cpu mode="custom" match="exact">
Apr 14 10:51:54 user nova-compute[71509]:     <model>Nehalem</model>
Apr 14 10:51:54 user nova-compute[71509]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 10:51:54 user nova-compute[71509]:   </cpu>
Apr 14 10:51:54 user nova-compute[71509]:   <devices>
Apr 14 10:51:54 user nova-compute[71509]:     <disk type="file" device="disk">
Apr 14 10:51:54 user nova-compute[71509]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 10:51:54 user nova-compute[71509]:       <source file="/opt/stack/data/nova/instances/b4abb549-8f36-40c5-971f-8accbb14ff86/disk"/>
Apr 14 10:51:54 user nova-compute[71509]:       <target dev="vda" bus="virtio"/>
Apr 14 10:51:54 user nova-compute[71509]:     </disk>
Apr 14 10:51:54 user nova-compute[71509]:     <disk type="block" device="disk">
Apr 14 10:51:54 user nova-compute[71509]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 10:51:54 user nova-compute[71509]:       <source dev="/dev/sdb"/>
Apr 14 10:51:54 user nova-compute[71509]:       <target dev="vdb" bus="virtio"/>
Apr 14 10:51:54 user nova-compute[71509]:       <serial>9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe</serial>
Apr 14 10:51:54 user nova-compute[71509]:     </disk>
Apr 14 10:51:54 user nova-compute[71509]:     <interface type="ethernet">
Apr 14 10:51:54 user nova-compute[71509]:       <mac address="fa:16:3e:e4:f7:87"/>
Apr 14 10:51:54 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 10:51:54 user nova-compute[71509]:       <mtu size="1442"/>
Apr 14 10:51:54 user nova-compute[71509]:       <target dev="tap608a2408-02"/>
Apr 14 10:51:54 user nova-compute[71509]:     </interface>
Apr 14 10:51:54 user nova-compute[71509]:     <serial type="pty">
Apr 14 10:51:54 user nova-compute[71509]:       <log file="/opt/stack/data/nova/instances/b4abb549-8f36-40c5-971f-8accbb14ff86/console.log" append="off"/>
Apr 14 10:51:54 user nova-compute[71509]:     </serial>
Apr 14 10:51:54 user nova-compute[71509]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 10:51:54 user nova-compute[71509]:     <video>
Apr 14 10:51:54 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 10:51:54 user nova-compute[71509]:     </video>
Apr 14 10:51:54 user nova-compute[71509]:     <rng model="virtio">
Apr 14 10:51:54 user nova-compute[71509]:       <backend model="random">/dev/urandom</backend>
Apr 14 10:51:54 user nova-compute[71509]:     </rng>
Apr 14 10:51:54 user nova-compute[71509]:     <controller type="usb" index="0" model="none"/>
Apr 14 10:51:54 user nova-compute[71509]:     <memballoon model="virtio">
Apr 14 10:51:54 user nova-compute[71509]:       <stats period="10"/>
Apr 14 10:51:54 user nova-compute[71509]:     </memballoon>
Apr 14 10:51:54 user nova-compute[71509]:   </devices>
Apr 14 10:51:54 user nova-compute[71509]: </domain>
Apr 14 10:51:54 user nova-compute[71509]:  {{(pid=71509) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 10:51:54 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T10:42:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-375061147',display_name='tempest-ServerActionsTestJSON-server-564468196',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-375061147',id=4,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNt/FyD1XXsxB5kJC+SJ1dgkjoXXHkL+KX0Cr5HvI72xTIz+DAtuVRPHeIpMNLt39mbbZ9KAoCJibRQza0Qbd8j8EEoV7QHombhWz2Mdusr+gJ2OYTqrrRzVbjIHACTFWw==',key_name='tempest-keypair-1544270235',keypairs=<?>,launch_index=0,launched_at=2023-04-14T10:47:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3ea2cb4dfa5b4a52b658efd8f5aefb36',ramdisk_id='',reservation_id='r-2qmryidz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-1923052090',owner_user_name='tempest-ServerActionsTestJSON-1923052090-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T10:51:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5873a358bf544691b12cd2979f5e36dc',uuid=b4abb549-8f36-40c5-971f-8accbb14ff86,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "608a2408-02df-474f-9006-260c8c97def1", "address": "fa:16:3e:e4:f7:87", "network": {"id": "18a91434-637b-4c19-a97b-736b32c1ea5a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1824162811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1824162811-network", "vif_mac": "fa:16:3e:e4:f7:87"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea2cb4dfa5b4a52b658efd8f5aefb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap608a2408-02", "ovs_interfaceid": "608a2408-02df-474f-9006-260c8c97def1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 10:51:54 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Converting VIF {"id": "608a2408-02df-474f-9006-260c8c97def1", "address": "fa:16:3e:e4:f7:87", "network": {"id": "18a91434-637b-4c19-a97b-736b32c1ea5a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1824162811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1824162811-network", "vif_mac": "fa:16:3e:e4:f7:87"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea2cb4dfa5b4a52b658efd8f5aefb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap608a2408-02", "ovs_interfaceid": "608a2408-02df-474f-9006-260c8c97def1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:51:54 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:f7:87,bridge_name='br-int',has_traffic_filtering=True,id=608a2408-02df-474f-9006-260c8c97def1,network=Network(18a91434-637b-4c19-a97b-736b32c1ea5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap608a2408-02') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:51:54 user nova-compute[71509]: DEBUG os_vif [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:f7:87,bridge_name='br-int',has_traffic_filtering=True,id=608a2408-02df-474f-9006-260c8c97def1,network=Network(18a91434-637b-4c19-a97b-736b32c1ea5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap608a2408-02') {{(pid=71509) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 10:51:54 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:51:54 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:51:54 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 10:51:54 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:51:54 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap608a2408-02, may_exist=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:51:54 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap608a2408-02, col_values=(('external_ids', {'iface-id': '608a2408-02df-474f-9006-260c8c97def1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e4:f7:87', 'vm-uuid': 'b4abb549-8f36-40c5-971f-8accbb14ff86'}),)) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:51:54 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 10:51:54 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:51:54 user nova-compute[71509]: INFO os_vif [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:f7:87,bridge_name='br-int',has_traffic_filtering=True,id=608a2408-02df-474f-9006-260c8c97def1,network=Network(18a91434-637b-4c19-a97b-736b32c1ea5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap608a2408-02')
Apr 14 10:51:54 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] No BDM found with device name vda, not building metadata. {{(pid=71509) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 10:51:54 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71509) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 10:51:54 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] No VIF found with MAC fa:16:3e:e4:f7:87, not building metadata {{(pid=71509) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 10:51:56 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:51:56 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:51:56 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:51:56 user nova-compute[71509]: DEBUG nova.compute.manager [req-4c8ca1c4-ae59-4c24-ab40-5457e56286e3 req-ff793781-3bd7-4d41-9635-88c103b336ef service nova] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Received event network-vif-plugged-608a2408-02df-474f-9006-260c8c97def1 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:51:56 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-4c8ca1c4-ae59-4c24-ab40-5457e56286e3 req-ff793781-3bd7-4d41-9635-88c103b336ef service nova] Acquiring lock "b4abb549-8f36-40c5-971f-8accbb14ff86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:51:56 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-4c8ca1c4-ae59-4c24-ab40-5457e56286e3 req-ff793781-3bd7-4d41-9635-88c103b336ef service nova] Lock "b4abb549-8f36-40c5-971f-8accbb14ff86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:51:56 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-4c8ca1c4-ae59-4c24-ab40-5457e56286e3 req-ff793781-3bd7-4d41-9635-88c103b336ef service nova] Lock "b4abb549-8f36-40c5-971f-8accbb14ff86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:51:56 user nova-compute[71509]: DEBUG nova.compute.manager [req-4c8ca1c4-ae59-4c24-ab40-5457e56286e3 req-ff793781-3bd7-4d41-9635-88c103b336ef service nova] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] No waiting events found dispatching network-vif-plugged-608a2408-02df-474f-9006-260c8c97def1 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:51:56 user nova-compute[71509]: WARNING nova.compute.manager [req-4c8ca1c4-ae59-4c24-ab40-5457e56286e3 req-ff793781-3bd7-4d41-9635-88c103b336ef service nova] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Received unexpected event network-vif-plugged-608a2408-02df-474f-9006-260c8c97def1 for instance with vm_state active and task_state resize_finish.
Apr 14 10:51:56 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:51:56 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:51:56 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:51:56 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:51:57 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:51:58 user nova-compute[71509]: DEBUG nova.virt.libvirt.host [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Removed pending event for b4abb549-8f36-40c5-971f-8accbb14ff86 due to event {{(pid=71509) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 10:51:58 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681469518.2111764, b4abb549-8f36-40c5-971f-8accbb14ff86 => Resumed> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 10:51:58 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] VM Resumed (Lifecycle Event)
Apr 14 10:51:58 user nova-compute[71509]: DEBUG nova.compute.manager [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Instance event wait completed in 0 seconds for  {{(pid=71509) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 10:51:58 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Instance running successfully.
Apr 14 10:51:58 user nova-compute[71509]: DEBUG nova.virt.libvirt.guest [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Failed to set time: agent not configured {{(pid=71509) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Apr 14 10:51:58 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-da99ebbb-68f9-4644-b983-10edec336cac tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] finish_migration finished successfully. {{(pid=71509) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11742}}
Apr 14 10:51:58 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:51:58 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 10:51:58 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] During sync_power_state the instance has a pending task (resize_finish). Skip.
Apr 14 10:51:58 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681469518.2129195, b4abb549-8f36-40c5-971f-8accbb14ff86 => Started> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 10:51:58 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] VM Started (Lifecycle Event)
Apr 14 10:51:58 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:51:58 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 10:51:58 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] During sync_power_state the instance has a pending task (resize_finish). Skip.
Apr 14 10:51:58 user nova-compute[71509]: DEBUG nova.compute.manager [req-f51498dd-cba4-43bb-b280-deda47f0df4d req-8a368676-3395-4524-83ab-3974ab8f3652 service nova] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Received event network-vif-plugged-608a2408-02df-474f-9006-260c8c97def1 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:51:58 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-f51498dd-cba4-43bb-b280-deda47f0df4d req-8a368676-3395-4524-83ab-3974ab8f3652 service nova] Acquiring lock "b4abb549-8f36-40c5-971f-8accbb14ff86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:51:58 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-f51498dd-cba4-43bb-b280-deda47f0df4d req-8a368676-3395-4524-83ab-3974ab8f3652 service nova] Lock "b4abb549-8f36-40c5-971f-8accbb14ff86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:51:58 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-f51498dd-cba4-43bb-b280-deda47f0df4d req-8a368676-3395-4524-83ab-3974ab8f3652 service nova] Lock "b4abb549-8f36-40c5-971f-8accbb14ff86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:51:58 user nova-compute[71509]: DEBUG nova.compute.manager [req-f51498dd-cba4-43bb-b280-deda47f0df4d req-8a368676-3395-4524-83ab-3974ab8f3652 service nova] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] No waiting events found dispatching network-vif-plugged-608a2408-02df-474f-9006-260c8c97def1 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:51:58 user nova-compute[71509]: WARNING nova.compute.manager [req-f51498dd-cba4-43bb-b280-deda47f0df4d req-8a368676-3395-4524-83ab-3974ab8f3652 service nova] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Received unexpected event network-vif-plugged-608a2408-02df-474f-9006-260c8c97def1 for instance with vm_state active and task_state resize_finish.
Apr 14 10:51:59 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:52:02 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:52:04 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:52:07 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:52:09 user nova-compute[71509]: INFO nova.compute.manager [None req-2a98431e-c795-4e2a-8b1b-ac99750c8226 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: 6cae9f61-763f-4671-a873-d15f01384416] Rescuing
Apr 14 10:52:09 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-2a98431e-c795-4e2a-8b1b-ac99750c8226 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Acquiring lock "refresh_cache-6cae9f61-763f-4671-a873-d15f01384416" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:52:09 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-2a98431e-c795-4e2a-8b1b-ac99750c8226 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Acquired lock "refresh_cache-6cae9f61-763f-4671-a873-d15f01384416" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:52:09 user nova-compute[71509]: DEBUG nova.network.neutron [None req-2a98431e-c795-4e2a-8b1b-ac99750c8226 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: 6cae9f61-763f-4671-a873-d15f01384416] Building network info cache for instance {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 10:52:09 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:52:09 user nova-compute[71509]: DEBUG nova.network.neutron [None req-2a98431e-c795-4e2a-8b1b-ac99750c8226 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: 6cae9f61-763f-4671-a873-d15f01384416] Updating instance_info_cache with network_info: [{"id": "30d57100-3321-41fe-9335-d53c8c5e291c", "address": "fa:16:3e:57:7d:4b", "network": {"id": "07f1f39e-292a-4e73-b4ed-99e5799d6fa8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1339551596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71289f80a05141f482cb538dac3d7b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30d57100-33", "ovs_interfaceid": "30d57100-3321-41fe-9335-d53c8c5e291c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:52:09 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-2a98431e-c795-4e2a-8b1b-ac99750c8226 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Releasing lock "refresh_cache-6cae9f61-763f-4671-a873-d15f01384416" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:52:10 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:52:10 user nova-compute[71509]: DEBUG nova.compute.manager [req-1d1fea35-06ab-47e3-9958-a08db2875154 req-95a48dac-1808-43d6-a163-6a5ac8c8df50 service nova] [instance: 6cae9f61-763f-4671-a873-d15f01384416] Received event network-vif-unplugged-30d57100-3321-41fe-9335-d53c8c5e291c {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:52:10 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-1d1fea35-06ab-47e3-9958-a08db2875154 req-95a48dac-1808-43d6-a163-6a5ac8c8df50 service nova] Acquiring lock "6cae9f61-763f-4671-a873-d15f01384416-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:52:10 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-1d1fea35-06ab-47e3-9958-a08db2875154 req-95a48dac-1808-43d6-a163-6a5ac8c8df50 service nova] Lock "6cae9f61-763f-4671-a873-d15f01384416-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:52:10 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-1d1fea35-06ab-47e3-9958-a08db2875154 req-95a48dac-1808-43d6-a163-6a5ac8c8df50 service nova] Lock "6cae9f61-763f-4671-a873-d15f01384416-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:52:10 user nova-compute[71509]: DEBUG nova.compute.manager [req-1d1fea35-06ab-47e3-9958-a08db2875154 req-95a48dac-1808-43d6-a163-6a5ac8c8df50 service nova] [instance: 6cae9f61-763f-4671-a873-d15f01384416] No waiting events found dispatching network-vif-unplugged-30d57100-3321-41fe-9335-d53c8c5e291c {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:52:10 user nova-compute[71509]: WARNING nova.compute.manager [req-1d1fea35-06ab-47e3-9958-a08db2875154 req-95a48dac-1808-43d6-a163-6a5ac8c8df50 service nova] [instance: 6cae9f61-763f-4671-a873-d15f01384416] Received unexpected event network-vif-unplugged-30d57100-3321-41fe-9335-d53c8c5e291c for instance with vm_state active and task_state rescuing.
Apr 14 10:52:10 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:52:10 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:52:10 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: 6cae9f61-763f-4671-a873-d15f01384416] Instance destroyed successfully.
Apr 14 10:52:10 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-2a98431e-c795-4e2a-8b1b-ac99750c8226 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: 6cae9f61-763f-4671-a873-d15f01384416] Attempting a stable device rescue
Apr 14 10:52:10 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-2a98431e-c795-4e2a-8b1b-ac99750c8226 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71509) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 14 10:52:10 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-2a98431e-c795-4e2a-8b1b-ac99750c8226 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: 6cae9f61-763f-4671-a873-d15f01384416] Instance directory exists: not creating {{(pid=71509) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 14 10:52:10 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-2a98431e-c795-4e2a-8b1b-ac99750c8226 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: 6cae9f61-763f-4671-a873-d15f01384416] Creating image(s)
Apr 14 10:52:10 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-2a98431e-c795-4e2a-8b1b-ac99750c8226 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Acquiring lock "/opt/stack/data/nova/instances/6cae9f61-763f-4671-a873-d15f01384416/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:52:10 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-2a98431e-c795-4e2a-8b1b-ac99750c8226 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "/opt/stack/data/nova/instances/6cae9f61-763f-4671-a873-d15f01384416/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:52:10 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-2a98431e-c795-4e2a-8b1b-ac99750c8226 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "/opt/stack/data/nova/instances/6cae9f61-763f-4671-a873-d15f01384416/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:52:10 user nova-compute[71509]: DEBUG nova.objects.instance [None req-2a98431e-c795-4e2a-8b1b-ac99750c8226 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lazy-loading 'trusted_certs' on Instance uuid 6cae9f61-763f-4671-a873-d15f01384416 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:52:10 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-2a98431e-c795-4e2a-8b1b-ac99750c8226 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Acquiring lock "c5f020440b64e6c7c652455c70efc38e975fe977" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:52:10 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-2a98431e-c795-4e2a-8b1b-ac99750c8226 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "c5f020440b64e6c7c652455c70efc38e975fe977" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:52:11 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-2a98431e-c795-4e2a-8b1b-ac99750c8226 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c5f020440b64e6c7c652455c70efc38e975fe977.part --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:52:11 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-2a98431e-c795-4e2a-8b1b-ac99750c8226 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c5f020440b64e6c7c652455c70efc38e975fe977.part --force-share --output=json" returned: 0 in 0.131s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:52:11 user nova-compute[71509]: DEBUG nova.virt.images [None req-2a98431e-c795-4e2a-8b1b-ac99750c8226 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] 92413760-9bf6-4794-85ee-4450e5351a44 was qcow2, converting to raw {{(pid=71509) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 14 10:52:11 user nova-compute[71509]: DEBUG nova.privsep.utils [None req-2a98431e-c795-4e2a-8b1b-ac99750c8226 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71509) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 10:52:11 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-2a98431e-c795-4e2a-8b1b-ac99750c8226 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c5f020440b64e6c7c652455c70efc38e975fe977.part /opt/stack/data/nova/instances/_base/c5f020440b64e6c7c652455c70efc38e975fe977.converted {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:52:12 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-2a98431e-c795-4e2a-8b1b-ac99750c8226 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c5f020440b64e6c7c652455c70efc38e975fe977.part /opt/stack/data/nova/instances/_base/c5f020440b64e6c7c652455c70efc38e975fe977.converted" returned: 0 in 0.286s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:52:12 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-2a98431e-c795-4e2a-8b1b-ac99750c8226 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c5f020440b64e6c7c652455c70efc38e975fe977.converted --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:52:12 user nova-compute[71509]: DEBUG nova.compute.manager [req-dd9d2ae6-6ada-407e-b921-328a99f93726 req-dc0b95f9-b099-4465-b589-1fc20234ecbf service nova] [instance: 6cae9f61-763f-4671-a873-d15f01384416] Received event network-vif-plugged-30d57100-3321-41fe-9335-d53c8c5e291c {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:52:12 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-dd9d2ae6-6ada-407e-b921-328a99f93726 req-dc0b95f9-b099-4465-b589-1fc20234ecbf service nova] Acquiring lock "6cae9f61-763f-4671-a873-d15f01384416-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:52:12 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-dd9d2ae6-6ada-407e-b921-328a99f93726 req-dc0b95f9-b099-4465-b589-1fc20234ecbf service nova] Lock "6cae9f61-763f-4671-a873-d15f01384416-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:52:12 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-dd9d2ae6-6ada-407e-b921-328a99f93726 req-dc0b95f9-b099-4465-b589-1fc20234ecbf service nova] Lock "6cae9f61-763f-4671-a873-d15f01384416-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:52:12 user nova-compute[71509]: DEBUG nova.compute.manager [req-dd9d2ae6-6ada-407e-b921-328a99f93726 req-dc0b95f9-b099-4465-b589-1fc20234ecbf service nova] [instance: 6cae9f61-763f-4671-a873-d15f01384416] No waiting events found dispatching network-vif-plugged-30d57100-3321-41fe-9335-d53c8c5e291c {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:52:12 user nova-compute[71509]: WARNING nova.compute.manager [req-dd9d2ae6-6ada-407e-b921-328a99f93726 req-dc0b95f9-b099-4465-b589-1fc20234ecbf service nova] [instance: 6cae9f61-763f-4671-a873-d15f01384416] Received unexpected event network-vif-plugged-30d57100-3321-41fe-9335-d53c8c5e291c for instance with vm_state active and task_state rescuing.
Apr 14 10:52:12 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-2a98431e-c795-4e2a-8b1b-ac99750c8226 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c5f020440b64e6c7c652455c70efc38e975fe977.converted --force-share --output=json" returned: 0 in 0.149s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:52:12 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-2a98431e-c795-4e2a-8b1b-ac99750c8226 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "c5f020440b64e6c7c652455c70efc38e975fe977" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.564s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:52:12 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-2a98431e-c795-4e2a-8b1b-ac99750c8226 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Acquiring lock "c5f020440b64e6c7c652455c70efc38e975fe977" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:52:12 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-2a98431e-c795-4e2a-8b1b-ac99750c8226 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "c5f020440b64e6c7c652455c70efc38e975fe977" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:52:12 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-2a98431e-c795-4e2a-8b1b-ac99750c8226 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c5f020440b64e6c7c652455c70efc38e975fe977 --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:52:12 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-2a98431e-c795-4e2a-8b1b-ac99750c8226 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c5f020440b64e6c7c652455c70efc38e975fe977 --force-share --output=json" returned: 0 in 0.130s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:52:12 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-2a98431e-c795-4e2a-8b1b-ac99750c8226 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c5f020440b64e6c7c652455c70efc38e975fe977,backing_fmt=raw /opt/stack/data/nova/instances/6cae9f61-763f-4671-a873-d15f01384416/disk.rescue {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:52:12 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-2a98431e-c795-4e2a-8b1b-ac99750c8226 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c5f020440b64e6c7c652455c70efc38e975fe977,backing_fmt=raw /opt/stack/data/nova/instances/6cae9f61-763f-4671-a873-d15f01384416/disk.rescue" returned: 0 in 0.047s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:52:12 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-2a98431e-c795-4e2a-8b1b-ac99750c8226 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "c5f020440b64e6c7c652455c70efc38e975fe977" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.182s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:52:12 user nova-compute[71509]: DEBUG nova.objects.instance [None req-2a98431e-c795-4e2a-8b1b-ac99750c8226 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lazy-loading 'migration_context' on Instance uuid 6cae9f61-763f-4671-a873-d15f01384416 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:52:12 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-2a98431e-c795-4e2a-8b1b-ac99750c8226 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: 6cae9f61-763f-4671-a873-d15f01384416] Created local disks {{(pid=71509) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 10:52:12 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-2a98431e-c795-4e2a-8b1b-ac99750c8226 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: 6cae9f61-763f-4671-a873-d15f01384416] Start _get_guest_xml network_info=[{"id": "30d57100-3321-41fe-9335-d53c8c5e291c", "address": "fa:16:3e:57:7d:4b", "network": {"id": "07f1f39e-292a-4e73-b4ed-99e5799d6fa8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1339551596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1339551596-network", "vif_mac": "fa:16:3e:57:7d:4b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71289f80a05141f482cb538dac3d7b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30d57100-33", "ovs_interfaceid": "30d57100-3321-41fe-9335-d53c8c5e291c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T10:38:55Z,direct_url=<?>,disk_format='qcow2',id=048ec0ee-0465-448d-8b4c-f072acb101dc,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='9742d6ad20cf48d9bab0fdbcc9491db9',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T10:38:57Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '92413760-9bf6-4794-85ee-4450e5351a44', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'attachment_id': 'a3b176db-d7c9-482c-af93-711eea02e4dd', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BvhFzdPu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '6cae9f61-763f-4671-a873-d15f01384416', 'attached_at': '', 'detached_at': '', 'volume_id': '00c6dcaa-8222-45d7-a3a2-c110834bd178', 'serial': '00c6dcaa-8222-45d7-a3a2-c110834bd178'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'volume_type': None} {{(pid=71509) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 10:52:12 user nova-compute[71509]: DEBUG nova.objects.instance [None req-2a98431e-c795-4e2a-8b1b-ac99750c8226 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lazy-loading 'resources' on Instance uuid 6cae9f61-763f-4671-a873-d15f01384416 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:52:12 user nova-compute[71509]: DEBUG nova.objects.instance [None req-2a98431e-c795-4e2a-8b1b-ac99750c8226 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lazy-loading 'numa_topology' on Instance uuid 6cae9f61-763f-4671-a873-d15f01384416 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:52:12 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-2a98431e-c795-4e2a-8b1b-ac99750c8226 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:52:12 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-2a98431e-c795-4e2a-8b1b-ac99750c8226 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:52:12 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-2a98431e-c795-4e2a-8b1b-ac99750c8226 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71509) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 10:52:12 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-2a98431e-c795-4e2a-8b1b-ac99750c8226 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T10:40:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T10:38:55Z,direct_url=<?>,disk_format='qcow2',id=048ec0ee-0465-448d-8b4c-f072acb101dc,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='9742d6ad20cf48d9bab0fdbcc9491db9',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T10:38:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 10:52:12 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-2a98431e-c795-4e2a-8b1b-ac99750c8226 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Flavor limits 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 10:52:12 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-2a98431e-c795-4e2a-8b1b-ac99750c8226 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Image limits 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 10:52:12 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-2a98431e-c795-4e2a-8b1b-ac99750c8226 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Flavor pref 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 10:52:12 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-2a98431e-c795-4e2a-8b1b-ac99750c8226 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Image pref 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 10:52:12 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-2a98431e-c795-4e2a-8b1b-ac99750c8226 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 10:52:12 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-2a98431e-c795-4e2a-8b1b-ac99750c8226 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 10:52:12 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-2a98431e-c795-4e2a-8b1b-ac99750c8226 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71509) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 10:52:12 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-2a98431e-c795-4e2a-8b1b-ac99750c8226 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Got 1 possible topologies {{(pid=71509) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 10:52:12 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-2a98431e-c795-4e2a-8b1b-ac99750c8226 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 10:52:12 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-2a98431e-c795-4e2a-8b1b-ac99750c8226 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 10:52:12 user nova-compute[71509]: DEBUG nova.objects.instance [None req-2a98431e-c795-4e2a-8b1b-ac99750c8226 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6cae9f61-763f-4671-a873-d15f01384416 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:52:12 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a98431e-c795-4e2a-8b1b-ac99750c8226 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: 6cae9f61-763f-4671-a873-d15f01384416] Calling os-brick to attach iSCSI Volume {{(pid=71509) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 10:52:12 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a98431e-c795-4e2a-8b1b-ac99750c8226 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0bf0749390>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BvhFzdPu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 10:52:12 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-2a98431e-c795-4e2a-8b1b-ac99750c8226 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 10:52:12 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-2a98431e-c795-4e2a-8b1b-ac99750c8226 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 10:52:12 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-2a98431e-c795-4e2a-8b1b-ac99750c8226 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 10:52:12 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-2a98431e-c795-4e2a-8b1b-ac99750c8226 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 10:52:12 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-2a98431e-c795-4e2a-8b1b-ac99750c8226 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 10:52:12 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-2a98431e-c795-4e2a-8b1b-ac99750c8226 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 10:52:12 user nova-compute[71509]: INFO os_brick.initiator.connectors.iscsi [None req-2a98431e-c795-4e2a-8b1b-ac99750c8226 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 10:52:12 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 -p 172.16.0.220:3260 {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:52:12 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:52:12 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[751a8041-a521-4d4e-b40f-8423e8455072]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = BvhFzdPu\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:52:12 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a98431e-c795-4e2a-8b1b-ac99750c8226 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Apr 14 10:52:12 user nova-compute[71509]: node.name = iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178
Apr 14 10:52:12 user nova-compute[71509]: node.tpgt = -1
Apr 14 10:52:12 user nova-compute[71509]: node.startup = automatic
Apr 14 10:52:12 user nova-compute[71509]: node.leading_login = No
Apr 14 10:52:12 user nova-compute[71509]: iface.iscsi_ifacename = default
Apr 14 10:52:12 user nova-compute[71509]: iface.net_ifacename = <empty>
Apr 14 10:52:12 user nova-compute[71509]: iface.ipaddress = <empty>
Apr 14 10:52:12 user nova-compute[71509]: iface.prefix_len = 0
Apr 14 10:52:12 user nova-compute[71509]: iface.hwaddress = <empty>
Apr 14 10:52:12 user nova-compute[71509]: iface.transport_name = tcp
Apr 14 10:52:12 user nova-compute[71509]: iface.initiatorname = <empty>
Apr 14 10:52:12 user nova-compute[71509]: iface.state = <empty>
Apr 14 10:52:12 user nova-compute[71509]: iface.vlan_id = 0
Apr 14 10:52:12 user nova-compute[71509]: iface.vlan_priority = 0
Apr 14 10:52:12 user nova-compute[71509]: iface.vlan_state = <empty>
Apr 14 10:52:12 user nova-compute[71509]: iface.iface_num = 0
Apr 14 10:52:12 user nova-compute[71509]: iface.mtu = 0
Apr 14 10:52:12 user nova-compute[71509]: iface.port = 0
Apr 14 10:52:12 user nova-compute[71509]: iface.bootproto = <empty>
Apr 14 10:52:12 user nova-compute[71509]: iface.subnet_mask = <empty>
Apr 14 10:52:12 user nova-compute[71509]: iface.gateway = <empty>
Apr 14 10:52:12 user nova-compute[71509]: iface.dhcp_alt_client_id_state = <empty>
Apr 14 10:52:12 user nova-compute[71509]: iface.dhcp_alt_client_id = <empty>
Apr 14 10:52:12 user nova-compute[71509]: iface.dhcp_dns = <empty>
Apr 14 10:52:12 user nova-compute[71509]: iface.dhcp_learn_iqn = <empty>
Apr 14 10:52:12 user nova-compute[71509]: iface.dhcp_req_vendor_id_state = <empty>
Apr 14 10:52:12 user nova-compute[71509]: iface.dhcp_vendor_id_state = <empty>
Apr 14 10:52:12 user nova-compute[71509]: iface.dhcp_vendor_id = <empty>
Apr 14 10:52:12 user nova-compute[71509]: iface.dhcp_slp_da = <empty>
Apr 14 10:52:12 user nova-compute[71509]: iface.fragmentation = <empty>
Apr 14 10:52:12 user nova-compute[71509]: iface.gratuitous_arp = <empty>
Apr 14 10:52:12 user nova-compute[71509]: iface.incoming_forwarding = <empty>
Apr 14 10:52:12 user nova-compute[71509]: iface.tos_state = <empty>
Apr 14 10:52:12 user nova-compute[71509]: iface.tos = 0
Apr 14 10:52:12 user nova-compute[71509]: iface.ttl = 0
Apr 14 10:52:12 user nova-compute[71509]: iface.delayed_ack = <empty>
Apr 14 10:52:12 user nova-compute[71509]: iface.tcp_nagle = <empty>
Apr 14 10:52:12 user nova-compute[71509]: iface.tcp_wsf_state = <empty>
Apr 14 10:52:12 user nova-compute[71509]: iface.tcp_wsf = 0
Apr 14 10:52:12 user nova-compute[71509]: iface.tcp_timer_scale = 0
Apr 14 10:52:12 user nova-compute[71509]: iface.tcp_timestamp = <empty>
Apr 14 10:52:12 user nova-compute[71509]: iface.redirect = <empty>
Apr 14 10:52:12 user nova-compute[71509]: iface.def_task_mgmt_timeout = 0
Apr 14 10:52:12 user nova-compute[71509]: iface.header_digest = <empty>
Apr 14 10:52:12 user nova-compute[71509]: iface.data_digest = <empty>
Apr 14 10:52:12 user nova-compute[71509]: iface.immediate_data = <empty>
Apr 14 10:52:12 user nova-compute[71509]: iface.initial_r2t = <empty>
Apr 14 10:52:12 user nova-compute[71509]: iface.data_seq_inorder = <empty>
Apr 14 10:52:12 user nova-compute[71509]: iface.data_pdu_inorder = <empty>
Apr 14 10:52:12 user nova-compute[71509]: iface.erl = 0
Apr 14 10:52:12 user nova-compute[71509]: iface.max_receive_data_len = 0
Apr 14 10:52:12 user nova-compute[71509]: iface.first_burst_len = 0
Apr 14 10:52:12 user nova-compute[71509]: iface.max_outstanding_r2t = 0
Apr 14 10:52:12 user nova-compute[71509]: iface.max_burst_len = 0
Apr 14 10:52:12 user nova-compute[71509]: iface.chap_auth = <empty>
Apr 14 10:52:12 user nova-compute[71509]: iface.bidi_chap = <empty>
Apr 14 10:52:12 user nova-compute[71509]: iface.strict_login_compliance = <empty>
Apr 14 10:52:12 user nova-compute[71509]: iface.discovery_auth = <empty>
Apr 14 10:52:12 user nova-compute[71509]: iface.discovery_logout = <empty>
Apr 14 10:52:12 user nova-compute[71509]: node.discovery_address = <empty>
Apr 14 10:52:12 user nova-compute[71509]: node.discovery_port = 0
Apr 14 10:52:12 user nova-compute[71509]: node.discovery_type = static
Apr 14 10:52:12 user nova-compute[71509]: node.session.initial_cmdsn = 0
Apr 14 10:52:12 user nova-compute[71509]: node.session.initial_login_retry_max = 8
Apr 14 10:52:12 user nova-compute[71509]: node.session.xmit_thread_priority = -20
Apr 14 10:52:12 user nova-compute[71509]: node.session.cmds_max = 128
Apr 14 10:52:12 user nova-compute[71509]: node.session.queue_depth = 32
Apr 14 10:52:12 user nova-compute[71509]: node.session.nr_sessions = 1
Apr 14 10:52:12 user nova-compute[71509]: node.session.auth.authmethod = CHAP
Apr 14 10:52:12 user nova-compute[71509]: node.session.auth.username = BvhFzdPu
Apr 14 10:52:12 user nova-compute[71509]: node.session.auth.password = ***
Apr 14 10:52:12 user nova-compute[71509]: node.session.auth.username_in = <empty>
Apr 14 10:52:12 user nova-compute[71509]: node.session.auth.password_in = <empty>
Apr 14 10:52:12 user nova-compute[71509]: node.session.auth.chap_algs = MD5
Apr 14 10:52:12 user nova-compute[71509]: node.session.timeo.replacement_timeout = 120
Apr 14 10:52:12 user nova-compute[71509]: node.session.err_timeo.abort_timeout = 15
Apr 14 10:52:12 user nova-compute[71509]: node.session.err_timeo.lu_reset_timeout = 30
Apr 14 10:52:12 user nova-compute[71509]: node.session.err_timeo.tgt_reset_timeout = 30
Apr 14 10:52:12 user nova-compute[71509]: node.session.err_timeo.host_reset_timeout = 60
Apr 14 10:52:12 user nova-compute[71509]: node.session.iscsi.FastAbort = Yes
Apr 14 10:52:12 user nova-compute[71509]: node.session.iscsi.InitialR2T = No
Apr 14 10:52:12 user nova-compute[71509]: node.session.iscsi.ImmediateData = Yes
Apr 14 10:52:12 user nova-compute[71509]: node.session.iscsi.FirstBurstLength = 262144
Apr 14 10:52:12 user nova-compute[71509]: node.session.iscsi.MaxBurstLength = 16776192
Apr 14 10:52:12 user nova-compute[71509]: node.session.iscsi.DefaultTime2Retain = 0
Apr 14 10:52:12 user nova-compute[71509]: node.session.iscsi.DefaultTime2Wait = 2
Apr 14 10:52:12 user nova-compute[71509]: node.session.iscsi.MaxConnections = 1
Apr 14 10:52:12 user nova-compute[71509]: node.session.iscsi.MaxOutstandingR2T = 1
Apr 14 10:52:12 user nova-compute[71509]: node.session.iscsi.ERL = 0
Apr 14 10:52:12 user nova-compute[71509]: node.session.scan = manual
Apr 14 10:52:12 user nova-compute[71509]: node.session.reopen_max = 0
Apr 14 10:52:12 user nova-compute[71509]: node.conn[0].address = 172.16.0.220
Apr 14 10:52:12 user nova-compute[71509]: node.conn[0].port = 3260
Apr 14 10:52:12 user nova-compute[71509]: node.conn[0].startup = manual
Apr 14 10:52:12 user nova-compute[71509]: node.conn[0].tcp.window_size = 524288
Apr 14 10:52:12 user nova-compute[71509]: node.conn[0].tcp.type_of_service = 0
Apr 14 10:52:12 user nova-compute[71509]: node.conn[0].timeo.logout_timeout = 15
Apr 14 10:52:12 user nova-compute[71509]: node.conn[0].timeo.login_timeout = 15
Apr 14 10:52:12 user nova-compute[71509]: node.conn[0].timeo.auth_timeout = 45
Apr 14 10:52:12 user nova-compute[71509]: node.conn[0].timeo.noop_out_interval = 5
Apr 14 10:52:12 user nova-compute[71509]: node.conn[0].timeo.noop_out_timeout = 5
Apr 14 10:52:12 user nova-compute[71509]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Apr 14 10:52:12 user nova-compute[71509]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Apr 14 10:52:12 user nova-compute[71509]: node.conn[0].iscsi.HeaderDigest = None
Apr 14 10:52:12 user nova-compute[71509]: node.conn[0].iscsi.DataDigest = None
Apr 14 10:52:12 user nova-compute[71509]: node.conn[0].iscsi.IFMarker = No
Apr 14 10:52:12 user nova-compute[71509]: node.conn[0].iscsi.OFMarker = No
Apr 14 10:52:12 user nova-compute[71509]: # END RECORD
Apr 14 10:52:12 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:52:12 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:52:12 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:52:12 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eb7cf45-faf5-4f8c-9de2-f38993dd45ba]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:52:12 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a98431e-c795-4e2a-8b1b-ac99750c8226 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:52:12 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:52:12 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:52:12 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[c79d8253-5c28-403d-bcfd-d7b32a14545c]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:52:12 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a98431e-c795-4e2a-8b1b-ac99750c8226 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:52:12 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BvhFzdPu {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:52:12 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BvhFzdPu" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:52:12 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[501a84dd-2495-47f1-9343-6c6aa2483f87]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:52:12 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a98431e-c795-4e2a-8b1b-ac99750c8226 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BvhFzdPu'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:52:12 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:52:12 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:52:12 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[62af0782-cfed-4e9b-b4e6-659f298f234e]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:52:12 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a98431e-c795-4e2a-8b1b-ac99750c8226 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:52:12 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:52:12 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:52:12 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b0ac800-aa97-4b7a-bb55-85cfc223890e]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:52:12 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a98431e-c795-4e2a-8b1b-ac99750c8226 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)
Apr 14 10:52:12 user nova-compute[71509]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2 (non-flash)
Apr 14 10:52:12 user nova-compute[71509]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe (non-flash)
Apr 14 10:52:12 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:52:12 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a98431e-c795-4e2a-8b1b-ac99750c8226 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)
Apr 14 10:52:12 user nova-compute[71509]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2 (non-flash)
Apr 14 10:52:12 user nova-compute[71509]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe (non-flash)
Apr 14 10:52:12 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 10:52:12 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-2a98431e-c795-4e2a-8b1b-ac99750c8226 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.135s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 10:52:12 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a98431e-c795-4e2a-8b1b-ac99750c8226 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Connected to 172.16.0.220:3260 {{(pid=71509) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 10:52:12 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-2a98431e-c795-4e2a-8b1b-ac99750c8226 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] HCTL ('35', '0', '0', 0) found on session 27 with lun 0 {{(pid=71509) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 10:52:12 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-2a98431e-c795-4e2a-8b1b-ac99750c8226 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=71509) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 10:52:12 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:52:12 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.013s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:52:12 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9c8ac35-0208-4959-a045-7e1f746a19e4]: (4, ('0 0 0', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:52:12 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-2a98431e-c795-4e2a-8b1b-ac99750c8226 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Searching for a device in session 27 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=71509) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 10:52:12 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a98431e-c795-4e2a-8b1b-ac99750c8226 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BvhFzdPu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71509) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 10:52:12 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-2a98431e-c795-4e2a-8b1b-ac99750c8226 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.157s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 10:52:12 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a98431e-c795-4e2a-8b1b-ac99750c8226 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] <== connect_volume: return (158ms) {'type': 'block', 'scsi_wwn': '26364363737393437', 'path': '/dev/sdd'} {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 10:52:12 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a98431e-c795-4e2a-8b1b-ac99750c8226 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: 6cae9f61-763f-4671-a873-d15f01384416] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26364363737393437', 'path': '/dev/sdd'} {{(pid=71509) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 10:52:12 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-2a98431e-c795-4e2a-8b1b-ac99750c8226 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T10:50:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-632123778',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-632123778',id=19,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T10:50:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='71289f80a05141f482cb538dac3d7b38',ramdisk_id='',reservation_id='r-07afy9z0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2130542140',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T10:50:36Z,user_data=None,user_id='395bc9d7007c4e01ac7effd418bcea19',uuid=6cae9f61-763f-4671-a873-d15f01384416,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "30d57100-3321-41fe-9335-d53c8c5e291c", "address": "fa:16:3e:57:7d:4b", "network": {"id": "07f1f39e-292a-4e73-b4ed-99e5799d6fa8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1339551596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1339551596-network", "vif_mac": "fa:16:3e:57:7d:4b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71289f80a05141f482cb538dac3d7b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30d57100-33", "ovs_interfaceid": "30d57100-3321-41fe-9335-d53c8c5e291c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71509) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 10:52:12 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-2a98431e-c795-4e2a-8b1b-ac99750c8226 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Converting VIF {"id": "30d57100-3321-41fe-9335-d53c8c5e291c", "address": "fa:16:3e:57:7d:4b", "network": {"id": "07f1f39e-292a-4e73-b4ed-99e5799d6fa8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1339551596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1339551596-network", "vif_mac": "fa:16:3e:57:7d:4b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71289f80a05141f482cb538dac3d7b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30d57100-33", "ovs_interfaceid": "30d57100-3321-41fe-9335-d53c8c5e291c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:52:12 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-2a98431e-c795-4e2a-8b1b-ac99750c8226 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:57:7d:4b,bridge_name='br-int',has_traffic_filtering=True,id=30d57100-3321-41fe-9335-d53c8c5e291c,network=Network(07f1f39e-292a-4e73-b4ed-99e5799d6fa8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30d57100-33') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:52:12 user nova-compute[71509]: DEBUG nova.objects.instance [None req-2a98431e-c795-4e2a-8b1b-ac99750c8226 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lazy-loading 'pci_devices' on Instance uuid 6cae9f61-763f-4671-a873-d15f01384416 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:52:12 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-2a98431e-c795-4e2a-8b1b-ac99750c8226 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: 6cae9f61-763f-4671-a873-d15f01384416] End _get_guest_xml xml=<domain type="kvm">
Apr 14 10:52:12 user nova-compute[71509]:   <uuid>6cae9f61-763f-4671-a873-d15f01384416</uuid>
Apr 14 10:52:12 user nova-compute[71509]:   <name>instance-00000013</name>
Apr 14 10:52:12 user nova-compute[71509]:   <memory>131072</memory>
Apr 14 10:52:12 user nova-compute[71509]:   <vcpu>1</vcpu>
Apr 14 10:52:12 user nova-compute[71509]:   <metadata>
Apr 14 10:52:12 user nova-compute[71509]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 10:52:12 user nova-compute[71509]:       <nova:package version="0.0.0"/>
Apr 14 10:52:12 user nova-compute[71509]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-632123778</nova:name>
Apr 14 10:52:12 user nova-compute[71509]:       <nova:creationTime>2023-04-14 10:52:12</nova:creationTime>
Apr 14 10:52:12 user nova-compute[71509]:       <nova:flavor name="m1.nano">
Apr 14 10:52:12 user nova-compute[71509]:         <nova:memory>128</nova:memory>
Apr 14 10:52:12 user nova-compute[71509]:         <nova:disk>1</nova:disk>
Apr 14 10:52:12 user nova-compute[71509]:         <nova:swap>0</nova:swap>
Apr 14 10:52:12 user nova-compute[71509]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 10:52:12 user nova-compute[71509]:         <nova:vcpus>1</nova:vcpus>
Apr 14 10:52:12 user nova-compute[71509]:       </nova:flavor>
Apr 14 10:52:12 user nova-compute[71509]:       <nova:owner>
Apr 14 10:52:12 user nova-compute[71509]:         <nova:user uuid="395bc9d7007c4e01ac7effd418bcea19">tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member</nova:user>
Apr 14 10:52:12 user nova-compute[71509]:         <nova:project uuid="71289f80a05141f482cb538dac3d7b38">tempest-ServerBootFromVolumeStableRescueTest-2130542140</nova:project>
Apr 14 10:52:12 user nova-compute[71509]:       </nova:owner>
Apr 14 10:52:12 user nova-compute[71509]:       <nova:root type="image" uuid="048ec0ee-0465-448d-8b4c-f072acb101dc"/>
Apr 14 10:52:12 user nova-compute[71509]:       <nova:ports>
Apr 14 10:52:12 user nova-compute[71509]:         <nova:port uuid="30d57100-3321-41fe-9335-d53c8c5e291c">
Apr 14 10:52:12 user nova-compute[71509]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 14 10:52:12 user nova-compute[71509]:         </nova:port>
Apr 14 10:52:12 user nova-compute[71509]:       </nova:ports>
Apr 14 10:52:12 user nova-compute[71509]:     </nova:instance>
Apr 14 10:52:12 user nova-compute[71509]:   </metadata>
Apr 14 10:52:12 user nova-compute[71509]:   <sysinfo type="smbios">
Apr 14 10:52:12 user nova-compute[71509]:     <system>
Apr 14 10:52:12 user nova-compute[71509]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 10:52:12 user nova-compute[71509]:       <entry name="product">OpenStack Nova</entry>
Apr 14 10:52:12 user nova-compute[71509]:       <entry name="version">0.0.0</entry>
Apr 14 10:52:12 user nova-compute[71509]:       <entry name="serial">6cae9f61-763f-4671-a873-d15f01384416</entry>
Apr 14 10:52:12 user nova-compute[71509]:       <entry name="uuid">6cae9f61-763f-4671-a873-d15f01384416</entry>
Apr 14 10:52:12 user nova-compute[71509]:       <entry name="family">Virtual Machine</entry>
Apr 14 10:52:12 user nova-compute[71509]:     </system>
Apr 14 10:52:12 user nova-compute[71509]:   </sysinfo>
Apr 14 10:52:12 user nova-compute[71509]:   <os>
Apr 14 10:52:12 user nova-compute[71509]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 10:52:12 user nova-compute[71509]:     <smbios mode="sysinfo"/>
Apr 14 10:52:12 user nova-compute[71509]:   </os>
Apr 14 10:52:12 user nova-compute[71509]:   <features>
Apr 14 10:52:12 user nova-compute[71509]:     <acpi/>
Apr 14 10:52:12 user nova-compute[71509]:     <apic/>
Apr 14 10:52:12 user nova-compute[71509]:     <vmcoreinfo/>
Apr 14 10:52:12 user nova-compute[71509]:   </features>
Apr 14 10:52:12 user nova-compute[71509]:   <clock offset="utc">
Apr 14 10:52:12 user nova-compute[71509]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 10:52:12 user nova-compute[71509]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 10:52:12 user nova-compute[71509]:     <timer name="hpet" present="no"/>
Apr 14 10:52:12 user nova-compute[71509]:   </clock>
Apr 14 10:52:12 user nova-compute[71509]:   <cpu mode="custom" match="exact">
Apr 14 10:52:12 user nova-compute[71509]:     <model>Nehalem</model>
Apr 14 10:52:12 user nova-compute[71509]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 10:52:12 user nova-compute[71509]:   </cpu>
Apr 14 10:52:12 user nova-compute[71509]:   <devices>
Apr 14 10:52:12 user nova-compute[71509]:     <disk type="block" device="disk">
Apr 14 10:52:12 user nova-compute[71509]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 10:52:12 user nova-compute[71509]:       <source dev="/dev/sdd"/>
Apr 14 10:52:12 user nova-compute[71509]:       <target dev="vda" bus="virtio"/>
Apr 14 10:52:12 user nova-compute[71509]:       <serial>00c6dcaa-8222-45d7-a3a2-c110834bd178</serial>
Apr 14 10:52:12 user nova-compute[71509]:     </disk>
Apr 14 10:52:12 user nova-compute[71509]:     <disk type="file" device="disk">
Apr 14 10:52:12 user nova-compute[71509]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 10:52:12 user nova-compute[71509]:       <source file="/opt/stack/data/nova/instances/6cae9f61-763f-4671-a873-d15f01384416/disk.rescue"/>
Apr 14 10:52:12 user nova-compute[71509]:       <target dev="vdb" bus="virtio"/>
Apr 14 10:52:12 user nova-compute[71509]:       <boot order="1"/>
Apr 14 10:52:12 user nova-compute[71509]:     </disk>
Apr 14 10:52:12 user nova-compute[71509]:     <interface type="ethernet">
Apr 14 10:52:12 user nova-compute[71509]:       <mac address="fa:16:3e:57:7d:4b"/>
Apr 14 10:52:12 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 10:52:12 user nova-compute[71509]:       <mtu size="1442"/>
Apr 14 10:52:12 user nova-compute[71509]:       <target dev="tap30d57100-33"/>
Apr 14 10:52:12 user nova-compute[71509]:     </interface>
Apr 14 10:52:12 user nova-compute[71509]:     <serial type="pty">
Apr 14 10:52:12 user nova-compute[71509]:       <log file="/opt/stack/data/nova/instances/6cae9f61-763f-4671-a873-d15f01384416/console.log" append="off"/>
Apr 14 10:52:12 user nova-compute[71509]:     </serial>
Apr 14 10:52:12 user nova-compute[71509]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 10:52:12 user nova-compute[71509]:     <video>
Apr 14 10:52:12 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 10:52:12 user nova-compute[71509]:     </video>
Apr 14 10:52:12 user nova-compute[71509]:     <rng model="virtio">
Apr 14 10:52:12 user nova-compute[71509]:       <backend model="random">/dev/urandom</backend>
Apr 14 10:52:12 user nova-compute[71509]:     </rng>
Apr 14 10:52:12 user nova-compute[71509]:     <controller type="usb" index="0" model="none"/>
Apr 14 10:52:12 user nova-compute[71509]:     <memballoon model="virtio">
Apr 14 10:52:12 user nova-compute[71509]:       <stats period="10"/>
Apr 14 10:52:12 user nova-compute[71509]:     </memballoon>
Apr 14 10:52:12 user nova-compute[71509]:   </devices>
Apr 14 10:52:12 user nova-compute[71509]: </domain>
Apr 14 10:52:12 user nova-compute[71509]:  {{(pid=71509) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 10:52:12 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: 6cae9f61-763f-4671-a873-d15f01384416] Instance destroyed successfully.
Apr 14 10:52:12 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-2a98431e-c795-4e2a-8b1b-ac99750c8226 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] No BDM found with device name vda, not building metadata. {{(pid=71509) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 10:52:12 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-2a98431e-c795-4e2a-8b1b-ac99750c8226 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71509) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 10:52:12 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-2a98431e-c795-4e2a-8b1b-ac99750c8226 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] No VIF found with MAC fa:16:3e:57:7d:4b, not building metadata {{(pid=71509) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 10:52:12 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:52:14 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:52:14 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:52:14 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:52:14 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:52:14 user nova-compute[71509]: DEBUG nova.compute.manager [req-9d82f10f-b3cd-4f1e-aa1a-724deeefcaf7 req-80232b9a-cb77-49a6-a104-f64ff6909904 service nova] [instance: 6cae9f61-763f-4671-a873-d15f01384416] Received event network-vif-plugged-30d57100-3321-41fe-9335-d53c8c5e291c {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:52:14 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-9d82f10f-b3cd-4f1e-aa1a-724deeefcaf7 req-80232b9a-cb77-49a6-a104-f64ff6909904 service nova] Acquiring lock "6cae9f61-763f-4671-a873-d15f01384416-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:52:14 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-9d82f10f-b3cd-4f1e-aa1a-724deeefcaf7 req-80232b9a-cb77-49a6-a104-f64ff6909904 service nova] Lock "6cae9f61-763f-4671-a873-d15f01384416-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:52:14 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-9d82f10f-b3cd-4f1e-aa1a-724deeefcaf7 req-80232b9a-cb77-49a6-a104-f64ff6909904 service nova] Lock "6cae9f61-763f-4671-a873-d15f01384416-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:52:14 user nova-compute[71509]: DEBUG nova.compute.manager [req-9d82f10f-b3cd-4f1e-aa1a-724deeefcaf7 req-80232b9a-cb77-49a6-a104-f64ff6909904 service nova] [instance: 6cae9f61-763f-4671-a873-d15f01384416] No waiting events found dispatching network-vif-plugged-30d57100-3321-41fe-9335-d53c8c5e291c {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:52:14 user nova-compute[71509]: WARNING nova.compute.manager [req-9d82f10f-b3cd-4f1e-aa1a-724deeefcaf7 req-80232b9a-cb77-49a6-a104-f64ff6909904 service nova] [instance: 6cae9f61-763f-4671-a873-d15f01384416] Received unexpected event network-vif-plugged-30d57100-3321-41fe-9335-d53c8c5e291c for instance with vm_state active and task_state rescuing.
Apr 14 10:52:14 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:52:14 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:52:14 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:52:16 user nova-compute[71509]: DEBUG nova.virt.libvirt.host [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Removed pending event for 6cae9f61-763f-4671-a873-d15f01384416 due to event {{(pid=71509) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 10:52:16 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681469536.4668436, 6cae9f61-763f-4671-a873-d15f01384416 => Resumed> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 10:52:16 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 6cae9f61-763f-4671-a873-d15f01384416] VM Resumed (Lifecycle Event)
Apr 14 10:52:16 user nova-compute[71509]: DEBUG nova.compute.manager [None req-2a98431e-c795-4e2a-8b1b-ac99750c8226 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: 6cae9f61-763f-4671-a873-d15f01384416] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:52:16 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 6cae9f61-763f-4671-a873-d15f01384416] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:52:16 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 6cae9f61-763f-4671-a873-d15f01384416] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 10:52:16 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 6cae9f61-763f-4671-a873-d15f01384416] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 14 10:52:16 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681469536.4712787, 6cae9f61-763f-4671-a873-d15f01384416 => Started> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 10:52:16 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 6cae9f61-763f-4671-a873-d15f01384416] VM Started (Lifecycle Event)
Apr 14 10:52:16 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 6cae9f61-763f-4671-a873-d15f01384416] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:52:16 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 6cae9f61-763f-4671-a873-d15f01384416] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 10:52:16 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 6cae9f61-763f-4671-a873-d15f01384416] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 14 10:52:16 user nova-compute[71509]: DEBUG nova.compute.manager [req-a01497ec-8031-40a9-b30a-81d162723f61 req-8fb6633b-9ea6-48ae-89db-a23756b12e7c service nova] [instance: 6cae9f61-763f-4671-a873-d15f01384416] Received event network-vif-plugged-30d57100-3321-41fe-9335-d53c8c5e291c {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:52:16 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-a01497ec-8031-40a9-b30a-81d162723f61 req-8fb6633b-9ea6-48ae-89db-a23756b12e7c service nova] Acquiring lock "6cae9f61-763f-4671-a873-d15f01384416-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:52:16 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-a01497ec-8031-40a9-b30a-81d162723f61 req-8fb6633b-9ea6-48ae-89db-a23756b12e7c service nova] Lock "6cae9f61-763f-4671-a873-d15f01384416-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:52:16 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-a01497ec-8031-40a9-b30a-81d162723f61 req-8fb6633b-9ea6-48ae-89db-a23756b12e7c service nova] Lock "6cae9f61-763f-4671-a873-d15f01384416-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:52:16 user nova-compute[71509]: DEBUG nova.compute.manager [req-a01497ec-8031-40a9-b30a-81d162723f61 req-8fb6633b-9ea6-48ae-89db-a23756b12e7c service nova] [instance: 6cae9f61-763f-4671-a873-d15f01384416] No waiting events found dispatching network-vif-plugged-30d57100-3321-41fe-9335-d53c8c5e291c {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:52:16 user nova-compute[71509]: WARNING nova.compute.manager [req-a01497ec-8031-40a9-b30a-81d162723f61 req-8fb6633b-9ea6-48ae-89db-a23756b12e7c service nova] [instance: 6cae9f61-763f-4671-a873-d15f01384416] Received unexpected event network-vif-plugged-30d57100-3321-41fe-9335-d53c8c5e291c for instance with vm_state active and task_state rescuing.
Apr 14 10:52:17 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:52:19 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:52:22 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:52:24 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:52:25 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-50147ed8-ef7d-497a-8faa-cb2aaf908ae7 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Acquiring lock "4b767f1b-e97e-497c-8c70-8806203c76ae" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:52:25 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-50147ed8-ef7d-497a-8faa-cb2aaf908ae7 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "4b767f1b-e97e-497c-8c70-8806203c76ae" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:52:25 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-50147ed8-ef7d-497a-8faa-cb2aaf908ae7 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Acquiring lock "4b767f1b-e97e-497c-8c70-8806203c76ae-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:52:25 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-50147ed8-ef7d-497a-8faa-cb2aaf908ae7 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "4b767f1b-e97e-497c-8c70-8806203c76ae-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:52:25 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-50147ed8-ef7d-497a-8faa-cb2aaf908ae7 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "4b767f1b-e97e-497c-8c70-8806203c76ae-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:52:25 user nova-compute[71509]: INFO nova.compute.manager [None req-50147ed8-ef7d-497a-8faa-cb2aaf908ae7 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Terminating instance
Apr 14 10:52:25 user nova-compute[71509]: DEBUG nova.compute.manager [None req-50147ed8-ef7d-497a-8faa-cb2aaf908ae7 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Start destroying the instance on the hypervisor. {{(pid=71509) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 10:52:25 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:52:25 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:52:25 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:52:25 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:52:25 user nova-compute[71509]: DEBUG nova.compute.manager [req-da591ad2-4c24-4681-9a70-29692a3ad004 req-44169b14-2507-4369-ac35-f5549a5ef7de service nova] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Received event network-vif-unplugged-8d8a356d-c198-4e13-a489-5c626fbd025c {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:52:25 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-da591ad2-4c24-4681-9a70-29692a3ad004 req-44169b14-2507-4369-ac35-f5549a5ef7de service nova] Acquiring lock "4b767f1b-e97e-497c-8c70-8806203c76ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:52:25 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-da591ad2-4c24-4681-9a70-29692a3ad004 req-44169b14-2507-4369-ac35-f5549a5ef7de service nova] Lock "4b767f1b-e97e-497c-8c70-8806203c76ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:52:25 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-da591ad2-4c24-4681-9a70-29692a3ad004 req-44169b14-2507-4369-ac35-f5549a5ef7de service nova] Lock "4b767f1b-e97e-497c-8c70-8806203c76ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:52:25 user nova-compute[71509]: DEBUG nova.compute.manager [req-da591ad2-4c24-4681-9a70-29692a3ad004 req-44169b14-2507-4369-ac35-f5549a5ef7de service nova] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] No waiting events found dispatching network-vif-unplugged-8d8a356d-c198-4e13-a489-5c626fbd025c {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:52:25 user nova-compute[71509]: DEBUG nova.compute.manager [req-da591ad2-4c24-4681-9a70-29692a3ad004 req-44169b14-2507-4369-ac35-f5549a5ef7de service nova] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Received event network-vif-unplugged-8d8a356d-c198-4e13-a489-5c626fbd025c for instance with task_state deleting. {{(pid=71509) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 10:52:26 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:52:26 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Instance destroyed successfully.
Apr 14 10:52:26 user nova-compute[71509]: DEBUG nova.objects.instance [None req-50147ed8-ef7d-497a-8faa-cb2aaf908ae7 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lazy-loading 'resources' on Instance uuid 4b767f1b-e97e-497c-8c70-8806203c76ae {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:52:26 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-50147ed8-ef7d-497a-8faa-cb2aaf908ae7 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T10:45:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1779641770',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1779641770',id=14,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ+BJG2hs5u25cAKxVjcO06DHIw9v85rt9ybRTOcJ5Z2J6Lwyi75EbIt/XGY4FaiJAg302gOYYve73U7hVGmBbLP+TE/GpIu0YYFEbftUPUQVwIX7wT/hvM2WJymZnJdhQ==',key_name='tempest-keypair-1533515584',keypairs=<?>,launch_index=0,launched_at=2023-04-14T10:50:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f8a9941095d445f48d70df26d8c90e6c',ramdisk_id='',reservation_id='r-8ce8ejer',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1250068675',owner_user_name='tempest-AttachVolumeShelveTestJSON-1250068675-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T10:50:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5afd3930d3a14aff8124a4782ec79870',uuid=4b767f1b-e97e-497c-8c70-8806203c76ae,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8d8a356d-c198-4e13-a489-5c626fbd025c", "address": "fa:16:3e:c6:af:76", "network": {"id": "1cb09253-66a4-4c81-82d0-c6d948e0aed4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1557121746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8a9941095d445f48d70df26d8c90e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d8a356d-c1", "ovs_interfaceid": "8d8a356d-c198-4e13-a489-5c626fbd025c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 10:52:26 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-50147ed8-ef7d-497a-8faa-cb2aaf908ae7 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Converting VIF {"id": "8d8a356d-c198-4e13-a489-5c626fbd025c", "address": "fa:16:3e:c6:af:76", "network": {"id": "1cb09253-66a4-4c81-82d0-c6d948e0aed4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1557121746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8a9941095d445f48d70df26d8c90e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d8a356d-c1", "ovs_interfaceid": "8d8a356d-c198-4e13-a489-5c626fbd025c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:52:26 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-50147ed8-ef7d-497a-8faa-cb2aaf908ae7 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:af:76,bridge_name='br-int',has_traffic_filtering=True,id=8d8a356d-c198-4e13-a489-5c626fbd025c,network=Network(1cb09253-66a4-4c81-82d0-c6d948e0aed4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d8a356d-c1') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:52:26 user nova-compute[71509]: DEBUG os_vif [None req-50147ed8-ef7d-497a-8faa-cb2aaf908ae7 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:af:76,bridge_name='br-int',has_traffic_filtering=True,id=8d8a356d-c198-4e13-a489-5c626fbd025c,network=Network(1cb09253-66a4-4c81-82d0-c6d948e0aed4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d8a356d-c1') {{(pid=71509) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 10:52:26 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:52:26 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8d8a356d-c1, bridge=br-int, if_exists=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:52:26 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:52:26 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 10:52:26 user nova-compute[71509]: INFO os_vif [None req-50147ed8-ef7d-497a-8faa-cb2aaf908ae7 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:af:76,bridge_name='br-int',has_traffic_filtering=True,id=8d8a356d-c198-4e13-a489-5c626fbd025c,network=Network(1cb09253-66a4-4c81-82d0-c6d948e0aed4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d8a356d-c1')
Apr 14 10:52:26 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-50147ed8-ef7d-497a-8faa-cb2aaf908ae7 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Deleting instance files /opt/stack/data/nova/instances/4b767f1b-e97e-497c-8c70-8806203c76ae_del
Apr 14 10:52:26 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-50147ed8-ef7d-497a-8faa-cb2aaf908ae7 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Deletion of /opt/stack/data/nova/instances/4b767f1b-e97e-497c-8c70-8806203c76ae_del complete
Apr 14 10:52:26 user nova-compute[71509]: INFO nova.compute.manager [None req-50147ed8-ef7d-497a-8faa-cb2aaf908ae7 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Took 0.87 seconds to destroy the instance on the hypervisor.
Apr 14 10:52:26 user nova-compute[71509]: DEBUG oslo.service.loopingcall [None req-50147ed8-ef7d-497a-8faa-cb2aaf908ae7 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71509) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 10:52:26 user nova-compute[71509]: DEBUG nova.compute.manager [-] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Deallocating network for instance {{(pid=71509) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 10:52:26 user nova-compute[71509]: DEBUG nova.network.neutron [-] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] deallocate_for_instance() {{(pid=71509) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 10:52:27 user nova-compute[71509]: DEBUG nova.network.neutron [-] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Updating instance_info_cache with network_info: [] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:52:27 user nova-compute[71509]: INFO nova.compute.manager [-] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Took 0.88 seconds to deallocate network for instance.
Apr 14 10:52:27 user nova-compute[71509]: DEBUG nova.compute.manager [req-683e4ff7-24c5-4613-8e3e-2da663c2df78 req-6bea44ff-1029-4abd-b614-86e7f21bc323 service nova] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Received event network-vif-deleted-8d8a356d-c198-4e13-a489-5c626fbd025c {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:52:27 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-50147ed8-ef7d-497a-8faa-cb2aaf908ae7 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:52:27 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-50147ed8-ef7d-497a-8faa-cb2aaf908ae7 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:52:27 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-50147ed8-ef7d-497a-8faa-cb2aaf908ae7 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 10:52:27 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-50147ed8-ef7d-497a-8faa-cb2aaf908ae7 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 10:52:27 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-50147ed8-ef7d-497a-8faa-cb2aaf908ae7 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.376s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:52:27 user nova-compute[71509]: INFO nova.scheduler.client.report [None req-50147ed8-ef7d-497a-8faa-cb2aaf908ae7 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Deleted allocations for instance 4b767f1b-e97e-497c-8c70-8806203c76ae
Apr 14 10:52:27 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-50147ed8-ef7d-497a-8faa-cb2aaf908ae7 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "4b767f1b-e97e-497c-8c70-8806203c76ae" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.317s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:52:27 user nova-compute[71509]: DEBUG nova.compute.manager [req-a45eed83-3a3e-4ef2-8ba5-3f958d65712c req-0c6f0058-67f9-48b3-b7b7-3dee493ef0cc service nova] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Received event network-vif-plugged-8d8a356d-c198-4e13-a489-5c626fbd025c {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:52:27 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-a45eed83-3a3e-4ef2-8ba5-3f958d65712c req-0c6f0058-67f9-48b3-b7b7-3dee493ef0cc service nova] Acquiring lock "4b767f1b-e97e-497c-8c70-8806203c76ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:52:27 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-a45eed83-3a3e-4ef2-8ba5-3f958d65712c req-0c6f0058-67f9-48b3-b7b7-3dee493ef0cc service nova] Lock "4b767f1b-e97e-497c-8c70-8806203c76ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:52:27 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-a45eed83-3a3e-4ef2-8ba5-3f958d65712c req-0c6f0058-67f9-48b3-b7b7-3dee493ef0cc service nova] Lock "4b767f1b-e97e-497c-8c70-8806203c76ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:52:27 user nova-compute[71509]: DEBUG nova.compute.manager [req-a45eed83-3a3e-4ef2-8ba5-3f958d65712c req-0c6f0058-67f9-48b3-b7b7-3dee493ef0cc service nova] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] No waiting events found dispatching network-vif-plugged-8d8a356d-c198-4e13-a489-5c626fbd025c {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:52:27 user nova-compute[71509]: WARNING nova.compute.manager [req-a45eed83-3a3e-4ef2-8ba5-3f958d65712c req-0c6f0058-67f9-48b3-b7b7-3dee493ef0cc service nova] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Received unexpected event network-vif-plugged-8d8a356d-c198-4e13-a489-5c626fbd025c for instance with vm_state deleted and task_state None.
Apr 14 10:52:27 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:52:31 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:52:32 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:52:36 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:52:37 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:52:38 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:52:38 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:52:38 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:52:38 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:52:38 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71509) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 10:52:41 user nova-compute[71509]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681469546.3139105, 4b767f1b-e97e-497c-8c70-8806203c76ae => Stopped> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 10:52:41 user nova-compute[71509]: INFO nova.compute.manager [-] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] VM Stopped (Lifecycle Event)
Apr 14 10:52:41 user nova-compute[71509]: DEBUG nova.compute.manager [None req-04f32479-2804-49f0-9807-39752d262f1a None None] [instance: 4b767f1b-e97e-497c-8c70-8806203c76ae] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:52:41 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:52:41 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:52:41 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:52:42 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:52:42 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:52:43 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:52:43 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Starting heal instance info cache {{(pid=71509) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 10:52:43 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "refresh_cache-8586a70e-9855-4177-ac1b-cf707a4df871" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:52:43 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquired lock "refresh_cache-8586a70e-9855-4177-ac1b-cf707a4df871" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:52:43 user nova-compute[71509]: DEBUG nova.network.neutron [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Forcefully refreshing network info cache for instance {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 10:52:43 user nova-compute[71509]: DEBUG nova.network.neutron [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Updating instance_info_cache with network_info: [{"id": "473d9af8-25a0-4e5a-9afb-7a0c843115cc", "address": "fa:16:3e:b0:12:bf", "network": {"id": "653f0c81-1afd-4ca6-9639-675ead1a6127", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-932652547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb9b9fc4f2e244879502006bb844761c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap473d9af8-25", "ovs_interfaceid": "473d9af8-25a0-4e5a-9afb-7a0c843115cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:52:44 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Releasing lock "refresh_cache-8586a70e-9855-4177-ac1b-cf707a4df871" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:52:44 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Updated the network info_cache for instance {{(pid=71509) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 10:52:44 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:52:44 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:52:44 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:52:44 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:52:44 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Auditing locally available compute resources for user (node: user) {{(pid=71509) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 10:52:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97820f17-22d1-4ec3-9721-1edadccc794a/disk.rescue --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:52:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97820f17-22d1-4ec3-9721-1edadccc794a/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:52:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97820f17-22d1-4ec3-9721-1edadccc794a/disk.rescue --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:52:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97820f17-22d1-4ec3-9721-1edadccc794a/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:52:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97820f17-22d1-4ec3-9721-1edadccc794a/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:52:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97820f17-22d1-4ec3-9721-1edadccc794a/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:52:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97820f17-22d1-4ec3-9721-1edadccc794a/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:52:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97820f17-22d1-4ec3-9721-1edadccc794a/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:52:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3245b74-dbe8-4b8b-83b6-58a4811fdba9/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:52:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3245b74-dbe8-4b8b-83b6-58a4811fdba9/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:52:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3245b74-dbe8-4b8b-83b6-58a4811fdba9/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:52:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3245b74-dbe8-4b8b-83b6-58a4811fdba9/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:52:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4abb549-8f36-40c5-971f-8accbb14ff86/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:52:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4abb549-8f36-40c5-971f-8accbb14ff86/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:52:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4abb549-8f36-40c5-971f-8accbb14ff86/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:52:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4abb549-8f36-40c5-971f-8accbb14ff86/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:52:45 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71509) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 10:52:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8586a70e-9855-4177-ac1b-cf707a4df871/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:52:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8586a70e-9855-4177-ac1b-cf707a4df871/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:52:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8586a70e-9855-4177-ac1b-cf707a4df871/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:52:46 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8586a70e-9855-4177-ac1b-cf707a4df871/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:52:46 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71509) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 10:52:46 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd661ae0-c4bb-4117-847d-ef7e85d062fb/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:52:46 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd661ae0-c4bb-4117-847d-ef7e85d062fb/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:52:46 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd661ae0-c4bb-4117-847d-ef7e85d062fb/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:52:46 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:52:46 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd661ae0-c4bb-4117-847d-ef7e85d062fb/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:52:46 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:52:46 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:52:46 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:52:46 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:52:46 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e479154a-acd6-47aa-9a5b-43c6e0feda07/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:52:46 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e479154a-acd6-47aa-9a5b-43c6e0feda07/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:52:46 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e479154a-acd6-47aa-9a5b-43c6e0feda07/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:52:46 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e479154a-acd6-47aa-9a5b-43c6e0feda07/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:52:46 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:52:47 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:52:47 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:52:47 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:52:47 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71509) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 10:52:47 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cae9f61-763f-4671-a873-d15f01384416/disk.rescue --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:52:47 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cae9f61-763f-4671-a873-d15f01384416/disk.rescue --force-share --output=json" returned: 0 in 0.139s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:52:47 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cae9f61-763f-4671-a873-d15f01384416/disk.rescue --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:52:47 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cae9f61-763f-4671-a873-d15f01384416/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:52:47 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97f20661-8b60-439e-b7af-2fc2013c5ade/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:52:47 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97f20661-8b60-439e-b7af-2fc2013c5ade/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:52:47 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97f20661-8b60-439e-b7af-2fc2013c5ade/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:52:47 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97f20661-8b60-439e-b7af-2fc2013c5ade/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:52:47 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b4b6e3e-0743-4ee6-900c-3172b09eb0f2/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:52:47 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b4b6e3e-0743-4ee6-900c-3172b09eb0f2/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:52:47 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b4b6e3e-0743-4ee6-900c-3172b09eb0f2/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:52:47 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:52:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b4b6e3e-0743-4ee6-900c-3172b09eb0f2/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:52:48 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:52:48 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:52:48 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Hypervisor/Node resource view: name=user free_ram=7504MB free_disk=25.9913330078125GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71509) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 10:52:48 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:52:48 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:52:48 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Applying migration context for instance b4abb549-8f36-40c5-971f-8accbb14ff86 as it has an incoming, in-progress migration aec5f116-c76f-438a-bee3-2a98dbe64d04. Migration status is finished {{(pid=71509) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:950}}
Apr 14 10:52:48 user nova-compute[71509]: INFO nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Updating resource usage from migration aec5f116-c76f-438a-bee3-2a98dbe64d04
Apr 14 10:52:48 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 97f20661-8b60-439e-b7af-2fc2013c5ade actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:52:48 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 97820f17-22d1-4ec3-9721-1edadccc794a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:52:48 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance e479154a-acd6-47aa-9a5b-43c6e0feda07 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:52:48 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 8586a70e-9855-4177-ac1b-cf707a4df871 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:52:48 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance f3245b74-dbe8-4b8b-83b6-58a4811fdba9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:52:48 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 6cae9f61-763f-4671-a873-d15f01384416 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:52:48 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:52:48 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 3b4b6e3e-0743-4ee6-900c-3172b09eb0f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:52:48 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:52:48 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance cd661ae0-c4bb-4117-847d-ef7e85d062fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:52:48 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Migration aec5f116-c76f-438a-bee3-2a98dbe64d04 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1637}}
Apr 14 10:52:48 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance b4abb549-8f36-40c5-971f-8accbb14ff86 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:52:48 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=71509) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 10:52:48 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Final resource view: name=user phys_ram=16023MB used_ram=2112MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=71509) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 10:52:48 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 10:52:49 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 10:52:49 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Compute_service record updated for user:user {{(pid=71509) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 10:52:49 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.508s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:52:51 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:52:52 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1b441039-154c-431e-803f-88ac8f78b4b3 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Acquiring lock "3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:52:52 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1b441039-154c-431e-803f-88ac8f78b4b3 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Lock "3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:52:52 user nova-compute[71509]: DEBUG nova.objects.instance [None req-1b441039-154c-431e-803f-88ac8f78b4b3 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Lazy-loading 'flavor' on Instance uuid 3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:52:52 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-1b441039-154c-431e-803f-88ac8f78b4b3 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] [instance: 3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d] Ignoring supplied device name: /dev/vdb
Apr 14 10:52:52 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1b441039-154c-431e-803f-88ac8f78b4b3 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Lock "3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:52:52 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1b441039-154c-431e-803f-88ac8f78b4b3 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Acquiring lock "3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:52:52 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1b441039-154c-431e-803f-88ac8f78b4b3 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Lock "3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:52:52 user nova-compute[71509]: INFO nova.compute.manager [None req-1b441039-154c-431e-803f-88ac8f78b4b3 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] [instance: 3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d] Attaching volume 7941e1c1-c0c5-4459-9b3e-e09e2d755f77 to /dev/vdb
Apr 14 10:52:52 user nova-compute[71509]: DEBUG os_brick.utils [None req-1b441039-154c-431e-803f-88ac8f78b4b3 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 10:52:52 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:52:52 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:52:52 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[9013020f-b79a-41ce-8643-eda12139841a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50119df3c417\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:52:52 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:52:52 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:52:52 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b637289-ae8c-4417-85f6-eef695bf650c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:52:52 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:52:52 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:52:52 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d36c79d-3620-4e4e-9b65-ca53c6277e6a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:52:52 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[22f7b388-0cb9-4926-9e8d-975272316d50]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:52:52 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1b441039-154c-431e-803f-88ac8f78b4b3 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Running cmd (subprocess): nvme version {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:52:52 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1b441039-154c-431e-803f-88ac8f78b4b3 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] 'nvme version' failed. Not Retrying. {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 10:52:52 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1b441039-154c-431e-803f-88ac8f78b4b3 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] nvme not present on system {{(pid=71509) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 10:52:52 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:52:52 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 10:52:52 user nova-compute[71509]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 10:52:52 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb6e7f26-78e3-429f-b01b-7d70334a532e]: (4, '') {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:52:52 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-1b441039-154c-431e-803f-88ac8f78b4b3 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71509) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 10:52:52 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-1b441039-154c-431e-803f-88ac8f78b4b3 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71509) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 10:52:52 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-1b441039-154c-431e-803f-88ac8f78b4b3 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] LIGHTOS: no hostnqn found. {{(pid=71509) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 10:52:52 user nova-compute[71509]: DEBUG os_brick.utils [None req-1b441039-154c-431e-803f-88ac8f78b4b3 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50119df3c417', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 10:52:52 user nova-compute[71509]: DEBUG nova.virt.block_device [None req-1b441039-154c-431e-803f-88ac8f78b4b3 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] [instance: 3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d] Updating existing volume attachment record: fbbb79c9-c0a9-45ce-bde4-297556f95666 {{(pid=71509) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 10:52:53 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:52:56 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:52:57 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:52:58 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b441039-154c-431e-803f-88ac8f78b4b3 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] [instance: 3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d] Calling os-brick to attach iSCSI Volume {{(pid=71509) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 10:52:58 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b441039-154c-431e-803f-88ac8f78b4b3 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0bf0749390>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7941e1c1-c0c5-4459-9b3e-e09e2d755f77', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KSJwnpuc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 10:52:58 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-1b441039-154c-431e-803f-88ac8f78b4b3 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 10:52:58 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-1b441039-154c-431e-803f-88ac8f78b4b3 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 10:52:58 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-1b441039-154c-431e-803f-88ac8f78b4b3 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 10:52:58 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-1b441039-154c-431e-803f-88ac8f78b4b3 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 10:52:58 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-1b441039-154c-431e-803f-88ac8f78b4b3 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7941e1c1-c0c5-4459-9b3e-e09e2d755f77" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 10:52:58 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-1b441039-154c-431e-803f-88ac8f78b4b3 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7941e1c1-c0c5-4459-9b3e-e09e2d755f77" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 10:52:58 user nova-compute[71509]: INFO os_brick.initiator.connectors.iscsi [None req-1b441039-154c-431e-803f-88ac8f78b4b3 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 10:52:58 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7941e1c1-c0c5-4459-9b3e-e09e2d755f77 -p 172.16.0.220:3260 {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:52:58 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7941e1c1-c0c5-4459-9b3e-e09e2d755f77 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:52:58 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[df975e3a-2dd7-4926-ad2b-0ef4b6054a69]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:52:58 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b441039-154c-431e-803f-88ac8f78b4b3 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 10:52:58 user nova-compute[71509]:  {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:52:58 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7941e1c1-c0c5-4459-9b3e-e09e2d755f77 -p 172.16.0.220:3260 --interface default --op new {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:52:58 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7941e1c1-c0c5-4459-9b3e-e09e2d755f77 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:52:58 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[628de217-8f07-4c9a-98f4-b96f3754e498]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7941e1c1-c0c5-4459-9b3e-e09e2d755f77] added\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:52:58 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b441039-154c-431e-803f-88ac8f78b4b3 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7941e1c1-c0c5-4459-9b3e-e09e2d755f77] added
Apr 14 10:52:58 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:52:58 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7941e1c1-c0c5-4459-9b3e-e09e2d755f77 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:52:58 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7941e1c1-c0c5-4459-9b3e-e09e2d755f77 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:52:58 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b183c4a-1d55-4152-b0d6-d5fde06dff03]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:52:58 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b441039-154c-431e-803f-88ac8f78b4b3 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:52:58 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7941e1c1-c0c5-4459-9b3e-e09e2d755f77 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:52:58 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7941e1c1-c0c5-4459-9b3e-e09e2d755f77 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:52:58 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[37cd86ae-dca9-4672-88e2-36e8b82f5ec2]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:52:58 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b441039-154c-431e-803f-88ac8f78b4b3 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:52:58 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7941e1c1-c0c5-4459-9b3e-e09e2d755f77 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KSJwnpuc {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:52:58 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7941e1c1-c0c5-4459-9b3e-e09e2d755f77 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KSJwnpuc" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:52:58 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0b5f84c-3623-429c-8c63-4237de7242bd]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:52:58 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b441039-154c-431e-803f-88ac8f78b4b3 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KSJwnpuc'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:52:58 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7941e1c1-c0c5-4459-9b3e-e09e2d755f77 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:52:58 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7941e1c1-c0c5-4459-9b3e-e09e2d755f77 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:52:58 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[740ef01d-945a-458a-bb90-1fd5d2f810be]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:52:58 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b441039-154c-431e-803f-88ac8f78b4b3 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:52:58 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:52:58 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:52:58 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[e459fc22-9cd2-49c5-9888-9a57168aa6f4]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:52:58 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b441039-154c-431e-803f-88ac8f78b4b3 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)
Apr 14 10:52:58 user nova-compute[71509]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2 (non-flash)
Apr 14 10:52:58 user nova-compute[71509]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe (non-flash)
Apr 14 10:52:58 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:52:58 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b441039-154c-431e-803f-88ac8f78b4b3 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)
Apr 14 10:52:58 user nova-compute[71509]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2 (non-flash)
Apr 14 10:52:58 user nova-compute[71509]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe (non-flash)
Apr 14 10:52:58 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 10:52:58 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7941e1c1-c0c5-4459-9b3e-e09e2d755f77 -p 172.16.0.220:3260 --login {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:52:58 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7941e1c1-c0c5-4459-9b3e-e09e2d755f77 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:52:58 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b1f5478-cedb-4d45-8696-014fc0e1e90c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7941e1c1-c0c5-4459-9b3e-e09e2d755f77, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7941e1c1-c0c5-4459-9b3e-e09e2d755f77, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:52:58 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b441039-154c-431e-803f-88ac8f78b4b3 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7941e1c1-c0c5-4459-9b3e-e09e2d755f77, portal: 172.16.0.220,3260]
Apr 14 10:52:58 user nova-compute[71509]: Login to [iface: default, target: iqn.2010-10.org.openstack:7941e1c1-c0c5-4459-9b3e-e09e2d755f77, portal: 172.16.0.220,3260] successful.
Apr 14 10:52:58 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:52:58 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7941e1c1-c0c5-4459-9b3e-e09e2d755f77 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:52:58 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7941e1c1-c0c5-4459-9b3e-e09e2d755f77 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:52:58 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[67002f25-c2e3-4de7-a3d6-6ee6fab49a88]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:52:58 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b441039-154c-431e-803f-88ac8f78b4b3 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:52:58 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:52:58 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:52:58 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3dba5ed-0fde-4acf-88d2-ca91e70d7985]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7941e1c1-c0c5-4459-9b3e-e09e2d755f77 (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:52:58 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b441039-154c-431e-803f-88ac8f78b4b3 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)
Apr 14 10:52:58 user nova-compute[71509]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2 (non-flash)
Apr 14 10:52:58 user nova-compute[71509]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe (non-flash)
Apr 14 10:52:58 user nova-compute[71509]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7941e1c1-c0c5-4459-9b3e-e09e2d755f77 (non-flash)
Apr 14 10:52:58 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:52:58 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b441039-154c-431e-803f-88ac8f78b4b3 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)
Apr 14 10:52:58 user nova-compute[71509]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2 (non-flash)
Apr 14 10:52:58 user nova-compute[71509]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe (non-flash)
Apr 14 10:52:58 user nova-compute[71509]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7941e1c1-c0c5-4459-9b3e-e09e2d755f77 (non-flash)
Apr 14 10:52:58 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 10:52:58 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-1b441039-154c-431e-803f-88ac8f78b4b3 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7941e1c1-c0c5-4459-9b3e-e09e2d755f77" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 10:52:58 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b441039-154c-431e-803f-88ac8f78b4b3 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Connected to 172.16.0.220:3260 {{(pid=71509) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 10:52:58 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-1b441039-154c-431e-803f-88ac8f78b4b3 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] HCTL ('36', '-', '-', 0) found on session 32 with lun 0 {{(pid=71509) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 10:52:58 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-1b441039-154c-431e-803f-88ac8f78b4b3 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71509) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 10:52:58 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:52:58 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:52:58 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[04130d6c-10f5-4c14-a874-6ee3c7d22586]: (4, ('- - 0', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:52:58 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-1b441039-154c-431e-803f-88ac8f78b4b3 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Searching for a device in session 32 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71509) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 10:52:58 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b441039-154c-431e-803f-88ac8f78b4b3 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:7941e1c1-c0c5-4459-9b3e-e09e2d755f77', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KSJwnpuc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71509) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 10:52:59 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-1b441039-154c-431e-803f-88ac8f78b4b3 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.317s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 10:52:59 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b441039-154c-431e-803f-88ac8f78b4b3 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] <== connect_volume: return (1319ms) {'type': 'block', 'scsi_wwn': '26631613864653139', 'path': '/dev/sde'} {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 10:52:59 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b441039-154c-431e-803f-88ac8f78b4b3 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] [instance: 3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26631613864653139', 'path': '/dev/sde'} {{(pid=71509) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 10:52:59 user nova-compute[71509]: DEBUG nova.objects.instance [None req-1b441039-154c-431e-803f-88ac8f78b4b3 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Lazy-loading 'flavor' on Instance uuid 3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:52:59 user nova-compute[71509]: DEBUG nova.virt.libvirt.guest [None req-1b441039-154c-431e-803f-88ac8f78b4b3 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 10:52:59 user nova-compute[71509]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 10:52:59 user nova-compute[71509]:   <source dev="/dev/sde"/>
Apr 14 10:52:59 user nova-compute[71509]:   <target dev="vdb" bus="virtio"/>
Apr 14 10:52:59 user nova-compute[71509]:   <serial>7941e1c1-c0c5-4459-9b3e-e09e2d755f77</serial>
Apr 14 10:52:59 user nova-compute[71509]: </disk>
Apr 14 10:52:59 user nova-compute[71509]:  {{(pid=71509) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 10:53:00 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-1b441039-154c-431e-803f-88ac8f78b4b3 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] No BDM found with device name vda, not building metadata. {{(pid=71509) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 10:53:00 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-1b441039-154c-431e-803f-88ac8f78b4b3 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71509) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 10:53:00 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-1b441039-154c-431e-803f-88ac8f78b4b3 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] No VIF found with MAC fa:16:3e:29:66:56, not building metadata {{(pid=71509) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 10:53:00 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1b441039-154c-431e-803f-88ac8f78b4b3 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Lock "3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.662s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:53:01 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:53:02 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-7cf49981-3ae7-4155-bf34-65a223368dad tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Acquiring lock "3b4b6e3e-0743-4ee6-900c-3172b09eb0f2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:53:02 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-7cf49981-3ae7-4155-bf34-65a223368dad tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Lock "3b4b6e3e-0743-4ee6-900c-3172b09eb0f2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:53:02 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-7cf49981-3ae7-4155-bf34-65a223368dad tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Acquiring lock "3b4b6e3e-0743-4ee6-900c-3172b09eb0f2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:53:02 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-7cf49981-3ae7-4155-bf34-65a223368dad tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Lock "3b4b6e3e-0743-4ee6-900c-3172b09eb0f2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:53:02 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-7cf49981-3ae7-4155-bf34-65a223368dad tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Lock "3b4b6e3e-0743-4ee6-900c-3172b09eb0f2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:53:02 user nova-compute[71509]: INFO nova.compute.manager [None req-7cf49981-3ae7-4155-bf34-65a223368dad tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] [instance: 3b4b6e3e-0743-4ee6-900c-3172b09eb0f2] Terminating instance
Apr 14 10:53:02 user nova-compute[71509]: DEBUG nova.compute.manager [None req-7cf49981-3ae7-4155-bf34-65a223368dad tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] [instance: 3b4b6e3e-0743-4ee6-900c-3172b09eb0f2] Start destroying the instance on the hypervisor. {{(pid=71509) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 10:53:02 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:53:02 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:53:03 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:53:03 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:53:03 user nova-compute[71509]: DEBUG nova.compute.manager [req-7352be6d-4ce2-4000-abe3-26676378ddcb req-d18044aa-d786-43e7-958a-3cd07f6ed772 service nova] [instance: 3b4b6e3e-0743-4ee6-900c-3172b09eb0f2] Received event network-vif-unplugged-2f4949b3-11d4-4970-878c-49a35c428147 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:53:03 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-7352be6d-4ce2-4000-abe3-26676378ddcb req-d18044aa-d786-43e7-958a-3cd07f6ed772 service nova] Acquiring lock "3b4b6e3e-0743-4ee6-900c-3172b09eb0f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:53:03 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-7352be6d-4ce2-4000-abe3-26676378ddcb req-d18044aa-d786-43e7-958a-3cd07f6ed772 service nova] Lock "3b4b6e3e-0743-4ee6-900c-3172b09eb0f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:53:03 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-7352be6d-4ce2-4000-abe3-26676378ddcb req-d18044aa-d786-43e7-958a-3cd07f6ed772 service nova] Lock "3b4b6e3e-0743-4ee6-900c-3172b09eb0f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:53:03 user nova-compute[71509]: DEBUG nova.compute.manager [req-7352be6d-4ce2-4000-abe3-26676378ddcb req-d18044aa-d786-43e7-958a-3cd07f6ed772 service nova] [instance: 3b4b6e3e-0743-4ee6-900c-3172b09eb0f2] No waiting events found dispatching network-vif-unplugged-2f4949b3-11d4-4970-878c-49a35c428147 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:53:03 user nova-compute[71509]: DEBUG nova.compute.manager [req-7352be6d-4ce2-4000-abe3-26676378ddcb req-d18044aa-d786-43e7-958a-3cd07f6ed772 service nova] [instance: 3b4b6e3e-0743-4ee6-900c-3172b09eb0f2] Received event network-vif-unplugged-2f4949b3-11d4-4970-878c-49a35c428147 for instance with task_state deleting. {{(pid=71509) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 10:53:03 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: 3b4b6e3e-0743-4ee6-900c-3172b09eb0f2] Instance destroyed successfully.
Apr 14 10:53:03 user nova-compute[71509]: DEBUG nova.objects.instance [None req-7cf49981-3ae7-4155-bf34-65a223368dad tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Lazy-loading 'resources' on Instance uuid 3b4b6e3e-0743-4ee6-900c-3172b09eb0f2 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:53:03 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-7cf49981-3ae7-4155-bf34-65a223368dad tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T10:51:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1788483212',display_name='tempest-VolumesAdminNegativeTest-server-1788483212',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1788483212',id=21,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T10:51:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='aca26975e5ad4524b4b1b1ec4335802f',ramdisk_id='',reservation_id='r-d8jhzy5t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-5408590',owner_user_name='tempest-VolumesAdminNegativeTest-5408590-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T10:51:13Z,user_data=None,user_id='6adefa90332c42c79a1372258a7be5ab',uuid=3b4b6e3e-0743-4ee6-900c-3172b09eb0f2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2f4949b3-11d4-4970-878c-49a35c428147", "address": "fa:16:3e:26:93:bd", "network": {"id": "36ccc911-348d-426a-ba7b-a49a0bfb0f97", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-256080753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aca26975e5ad4524b4b1b1ec4335802f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f4949b3-11", "ovs_interfaceid": "2f4949b3-11d4-4970-878c-49a35c428147", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 10:53:03 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-7cf49981-3ae7-4155-bf34-65a223368dad tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Converting VIF {"id": "2f4949b3-11d4-4970-878c-49a35c428147", "address": "fa:16:3e:26:93:bd", "network": {"id": "36ccc911-348d-426a-ba7b-a49a0bfb0f97", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-256080753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aca26975e5ad4524b4b1b1ec4335802f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f4949b3-11", "ovs_interfaceid": "2f4949b3-11d4-4970-878c-49a35c428147", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:53:03 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-7cf49981-3ae7-4155-bf34-65a223368dad tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:93:bd,bridge_name='br-int',has_traffic_filtering=True,id=2f4949b3-11d4-4970-878c-49a35c428147,network=Network(36ccc911-348d-426a-ba7b-a49a0bfb0f97),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f4949b3-11') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:53:03 user nova-compute[71509]: DEBUG os_vif [None req-7cf49981-3ae7-4155-bf34-65a223368dad tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:93:bd,bridge_name='br-int',has_traffic_filtering=True,id=2f4949b3-11d4-4970-878c-49a35c428147,network=Network(36ccc911-348d-426a-ba7b-a49a0bfb0f97),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f4949b3-11') {{(pid=71509) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 10:53:03 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:53:03 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2f4949b3-11, bridge=br-int, if_exists=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:53:03 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:53:03 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 10:53:03 user nova-compute[71509]: INFO os_vif [None req-7cf49981-3ae7-4155-bf34-65a223368dad tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:93:bd,bridge_name='br-int',has_traffic_filtering=True,id=2f4949b3-11d4-4970-878c-49a35c428147,network=Network(36ccc911-348d-426a-ba7b-a49a0bfb0f97),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f4949b3-11')
Apr 14 10:53:03 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-7cf49981-3ae7-4155-bf34-65a223368dad tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] [instance: 3b4b6e3e-0743-4ee6-900c-3172b09eb0f2] Deleting instance files /opt/stack/data/nova/instances/3b4b6e3e-0743-4ee6-900c-3172b09eb0f2_del
Apr 14 10:53:03 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-7cf49981-3ae7-4155-bf34-65a223368dad tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] [instance: 3b4b6e3e-0743-4ee6-900c-3172b09eb0f2] Deletion of /opt/stack/data/nova/instances/3b4b6e3e-0743-4ee6-900c-3172b09eb0f2_del complete
Apr 14 10:53:03 user nova-compute[71509]: INFO nova.compute.manager [None req-7cf49981-3ae7-4155-bf34-65a223368dad tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] [instance: 3b4b6e3e-0743-4ee6-900c-3172b09eb0f2] Took 0.71 seconds to destroy the instance on the hypervisor.
Apr 14 10:53:03 user nova-compute[71509]: DEBUG oslo.service.loopingcall [None req-7cf49981-3ae7-4155-bf34-65a223368dad tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71509) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 10:53:03 user nova-compute[71509]: DEBUG nova.compute.manager [-] [instance: 3b4b6e3e-0743-4ee6-900c-3172b09eb0f2] Deallocating network for instance {{(pid=71509) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 10:53:03 user nova-compute[71509]: DEBUG nova.network.neutron [-] [instance: 3b4b6e3e-0743-4ee6-900c-3172b09eb0f2] deallocate_for_instance() {{(pid=71509) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 10:53:03 user nova-compute[71509]: DEBUG nova.network.neutron [-] [instance: 3b4b6e3e-0743-4ee6-900c-3172b09eb0f2] Updating instance_info_cache with network_info: [] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:53:03 user nova-compute[71509]: INFO nova.compute.manager [-] [instance: 3b4b6e3e-0743-4ee6-900c-3172b09eb0f2] Took 0.54 seconds to deallocate network for instance.
Apr 14 10:53:03 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-7cf49981-3ae7-4155-bf34-65a223368dad tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:53:03 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-7cf49981-3ae7-4155-bf34-65a223368dad tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:53:04 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-7cf49981-3ae7-4155-bf34-65a223368dad tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 10:53:04 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-7cf49981-3ae7-4155-bf34-65a223368dad tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 10:53:04 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-7cf49981-3ae7-4155-bf34-65a223368dad tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.378s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:53:04 user nova-compute[71509]: INFO nova.scheduler.client.report [None req-7cf49981-3ae7-4155-bf34-65a223368dad tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Deleted allocations for instance 3b4b6e3e-0743-4ee6-900c-3172b09eb0f2
Apr 14 10:53:04 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-7cf49981-3ae7-4155-bf34-65a223368dad tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Lock "3b4b6e3e-0743-4ee6-900c-3172b09eb0f2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.822s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:53:05 user nova-compute[71509]: DEBUG nova.compute.manager [req-ea2abf3b-38cb-4c04-a189-d9ab9d1fd658 req-468c24ab-3a9c-442f-b117-c2c4a6342a4d service nova] [instance: 3b4b6e3e-0743-4ee6-900c-3172b09eb0f2] Received event network-vif-plugged-2f4949b3-11d4-4970-878c-49a35c428147 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:53:05 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-ea2abf3b-38cb-4c04-a189-d9ab9d1fd658 req-468c24ab-3a9c-442f-b117-c2c4a6342a4d service nova] Acquiring lock "3b4b6e3e-0743-4ee6-900c-3172b09eb0f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:53:05 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-ea2abf3b-38cb-4c04-a189-d9ab9d1fd658 req-468c24ab-3a9c-442f-b117-c2c4a6342a4d service nova] Lock "3b4b6e3e-0743-4ee6-900c-3172b09eb0f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:53:05 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-ea2abf3b-38cb-4c04-a189-d9ab9d1fd658 req-468c24ab-3a9c-442f-b117-c2c4a6342a4d service nova] Lock "3b4b6e3e-0743-4ee6-900c-3172b09eb0f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:53:05 user nova-compute[71509]: DEBUG nova.compute.manager [req-ea2abf3b-38cb-4c04-a189-d9ab9d1fd658 req-468c24ab-3a9c-442f-b117-c2c4a6342a4d service nova] [instance: 3b4b6e3e-0743-4ee6-900c-3172b09eb0f2] No waiting events found dispatching network-vif-plugged-2f4949b3-11d4-4970-878c-49a35c428147 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:53:05 user nova-compute[71509]: WARNING nova.compute.manager [req-ea2abf3b-38cb-4c04-a189-d9ab9d1fd658 req-468c24ab-3a9c-442f-b117-c2c4a6342a4d service nova] [instance: 3b4b6e3e-0743-4ee6-900c-3172b09eb0f2] Received unexpected event network-vif-plugged-2f4949b3-11d4-4970-878c-49a35c428147 for instance with vm_state deleted and task_state None.
Apr 14 10:53:05 user nova-compute[71509]: DEBUG nova.compute.manager [req-ea2abf3b-38cb-4c04-a189-d9ab9d1fd658 req-468c24ab-3a9c-442f-b117-c2c4a6342a4d service nova] [instance: 3b4b6e3e-0743-4ee6-900c-3172b09eb0f2] Received event network-vif-deleted-2f4949b3-11d4-4970-878c-49a35c428147 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:53:05 user nova-compute[71509]: DEBUG nova.compute.manager [req-dec2dd9e-2fc7-47ee-aa51-7898c3b5baf3 req-5731e8cf-ec79-4c30-be68-8d2ac2a56dc6 service nova] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Received event network-changed-f2196ef3-aada-48d6-b524-5e9cef6a9eda {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:53:05 user nova-compute[71509]: DEBUG nova.compute.manager [req-dec2dd9e-2fc7-47ee-aa51-7898c3b5baf3 req-5731e8cf-ec79-4c30-be68-8d2ac2a56dc6 service nova] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Refreshing instance network info cache due to event network-changed-f2196ef3-aada-48d6-b524-5e9cef6a9eda. {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 10:53:05 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-dec2dd9e-2fc7-47ee-aa51-7898c3b5baf3 req-5731e8cf-ec79-4c30-be68-8d2ac2a56dc6 service nova] Acquiring lock "refresh_cache-d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:53:05 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-dec2dd9e-2fc7-47ee-aa51-7898c3b5baf3 req-5731e8cf-ec79-4c30-be68-8d2ac2a56dc6 service nova] Acquired lock "refresh_cache-d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:53:05 user nova-compute[71509]: DEBUG nova.network.neutron [req-dec2dd9e-2fc7-47ee-aa51-7898c3b5baf3 req-5731e8cf-ec79-4c30-be68-8d2ac2a56dc6 service nova] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Refreshing network info cache for port f2196ef3-aada-48d6-b524-5e9cef6a9eda {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 10:53:05 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-f7f614b2-ece8-40b4-869c-c6572f5070cd tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Acquiring lock "d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:53:05 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-f7f614b2-ece8-40b4-869c-c6572f5070cd tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:53:05 user nova-compute[71509]: DEBUG nova.objects.instance [None req-f7f614b2-ece8-40b4-869c-c6572f5070cd tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lazy-loading 'flavor' on Instance uuid d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:53:05 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-f7f614b2-ece8-40b4-869c-c6572f5070cd tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:53:05 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-f7f614b2-ece8-40b4-869c-c6572f5070cd tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Acquiring lock "d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:53:05 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-f7f614b2-ece8-40b4-869c-c6572f5070cd tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:53:05 user nova-compute[71509]: INFO nova.compute.manager [None req-f7f614b2-ece8-40b4-869c-c6572f5070cd tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Attaching volume 08f71190-2402-402d-af67-edf9226e4fb8 to /dev/vdb
Apr 14 10:53:05 user nova-compute[71509]: DEBUG os_brick.utils [None req-f7f614b2-ece8-40b4-869c-c6572f5070cd tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 10:53:05 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:53:05 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:53:05 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[50a40cb1-e3c1-4908-b8d5-674c9f04e8ed]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50119df3c417\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:53:05 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:53:05 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:53:05 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[76b09f30-3542-4d38-81d6-76be49feef6d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:53:05 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:53:05 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:53:05 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a46b0e8-91f6-4075-99a0-ba3b1c1247cc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:53:05 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1a737ad-c191-4150-a0e0-09bad1451d5c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:53:05 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-f7f614b2-ece8-40b4-869c-c6572f5070cd tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Running cmd (subprocess): nvme version {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:53:05 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-f7f614b2-ece8-40b4-869c-c6572f5070cd tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] 'nvme version' failed. Not Retrying. {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 10:53:05 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f7f614b2-ece8-40b4-869c-c6572f5070cd tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] nvme not present on system {{(pid=71509) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 10:53:05 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:53:05 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 10:53:05 user nova-compute[71509]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 10:53:05 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a2d9588-7d4f-4624-8e1f-6e5f09b4fde2]: (4, '') {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:53:05 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-f7f614b2-ece8-40b4-869c-c6572f5070cd tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71509) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 10:53:05 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-f7f614b2-ece8-40b4-869c-c6572f5070cd tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71509) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 10:53:05 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-f7f614b2-ece8-40b4-869c-c6572f5070cd tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] LIGHTOS: no hostnqn found. {{(pid=71509) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 10:53:05 user nova-compute[71509]: DEBUG os_brick.utils [None req-f7f614b2-ece8-40b4-869c-c6572f5070cd tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50119df3c417', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 10:53:05 user nova-compute[71509]: DEBUG nova.virt.block_device [None req-f7f614b2-ece8-40b4-869c-c6572f5070cd tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Updating existing volume attachment record: 0eef4a21-be02-4b48-935f-bd94674c13d7 {{(pid=71509) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 10:53:06 user nova-compute[71509]: DEBUG nova.network.neutron [req-dec2dd9e-2fc7-47ee-aa51-7898c3b5baf3 req-5731e8cf-ec79-4c30-be68-8d2ac2a56dc6 service nova] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Updated VIF entry in instance network info cache for port f2196ef3-aada-48d6-b524-5e9cef6a9eda. {{(pid=71509) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 10:53:06 user nova-compute[71509]: DEBUG nova.network.neutron [req-dec2dd9e-2fc7-47ee-aa51-7898c3b5baf3 req-5731e8cf-ec79-4c30-be68-8d2ac2a56dc6 service nova] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Updating instance_info_cache with network_info: [{"id": "f2196ef3-aada-48d6-b524-5e9cef6a9eda", "address": "fa:16:3e:e7:31:44", "network": {"id": "22eb5f87-be4d-447d-bafe-25e0284ea3ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-787804772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf93e5dac50342d0b65ef09711401e99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2196ef3-aa", "ovs_interfaceid": "f2196ef3-aada-48d6-b524-5e9cef6a9eda", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:53:06 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-dec2dd9e-2fc7-47ee-aa51-7898c3b5baf3 req-5731e8cf-ec79-4c30-be68-8d2ac2a56dc6 service nova] Releasing lock "refresh_cache-d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:53:08 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:53:08 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:53:11 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-65119d9c-439d-40fd-b2db-3b154f0cc47c tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Acquiring lock "8586a70e-9855-4177-ac1b-cf707a4df871" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:53:11 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-65119d9c-439d-40fd-b2db-3b154f0cc47c tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "8586a70e-9855-4177-ac1b-cf707a4df871" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:53:11 user nova-compute[71509]: INFO nova.compute.manager [None req-65119d9c-439d-40fd-b2db-3b154f0cc47c tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Detaching volume 64fbf5f9-3b53-42b6-8eb9-34688db256a2
Apr 14 10:53:11 user nova-compute[71509]: INFO nova.virt.block_device [None req-65119d9c-439d-40fd-b2db-3b154f0cc47c tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Attempting to driver detach volume 64fbf5f9-3b53-42b6-8eb9-34688db256a2 from mountpoint /dev/vdb
Apr 14 10:53:11 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-65119d9c-439d-40fd-b2db-3b154f0cc47c tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Attempting to detach device vdb from instance 8586a70e-9855-4177-ac1b-cf707a4df871 from the persistent domain config. {{(pid=71509) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 10:53:11 user nova-compute[71509]: DEBUG nova.virt.libvirt.guest [None req-65119d9c-439d-40fd-b2db-3b154f0cc47c tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 10:53:11 user nova-compute[71509]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 10:53:11 user nova-compute[71509]:   <source dev="/dev/sdc"/>
Apr 14 10:53:11 user nova-compute[71509]:   <target dev="vdb" bus="virtio"/>
Apr 14 10:53:11 user nova-compute[71509]:   <serial>64fbf5f9-3b53-42b6-8eb9-34688db256a2</serial>
Apr 14 10:53:11 user nova-compute[71509]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 14 10:53:11 user nova-compute[71509]: </disk>
Apr 14 10:53:11 user nova-compute[71509]:  {{(pid=71509) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 10:53:11 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-65119d9c-439d-40fd-b2db-3b154f0cc47c tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Successfully detached device vdb from instance 8586a70e-9855-4177-ac1b-cf707a4df871 from the persistent domain config.
Apr 14 10:53:11 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-65119d9c-439d-40fd-b2db-3b154f0cc47c tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8586a70e-9855-4177-ac1b-cf707a4df871 from the live domain config. {{(pid=71509) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 10:53:11 user nova-compute[71509]: DEBUG nova.virt.libvirt.guest [None req-65119d9c-439d-40fd-b2db-3b154f0cc47c tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 10:53:11 user nova-compute[71509]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 10:53:11 user nova-compute[71509]:   <source dev="/dev/sdc"/>
Apr 14 10:53:11 user nova-compute[71509]:   <target dev="vdb" bus="virtio"/>
Apr 14 10:53:11 user nova-compute[71509]:   <serial>64fbf5f9-3b53-42b6-8eb9-34688db256a2</serial>
Apr 14 10:53:11 user nova-compute[71509]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 14 10:53:11 user nova-compute[71509]: </disk>
Apr 14 10:53:11 user nova-compute[71509]:  {{(pid=71509) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 10:53:12 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Received event <DeviceRemovedEvent: 1681469592.2563047, 8586a70e-9855-4177-ac1b-cf707a4df871 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71509) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 10:53:12 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-65119d9c-439d-40fd-b2db-3b154f0cc47c tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8586a70e-9855-4177-ac1b-cf707a4df871 {{(pid=71509) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 10:53:12 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-65119d9c-439d-40fd-b2db-3b154f0cc47c tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Successfully detached device vdb from instance 8586a70e-9855-4177-ac1b-cf707a4df871 from the live domain config.
Apr 14 10:53:12 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65119d9c-439d-40fd-b2db-3b154f0cc47c tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] calling os-brick to detach iSCSI Volume {{(pid=71509) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 10:53:12 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-65119d9c-439d-40fd-b2db-3b154f0cc47c tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0bf0749390>, {'target_iqn': 'iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yctQbvEP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 10:53:12 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-65119d9c-439d-40fd-b2db-3b154f0cc47c tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 10:53:12 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-65119d9c-439d-40fd-b2db-3b154f0cc47c tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 10:53:12 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-65119d9c-439d-40fd-b2db-3b154f0cc47c tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 10:53:12 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:53:12 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:53:12 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee0fbb30-fbc6-4108-8a76-00d2e04258c9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7941e1c1-c0c5-4459-9b3e-e09e2d755f77\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:53:12 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-65119d9c-439d-40fd-b2db-3b154f0cc47c tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 10:53:12 user nova-compute[71509]: No targets found.
Apr 14 10:53:12 user nova-compute[71509]: iSNS:
Apr 14 10:53:12 user nova-compute[71509]: No targets found.
Apr 14 10:53:12 user nova-compute[71509]: STATIC:
Apr 14 10:53:12 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2
Apr 14 10:53:12 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:53:12 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:53:12 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe
Apr 14 10:53:12 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:53:12 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:53:12 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:7941e1c1-c0c5-4459-9b3e-e09e2d755f77
Apr 14 10:53:12 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:53:12 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:53:12 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178
Apr 14 10:53:12 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:53:12 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:53:12 user nova-compute[71509]: FIRMWARE:
Apr 14 10:53:12 user nova-compute[71509]: No targets found.
Apr 14 10:53:12 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:53:12 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-65119d9c-439d-40fd-b2db-3b154f0cc47c tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 10:53:12 user nova-compute[71509]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 10:53:12 user nova-compute[71509]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71509) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 10:53:12 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-65119d9c-439d-40fd-b2db-3b154f0cc47c tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2', 0)] {{(pid=71509) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 10:53:12 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:53:12 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:53:12 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2284658-a1a7-4e32-a9e8-b0929c345738]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7941e1c1-c0c5-4459-9b3e-e09e2d755f77\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:53:12 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:53:12 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:53:12 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[025a6cf7-2670-42ac-9d60-2d505eafb0f1]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7941e1c1-c0c5-4459-9b3e-e09e2d755f77 (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:53:12 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-65119d9c-439d-40fd-b2db-3b154f0cc47c tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)
Apr 14 10:53:12 user nova-compute[71509]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2 (non-flash)
Apr 14 10:53:12 user nova-compute[71509]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe (non-flash)
Apr 14 10:53:12 user nova-compute[71509]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7941e1c1-c0c5-4459-9b3e-e09e2d755f77 (non-flash)
Apr 14 10:53:12 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:53:12 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-65119d9c-439d-40fd-b2db-3b154f0cc47c tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)
Apr 14 10:53:12 user nova-compute[71509]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2 (non-flash)
Apr 14 10:53:12 user nova-compute[71509]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe (non-flash)
Apr 14 10:53:12 user nova-compute[71509]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7941e1c1-c0c5-4459-9b3e-e09e2d755f77 (non-flash)
Apr 14 10:53:12 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 10:53:12 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-65119d9c-439d-40fd-b2db-3b154f0cc47c tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0c141dcdc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2'): ({'sdc'}, set())}) {{(pid=71509) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 10:53:12 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-65119d9c-439d-40fd-b2db-3b154f0cc47c tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Removing single pathed devices sdc {{(pid=71509) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 10:53:12 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:53:12 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:53:12 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[22bff32d-507c-4157-9217-91ebb2005cf5]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:53:12 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:53:12 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:53:12 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8974e05-60aa-4075-b284-1a7466ba6f50]: (4, ('ok\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:53:12 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-65119d9c-439d-40fd-b2db-3b154f0cc47c tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Flushing IO for device /dev/sdc {{(pid=71509) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 10:53:12 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:53:12 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:53:12 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[321fae85-e4f7-4c67-84a3-8f801b761a8c]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:53:12 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-65119d9c-439d-40fd-b2db-3b154f0cc47c tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71509) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 10:53:12 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:53:12 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:53:12 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5e36ded-70b8-4a55-bb63-0bb2e9ea93e2]: (4, ('1', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:53:12 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-65119d9c-439d-40fd-b2db-3b154f0cc47c tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71509) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 10:53:12 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-65119d9c-439d-40fd-b2db-3b154f0cc47c tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] SCSI volumes sdc have been removed. {{(pid=71509) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 10:53:12 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-65119d9c-439d-40fd-b2db-3b154f0cc47c tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2')] {{(pid=71509) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 10:53:12 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:53:12 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:53:12 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[047a4cbf-29b1-41cc-8341-53bdc596fcd0]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:53:12 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-65119d9c-439d-40fd-b2db-3b154f0cc47c tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:53:12 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2 -p 172.16.0.220:3260 --logout {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:53:12 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:53:12 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[3970ddc3-89b9-4952-8088-6f4a4fcb4a2a]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:53:12 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-65119d9c-439d-40fd-b2db-3b154f0cc47c tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2, portal: 172.16.0.220,3260]
Apr 14 10:53:12 user nova-compute[71509]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2, portal: 172.16.0.220,3260] successful.
Apr 14 10:53:12 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:53:12 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2 -p 172.16.0.220:3260 --op delete {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:53:12 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64fbf5f9-3b53-42b6-8eb9-34688db256a2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:53:12 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5dca61c-4034-41a8-a653-67972ee748e2]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:53:12 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-65119d9c-439d-40fd-b2db-3b154f0cc47c tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:53:12 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-65119d9c-439d-40fd-b2db-3b154f0cc47c tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.336s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 10:53:12 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-65119d9c-439d-40fd-b2db-3b154f0cc47c tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] <== disconnect_volume: return (339ms) None {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 10:53:12 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65119d9c-439d-40fd-b2db-3b154f0cc47c tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Disconnected iSCSI Volume {{(pid=71509) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 10:53:12 user nova-compute[71509]: DEBUG nova.compute.manager [req-5b1be52a-b26f-43cd-851d-ac2ffb7b0b84 req-7700863d-b354-46bb-b0f7-a5f23cd93704 service nova] [instance: cd661ae0-c4bb-4117-847d-ef7e85d062fb] Received event network-changed-e2fa8ebc-482c-460c-924a-26111123a1d5 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:53:12 user nova-compute[71509]: DEBUG nova.compute.manager [req-5b1be52a-b26f-43cd-851d-ac2ffb7b0b84 req-7700863d-b354-46bb-b0f7-a5f23cd93704 service nova] [instance: cd661ae0-c4bb-4117-847d-ef7e85d062fb] Refreshing instance network info cache due to event network-changed-e2fa8ebc-482c-460c-924a-26111123a1d5. {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 10:53:12 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-5b1be52a-b26f-43cd-851d-ac2ffb7b0b84 req-7700863d-b354-46bb-b0f7-a5f23cd93704 service nova] Acquiring lock "refresh_cache-cd661ae0-c4bb-4117-847d-ef7e85d062fb" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:53:12 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-5b1be52a-b26f-43cd-851d-ac2ffb7b0b84 req-7700863d-b354-46bb-b0f7-a5f23cd93704 service nova] Acquired lock "refresh_cache-cd661ae0-c4bb-4117-847d-ef7e85d062fb" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:53:12 user nova-compute[71509]: DEBUG nova.network.neutron [req-5b1be52a-b26f-43cd-851d-ac2ffb7b0b84 req-7700863d-b354-46bb-b0f7-a5f23cd93704 service nova] [instance: cd661ae0-c4bb-4117-847d-ef7e85d062fb] Refreshing network info cache for port e2fa8ebc-482c-460c-924a-26111123a1d5 {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 10:53:13 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:53:13 user nova-compute[71509]: DEBUG nova.network.neutron [req-5b1be52a-b26f-43cd-851d-ac2ffb7b0b84 req-7700863d-b354-46bb-b0f7-a5f23cd93704 service nova] [instance: cd661ae0-c4bb-4117-847d-ef7e85d062fb] Updated VIF entry in instance network info cache for port e2fa8ebc-482c-460c-924a-26111123a1d5. {{(pid=71509) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 10:53:13 user nova-compute[71509]: DEBUG nova.network.neutron [req-5b1be52a-b26f-43cd-851d-ac2ffb7b0b84 req-7700863d-b354-46bb-b0f7-a5f23cd93704 service nova] [instance: cd661ae0-c4bb-4117-847d-ef7e85d062fb] Updating instance_info_cache with network_info: [{"id": "e2fa8ebc-482c-460c-924a-26111123a1d5", "address": "fa:16:3e:d2:b7:64", "network": {"id": "b639a68a-2b4e-435c-b98b-65b5b4981c73", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1070821894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb8f294f957f4c74ae959c1e9f238427", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2fa8ebc-48", "ovs_interfaceid": "e2fa8ebc-482c-460c-924a-26111123a1d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:53:13 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:53:13 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-5b1be52a-b26f-43cd-851d-ac2ffb7b0b84 req-7700863d-b354-46bb-b0f7-a5f23cd93704 service nova] Releasing lock "refresh_cache-cd661ae0-c4bb-4117-847d-ef7e85d062fb" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:53:13 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7f614b2-ece8-40b4-869c-c6572f5070cd tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Calling os-brick to attach iSCSI Volume {{(pid=71509) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 10:53:13 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7f614b2-ece8-40b4-869c-c6572f5070cd tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0bf0749390>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:08f71190-2402-402d-af67-edf9226e4fb8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UrvhzlJj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 10:53:13 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-f7f614b2-ece8-40b4-869c-c6572f5070cd tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 10:53:13 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-f7f614b2-ece8-40b4-869c-c6572f5070cd tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 10:53:13 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-f7f614b2-ece8-40b4-869c-c6572f5070cd tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 10:53:13 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-f7f614b2-ece8-40b4-869c-c6572f5070cd tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 10:53:13 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-f7f614b2-ece8-40b4-869c-c6572f5070cd tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:08f71190-2402-402d-af67-edf9226e4fb8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 10:53:13 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-f7f614b2-ece8-40b4-869c-c6572f5070cd tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:08f71190-2402-402d-af67-edf9226e4fb8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 10:53:13 user nova-compute[71509]: INFO os_brick.initiator.connectors.iscsi [None req-f7f614b2-ece8-40b4-869c-c6572f5070cd tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 10:53:13 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08f71190-2402-402d-af67-edf9226e4fb8 -p 172.16.0.220:3260 {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:53:13 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08f71190-2402-402d-af67-edf9226e4fb8 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:53:13 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b18439a-cdf4-49e5-83cf-dd1def79e66b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:53:13 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7f614b2-ece8-40b4-869c-c6572f5070cd tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 10:53:13 user nova-compute[71509]:  {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:53:13 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08f71190-2402-402d-af67-edf9226e4fb8 -p 172.16.0.220:3260 --interface default --op new {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:53:13 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08f71190-2402-402d-af67-edf9226e4fb8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:53:13 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6fc0bd7-ba71-4a10-bcf8-5040ed841d0c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:08f71190-2402-402d-af67-edf9226e4fb8] added\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:53:13 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7f614b2-ece8-40b4-869c-c6572f5070cd tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:08f71190-2402-402d-af67-edf9226e4fb8] added
Apr 14 10:53:13 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:53:13 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08f71190-2402-402d-af67-edf9226e4fb8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:53:13 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08f71190-2402-402d-af67-edf9226e4fb8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:53:13 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[1df8b130-dc29-46ee-b2e7-d8ae45d9dc2b]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:53:13 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7f614b2-ece8-40b4-869c-c6572f5070cd tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:53:13 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08f71190-2402-402d-af67-edf9226e4fb8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:53:13 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08f71190-2402-402d-af67-edf9226e4fb8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:53:13 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bc50500-8589-4466-9626-d12bf80777fb]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:53:13 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7f614b2-ece8-40b4-869c-c6572f5070cd tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:53:13 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08f71190-2402-402d-af67-edf9226e4fb8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UrvhzlJj {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:53:13 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08f71190-2402-402d-af67-edf9226e4fb8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UrvhzlJj" returned: 0 in 0.032s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:53:13 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[98f3605f-ce35-4d20-bffa-4a692f2d11f6]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:53:13 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7f614b2-ece8-40b4-869c-c6572f5070cd tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UrvhzlJj'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:53:13 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08f71190-2402-402d-af67-edf9226e4fb8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:53:13 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08f71190-2402-402d-af67-edf9226e4fb8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:53:13 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ade61b3-008a-45b1-a21f-0ff07791c22f]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:53:13 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7f614b2-ece8-40b4-869c-c6572f5070cd tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:53:13 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:53:13 user nova-compute[71509]: DEBUG nova.objects.instance [None req-65119d9c-439d-40fd-b2db-3b154f0cc47c tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lazy-loading 'flavor' on Instance uuid 8586a70e-9855-4177-ac1b-cf707a4df871 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:53:13 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:53:13 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe4c56d0-a408-4322-9d9b-dc6221b503bb]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7941e1c1-c0c5-4459-9b3e-e09e2d755f77 (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:53:13 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7f614b2-ece8-40b4-869c-c6572f5070cd tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)
Apr 14 10:53:13 user nova-compute[71509]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe (non-flash)
Apr 14 10:53:13 user nova-compute[71509]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7941e1c1-c0c5-4459-9b3e-e09e2d755f77 (non-flash)
Apr 14 10:53:13 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:53:13 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7f614b2-ece8-40b4-869c-c6572f5070cd tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)
Apr 14 10:53:13 user nova-compute[71509]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe (non-flash)
Apr 14 10:53:13 user nova-compute[71509]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7941e1c1-c0c5-4459-9b3e-e09e2d755f77 (non-flash)
Apr 14 10:53:13 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 10:53:13 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08f71190-2402-402d-af67-edf9226e4fb8 -p 172.16.0.220:3260 --login {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:53:13 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-65119d9c-439d-40fd-b2db-3b154f0cc47c tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "8586a70e-9855-4177-ac1b-cf707a4df871" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.959s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:53:13 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08f71190-2402-402d-af67-edf9226e4fb8 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:53:13 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9e954fc-b009-43ae-8d06-7f2db127da04]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:08f71190-2402-402d-af67-edf9226e4fb8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:08f71190-2402-402d-af67-edf9226e4fb8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:53:13 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7f614b2-ece8-40b4-869c-c6572f5070cd tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:08f71190-2402-402d-af67-edf9226e4fb8, portal: 172.16.0.220,3260]
Apr 14 10:53:13 user nova-compute[71509]: Login to [iface: default, target: iqn.2010-10.org.openstack:08f71190-2402-402d-af67-edf9226e4fb8, portal: 172.16.0.220,3260] successful.
Apr 14 10:53:13 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:53:13 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08f71190-2402-402d-af67-edf9226e4fb8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:53:13 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08f71190-2402-402d-af67-edf9226e4fb8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:53:13 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[516e92d1-024c-47a0-8d5f-ddef94c4387a]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:53:13 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7f614b2-ece8-40b4-869c-c6572f5070cd tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:53:13 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:53:13 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:53:13 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3ea8e02-25a4-4d77-a52d-c03445b4bf3d]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7941e1c1-c0c5-4459-9b3e-e09e2d755f77 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08f71190-2402-402d-af67-edf9226e4fb8 (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:53:13 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7f614b2-ece8-40b4-869c-c6572f5070cd tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)
Apr 14 10:53:13 user nova-compute[71509]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe (non-flash)
Apr 14 10:53:13 user nova-compute[71509]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7941e1c1-c0c5-4459-9b3e-e09e2d755f77 (non-flash)
Apr 14 10:53:13 user nova-compute[71509]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08f71190-2402-402d-af67-edf9226e4fb8 (non-flash)
Apr 14 10:53:13 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:53:13 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7f614b2-ece8-40b4-869c-c6572f5070cd tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)
Apr 14 10:53:13 user nova-compute[71509]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe (non-flash)
Apr 14 10:53:13 user nova-compute[71509]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7941e1c1-c0c5-4459-9b3e-e09e2d755f77 (non-flash)
Apr 14 10:53:13 user nova-compute[71509]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08f71190-2402-402d-af67-edf9226e4fb8 (non-flash)
Apr 14 10:53:13 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 10:53:13 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-f7f614b2-ece8-40b4-869c-c6572f5070cd tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:08f71190-2402-402d-af67-edf9226e4fb8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.327s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 10:53:13 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7f614b2-ece8-40b4-869c-c6572f5070cd tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Connected to 172.16.0.220:3260 {{(pid=71509) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 10:53:13 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-f7f614b2-ece8-40b4-869c-c6572f5070cd tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] HCTL ('34', '-', '-', 0) found on session 33 with lun 0 {{(pid=71509) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 10:53:13 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-f7f614b2-ece8-40b4-869c-c6572f5070cd tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71509) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 10:53:13 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:53:13 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:53:13 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dd417bc-14b8-4aaa-8e81-bf0395cf3e89]: (4, ('- - 0', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:53:13 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-f7f614b2-ece8-40b4-869c-c6572f5070cd tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Searching for a device in session 33 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71509) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 10:53:13 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7f614b2-ece8-40b4-869c-c6572f5070cd tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:08f71190-2402-402d-af67-edf9226e4fb8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UrvhzlJj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71509) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 10:53:14 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-dd290e56-bab8-408d-ae0c-5073fb7030a6 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Acquiring lock "8586a70e-9855-4177-ac1b-cf707a4df871" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:53:14 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-dd290e56-bab8-408d-ae0c-5073fb7030a6 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "8586a70e-9855-4177-ac1b-cf707a4df871" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:53:14 user nova-compute[71509]: DEBUG nova.compute.manager [None req-dd290e56-bab8-408d-ae0c-5073fb7030a6 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:53:14 user nova-compute[71509]: DEBUG nova.compute.manager [None req-dd290e56-bab8-408d-ae0c-5073fb7030a6 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=71509) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3323}}
Apr 14 10:53:14 user nova-compute[71509]: DEBUG nova.objects.instance [None req-dd290e56-bab8-408d-ae0c-5073fb7030a6 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lazy-loading 'flavor' on Instance uuid 8586a70e-9855-4177-ac1b-cf707a4df871 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:53:14 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:53:14 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:53:14 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:53:14 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:53:14 user nova-compute[71509]: DEBUG nova.compute.manager [req-9629d4f0-dfe6-45ec-aaf4-84d1e74530d1 req-8fb23230-44b6-4fd4-8ec3-41660c622395 service nova] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Received event network-vif-unplugged-473d9af8-25a0-4e5a-9afb-7a0c843115cc {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:53:14 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-9629d4f0-dfe6-45ec-aaf4-84d1e74530d1 req-8fb23230-44b6-4fd4-8ec3-41660c622395 service nova] Acquiring lock "8586a70e-9855-4177-ac1b-cf707a4df871-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:53:14 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-9629d4f0-dfe6-45ec-aaf4-84d1e74530d1 req-8fb23230-44b6-4fd4-8ec3-41660c622395 service nova] Lock "8586a70e-9855-4177-ac1b-cf707a4df871-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:53:14 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-9629d4f0-dfe6-45ec-aaf4-84d1e74530d1 req-8fb23230-44b6-4fd4-8ec3-41660c622395 service nova] Lock "8586a70e-9855-4177-ac1b-cf707a4df871-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:53:14 user nova-compute[71509]: DEBUG nova.compute.manager [req-9629d4f0-dfe6-45ec-aaf4-84d1e74530d1 req-8fb23230-44b6-4fd4-8ec3-41660c622395 service nova] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] No waiting events found dispatching network-vif-unplugged-473d9af8-25a0-4e5a-9afb-7a0c843115cc {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:53:14 user nova-compute[71509]: WARNING nova.compute.manager [req-9629d4f0-dfe6-45ec-aaf4-84d1e74530d1 req-8fb23230-44b6-4fd4-8ec3-41660c622395 service nova] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Received unexpected event network-vif-unplugged-473d9af8-25a0-4e5a-9afb-7a0c843115cc for instance with vm_state active and task_state powering-off.
Apr 14 10:53:14 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-f7f614b2-ece8-40b4-869c-c6572f5070cd tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.364s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 10:53:14 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7f614b2-ece8-40b4-869c-c6572f5070cd tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] <== connect_volume: return (1366ms) {'type': 'block', 'scsi_wwn': '23339363335663835', 'path': '/dev/sdc'} {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 10:53:14 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7f614b2-ece8-40b4-869c-c6572f5070cd tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23339363335663835', 'path': '/dev/sdc'} {{(pid=71509) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 10:53:14 user nova-compute[71509]: DEBUG nova.objects.instance [None req-f7f614b2-ece8-40b4-869c-c6572f5070cd tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lazy-loading 'flavor' on Instance uuid d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:53:14 user nova-compute[71509]: DEBUG nova.virt.libvirt.guest [None req-f7f614b2-ece8-40b4-869c-c6572f5070cd tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 10:53:14 user nova-compute[71509]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 10:53:14 user nova-compute[71509]:   <source dev="/dev/sdc"/>
Apr 14 10:53:14 user nova-compute[71509]:   <target dev="vdb" bus="virtio"/>
Apr 14 10:53:14 user nova-compute[71509]:   <serial>08f71190-2402-402d-af67-edf9226e4fb8</serial>
Apr 14 10:53:14 user nova-compute[71509]: </disk>
Apr 14 10:53:14 user nova-compute[71509]:  {{(pid=71509) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 10:53:14 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:53:15 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-590dc66a-cb9d-4902-b777-2f1c13402ceb tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "cd661ae0-c4bb-4117-847d-ef7e85d062fb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:53:15 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-590dc66a-cb9d-4902-b777-2f1c13402ceb tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "cd661ae0-c4bb-4117-847d-ef7e85d062fb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:53:15 user nova-compute[71509]: DEBUG nova.objects.instance [None req-590dc66a-cb9d-4902-b777-2f1c13402ceb tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lazy-loading 'flavor' on Instance uuid cd661ae0-c4bb-4117-847d-ef7e85d062fb {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:53:15 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-590dc66a-cb9d-4902-b777-2f1c13402ceb tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "cd661ae0-c4bb-4117-847d-ef7e85d062fb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:53:15 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Instance destroyed successfully.
Apr 14 10:53:15 user nova-compute[71509]: DEBUG nova.compute.manager [None req-dd290e56-bab8-408d-ae0c-5073fb7030a6 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:53:15 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-f7f614b2-ece8-40b4-869c-c6572f5070cd tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] No BDM found with device name vda, not building metadata. {{(pid=71509) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 10:53:15 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-f7f614b2-ece8-40b4-869c-c6572f5070cd tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71509) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 10:53:15 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-f7f614b2-ece8-40b4-869c-c6572f5070cd tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] No VIF found with MAC fa:16:3e:e7:31:44, not building metadata {{(pid=71509) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 10:53:15 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-dd290e56-bab8-408d-ae0c-5073fb7030a6 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "8586a70e-9855-4177-ac1b-cf707a4df871" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.188s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:53:15 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-590dc66a-cb9d-4902-b777-2f1c13402ceb tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "cd661ae0-c4bb-4117-847d-ef7e85d062fb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:53:15 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-590dc66a-cb9d-4902-b777-2f1c13402ceb tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "cd661ae0-c4bb-4117-847d-ef7e85d062fb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:53:15 user nova-compute[71509]: INFO nova.compute.manager [None req-590dc66a-cb9d-4902-b777-2f1c13402ceb tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: cd661ae0-c4bb-4117-847d-ef7e85d062fb] Attaching volume e52b9d6a-ee3e-42b8-973e-d47c4ed33196 to /dev/vdb
Apr 14 10:53:15 user nova-compute[71509]: DEBUG os_brick.utils [None req-590dc66a-cb9d-4902-b777-2f1c13402ceb tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 10:53:15 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:53:15 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-f7f614b2-ece8-40b4-869c-c6572f5070cd tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.818s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:53:15 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:53:15 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd9e5ec7-7886-4300-a43e-52db523720f0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50119df3c417\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:53:15 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:53:15 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:53:15 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[563b2975-5a5d-4859-a417-ebbea33f1d02]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:53:15 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:53:15 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:53:15 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a55590e-51e7-4fc3-af18-e1aeeba89202]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:53:15 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[9263be7e-6e3f-419a-bfee-b174104f94f5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:53:15 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-590dc66a-cb9d-4902-b777-2f1c13402ceb tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Running cmd (subprocess): nvme version {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:53:15 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-590dc66a-cb9d-4902-b777-2f1c13402ceb tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] 'nvme version' failed. Not Retrying. {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 10:53:15 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.nvmeof [None req-590dc66a-cb9d-4902-b777-2f1c13402ceb tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] nvme not present on system {{(pid=71509) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 10:53:15 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:53:15 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 10:53:15 user nova-compute[71509]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 10:53:15 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[19aba28e-f344-4b11-bda5-8e3bc5fb874f]: (4, '') {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:53:15 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-590dc66a-cb9d-4902-b777-2f1c13402ceb tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71509) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 10:53:15 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-590dc66a-cb9d-4902-b777-2f1c13402ceb tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71509) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 10:53:15 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-590dc66a-cb9d-4902-b777-2f1c13402ceb tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] LIGHTOS: no hostnqn found. {{(pid=71509) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 10:53:15 user nova-compute[71509]: DEBUG os_brick.utils [None req-590dc66a-cb9d-4902-b777-2f1c13402ceb tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50119df3c417', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 10:53:15 user nova-compute[71509]: DEBUG nova.virt.block_device [None req-590dc66a-cb9d-4902-b777-2f1c13402ceb tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: cd661ae0-c4bb-4117-847d-ef7e85d062fb] Updating existing volume attachment record: d7efa2c7-9dc0-4eda-8af2-e88ddc631708 {{(pid=71509) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 10:53:16 user nova-compute[71509]: DEBUG nova.compute.manager [req-f5b8bd6f-88a9-422d-b63d-ead3f854b53c req-02f312dc-6607-4ebd-8d9d-cd01db75b25c service nova] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Received event network-vif-plugged-473d9af8-25a0-4e5a-9afb-7a0c843115cc {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:53:16 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-f5b8bd6f-88a9-422d-b63d-ead3f854b53c req-02f312dc-6607-4ebd-8d9d-cd01db75b25c service nova] Acquiring lock "8586a70e-9855-4177-ac1b-cf707a4df871-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:53:16 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-f5b8bd6f-88a9-422d-b63d-ead3f854b53c req-02f312dc-6607-4ebd-8d9d-cd01db75b25c service nova] Lock "8586a70e-9855-4177-ac1b-cf707a4df871-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:53:16 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-f5b8bd6f-88a9-422d-b63d-ead3f854b53c req-02f312dc-6607-4ebd-8d9d-cd01db75b25c service nova] Lock "8586a70e-9855-4177-ac1b-cf707a4df871-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:53:16 user nova-compute[71509]: DEBUG nova.compute.manager [req-f5b8bd6f-88a9-422d-b63d-ead3f854b53c req-02f312dc-6607-4ebd-8d9d-cd01db75b25c service nova] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] No waiting events found dispatching network-vif-plugged-473d9af8-25a0-4e5a-9afb-7a0c843115cc {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:53:16 user nova-compute[71509]: WARNING nova.compute.manager [req-f5b8bd6f-88a9-422d-b63d-ead3f854b53c req-02f312dc-6607-4ebd-8d9d-cd01db75b25c service nova] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Received unexpected event network-vif-plugged-473d9af8-25a0-4e5a-9afb-7a0c843115cc for instance with vm_state stopped and task_state None.
Apr 14 10:53:16 user nova-compute[71509]: INFO nova.compute.manager [None req-51a825e6-d2de-43b8-9609-e306d700ee53 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Rescuing
Apr 14 10:53:16 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-51a825e6-d2de-43b8-9609-e306d700ee53 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Acquiring lock "refresh_cache-d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:53:16 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-51a825e6-d2de-43b8-9609-e306d700ee53 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Acquired lock "refresh_cache-d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:53:16 user nova-compute[71509]: DEBUG nova.network.neutron [None req-51a825e6-d2de-43b8-9609-e306d700ee53 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Building network info cache for instance {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 10:53:17 user nova-compute[71509]: DEBUG nova.network.neutron [None req-51a825e6-d2de-43b8-9609-e306d700ee53 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Updating instance_info_cache with network_info: [{"id": "f2196ef3-aada-48d6-b524-5e9cef6a9eda", "address": "fa:16:3e:e7:31:44", "network": {"id": "22eb5f87-be4d-447d-bafe-25e0284ea3ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-787804772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf93e5dac50342d0b65ef09711401e99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2196ef3-aa", "ovs_interfaceid": "f2196ef3-aada-48d6-b524-5e9cef6a9eda", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:53:17 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-51a825e6-d2de-43b8-9609-e306d700ee53 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Releasing lock "refresh_cache-d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:53:17 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:53:18 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:53:18 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:53:18 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:53:18 user nova-compute[71509]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681469583.2687068, 3b4b6e3e-0743-4ee6-900c-3172b09eb0f2 => Stopped> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 10:53:18 user nova-compute[71509]: INFO nova.compute.manager [-] [instance: 3b4b6e3e-0743-4ee6-900c-3172b09eb0f2] VM Stopped (Lifecycle Event)
Apr 14 10:53:18 user nova-compute[71509]: DEBUG nova.compute.manager [None req-a0a96c38-e3ba-449f-8f77-b52fa8f8113e None None] [instance: 3b4b6e3e-0743-4ee6-900c-3172b09eb0f2] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:53:18 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:53:18 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:53:18 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:53:18 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Instance destroyed successfully.
Apr 14 10:53:18 user nova-compute[71509]: DEBUG nova.compute.manager [req-7eaa31cf-4c59-4aa5-9e1b-d4c69261c27e req-699acca6-b4c5-4672-a06f-189724f71861 service nova] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Received event network-vif-unplugged-f2196ef3-aada-48d6-b524-5e9cef6a9eda {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:53:18 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-7eaa31cf-4c59-4aa5-9e1b-d4c69261c27e req-699acca6-b4c5-4672-a06f-189724f71861 service nova] Acquiring lock "d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:53:18 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-7eaa31cf-4c59-4aa5-9e1b-d4c69261c27e req-699acca6-b4c5-4672-a06f-189724f71861 service nova] Lock "d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:53:18 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-7eaa31cf-4c59-4aa5-9e1b-d4c69261c27e req-699acca6-b4c5-4672-a06f-189724f71861 service nova] Lock "d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:53:18 user nova-compute[71509]: DEBUG nova.compute.manager [req-7eaa31cf-4c59-4aa5-9e1b-d4c69261c27e req-699acca6-b4c5-4672-a06f-189724f71861 service nova] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] No waiting events found dispatching network-vif-unplugged-f2196ef3-aada-48d6-b524-5e9cef6a9eda {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:53:18 user nova-compute[71509]: WARNING nova.compute.manager [req-7eaa31cf-4c59-4aa5-9e1b-d4c69261c27e req-699acca6-b4c5-4672-a06f-189724f71861 service nova] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Received unexpected event network-vif-unplugged-f2196ef3-aada-48d6-b524-5e9cef6a9eda for instance with vm_state active and task_state rescuing.
Apr 14 10:53:18 user nova-compute[71509]: DEBUG nova.compute.manager [req-7eaa31cf-4c59-4aa5-9e1b-d4c69261c27e req-699acca6-b4c5-4672-a06f-189724f71861 service nova] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Received event network-vif-plugged-f2196ef3-aada-48d6-b524-5e9cef6a9eda {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:53:18 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-7eaa31cf-4c59-4aa5-9e1b-d4c69261c27e req-699acca6-b4c5-4672-a06f-189724f71861 service nova] Acquiring lock "d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:53:18 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-7eaa31cf-4c59-4aa5-9e1b-d4c69261c27e req-699acca6-b4c5-4672-a06f-189724f71861 service nova] Lock "d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:53:18 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-7eaa31cf-4c59-4aa5-9e1b-d4c69261c27e req-699acca6-b4c5-4672-a06f-189724f71861 service nova] Lock "d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:53:18 user nova-compute[71509]: DEBUG nova.compute.manager [req-7eaa31cf-4c59-4aa5-9e1b-d4c69261c27e req-699acca6-b4c5-4672-a06f-189724f71861 service nova] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] No waiting events found dispatching network-vif-plugged-f2196ef3-aada-48d6-b524-5e9cef6a9eda {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:53:18 user nova-compute[71509]: WARNING nova.compute.manager [req-7eaa31cf-4c59-4aa5-9e1b-d4c69261c27e req-699acca6-b4c5-4672-a06f-189724f71861 service nova] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Received unexpected event network-vif-plugged-f2196ef3-aada-48d6-b524-5e9cef6a9eda for instance with vm_state active and task_state rescuing.
Apr 14 10:53:18 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-51a825e6-d2de-43b8-9609-e306d700ee53 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Attempting rescue
Apr 14 10:53:18 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-51a825e6-d2de-43b8-9609-e306d700ee53 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71509) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 14 10:53:18 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-51a825e6-d2de-43b8-9609-e306d700ee53 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Instance directory exists: not creating {{(pid=71509) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 14 10:53:18 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-51a825e6-d2de-43b8-9609-e306d700ee53 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Creating image(s)
Apr 14 10:53:18 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-51a825e6-d2de-43b8-9609-e306d700ee53 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Acquiring lock "/opt/stack/data/nova/instances/d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:53:18 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-51a825e6-d2de-43b8-9609-e306d700ee53 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "/opt/stack/data/nova/instances/d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:53:18 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-51a825e6-d2de-43b8-9609-e306d700ee53 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "/opt/stack/data/nova/instances/d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:53:18 user nova-compute[71509]: DEBUG nova.objects.instance [None req-51a825e6-d2de-43b8-9609-e306d700ee53 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lazy-loading 'trusted_certs' on Instance uuid d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:53:18 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-51a825e6-d2de-43b8-9609-e306d700ee53 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Acquiring lock "5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:53:18 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-51a825e6-d2de-43b8-9609-e306d700ee53 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:53:18 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-51a825e6-d2de-43b8-9609-e306d700ee53 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:53:18 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-51a825e6-d2de-43b8-9609-e306d700ee53 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json" returned: 0 in 0.138s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:53:18 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-51a825e6-d2de-43b8-9609-e306d700ee53 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18,backing_fmt=raw /opt/stack/data/nova/instances/d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5/disk.rescue {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:53:19 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-51a825e6-d2de-43b8-9609-e306d700ee53 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18,backing_fmt=raw /opt/stack/data/nova/instances/d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5/disk.rescue" returned: 0 in 0.055s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:53:19 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-51a825e6-d2de-43b8-9609-e306d700ee53 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.200s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:53:19 user nova-compute[71509]: DEBUG nova.objects.instance [None req-51a825e6-d2de-43b8-9609-e306d700ee53 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lazy-loading 'migration_context' on Instance uuid d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:53:19 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-51a825e6-d2de-43b8-9609-e306d700ee53 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Created local disks {{(pid=71509) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 10:53:19 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-51a825e6-d2de-43b8-9609-e306d700ee53 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Start _get_guest_xml network_info=[{"id": "f2196ef3-aada-48d6-b524-5e9cef6a9eda", "address": "fa:16:3e:e7:31:44", "network": {"id": "22eb5f87-be4d-447d-bafe-25e0284ea3ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-787804772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-787804772-network", "vif_mac": "fa:16:3e:e7:31:44"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf93e5dac50342d0b65ef09711401e99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2196ef3-aa", "ovs_interfaceid": "f2196ef3-aada-48d6-b524-5e9cef6a9eda", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T10:38:55Z,direct_url=<?>,disk_format='qcow2',id=048ec0ee-0465-448d-8b4c-f072acb101dc,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='9742d6ad20cf48d9bab0fdbcc9491db9',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T10:38:57Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '048ec0ee-0465-448d-8b4c-f072acb101dc', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=71509) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 10:53:19 user nova-compute[71509]: DEBUG nova.objects.instance [None req-51a825e6-d2de-43b8-9609-e306d700ee53 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lazy-loading 'resources' on Instance uuid d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:53:19 user nova-compute[71509]: DEBUG nova.objects.instance [None req-51a825e6-d2de-43b8-9609-e306d700ee53 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lazy-loading 'numa_topology' on Instance uuid d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:53:19 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-51a825e6-d2de-43b8-9609-e306d700ee53 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:53:19 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-51a825e6-d2de-43b8-9609-e306d700ee53 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:53:19 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-51a825e6-d2de-43b8-9609-e306d700ee53 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71509) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 10:53:19 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-51a825e6-d2de-43b8-9609-e306d700ee53 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T10:40:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T10:38:55Z,direct_url=<?>,disk_format='qcow2',id=048ec0ee-0465-448d-8b4c-f072acb101dc,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='9742d6ad20cf48d9bab0fdbcc9491db9',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T10:38:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 10:53:19 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-51a825e6-d2de-43b8-9609-e306d700ee53 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Flavor limits 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 10:53:19 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-51a825e6-d2de-43b8-9609-e306d700ee53 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Image limits 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 10:53:19 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-51a825e6-d2de-43b8-9609-e306d700ee53 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Flavor pref 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 10:53:19 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-51a825e6-d2de-43b8-9609-e306d700ee53 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Image pref 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 10:53:19 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-51a825e6-d2de-43b8-9609-e306d700ee53 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 10:53:19 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-51a825e6-d2de-43b8-9609-e306d700ee53 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 10:53:19 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-51a825e6-d2de-43b8-9609-e306d700ee53 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71509) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 10:53:19 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-51a825e6-d2de-43b8-9609-e306d700ee53 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Got 1 possible topologies {{(pid=71509) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 10:53:19 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-51a825e6-d2de-43b8-9609-e306d700ee53 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 10:53:19 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-51a825e6-d2de-43b8-9609-e306d700ee53 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 10:53:19 user nova-compute[71509]: DEBUG nova.objects.instance [None req-51a825e6-d2de-43b8-9609-e306d700ee53 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lazy-loading 'vcpu_model' on Instance uuid d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:53:19 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-51a825e6-d2de-43b8-9609-e306d700ee53 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T10:51:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1793508079',display_name='tempest-ServerRescueNegativeTestJSON-server-1793508079',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1793508079',id=22,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPCWcovyJGJoU2VVqBXHmxw2WqzQwe3JweQ4DFCyMODxzU7SfyIb92ARO4ehF+n8xN2UWQPLSSsVS3f1Va86nHzHvrj9cePHzTOq5SnHeWVBXyUULcZytrQgbP7FG6mgKQ==',key_name='tempest-keypair-1550009007',keypairs=<?>,launch_index=0,launched_at=2023-04-14T10:51:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bf93e5dac50342d0b65ef09711401e99',ramdisk_id='',reservation_id='r-qz8mgt4t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-563868574',owner_user_name='tempest-ServerRescueNegativeTestJSON-563868574-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T10:51:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e359578dcbb24755a216415053d415ef',uuid=d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f2196ef3-aada-48d6-b524-5e9cef6a9eda", "address": "fa:16:3e:e7:31:44", "network": {"id": "22eb5f87-be4d-447d-bafe-25e0284ea3ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-787804772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-787804772-network", "vif_mac": "fa:16:3e:e7:31:44"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf93e5dac50342d0b65ef09711401e99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2196ef3-aa", "ovs_interfaceid": "f2196ef3-aada-48d6-b524-5e9cef6a9eda", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71509) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 10:53:19 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-51a825e6-d2de-43b8-9609-e306d700ee53 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Converting VIF {"id": "f2196ef3-aada-48d6-b524-5e9cef6a9eda", "address": "fa:16:3e:e7:31:44", "network": {"id": "22eb5f87-be4d-447d-bafe-25e0284ea3ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-787804772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-787804772-network", "vif_mac": "fa:16:3e:e7:31:44"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf93e5dac50342d0b65ef09711401e99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2196ef3-aa", "ovs_interfaceid": "f2196ef3-aada-48d6-b524-5e9cef6a9eda", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:53:19 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-51a825e6-d2de-43b8-9609-e306d700ee53 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e7:31:44,bridge_name='br-int',has_traffic_filtering=True,id=f2196ef3-aada-48d6-b524-5e9cef6a9eda,network=Network(22eb5f87-be4d-447d-bafe-25e0284ea3ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2196ef3-aa') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:53:19 user nova-compute[71509]: DEBUG nova.objects.instance [None req-51a825e6-d2de-43b8-9609-e306d700ee53 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lazy-loading 'pci_devices' on Instance uuid d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:53:19 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-51a825e6-d2de-43b8-9609-e306d700ee53 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] End _get_guest_xml xml=<domain type="kvm">
Apr 14 10:53:19 user nova-compute[71509]:   <uuid>d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5</uuid>
Apr 14 10:53:19 user nova-compute[71509]:   <name>instance-00000016</name>
Apr 14 10:53:19 user nova-compute[71509]:   <memory>131072</memory>
Apr 14 10:53:19 user nova-compute[71509]:   <vcpu>1</vcpu>
Apr 14 10:53:19 user nova-compute[71509]:   <metadata>
Apr 14 10:53:19 user nova-compute[71509]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 10:53:19 user nova-compute[71509]:       <nova:package version="0.0.0"/>
Apr 14 10:53:19 user nova-compute[71509]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1793508079</nova:name>
Apr 14 10:53:19 user nova-compute[71509]:       <nova:creationTime>2023-04-14 10:53:19</nova:creationTime>
Apr 14 10:53:19 user nova-compute[71509]:       <nova:flavor name="m1.nano">
Apr 14 10:53:19 user nova-compute[71509]:         <nova:memory>128</nova:memory>
Apr 14 10:53:19 user nova-compute[71509]:         <nova:disk>1</nova:disk>
Apr 14 10:53:19 user nova-compute[71509]:         <nova:swap>0</nova:swap>
Apr 14 10:53:19 user nova-compute[71509]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 10:53:19 user nova-compute[71509]:         <nova:vcpus>1</nova:vcpus>
Apr 14 10:53:19 user nova-compute[71509]:       </nova:flavor>
Apr 14 10:53:19 user nova-compute[71509]:       <nova:owner>
Apr 14 10:53:19 user nova-compute[71509]:         <nova:user uuid="e359578dcbb24755a216415053d415ef">tempest-ServerRescueNegativeTestJSON-563868574-project-member</nova:user>
Apr 14 10:53:19 user nova-compute[71509]:         <nova:project uuid="bf93e5dac50342d0b65ef09711401e99">tempest-ServerRescueNegativeTestJSON-563868574</nova:project>
Apr 14 10:53:19 user nova-compute[71509]:       </nova:owner>
Apr 14 10:53:19 user nova-compute[71509]:       <nova:root type="image" uuid="048ec0ee-0465-448d-8b4c-f072acb101dc"/>
Apr 14 10:53:19 user nova-compute[71509]:       <nova:ports>
Apr 14 10:53:19 user nova-compute[71509]:         <nova:port uuid="f2196ef3-aada-48d6-b524-5e9cef6a9eda">
Apr 14 10:53:19 user nova-compute[71509]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 14 10:53:19 user nova-compute[71509]:         </nova:port>
Apr 14 10:53:19 user nova-compute[71509]:       </nova:ports>
Apr 14 10:53:19 user nova-compute[71509]:     </nova:instance>
Apr 14 10:53:19 user nova-compute[71509]:   </metadata>
Apr 14 10:53:19 user nova-compute[71509]:   <sysinfo type="smbios">
Apr 14 10:53:19 user nova-compute[71509]:     <system>
Apr 14 10:53:19 user nova-compute[71509]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 10:53:19 user nova-compute[71509]:       <entry name="product">OpenStack Nova</entry>
Apr 14 10:53:19 user nova-compute[71509]:       <entry name="version">0.0.0</entry>
Apr 14 10:53:19 user nova-compute[71509]:       <entry name="serial">d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5</entry>
Apr 14 10:53:19 user nova-compute[71509]:       <entry name="uuid">d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5</entry>
Apr 14 10:53:19 user nova-compute[71509]:       <entry name="family">Virtual Machine</entry>
Apr 14 10:53:19 user nova-compute[71509]:     </system>
Apr 14 10:53:19 user nova-compute[71509]:   </sysinfo>
Apr 14 10:53:19 user nova-compute[71509]:   <os>
Apr 14 10:53:19 user nova-compute[71509]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 10:53:19 user nova-compute[71509]:     <smbios mode="sysinfo"/>
Apr 14 10:53:19 user nova-compute[71509]:   </os>
Apr 14 10:53:19 user nova-compute[71509]:   <features>
Apr 14 10:53:19 user nova-compute[71509]:     <acpi/>
Apr 14 10:53:19 user nova-compute[71509]:     <apic/>
Apr 14 10:53:19 user nova-compute[71509]:     <vmcoreinfo/>
Apr 14 10:53:19 user nova-compute[71509]:   </features>
Apr 14 10:53:19 user nova-compute[71509]:   <clock offset="utc">
Apr 14 10:53:19 user nova-compute[71509]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 10:53:19 user nova-compute[71509]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 10:53:19 user nova-compute[71509]:     <timer name="hpet" present="no"/>
Apr 14 10:53:19 user nova-compute[71509]:   </clock>
Apr 14 10:53:19 user nova-compute[71509]:   <cpu mode="custom" match="exact">
Apr 14 10:53:19 user nova-compute[71509]:     <model>Nehalem</model>
Apr 14 10:53:19 user nova-compute[71509]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 10:53:19 user nova-compute[71509]:   </cpu>
Apr 14 10:53:19 user nova-compute[71509]:   <devices>
Apr 14 10:53:19 user nova-compute[71509]:     <disk type="file" device="disk">
Apr 14 10:53:19 user nova-compute[71509]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 10:53:19 user nova-compute[71509]:       <source file="/opt/stack/data/nova/instances/d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5/disk.rescue"/>
Apr 14 10:53:19 user nova-compute[71509]:       <target dev="vda" bus="virtio"/>
Apr 14 10:53:19 user nova-compute[71509]:     </disk>
Apr 14 10:53:19 user nova-compute[71509]:     <disk type="file" device="disk">
Apr 14 10:53:19 user nova-compute[71509]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 10:53:19 user nova-compute[71509]:       <source file="/opt/stack/data/nova/instances/d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5/disk"/>
Apr 14 10:53:19 user nova-compute[71509]:       <target dev="vdb" bus="virtio"/>
Apr 14 10:53:19 user nova-compute[71509]:     </disk>
Apr 14 10:53:19 user nova-compute[71509]:     <interface type="ethernet">
Apr 14 10:53:19 user nova-compute[71509]:       <mac address="fa:16:3e:e7:31:44"/>
Apr 14 10:53:19 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 10:53:19 user nova-compute[71509]:       <mtu size="1442"/>
Apr 14 10:53:19 user nova-compute[71509]:       <target dev="tapf2196ef3-aa"/>
Apr 14 10:53:19 user nova-compute[71509]:     </interface>
Apr 14 10:53:19 user nova-compute[71509]:     <serial type="pty">
Apr 14 10:53:19 user nova-compute[71509]:       <log file="/opt/stack/data/nova/instances/d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5/console.log" append="off"/>
Apr 14 10:53:19 user nova-compute[71509]:     </serial>
Apr 14 10:53:19 user nova-compute[71509]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 10:53:19 user nova-compute[71509]:     <video>
Apr 14 10:53:19 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 10:53:19 user nova-compute[71509]:     </video>
Apr 14 10:53:19 user nova-compute[71509]:     <rng model="virtio">
Apr 14 10:53:19 user nova-compute[71509]:       <backend model="random">/dev/urandom</backend>
Apr 14 10:53:19 user nova-compute[71509]:     </rng>
Apr 14 10:53:19 user nova-compute[71509]:     <controller type="usb" index="0" model="none"/>
Apr 14 10:53:19 user nova-compute[71509]:     <memballoon model="virtio">
Apr 14 10:53:19 user nova-compute[71509]:       <stats period="10"/>
Apr 14 10:53:19 user nova-compute[71509]:     </memballoon>
Apr 14 10:53:19 user nova-compute[71509]:   </devices>
Apr 14 10:53:19 user nova-compute[71509]: </domain>
Apr 14 10:53:19 user nova-compute[71509]:  {{(pid=71509) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 10:53:19 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Instance destroyed successfully.
Apr 14 10:53:19 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-51a825e6-d2de-43b8-9609-e306d700ee53 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] No BDM found with device name vda, not building metadata. {{(pid=71509) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 10:53:19 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-51a825e6-d2de-43b8-9609-e306d700ee53 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71509) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 10:53:19 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-51a825e6-d2de-43b8-9609-e306d700ee53 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] No VIF found with MAC fa:16:3e:e7:31:44, not building metadata {{(pid=71509) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 10:53:20 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-68635ce3-4c69-4b42-af80-02f641f61d3c tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Acquiring lock "fe152ebd-4f99-4fa8-bfdb-8744cdf3f387" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:53:20 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-68635ce3-4c69-4b42-af80-02f641f61d3c tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "fe152ebd-4f99-4fa8-bfdb-8744cdf3f387" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:53:20 user nova-compute[71509]: DEBUG nova.compute.manager [None req-68635ce3-4c69-4b42-af80-02f641f61d3c tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] Starting instance... {{(pid=71509) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 10:53:20 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-68635ce3-4c69-4b42-af80-02f641f61d3c tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:53:20 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-68635ce3-4c69-4b42-af80-02f641f61d3c tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:53:20 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-68635ce3-4c69-4b42-af80-02f641f61d3c tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71509) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 10:53:20 user nova-compute[71509]: INFO nova.compute.claims [None req-68635ce3-4c69-4b42-af80-02f641f61d3c tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] Claim successful on node user
Apr 14 10:53:20 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:53:20 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-590dc66a-cb9d-4902-b777-2f1c13402ceb tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: cd661ae0-c4bb-4117-847d-ef7e85d062fb] Calling os-brick to attach iSCSI Volume {{(pid=71509) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 10:53:20 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-590dc66a-cb9d-4902-b777-2f1c13402ceb tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0bf0749390>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e52b9d6a-ee3e-42b8-973e-d47c4ed33196', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YcfwqigL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 10:53:20 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-590dc66a-cb9d-4902-b777-2f1c13402ceb tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 10:53:20 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-590dc66a-cb9d-4902-b777-2f1c13402ceb tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 10:53:20 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-590dc66a-cb9d-4902-b777-2f1c13402ceb tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 10:53:20 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-590dc66a-cb9d-4902-b777-2f1c13402ceb tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 10:53:20 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-590dc66a-cb9d-4902-b777-2f1c13402ceb tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e52b9d6a-ee3e-42b8-973e-d47c4ed33196" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 10:53:20 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-590dc66a-cb9d-4902-b777-2f1c13402ceb tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e52b9d6a-ee3e-42b8-973e-d47c4ed33196" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 10:53:20 user nova-compute[71509]: INFO os_brick.initiator.connectors.iscsi [None req-590dc66a-cb9d-4902-b777-2f1c13402ceb tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 10:53:20 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e52b9d6a-ee3e-42b8-973e-d47c4ed33196 -p 172.16.0.220:3260 {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:53:20 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:53:20 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:53:20 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:53:20 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e52b9d6a-ee3e-42b8-973e-d47c4ed33196 -p 172.16.0.220:3260" returned: 21 in 0.033s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:53:20 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e357183-690b-488b-b5ad-52d8b3f2d26e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:53:20 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-590dc66a-cb9d-4902-b777-2f1c13402ceb tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 10:53:20 user nova-compute[71509]:  {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:53:20 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e52b9d6a-ee3e-42b8-973e-d47c4ed33196 -p 172.16.0.220:3260 --interface default --op new {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:53:20 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e52b9d6a-ee3e-42b8-973e-d47c4ed33196 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:53:20 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce59ac0d-d3ce-4474-b270-5268fdf3c426]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e52b9d6a-ee3e-42b8-973e-d47c4ed33196] added\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:53:20 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-590dc66a-cb9d-4902-b777-2f1c13402ceb tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e52b9d6a-ee3e-42b8-973e-d47c4ed33196] added
Apr 14 10:53:20 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:53:20 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e52b9d6a-ee3e-42b8-973e-d47c4ed33196 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:53:20 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e52b9d6a-ee3e-42b8-973e-d47c4ed33196 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:53:20 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[604a80af-496f-4abb-9f96-098896496c52]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:53:20 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-590dc66a-cb9d-4902-b777-2f1c13402ceb tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:53:20 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e52b9d6a-ee3e-42b8-973e-d47c4ed33196 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:53:20 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e52b9d6a-ee3e-42b8-973e-d47c4ed33196 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:53:20 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a41f969-bf86-4424-a263-3908b932ec0a]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:53:20 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-590dc66a-cb9d-4902-b777-2f1c13402ceb tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:53:20 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e52b9d6a-ee3e-42b8-973e-d47c4ed33196 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YcfwqigL {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:53:20 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-68635ce3-4c69-4b42-af80-02f641f61d3c tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 10:53:20 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e52b9d6a-ee3e-42b8-973e-d47c4ed33196 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YcfwqigL" returned: 0 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:53:20 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[77ff6bb7-686e-4bbe-983c-e73687858ba7]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:53:20 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-590dc66a-cb9d-4902-b777-2f1c13402ceb tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YcfwqigL'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:53:20 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e52b9d6a-ee3e-42b8-973e-d47c4ed33196 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:53:20 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-68635ce3-4c69-4b42-af80-02f641f61d3c tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 10:53:20 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e52b9d6a-ee3e-42b8-973e-d47c4ed33196 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:53:20 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[bac3ff7b-0794-4ce1-b3f8-ae28282995f5]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:53:20 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-590dc66a-cb9d-4902-b777-2f1c13402ceb tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:53:20 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:53:20 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-68635ce3-4c69-4b42-af80-02f641f61d3c tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.517s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:53:20 user nova-compute[71509]: DEBUG nova.compute.manager [None req-68635ce3-4c69-4b42-af80-02f641f61d3c tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] Start building networks asynchronously for instance. {{(pid=71509) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 10:53:20 user nova-compute[71509]: DEBUG nova.compute.manager [req-8eef8ea0-bb03-443f-a135-f7beebca7c45 req-8fbc0113-d1e0-41c4-a050-3602df5df554 service nova] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Received event network-vif-plugged-f2196ef3-aada-48d6-b524-5e9cef6a9eda {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:53:20 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-8eef8ea0-bb03-443f-a135-f7beebca7c45 req-8fbc0113-d1e0-41c4-a050-3602df5df554 service nova] Acquiring lock "d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:53:20 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-8eef8ea0-bb03-443f-a135-f7beebca7c45 req-8fbc0113-d1e0-41c4-a050-3602df5df554 service nova] Lock "d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:53:20 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-8eef8ea0-bb03-443f-a135-f7beebca7c45 req-8fbc0113-d1e0-41c4-a050-3602df5df554 service nova] Lock "d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:53:20 user nova-compute[71509]: DEBUG nova.compute.manager [req-8eef8ea0-bb03-443f-a135-f7beebca7c45 req-8fbc0113-d1e0-41c4-a050-3602df5df554 service nova] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] No waiting events found dispatching network-vif-plugged-f2196ef3-aada-48d6-b524-5e9cef6a9eda {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:53:20 user nova-compute[71509]: WARNING nova.compute.manager [req-8eef8ea0-bb03-443f-a135-f7beebca7c45 req-8fbc0113-d1e0-41c4-a050-3602df5df554 service nova] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Received unexpected event network-vif-plugged-f2196ef3-aada-48d6-b524-5e9cef6a9eda for instance with vm_state active and task_state rescuing.
Apr 14 10:53:20 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:53:20 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ad1cd7e-88de-466f-8ce6-9db7c5f60d96]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7941e1c1-c0c5-4459-9b3e-e09e2d755f77 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08f71190-2402-402d-af67-edf9226e4fb8 (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:53:20 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-590dc66a-cb9d-4902-b777-2f1c13402ceb tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)
Apr 14 10:53:20 user nova-compute[71509]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe (non-flash)
Apr 14 10:53:20 user nova-compute[71509]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7941e1c1-c0c5-4459-9b3e-e09e2d755f77 (non-flash)
Apr 14 10:53:20 user nova-compute[71509]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08f71190-2402-402d-af67-edf9226e4fb8 (non-flash)
Apr 14 10:53:20 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:53:20 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-590dc66a-cb9d-4902-b777-2f1c13402ceb tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)
Apr 14 10:53:20 user nova-compute[71509]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe (non-flash)
Apr 14 10:53:20 user nova-compute[71509]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7941e1c1-c0c5-4459-9b3e-e09e2d755f77 (non-flash)
Apr 14 10:53:20 user nova-compute[71509]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08f71190-2402-402d-af67-edf9226e4fb8 (non-flash)
Apr 14 10:53:20 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 10:53:20 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e52b9d6a-ee3e-42b8-973e-d47c4ed33196 -p 172.16.0.220:3260 --login {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:53:20 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:53:20 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:53:20 user nova-compute[71509]: DEBUG nova.compute.manager [None req-68635ce3-4c69-4b42-af80-02f641f61d3c tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] Allocating IP information in the background. {{(pid=71509) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 10:53:20 user nova-compute[71509]: DEBUG nova.network.neutron [None req-68635ce3-4c69-4b42-af80-02f641f61d3c tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] allocate_for_instance() {{(pid=71509) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 10:53:20 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e52b9d6a-ee3e-42b8-973e-d47c4ed33196 -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:53:20 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[f04f3e23-bb73-4247-ade0-7a4e51503438]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e52b9d6a-ee3e-42b8-973e-d47c4ed33196, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e52b9d6a-ee3e-42b8-973e-d47c4ed33196, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:53:20 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-590dc66a-cb9d-4902-b777-2f1c13402ceb tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e52b9d6a-ee3e-42b8-973e-d47c4ed33196, portal: 172.16.0.220,3260]
Apr 14 10:53:20 user nova-compute[71509]: Login to [iface: default, target: iqn.2010-10.org.openstack:e52b9d6a-ee3e-42b8-973e-d47c4ed33196, portal: 172.16.0.220,3260] successful.
Apr 14 10:53:20 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:53:20 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e52b9d6a-ee3e-42b8-973e-d47c4ed33196 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:53:21 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-68635ce3-4c69-4b42-af80-02f641f61d3c tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 10:53:21 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e52b9d6a-ee3e-42b8-973e-d47c4ed33196 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:53:21 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[65bd890c-9913-4385-8560-68c80f419eb3]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:53:21 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-590dc66a-cb9d-4902-b777-2f1c13402ceb tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:53:21 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:53:21 user nova-compute[71509]: DEBUG nova.compute.manager [None req-68635ce3-4c69-4b42-af80-02f641f61d3c tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] Start building block device mappings for instance. {{(pid=71509) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 10:53:21 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:53:21 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a40b0c6-59ab-4256-9e76-a625aa6956f0]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7941e1c1-c0c5-4459-9b3e-e09e2d755f77 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08f71190-2402-402d-af67-edf9226e4fb8 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52b9d6a-ee3e-42b8-973e-d47c4ed33196 (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:53:21 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-590dc66a-cb9d-4902-b777-2f1c13402ceb tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)
Apr 14 10:53:21 user nova-compute[71509]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe (non-flash)
Apr 14 10:53:21 user nova-compute[71509]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7941e1c1-c0c5-4459-9b3e-e09e2d755f77 (non-flash)
Apr 14 10:53:21 user nova-compute[71509]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08f71190-2402-402d-af67-edf9226e4fb8 (non-flash)
Apr 14 10:53:21 user nova-compute[71509]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52b9d6a-ee3e-42b8-973e-d47c4ed33196 (non-flash)
Apr 14 10:53:21 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:53:21 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-590dc66a-cb9d-4902-b777-2f1c13402ceb tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)
Apr 14 10:53:21 user nova-compute[71509]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe (non-flash)
Apr 14 10:53:21 user nova-compute[71509]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7941e1c1-c0c5-4459-9b3e-e09e2d755f77 (non-flash)
Apr 14 10:53:21 user nova-compute[71509]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08f71190-2402-402d-af67-edf9226e4fb8 (non-flash)
Apr 14 10:53:21 user nova-compute[71509]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52b9d6a-ee3e-42b8-973e-d47c4ed33196 (non-flash)
Apr 14 10:53:21 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 10:53:21 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-590dc66a-cb9d-4902-b777-2f1c13402ceb tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e52b9d6a-ee3e-42b8-973e-d47c4ed33196" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.390s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 10:53:21 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-590dc66a-cb9d-4902-b777-2f1c13402ceb tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Connected to 172.16.0.220:3260 {{(pid=71509) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 10:53:21 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-590dc66a-cb9d-4902-b777-2f1c13402ceb tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] HCTL ('37', '-', '-', 0) found on session 34 with lun 0 {{(pid=71509) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 10:53:21 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-590dc66a-cb9d-4902-b777-2f1c13402ceb tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=71509) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 10:53:21 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:53:21 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:53:21 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d4c4f02-ee32-4e19-add1-bb6793921e48]: (4, ('- - 0', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:53:21 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-590dc66a-cb9d-4902-b777-2f1c13402ceb tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Searching for a device in session 34 and hctl ['37', '*', '*', 0] yield: None {{(pid=71509) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 10:53:21 user nova-compute[71509]: DEBUG nova.policy [None req-68635ce3-4c69-4b42-af80-02f641f61d3c tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5afd3930d3a14aff8124a4782ec79870', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8a9941095d445f48d70df26d8c90e6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71509) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 10:53:21 user nova-compute[71509]: DEBUG nova.compute.manager [None req-68635ce3-4c69-4b42-af80-02f641f61d3c tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] Start spawning the instance on the hypervisor. {{(pid=71509) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 10:53:21 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-68635ce3-4c69-4b42-af80-02f641f61d3c tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] Creating instance directory {{(pid=71509) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 10:53:21 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-68635ce3-4c69-4b42-af80-02f641f61d3c tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] Creating image(s)
Apr 14 10:53:21 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-68635ce3-4c69-4b42-af80-02f641f61d3c tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Acquiring lock "/opt/stack/data/nova/instances/fe152ebd-4f99-4fa8-bfdb-8744cdf3f387/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:53:21 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-68635ce3-4c69-4b42-af80-02f641f61d3c tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "/opt/stack/data/nova/instances/fe152ebd-4f99-4fa8-bfdb-8744cdf3f387/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:53:21 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-68635ce3-4c69-4b42-af80-02f641f61d3c tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "/opt/stack/data/nova/instances/fe152ebd-4f99-4fa8-bfdb-8744cdf3f387/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:53:21 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-68635ce3-4c69-4b42-af80-02f641f61d3c tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:53:21 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-68635ce3-4c69-4b42-af80-02f641f61d3c tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json" returned: 0 in 0.143s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:53:21 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-68635ce3-4c69-4b42-af80-02f641f61d3c tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Acquiring lock "5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:53:21 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-68635ce3-4c69-4b42-af80-02f641f61d3c tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:53:21 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-68635ce3-4c69-4b42-af80-02f641f61d3c tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:53:21 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-68635ce3-4c69-4b42-af80-02f641f61d3c tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json" returned: 0 in 0.147s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:53:21 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-68635ce3-4c69-4b42-af80-02f641f61d3c tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18,backing_fmt=raw /opt/stack/data/nova/instances/fe152ebd-4f99-4fa8-bfdb-8744cdf3f387/disk 1073741824 {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:53:21 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-68635ce3-4c69-4b42-af80-02f641f61d3c tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18,backing_fmt=raw /opt/stack/data/nova/instances/fe152ebd-4f99-4fa8-bfdb-8744cdf3f387/disk 1073741824" returned: 0 in 0.051s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:53:21 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-68635ce3-4c69-4b42-af80-02f641f61d3c tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.204s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:53:21 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-68635ce3-4c69-4b42-af80-02f641f61d3c tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:53:21 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-68635ce3-4c69-4b42-af80-02f641f61d3c tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json" returned: 0 in 0.139s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:53:21 user nova-compute[71509]: DEBUG nova.virt.disk.api [None req-68635ce3-4c69-4b42-af80-02f641f61d3c tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fe152ebd-4f99-4fa8-bfdb-8744cdf3f387/disk. size=1073741824 {{(pid=71509) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 10:53:21 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-68635ce3-4c69-4b42-af80-02f641f61d3c tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe152ebd-4f99-4fa8-bfdb-8744cdf3f387/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:53:21 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-68635ce3-4c69-4b42-af80-02f641f61d3c tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe152ebd-4f99-4fa8-bfdb-8744cdf3f387/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:53:21 user nova-compute[71509]: DEBUG nova.virt.disk.api [None req-68635ce3-4c69-4b42-af80-02f641f61d3c tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Cannot resize image /opt/stack/data/nova/instances/fe152ebd-4f99-4fa8-bfdb-8744cdf3f387/disk to a smaller size. {{(pid=71509) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 10:53:21 user nova-compute[71509]: DEBUG nova.objects.instance [None req-68635ce3-4c69-4b42-af80-02f641f61d3c tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lazy-loading 'migration_context' on Instance uuid fe152ebd-4f99-4fa8-bfdb-8744cdf3f387 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:53:21 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-68635ce3-4c69-4b42-af80-02f641f61d3c tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] Created local disks {{(pid=71509) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 10:53:21 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-68635ce3-4c69-4b42-af80-02f641f61d3c tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] Ensure instance console log exists: /opt/stack/data/nova/instances/fe152ebd-4f99-4fa8-bfdb-8744cdf3f387/console.log {{(pid=71509) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 10:53:21 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-68635ce3-4c69-4b42-af80-02f641f61d3c tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:53:21 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-68635ce3-4c69-4b42-af80-02f641f61d3c tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:53:21 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-68635ce3-4c69-4b42-af80-02f641f61d3c tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:53:21 user nova-compute[71509]: DEBUG nova.network.neutron [None req-68635ce3-4c69-4b42-af80-02f641f61d3c tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] Successfully created port: 1a142b11-f1ec-41d4-9728-f9f0de9a96ff {{(pid=71509) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 10:53:22 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-c8a08757-0c90-4658-b71e-304518b9a45d tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Acquiring lock "3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:53:22 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-c8a08757-0c90-4658-b71e-304518b9a45d tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Lock "3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:53:22 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-590dc66a-cb9d-4902-b777-2f1c13402ceb tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Searching for a device in session 34 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71509) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 10:53:22 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-590dc66a-cb9d-4902-b777-2f1c13402ceb tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:e52b9d6a-ee3e-42b8-973e-d47c4ed33196', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YcfwqigL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71509) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 10:53:22 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-590dc66a-cb9d-4902-b777-2f1c13402ceb tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.424s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 10:53:22 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-590dc66a-cb9d-4902-b777-2f1c13402ceb tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] <== connect_volume: return (1426ms) {'type': 'block', 'scsi_wwn': '26664313232346235', 'path': '/dev/sdf'} {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 10:53:22 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-590dc66a-cb9d-4902-b777-2f1c13402ceb tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: cd661ae0-c4bb-4117-847d-ef7e85d062fb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26664313232346235', 'path': '/dev/sdf'} {{(pid=71509) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 10:53:22 user nova-compute[71509]: DEBUG nova.objects.instance [None req-590dc66a-cb9d-4902-b777-2f1c13402ceb tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lazy-loading 'flavor' on Instance uuid cd661ae0-c4bb-4117-847d-ef7e85d062fb {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:53:22 user nova-compute[71509]: INFO nova.compute.manager [None req-c8a08757-0c90-4658-b71e-304518b9a45d tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] [instance: 3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d] Detaching volume 7941e1c1-c0c5-4459-9b3e-e09e2d755f77
Apr 14 10:53:22 user nova-compute[71509]: DEBUG nova.virt.libvirt.guest [None req-590dc66a-cb9d-4902-b777-2f1c13402ceb tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 10:53:22 user nova-compute[71509]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 10:53:22 user nova-compute[71509]:   <source dev="/dev/sdf"/>
Apr 14 10:53:22 user nova-compute[71509]:   <target dev="vdb" bus="virtio"/>
Apr 14 10:53:22 user nova-compute[71509]:   <serial>e52b9d6a-ee3e-42b8-973e-d47c4ed33196</serial>
Apr 14 10:53:22 user nova-compute[71509]: </disk>
Apr 14 10:53:22 user nova-compute[71509]:  {{(pid=71509) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 10:53:22 user nova-compute[71509]: INFO nova.virt.block_device [None req-c8a08757-0c90-4658-b71e-304518b9a45d tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] [instance: 3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d] Attempting to driver detach volume 7941e1c1-c0c5-4459-9b3e-e09e2d755f77 from mountpoint /dev/vdb
Apr 14 10:53:22 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-c8a08757-0c90-4658-b71e-304518b9a45d tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Attempting to detach device vdb from instance 3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d from the persistent domain config. {{(pid=71509) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 10:53:22 user nova-compute[71509]: DEBUG nova.virt.libvirt.guest [None req-c8a08757-0c90-4658-b71e-304518b9a45d tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 10:53:22 user nova-compute[71509]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 10:53:22 user nova-compute[71509]:   <source dev="/dev/sde"/>
Apr 14 10:53:22 user nova-compute[71509]:   <target dev="vdb" bus="virtio"/>
Apr 14 10:53:22 user nova-compute[71509]:   <serial>7941e1c1-c0c5-4459-9b3e-e09e2d755f77</serial>
Apr 14 10:53:22 user nova-compute[71509]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 10:53:22 user nova-compute[71509]: </disk>
Apr 14 10:53:22 user nova-compute[71509]:  {{(pid=71509) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 10:53:22 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-c8a08757-0c90-4658-b71e-304518b9a45d tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Successfully detached device vdb from instance 3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d from the persistent domain config.
Apr 14 10:53:22 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-c8a08757-0c90-4658-b71e-304518b9a45d tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d from the live domain config. {{(pid=71509) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 10:53:22 user nova-compute[71509]: DEBUG nova.virt.libvirt.guest [None req-c8a08757-0c90-4658-b71e-304518b9a45d tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 10:53:22 user nova-compute[71509]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 10:53:22 user nova-compute[71509]:   <source dev="/dev/sde"/>
Apr 14 10:53:22 user nova-compute[71509]:   <target dev="vdb" bus="virtio"/>
Apr 14 10:53:22 user nova-compute[71509]:   <serial>7941e1c1-c0c5-4459-9b3e-e09e2d755f77</serial>
Apr 14 10:53:22 user nova-compute[71509]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 10:53:22 user nova-compute[71509]: </disk>
Apr 14 10:53:22 user nova-compute[71509]:  {{(pid=71509) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 10:53:22 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-fe2a649d-f9a1-4f5e-88e3-10eec05a4ed6 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Acquiring lock "3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:53:22 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-590dc66a-cb9d-4902-b777-2f1c13402ceb tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] No BDM found with device name vda, not building metadata. {{(pid=71509) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 10:53:22 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-590dc66a-cb9d-4902-b777-2f1c13402ceb tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71509) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 10:53:22 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-590dc66a-cb9d-4902-b777-2f1c13402ceb tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] No VIF found with MAC fa:16:3e:d2:b7:64, not building metadata {{(pid=71509) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 10:53:22 user nova-compute[71509]: DEBUG nova.network.neutron [None req-68635ce3-4c69-4b42-af80-02f641f61d3c tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] Successfully updated port: 1a142b11-f1ec-41d4-9728-f9f0de9a96ff {{(pid=71509) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 10:53:22 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-590dc66a-cb9d-4902-b777-2f1c13402ceb tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "cd661ae0-c4bb-4117-847d-ef7e85d062fb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.232s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:53:22 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-68635ce3-4c69-4b42-af80-02f641f61d3c tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Acquiring lock "refresh_cache-fe152ebd-4f99-4fa8-bfdb-8744cdf3f387" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:53:22 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-68635ce3-4c69-4b42-af80-02f641f61d3c tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Acquired lock "refresh_cache-fe152ebd-4f99-4fa8-bfdb-8744cdf3f387" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:53:22 user nova-compute[71509]: DEBUG nova.network.neutron [None req-68635ce3-4c69-4b42-af80-02f641f61d3c tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] Building network info cache for instance {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 10:53:22 user nova-compute[71509]: DEBUG nova.compute.manager [req-040416f1-66c0-4241-a87e-8a861f9f2f31 req-6b8bccf6-39bb-48af-8d02-48af350d7ba8 service nova] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] Received event network-changed-1a142b11-f1ec-41d4-9728-f9f0de9a96ff {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:53:22 user nova-compute[71509]: DEBUG nova.compute.manager [req-040416f1-66c0-4241-a87e-8a861f9f2f31 req-6b8bccf6-39bb-48af-8d02-48af350d7ba8 service nova] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] Refreshing instance network info cache due to event network-changed-1a142b11-f1ec-41d4-9728-f9f0de9a96ff. {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 10:53:22 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-040416f1-66c0-4241-a87e-8a861f9f2f31 req-6b8bccf6-39bb-48af-8d02-48af350d7ba8 service nova] Acquiring lock "refresh_cache-fe152ebd-4f99-4fa8-bfdb-8744cdf3f387" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:53:22 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Received event <DeviceRemovedEvent: 1681469602.8588188, 3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71509) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 10:53:22 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-c8a08757-0c90-4658-b71e-304518b9a45d tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d {{(pid=71509) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 10:53:22 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-c8a08757-0c90-4658-b71e-304518b9a45d tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Successfully detached device vdb from instance 3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d from the live domain config.
Apr 14 10:53:22 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8a08757-0c90-4658-b71e-304518b9a45d tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] [instance: 3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d] calling os-brick to detach iSCSI Volume {{(pid=71509) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 10:53:22 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8a08757-0c90-4658-b71e-304518b9a45d tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0bf0749390>, {'target_iqn': 'iqn.2010-10.org.openstack:7941e1c1-c0c5-4459-9b3e-e09e2d755f77', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KSJwnpuc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 10:53:22 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-c8a08757-0c90-4658-b71e-304518b9a45d tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 10:53:22 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-c8a08757-0c90-4658-b71e-304518b9a45d tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 10:53:22 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-c8a08757-0c90-4658-b71e-304518b9a45d tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 10:53:22 user nova-compute[71509]: DEBUG nova.network.neutron [None req-68635ce3-4c69-4b42-af80-02f641f61d3c tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] Instance cache missing network info. {{(pid=71509) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 10:53:22 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:53:22 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:53:22 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[dda6a00d-479d-4dbf-931e-11b491b57f2c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e52b9d6a-ee3e-42b8-973e-d47c4ed33196\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:08f71190-2402-402d-af67-edf9226e4fb8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7941e1c1-c0c5-4459-9b3e-e09e2d755f77\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:53:22 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8a08757-0c90-4658-b71e-304518b9a45d tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 10:53:22 user nova-compute[71509]: No targets found.
Apr 14 10:53:22 user nova-compute[71509]: iSNS:
Apr 14 10:53:22 user nova-compute[71509]: No targets found.
Apr 14 10:53:22 user nova-compute[71509]: STATIC:
Apr 14 10:53:22 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe
Apr 14 10:53:22 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:53:22 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:53:22 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:e52b9d6a-ee3e-42b8-973e-d47c4ed33196
Apr 14 10:53:22 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:53:22 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:53:22 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:08f71190-2402-402d-af67-edf9226e4fb8
Apr 14 10:53:22 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:53:22 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:53:22 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:7941e1c1-c0c5-4459-9b3e-e09e2d755f77
Apr 14 10:53:22 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:53:22 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:53:22 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178
Apr 14 10:53:22 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:53:22 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:53:22 user nova-compute[71509]: FIRMWARE:
Apr 14 10:53:22 user nova-compute[71509]: No targets found.
Apr 14 10:53:22 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:53:22 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8a08757-0c90-4658-b71e-304518b9a45d tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 10:53:22 user nova-compute[71509]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 10:53:22 user nova-compute[71509]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71509) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 10:53:22 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8a08757-0c90-4658-b71e-304518b9a45d tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7941e1c1-c0c5-4459-9b3e-e09e2d755f77', 0)] {{(pid=71509) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 10:53:22 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:53:22 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:53:22 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[690362d8-c110-4582-a3d9-d128b833eb04]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:08f71190-2402-402d-af67-edf9226e4fb8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7941e1c1-c0c5-4459-9b3e-e09e2d755f77\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e52b9d6a-ee3e-42b8-973e-d47c4ed33196\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:53:22 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:53:22 user nova-compute[71509]: DEBUG nova.compute.manager [req-3aa99f44-aacf-4aa2-87f7-7beedcbf1f49 req-d3bda36a-2261-4427-a3fd-0995b52d9419 service nova] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Received event network-vif-plugged-f2196ef3-aada-48d6-b524-5e9cef6a9eda {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:53:22 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-3aa99f44-aacf-4aa2-87f7-7beedcbf1f49 req-d3bda36a-2261-4427-a3fd-0995b52d9419 service nova] Acquiring lock "d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:53:22 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-3aa99f44-aacf-4aa2-87f7-7beedcbf1f49 req-d3bda36a-2261-4427-a3fd-0995b52d9419 service nova] Lock "d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:53:22 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-3aa99f44-aacf-4aa2-87f7-7beedcbf1f49 req-d3bda36a-2261-4427-a3fd-0995b52d9419 service nova] Lock "d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:53:22 user nova-compute[71509]: DEBUG nova.compute.manager [req-3aa99f44-aacf-4aa2-87f7-7beedcbf1f49 req-d3bda36a-2261-4427-a3fd-0995b52d9419 service nova] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] No waiting events found dispatching network-vif-plugged-f2196ef3-aada-48d6-b524-5e9cef6a9eda {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:53:22 user nova-compute[71509]: WARNING nova.compute.manager [req-3aa99f44-aacf-4aa2-87f7-7beedcbf1f49 req-d3bda36a-2261-4427-a3fd-0995b52d9419 service nova] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Received unexpected event network-vif-plugged-f2196ef3-aada-48d6-b524-5e9cef6a9eda for instance with vm_state active and task_state rescuing.
Apr 14 10:53:22 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:53:22 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[6013c756-2986-46ea-a4e4-b3bcf160c0b8]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7941e1c1-c0c5-4459-9b3e-e09e2d755f77 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08f71190-2402-402d-af67-edf9226e4fb8 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52b9d6a-ee3e-42b8-973e-d47c4ed33196 (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:53:22 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8a08757-0c90-4658-b71e-304518b9a45d tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)
Apr 14 10:53:22 user nova-compute[71509]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe (non-flash)
Apr 14 10:53:22 user nova-compute[71509]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7941e1c1-c0c5-4459-9b3e-e09e2d755f77 (non-flash)
Apr 14 10:53:22 user nova-compute[71509]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08f71190-2402-402d-af67-edf9226e4fb8 (non-flash)
Apr 14 10:53:22 user nova-compute[71509]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52b9d6a-ee3e-42b8-973e-d47c4ed33196 (non-flash)
Apr 14 10:53:22 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:53:22 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8a08757-0c90-4658-b71e-304518b9a45d tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)
Apr 14 10:53:22 user nova-compute[71509]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe (non-flash)
Apr 14 10:53:22 user nova-compute[71509]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7941e1c1-c0c5-4459-9b3e-e09e2d755f77 (non-flash)
Apr 14 10:53:22 user nova-compute[71509]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08f71190-2402-402d-af67-edf9226e4fb8 (non-flash)
Apr 14 10:53:22 user nova-compute[71509]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52b9d6a-ee3e-42b8-973e-d47c4ed33196 (non-flash)
Apr 14 10:53:22 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 10:53:22 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8a08757-0c90-4658-b71e-304518b9a45d tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0bf05809d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7941e1c1-c0c5-4459-9b3e-e09e2d755f77'): ({'sde'}, set())}) {{(pid=71509) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 10:53:22 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-c8a08757-0c90-4658-b71e-304518b9a45d tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Removing single pathed devices sde {{(pid=71509) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 10:53:22 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:53:22 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:53:22 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[19dac5f9-e5cb-4aef-ba7f-9f0d8a487fd9]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:53:22 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:53:23 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:53:23 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[08874196-f03d-4506-bcd6-250a1a821e40]: (4, ('ok\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:53:23 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-c8a08757-0c90-4658-b71e-304518b9a45d tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Flushing IO for device /dev/sde {{(pid=71509) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 10:53:23 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:53:23 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:53:23 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:53:23 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a1eda33-03bf-4cd8-b841-a1981c37b1e4]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:53:23 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-c8a08757-0c90-4658-b71e-304518b9a45d tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71509) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 10:53:23 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:53:23 user nova-compute[71509]: DEBUG nova.virt.libvirt.host [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Removed pending event for d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5 due to event {{(pid=71509) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 10:53:23 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681469603.026318, d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5 => Resumed> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 10:53:23 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] VM Resumed (Lifecycle Event)
Apr 14 10:53:23 user nova-compute[71509]: DEBUG nova.compute.manager [None req-51a825e6-d2de-43b8-9609-e306d700ee53 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:53:23 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:53:23 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 10:53:23 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.047s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:53:23 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f5b476e-1190-43a0-aaa2-9d908cdefde1]: (4, ('1', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:53:23 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-c8a08757-0c90-4658-b71e-304518b9a45d tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71509) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 10:53:23 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-c8a08757-0c90-4658-b71e-304518b9a45d tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] SCSI volumes sde have been removed. {{(pid=71509) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 10:53:23 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8a08757-0c90-4658-b71e-304518b9a45d tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7941e1c1-c0c5-4459-9b3e-e09e2d755f77')] {{(pid=71509) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 10:53:23 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7941e1c1-c0c5-4459-9b3e-e09e2d755f77 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:53:23 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 14 10:53:23 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681469603.0271695, d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5 => Started> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 10:53:23 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] VM Started (Lifecycle Event)
Apr 14 10:53:23 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7941e1c1-c0c5-4459-9b3e-e09e2d755f77 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:53:23 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[71c4b5d4-b570-4a06-b767-46aa1c7e5c73]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:53:23 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8a08757-0c90-4658-b71e-304518b9a45d tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:53:23 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7941e1c1-c0c5-4459-9b3e-e09e2d755f77 -p 172.16.0.220:3260 --logout {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:53:23 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:53:23 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 10:53:23 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7941e1c1-c0c5-4459-9b3e-e09e2d755f77 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:53:23 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8675b4f-11fe-42d8-8a06-878b4e7acea6]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:7941e1c1-c0c5-4459-9b3e-e09e2d755f77, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:7941e1c1-c0c5-4459-9b3e-e09e2d755f77, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:53:23 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8a08757-0c90-4658-b71e-304518b9a45d tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:7941e1c1-c0c5-4459-9b3e-e09e2d755f77, portal: 172.16.0.220,3260]
Apr 14 10:53:23 user nova-compute[71509]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:7941e1c1-c0c5-4459-9b3e-e09e2d755f77, portal: 172.16.0.220,3260] successful.
Apr 14 10:53:23 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:53:23 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7941e1c1-c0c5-4459-9b3e-e09e2d755f77 -p 172.16.0.220:3260 --op delete {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:53:23 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7941e1c1-c0c5-4459-9b3e-e09e2d755f77 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:53:23 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[8445a79c-bd2c-4529-a3bf-6fcc5c1f342f]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:53:23 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8a08757-0c90-4658-b71e-304518b9a45d tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:53:23 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-c8a08757-0c90-4658-b71e-304518b9a45d tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 10:53:23 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8a08757-0c90-4658-b71e-304518b9a45d tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] <== disconnect_volume: return (339ms) None {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 10:53:23 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8a08757-0c90-4658-b71e-304518b9a45d tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] [instance: 3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d] Disconnected iSCSI Volume {{(pid=71509) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 10:53:23 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:53:23 user nova-compute[71509]: DEBUG nova.network.neutron [None req-68635ce3-4c69-4b42-af80-02f641f61d3c tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] Updating instance_info_cache with network_info: [{"id": "1a142b11-f1ec-41d4-9728-f9f0de9a96ff", "address": "fa:16:3e:96:f1:e3", "network": {"id": "1cb09253-66a4-4c81-82d0-c6d948e0aed4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1557121746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8a9941095d445f48d70df26d8c90e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a142b11-f1", "ovs_interfaceid": "1a142b11-f1ec-41d4-9728-f9f0de9a96ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:53:23 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-68635ce3-4c69-4b42-af80-02f641f61d3c tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Releasing lock "refresh_cache-fe152ebd-4f99-4fa8-bfdb-8744cdf3f387" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:53:23 user nova-compute[71509]: DEBUG nova.compute.manager [None req-68635ce3-4c69-4b42-af80-02f641f61d3c tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] Instance network_info: |[{"id": "1a142b11-f1ec-41d4-9728-f9f0de9a96ff", "address": "fa:16:3e:96:f1:e3", "network": {"id": "1cb09253-66a4-4c81-82d0-c6d948e0aed4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1557121746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8a9941095d445f48d70df26d8c90e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a142b11-f1", "ovs_interfaceid": "1a142b11-f1ec-41d4-9728-f9f0de9a96ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71509) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 10:53:23 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-040416f1-66c0-4241-a87e-8a861f9f2f31 req-6b8bccf6-39bb-48af-8d02-48af350d7ba8 service nova] Acquired lock "refresh_cache-fe152ebd-4f99-4fa8-bfdb-8744cdf3f387" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:53:23 user nova-compute[71509]: DEBUG nova.network.neutron [req-040416f1-66c0-4241-a87e-8a861f9f2f31 req-6b8bccf6-39bb-48af-8d02-48af350d7ba8 service nova] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] Refreshing network info cache for port 1a142b11-f1ec-41d4-9728-f9f0de9a96ff {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 10:53:23 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-68635ce3-4c69-4b42-af80-02f641f61d3c tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] Start _get_guest_xml network_info=[{"id": "1a142b11-f1ec-41d4-9728-f9f0de9a96ff", "address": "fa:16:3e:96:f1:e3", "network": {"id": "1cb09253-66a4-4c81-82d0-c6d948e0aed4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1557121746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8a9941095d445f48d70df26d8c90e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a142b11-f1", "ovs_interfaceid": "1a142b11-f1ec-41d4-9728-f9f0de9a96ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T10:38:55Z,direct_url=<?>,disk_format='qcow2',id=048ec0ee-0465-448d-8b4c-f072acb101dc,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='9742d6ad20cf48d9bab0fdbcc9491db9',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T10:38:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '048ec0ee-0465-448d-8b4c-f072acb101dc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71509) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 10:53:23 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-68635ce3-4c69-4b42-af80-02f641f61d3c tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:53:23 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-68635ce3-4c69-4b42-af80-02f641f61d3c tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:53:23 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-68635ce3-4c69-4b42-af80-02f641f61d3c tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71509) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 10:53:23 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-68635ce3-4c69-4b42-af80-02f641f61d3c tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T10:40:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T10:38:55Z,direct_url=<?>,disk_format='qcow2',id=048ec0ee-0465-448d-8b4c-f072acb101dc,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='9742d6ad20cf48d9bab0fdbcc9491db9',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T10:38:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 10:53:23 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-68635ce3-4c69-4b42-af80-02f641f61d3c tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Flavor limits 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 10:53:23 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-68635ce3-4c69-4b42-af80-02f641f61d3c tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Image limits 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 10:53:23 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-68635ce3-4c69-4b42-af80-02f641f61d3c tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Flavor pref 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 10:53:23 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-68635ce3-4c69-4b42-af80-02f641f61d3c tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Image pref 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 10:53:23 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-68635ce3-4c69-4b42-af80-02f641f61d3c tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 10:53:23 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-68635ce3-4c69-4b42-af80-02f641f61d3c tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 10:53:23 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-68635ce3-4c69-4b42-af80-02f641f61d3c tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71509) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 10:53:23 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-68635ce3-4c69-4b42-af80-02f641f61d3c tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Got 1 possible topologies {{(pid=71509) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 10:53:23 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-68635ce3-4c69-4b42-af80-02f641f61d3c tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 10:53:23 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-68635ce3-4c69-4b42-af80-02f641f61d3c tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 10:53:23 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-68635ce3-4c69-4b42-af80-02f641f61d3c tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T10:53:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1556975659',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1556975659',id=24,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFLvBNTxhHSIubw0F7uDtXu3lrC4fQZkREwo5wOypbS5+Ne2y87VyX2V16fNDjYxnAH2TEtOojObi2Pe4MMNu8MWvc1u20HwRd46X6UXa7+BJMSqgQ2sXpyz9M+hNSfjsA==',key_name='tempest-keypair-2083532637',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f8a9941095d445f48d70df26d8c90e6c',ramdisk_id='',reservation_id='r-tlsa2xby',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1250068675',owner_user_name='tempest-AttachVolumeShelveTestJSON-1250068675-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T10:53:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5afd3930d3a14aff8124a4782ec79870',uuid=fe152ebd-4f99-4fa8-bfdb-8744cdf3f387,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1a142b11-f1ec-41d4-9728-f9f0de9a96ff", "address": "fa:16:3e:96:f1:e3", "network": {"id": "1cb09253-66a4-4c81-82d0-c6d948e0aed4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1557121746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8a9941095d445f48d70df26d8c90e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a142b11-f1", "ovs_interfaceid": "1a142b11-f1ec-41d4-9728-f9f0de9a96ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71509) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 10:53:23 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-68635ce3-4c69-4b42-af80-02f641f61d3c tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Converting VIF {"id": "1a142b11-f1ec-41d4-9728-f9f0de9a96ff", "address": "fa:16:3e:96:f1:e3", "network": {"id": "1cb09253-66a4-4c81-82d0-c6d948e0aed4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1557121746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8a9941095d445f48d70df26d8c90e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a142b11-f1", "ovs_interfaceid": "1a142b11-f1ec-41d4-9728-f9f0de9a96ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:53:23 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-68635ce3-4c69-4b42-af80-02f641f61d3c tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:f1:e3,bridge_name='br-int',has_traffic_filtering=True,id=1a142b11-f1ec-41d4-9728-f9f0de9a96ff,network=Network(1cb09253-66a4-4c81-82d0-c6d948e0aed4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a142b11-f1') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:53:23 user nova-compute[71509]: DEBUG nova.objects.instance [None req-68635ce3-4c69-4b42-af80-02f641f61d3c tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lazy-loading 'pci_devices' on Instance uuid fe152ebd-4f99-4fa8-bfdb-8744cdf3f387 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:53:23 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-68635ce3-4c69-4b42-af80-02f641f61d3c tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] End _get_guest_xml xml=<domain type="kvm">
Apr 14 10:53:23 user nova-compute[71509]:   <uuid>fe152ebd-4f99-4fa8-bfdb-8744cdf3f387</uuid>
Apr 14 10:53:23 user nova-compute[71509]:   <name>instance-00000018</name>
Apr 14 10:53:23 user nova-compute[71509]:   <memory>131072</memory>
Apr 14 10:53:23 user nova-compute[71509]:   <vcpu>1</vcpu>
Apr 14 10:53:23 user nova-compute[71509]:   <metadata>
Apr 14 10:53:23 user nova-compute[71509]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 10:53:23 user nova-compute[71509]:       <nova:package version="0.0.0"/>
Apr 14 10:53:23 user nova-compute[71509]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1556975659</nova:name>
Apr 14 10:53:23 user nova-compute[71509]:       <nova:creationTime>2023-04-14 10:53:23</nova:creationTime>
Apr 14 10:53:23 user nova-compute[71509]:       <nova:flavor name="m1.nano">
Apr 14 10:53:23 user nova-compute[71509]:         <nova:memory>128</nova:memory>
Apr 14 10:53:23 user nova-compute[71509]:         <nova:disk>1</nova:disk>
Apr 14 10:53:23 user nova-compute[71509]:         <nova:swap>0</nova:swap>
Apr 14 10:53:23 user nova-compute[71509]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 10:53:23 user nova-compute[71509]:         <nova:vcpus>1</nova:vcpus>
Apr 14 10:53:23 user nova-compute[71509]:       </nova:flavor>
Apr 14 10:53:23 user nova-compute[71509]:       <nova:owner>
Apr 14 10:53:23 user nova-compute[71509]:         <nova:user uuid="5afd3930d3a14aff8124a4782ec79870">tempest-AttachVolumeShelveTestJSON-1250068675-project-member</nova:user>
Apr 14 10:53:23 user nova-compute[71509]:         <nova:project uuid="f8a9941095d445f48d70df26d8c90e6c">tempest-AttachVolumeShelveTestJSON-1250068675</nova:project>
Apr 14 10:53:23 user nova-compute[71509]:       </nova:owner>
Apr 14 10:53:23 user nova-compute[71509]:       <nova:root type="image" uuid="048ec0ee-0465-448d-8b4c-f072acb101dc"/>
Apr 14 10:53:23 user nova-compute[71509]:       <nova:ports>
Apr 14 10:53:23 user nova-compute[71509]:         <nova:port uuid="1a142b11-f1ec-41d4-9728-f9f0de9a96ff">
Apr 14 10:53:23 user nova-compute[71509]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 14 10:53:23 user nova-compute[71509]:         </nova:port>
Apr 14 10:53:23 user nova-compute[71509]:       </nova:ports>
Apr 14 10:53:23 user nova-compute[71509]:     </nova:instance>
Apr 14 10:53:23 user nova-compute[71509]:   </metadata>
Apr 14 10:53:23 user nova-compute[71509]:   <sysinfo type="smbios">
Apr 14 10:53:23 user nova-compute[71509]:     <system>
Apr 14 10:53:23 user nova-compute[71509]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 10:53:23 user nova-compute[71509]:       <entry name="product">OpenStack Nova</entry>
Apr 14 10:53:23 user nova-compute[71509]:       <entry name="version">0.0.0</entry>
Apr 14 10:53:23 user nova-compute[71509]:       <entry name="serial">fe152ebd-4f99-4fa8-bfdb-8744cdf3f387</entry>
Apr 14 10:53:23 user nova-compute[71509]:       <entry name="uuid">fe152ebd-4f99-4fa8-bfdb-8744cdf3f387</entry>
Apr 14 10:53:23 user nova-compute[71509]:       <entry name="family">Virtual Machine</entry>
Apr 14 10:53:23 user nova-compute[71509]:     </system>
Apr 14 10:53:23 user nova-compute[71509]:   </sysinfo>
Apr 14 10:53:23 user nova-compute[71509]:   <os>
Apr 14 10:53:23 user nova-compute[71509]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 10:53:23 user nova-compute[71509]:     <boot dev="hd"/>
Apr 14 10:53:23 user nova-compute[71509]:     <smbios mode="sysinfo"/>
Apr 14 10:53:23 user nova-compute[71509]:   </os>
Apr 14 10:53:23 user nova-compute[71509]:   <features>
Apr 14 10:53:23 user nova-compute[71509]:     <acpi/>
Apr 14 10:53:23 user nova-compute[71509]:     <apic/>
Apr 14 10:53:23 user nova-compute[71509]:     <vmcoreinfo/>
Apr 14 10:53:23 user nova-compute[71509]:   </features>
Apr 14 10:53:23 user nova-compute[71509]:   <clock offset="utc">
Apr 14 10:53:23 user nova-compute[71509]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 10:53:23 user nova-compute[71509]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 10:53:23 user nova-compute[71509]:     <timer name="hpet" present="no"/>
Apr 14 10:53:23 user nova-compute[71509]:   </clock>
Apr 14 10:53:23 user nova-compute[71509]:   <cpu mode="custom" match="exact">
Apr 14 10:53:23 user nova-compute[71509]:     <model>Nehalem</model>
Apr 14 10:53:23 user nova-compute[71509]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 10:53:23 user nova-compute[71509]:   </cpu>
Apr 14 10:53:23 user nova-compute[71509]:   <devices>
Apr 14 10:53:23 user nova-compute[71509]:     <disk type="file" device="disk">
Apr 14 10:53:23 user nova-compute[71509]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 10:53:23 user nova-compute[71509]:       <source file="/opt/stack/data/nova/instances/fe152ebd-4f99-4fa8-bfdb-8744cdf3f387/disk"/>
Apr 14 10:53:23 user nova-compute[71509]:       <target dev="vda" bus="virtio"/>
Apr 14 10:53:23 user nova-compute[71509]:     </disk>
Apr 14 10:53:23 user nova-compute[71509]:     <interface type="ethernet">
Apr 14 10:53:23 user nova-compute[71509]:       <mac address="fa:16:3e:96:f1:e3"/>
Apr 14 10:53:23 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 10:53:23 user nova-compute[71509]:       <mtu size="1442"/>
Apr 14 10:53:23 user nova-compute[71509]:       <target dev="tap1a142b11-f1"/>
Apr 14 10:53:23 user nova-compute[71509]:     </interface>
Apr 14 10:53:23 user nova-compute[71509]:     <serial type="pty">
Apr 14 10:53:23 user nova-compute[71509]:       <log file="/opt/stack/data/nova/instances/fe152ebd-4f99-4fa8-bfdb-8744cdf3f387/console.log" append="off"/>
Apr 14 10:53:23 user nova-compute[71509]:     </serial>
Apr 14 10:53:23 user nova-compute[71509]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 10:53:23 user nova-compute[71509]:     <video>
Apr 14 10:53:23 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 10:53:23 user nova-compute[71509]:     </video>
Apr 14 10:53:23 user nova-compute[71509]:     <rng model="virtio">
Apr 14 10:53:23 user nova-compute[71509]:       <backend model="random">/dev/urandom</backend>
Apr 14 10:53:23 user nova-compute[71509]:     </rng>
Apr 14 10:53:23 user nova-compute[71509]:     <controller type="usb" index="0" model="none"/>
Apr 14 10:53:23 user nova-compute[71509]:     <memballoon model="virtio">
Apr 14 10:53:23 user nova-compute[71509]:       <stats period="10"/>
Apr 14 10:53:23 user nova-compute[71509]:     </memballoon>
Apr 14 10:53:23 user nova-compute[71509]:   </devices>
Apr 14 10:53:23 user nova-compute[71509]: </domain>
Apr 14 10:53:23 user nova-compute[71509]:  {{(pid=71509) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 10:53:23 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-68635ce3-4c69-4b42-af80-02f641f61d3c tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T10:53:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1556975659',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1556975659',id=24,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFLvBNTxhHSIubw0F7uDtXu3lrC4fQZkREwo5wOypbS5+Ne2y87VyX2V16fNDjYxnAH2TEtOojObi2Pe4MMNu8MWvc1u20HwRd46X6UXa7+BJMSqgQ2sXpyz9M+hNSfjsA==',key_name='tempest-keypair-2083532637',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f8a9941095d445f48d70df26d8c90e6c',ramdisk_id='',reservation_id='r-tlsa2xby',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1250068675',owner_user_name='tempest-AttachVolumeShelveTestJSON-1250068675-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T10:53:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5afd3930d3a14aff8124a4782ec79870',uuid=fe152ebd-4f99-4fa8-bfdb-8744cdf3f387,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1a142b11-f1ec-41d4-9728-f9f0de9a96ff", "address": "fa:16:3e:96:f1:e3", "network": {"id": "1cb09253-66a4-4c81-82d0-c6d948e0aed4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1557121746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8a9941095d445f48d70df26d8c90e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a142b11-f1", "ovs_interfaceid": "1a142b11-f1ec-41d4-9728-f9f0de9a96ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 10:53:23 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-68635ce3-4c69-4b42-af80-02f641f61d3c tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Converting VIF {"id": "1a142b11-f1ec-41d4-9728-f9f0de9a96ff", "address": "fa:16:3e:96:f1:e3", "network": {"id": "1cb09253-66a4-4c81-82d0-c6d948e0aed4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1557121746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8a9941095d445f48d70df26d8c90e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a142b11-f1", "ovs_interfaceid": "1a142b11-f1ec-41d4-9728-f9f0de9a96ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:53:23 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-68635ce3-4c69-4b42-af80-02f641f61d3c tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:f1:e3,bridge_name='br-int',has_traffic_filtering=True,id=1a142b11-f1ec-41d4-9728-f9f0de9a96ff,network=Network(1cb09253-66a4-4c81-82d0-c6d948e0aed4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a142b11-f1') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:53:23 user nova-compute[71509]: DEBUG os_vif [None req-68635ce3-4c69-4b42-af80-02f641f61d3c tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:f1:e3,bridge_name='br-int',has_traffic_filtering=True,id=1a142b11-f1ec-41d4-9728-f9f0de9a96ff,network=Network(1cb09253-66a4-4c81-82d0-c6d948e0aed4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a142b11-f1') {{(pid=71509) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 10:53:23 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:53:23 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:53:23 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 10:53:23 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:53:23 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1a142b11-f1, may_exist=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:53:23 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1a142b11-f1, col_values=(('external_ids', {'iface-id': '1a142b11-f1ec-41d4-9728-f9f0de9a96ff', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:96:f1:e3', 'vm-uuid': 'fe152ebd-4f99-4fa8-bfdb-8744cdf3f387'}),)) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:53:23 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:53:23 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 10:53:23 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:53:23 user nova-compute[71509]: INFO os_vif [None req-68635ce3-4c69-4b42-af80-02f641f61d3c tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:f1:e3,bridge_name='br-int',has_traffic_filtering=True,id=1a142b11-f1ec-41d4-9728-f9f0de9a96ff,network=Network(1cb09253-66a4-4c81-82d0-c6d948e0aed4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a142b11-f1')
Apr 14 10:53:23 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-68635ce3-4c69-4b42-af80-02f641f61d3c tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] No BDM found with device name vda, not building metadata. {{(pid=71509) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 10:53:23 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-68635ce3-4c69-4b42-af80-02f641f61d3c tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] No VIF found with MAC fa:16:3e:96:f1:e3, not building metadata {{(pid=71509) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 10:53:24 user nova-compute[71509]: DEBUG nova.objects.instance [None req-c8a08757-0c90-4658-b71e-304518b9a45d tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Lazy-loading 'flavor' on Instance uuid 3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:53:24 user nova-compute[71509]: DEBUG nova.network.neutron [req-040416f1-66c0-4241-a87e-8a861f9f2f31 req-6b8bccf6-39bb-48af-8d02-48af350d7ba8 service nova] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] Updated VIF entry in instance network info cache for port 1a142b11-f1ec-41d4-9728-f9f0de9a96ff. {{(pid=71509) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 10:53:24 user nova-compute[71509]: DEBUG nova.network.neutron [req-040416f1-66c0-4241-a87e-8a861f9f2f31 req-6b8bccf6-39bb-48af-8d02-48af350d7ba8 service nova] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] Updating instance_info_cache with network_info: [{"id": "1a142b11-f1ec-41d4-9728-f9f0de9a96ff", "address": "fa:16:3e:96:f1:e3", "network": {"id": "1cb09253-66a4-4c81-82d0-c6d948e0aed4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1557121746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8a9941095d445f48d70df26d8c90e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a142b11-f1", "ovs_interfaceid": "1a142b11-f1ec-41d4-9728-f9f0de9a96ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:53:24 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-040416f1-66c0-4241-a87e-8a861f9f2f31 req-6b8bccf6-39bb-48af-8d02-48af350d7ba8 service nova] Releasing lock "refresh_cache-fe152ebd-4f99-4fa8-bfdb-8744cdf3f387" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:53:24 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-c8a08757-0c90-4658-b71e-304518b9a45d tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Lock "3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.154s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:53:24 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-fe2a649d-f9a1-4f5e-88e3-10eec05a4ed6 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Lock "3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.918s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:53:24 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-fe2a649d-f9a1-4f5e-88e3-10eec05a4ed6 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Acquiring lock "3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:53:24 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-fe2a649d-f9a1-4f5e-88e3-10eec05a4ed6 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Lock "3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:53:24 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-fe2a649d-f9a1-4f5e-88e3-10eec05a4ed6 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Lock "3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:53:24 user nova-compute[71509]: INFO nova.compute.manager [None req-fe2a649d-f9a1-4f5e-88e3-10eec05a4ed6 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] [instance: 3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d] Terminating instance
Apr 14 10:53:24 user nova-compute[71509]: DEBUG nova.compute.manager [None req-fe2a649d-f9a1-4f5e-88e3-10eec05a4ed6 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] [instance: 3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d] Start destroying the instance on the hypervisor. {{(pid=71509) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 10:53:24 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:53:24 user nova-compute[71509]: DEBUG nova.compute.manager [req-6f005d6c-10d0-4c03-ba16-18167af0cb17 req-0c54b07c-3579-4166-be32-ea36c0ff44df service nova] [instance: 3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d] Received event network-vif-unplugged-ff9ac514-2d14-4580-8d6a-2c525b72a5db {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:53:24 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-6f005d6c-10d0-4c03-ba16-18167af0cb17 req-0c54b07c-3579-4166-be32-ea36c0ff44df service nova] Acquiring lock "3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:53:24 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-6f005d6c-10d0-4c03-ba16-18167af0cb17 req-0c54b07c-3579-4166-be32-ea36c0ff44df service nova] Lock "3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:53:24 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-6f005d6c-10d0-4c03-ba16-18167af0cb17 req-0c54b07c-3579-4166-be32-ea36c0ff44df service nova] Lock "3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:53:24 user nova-compute[71509]: DEBUG nova.compute.manager [req-6f005d6c-10d0-4c03-ba16-18167af0cb17 req-0c54b07c-3579-4166-be32-ea36c0ff44df service nova] [instance: 3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d] No waiting events found dispatching network-vif-unplugged-ff9ac514-2d14-4580-8d6a-2c525b72a5db {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:53:24 user nova-compute[71509]: DEBUG nova.compute.manager [req-6f005d6c-10d0-4c03-ba16-18167af0cb17 req-0c54b07c-3579-4166-be32-ea36c0ff44df service nova] [instance: 3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d] Received event network-vif-unplugged-ff9ac514-2d14-4580-8d6a-2c525b72a5db for instance with task_state deleting. {{(pid=71509) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 10:53:24 user nova-compute[71509]: DEBUG nova.compute.manager [req-6f005d6c-10d0-4c03-ba16-18167af0cb17 req-0c54b07c-3579-4166-be32-ea36c0ff44df service nova] [instance: 3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d] Received event network-vif-plugged-ff9ac514-2d14-4580-8d6a-2c525b72a5db {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:53:24 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-6f005d6c-10d0-4c03-ba16-18167af0cb17 req-0c54b07c-3579-4166-be32-ea36c0ff44df service nova] Acquiring lock "3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:53:24 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-6f005d6c-10d0-4c03-ba16-18167af0cb17 req-0c54b07c-3579-4166-be32-ea36c0ff44df service nova] Lock "3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:53:24 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-6f005d6c-10d0-4c03-ba16-18167af0cb17 req-0c54b07c-3579-4166-be32-ea36c0ff44df service nova] Lock "3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:53:24 user nova-compute[71509]: DEBUG nova.compute.manager [req-6f005d6c-10d0-4c03-ba16-18167af0cb17 req-0c54b07c-3579-4166-be32-ea36c0ff44df service nova] [instance: 3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d] No waiting events found dispatching network-vif-plugged-ff9ac514-2d14-4580-8d6a-2c525b72a5db {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:53:24 user nova-compute[71509]: WARNING nova.compute.manager [req-6f005d6c-10d0-4c03-ba16-18167af0cb17 req-0c54b07c-3579-4166-be32-ea36c0ff44df service nova] [instance: 3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d] Received unexpected event network-vif-plugged-ff9ac514-2d14-4580-8d6a-2c525b72a5db for instance with vm_state active and task_state deleting.
Apr 14 10:53:25 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: 3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d] Instance destroyed successfully.
Apr 14 10:53:25 user nova-compute[71509]: DEBUG nova.objects.instance [None req-fe2a649d-f9a1-4f5e-88e3-10eec05a4ed6 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Lazy-loading 'resources' on Instance uuid 3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:53:25 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:53:25 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-fe2a649d-f9a1-4f5e-88e3-10eec05a4ed6 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T10:51:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1661573828',display_name='tempest-VolumesSnapshotTestJSON-instance-1661573828',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1661573828',id=20,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T10:51:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a84a2fac4604454982dc018b36440b00',ramdisk_id='',reservation_id='r-4ki40nsj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-685456681',owner_user_name='tempest-VolumesSnapshotTestJSON-685456681-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T10:51:08Z,user_data=None,user_id='ac498c56dae543cf9e64fbb61ad50df3',uuid=3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ff9ac514-2d14-4580-8d6a-2c525b72a5db", "address": "fa:16:3e:29:66:56", "network": {"id": "4efde76c-8493-4902-a655-f10faee002a4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1588457316-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "a84a2fac4604454982dc018b36440b00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff9ac514-2d", "ovs_interfaceid": "ff9ac514-2d14-4580-8d6a-2c525b72a5db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 10:53:25 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-fe2a649d-f9a1-4f5e-88e3-10eec05a4ed6 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Converting VIF {"id": "ff9ac514-2d14-4580-8d6a-2c525b72a5db", "address": "fa:16:3e:29:66:56", "network": {"id": "4efde76c-8493-4902-a655-f10faee002a4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1588457316-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "a84a2fac4604454982dc018b36440b00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff9ac514-2d", "ovs_interfaceid": "ff9ac514-2d14-4580-8d6a-2c525b72a5db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:53:25 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-fe2a649d-f9a1-4f5e-88e3-10eec05a4ed6 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:66:56,bridge_name='br-int',has_traffic_filtering=True,id=ff9ac514-2d14-4580-8d6a-2c525b72a5db,network=Network(4efde76c-8493-4902-a655-f10faee002a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff9ac514-2d') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:53:25 user nova-compute[71509]: DEBUG os_vif [None req-fe2a649d-f9a1-4f5e-88e3-10eec05a4ed6 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:66:56,bridge_name='br-int',has_traffic_filtering=True,id=ff9ac514-2d14-4580-8d6a-2c525b72a5db,network=Network(4efde76c-8493-4902-a655-f10faee002a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff9ac514-2d') {{(pid=71509) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 10:53:25 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:53:25 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapff9ac514-2d, bridge=br-int, if_exists=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:53:25 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:53:25 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 10:53:25 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:53:25 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:53:25 user nova-compute[71509]: INFO os_vif [None req-fe2a649d-f9a1-4f5e-88e3-10eec05a4ed6 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:66:56,bridge_name='br-int',has_traffic_filtering=True,id=ff9ac514-2d14-4580-8d6a-2c525b72a5db,network=Network(4efde76c-8493-4902-a655-f10faee002a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff9ac514-2d')
Apr 14 10:53:25 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe2a649d-f9a1-4f5e-88e3-10eec05a4ed6 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] [instance: 3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d] calling os-brick to detach iSCSI Volume {{(pid=71509) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 10:53:25 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe2a649d-f9a1-4f5e-88e3-10eec05a4ed6 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0bf0749390>, {'target_iqn': 'iqn.2010-10.org.openstack:7941e1c1-c0c5-4459-9b3e-e09e2d755f77', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KSJwnpuc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 10:53:25 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-fe2a649d-f9a1-4f5e-88e3-10eec05a4ed6 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 10:53:25 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-fe2a649d-f9a1-4f5e-88e3-10eec05a4ed6 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 10:53:25 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-fe2a649d-f9a1-4f5e-88e3-10eec05a4ed6 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 10:53:25 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:53:25 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:53:25 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[69675b40-57a9-437d-9b35-f9ae48518a3d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e52b9d6a-ee3e-42b8-973e-d47c4ed33196\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:08f71190-2402-402d-af67-edf9226e4fb8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:53:25 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe2a649d-f9a1-4f5e-88e3-10eec05a4ed6 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 10:53:25 user nova-compute[71509]: No targets found.
Apr 14 10:53:25 user nova-compute[71509]: iSNS:
Apr 14 10:53:25 user nova-compute[71509]: No targets found.
Apr 14 10:53:25 user nova-compute[71509]: STATIC:
Apr 14 10:53:25 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe
Apr 14 10:53:25 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:53:25 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:53:25 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:e52b9d6a-ee3e-42b8-973e-d47c4ed33196
Apr 14 10:53:25 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:53:25 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:53:25 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:08f71190-2402-402d-af67-edf9226e4fb8
Apr 14 10:53:25 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:53:25 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:53:25 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178
Apr 14 10:53:25 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:53:25 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:53:25 user nova-compute[71509]: FIRMWARE:
Apr 14 10:53:25 user nova-compute[71509]: No targets found.
Apr 14 10:53:25 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:53:25 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe2a649d-f9a1-4f5e-88e3-10eec05a4ed6 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 10:53:25 user nova-compute[71509]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 10:53:25 user nova-compute[71509]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71509) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 10:53:25 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe2a649d-f9a1-4f5e-88e3-10eec05a4ed6 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7941e1c1-c0c5-4459-9b3e-e09e2d755f77', 0)] {{(pid=71509) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 10:53:25 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:53:25 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:53:25 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[c25296ff-01a8-4378-814b-8d3caacc1f86]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:08f71190-2402-402d-af67-edf9226e4fb8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e52b9d6a-ee3e-42b8-973e-d47c4ed33196\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:53:25 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:53:25 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:53:25 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[224813a8-5c54-4687-9e20-8828bca64f5d]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08f71190-2402-402d-af67-edf9226e4fb8 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52b9d6a-ee3e-42b8-973e-d47c4ed33196 (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:53:25 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe2a649d-f9a1-4f5e-88e3-10eec05a4ed6 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)
Apr 14 10:53:25 user nova-compute[71509]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe (non-flash)
Apr 14 10:53:25 user nova-compute[71509]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08f71190-2402-402d-af67-edf9226e4fb8 (non-flash)
Apr 14 10:53:25 user nova-compute[71509]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52b9d6a-ee3e-42b8-973e-d47c4ed33196 (non-flash)
Apr 14 10:53:25 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:53:25 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe2a649d-f9a1-4f5e-88e3-10eec05a4ed6 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)
Apr 14 10:53:25 user nova-compute[71509]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe (non-flash)
Apr 14 10:53:25 user nova-compute[71509]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08f71190-2402-402d-af67-edf9226e4fb8 (non-flash)
Apr 14 10:53:25 user nova-compute[71509]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52b9d6a-ee3e-42b8-973e-d47c4ed33196 (non-flash)
Apr 14 10:53:25 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 10:53:25 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe2a649d-f9a1-4f5e-88e3-10eec05a4ed6 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0bf06a1c60>, {}) {{(pid=71509) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 10:53:25 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe2a649d-f9a1-4f5e-88e3-10eec05a4ed6 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Disconnecting from: [] {{(pid=71509) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 10:53:25 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-fe2a649d-f9a1-4f5e-88e3-10eec05a4ed6 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.086s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 10:53:25 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe2a649d-f9a1-4f5e-88e3-10eec05a4ed6 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] <== disconnect_volume: return (86ms) None {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 10:53:25 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe2a649d-f9a1-4f5e-88e3-10eec05a4ed6 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] [instance: 3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d] Disconnected iSCSI Volume {{(pid=71509) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 10:53:25 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-fe2a649d-f9a1-4f5e-88e3-10eec05a4ed6 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] [instance: 3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d] Deleting instance files /opt/stack/data/nova/instances/3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d_del
Apr 14 10:53:25 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-fe2a649d-f9a1-4f5e-88e3-10eec05a4ed6 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] [instance: 3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d] Deletion of /opt/stack/data/nova/instances/3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d_del complete
Apr 14 10:53:25 user nova-compute[71509]: INFO nova.compute.manager [None req-fe2a649d-f9a1-4f5e-88e3-10eec05a4ed6 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] [instance: 3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d] Took 1.65 seconds to destroy the instance on the hypervisor.
Apr 14 10:53:25 user nova-compute[71509]: DEBUG oslo.service.loopingcall [None req-fe2a649d-f9a1-4f5e-88e3-10eec05a4ed6 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71509) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 10:53:25 user nova-compute[71509]: DEBUG nova.compute.manager [-] [instance: 3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d] Deallocating network for instance {{(pid=71509) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 10:53:25 user nova-compute[71509]: DEBUG nova.network.neutron [-] [instance: 3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d] deallocate_for_instance() {{(pid=71509) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 10:53:26 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:53:26 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:53:26 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:53:26 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:53:26 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:53:26 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-105e1d43-2691-4e24-a38c-30a9e272fd22 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "3393be13-7d81-48da-b6dd-a427e8403b22" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:53:26 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-105e1d43-2691-4e24-a38c-30a9e272fd22 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "3393be13-7d81-48da-b6dd-a427e8403b22" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:53:26 user nova-compute[71509]: DEBUG nova.compute.manager [None req-105e1d43-2691-4e24-a38c-30a9e272fd22 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: 3393be13-7d81-48da-b6dd-a427e8403b22] Starting instance... {{(pid=71509) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 10:53:26 user nova-compute[71509]: DEBUG nova.network.neutron [-] [instance: 3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d] Updating instance_info_cache with network_info: [] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:53:26 user nova-compute[71509]: INFO nova.compute.manager [-] [instance: 3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d] Took 0.81 seconds to deallocate network for instance.
Apr 14 10:53:26 user nova-compute[71509]: WARNING nova.volume.cinder [None req-fe2a649d-f9a1-4f5e-88e3-10eec05a4ed6 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Attachment fbbb79c9-c0a9-45ce-bde4-297556f95666 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = fbbb79c9-c0a9-45ce-bde4-297556f95666. (HTTP 404) (Request-ID: req-e6aeb9ae-01d8-4e4b-8fe3-6b8b0bb1dee4)
Apr 14 10:53:26 user nova-compute[71509]: INFO nova.compute.manager [None req-fe2a649d-f9a1-4f5e-88e3-10eec05a4ed6 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] [instance: 3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d] Took 0.03 seconds to detach 1 volumes for instance.
Apr 14 10:53:26 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-105e1d43-2691-4e24-a38c-30a9e272fd22 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:53:26 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-105e1d43-2691-4e24-a38c-30a9e272fd22 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:53:26 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-fe2a649d-f9a1-4f5e-88e3-10eec05a4ed6 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:53:26 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-105e1d43-2691-4e24-a38c-30a9e272fd22 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71509) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 10:53:26 user nova-compute[71509]: INFO nova.compute.claims [None req-105e1d43-2691-4e24-a38c-30a9e272fd22 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: 3393be13-7d81-48da-b6dd-a427e8403b22] Claim successful on node user
Apr 14 10:53:26 user nova-compute[71509]: DEBUG nova.compute.manager [req-8b337a7f-50b8-4444-aa2e-ad06a8de2ae3 req-483602ed-6d94-4565-b91c-33b280dbc20d service nova] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] Received event network-vif-plugged-1a142b11-f1ec-41d4-9728-f9f0de9a96ff {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:53:26 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-8b337a7f-50b8-4444-aa2e-ad06a8de2ae3 req-483602ed-6d94-4565-b91c-33b280dbc20d service nova] Acquiring lock "fe152ebd-4f99-4fa8-bfdb-8744cdf3f387-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:53:26 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-8b337a7f-50b8-4444-aa2e-ad06a8de2ae3 req-483602ed-6d94-4565-b91c-33b280dbc20d service nova] Lock "fe152ebd-4f99-4fa8-bfdb-8744cdf3f387-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:53:26 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-8b337a7f-50b8-4444-aa2e-ad06a8de2ae3 req-483602ed-6d94-4565-b91c-33b280dbc20d service nova] Lock "fe152ebd-4f99-4fa8-bfdb-8744cdf3f387-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:53:26 user nova-compute[71509]: DEBUG nova.compute.manager [req-8b337a7f-50b8-4444-aa2e-ad06a8de2ae3 req-483602ed-6d94-4565-b91c-33b280dbc20d service nova] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] No waiting events found dispatching network-vif-plugged-1a142b11-f1ec-41d4-9728-f9f0de9a96ff {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:53:26 user nova-compute[71509]: WARNING nova.compute.manager [req-8b337a7f-50b8-4444-aa2e-ad06a8de2ae3 req-483602ed-6d94-4565-b91c-33b280dbc20d service nova] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] Received unexpected event network-vif-plugged-1a142b11-f1ec-41d4-9728-f9f0de9a96ff for instance with vm_state building and task_state spawning.
Apr 14 10:53:26 user nova-compute[71509]: DEBUG nova.compute.manager [req-8b337a7f-50b8-4444-aa2e-ad06a8de2ae3 req-483602ed-6d94-4565-b91c-33b280dbc20d service nova] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] Received event network-vif-plugged-1a142b11-f1ec-41d4-9728-f9f0de9a96ff {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:53:26 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-8b337a7f-50b8-4444-aa2e-ad06a8de2ae3 req-483602ed-6d94-4565-b91c-33b280dbc20d service nova] Acquiring lock "fe152ebd-4f99-4fa8-bfdb-8744cdf3f387-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:53:26 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-8b337a7f-50b8-4444-aa2e-ad06a8de2ae3 req-483602ed-6d94-4565-b91c-33b280dbc20d service nova] Lock "fe152ebd-4f99-4fa8-bfdb-8744cdf3f387-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:53:26 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-8b337a7f-50b8-4444-aa2e-ad06a8de2ae3 req-483602ed-6d94-4565-b91c-33b280dbc20d service nova] Lock "fe152ebd-4f99-4fa8-bfdb-8744cdf3f387-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:53:26 user nova-compute[71509]: DEBUG nova.compute.manager [req-8b337a7f-50b8-4444-aa2e-ad06a8de2ae3 req-483602ed-6d94-4565-b91c-33b280dbc20d service nova] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] No waiting events found dispatching network-vif-plugged-1a142b11-f1ec-41d4-9728-f9f0de9a96ff {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:53:26 user nova-compute[71509]: WARNING nova.compute.manager [req-8b337a7f-50b8-4444-aa2e-ad06a8de2ae3 req-483602ed-6d94-4565-b91c-33b280dbc20d service nova] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] Received unexpected event network-vif-plugged-1a142b11-f1ec-41d4-9728-f9f0de9a96ff for instance with vm_state building and task_state spawning.
Apr 14 10:53:26 user nova-compute[71509]: DEBUG nova.compute.manager [req-8b337a7f-50b8-4444-aa2e-ad06a8de2ae3 req-483602ed-6d94-4565-b91c-33b280dbc20d service nova] [instance: 3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d] Received event network-vif-deleted-ff9ac514-2d14-4580-8d6a-2c525b72a5db {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:53:27 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-105e1d43-2691-4e24-a38c-30a9e272fd22 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 10:53:27 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-105e1d43-2691-4e24-a38c-30a9e272fd22 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 10:53:27 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-105e1d43-2691-4e24-a38c-30a9e272fd22 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.737s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:53:27 user nova-compute[71509]: DEBUG nova.compute.manager [None req-105e1d43-2691-4e24-a38c-30a9e272fd22 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: 3393be13-7d81-48da-b6dd-a427e8403b22] Start building networks asynchronously for instance. {{(pid=71509) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 10:53:27 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-fe2a649d-f9a1-4f5e-88e3-10eec05a4ed6 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.740s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:53:27 user nova-compute[71509]: DEBUG nova.compute.manager [None req-105e1d43-2691-4e24-a38c-30a9e272fd22 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: 3393be13-7d81-48da-b6dd-a427e8403b22] Allocating IP information in the background. {{(pid=71509) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 10:53:27 user nova-compute[71509]: DEBUG nova.network.neutron [None req-105e1d43-2691-4e24-a38c-30a9e272fd22 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: 3393be13-7d81-48da-b6dd-a427e8403b22] allocate_for_instance() {{(pid=71509) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 10:53:27 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-105e1d43-2691-4e24-a38c-30a9e272fd22 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: 3393be13-7d81-48da-b6dd-a427e8403b22] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 10:53:27 user nova-compute[71509]: DEBUG nova.compute.manager [None req-105e1d43-2691-4e24-a38c-30a9e272fd22 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: 3393be13-7d81-48da-b6dd-a427e8403b22] Start building block device mappings for instance. {{(pid=71509) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 10:53:27 user nova-compute[71509]: DEBUG nova.compute.manager [None req-105e1d43-2691-4e24-a38c-30a9e272fd22 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: 3393be13-7d81-48da-b6dd-a427e8403b22] Start spawning the instance on the hypervisor. {{(pid=71509) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 10:53:27 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-105e1d43-2691-4e24-a38c-30a9e272fd22 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: 3393be13-7d81-48da-b6dd-a427e8403b22] Creating instance directory {{(pid=71509) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 10:53:27 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-105e1d43-2691-4e24-a38c-30a9e272fd22 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: 3393be13-7d81-48da-b6dd-a427e8403b22] Creating image(s)
Apr 14 10:53:27 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-105e1d43-2691-4e24-a38c-30a9e272fd22 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "/opt/stack/data/nova/instances/3393be13-7d81-48da-b6dd-a427e8403b22/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:53:27 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-105e1d43-2691-4e24-a38c-30a9e272fd22 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "/opt/stack/data/nova/instances/3393be13-7d81-48da-b6dd-a427e8403b22/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:53:27 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-105e1d43-2691-4e24-a38c-30a9e272fd22 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "/opt/stack/data/nova/instances/3393be13-7d81-48da-b6dd-a427e8403b22/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:53:27 user nova-compute[71509]: DEBUG nova.policy [None req-105e1d43-2691-4e24-a38c-30a9e272fd22 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '78adbbdcd10e446daddde754e46309b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8f294f957f4c74ae959c1e9f238427', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71509) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 10:53:27 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-105e1d43-2691-4e24-a38c-30a9e272fd22 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:53:27 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681469607.9120855, fe152ebd-4f99-4fa8-bfdb-8744cdf3f387 => Resumed> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 10:53:27 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] VM Resumed (Lifecycle Event)
Apr 14 10:53:27 user nova-compute[71509]: DEBUG nova.compute.manager [None req-68635ce3-4c69-4b42-af80-02f641f61d3c tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] Instance event wait completed in 0 seconds for  {{(pid=71509) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 10:53:27 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-68635ce3-4c69-4b42-af80-02f641f61d3c tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] Guest created on hypervisor {{(pid=71509) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 10:53:27 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-105e1d43-2691-4e24-a38c-30a9e272fd22 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json" returned: 0 in 0.135s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:53:27 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-105e1d43-2691-4e24-a38c-30a9e272fd22 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:53:27 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-105e1d43-2691-4e24-a38c-30a9e272fd22 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:53:27 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-105e1d43-2691-4e24-a38c-30a9e272fd22 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:53:27 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:53:27 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] Instance spawned successfully.
Apr 14 10:53:27 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-68635ce3-4c69-4b42-af80-02f641f61d3c tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 10:53:27 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 10:53:28 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-fe2a649d-f9a1-4f5e-88e3-10eec05a4ed6 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 10:53:28 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:53:28 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-fe2a649d-f9a1-4f5e-88e3-10eec05a4ed6 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 10:53:28 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 10:53:28 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681469607.9149823, fe152ebd-4f99-4fa8-bfdb-8744cdf3f387 => Started> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 10:53:28 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] VM Started (Lifecycle Event)
Apr 14 10:53:28 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-68635ce3-4c69-4b42-af80-02f641f61d3c tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] Found default for hw_cdrom_bus of ide {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:53:28 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-68635ce3-4c69-4b42-af80-02f641f61d3c tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] Found default for hw_disk_bus of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:53:28 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-68635ce3-4c69-4b42-af80-02f641f61d3c tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] Found default for hw_input_bus of None {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:53:28 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-68635ce3-4c69-4b42-af80-02f641f61d3c tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] Found default for hw_pointer_model of None {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:53:28 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-68635ce3-4c69-4b42-af80-02f641f61d3c tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] Found default for hw_video_model of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:53:28 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-68635ce3-4c69-4b42-af80-02f641f61d3c tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] Found default for hw_vif_model of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:53:28 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:53:28 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-fe2a649d-f9a1-4f5e-88e3-10eec05a4ed6 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.510s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:53:28 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 10:53:28 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-105e1d43-2691-4e24-a38c-30a9e272fd22 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json" returned: 0 in 0.144s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:53:28 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-105e1d43-2691-4e24-a38c-30a9e272fd22 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18,backing_fmt=raw /opt/stack/data/nova/instances/3393be13-7d81-48da-b6dd-a427e8403b22/disk 1073741824 {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:53:28 user nova-compute[71509]: INFO nova.scheduler.client.report [None req-fe2a649d-f9a1-4f5e-88e3-10eec05a4ed6 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Deleted allocations for instance 3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d
Apr 14 10:53:28 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 10:53:28 user nova-compute[71509]: INFO nova.compute.manager [None req-68635ce3-4c69-4b42-af80-02f641f61d3c tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] Took 6.97 seconds to spawn the instance on the hypervisor.
Apr 14 10:53:28 user nova-compute[71509]: DEBUG nova.compute.manager [None req-68635ce3-4c69-4b42-af80-02f641f61d3c tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:53:28 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-105e1d43-2691-4e24-a38c-30a9e272fd22 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18,backing_fmt=raw /opt/stack/data/nova/instances/3393be13-7d81-48da-b6dd-a427e8403b22/disk 1073741824" returned: 0 in 0.072s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:53:28 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-105e1d43-2691-4e24-a38c-30a9e272fd22 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.218s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:53:28 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-105e1d43-2691-4e24-a38c-30a9e272fd22 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:53:28 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-fe2a649d-f9a1-4f5e-88e3-10eec05a4ed6 tempest-VolumesSnapshotTestJSON-685456681 tempest-VolumesSnapshotTestJSON-685456681-project-member] Lock "3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.043s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:53:28 user nova-compute[71509]: INFO nova.compute.manager [None req-68635ce3-4c69-4b42-af80-02f641f61d3c tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] Took 7.97 seconds to build instance.
Apr 14 10:53:28 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-105e1d43-2691-4e24-a38c-30a9e272fd22 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json" returned: 0 in 0.138s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:53:28 user nova-compute[71509]: DEBUG nova.virt.disk.api [None req-105e1d43-2691-4e24-a38c-30a9e272fd22 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3393be13-7d81-48da-b6dd-a427e8403b22/disk. size=1073741824 {{(pid=71509) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 10:53:28 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-105e1d43-2691-4e24-a38c-30a9e272fd22 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3393be13-7d81-48da-b6dd-a427e8403b22/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:53:28 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-68635ce3-4c69-4b42-af80-02f641f61d3c tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "fe152ebd-4f99-4fa8-bfdb-8744cdf3f387" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.099s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:53:28 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-105e1d43-2691-4e24-a38c-30a9e272fd22 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3393be13-7d81-48da-b6dd-a427e8403b22/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:53:28 user nova-compute[71509]: DEBUG nova.virt.disk.api [None req-105e1d43-2691-4e24-a38c-30a9e272fd22 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Cannot resize image /opt/stack/data/nova/instances/3393be13-7d81-48da-b6dd-a427e8403b22/disk to a smaller size. {{(pid=71509) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 10:53:28 user nova-compute[71509]: DEBUG nova.objects.instance [None req-105e1d43-2691-4e24-a38c-30a9e272fd22 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lazy-loading 'migration_context' on Instance uuid 3393be13-7d81-48da-b6dd-a427e8403b22 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:53:28 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-105e1d43-2691-4e24-a38c-30a9e272fd22 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: 3393be13-7d81-48da-b6dd-a427e8403b22] Created local disks {{(pid=71509) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 10:53:28 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-105e1d43-2691-4e24-a38c-30a9e272fd22 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: 3393be13-7d81-48da-b6dd-a427e8403b22] Ensure instance console log exists: /opt/stack/data/nova/instances/3393be13-7d81-48da-b6dd-a427e8403b22/console.log {{(pid=71509) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 10:53:28 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-105e1d43-2691-4e24-a38c-30a9e272fd22 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:53:28 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-105e1d43-2691-4e24-a38c-30a9e272fd22 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:53:28 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-105e1d43-2691-4e24-a38c-30a9e272fd22 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:53:28 user nova-compute[71509]: DEBUG nova.network.neutron [None req-105e1d43-2691-4e24-a38c-30a9e272fd22 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: 3393be13-7d81-48da-b6dd-a427e8403b22] Successfully created port: 5c5720ce-d39a-4676-9116-0e5adf24d40f {{(pid=71509) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 10:53:29 user nova-compute[71509]: DEBUG nova.network.neutron [None req-105e1d43-2691-4e24-a38c-30a9e272fd22 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: 3393be13-7d81-48da-b6dd-a427e8403b22] Successfully updated port: 5c5720ce-d39a-4676-9116-0e5adf24d40f {{(pid=71509) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 10:53:29 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-105e1d43-2691-4e24-a38c-30a9e272fd22 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "refresh_cache-3393be13-7d81-48da-b6dd-a427e8403b22" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:53:29 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-105e1d43-2691-4e24-a38c-30a9e272fd22 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquired lock "refresh_cache-3393be13-7d81-48da-b6dd-a427e8403b22" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:53:29 user nova-compute[71509]: DEBUG nova.network.neutron [None req-105e1d43-2691-4e24-a38c-30a9e272fd22 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: 3393be13-7d81-48da-b6dd-a427e8403b22] Building network info cache for instance {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 10:53:29 user nova-compute[71509]: DEBUG nova.compute.manager [req-894762d6-c837-40ce-b7ed-79bd23025902 req-82cfa446-0ca9-4506-bb6f-5fd9c6d2e06d service nova] [instance: 3393be13-7d81-48da-b6dd-a427e8403b22] Received event network-changed-5c5720ce-d39a-4676-9116-0e5adf24d40f {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:53:29 user nova-compute[71509]: DEBUG nova.compute.manager [req-894762d6-c837-40ce-b7ed-79bd23025902 req-82cfa446-0ca9-4506-bb6f-5fd9c6d2e06d service nova] [instance: 3393be13-7d81-48da-b6dd-a427e8403b22] Refreshing instance network info cache due to event network-changed-5c5720ce-d39a-4676-9116-0e5adf24d40f. {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 10:53:29 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-894762d6-c837-40ce-b7ed-79bd23025902 req-82cfa446-0ca9-4506-bb6f-5fd9c6d2e06d service nova] Acquiring lock "refresh_cache-3393be13-7d81-48da-b6dd-a427e8403b22" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:53:29 user nova-compute[71509]: DEBUG nova.network.neutron [None req-105e1d43-2691-4e24-a38c-30a9e272fd22 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: 3393be13-7d81-48da-b6dd-a427e8403b22] Instance cache missing network info. {{(pid=71509) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 10:53:30 user nova-compute[71509]: DEBUG nova.network.neutron [None req-105e1d43-2691-4e24-a38c-30a9e272fd22 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: 3393be13-7d81-48da-b6dd-a427e8403b22] Updating instance_info_cache with network_info: [{"id": "5c5720ce-d39a-4676-9116-0e5adf24d40f", "address": "fa:16:3e:68:2b:29", "network": {"id": "b639a68a-2b4e-435c-b98b-65b5b4981c73", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1070821894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb8f294f957f4c74ae959c1e9f238427", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c5720ce-d3", "ovs_interfaceid": "5c5720ce-d39a-4676-9116-0e5adf24d40f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:53:30 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-105e1d43-2691-4e24-a38c-30a9e272fd22 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Releasing lock "refresh_cache-3393be13-7d81-48da-b6dd-a427e8403b22" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:53:30 user nova-compute[71509]: DEBUG nova.compute.manager [None req-105e1d43-2691-4e24-a38c-30a9e272fd22 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: 3393be13-7d81-48da-b6dd-a427e8403b22] Instance network_info: |[{"id": "5c5720ce-d39a-4676-9116-0e5adf24d40f", "address": "fa:16:3e:68:2b:29", "network": {"id": "b639a68a-2b4e-435c-b98b-65b5b4981c73", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1070821894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb8f294f957f4c74ae959c1e9f238427", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c5720ce-d3", "ovs_interfaceid": "5c5720ce-d39a-4676-9116-0e5adf24d40f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71509) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 10:53:30 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-894762d6-c837-40ce-b7ed-79bd23025902 req-82cfa446-0ca9-4506-bb6f-5fd9c6d2e06d service nova] Acquired lock "refresh_cache-3393be13-7d81-48da-b6dd-a427e8403b22" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:53:30 user nova-compute[71509]: DEBUG nova.network.neutron [req-894762d6-c837-40ce-b7ed-79bd23025902 req-82cfa446-0ca9-4506-bb6f-5fd9c6d2e06d service nova] [instance: 3393be13-7d81-48da-b6dd-a427e8403b22] Refreshing network info cache for port 5c5720ce-d39a-4676-9116-0e5adf24d40f {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 10:53:30 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-105e1d43-2691-4e24-a38c-30a9e272fd22 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: 3393be13-7d81-48da-b6dd-a427e8403b22] Start _get_guest_xml network_info=[{"id": "5c5720ce-d39a-4676-9116-0e5adf24d40f", "address": "fa:16:3e:68:2b:29", "network": {"id": "b639a68a-2b4e-435c-b98b-65b5b4981c73", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1070821894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb8f294f957f4c74ae959c1e9f238427", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c5720ce-d3", "ovs_interfaceid": "5c5720ce-d39a-4676-9116-0e5adf24d40f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T10:38:55Z,direct_url=<?>,disk_format='qcow2',id=048ec0ee-0465-448d-8b4c-f072acb101dc,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='9742d6ad20cf48d9bab0fdbcc9491db9',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T10:38:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '048ec0ee-0465-448d-8b4c-f072acb101dc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71509) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 10:53:30 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-105e1d43-2691-4e24-a38c-30a9e272fd22 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:53:30 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-105e1d43-2691-4e24-a38c-30a9e272fd22 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:53:30 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-105e1d43-2691-4e24-a38c-30a9e272fd22 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71509) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 10:53:30 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-105e1d43-2691-4e24-a38c-30a9e272fd22 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T10:40:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T10:38:55Z,direct_url=<?>,disk_format='qcow2',id=048ec0ee-0465-448d-8b4c-f072acb101dc,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='9742d6ad20cf48d9bab0fdbcc9491db9',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T10:38:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 10:53:30 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-105e1d43-2691-4e24-a38c-30a9e272fd22 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Flavor limits 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 10:53:30 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-105e1d43-2691-4e24-a38c-30a9e272fd22 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Image limits 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 10:53:30 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-105e1d43-2691-4e24-a38c-30a9e272fd22 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Flavor pref 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 10:53:30 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-105e1d43-2691-4e24-a38c-30a9e272fd22 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Image pref 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 10:53:30 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-105e1d43-2691-4e24-a38c-30a9e272fd22 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 10:53:30 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-105e1d43-2691-4e24-a38c-30a9e272fd22 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 10:53:30 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-105e1d43-2691-4e24-a38c-30a9e272fd22 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71509) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 10:53:30 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-105e1d43-2691-4e24-a38c-30a9e272fd22 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Got 1 possible topologies {{(pid=71509) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 10:53:30 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-105e1d43-2691-4e24-a38c-30a9e272fd22 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 10:53:30 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-105e1d43-2691-4e24-a38c-30a9e272fd22 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 10:53:30 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-105e1d43-2691-4e24-a38c-30a9e272fd22 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T10:53:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1573447995',display_name='tempest-AttachVolumeNegativeTest-server-1573447995',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1573447995',id=25,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBxakvNptBAyP1cjMVTNUR7Y9sIuqqQnSxaFT8xZj4eZ6vJiU+rnz3GVavCxzbNROb7vJOXXsA/chLaRy0bXyzzLXIsm6NEmtgSBCKwqRkZOoqmVz1nPd1tzgRdcn3tDVw==',key_name='tempest-keypair-160863978',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cb8f294f957f4c74ae959c1e9f238427',ramdisk_id='',reservation_id='r-lqlutgzh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-531644967',owner_user_name='tempest-AttachVolumeNegativeTest-531644967-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T10:53:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='78adbbdcd10e446daddde754e46309b2',uuid=3393be13-7d81-48da-b6dd-a427e8403b22,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5c5720ce-d39a-4676-9116-0e5adf24d40f", "address": "fa:16:3e:68:2b:29", "network": {"id": "b639a68a-2b4e-435c-b98b-65b5b4981c73", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1070821894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb8f294f957f4c74ae959c1e9f238427", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c5720ce-d3", "ovs_interfaceid": "5c5720ce-d39a-4676-9116-0e5adf24d40f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71509) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 10:53:30 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-105e1d43-2691-4e24-a38c-30a9e272fd22 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Converting VIF {"id": "5c5720ce-d39a-4676-9116-0e5adf24d40f", "address": "fa:16:3e:68:2b:29", "network": {"id": "b639a68a-2b4e-435c-b98b-65b5b4981c73", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1070821894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb8f294f957f4c74ae959c1e9f238427", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c5720ce-d3", "ovs_interfaceid": "5c5720ce-d39a-4676-9116-0e5adf24d40f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:53:30 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-105e1d43-2691-4e24-a38c-30a9e272fd22 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:2b:29,bridge_name='br-int',has_traffic_filtering=True,id=5c5720ce-d39a-4676-9116-0e5adf24d40f,network=Network(b639a68a-2b4e-435c-b98b-65b5b4981c73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c5720ce-d3') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:53:30 user nova-compute[71509]: DEBUG nova.objects.instance [None req-105e1d43-2691-4e24-a38c-30a9e272fd22 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lazy-loading 'pci_devices' on Instance uuid 3393be13-7d81-48da-b6dd-a427e8403b22 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:53:30 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-105e1d43-2691-4e24-a38c-30a9e272fd22 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: 3393be13-7d81-48da-b6dd-a427e8403b22] End _get_guest_xml xml=<domain type="kvm">
Apr 14 10:53:30 user nova-compute[71509]:   <uuid>3393be13-7d81-48da-b6dd-a427e8403b22</uuid>
Apr 14 10:53:30 user nova-compute[71509]:   <name>instance-00000019</name>
Apr 14 10:53:30 user nova-compute[71509]:   <memory>131072</memory>
Apr 14 10:53:30 user nova-compute[71509]:   <vcpu>1</vcpu>
Apr 14 10:53:30 user nova-compute[71509]:   <metadata>
Apr 14 10:53:30 user nova-compute[71509]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 10:53:30 user nova-compute[71509]:       <nova:package version="0.0.0"/>
Apr 14 10:53:30 user nova-compute[71509]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1573447995</nova:name>
Apr 14 10:53:30 user nova-compute[71509]:       <nova:creationTime>2023-04-14 10:53:30</nova:creationTime>
Apr 14 10:53:30 user nova-compute[71509]:       <nova:flavor name="m1.nano">
Apr 14 10:53:30 user nova-compute[71509]:         <nova:memory>128</nova:memory>
Apr 14 10:53:30 user nova-compute[71509]:         <nova:disk>1</nova:disk>
Apr 14 10:53:30 user nova-compute[71509]:         <nova:swap>0</nova:swap>
Apr 14 10:53:30 user nova-compute[71509]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 10:53:30 user nova-compute[71509]:         <nova:vcpus>1</nova:vcpus>
Apr 14 10:53:30 user nova-compute[71509]:       </nova:flavor>
Apr 14 10:53:30 user nova-compute[71509]:       <nova:owner>
Apr 14 10:53:30 user nova-compute[71509]:         <nova:user uuid="78adbbdcd10e446daddde754e46309b2">tempest-AttachVolumeNegativeTest-531644967-project-member</nova:user>
Apr 14 10:53:30 user nova-compute[71509]:         <nova:project uuid="cb8f294f957f4c74ae959c1e9f238427">tempest-AttachVolumeNegativeTest-531644967</nova:project>
Apr 14 10:53:30 user nova-compute[71509]:       </nova:owner>
Apr 14 10:53:30 user nova-compute[71509]:       <nova:root type="image" uuid="048ec0ee-0465-448d-8b4c-f072acb101dc"/>
Apr 14 10:53:30 user nova-compute[71509]:       <nova:ports>
Apr 14 10:53:30 user nova-compute[71509]:         <nova:port uuid="5c5720ce-d39a-4676-9116-0e5adf24d40f">
Apr 14 10:53:30 user nova-compute[71509]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 14 10:53:30 user nova-compute[71509]:         </nova:port>
Apr 14 10:53:30 user nova-compute[71509]:       </nova:ports>
Apr 14 10:53:30 user nova-compute[71509]:     </nova:instance>
Apr 14 10:53:30 user nova-compute[71509]:   </metadata>
Apr 14 10:53:30 user nova-compute[71509]:   <sysinfo type="smbios">
Apr 14 10:53:30 user nova-compute[71509]:     <system>
Apr 14 10:53:30 user nova-compute[71509]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 10:53:30 user nova-compute[71509]:       <entry name="product">OpenStack Nova</entry>
Apr 14 10:53:30 user nova-compute[71509]:       <entry name="version">0.0.0</entry>
Apr 14 10:53:30 user nova-compute[71509]:       <entry name="serial">3393be13-7d81-48da-b6dd-a427e8403b22</entry>
Apr 14 10:53:30 user nova-compute[71509]:       <entry name="uuid">3393be13-7d81-48da-b6dd-a427e8403b22</entry>
Apr 14 10:53:30 user nova-compute[71509]:       <entry name="family">Virtual Machine</entry>
Apr 14 10:53:30 user nova-compute[71509]:     </system>
Apr 14 10:53:30 user nova-compute[71509]:   </sysinfo>
Apr 14 10:53:30 user nova-compute[71509]:   <os>
Apr 14 10:53:30 user nova-compute[71509]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 10:53:30 user nova-compute[71509]:     <boot dev="hd"/>
Apr 14 10:53:30 user nova-compute[71509]:     <smbios mode="sysinfo"/>
Apr 14 10:53:30 user nova-compute[71509]:   </os>
Apr 14 10:53:30 user nova-compute[71509]:   <features>
Apr 14 10:53:30 user nova-compute[71509]:     <acpi/>
Apr 14 10:53:30 user nova-compute[71509]:     <apic/>
Apr 14 10:53:30 user nova-compute[71509]:     <vmcoreinfo/>
Apr 14 10:53:30 user nova-compute[71509]:   </features>
Apr 14 10:53:30 user nova-compute[71509]:   <clock offset="utc">
Apr 14 10:53:30 user nova-compute[71509]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 10:53:30 user nova-compute[71509]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 10:53:30 user nova-compute[71509]:     <timer name="hpet" present="no"/>
Apr 14 10:53:30 user nova-compute[71509]:   </clock>
Apr 14 10:53:30 user nova-compute[71509]:   <cpu mode="custom" match="exact">
Apr 14 10:53:30 user nova-compute[71509]:     <model>Nehalem</model>
Apr 14 10:53:30 user nova-compute[71509]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 10:53:30 user nova-compute[71509]:   </cpu>
Apr 14 10:53:30 user nova-compute[71509]:   <devices>
Apr 14 10:53:30 user nova-compute[71509]:     <disk type="file" device="disk">
Apr 14 10:53:30 user nova-compute[71509]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 10:53:30 user nova-compute[71509]:       <source file="/opt/stack/data/nova/instances/3393be13-7d81-48da-b6dd-a427e8403b22/disk"/>
Apr 14 10:53:30 user nova-compute[71509]:       <target dev="vda" bus="virtio"/>
Apr 14 10:53:30 user nova-compute[71509]:     </disk>
Apr 14 10:53:30 user nova-compute[71509]:     <interface type="ethernet">
Apr 14 10:53:30 user nova-compute[71509]:       <mac address="fa:16:3e:68:2b:29"/>
Apr 14 10:53:30 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 10:53:30 user nova-compute[71509]:       <mtu size="1442"/>
Apr 14 10:53:30 user nova-compute[71509]:       <target dev="tap5c5720ce-d3"/>
Apr 14 10:53:30 user nova-compute[71509]:     </interface>
Apr 14 10:53:30 user nova-compute[71509]:     <serial type="pty">
Apr 14 10:53:30 user nova-compute[71509]:       <log file="/opt/stack/data/nova/instances/3393be13-7d81-48da-b6dd-a427e8403b22/console.log" append="off"/>
Apr 14 10:53:30 user nova-compute[71509]:     </serial>
Apr 14 10:53:30 user nova-compute[71509]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 10:53:30 user nova-compute[71509]:     <video>
Apr 14 10:53:30 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 10:53:30 user nova-compute[71509]:     </video>
Apr 14 10:53:30 user nova-compute[71509]:     <rng model="virtio">
Apr 14 10:53:30 user nova-compute[71509]:       <backend model="random">/dev/urandom</backend>
Apr 14 10:53:30 user nova-compute[71509]:     </rng>
Apr 14 10:53:30 user nova-compute[71509]:     <controller type="usb" index="0" model="none"/>
Apr 14 10:53:30 user nova-compute[71509]:     <memballoon model="virtio">
Apr 14 10:53:30 user nova-compute[71509]:       <stats period="10"/>
Apr 14 10:53:30 user nova-compute[71509]:     </memballoon>
Apr 14 10:53:30 user nova-compute[71509]:   </devices>
Apr 14 10:53:30 user nova-compute[71509]: </domain>
Apr 14 10:53:30 user nova-compute[71509]:  {{(pid=71509) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 10:53:30 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-105e1d43-2691-4e24-a38c-30a9e272fd22 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T10:53:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1573447995',display_name='tempest-AttachVolumeNegativeTest-server-1573447995',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1573447995',id=25,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBxakvNptBAyP1cjMVTNUR7Y9sIuqqQnSxaFT8xZj4eZ6vJiU+rnz3GVavCxzbNROb7vJOXXsA/chLaRy0bXyzzLXIsm6NEmtgSBCKwqRkZOoqmVz1nPd1tzgRdcn3tDVw==',key_name='tempest-keypair-160863978',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cb8f294f957f4c74ae959c1e9f238427',ramdisk_id='',reservation_id='r-lqlutgzh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-531644967',owner_user_name='tempest-AttachVolumeNegativeTest-531644967-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T10:53:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='78adbbdcd10e446daddde754e46309b2',uuid=3393be13-7d81-48da-b6dd-a427e8403b22,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5c5720ce-d39a-4676-9116-0e5adf24d40f", "address": "fa:16:3e:68:2b:29", "network": {"id": "b639a68a-2b4e-435c-b98b-65b5b4981c73", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1070821894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb8f294f957f4c74ae959c1e9f238427", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c5720ce-d3", "ovs_interfaceid": "5c5720ce-d39a-4676-9116-0e5adf24d40f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 10:53:30 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-105e1d43-2691-4e24-a38c-30a9e272fd22 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Converting VIF {"id": "5c5720ce-d39a-4676-9116-0e5adf24d40f", "address": "fa:16:3e:68:2b:29", "network": {"id": "b639a68a-2b4e-435c-b98b-65b5b4981c73", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1070821894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb8f294f957f4c74ae959c1e9f238427", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c5720ce-d3", "ovs_interfaceid": "5c5720ce-d39a-4676-9116-0e5adf24d40f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:53:30 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-105e1d43-2691-4e24-a38c-30a9e272fd22 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:2b:29,bridge_name='br-int',has_traffic_filtering=True,id=5c5720ce-d39a-4676-9116-0e5adf24d40f,network=Network(b639a68a-2b4e-435c-b98b-65b5b4981c73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c5720ce-d3') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:53:30 user nova-compute[71509]: DEBUG os_vif [None req-105e1d43-2691-4e24-a38c-30a9e272fd22 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:2b:29,bridge_name='br-int',has_traffic_filtering=True,id=5c5720ce-d39a-4676-9116-0e5adf24d40f,network=Network(b639a68a-2b4e-435c-b98b-65b5b4981c73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c5720ce-d3') {{(pid=71509) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 10:53:30 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:53:30 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:53:30 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 10:53:30 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:53:30 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5c5720ce-d3, may_exist=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:53:30 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5c5720ce-d3, col_values=(('external_ids', {'iface-id': '5c5720ce-d39a-4676-9116-0e5adf24d40f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:68:2b:29', 'vm-uuid': '3393be13-7d81-48da-b6dd-a427e8403b22'}),)) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:53:30 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:53:30 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 10:53:30 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:53:30 user nova-compute[71509]: INFO os_vif [None req-105e1d43-2691-4e24-a38c-30a9e272fd22 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:2b:29,bridge_name='br-int',has_traffic_filtering=True,id=5c5720ce-d39a-4676-9116-0e5adf24d40f,network=Network(b639a68a-2b4e-435c-b98b-65b5b4981c73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c5720ce-d3')
Apr 14 10:53:30 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-105e1d43-2691-4e24-a38c-30a9e272fd22 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] No BDM found with device name vda, not building metadata. {{(pid=71509) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 10:53:30 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-105e1d43-2691-4e24-a38c-30a9e272fd22 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] No VIF found with MAC fa:16:3e:68:2b:29, not building metadata {{(pid=71509) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 10:53:30 user nova-compute[71509]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681469595.3961265, 8586a70e-9855-4177-ac1b-cf707a4df871 => Stopped> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 10:53:30 user nova-compute[71509]: INFO nova.compute.manager [-] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] VM Stopped (Lifecycle Event)
Apr 14 10:53:30 user nova-compute[71509]: DEBUG nova.compute.manager [None req-ae382ef0-1e72-4776-822a-7a6a651e63c3 None None] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:53:30 user nova-compute[71509]: DEBUG nova.compute.manager [None req-ae382ef0-1e72-4776-822a-7a6a651e63c3 None None] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 10:53:30 user nova-compute[71509]: DEBUG nova.network.neutron [req-894762d6-c837-40ce-b7ed-79bd23025902 req-82cfa446-0ca9-4506-bb6f-5fd9c6d2e06d service nova] [instance: 3393be13-7d81-48da-b6dd-a427e8403b22] Updated VIF entry in instance network info cache for port 5c5720ce-d39a-4676-9116-0e5adf24d40f. {{(pid=71509) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 10:53:30 user nova-compute[71509]: DEBUG nova.network.neutron [req-894762d6-c837-40ce-b7ed-79bd23025902 req-82cfa446-0ca9-4506-bb6f-5fd9c6d2e06d service nova] [instance: 3393be13-7d81-48da-b6dd-a427e8403b22] Updating instance_info_cache with network_info: [{"id": "5c5720ce-d39a-4676-9116-0e5adf24d40f", "address": "fa:16:3e:68:2b:29", "network": {"id": "b639a68a-2b4e-435c-b98b-65b5b4981c73", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1070821894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb8f294f957f4c74ae959c1e9f238427", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c5720ce-d3", "ovs_interfaceid": "5c5720ce-d39a-4676-9116-0e5adf24d40f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:53:30 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-894762d6-c837-40ce-b7ed-79bd23025902 req-82cfa446-0ca9-4506-bb6f-5fd9c6d2e06d service nova] Releasing lock "refresh_cache-3393be13-7d81-48da-b6dd-a427e8403b22" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:53:31 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:53:31 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:53:31 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:53:31 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:53:31 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:53:31 user nova-compute[71509]: DEBUG nova.compute.manager [req-5d3f21da-871f-42c5-ad42-f97453e57f65 req-278f9148-de92-430b-a24f-dfb8b636935b service nova] [instance: 3393be13-7d81-48da-b6dd-a427e8403b22] Received event network-vif-plugged-5c5720ce-d39a-4676-9116-0e5adf24d40f {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:53:31 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-5d3f21da-871f-42c5-ad42-f97453e57f65 req-278f9148-de92-430b-a24f-dfb8b636935b service nova] Acquiring lock "3393be13-7d81-48da-b6dd-a427e8403b22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:53:31 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-5d3f21da-871f-42c5-ad42-f97453e57f65 req-278f9148-de92-430b-a24f-dfb8b636935b service nova] Lock "3393be13-7d81-48da-b6dd-a427e8403b22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:53:31 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-5d3f21da-871f-42c5-ad42-f97453e57f65 req-278f9148-de92-430b-a24f-dfb8b636935b service nova] Lock "3393be13-7d81-48da-b6dd-a427e8403b22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:53:31 user nova-compute[71509]: DEBUG nova.compute.manager [req-5d3f21da-871f-42c5-ad42-f97453e57f65 req-278f9148-de92-430b-a24f-dfb8b636935b service nova] [instance: 3393be13-7d81-48da-b6dd-a427e8403b22] No waiting events found dispatching network-vif-plugged-5c5720ce-d39a-4676-9116-0e5adf24d40f {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:53:31 user nova-compute[71509]: WARNING nova.compute.manager [req-5d3f21da-871f-42c5-ad42-f97453e57f65 req-278f9148-de92-430b-a24f-dfb8b636935b service nova] [instance: 3393be13-7d81-48da-b6dd-a427e8403b22] Received unexpected event network-vif-plugged-5c5720ce-d39a-4676-9116-0e5adf24d40f for instance with vm_state building and task_state spawning.
Apr 14 10:53:31 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:53:32 user nova-compute[71509]: DEBUG nova.network.neutron [None req-2311f678-0678-4bb2-8183-b029d7d8e4c4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Port 608a2408-02df-474f-9006-260c8c97def1 binding to destination host user is already ACTIVE {{(pid=71509) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3161}}
Apr 14 10:53:32 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-2311f678-0678-4bb2-8183-b029d7d8e4c4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "refresh_cache-b4abb549-8f36-40c5-971f-8accbb14ff86" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:53:32 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-2311f678-0678-4bb2-8183-b029d7d8e4c4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquired lock "refresh_cache-b4abb549-8f36-40c5-971f-8accbb14ff86" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:53:32 user nova-compute[71509]: DEBUG nova.network.neutron [None req-2311f678-0678-4bb2-8183-b029d7d8e4c4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Building network info cache for instance {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 10:53:33 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:53:33 user nova-compute[71509]: DEBUG nova.network.neutron [None req-2311f678-0678-4bb2-8183-b029d7d8e4c4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Updating instance_info_cache with network_info: [{"id": "608a2408-02df-474f-9006-260c8c97def1", "address": "fa:16:3e:e4:f7:87", "network": {"id": "18a91434-637b-4c19-a97b-736b32c1ea5a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1824162811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea2cb4dfa5b4a52b658efd8f5aefb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap608a2408-02", "ovs_interfaceid": "608a2408-02df-474f-9006-260c8c97def1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:53:33 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-2311f678-0678-4bb2-8183-b029d7d8e4c4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Releasing lock "refresh_cache-b4abb549-8f36-40c5-971f-8accbb14ff86" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:53:33 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-2311f678-0678-4bb2-8183-b029d7d8e4c4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Creating tmpfile /opt/stack/data/nova/instances/b4abb549-8f36-40c5-971f-8accbb14ff86/tmp63mkvlif to verify with other compute node that the instance is on the same shared storage. {{(pid=71509) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9595}}
Apr 14 10:53:33 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:53:33 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:53:33 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:53:33 user nova-compute[71509]: DEBUG nova.compute.manager [req-bb5c73bf-afcb-47cb-96f5-525d51606fd9 req-efd43e19-231c-4259-8e27-9ba5ad89cb59 service nova] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Received event network-vif-unplugged-608a2408-02df-474f-9006-260c8c97def1 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:53:33 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-bb5c73bf-afcb-47cb-96f5-525d51606fd9 req-efd43e19-231c-4259-8e27-9ba5ad89cb59 service nova] Acquiring lock "b4abb549-8f36-40c5-971f-8accbb14ff86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:53:33 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-bb5c73bf-afcb-47cb-96f5-525d51606fd9 req-efd43e19-231c-4259-8e27-9ba5ad89cb59 service nova] Lock "b4abb549-8f36-40c5-971f-8accbb14ff86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:53:33 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-bb5c73bf-afcb-47cb-96f5-525d51606fd9 req-efd43e19-231c-4259-8e27-9ba5ad89cb59 service nova] Lock "b4abb549-8f36-40c5-971f-8accbb14ff86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:53:33 user nova-compute[71509]: DEBUG nova.compute.manager [req-bb5c73bf-afcb-47cb-96f5-525d51606fd9 req-efd43e19-231c-4259-8e27-9ba5ad89cb59 service nova] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] No waiting events found dispatching network-vif-unplugged-608a2408-02df-474f-9006-260c8c97def1 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:53:33 user nova-compute[71509]: WARNING nova.compute.manager [req-bb5c73bf-afcb-47cb-96f5-525d51606fd9 req-efd43e19-231c-4259-8e27-9ba5ad89cb59 service nova] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Received unexpected event network-vif-unplugged-608a2408-02df-474f-9006-260c8c97def1 for instance with vm_state resized and task_state resize_reverting.
Apr 14 10:53:33 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Instance destroyed successfully.
Apr 14 10:53:33 user nova-compute[71509]: DEBUG nova.objects.instance [None req-2311f678-0678-4bb2-8183-b029d7d8e4c4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lazy-loading 'resources' on Instance uuid b4abb549-8f36-40c5-971f-8accbb14ff86 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:53:33 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-2311f678-0678-4bb2-8183-b029d7d8e4c4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T10:42:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-375061147',display_name='tempest-ServerActionsTestJSON-server-564468196',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-375061147',id=4,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNt/FyD1XXsxB5kJC+SJ1dgkjoXXHkL+KX0Cr5HvI72xTIz+DAtuVRPHeIpMNLt39mbbZ9KAoCJibRQza0Qbd8j8EEoV7QHombhWz2Mdusr+gJ2OYTqrrRzVbjIHACTFWw==',key_name='tempest-keypair-1544270235',keypairs=<?>,launch_index=0,launched_at=2023-04-14T10:51:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=<?>,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3ea2cb4dfa5b4a52b658efd8f5aefb36',ramdisk_id='',reservation_id='r-2qmryidz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-1923052090',owner_user_name='tempest-ServerActionsTestJSON-1923052090-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T10:51:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5873a358bf544691b12cd2979f5e36dc',uuid=b4abb549-8f36-40c5-971f-8accbb14ff86,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "608a2408-02df-474f-9006-260c8c97def1", "address": "fa:16:3e:e4:f7:87", "network": {"id": "18a91434-637b-4c19-a97b-736b32c1ea5a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1824162811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea2cb4dfa5b4a52b658efd8f5aefb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap608a2408-02", "ovs_interfaceid": "608a2408-02df-474f-9006-260c8c97def1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 10:53:33 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-2311f678-0678-4bb2-8183-b029d7d8e4c4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Converting VIF {"id": "608a2408-02df-474f-9006-260c8c97def1", "address": "fa:16:3e:e4:f7:87", "network": {"id": "18a91434-637b-4c19-a97b-736b32c1ea5a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1824162811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea2cb4dfa5b4a52b658efd8f5aefb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap608a2408-02", "ovs_interfaceid": "608a2408-02df-474f-9006-260c8c97def1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:53:33 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-2311f678-0678-4bb2-8183-b029d7d8e4c4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e4:f7:87,bridge_name='br-int',has_traffic_filtering=True,id=608a2408-02df-474f-9006-260c8c97def1,network=Network(18a91434-637b-4c19-a97b-736b32c1ea5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap608a2408-02') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:53:33 user nova-compute[71509]: DEBUG os_vif [None req-2311f678-0678-4bb2-8183-b029d7d8e4c4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e4:f7:87,bridge_name='br-int',has_traffic_filtering=True,id=608a2408-02df-474f-9006-260c8c97def1,network=Network(18a91434-637b-4c19-a97b-736b32c1ea5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap608a2408-02') {{(pid=71509) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 10:53:33 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:53:33 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap608a2408-02, bridge=br-int, if_exists=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:53:33 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:53:33 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 10:53:33 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:53:33 user nova-compute[71509]: INFO os_vif [None req-2311f678-0678-4bb2-8183-b029d7d8e4c4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e4:f7:87,bridge_name='br-int',has_traffic_filtering=True,id=608a2408-02df-474f-9006-260c8c97def1,network=Network(18a91434-637b-4c19-a97b-736b32c1ea5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap608a2408-02')
Apr 14 10:53:33 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2311f678-0678-4bb2-8183-b029d7d8e4c4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] calling os-brick to detach iSCSI Volume {{(pid=71509) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 10:53:33 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-2311f678-0678-4bb2-8183-b029d7d8e4c4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0bf0749390>, {'target_iqn': 'iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KDNjCusQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 10:53:33 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-2311f678-0678-4bb2-8183-b029d7d8e4c4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 10:53:33 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-2311f678-0678-4bb2-8183-b029d7d8e4c4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 10:53:33 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-2311f678-0678-4bb2-8183-b029d7d8e4c4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 10:53:33 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:53:33 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681469613.9099936, 3393be13-7d81-48da-b6dd-a427e8403b22 => Resumed> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 10:53:33 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 3393be13-7d81-48da-b6dd-a427e8403b22] VM Resumed (Lifecycle Event)
Apr 14 10:53:33 user nova-compute[71509]: DEBUG nova.compute.manager [None req-105e1d43-2691-4e24-a38c-30a9e272fd22 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: 3393be13-7d81-48da-b6dd-a427e8403b22] Instance event wait completed in 0 seconds for  {{(pid=71509) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 10:53:33 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-105e1d43-2691-4e24-a38c-30a9e272fd22 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: 3393be13-7d81-48da-b6dd-a427e8403b22] Guest created on hypervisor {{(pid=71509) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 10:53:33 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: 3393be13-7d81-48da-b6dd-a427e8403b22] Instance spawned successfully.
Apr 14 10:53:33 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-105e1d43-2691-4e24-a38c-30a9e272fd22 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: 3393be13-7d81-48da-b6dd-a427e8403b22] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 10:53:33 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:53:33 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bbaa72e-b312-4bfd-aa48-2e94fa3d26de]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e52b9d6a-ee3e-42b8-973e-d47c4ed33196\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:08f71190-2402-402d-af67-edf9226e4fb8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:53:33 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-2311f678-0678-4bb2-8183-b029d7d8e4c4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 10:53:33 user nova-compute[71509]: No targets found.
Apr 14 10:53:33 user nova-compute[71509]: iSNS:
Apr 14 10:53:33 user nova-compute[71509]: No targets found.
Apr 14 10:53:33 user nova-compute[71509]: STATIC:
Apr 14 10:53:33 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe
Apr 14 10:53:33 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:53:33 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:53:33 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:e52b9d6a-ee3e-42b8-973e-d47c4ed33196
Apr 14 10:53:33 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:53:33 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:53:33 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:08f71190-2402-402d-af67-edf9226e4fb8
Apr 14 10:53:33 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:53:33 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:53:33 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178
Apr 14 10:53:33 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:53:33 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:53:33 user nova-compute[71509]: FIRMWARE:
Apr 14 10:53:33 user nova-compute[71509]: No targets found.
Apr 14 10:53:33 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:53:33 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-2311f678-0678-4bb2-8183-b029d7d8e4c4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 10:53:33 user nova-compute[71509]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 10:53:33 user nova-compute[71509]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71509) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 10:53:33 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-2311f678-0678-4bb2-8183-b029d7d8e4c4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe', 0)] {{(pid=71509) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 10:53:33 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:53:33 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 3393be13-7d81-48da-b6dd-a427e8403b22] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:53:33 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:53:33 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[a273467d-6487-4818-b8d0-211d0a8f3694]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:08f71190-2402-402d-af67-edf9226e4fb8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e52b9d6a-ee3e-42b8-973e-d47c4ed33196\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:53:33 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:53:33 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-105e1d43-2691-4e24-a38c-30a9e272fd22 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: 3393be13-7d81-48da-b6dd-a427e8403b22] Found default for hw_cdrom_bus of ide {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:53:33 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-105e1d43-2691-4e24-a38c-30a9e272fd22 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: 3393be13-7d81-48da-b6dd-a427e8403b22] Found default for hw_disk_bus of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:53:33 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-105e1d43-2691-4e24-a38c-30a9e272fd22 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: 3393be13-7d81-48da-b6dd-a427e8403b22] Found default for hw_input_bus of None {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:53:33 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-105e1d43-2691-4e24-a38c-30a9e272fd22 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: 3393be13-7d81-48da-b6dd-a427e8403b22] Found default for hw_pointer_model of None {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:53:33 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-105e1d43-2691-4e24-a38c-30a9e272fd22 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: 3393be13-7d81-48da-b6dd-a427e8403b22] Found default for hw_video_model of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:53:33 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-105e1d43-2691-4e24-a38c-30a9e272fd22 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: 3393be13-7d81-48da-b6dd-a427e8403b22] Found default for hw_vif_model of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:53:33 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 3393be13-7d81-48da-b6dd-a427e8403b22] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 10:53:33 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:53:33 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dddcf24-28bd-4500-ac38-e4316029b041]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08f71190-2402-402d-af67-edf9226e4fb8 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52b9d6a-ee3e-42b8-973e-d47c4ed33196 (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:53:33 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-2311f678-0678-4bb2-8183-b029d7d8e4c4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)
Apr 14 10:53:33 user nova-compute[71509]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe (non-flash)
Apr 14 10:53:33 user nova-compute[71509]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08f71190-2402-402d-af67-edf9226e4fb8 (non-flash)
Apr 14 10:53:33 user nova-compute[71509]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52b9d6a-ee3e-42b8-973e-d47c4ed33196 (non-flash)
Apr 14 10:53:33 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:53:33 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-2311f678-0678-4bb2-8183-b029d7d8e4c4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)
Apr 14 10:53:33 user nova-compute[71509]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe (non-flash)
Apr 14 10:53:33 user nova-compute[71509]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08f71190-2402-402d-af67-edf9226e4fb8 (non-flash)
Apr 14 10:53:33 user nova-compute[71509]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52b9d6a-ee3e-42b8-973e-d47c4ed33196 (non-flash)
Apr 14 10:53:33 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 10:53:33 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-2311f678-0678-4bb2-8183-b029d7d8e4c4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0c375bb490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe'): ({'sdb'}, set())}) {{(pid=71509) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 10:53:33 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-2311f678-0678-4bb2-8183-b029d7d8e4c4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Removing single pathed devices sdb {{(pid=71509) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 10:53:33 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 3393be13-7d81-48da-b6dd-a427e8403b22] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 10:53:33 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681469613.9119847, 3393be13-7d81-48da-b6dd-a427e8403b22 => Started> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 10:53:33 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 3393be13-7d81-48da-b6dd-a427e8403b22] VM Started (Lifecycle Event)
Apr 14 10:53:33 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:53:34 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 3393be13-7d81-48da-b6dd-a427e8403b22] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:53:34 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:53:34 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fe09b2c-0272-4a91-addc-1ee689f40296]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:53:34 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 3393be13-7d81-48da-b6dd-a427e8403b22] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 10:53:34 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:53:34 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:53:34 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[641fb4de-bec9-4d21-8b28-da20fddc271d]: (4, ('ok\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:53:34 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-2311f678-0678-4bb2-8183-b029d7d8e4c4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Flushing IO for device /dev/sdb {{(pid=71509) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 10:53:34 user nova-compute[71509]: DEBUG nova.compute.manager [req-65b2e5a8-ba71-4078-af97-bee058598735 req-9f1a73c2-423f-43d2-9172-32b30627f1f9 service nova] [instance: 3393be13-7d81-48da-b6dd-a427e8403b22] Received event network-vif-plugged-5c5720ce-d39a-4676-9116-0e5adf24d40f {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:53:34 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-65b2e5a8-ba71-4078-af97-bee058598735 req-9f1a73c2-423f-43d2-9172-32b30627f1f9 service nova] Acquiring lock "3393be13-7d81-48da-b6dd-a427e8403b22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:53:34 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-65b2e5a8-ba71-4078-af97-bee058598735 req-9f1a73c2-423f-43d2-9172-32b30627f1f9 service nova] Lock "3393be13-7d81-48da-b6dd-a427e8403b22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:53:34 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-65b2e5a8-ba71-4078-af97-bee058598735 req-9f1a73c2-423f-43d2-9172-32b30627f1f9 service nova] Lock "3393be13-7d81-48da-b6dd-a427e8403b22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:53:34 user nova-compute[71509]: DEBUG nova.compute.manager [req-65b2e5a8-ba71-4078-af97-bee058598735 req-9f1a73c2-423f-43d2-9172-32b30627f1f9 service nova] [instance: 3393be13-7d81-48da-b6dd-a427e8403b22] No waiting events found dispatching network-vif-plugged-5c5720ce-d39a-4676-9116-0e5adf24d40f {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:53:34 user nova-compute[71509]: WARNING nova.compute.manager [req-65b2e5a8-ba71-4078-af97-bee058598735 req-9f1a73c2-423f-43d2-9172-32b30627f1f9 service nova] [instance: 3393be13-7d81-48da-b6dd-a427e8403b22] Received unexpected event network-vif-plugged-5c5720ce-d39a-4676-9116-0e5adf24d40f for instance with vm_state building and task_state spawning.
Apr 14 10:53:34 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:53:34 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 3393be13-7d81-48da-b6dd-a427e8403b22] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 10:53:34 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:53:34 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4b979d7-f0e3-49c3-a999-fd1914e34f7b]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:53:34 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-2311f678-0678-4bb2-8183-b029d7d8e4c4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71509) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 10:53:34 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:53:34 user nova-compute[71509]: INFO nova.compute.manager [None req-105e1d43-2691-4e24-a38c-30a9e272fd22 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: 3393be13-7d81-48da-b6dd-a427e8403b22] Took 6.28 seconds to spawn the instance on the hypervisor.
Apr 14 10:53:34 user nova-compute[71509]: DEBUG nova.compute.manager [None req-105e1d43-2691-4e24-a38c-30a9e272fd22 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: 3393be13-7d81-48da-b6dd-a427e8403b22] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:53:34 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:53:34 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e422fb6-deaf-4c7b-af49-cc782a7e9f69]: (4, ('1', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:53:34 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-2311f678-0678-4bb2-8183-b029d7d8e4c4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71509) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 10:53:34 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-2311f678-0678-4bb2-8183-b029d7d8e4c4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] SCSI volumes sdb have been removed. {{(pid=71509) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 10:53:34 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-2311f678-0678-4bb2-8183-b029d7d8e4c4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe')] {{(pid=71509) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 10:53:34 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:53:34 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:53:34 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[eebee52e-a8f1-4ae7-937f-31aaa6070330]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:53:34 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-2311f678-0678-4bb2-8183-b029d7d8e4c4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:53:34 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe -p 172.16.0.220:3260 --logout {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:53:34 user nova-compute[71509]: INFO nova.compute.manager [None req-105e1d43-2691-4e24-a38c-30a9e272fd22 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: 3393be13-7d81-48da-b6dd-a427e8403b22] Took 7.41 seconds to build instance.
Apr 14 10:53:34 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe -p 172.16.0.220:3260 --logout" returned: 0 in 0.094s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:53:34 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[063485da-3f83-41f6-a165-2234f4f49ee7]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:53:34 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-2311f678-0678-4bb2-8183-b029d7d8e4c4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe, portal: 172.16.0.220,3260]
Apr 14 10:53:34 user nova-compute[71509]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe, portal: 172.16.0.220,3260] successful.
Apr 14 10:53:34 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:53:34 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe -p 172.16.0.220:3260 --op delete {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:53:34 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-105e1d43-2691-4e24-a38c-30a9e272fd22 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "3393be13-7d81-48da-b6dd-a427e8403b22" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.597s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:53:34 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:53:34 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[048934b0-6180-4ad0-b8db-962f311f233f]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:53:34 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-2311f678-0678-4bb2-8183-b029d7d8e4c4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:53:34 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-2311f678-0678-4bb2-8183-b029d7d8e4c4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.370s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 10:53:34 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-2311f678-0678-4bb2-8183-b029d7d8e4c4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] <== disconnect_volume: return (371ms) None {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 10:53:34 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2311f678-0678-4bb2-8183-b029d7d8e4c4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Disconnected iSCSI Volume {{(pid=71509) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 10:53:34 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:53:34 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71509) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 10:53:34 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:53:34 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Cleaning up deleted instances {{(pid=71509) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 14 10:53:34 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] There are 0 instances to clean {{(pid=71509) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 14 10:53:35 user nova-compute[71509]: DEBUG nova.compute.manager [req-edfc7a2c-3ac3-46b7-9679-101273d8b6c9 req-825eb0fe-25b8-4658-bde3-2669969c8e35 service nova] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Received event network-vif-plugged-608a2408-02df-474f-9006-260c8c97def1 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:53:35 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-edfc7a2c-3ac3-46b7-9679-101273d8b6c9 req-825eb0fe-25b8-4658-bde3-2669969c8e35 service nova] Acquiring lock "b4abb549-8f36-40c5-971f-8accbb14ff86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:53:35 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-edfc7a2c-3ac3-46b7-9679-101273d8b6c9 req-825eb0fe-25b8-4658-bde3-2669969c8e35 service nova] Lock "b4abb549-8f36-40c5-971f-8accbb14ff86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:53:35 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-edfc7a2c-3ac3-46b7-9679-101273d8b6c9 req-825eb0fe-25b8-4658-bde3-2669969c8e35 service nova] Lock "b4abb549-8f36-40c5-971f-8accbb14ff86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:53:35 user nova-compute[71509]: DEBUG nova.compute.manager [req-edfc7a2c-3ac3-46b7-9679-101273d8b6c9 req-825eb0fe-25b8-4658-bde3-2669969c8e35 service nova] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] No waiting events found dispatching network-vif-plugged-608a2408-02df-474f-9006-260c8c97def1 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:53:35 user nova-compute[71509]: WARNING nova.compute.manager [req-edfc7a2c-3ac3-46b7-9679-101273d8b6c9 req-825eb0fe-25b8-4658-bde3-2669969c8e35 service nova] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Received unexpected event network-vif-plugged-608a2408-02df-474f-9006-260c8c97def1 for instance with vm_state resized and task_state resize_reverting.
Apr 14 10:53:35 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:53:35 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-2311f678-0678-4bb2-8183-b029d7d8e4c4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:53:35 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-2311f678-0678-4bb2-8183-b029d7d8e4c4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:53:35 user nova-compute[71509]: DEBUG nova.objects.instance [None req-2311f678-0678-4bb2-8183-b029d7d8e4c4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lazy-loading 'migration_context' on Instance uuid b4abb549-8f36-40c5-971f-8accbb14ff86 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:53:36 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-2311f678-0678-4bb2-8183-b029d7d8e4c4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 10:53:36 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-2311f678-0678-4bb2-8183-b029d7d8e4c4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 10:53:36 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:53:36 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-2311f678-0678-4bb2-8183-b029d7d8e4c4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.648s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:53:36 user nova-compute[71509]: INFO nova.compute.manager [None req-2311f678-0678-4bb2-8183-b029d7d8e4c4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Swapping old allocation on dict_keys(['52209f7e-594e-4cf4-9018-18636056cd6b']) held by migration aec5f116-c76f-438a-bee3-2a98dbe64d04 for instance
Apr 14 10:53:36 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-2311f678-0678-4bb2-8183-b029d7d8e4c4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Overwriting current allocation {'allocations': {'52209f7e-594e-4cf4-9018-18636056cd6b': {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}, 'generation': 31}}, 'project_id': '3ea2cb4dfa5b4a52b658efd8f5aefb36', 'user_id': '5873a358bf544691b12cd2979f5e36dc', 'consumer_generation': 1} on consumer b4abb549-8f36-40c5-971f-8accbb14ff86 {{(pid=71509) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Apr 14 10:53:36 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-2311f678-0678-4bb2-8183-b029d7d8e4c4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "refresh_cache-b4abb549-8f36-40c5-971f-8accbb14ff86" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:53:36 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-2311f678-0678-4bb2-8183-b029d7d8e4c4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquired lock "refresh_cache-b4abb549-8f36-40c5-971f-8accbb14ff86" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:53:36 user nova-compute[71509]: DEBUG nova.network.neutron [None req-2311f678-0678-4bb2-8183-b029d7d8e4c4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Building network info cache for instance {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 10:53:37 user nova-compute[71509]: DEBUG nova.network.neutron [None req-2311f678-0678-4bb2-8183-b029d7d8e4c4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Updating instance_info_cache with network_info: [{"id": "608a2408-02df-474f-9006-260c8c97def1", "address": "fa:16:3e:e4:f7:87", "network": {"id": "18a91434-637b-4c19-a97b-736b32c1ea5a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1824162811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea2cb4dfa5b4a52b658efd8f5aefb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap608a2408-02", "ovs_interfaceid": "608a2408-02df-474f-9006-260c8c97def1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:53:37 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-2311f678-0678-4bb2-8183-b029d7d8e4c4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Releasing lock "refresh_cache-b4abb549-8f36-40c5-971f-8accbb14ff86" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:53:37 user nova-compute[71509]: DEBUG os_brick.utils [None req-2311f678-0678-4bb2-8183-b029d7d8e4c4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 10:53:37 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:53:37 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:53:37 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c58d898-d89a-404b-b255-85f259aa6e06]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50119df3c417\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:53:37 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:53:37 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:53:37 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[775374be-ffe0-48e9-90dd-d1f19482e484]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:53:37 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:53:37 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:53:37 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[503fa141-9037-428a-bf5c-6f9b938e3211]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:53:37 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[238771c1-90bd-48a6-9b6f-2b455e7dad4f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:53:37 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-2311f678-0678-4bb2-8183-b029d7d8e4c4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Running cmd (subprocess): nvme version {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:53:38 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-2311f678-0678-4bb2-8183-b029d7d8e4c4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] 'nvme version' failed. Not Retrying. {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 10:53:38 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:53:38 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2311f678-0678-4bb2-8183-b029d7d8e4c4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] nvme not present on system {{(pid=71509) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 10:53:38 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:53:38 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 10:53:38 user nova-compute[71509]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 10:53:38 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[f47d1259-d99c-403e-b13e-632bc4a12ae1]: (4, '') {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:53:38 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-2311f678-0678-4bb2-8183-b029d7d8e4c4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71509) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 10:53:38 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-2311f678-0678-4bb2-8183-b029d7d8e4c4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71509) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 10:53:38 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-2311f678-0678-4bb2-8183-b029d7d8e4c4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] LIGHTOS: no hostnqn found. {{(pid=71509) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 10:53:38 user nova-compute[71509]: DEBUG os_brick.utils [None req-2311f678-0678-4bb2-8183-b029d7d8e4c4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] <== get_connector_properties: return (154ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50119df3c417', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 10:53:38 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:53:38 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:53:40 user nova-compute[71509]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681469605.5877087, 3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d => Stopped> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 10:53:40 user nova-compute[71509]: INFO nova.compute.manager [-] [instance: 3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d] VM Stopped (Lifecycle Event)
Apr 14 10:53:40 user nova-compute[71509]: DEBUG nova.compute.manager [None req-53ff71e8-d9f3-46c5-94ad-a0f99d6462c1 None None] [instance: 3ccda5ad-a9b7-4dd4-9024-0aee5d6a6f6d] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:53:41 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:53:41 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:53:42 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:53:42 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-2311f678-0678-4bb2-8183-b029d7d8e4c4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Starting finish_revert_migration {{(pid=71509) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11792}}
Apr 14 10:53:42 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-2311f678-0678-4bb2-8183-b029d7d8e4c4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Start _get_guest_xml network_info=[{"id": "608a2408-02df-474f-9006-260c8c97def1", "address": "fa:16:3e:e4:f7:87", "network": {"id": "18a91434-637b-4c19-a97b-736b32c1ea5a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1824162811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea2cb4dfa5b4a52b658efd8f5aefb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap608a2408-02", "ovs_interfaceid": "608a2408-02df-474f-9006-260c8c97def1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=048ec0ee-0465-448d-8b4c-f072acb101dc,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '048ec0ee-0465-448d-8b4c-f072acb101dc'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vdb', 'boot_index': None, 'device_type': 'disk', 'attachment_id': 'c3dd5a63-55b2-4476-9250-fded9f4dfed5', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KDNjCusQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'b4abb549-8f36-40c5-971f-8accbb14ff86', 'attached_at': '2023-04-14T10:53:43.000000', 'detached_at': '', 'volume_id': '9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe', 'serial': '9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'volume_type': None} {{(pid=71509) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 10:53:42 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-2311f678-0678-4bb2-8183-b029d7d8e4c4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:53:42 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-2311f678-0678-4bb2-8183-b029d7d8e4c4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:53:42 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-2311f678-0678-4bb2-8183-b029d7d8e4c4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71509) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 10:53:42 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-2311f678-0678-4bb2-8183-b029d7d8e4c4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T10:40:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=048ec0ee-0465-448d-8b4c-f072acb101dc,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 10:53:42 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-2311f678-0678-4bb2-8183-b029d7d8e4c4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Flavor limits 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 10:53:42 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-2311f678-0678-4bb2-8183-b029d7d8e4c4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Image limits 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 10:53:42 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-2311f678-0678-4bb2-8183-b029d7d8e4c4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Flavor pref 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 10:53:42 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-2311f678-0678-4bb2-8183-b029d7d8e4c4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Image pref 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 10:53:42 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-2311f678-0678-4bb2-8183-b029d7d8e4c4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 10:53:42 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-2311f678-0678-4bb2-8183-b029d7d8e4c4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 10:53:42 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-2311f678-0678-4bb2-8183-b029d7d8e4c4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71509) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 10:53:42 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-2311f678-0678-4bb2-8183-b029d7d8e4c4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Got 1 possible topologies {{(pid=71509) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 10:53:42 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-2311f678-0678-4bb2-8183-b029d7d8e4c4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 10:53:42 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-2311f678-0678-4bb2-8183-b029d7d8e4c4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 10:53:42 user nova-compute[71509]: DEBUG nova.objects.instance [None req-2311f678-0678-4bb2-8183-b029d7d8e4c4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lazy-loading 'vcpu_model' on Instance uuid b4abb549-8f36-40c5-971f-8accbb14ff86 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:53:42 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2311f678-0678-4bb2-8183-b029d7d8e4c4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Calling os-brick to attach iSCSI Volume {{(pid=71509) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 10:53:42 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-2311f678-0678-4bb2-8183-b029d7d8e4c4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0bf0749390>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KDNjCusQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 10:53:42 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-2311f678-0678-4bb2-8183-b029d7d8e4c4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 10:53:42 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-2311f678-0678-4bb2-8183-b029d7d8e4c4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 10:53:42 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-2311f678-0678-4bb2-8183-b029d7d8e4c4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 10:53:42 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-2311f678-0678-4bb2-8183-b029d7d8e4c4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 10:53:42 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-2311f678-0678-4bb2-8183-b029d7d8e4c4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 10:53:42 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-2311f678-0678-4bb2-8183-b029d7d8e4c4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 10:53:42 user nova-compute[71509]: INFO os_brick.initiator.connectors.iscsi [None req-2311f678-0678-4bb2-8183-b029d7d8e4c4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 10:53:42 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe -p 172.16.0.220:3260 {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:53:42 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:53:42 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcee5c70-2dbc-4c12-9540-39d412136268]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:53:42 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-2311f678-0678-4bb2-8183-b029d7d8e4c4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 10:53:42 user nova-compute[71509]:  {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:53:42 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe -p 172.16.0.220:3260 --interface default --op new {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:53:42 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:53:42 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb451751-fb19-4af1-a4a6-c7ce487c49a3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe] added\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:53:42 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-2311f678-0678-4bb2-8183-b029d7d8e4c4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe] added
Apr 14 10:53:42 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:53:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:53:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:53:43 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab93d194-6b0e-471f-9ca5-8847de1e3b51]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:53:43 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-2311f678-0678-4bb2-8183-b029d7d8e4c4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:53:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:53:43 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:53:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:53:43 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e38af7d-dd1c-4d1b-a89f-5e97c3d5f0a6]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:53:43 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-2311f678-0678-4bb2-8183-b029d7d8e4c4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:53:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KDNjCusQ {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:53:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KDNjCusQ" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:53:43 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[e36d77b6-e5ce-4bb5-a262-5f5c16ce836e]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:53:43 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-2311f678-0678-4bb2-8183-b029d7d8e4c4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KDNjCusQ'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:53:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:53:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:53:43 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[743922c3-e0e3-4a50-ab14-41130705c549]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:53:43 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-2311f678-0678-4bb2-8183-b029d7d8e4c4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:53:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:53:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:53:43 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[2489c1c9-ca26-47f1-b243-4787c8d074c9]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08f71190-2402-402d-af67-edf9226e4fb8 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52b9d6a-ee3e-42b8-973e-d47c4ed33196 (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:53:43 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-2311f678-0678-4bb2-8183-b029d7d8e4c4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)
Apr 14 10:53:43 user nova-compute[71509]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08f71190-2402-402d-af67-edf9226e4fb8 (non-flash)
Apr 14 10:53:43 user nova-compute[71509]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52b9d6a-ee3e-42b8-973e-d47c4ed33196 (non-flash)
Apr 14 10:53:43 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:53:43 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-2311f678-0678-4bb2-8183-b029d7d8e4c4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)
Apr 14 10:53:43 user nova-compute[71509]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08f71190-2402-402d-af67-edf9226e4fb8 (non-flash)
Apr 14 10:53:43 user nova-compute[71509]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52b9d6a-ee3e-42b8-973e-d47c4ed33196 (non-flash)
Apr 14 10:53:43 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 10:53:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe -p 172.16.0.220:3260 --login {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:53:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:53:43 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[db4992b1-594f-4c02-b22f-2a0ca81b3a6e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:53:43 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-2311f678-0678-4bb2-8183-b029d7d8e4c4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe, portal: 172.16.0.220,3260]
Apr 14 10:53:43 user nova-compute[71509]: Login to [iface: default, target: iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe, portal: 172.16.0.220,3260] successful.
Apr 14 10:53:43 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:53:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:53:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:53:43 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5e66875-88d4-480a-9411-0bf3d07132ce]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:53:43 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-2311f678-0678-4bb2-8183-b029d7d8e4c4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:53:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:53:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:53:43 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[0511d823-228d-4663-82a9-1010a930b2fd]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08f71190-2402-402d-af67-edf9226e4fb8 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52b9d6a-ee3e-42b8-973e-d47c4ed33196 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:53:43 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-2311f678-0678-4bb2-8183-b029d7d8e4c4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)
Apr 14 10:53:43 user nova-compute[71509]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08f71190-2402-402d-af67-edf9226e4fb8 (non-flash)
Apr 14 10:53:43 user nova-compute[71509]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52b9d6a-ee3e-42b8-973e-d47c4ed33196 (non-flash)
Apr 14 10:53:43 user nova-compute[71509]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe (non-flash)
Apr 14 10:53:43 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:53:43 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-2311f678-0678-4bb2-8183-b029d7d8e4c4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)
Apr 14 10:53:43 user nova-compute[71509]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08f71190-2402-402d-af67-edf9226e4fb8 (non-flash)
Apr 14 10:53:43 user nova-compute[71509]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52b9d6a-ee3e-42b8-973e-d47c4ed33196 (non-flash)
Apr 14 10:53:43 user nova-compute[71509]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe (non-flash)
Apr 14 10:53:43 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 10:53:43 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-2311f678-0678-4bb2-8183-b029d7d8e4c4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 10:53:43 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-2311f678-0678-4bb2-8183-b029d7d8e4c4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Connected to 172.16.0.220:3260 {{(pid=71509) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 10:53:43 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-2311f678-0678-4bb2-8183-b029d7d8e4c4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] HCTL ('33', '-', '-', 0) found on session 35 with lun 0 {{(pid=71509) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 10:53:43 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-2311f678-0678-4bb2-8183-b029d7d8e4c4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71509) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 10:53:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:53:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:53:43 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[82300049-4472-4fc5-9b44-b9ef68331ba6]: (4, ('- - 0', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:53:43 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-2311f678-0678-4bb2-8183-b029d7d8e4c4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Searching for a device in session 35 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71509) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 10:53:43 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-2311f678-0678-4bb2-8183-b029d7d8e4c4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KDNjCusQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71509) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 10:53:43 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:53:43 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Starting heal instance info cache {{(pid=71509) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 10:53:43 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "refresh_cache-f3245b74-dbe8-4b8b-83b6-58a4811fdba9" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:53:43 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquired lock "refresh_cache-f3245b74-dbe8-4b8b-83b6-58a4811fdba9" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:53:43 user nova-compute[71509]: DEBUG nova.network.neutron [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] [instance: f3245b74-dbe8-4b8b-83b6-58a4811fdba9] Forcefully refreshing network info cache for instance {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 10:53:43 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:53:43 user nova-compute[71509]: DEBUG nova.network.neutron [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] [instance: f3245b74-dbe8-4b8b-83b6-58a4811fdba9] Updating instance_info_cache with network_info: [{"id": "9abeb28a-35f1-4e16-a152-ed2578e8a678", "address": "fa:16:3e:54:9b:f3", "network": {"id": "36ccc911-348d-426a-ba7b-a49a0bfb0f97", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-256080753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aca26975e5ad4524b4b1b1ec4335802f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9abeb28a-35", "ovs_interfaceid": "9abeb28a-35f1-4e16-a152-ed2578e8a678", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:53:43 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Releasing lock "refresh_cache-f3245b74-dbe8-4b8b-83b6-58a4811fdba9" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:53:43 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] [instance: f3245b74-dbe8-4b8b-83b6-58a4811fdba9] Updated the network info_cache for instance {{(pid=71509) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 10:53:43 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:53:44 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-2311f678-0678-4bb2-8183-b029d7d8e4c4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.310s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 10:53:44 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-2311f678-0678-4bb2-8183-b029d7d8e4c4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] <== connect_volume: return (1312ms) {'type': 'block', 'scsi_wwn': '23530323537323431', 'path': '/dev/sdb'} {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 10:53:44 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2311f678-0678-4bb2-8183-b029d7d8e4c4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23530323537323431', 'path': '/dev/sdb'} {{(pid=71509) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 10:53:44 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-2311f678-0678-4bb2-8183-b029d7d8e4c4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T10:42:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-375061147',display_name='tempest-ServerActionsTestJSON-server-564468196',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-375061147',id=4,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNt/FyD1XXsxB5kJC+SJ1dgkjoXXHkL+KX0Cr5HvI72xTIz+DAtuVRPHeIpMNLt39mbbZ9KAoCJibRQza0Qbd8j8EEoV7QHombhWz2Mdusr+gJ2OYTqrrRzVbjIHACTFWw==',key_name='tempest-keypair-1544270235',keypairs=<?>,launch_index=0,launched_at=2023-04-14T10:51:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3ea2cb4dfa5b4a52b658efd8f5aefb36',ramdisk_id='',reservation_id='r-2qmryidz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-1923052090',owner_user_name='tempest-ServerActionsTestJSON-1923052090-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T10:53:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5873a358bf544691b12cd2979f5e36dc',uuid=b4abb549-8f36-40c5-971f-8accbb14ff86,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "608a2408-02df-474f-9006-260c8c97def1", "address": "fa:16:3e:e4:f7:87", "network": {"id": "18a91434-637b-4c19-a97b-736b32c1ea5a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1824162811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea2cb4dfa5b4a52b658efd8f5aefb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap608a2408-02", "ovs_interfaceid": "608a2408-02df-474f-9006-260c8c97def1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71509) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 10:53:44 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-2311f678-0678-4bb2-8183-b029d7d8e4c4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Converting VIF {"id": "608a2408-02df-474f-9006-260c8c97def1", "address": "fa:16:3e:e4:f7:87", "network": {"id": "18a91434-637b-4c19-a97b-736b32c1ea5a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1824162811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea2cb4dfa5b4a52b658efd8f5aefb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap608a2408-02", "ovs_interfaceid": "608a2408-02df-474f-9006-260c8c97def1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:53:44 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-2311f678-0678-4bb2-8183-b029d7d8e4c4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:f7:87,bridge_name='br-int',has_traffic_filtering=True,id=608a2408-02df-474f-9006-260c8c97def1,network=Network(18a91434-637b-4c19-a97b-736b32c1ea5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap608a2408-02') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:53:44 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-2311f678-0678-4bb2-8183-b029d7d8e4c4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] End _get_guest_xml xml=<domain type="kvm">
Apr 14 10:53:44 user nova-compute[71509]:   <uuid>b4abb549-8f36-40c5-971f-8accbb14ff86</uuid>
Apr 14 10:53:44 user nova-compute[71509]:   <name>instance-00000004</name>
Apr 14 10:53:44 user nova-compute[71509]:   <memory>131072</memory>
Apr 14 10:53:44 user nova-compute[71509]:   <vcpu>1</vcpu>
Apr 14 10:53:44 user nova-compute[71509]:   <metadata>
Apr 14 10:53:44 user nova-compute[71509]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 10:53:44 user nova-compute[71509]:       <nova:package version="0.0.0"/>
Apr 14 10:53:44 user nova-compute[71509]:       <nova:name>tempest-ServerActionsTestJSON-server-564468196</nova:name>
Apr 14 10:53:44 user nova-compute[71509]:       <nova:creationTime>2023-04-14 10:53:42</nova:creationTime>
Apr 14 10:53:44 user nova-compute[71509]:       <nova:flavor name="m1.nano">
Apr 14 10:53:44 user nova-compute[71509]:         <nova:memory>128</nova:memory>
Apr 14 10:53:44 user nova-compute[71509]:         <nova:disk>1</nova:disk>
Apr 14 10:53:44 user nova-compute[71509]:         <nova:swap>0</nova:swap>
Apr 14 10:53:44 user nova-compute[71509]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 10:53:44 user nova-compute[71509]:         <nova:vcpus>1</nova:vcpus>
Apr 14 10:53:44 user nova-compute[71509]:       </nova:flavor>
Apr 14 10:53:44 user nova-compute[71509]:       <nova:owner>
Apr 14 10:53:44 user nova-compute[71509]:         <nova:user uuid="5873a358bf544691b12cd2979f5e36dc">tempest-ServerActionsTestJSON-1923052090-project-member</nova:user>
Apr 14 10:53:44 user nova-compute[71509]:         <nova:project uuid="3ea2cb4dfa5b4a52b658efd8f5aefb36">tempest-ServerActionsTestJSON-1923052090</nova:project>
Apr 14 10:53:44 user nova-compute[71509]:       </nova:owner>
Apr 14 10:53:44 user nova-compute[71509]:       <nova:root type="image" uuid="048ec0ee-0465-448d-8b4c-f072acb101dc"/>
Apr 14 10:53:44 user nova-compute[71509]:       <nova:ports>
Apr 14 10:53:44 user nova-compute[71509]:         <nova:port uuid="608a2408-02df-474f-9006-260c8c97def1">
Apr 14 10:53:44 user nova-compute[71509]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 14 10:53:44 user nova-compute[71509]:         </nova:port>
Apr 14 10:53:44 user nova-compute[71509]:       </nova:ports>
Apr 14 10:53:44 user nova-compute[71509]:     </nova:instance>
Apr 14 10:53:44 user nova-compute[71509]:   </metadata>
Apr 14 10:53:44 user nova-compute[71509]:   <sysinfo type="smbios">
Apr 14 10:53:44 user nova-compute[71509]:     <system>
Apr 14 10:53:44 user nova-compute[71509]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 10:53:44 user nova-compute[71509]:       <entry name="product">OpenStack Nova</entry>
Apr 14 10:53:44 user nova-compute[71509]:       <entry name="version">0.0.0</entry>
Apr 14 10:53:44 user nova-compute[71509]:       <entry name="serial">b4abb549-8f36-40c5-971f-8accbb14ff86</entry>
Apr 14 10:53:44 user nova-compute[71509]:       <entry name="uuid">b4abb549-8f36-40c5-971f-8accbb14ff86</entry>
Apr 14 10:53:44 user nova-compute[71509]:       <entry name="family">Virtual Machine</entry>
Apr 14 10:53:44 user nova-compute[71509]:     </system>
Apr 14 10:53:44 user nova-compute[71509]:   </sysinfo>
Apr 14 10:53:44 user nova-compute[71509]:   <os>
Apr 14 10:53:44 user nova-compute[71509]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 10:53:44 user nova-compute[71509]:     <boot dev="hd"/>
Apr 14 10:53:44 user nova-compute[71509]:     <smbios mode="sysinfo"/>
Apr 14 10:53:44 user nova-compute[71509]:   </os>
Apr 14 10:53:44 user nova-compute[71509]:   <features>
Apr 14 10:53:44 user nova-compute[71509]:     <acpi/>
Apr 14 10:53:44 user nova-compute[71509]:     <apic/>
Apr 14 10:53:44 user nova-compute[71509]:     <vmcoreinfo/>
Apr 14 10:53:44 user nova-compute[71509]:   </features>
Apr 14 10:53:44 user nova-compute[71509]:   <clock offset="utc">
Apr 14 10:53:44 user nova-compute[71509]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 10:53:44 user nova-compute[71509]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 10:53:44 user nova-compute[71509]:     <timer name="hpet" present="no"/>
Apr 14 10:53:44 user nova-compute[71509]:   </clock>
Apr 14 10:53:44 user nova-compute[71509]:   <cpu mode="custom" match="exact">
Apr 14 10:53:44 user nova-compute[71509]:     <model>Nehalem</model>
Apr 14 10:53:44 user nova-compute[71509]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 10:53:44 user nova-compute[71509]:   </cpu>
Apr 14 10:53:44 user nova-compute[71509]:   <devices>
Apr 14 10:53:44 user nova-compute[71509]:     <disk type="file" device="disk">
Apr 14 10:53:44 user nova-compute[71509]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 10:53:44 user nova-compute[71509]:       <source file="/opt/stack/data/nova/instances/b4abb549-8f36-40c5-971f-8accbb14ff86/disk"/>
Apr 14 10:53:44 user nova-compute[71509]:       <target dev="vda" bus="virtio"/>
Apr 14 10:53:44 user nova-compute[71509]:     </disk>
Apr 14 10:53:44 user nova-compute[71509]:     <disk type="block" device="disk">
Apr 14 10:53:44 user nova-compute[71509]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 10:53:44 user nova-compute[71509]:       <source dev="/dev/sdb"/>
Apr 14 10:53:44 user nova-compute[71509]:       <target dev="vdb" bus="virtio"/>
Apr 14 10:53:44 user nova-compute[71509]:       <serial>9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe</serial>
Apr 14 10:53:44 user nova-compute[71509]:     </disk>
Apr 14 10:53:44 user nova-compute[71509]:     <interface type="ethernet">
Apr 14 10:53:44 user nova-compute[71509]:       <mac address="fa:16:3e:e4:f7:87"/>
Apr 14 10:53:44 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 10:53:44 user nova-compute[71509]:       <mtu size="1442"/>
Apr 14 10:53:44 user nova-compute[71509]:       <target dev="tap608a2408-02"/>
Apr 14 10:53:44 user nova-compute[71509]:     </interface>
Apr 14 10:53:44 user nova-compute[71509]:     <serial type="pty">
Apr 14 10:53:44 user nova-compute[71509]:       <log file="/opt/stack/data/nova/instances/b4abb549-8f36-40c5-971f-8accbb14ff86/console.log" append="off"/>
Apr 14 10:53:44 user nova-compute[71509]:     </serial>
Apr 14 10:53:44 user nova-compute[71509]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 10:53:44 user nova-compute[71509]:     <video>
Apr 14 10:53:44 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 10:53:44 user nova-compute[71509]:     </video>
Apr 14 10:53:44 user nova-compute[71509]:     <rng model="virtio">
Apr 14 10:53:44 user nova-compute[71509]:       <backend model="random">/dev/urandom</backend>
Apr 14 10:53:44 user nova-compute[71509]:     </rng>
Apr 14 10:53:44 user nova-compute[71509]:     <controller type="usb" index="0" model="none"/>
Apr 14 10:53:44 user nova-compute[71509]:     <memballoon model="virtio">
Apr 14 10:53:44 user nova-compute[71509]:       <stats period="10"/>
Apr 14 10:53:44 user nova-compute[71509]:     </memballoon>
Apr 14 10:53:44 user nova-compute[71509]:   </devices>
Apr 14 10:53:44 user nova-compute[71509]: </domain>
Apr 14 10:53:44 user nova-compute[71509]:  {{(pid=71509) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 10:53:44 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-2311f678-0678-4bb2-8183-b029d7d8e4c4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T10:42:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-375061147',display_name='tempest-ServerActionsTestJSON-server-564468196',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-375061147',id=4,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNt/FyD1XXsxB5kJC+SJ1dgkjoXXHkL+KX0Cr5HvI72xTIz+DAtuVRPHeIpMNLt39mbbZ9KAoCJibRQza0Qbd8j8EEoV7QHombhWz2Mdusr+gJ2OYTqrrRzVbjIHACTFWw==',key_name='tempest-keypair-1544270235',keypairs=<?>,launch_index=0,launched_at=2023-04-14T10:51:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3ea2cb4dfa5b4a52b658efd8f5aefb36',ramdisk_id='',reservation_id='r-2qmryidz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-1923052090',owner_user_name='tempest-ServerActionsTestJSON-1923052090-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T10:53:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5873a358bf544691b12cd2979f5e36dc',uuid=b4abb549-8f36-40c5-971f-8accbb14ff86,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "608a2408-02df-474f-9006-260c8c97def1", "address": "fa:16:3e:e4:f7:87", "network": {"id": "18a91434-637b-4c19-a97b-736b32c1ea5a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1824162811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea2cb4dfa5b4a52b658efd8f5aefb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap608a2408-02", "ovs_interfaceid": "608a2408-02df-474f-9006-260c8c97def1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 10:53:44 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-2311f678-0678-4bb2-8183-b029d7d8e4c4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Converting VIF {"id": "608a2408-02df-474f-9006-260c8c97def1", "address": "fa:16:3e:e4:f7:87", "network": {"id": "18a91434-637b-4c19-a97b-736b32c1ea5a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1824162811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea2cb4dfa5b4a52b658efd8f5aefb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap608a2408-02", "ovs_interfaceid": "608a2408-02df-474f-9006-260c8c97def1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:53:44 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-2311f678-0678-4bb2-8183-b029d7d8e4c4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:f7:87,bridge_name='br-int',has_traffic_filtering=True,id=608a2408-02df-474f-9006-260c8c97def1,network=Network(18a91434-637b-4c19-a97b-736b32c1ea5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap608a2408-02') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:53:44 user nova-compute[71509]: DEBUG os_vif [None req-2311f678-0678-4bb2-8183-b029d7d8e4c4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:f7:87,bridge_name='br-int',has_traffic_filtering=True,id=608a2408-02df-474f-9006-260c8c97def1,network=Network(18a91434-637b-4c19-a97b-736b32c1ea5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap608a2408-02') {{(pid=71509) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 10:53:44 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:53:44 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:53:44 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 10:53:44 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:53:44 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap608a2408-02, may_exist=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:53:44 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap608a2408-02, col_values=(('external_ids', {'iface-id': '608a2408-02df-474f-9006-260c8c97def1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e4:f7:87', 'vm-uuid': 'b4abb549-8f36-40c5-971f-8accbb14ff86'}),)) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:53:44 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:53:44 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 10:53:44 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:53:44 user nova-compute[71509]: INFO os_vif [None req-2311f678-0678-4bb2-8183-b029d7d8e4c4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:f7:87,bridge_name='br-int',has_traffic_filtering=True,id=608a2408-02df-474f-9006-260c8c97def1,network=Network(18a91434-637b-4c19-a97b-736b32c1ea5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap608a2408-02')
Apr 14 10:53:44 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:53:44 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:53:44 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:53:44 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:53:44 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Auditing locally available compute resources for user (node: user) {{(pid=71509) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 10:53:45 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:53:45 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:53:45 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:53:45 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:53:45 user nova-compute[71509]: DEBUG nova.compute.manager [req-84df0f8e-e8f9-475b-b25e-fe3657b6f6e5 req-ca20dfb8-9041-49f9-bafe-13e18ebf24f9 service nova] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Received event network-vif-plugged-608a2408-02df-474f-9006-260c8c97def1 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:53:45 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-84df0f8e-e8f9-475b-b25e-fe3657b6f6e5 req-ca20dfb8-9041-49f9-bafe-13e18ebf24f9 service nova] Acquiring lock "b4abb549-8f36-40c5-971f-8accbb14ff86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:53:45 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-84df0f8e-e8f9-475b-b25e-fe3657b6f6e5 req-ca20dfb8-9041-49f9-bafe-13e18ebf24f9 service nova] Lock "b4abb549-8f36-40c5-971f-8accbb14ff86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:53:45 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-84df0f8e-e8f9-475b-b25e-fe3657b6f6e5 req-ca20dfb8-9041-49f9-bafe-13e18ebf24f9 service nova] Lock "b4abb549-8f36-40c5-971f-8accbb14ff86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:53:45 user nova-compute[71509]: DEBUG nova.compute.manager [req-84df0f8e-e8f9-475b-b25e-fe3657b6f6e5 req-ca20dfb8-9041-49f9-bafe-13e18ebf24f9 service nova] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] No waiting events found dispatching network-vif-plugged-608a2408-02df-474f-9006-260c8c97def1 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:53:45 user nova-compute[71509]: WARNING nova.compute.manager [req-84df0f8e-e8f9-475b-b25e-fe3657b6f6e5 req-ca20dfb8-9041-49f9-bafe-13e18ebf24f9 service nova] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Received unexpected event network-vif-plugged-608a2408-02df-474f-9006-260c8c97def1 for instance with vm_state resized and task_state resize_reverting.
Apr 14 10:53:46 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97820f17-22d1-4ec3-9721-1edadccc794a/disk.rescue --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:53:46 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:53:46 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:53:46 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:53:46 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97820f17-22d1-4ec3-9721-1edadccc794a/disk.rescue --force-share --output=json" returned: 0 in 0.139s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:53:46 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97820f17-22d1-4ec3-9721-1edadccc794a/disk.rescue --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:53:46 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97820f17-22d1-4ec3-9721-1edadccc794a/disk.rescue --force-share --output=json" returned: 0 in 0.147s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:53:46 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97820f17-22d1-4ec3-9721-1edadccc794a/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:53:46 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97820f17-22d1-4ec3-9721-1edadccc794a/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:53:46 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97820f17-22d1-4ec3-9721-1edadccc794a/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:53:46 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97820f17-22d1-4ec3-9721-1edadccc794a/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:53:46 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3245b74-dbe8-4b8b-83b6-58a4811fdba9/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:53:46 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3245b74-dbe8-4b8b-83b6-58a4811fdba9/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:53:46 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3245b74-dbe8-4b8b-83b6-58a4811fdba9/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:53:47 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3245b74-dbe8-4b8b-83b6-58a4811fdba9/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:53:47 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4abb549-8f36-40c5-971f-8accbb14ff86/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:53:47 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4abb549-8f36-40c5-971f-8accbb14ff86/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:53:47 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4abb549-8f36-40c5-971f-8accbb14ff86/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:53:47 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4abb549-8f36-40c5-971f-8accbb14ff86/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:53:47 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71509) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 10:53:47 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8586a70e-9855-4177-ac1b-cf707a4df871/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:53:47 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8586a70e-9855-4177-ac1b-cf707a4df871/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:53:47 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8586a70e-9855-4177-ac1b-cf707a4df871/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:53:47 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8586a70e-9855-4177-ac1b-cf707a4df871/disk --force-share --output=json" returned: 0 in 0.126s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:53:47 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd661ae0-c4bb-4117-847d-ef7e85d062fb/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:53:47 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd661ae0-c4bb-4117-847d-ef7e85d062fb/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:53:47 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd661ae0-c4bb-4117-847d-ef7e85d062fb/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:53:47 user nova-compute[71509]: DEBUG nova.virt.libvirt.host [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Removed pending event for b4abb549-8f36-40c5-971f-8accbb14ff86 due to event {{(pid=71509) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 10:53:47 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681469627.8255606, b4abb549-8f36-40c5-971f-8accbb14ff86 => Resumed> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 10:53:47 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] VM Resumed (Lifecycle Event)
Apr 14 10:53:47 user nova-compute[71509]: DEBUG nova.compute.manager [None req-2311f678-0678-4bb2-8183-b029d7d8e4c4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Instance event wait completed in 0 seconds for  {{(pid=71509) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 10:53:47 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Instance running successfully.
Apr 14 10:53:47 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-2311f678-0678-4bb2-8183-b029d7d8e4c4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] finish_revert_migration finished successfully. {{(pid=71509) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11836}}
Apr 14 10:53:47 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:53:47 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 10:53:47 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Apr 14 10:53:47 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681469627.8371685, b4abb549-8f36-40c5-971f-8accbb14ff86 => Started> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 10:53:47 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] VM Started (Lifecycle Event)
Apr 14 10:53:47 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd661ae0-c4bb-4117-847d-ef7e85d062fb/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:53:47 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=71509) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 10:53:47 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:53:47 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3393be13-7d81-48da-b6dd-a427e8403b22/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:53:47 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 10:53:47 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Apr 14 10:53:47 user nova-compute[71509]: DEBUG nova.compute.manager [req-74de430f-35d6-4a41-881e-3bd4cf5794af req-858e1d66-c4cd-4539-84cd-5b7f40b5bfda service nova] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Received event network-vif-plugged-608a2408-02df-474f-9006-260c8c97def1 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:53:47 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-74de430f-35d6-4a41-881e-3bd4cf5794af req-858e1d66-c4cd-4539-84cd-5b7f40b5bfda service nova] Acquiring lock "b4abb549-8f36-40c5-971f-8accbb14ff86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:53:47 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-74de430f-35d6-4a41-881e-3bd4cf5794af req-858e1d66-c4cd-4539-84cd-5b7f40b5bfda service nova] Lock "b4abb549-8f36-40c5-971f-8accbb14ff86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:53:47 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-74de430f-35d6-4a41-881e-3bd4cf5794af req-858e1d66-c4cd-4539-84cd-5b7f40b5bfda service nova] Lock "b4abb549-8f36-40c5-971f-8accbb14ff86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:53:47 user nova-compute[71509]: DEBUG nova.compute.manager [req-74de430f-35d6-4a41-881e-3bd4cf5794af req-858e1d66-c4cd-4539-84cd-5b7f40b5bfda service nova] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] No waiting events found dispatching network-vif-plugged-608a2408-02df-474f-9006-260c8c97def1 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:53:47 user nova-compute[71509]: WARNING nova.compute.manager [req-74de430f-35d6-4a41-881e-3bd4cf5794af req-858e1d66-c4cd-4539-84cd-5b7f40b5bfda service nova] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Received unexpected event network-vif-plugged-608a2408-02df-474f-9006-260c8c97def1 for instance with vm_state resized and task_state resize_reverting.
Apr 14 10:53:48 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:53:48 user nova-compute[71509]: INFO nova.compute.manager [None req-2311f678-0678-4bb2-8183-b029d7d8e4c4 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Updating instance to original state: 'active'
Apr 14 10:53:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3393be13-7d81-48da-b6dd-a427e8403b22/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:53:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3393be13-7d81-48da-b6dd-a427e8403b22/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:53:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3393be13-7d81-48da-b6dd-a427e8403b22/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:53:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e479154a-acd6-47aa-9a5b-43c6e0feda07/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:53:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e479154a-acd6-47aa-9a5b-43c6e0feda07/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:53:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e479154a-acd6-47aa-9a5b-43c6e0feda07/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:53:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e479154a-acd6-47aa-9a5b-43c6e0feda07/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:53:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5/disk.rescue --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:53:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5/disk.rescue --force-share --output=json" returned: 0 in 0.142s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:53:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5/disk.rescue --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:53:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:53:48 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] skipping disk /opt/stack/data/nova/instances/d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5/disk (vdb) as it is a volume {{(pid=71509) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 10:53:48 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71509) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 10:53:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cae9f61-763f-4671-a873-d15f01384416/disk.rescue --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:53:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cae9f61-763f-4671-a873-d15f01384416/disk.rescue --force-share --output=json" returned: 0 in 0.142s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:53:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cae9f61-763f-4671-a873-d15f01384416/disk.rescue --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:53:49 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6cae9f61-763f-4671-a873-d15f01384416/disk.rescue --force-share --output=json" returned: 0 in 0.142s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:53:49 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97f20661-8b60-439e-b7af-2fc2013c5ade/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:53:49 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97f20661-8b60-439e-b7af-2fc2013c5ade/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:53:49 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97f20661-8b60-439e-b7af-2fc2013c5ade/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:53:49 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:53:49 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97f20661-8b60-439e-b7af-2fc2013c5ade/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:53:49 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe152ebd-4f99-4fa8-bfdb-8744cdf3f387/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:53:49 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe152ebd-4f99-4fa8-bfdb-8744cdf3f387/disk --force-share --output=json" returned: 0 in 0.322s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:53:49 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe152ebd-4f99-4fa8-bfdb-8744cdf3f387/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:53:49 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe152ebd-4f99-4fa8-bfdb-8744cdf3f387/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:53:50 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:53:50 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:53:50 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Hypervisor/Node resource view: name=user free_ram=7607MB free_disk=26.00466537475586GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71509) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 10:53:50 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:53:50 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:53:50 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 97f20661-8b60-439e-b7af-2fc2013c5ade actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:53:50 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 97820f17-22d1-4ec3-9721-1edadccc794a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:53:50 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance e479154a-acd6-47aa-9a5b-43c6e0feda07 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:53:50 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 8586a70e-9855-4177-ac1b-cf707a4df871 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:53:50 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance f3245b74-dbe8-4b8b-83b6-58a4811fdba9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:53:50 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 6cae9f61-763f-4671-a873-d15f01384416 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:53:50 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:53:50 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance cd661ae0-c4bb-4117-847d-ef7e85d062fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:53:50 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance b4abb549-8f36-40c5-971f-8accbb14ff86 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:53:50 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance fe152ebd-4f99-4fa8-bfdb-8744cdf3f387 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:53:50 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 3393be13-7d81-48da-b6dd-a427e8403b22 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:53:50 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=71509) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 10:53:50 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Final resource view: name=user phys_ram=16023MB used_ram=1920MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=71509) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 10:53:50 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Refreshing inventories for resource provider 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 14 10:53:50 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Updating ProviderTree inventory for provider 52209f7e-594e-4cf4-9018-18636056cd6b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 14 10:53:50 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Updating inventory in ProviderTree for provider 52209f7e-594e-4cf4-9018-18636056cd6b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 14 10:53:50 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Refreshing aggregate associations for resource provider 52209f7e-594e-4cf4-9018-18636056cd6b, aggregates: None {{(pid=71509) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 14 10:53:50 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Refreshing trait associations for resource provider 52209f7e-594e-4cf4-9018-18636056cd6b, traits: COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE42,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_SATA {{(pid=71509) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 14 10:53:51 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 10:53:51 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 10:53:51 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Compute_service record updated for user:user {{(pid=71509) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 10:53:51 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.769s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:53:51 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:53:51 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71509) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 14 10:53:53 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:53:54 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:53:56 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-87e00c0f-6899-43e7-9cdb-6477d7be0ee5 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Acquiring lock "f3245b74-dbe8-4b8b-83b6-58a4811fdba9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:53:56 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-87e00c0f-6899-43e7-9cdb-6477d7be0ee5 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Lock "f3245b74-dbe8-4b8b-83b6-58a4811fdba9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:53:56 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-87e00c0f-6899-43e7-9cdb-6477d7be0ee5 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Acquiring lock "f3245b74-dbe8-4b8b-83b6-58a4811fdba9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:53:56 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-87e00c0f-6899-43e7-9cdb-6477d7be0ee5 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Lock "f3245b74-dbe8-4b8b-83b6-58a4811fdba9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:53:56 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-87e00c0f-6899-43e7-9cdb-6477d7be0ee5 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Lock "f3245b74-dbe8-4b8b-83b6-58a4811fdba9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:53:56 user nova-compute[71509]: INFO nova.compute.manager [None req-87e00c0f-6899-43e7-9cdb-6477d7be0ee5 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] [instance: f3245b74-dbe8-4b8b-83b6-58a4811fdba9] Terminating instance
Apr 14 10:53:56 user nova-compute[71509]: DEBUG nova.compute.manager [None req-87e00c0f-6899-43e7-9cdb-6477d7be0ee5 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] [instance: f3245b74-dbe8-4b8b-83b6-58a4811fdba9] Start destroying the instance on the hypervisor. {{(pid=71509) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 10:53:56 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:53:56 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:53:56 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:53:56 user nova-compute[71509]: DEBUG nova.compute.manager [req-58540dc3-2bf3-45b0-96bf-3e5a16fec148 req-feb37da4-86b5-465d-9ffd-ca61f722c613 service nova] [instance: f3245b74-dbe8-4b8b-83b6-58a4811fdba9] Received event network-vif-unplugged-9abeb28a-35f1-4e16-a152-ed2578e8a678 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:53:56 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-58540dc3-2bf3-45b0-96bf-3e5a16fec148 req-feb37da4-86b5-465d-9ffd-ca61f722c613 service nova] Acquiring lock "f3245b74-dbe8-4b8b-83b6-58a4811fdba9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:53:56 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-58540dc3-2bf3-45b0-96bf-3e5a16fec148 req-feb37da4-86b5-465d-9ffd-ca61f722c613 service nova] Lock "f3245b74-dbe8-4b8b-83b6-58a4811fdba9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:53:56 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-58540dc3-2bf3-45b0-96bf-3e5a16fec148 req-feb37da4-86b5-465d-9ffd-ca61f722c613 service nova] Lock "f3245b74-dbe8-4b8b-83b6-58a4811fdba9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:53:56 user nova-compute[71509]: DEBUG nova.compute.manager [req-58540dc3-2bf3-45b0-96bf-3e5a16fec148 req-feb37da4-86b5-465d-9ffd-ca61f722c613 service nova] [instance: f3245b74-dbe8-4b8b-83b6-58a4811fdba9] No waiting events found dispatching network-vif-unplugged-9abeb28a-35f1-4e16-a152-ed2578e8a678 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:53:56 user nova-compute[71509]: DEBUG nova.compute.manager [req-58540dc3-2bf3-45b0-96bf-3e5a16fec148 req-feb37da4-86b5-465d-9ffd-ca61f722c613 service nova] [instance: f3245b74-dbe8-4b8b-83b6-58a4811fdba9] Received event network-vif-unplugged-9abeb28a-35f1-4e16-a152-ed2578e8a678 for instance with task_state deleting. {{(pid=71509) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 10:53:57 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: f3245b74-dbe8-4b8b-83b6-58a4811fdba9] Instance destroyed successfully.
Apr 14 10:53:57 user nova-compute[71509]: DEBUG nova.objects.instance [None req-87e00c0f-6899-43e7-9cdb-6477d7be0ee5 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Lazy-loading 'resources' on Instance uuid f3245b74-dbe8-4b8b-83b6-58a4811fdba9 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:53:57 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-87e00c0f-6899-43e7-9cdb-6477d7be0ee5 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T10:48:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-186982469',display_name='tempest-VolumesAdminNegativeTest-server-186982469',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-186982469',id=18,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC4n7cCmjQrFnx0jG2LyeLXh4VwIGx2PxO0+r8zAKj/Oj2f/50NTGIkyw35hqehB4Xb7vkg33UPXB0dq8gJQe8S7XSS6kQN94P7QD6GPEDoWU9GDCzvMWJoK2JE5ox6/6w==',key_name='tempest-keypair-685259735',keypairs=<?>,launch_index=0,launched_at=2023-04-14T10:48:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='aca26975e5ad4524b4b1b1ec4335802f',ramdisk_id='',reservation_id='r-b60q9ed9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-5408590',owner_user_name='tempest-VolumesAdminNegativeTest-5408590-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T10:48:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6adefa90332c42c79a1372258a7be5ab',uuid=f3245b74-dbe8-4b8b-83b6-58a4811fdba9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9abeb28a-35f1-4e16-a152-ed2578e8a678", "address": "fa:16:3e:54:9b:f3", "network": {"id": "36ccc911-348d-426a-ba7b-a49a0bfb0f97", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-256080753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aca26975e5ad4524b4b1b1ec4335802f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9abeb28a-35", "ovs_interfaceid": "9abeb28a-35f1-4e16-a152-ed2578e8a678", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 10:53:57 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-87e00c0f-6899-43e7-9cdb-6477d7be0ee5 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Converting VIF {"id": "9abeb28a-35f1-4e16-a152-ed2578e8a678", "address": "fa:16:3e:54:9b:f3", "network": {"id": "36ccc911-348d-426a-ba7b-a49a0bfb0f97", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-256080753-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aca26975e5ad4524b4b1b1ec4335802f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9abeb28a-35", "ovs_interfaceid": "9abeb28a-35f1-4e16-a152-ed2578e8a678", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:53:57 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-87e00c0f-6899-43e7-9cdb-6477d7be0ee5 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:54:9b:f3,bridge_name='br-int',has_traffic_filtering=True,id=9abeb28a-35f1-4e16-a152-ed2578e8a678,network=Network(36ccc911-348d-426a-ba7b-a49a0bfb0f97),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9abeb28a-35') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:53:57 user nova-compute[71509]: DEBUG os_vif [None req-87e00c0f-6899-43e7-9cdb-6477d7be0ee5 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:9b:f3,bridge_name='br-int',has_traffic_filtering=True,id=9abeb28a-35f1-4e16-a152-ed2578e8a678,network=Network(36ccc911-348d-426a-ba7b-a49a0bfb0f97),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9abeb28a-35') {{(pid=71509) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 10:53:57 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:53:57 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9abeb28a-35, bridge=br-int, if_exists=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:53:57 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:53:57 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 10:53:57 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:53:57 user nova-compute[71509]: INFO os_vif [None req-87e00c0f-6899-43e7-9cdb-6477d7be0ee5 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:9b:f3,bridge_name='br-int',has_traffic_filtering=True,id=9abeb28a-35f1-4e16-a152-ed2578e8a678,network=Network(36ccc911-348d-426a-ba7b-a49a0bfb0f97),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9abeb28a-35')
Apr 14 10:53:57 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-87e00c0f-6899-43e7-9cdb-6477d7be0ee5 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] [instance: f3245b74-dbe8-4b8b-83b6-58a4811fdba9] Deleting instance files /opt/stack/data/nova/instances/f3245b74-dbe8-4b8b-83b6-58a4811fdba9_del
Apr 14 10:53:57 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-87e00c0f-6899-43e7-9cdb-6477d7be0ee5 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] [instance: f3245b74-dbe8-4b8b-83b6-58a4811fdba9] Deletion of /opt/stack/data/nova/instances/f3245b74-dbe8-4b8b-83b6-58a4811fdba9_del complete
Apr 14 10:53:57 user nova-compute[71509]: INFO nova.compute.manager [None req-87e00c0f-6899-43e7-9cdb-6477d7be0ee5 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] [instance: f3245b74-dbe8-4b8b-83b6-58a4811fdba9] Took 0.90 seconds to destroy the instance on the hypervisor.
Apr 14 10:53:57 user nova-compute[71509]: DEBUG oslo.service.loopingcall [None req-87e00c0f-6899-43e7-9cdb-6477d7be0ee5 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71509) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 10:53:57 user nova-compute[71509]: DEBUG nova.compute.manager [-] [instance: f3245b74-dbe8-4b8b-83b6-58a4811fdba9] Deallocating network for instance {{(pid=71509) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 10:53:57 user nova-compute[71509]: DEBUG nova.network.neutron [-] [instance: f3245b74-dbe8-4b8b-83b6-58a4811fdba9] deallocate_for_instance() {{(pid=71509) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 10:53:58 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:53:58 user nova-compute[71509]: DEBUG nova.network.neutron [-] [instance: f3245b74-dbe8-4b8b-83b6-58a4811fdba9] Updating instance_info_cache with network_info: [] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:53:58 user nova-compute[71509]: INFO nova.compute.manager [-] [instance: f3245b74-dbe8-4b8b-83b6-58a4811fdba9] Took 0.99 seconds to deallocate network for instance.
Apr 14 10:53:58 user nova-compute[71509]: DEBUG nova.compute.manager [req-ec83556b-01c7-43c5-8db8-baaf9f9e2f38 req-1854d711-1e7f-430b-b57f-7e3bae9ac71b service nova] [instance: f3245b74-dbe8-4b8b-83b6-58a4811fdba9] Received event network-vif-deleted-9abeb28a-35f1-4e16-a152-ed2578e8a678 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:53:58 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-87e00c0f-6899-43e7-9cdb-6477d7be0ee5 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:53:58 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-87e00c0f-6899-43e7-9cdb-6477d7be0ee5 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:53:58 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-87e00c0f-6899-43e7-9cdb-6477d7be0ee5 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 10:53:58 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-87e00c0f-6899-43e7-9cdb-6477d7be0ee5 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 10:53:58 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-87e00c0f-6899-43e7-9cdb-6477d7be0ee5 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.313s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:53:58 user nova-compute[71509]: INFO nova.scheduler.client.report [None req-87e00c0f-6899-43e7-9cdb-6477d7be0ee5 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Deleted allocations for instance f3245b74-dbe8-4b8b-83b6-58a4811fdba9
Apr 14 10:53:58 user nova-compute[71509]: DEBUG nova.compute.manager [req-c0756a38-bd0c-4ab1-bbc4-40a4d3513b76 req-bfc14849-9432-4ea0-8021-7b8363cd1b00 service nova] [instance: f3245b74-dbe8-4b8b-83b6-58a4811fdba9] Received event network-vif-plugged-9abeb28a-35f1-4e16-a152-ed2578e8a678 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:53:58 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-c0756a38-bd0c-4ab1-bbc4-40a4d3513b76 req-bfc14849-9432-4ea0-8021-7b8363cd1b00 service nova] Acquiring lock "f3245b74-dbe8-4b8b-83b6-58a4811fdba9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:53:58 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-c0756a38-bd0c-4ab1-bbc4-40a4d3513b76 req-bfc14849-9432-4ea0-8021-7b8363cd1b00 service nova] Lock "f3245b74-dbe8-4b8b-83b6-58a4811fdba9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:53:58 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-c0756a38-bd0c-4ab1-bbc4-40a4d3513b76 req-bfc14849-9432-4ea0-8021-7b8363cd1b00 service nova] Lock "f3245b74-dbe8-4b8b-83b6-58a4811fdba9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:53:58 user nova-compute[71509]: DEBUG nova.compute.manager [req-c0756a38-bd0c-4ab1-bbc4-40a4d3513b76 req-bfc14849-9432-4ea0-8021-7b8363cd1b00 service nova] [instance: f3245b74-dbe8-4b8b-83b6-58a4811fdba9] No waiting events found dispatching network-vif-plugged-9abeb28a-35f1-4e16-a152-ed2578e8a678 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:53:58 user nova-compute[71509]: WARNING nova.compute.manager [req-c0756a38-bd0c-4ab1-bbc4-40a4d3513b76 req-bfc14849-9432-4ea0-8021-7b8363cd1b00 service nova] [instance: f3245b74-dbe8-4b8b-83b6-58a4811fdba9] Received unexpected event network-vif-plugged-9abeb28a-35f1-4e16-a152-ed2578e8a678 for instance with vm_state deleted and task_state None.
Apr 14 10:53:58 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-87e00c0f-6899-43e7-9cdb-6477d7be0ee5 tempest-VolumesAdminNegativeTest-5408590 tempest-VolumesAdminNegativeTest-5408590-project-member] Lock "f3245b74-dbe8-4b8b-83b6-58a4811fdba9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.401s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:53:59 user nova-compute[71509]: INFO nova.compute.manager [None req-8d47caf5-37ae-4255-8557-9c7af65d4155 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: 6cae9f61-763f-4671-a873-d15f01384416] Unrescuing
Apr 14 10:53:59 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-8d47caf5-37ae-4255-8557-9c7af65d4155 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Acquiring lock "refresh_cache-6cae9f61-763f-4671-a873-d15f01384416" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:53:59 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-8d47caf5-37ae-4255-8557-9c7af65d4155 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Acquired lock "refresh_cache-6cae9f61-763f-4671-a873-d15f01384416" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:53:59 user nova-compute[71509]: DEBUG nova.network.neutron [None req-8d47caf5-37ae-4255-8557-9c7af65d4155 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: 6cae9f61-763f-4671-a873-d15f01384416] Building network info cache for instance {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 10:54:00 user nova-compute[71509]: DEBUG nova.network.neutron [None req-8d47caf5-37ae-4255-8557-9c7af65d4155 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: 6cae9f61-763f-4671-a873-d15f01384416] Updating instance_info_cache with network_info: [{"id": "30d57100-3321-41fe-9335-d53c8c5e291c", "address": "fa:16:3e:57:7d:4b", "network": {"id": "07f1f39e-292a-4e73-b4ed-99e5799d6fa8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1339551596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71289f80a05141f482cb538dac3d7b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30d57100-33", "ovs_interfaceid": "30d57100-3321-41fe-9335-d53c8c5e291c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:54:00 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-8d47caf5-37ae-4255-8557-9c7af65d4155 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Releasing lock "refresh_cache-6cae9f61-763f-4671-a873-d15f01384416" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:54:00 user nova-compute[71509]: DEBUG nova.objects.instance [None req-8d47caf5-37ae-4255-8557-9c7af65d4155 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lazy-loading 'flavor' on Instance uuid 6cae9f61-763f-4671-a873-d15f01384416 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:54:00 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:54:00 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:54:00 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:54:00 user nova-compute[71509]: DEBUG nova.compute.manager [req-392e172d-cb5f-48b9-adf2-9c097767417c req-32b5a175-6ad2-4b7e-baa2-0d3338ac617f service nova] [instance: 6cae9f61-763f-4671-a873-d15f01384416] Received event network-vif-unplugged-30d57100-3321-41fe-9335-d53c8c5e291c {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:54:00 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-392e172d-cb5f-48b9-adf2-9c097767417c req-32b5a175-6ad2-4b7e-baa2-0d3338ac617f service nova] Acquiring lock "6cae9f61-763f-4671-a873-d15f01384416-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:54:00 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-392e172d-cb5f-48b9-adf2-9c097767417c req-32b5a175-6ad2-4b7e-baa2-0d3338ac617f service nova] Lock "6cae9f61-763f-4671-a873-d15f01384416-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:54:00 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-392e172d-cb5f-48b9-adf2-9c097767417c req-32b5a175-6ad2-4b7e-baa2-0d3338ac617f service nova] Lock "6cae9f61-763f-4671-a873-d15f01384416-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:54:00 user nova-compute[71509]: DEBUG nova.compute.manager [req-392e172d-cb5f-48b9-adf2-9c097767417c req-32b5a175-6ad2-4b7e-baa2-0d3338ac617f service nova] [instance: 6cae9f61-763f-4671-a873-d15f01384416] No waiting events found dispatching network-vif-unplugged-30d57100-3321-41fe-9335-d53c8c5e291c {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:54:00 user nova-compute[71509]: WARNING nova.compute.manager [req-392e172d-cb5f-48b9-adf2-9c097767417c req-32b5a175-6ad2-4b7e-baa2-0d3338ac617f service nova] [instance: 6cae9f61-763f-4671-a873-d15f01384416] Received unexpected event network-vif-unplugged-30d57100-3321-41fe-9335-d53c8c5e291c for instance with vm_state rescued and task_state unrescuing.
Apr 14 10:54:01 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: 6cae9f61-763f-4671-a873-d15f01384416] Instance destroyed successfully.
Apr 14 10:54:02 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:54:02 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:54:02 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:54:02 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:54:02 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:54:02 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:54:02 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:54:02 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:54:03 user nova-compute[71509]: DEBUG nova.compute.manager [req-1808f761-502d-4d2f-9961-d7e087c767f3 req-25b83f41-1b9e-45b1-a713-4c6c287e3906 service nova] [instance: 6cae9f61-763f-4671-a873-d15f01384416] Received event network-vif-plugged-30d57100-3321-41fe-9335-d53c8c5e291c {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:54:03 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-1808f761-502d-4d2f-9961-d7e087c767f3 req-25b83f41-1b9e-45b1-a713-4c6c287e3906 service nova] Acquiring lock "6cae9f61-763f-4671-a873-d15f01384416-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:54:03 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-1808f761-502d-4d2f-9961-d7e087c767f3 req-25b83f41-1b9e-45b1-a713-4c6c287e3906 service nova] Lock "6cae9f61-763f-4671-a873-d15f01384416-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:54:03 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-1808f761-502d-4d2f-9961-d7e087c767f3 req-25b83f41-1b9e-45b1-a713-4c6c287e3906 service nova] Lock "6cae9f61-763f-4671-a873-d15f01384416-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:54:03 user nova-compute[71509]: DEBUG nova.compute.manager [req-1808f761-502d-4d2f-9961-d7e087c767f3 req-25b83f41-1b9e-45b1-a713-4c6c287e3906 service nova] [instance: 6cae9f61-763f-4671-a873-d15f01384416] No waiting events found dispatching network-vif-plugged-30d57100-3321-41fe-9335-d53c8c5e291c {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:54:03 user nova-compute[71509]: WARNING nova.compute.manager [req-1808f761-502d-4d2f-9961-d7e087c767f3 req-25b83f41-1b9e-45b1-a713-4c6c287e3906 service nova] [instance: 6cae9f61-763f-4671-a873-d15f01384416] Received unexpected event network-vif-plugged-30d57100-3321-41fe-9335-d53c8c5e291c for instance with vm_state rescued and task_state unrescuing.
Apr 14 10:54:03 user nova-compute[71509]: DEBUG nova.compute.manager [req-1808f761-502d-4d2f-9961-d7e087c767f3 req-25b83f41-1b9e-45b1-a713-4c6c287e3906 service nova] [instance: 6cae9f61-763f-4671-a873-d15f01384416] Received event network-vif-plugged-30d57100-3321-41fe-9335-d53c8c5e291c {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:54:03 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-1808f761-502d-4d2f-9961-d7e087c767f3 req-25b83f41-1b9e-45b1-a713-4c6c287e3906 service nova] Acquiring lock "6cae9f61-763f-4671-a873-d15f01384416-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:54:03 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-1808f761-502d-4d2f-9961-d7e087c767f3 req-25b83f41-1b9e-45b1-a713-4c6c287e3906 service nova] Lock "6cae9f61-763f-4671-a873-d15f01384416-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:54:03 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-1808f761-502d-4d2f-9961-d7e087c767f3 req-25b83f41-1b9e-45b1-a713-4c6c287e3906 service nova] Lock "6cae9f61-763f-4671-a873-d15f01384416-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:54:03 user nova-compute[71509]: DEBUG nova.compute.manager [req-1808f761-502d-4d2f-9961-d7e087c767f3 req-25b83f41-1b9e-45b1-a713-4c6c287e3906 service nova] [instance: 6cae9f61-763f-4671-a873-d15f01384416] No waiting events found dispatching network-vif-plugged-30d57100-3321-41fe-9335-d53c8c5e291c {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:54:03 user nova-compute[71509]: WARNING nova.compute.manager [req-1808f761-502d-4d2f-9961-d7e087c767f3 req-25b83f41-1b9e-45b1-a713-4c6c287e3906 service nova] [instance: 6cae9f61-763f-4671-a873-d15f01384416] Received unexpected event network-vif-plugged-30d57100-3321-41fe-9335-d53c8c5e291c for instance with vm_state rescued and task_state unrescuing.
Apr 14 10:54:03 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:54:04 user nova-compute[71509]: DEBUG nova.virt.libvirt.host [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Removed pending event for 6cae9f61-763f-4671-a873-d15f01384416 due to event {{(pid=71509) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 10:54:04 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681469644.7653415, 6cae9f61-763f-4671-a873-d15f01384416 => Resumed> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 10:54:04 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 6cae9f61-763f-4671-a873-d15f01384416] VM Resumed (Lifecycle Event)
Apr 14 10:54:04 user nova-compute[71509]: DEBUG nova.compute.manager [None req-8d47caf5-37ae-4255-8557-9c7af65d4155 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: 6cae9f61-763f-4671-a873-d15f01384416] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:54:04 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 6cae9f61-763f-4671-a873-d15f01384416] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:54:04 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 6cae9f61-763f-4671-a873-d15f01384416] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 10:54:04 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 6cae9f61-763f-4671-a873-d15f01384416] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 14 10:54:04 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681469644.7706077, 6cae9f61-763f-4671-a873-d15f01384416 => Started> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 10:54:04 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 6cae9f61-763f-4671-a873-d15f01384416] VM Started (Lifecycle Event)
Apr 14 10:54:04 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 6cae9f61-763f-4671-a873-d15f01384416] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:54:04 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 6cae9f61-763f-4671-a873-d15f01384416] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 10:54:05 user nova-compute[71509]: DEBUG nova.compute.manager [req-ae13fa73-8933-4e58-9a9f-7ca5502ccdf1 req-d831a986-f3e0-4789-b4a5-34f8b1e3fda7 service nova] [instance: 6cae9f61-763f-4671-a873-d15f01384416] Received event network-vif-plugged-30d57100-3321-41fe-9335-d53c8c5e291c {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:54:05 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-ae13fa73-8933-4e58-9a9f-7ca5502ccdf1 req-d831a986-f3e0-4789-b4a5-34f8b1e3fda7 service nova] Acquiring lock "6cae9f61-763f-4671-a873-d15f01384416-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:54:05 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-ae13fa73-8933-4e58-9a9f-7ca5502ccdf1 req-d831a986-f3e0-4789-b4a5-34f8b1e3fda7 service nova] Lock "6cae9f61-763f-4671-a873-d15f01384416-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:54:05 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-ae13fa73-8933-4e58-9a9f-7ca5502ccdf1 req-d831a986-f3e0-4789-b4a5-34f8b1e3fda7 service nova] Lock "6cae9f61-763f-4671-a873-d15f01384416-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:54:05 user nova-compute[71509]: DEBUG nova.compute.manager [req-ae13fa73-8933-4e58-9a9f-7ca5502ccdf1 req-d831a986-f3e0-4789-b4a5-34f8b1e3fda7 service nova] [instance: 6cae9f61-763f-4671-a873-d15f01384416] No waiting events found dispatching network-vif-plugged-30d57100-3321-41fe-9335-d53c8c5e291c {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:54:05 user nova-compute[71509]: WARNING nova.compute.manager [req-ae13fa73-8933-4e58-9a9f-7ca5502ccdf1 req-d831a986-f3e0-4789-b4a5-34f8b1e3fda7 service nova] [instance: 6cae9f61-763f-4671-a873-d15f01384416] Received unexpected event network-vif-plugged-30d57100-3321-41fe-9335-d53c8c5e291c for instance with vm_state active and task_state None.
Apr 14 10:54:07 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:54:08 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:54:12 user nova-compute[71509]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681469637.3777776, f3245b74-dbe8-4b8b-83b6-58a4811fdba9 => Stopped> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 10:54:12 user nova-compute[71509]: INFO nova.compute.manager [-] [instance: f3245b74-dbe8-4b8b-83b6-58a4811fdba9] VM Stopped (Lifecycle Event)
Apr 14 10:54:12 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1dc54aae-b742-4c0b-b0bf-6285f507bcee None None] [instance: f3245b74-dbe8-4b8b-83b6-58a4811fdba9] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:54:12 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:54:13 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:54:17 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:54:18 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:54:22 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:54:27 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 10:54:27 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 10:54:27 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71509) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 10:54:27 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71509) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 10:54:27 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71509) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 10:54:27 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:54:32 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 10:54:33 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:54:37 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:54:42 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 10:54:42 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:54:42 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71509) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 10:54:42 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71509) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 10:54:42 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71509) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 10:54:42 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:54:43 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:54:43 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:54:43 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:54:43 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:54:43 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:54:43 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:54:43 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:54:43 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71509) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 10:54:44 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:54:44 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Starting heal instance info cache {{(pid=71509) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 10:54:44 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "refresh_cache-b4abb549-8f36-40c5-971f-8accbb14ff86" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:54:44 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquired lock "refresh_cache-b4abb549-8f36-40c5-971f-8accbb14ff86" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:54:44 user nova-compute[71509]: DEBUG nova.network.neutron [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Forcefully refreshing network info cache for instance {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 10:54:45 user nova-compute[71509]: DEBUG nova.network.neutron [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Updating instance_info_cache with network_info: [{"id": "608a2408-02df-474f-9006-260c8c97def1", "address": "fa:16:3e:e4:f7:87", "network": {"id": "18a91434-637b-4c19-a97b-736b32c1ea5a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1824162811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea2cb4dfa5b4a52b658efd8f5aefb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap608a2408-02", "ovs_interfaceid": "608a2408-02df-474f-9006-260c8c97def1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:54:45 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Releasing lock "refresh_cache-b4abb549-8f36-40c5-971f-8accbb14ff86" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:54:45 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Updated the network info_cache for instance {{(pid=71509) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 10:54:45 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:54:45 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:54:45 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:54:45 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:54:45 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:54:45 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Auditing locally available compute resources for user (node: user) {{(pid=71509) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 10:54:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97820f17-22d1-4ec3-9721-1edadccc794a/disk.rescue --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:54:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97820f17-22d1-4ec3-9721-1edadccc794a/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:54:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97820f17-22d1-4ec3-9721-1edadccc794a/disk.rescue --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:54:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97820f17-22d1-4ec3-9721-1edadccc794a/disk.rescue --force-share --output=json" returned: 0 in 0.156s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:54:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97820f17-22d1-4ec3-9721-1edadccc794a/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:54:46 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97820f17-22d1-4ec3-9721-1edadccc794a/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:54:46 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97820f17-22d1-4ec3-9721-1edadccc794a/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:54:46 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97820f17-22d1-4ec3-9721-1edadccc794a/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:54:46 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4abb549-8f36-40c5-971f-8accbb14ff86/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:54:46 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4abb549-8f36-40c5-971f-8accbb14ff86/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:54:46 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4abb549-8f36-40c5-971f-8accbb14ff86/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:54:46 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4abb549-8f36-40c5-971f-8accbb14ff86/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:54:46 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71509) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 10:54:46 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8586a70e-9855-4177-ac1b-cf707a4df871/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:54:46 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8586a70e-9855-4177-ac1b-cf707a4df871/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:54:46 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8586a70e-9855-4177-ac1b-cf707a4df871/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:54:46 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8586a70e-9855-4177-ac1b-cf707a4df871/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:54:46 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd661ae0-c4bb-4117-847d-ef7e85d062fb/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:54:46 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd661ae0-c4bb-4117-847d-ef7e85d062fb/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:54:46 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd661ae0-c4bb-4117-847d-ef7e85d062fb/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:54:47 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd661ae0-c4bb-4117-847d-ef7e85d062fb/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:54:47 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=71509) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 10:54:47 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3393be13-7d81-48da-b6dd-a427e8403b22/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:54:47 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:54:47 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3393be13-7d81-48da-b6dd-a427e8403b22/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:54:47 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3393be13-7d81-48da-b6dd-a427e8403b22/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:54:47 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3393be13-7d81-48da-b6dd-a427e8403b22/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:54:47 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e479154a-acd6-47aa-9a5b-43c6e0feda07/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:54:47 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:54:47 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e479154a-acd6-47aa-9a5b-43c6e0feda07/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:54:47 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e479154a-acd6-47aa-9a5b-43c6e0feda07/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:54:47 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e479154a-acd6-47aa-9a5b-43c6e0feda07/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:54:47 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5/disk.rescue --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:54:47 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:54:47 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5/disk.rescue --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:54:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5/disk.rescue --force-share --output=json" returned: 0 in 0.145s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:54:48 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] skipping disk /opt/stack/data/nova/instances/d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5/disk (vdb) as it is a volume {{(pid=71509) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 10:54:48 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71509) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 10:54:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97f20661-8b60-439e-b7af-2fc2013c5ade/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:54:48 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:54:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97f20661-8b60-439e-b7af-2fc2013c5ade/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:54:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97f20661-8b60-439e-b7af-2fc2013c5ade/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:54:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97f20661-8b60-439e-b7af-2fc2013c5ade/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:54:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe152ebd-4f99-4fa8-bfdb-8744cdf3f387/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:54:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe152ebd-4f99-4fa8-bfdb-8744cdf3f387/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:54:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe152ebd-4f99-4fa8-bfdb-8744cdf3f387/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:54:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe152ebd-4f99-4fa8-bfdb-8744cdf3f387/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:54:49 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:54:49 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:54:49 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Hypervisor/Node resource view: name=user free_ram=7842MB free_disk=25.99481201171875GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71509) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 10:54:49 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:54:49 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:54:49 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 97f20661-8b60-439e-b7af-2fc2013c5ade actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:54:49 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 97820f17-22d1-4ec3-9721-1edadccc794a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:54:49 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance e479154a-acd6-47aa-9a5b-43c6e0feda07 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:54:49 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 8586a70e-9855-4177-ac1b-cf707a4df871 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:54:49 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 6cae9f61-763f-4671-a873-d15f01384416 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:54:49 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:54:49 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance cd661ae0-c4bb-4117-847d-ef7e85d062fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:54:49 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance b4abb549-8f36-40c5-971f-8accbb14ff86 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:54:49 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance fe152ebd-4f99-4fa8-bfdb-8744cdf3f387 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:54:49 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 3393be13-7d81-48da-b6dd-a427e8403b22 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:54:49 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=71509) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 10:54:49 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Final resource view: name=user phys_ram=16023MB used_ram=1792MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=71509) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 10:54:49 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 10:54:49 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 10:54:49 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Compute_service record updated for user:user {{(pid=71509) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 10:54:49 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.446s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:54:50 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:54:52 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:54:52 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:54:53 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:54:54 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:54:57 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:55:00 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:55:01 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:55:02 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:55:03 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:55:04 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:55:04 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:55:04 user nova-compute[71509]: DEBUG nova.objects.instance [None req-67547f87-d0a9-4980-9fa2-7f83bf24957d tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lazy-loading 'flavor' on Instance uuid 8586a70e-9855-4177-ac1b-cf707a4df871 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:55:04 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-67547f87-d0a9-4980-9fa2-7f83bf24957d tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Acquiring lock "refresh_cache-8586a70e-9855-4177-ac1b-cf707a4df871" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:55:04 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-67547f87-d0a9-4980-9fa2-7f83bf24957d tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Acquired lock "refresh_cache-8586a70e-9855-4177-ac1b-cf707a4df871" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:55:04 user nova-compute[71509]: DEBUG nova.network.neutron [None req-67547f87-d0a9-4980-9fa2-7f83bf24957d tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Building network info cache for instance {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 10:55:04 user nova-compute[71509]: DEBUG nova.objects.instance [None req-67547f87-d0a9-4980-9fa2-7f83bf24957d tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lazy-loading 'info_cache' on Instance uuid 8586a70e-9855-4177-ac1b-cf707a4df871 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:55:05 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-b9f99c7f-211e-4d58-af3e-c082518df402 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Acquiring lock "6f41f217-0df2-4205-9633-7dbe83f40c96" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:55:05 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-b9f99c7f-211e-4d58-af3e-c082518df402 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Lock "6f41f217-0df2-4205-9633-7dbe83f40c96" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:55:05 user nova-compute[71509]: DEBUG nova.compute.manager [None req-b9f99c7f-211e-4d58-af3e-c082518df402 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] [instance: 6f41f217-0df2-4205-9633-7dbe83f40c96] Starting instance... {{(pid=71509) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 10:55:05 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-b9f99c7f-211e-4d58-af3e-c082518df402 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:55:05 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-b9f99c7f-211e-4d58-af3e-c082518df402 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:55:05 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-b9f99c7f-211e-4d58-af3e-c082518df402 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71509) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 10:55:05 user nova-compute[71509]: INFO nova.compute.claims [None req-b9f99c7f-211e-4d58-af3e-c082518df402 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] [instance: 6f41f217-0df2-4205-9633-7dbe83f40c96] Claim successful on node user
Apr 14 10:55:05 user nova-compute[71509]: DEBUG nova.network.neutron [None req-67547f87-d0a9-4980-9fa2-7f83bf24957d tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Updating instance_info_cache with network_info: [{"id": "473d9af8-25a0-4e5a-9afb-7a0c843115cc", "address": "fa:16:3e:b0:12:bf", "network": {"id": "653f0c81-1afd-4ca6-9639-675ead1a6127", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-932652547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb9b9fc4f2e244879502006bb844761c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap473d9af8-25", "ovs_interfaceid": "473d9af8-25a0-4e5a-9afb-7a0c843115cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:55:05 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-67547f87-d0a9-4980-9fa2-7f83bf24957d tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Releasing lock "refresh_cache-8586a70e-9855-4177-ac1b-cf707a4df871" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:55:05 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Instance destroyed successfully.
Apr 14 10:55:05 user nova-compute[71509]: DEBUG nova.objects.instance [None req-67547f87-d0a9-4980-9fa2-7f83bf24957d tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lazy-loading 'resources' on Instance uuid 8586a70e-9855-4177-ac1b-cf707a4df871 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:55:05 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-67547f87-d0a9-4980-9fa2-7f83bf24957d tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T10:47:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1909620947',display_name='tempest-AttachVolumeTestJSON-server-1909620947',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1909620947',id=16,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB8cubhYj6kalSkwto2AOwwQ8SwXu5MQ/cjSK0TQBgPs7qiNcfKtpFOEItZcvi+VTwGeXlKnu4SiqcBNrbUUIw9hxThGtWyniX5k6WeMBHziH1L0bIiIvkr1gDZ6mYbTMQ==',key_name='tempest-keypair-1352311307',keypairs=<?>,launch_index=0,launched_at=2023-04-14T10:47:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='eb9b9fc4f2e244879502006bb844761c',ramdisk_id='',reservation_id='r-043k765a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-821788322',owner_user_name='tempest-AttachVolumeTestJSON-821788322-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T10:53:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11cb4a1e78d447dbb18cde5453fe499c',uuid=8586a70e-9855-4177-ac1b-cf707a4df871,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "473d9af8-25a0-4e5a-9afb-7a0c843115cc", "address": "fa:16:3e:b0:12:bf", "network": {"id": "653f0c81-1afd-4ca6-9639-675ead1a6127", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-932652547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb9b9fc4f2e244879502006bb844761c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap473d9af8-25", "ovs_interfaceid": "473d9af8-25a0-4e5a-9afb-7a0c843115cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 10:55:05 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-67547f87-d0a9-4980-9fa2-7f83bf24957d tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Converting VIF {"id": "473d9af8-25a0-4e5a-9afb-7a0c843115cc", "address": "fa:16:3e:b0:12:bf", "network": {"id": "653f0c81-1afd-4ca6-9639-675ead1a6127", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-932652547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb9b9fc4f2e244879502006bb844761c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap473d9af8-25", "ovs_interfaceid": "473d9af8-25a0-4e5a-9afb-7a0c843115cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:55:05 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-67547f87-d0a9-4980-9fa2-7f83bf24957d tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:12:bf,bridge_name='br-int',has_traffic_filtering=True,id=473d9af8-25a0-4e5a-9afb-7a0c843115cc,network=Network(653f0c81-1afd-4ca6-9639-675ead1a6127),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap473d9af8-25') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:55:05 user nova-compute[71509]: DEBUG os_vif [None req-67547f87-d0a9-4980-9fa2-7f83bf24957d tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:12:bf,bridge_name='br-int',has_traffic_filtering=True,id=473d9af8-25a0-4e5a-9afb-7a0c843115cc,network=Network(653f0c81-1afd-4ca6-9639-675ead1a6127),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap473d9af8-25') {{(pid=71509) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 10:55:05 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:55:05 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap473d9af8-25, bridge=br-int, if_exists=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:55:05 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 10:55:05 user nova-compute[71509]: INFO os_vif [None req-67547f87-d0a9-4980-9fa2-7f83bf24957d tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:12:bf,bridge_name='br-int',has_traffic_filtering=True,id=473d9af8-25a0-4e5a-9afb-7a0c843115cc,network=Network(653f0c81-1afd-4ca6-9639-675ead1a6127),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap473d9af8-25')
Apr 14 10:55:05 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-67547f87-d0a9-4980-9fa2-7f83bf24957d tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Start _get_guest_xml network_info=[{"id": "473d9af8-25a0-4e5a-9afb-7a0c843115cc", "address": "fa:16:3e:b0:12:bf", "network": {"id": "653f0c81-1afd-4ca6-9639-675ead1a6127", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-932652547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb9b9fc4f2e244879502006bb844761c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap473d9af8-25", "ovs_interfaceid": "473d9af8-25a0-4e5a-9afb-7a0c843115cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=048ec0ee-0465-448d-8b4c-f072acb101dc,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '048ec0ee-0465-448d-8b4c-f072acb101dc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71509) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 10:55:05 user nova-compute[71509]: DEBUG nova.objects.instance [None req-67547f87-d0a9-4980-9fa2-7f83bf24957d tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lazy-loading 'numa_topology' on Instance uuid 8586a70e-9855-4177-ac1b-cf707a4df871 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:55:05 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-b9f99c7f-211e-4d58-af3e-c082518df402 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 10:55:05 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-67547f87-d0a9-4980-9fa2-7f83bf24957d tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:55:05 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-67547f87-d0a9-4980-9fa2-7f83bf24957d tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:55:05 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-67547f87-d0a9-4980-9fa2-7f83bf24957d tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71509) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 10:55:05 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-67547f87-d0a9-4980-9fa2-7f83bf24957d tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T10:40:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=048ec0ee-0465-448d-8b4c-f072acb101dc,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 10:55:05 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-67547f87-d0a9-4980-9fa2-7f83bf24957d tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Flavor limits 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 10:55:05 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-67547f87-d0a9-4980-9fa2-7f83bf24957d tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Image limits 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 10:55:05 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-67547f87-d0a9-4980-9fa2-7f83bf24957d tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Flavor pref 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 10:55:05 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-67547f87-d0a9-4980-9fa2-7f83bf24957d tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Image pref 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 10:55:05 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-67547f87-d0a9-4980-9fa2-7f83bf24957d tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 10:55:05 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-67547f87-d0a9-4980-9fa2-7f83bf24957d tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 10:55:05 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-67547f87-d0a9-4980-9fa2-7f83bf24957d tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71509) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 10:55:05 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-67547f87-d0a9-4980-9fa2-7f83bf24957d tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Got 1 possible topologies {{(pid=71509) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 10:55:05 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-67547f87-d0a9-4980-9fa2-7f83bf24957d tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 10:55:05 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-67547f87-d0a9-4980-9fa2-7f83bf24957d tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 10:55:05 user nova-compute[71509]: DEBUG nova.objects.instance [None req-67547f87-d0a9-4980-9fa2-7f83bf24957d tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8586a70e-9855-4177-ac1b-cf707a4df871 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:55:05 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-b9f99c7f-211e-4d58-af3e-c082518df402 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 10:55:05 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-67547f87-d0a9-4980-9fa2-7f83bf24957d tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T10:47:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1909620947',display_name='tempest-AttachVolumeTestJSON-server-1909620947',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1909620947',id=16,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB8cubhYj6kalSkwto2AOwwQ8SwXu5MQ/cjSK0TQBgPs7qiNcfKtpFOEItZcvi+VTwGeXlKnu4SiqcBNrbUUIw9hxThGtWyniX5k6WeMBHziH1L0bIiIvkr1gDZ6mYbTMQ==',key_name='tempest-keypair-1352311307',keypairs=<?>,launch_index=0,launched_at=2023-04-14T10:47:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='eb9b9fc4f2e244879502006bb844761c',ramdisk_id='',reservation_id='r-043k765a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-821788322',owner_user_name='tempest-AttachVolumeTestJSON-821788322-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T10:53:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11cb4a1e78d447dbb18cde5453fe499c',uuid=8586a70e-9855-4177-ac1b-cf707a4df871,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "473d9af8-25a0-4e5a-9afb-7a0c843115cc", "address": "fa:16:3e:b0:12:bf", "network": {"id": "653f0c81-1afd-4ca6-9639-675ead1a6127", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-932652547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb9b9fc4f2e244879502006bb844761c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap473d9af8-25", "ovs_interfaceid": "473d9af8-25a0-4e5a-9afb-7a0c843115cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71509) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 10:55:05 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-67547f87-d0a9-4980-9fa2-7f83bf24957d tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Converting VIF {"id": "473d9af8-25a0-4e5a-9afb-7a0c843115cc", "address": "fa:16:3e:b0:12:bf", "network": {"id": "653f0c81-1afd-4ca6-9639-675ead1a6127", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-932652547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb9b9fc4f2e244879502006bb844761c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap473d9af8-25", "ovs_interfaceid": "473d9af8-25a0-4e5a-9afb-7a0c843115cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:55:05 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-67547f87-d0a9-4980-9fa2-7f83bf24957d tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:12:bf,bridge_name='br-int',has_traffic_filtering=True,id=473d9af8-25a0-4e5a-9afb-7a0c843115cc,network=Network(653f0c81-1afd-4ca6-9639-675ead1a6127),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap473d9af8-25') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:55:05 user nova-compute[71509]: DEBUG nova.objects.instance [None req-67547f87-d0a9-4980-9fa2-7f83bf24957d tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lazy-loading 'pci_devices' on Instance uuid 8586a70e-9855-4177-ac1b-cf707a4df871 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:55:05 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-b9f99c7f-211e-4d58-af3e-c082518df402 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.482s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:55:05 user nova-compute[71509]: DEBUG nova.compute.manager [None req-b9f99c7f-211e-4d58-af3e-c082518df402 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] [instance: 6f41f217-0df2-4205-9633-7dbe83f40c96] Start building networks asynchronously for instance. {{(pid=71509) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 10:55:05 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-67547f87-d0a9-4980-9fa2-7f83bf24957d tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] End _get_guest_xml xml=<domain type="kvm">
Apr 14 10:55:05 user nova-compute[71509]:   <uuid>8586a70e-9855-4177-ac1b-cf707a4df871</uuid>
Apr 14 10:55:05 user nova-compute[71509]:   <name>instance-00000010</name>
Apr 14 10:55:05 user nova-compute[71509]:   <memory>131072</memory>
Apr 14 10:55:05 user nova-compute[71509]:   <vcpu>1</vcpu>
Apr 14 10:55:05 user nova-compute[71509]:   <metadata>
Apr 14 10:55:05 user nova-compute[71509]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 10:55:05 user nova-compute[71509]:       <nova:package version="0.0.0"/>
Apr 14 10:55:05 user nova-compute[71509]:       <nova:name>tempest-AttachVolumeTestJSON-server-1909620947</nova:name>
Apr 14 10:55:05 user nova-compute[71509]:       <nova:creationTime>2023-04-14 10:55:05</nova:creationTime>
Apr 14 10:55:05 user nova-compute[71509]:       <nova:flavor name="m1.nano">
Apr 14 10:55:05 user nova-compute[71509]:         <nova:memory>128</nova:memory>
Apr 14 10:55:05 user nova-compute[71509]:         <nova:disk>1</nova:disk>
Apr 14 10:55:05 user nova-compute[71509]:         <nova:swap>0</nova:swap>
Apr 14 10:55:05 user nova-compute[71509]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 10:55:05 user nova-compute[71509]:         <nova:vcpus>1</nova:vcpus>
Apr 14 10:55:05 user nova-compute[71509]:       </nova:flavor>
Apr 14 10:55:05 user nova-compute[71509]:       <nova:owner>
Apr 14 10:55:05 user nova-compute[71509]:         <nova:user uuid="11cb4a1e78d447dbb18cde5453fe499c">tempest-AttachVolumeTestJSON-821788322-project-member</nova:user>
Apr 14 10:55:05 user nova-compute[71509]:         <nova:project uuid="eb9b9fc4f2e244879502006bb844761c">tempest-AttachVolumeTestJSON-821788322</nova:project>
Apr 14 10:55:05 user nova-compute[71509]:       </nova:owner>
Apr 14 10:55:05 user nova-compute[71509]:       <nova:root type="image" uuid="048ec0ee-0465-448d-8b4c-f072acb101dc"/>
Apr 14 10:55:05 user nova-compute[71509]:       <nova:ports>
Apr 14 10:55:05 user nova-compute[71509]:         <nova:port uuid="473d9af8-25a0-4e5a-9afb-7a0c843115cc">
Apr 14 10:55:05 user nova-compute[71509]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 14 10:55:05 user nova-compute[71509]:         </nova:port>
Apr 14 10:55:05 user nova-compute[71509]:       </nova:ports>
Apr 14 10:55:05 user nova-compute[71509]:     </nova:instance>
Apr 14 10:55:05 user nova-compute[71509]:   </metadata>
Apr 14 10:55:05 user nova-compute[71509]:   <sysinfo type="smbios">
Apr 14 10:55:05 user nova-compute[71509]:     <system>
Apr 14 10:55:05 user nova-compute[71509]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 10:55:05 user nova-compute[71509]:       <entry name="product">OpenStack Nova</entry>
Apr 14 10:55:05 user nova-compute[71509]:       <entry name="version">0.0.0</entry>
Apr 14 10:55:05 user nova-compute[71509]:       <entry name="serial">8586a70e-9855-4177-ac1b-cf707a4df871</entry>
Apr 14 10:55:05 user nova-compute[71509]:       <entry name="uuid">8586a70e-9855-4177-ac1b-cf707a4df871</entry>
Apr 14 10:55:05 user nova-compute[71509]:       <entry name="family">Virtual Machine</entry>
Apr 14 10:55:05 user nova-compute[71509]:     </system>
Apr 14 10:55:05 user nova-compute[71509]:   </sysinfo>
Apr 14 10:55:05 user nova-compute[71509]:   <os>
Apr 14 10:55:05 user nova-compute[71509]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 10:55:05 user nova-compute[71509]:     <boot dev="hd"/>
Apr 14 10:55:05 user nova-compute[71509]:     <smbios mode="sysinfo"/>
Apr 14 10:55:05 user nova-compute[71509]:   </os>
Apr 14 10:55:05 user nova-compute[71509]:   <features>
Apr 14 10:55:05 user nova-compute[71509]:     <acpi/>
Apr 14 10:55:05 user nova-compute[71509]:     <apic/>
Apr 14 10:55:05 user nova-compute[71509]:     <vmcoreinfo/>
Apr 14 10:55:05 user nova-compute[71509]:   </features>
Apr 14 10:55:05 user nova-compute[71509]:   <clock offset="utc">
Apr 14 10:55:05 user nova-compute[71509]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 10:55:05 user nova-compute[71509]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 10:55:05 user nova-compute[71509]:     <timer name="hpet" present="no"/>
Apr 14 10:55:05 user nova-compute[71509]:   </clock>
Apr 14 10:55:05 user nova-compute[71509]:   <cpu mode="custom" match="exact">
Apr 14 10:55:05 user nova-compute[71509]:     <model>Nehalem</model>
Apr 14 10:55:05 user nova-compute[71509]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 10:55:05 user nova-compute[71509]:   </cpu>
Apr 14 10:55:05 user nova-compute[71509]:   <devices>
Apr 14 10:55:05 user nova-compute[71509]:     <disk type="file" device="disk">
Apr 14 10:55:05 user nova-compute[71509]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 10:55:05 user nova-compute[71509]:       <source file="/opt/stack/data/nova/instances/8586a70e-9855-4177-ac1b-cf707a4df871/disk"/>
Apr 14 10:55:05 user nova-compute[71509]:       <target dev="vda" bus="virtio"/>
Apr 14 10:55:05 user nova-compute[71509]:     </disk>
Apr 14 10:55:05 user nova-compute[71509]:     <interface type="ethernet">
Apr 14 10:55:05 user nova-compute[71509]:       <mac address="fa:16:3e:b0:12:bf"/>
Apr 14 10:55:05 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 10:55:05 user nova-compute[71509]:       <mtu size="1442"/>
Apr 14 10:55:05 user nova-compute[71509]:       <target dev="tap473d9af8-25"/>
Apr 14 10:55:05 user nova-compute[71509]:     </interface>
Apr 14 10:55:05 user nova-compute[71509]:     <serial type="pty">
Apr 14 10:55:05 user nova-compute[71509]:       <log file="/opt/stack/data/nova/instances/8586a70e-9855-4177-ac1b-cf707a4df871/console.log" append="off"/>
Apr 14 10:55:05 user nova-compute[71509]:     </serial>
Apr 14 10:55:05 user nova-compute[71509]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 10:55:05 user nova-compute[71509]:     <video>
Apr 14 10:55:05 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 10:55:05 user nova-compute[71509]:     </video>
Apr 14 10:55:05 user nova-compute[71509]:     <rng model="virtio">
Apr 14 10:55:05 user nova-compute[71509]:       <backend model="random">/dev/urandom</backend>
Apr 14 10:55:05 user nova-compute[71509]:     </rng>
Apr 14 10:55:05 user nova-compute[71509]:     <controller type="usb" index="0" model="none"/>
Apr 14 10:55:05 user nova-compute[71509]:     <memballoon model="virtio">
Apr 14 10:55:05 user nova-compute[71509]:       <stats period="10"/>
Apr 14 10:55:05 user nova-compute[71509]:     </memballoon>
Apr 14 10:55:05 user nova-compute[71509]:   </devices>
Apr 14 10:55:05 user nova-compute[71509]: </domain>
Apr 14 10:55:05 user nova-compute[71509]:  {{(pid=71509) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 10:55:05 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-67547f87-d0a9-4980-9fa2-7f83bf24957d tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8586a70e-9855-4177-ac1b-cf707a4df871/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:55:05 user nova-compute[71509]: DEBUG nova.compute.manager [None req-b9f99c7f-211e-4d58-af3e-c082518df402 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] [instance: 6f41f217-0df2-4205-9633-7dbe83f40c96] Allocating IP information in the background. {{(pid=71509) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 10:55:05 user nova-compute[71509]: DEBUG nova.network.neutron [None req-b9f99c7f-211e-4d58-af3e-c082518df402 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] [instance: 6f41f217-0df2-4205-9633-7dbe83f40c96] allocate_for_instance() {{(pid=71509) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 10:55:05 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-b9f99c7f-211e-4d58-af3e-c082518df402 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] [instance: 6f41f217-0df2-4205-9633-7dbe83f40c96] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 10:55:05 user nova-compute[71509]: DEBUG nova.compute.manager [None req-b9f99c7f-211e-4d58-af3e-c082518df402 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] [instance: 6f41f217-0df2-4205-9633-7dbe83f40c96] Start building block device mappings for instance. {{(pid=71509) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 10:55:05 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-67547f87-d0a9-4980-9fa2-7f83bf24957d tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8586a70e-9855-4177-ac1b-cf707a4df871/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:55:05 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-67547f87-d0a9-4980-9fa2-7f83bf24957d tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8586a70e-9855-4177-ac1b-cf707a4df871/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:55:06 user nova-compute[71509]: DEBUG nova.policy [None req-b9f99c7f-211e-4d58-af3e-c082518df402 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b3f2157c5d4d441db80ea4a3ca60e4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1c0764b8a843808158644eb90704e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71509) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 10:55:06 user nova-compute[71509]: DEBUG nova.compute.manager [None req-b9f99c7f-211e-4d58-af3e-c082518df402 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] [instance: 6f41f217-0df2-4205-9633-7dbe83f40c96] Start spawning the instance on the hypervisor. {{(pid=71509) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 10:55:06 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-b9f99c7f-211e-4d58-af3e-c082518df402 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] [instance: 6f41f217-0df2-4205-9633-7dbe83f40c96] Creating instance directory {{(pid=71509) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 10:55:06 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-b9f99c7f-211e-4d58-af3e-c082518df402 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] [instance: 6f41f217-0df2-4205-9633-7dbe83f40c96] Creating image(s)
Apr 14 10:55:06 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-b9f99c7f-211e-4d58-af3e-c082518df402 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Acquiring lock "/opt/stack/data/nova/instances/6f41f217-0df2-4205-9633-7dbe83f40c96/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:55:06 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-b9f99c7f-211e-4d58-af3e-c082518df402 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Lock "/opt/stack/data/nova/instances/6f41f217-0df2-4205-9633-7dbe83f40c96/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:55:06 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-b9f99c7f-211e-4d58-af3e-c082518df402 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Lock "/opt/stack/data/nova/instances/6f41f217-0df2-4205-9633-7dbe83f40c96/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:55:06 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-b9f99c7f-211e-4d58-af3e-c082518df402 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:55:06 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-67547f87-d0a9-4980-9fa2-7f83bf24957d tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8586a70e-9855-4177-ac1b-cf707a4df871/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:55:06 user nova-compute[71509]: DEBUG nova.objects.instance [None req-67547f87-d0a9-4980-9fa2-7f83bf24957d tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lazy-loading 'trusted_certs' on Instance uuid 8586a70e-9855-4177-ac1b-cf707a4df871 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:55:06 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-67547f87-d0a9-4980-9fa2-7f83bf24957d tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:55:06 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-b9f99c7f-211e-4d58-af3e-c082518df402 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json" returned: 0 in 0.136s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:55:06 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-b9f99c7f-211e-4d58-af3e-c082518df402 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Acquiring lock "5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:55:06 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-b9f99c7f-211e-4d58-af3e-c082518df402 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Lock "5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:55:06 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-b9f99c7f-211e-4d58-af3e-c082518df402 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:55:06 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-67547f87-d0a9-4980-9fa2-7f83bf24957d tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json" returned: 0 in 0.133s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:55:06 user nova-compute[71509]: DEBUG nova.virt.disk.api [None req-67547f87-d0a9-4980-9fa2-7f83bf24957d tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8586a70e-9855-4177-ac1b-cf707a4df871/disk. size=1073741824 {{(pid=71509) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 10:55:06 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-67547f87-d0a9-4980-9fa2-7f83bf24957d tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8586a70e-9855-4177-ac1b-cf707a4df871/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:55:06 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-b9f99c7f-211e-4d58-af3e-c082518df402 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json" returned: 0 in 0.142s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:55:06 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-b9f99c7f-211e-4d58-af3e-c082518df402 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18,backing_fmt=raw /opt/stack/data/nova/instances/6f41f217-0df2-4205-9633-7dbe83f40c96/disk 1073741824 {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:55:06 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-b9f99c7f-211e-4d58-af3e-c082518df402 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18,backing_fmt=raw /opt/stack/data/nova/instances/6f41f217-0df2-4205-9633-7dbe83f40c96/disk 1073741824" returned: 0 in 0.069s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:55:06 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-67547f87-d0a9-4980-9fa2-7f83bf24957d tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8586a70e-9855-4177-ac1b-cf707a4df871/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:55:06 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-b9f99c7f-211e-4d58-af3e-c082518df402 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Lock "5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.219s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:55:06 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-b9f99c7f-211e-4d58-af3e-c082518df402 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:55:06 user nova-compute[71509]: DEBUG nova.virt.disk.api [None req-67547f87-d0a9-4980-9fa2-7f83bf24957d tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Cannot resize image /opt/stack/data/nova/instances/8586a70e-9855-4177-ac1b-cf707a4df871/disk to a smaller size. {{(pid=71509) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 10:55:06 user nova-compute[71509]: DEBUG nova.objects.instance [None req-67547f87-d0a9-4980-9fa2-7f83bf24957d tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lazy-loading 'migration_context' on Instance uuid 8586a70e-9855-4177-ac1b-cf707a4df871 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:55:06 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-67547f87-d0a9-4980-9fa2-7f83bf24957d tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T10:47:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1909620947',display_name='tempest-AttachVolumeTestJSON-server-1909620947',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1909620947',id=16,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB8cubhYj6kalSkwto2AOwwQ8SwXu5MQ/cjSK0TQBgPs7qiNcfKtpFOEItZcvi+VTwGeXlKnu4SiqcBNrbUUIw9hxThGtWyniX5k6WeMBHziH1L0bIiIvkr1gDZ6mYbTMQ==',key_name='tempest-keypair-1352311307',keypairs=<?>,launch_index=0,launched_at=2023-04-14T10:47:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='eb9b9fc4f2e244879502006bb844761c',ramdisk_id='',reservation_id='r-043k765a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-821788322',owner_user_name='tempest-AttachVolumeTestJSON-821788322-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T10:53:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11cb4a1e78d447dbb18cde5453fe499c',uuid=8586a70e-9855-4177-ac1b-cf707a4df871,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "473d9af8-25a0-4e5a-9afb-7a0c843115cc", "address": "fa:16:3e:b0:12:bf", "network": {"id": "653f0c81-1afd-4ca6-9639-675ead1a6127", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-932652547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb9b9fc4f2e244879502006bb844761c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap473d9af8-25", "ovs_interfaceid": "473d9af8-25a0-4e5a-9afb-7a0c843115cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 10:55:06 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-67547f87-d0a9-4980-9fa2-7f83bf24957d tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Converting VIF {"id": "473d9af8-25a0-4e5a-9afb-7a0c843115cc", "address": "fa:16:3e:b0:12:bf", "network": {"id": "653f0c81-1afd-4ca6-9639-675ead1a6127", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-932652547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb9b9fc4f2e244879502006bb844761c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap473d9af8-25", "ovs_interfaceid": "473d9af8-25a0-4e5a-9afb-7a0c843115cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:55:06 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-67547f87-d0a9-4980-9fa2-7f83bf24957d tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:12:bf,bridge_name='br-int',has_traffic_filtering=True,id=473d9af8-25a0-4e5a-9afb-7a0c843115cc,network=Network(653f0c81-1afd-4ca6-9639-675ead1a6127),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap473d9af8-25') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:55:06 user nova-compute[71509]: DEBUG os_vif [None req-67547f87-d0a9-4980-9fa2-7f83bf24957d tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:12:bf,bridge_name='br-int',has_traffic_filtering=True,id=473d9af8-25a0-4e5a-9afb-7a0c843115cc,network=Network(653f0c81-1afd-4ca6-9639-675ead1a6127),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap473d9af8-25') {{(pid=71509) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 10:55:06 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:55:06 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:55:06 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 10:55:06 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:55:06 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap473d9af8-25, may_exist=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:55:06 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap473d9af8-25, col_values=(('external_ids', {'iface-id': '473d9af8-25a0-4e5a-9afb-7a0c843115cc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b0:12:bf', 'vm-uuid': '8586a70e-9855-4177-ac1b-cf707a4df871'}),)) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:55:06 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 10:55:06 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:55:06 user nova-compute[71509]: INFO os_vif [None req-67547f87-d0a9-4980-9fa2-7f83bf24957d tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:12:bf,bridge_name='br-int',has_traffic_filtering=True,id=473d9af8-25a0-4e5a-9afb-7a0c843115cc,network=Network(653f0c81-1afd-4ca6-9639-675ead1a6127),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap473d9af8-25')
Apr 14 10:55:06 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-b9f99c7f-211e-4d58-af3e-c082518df402 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json" returned: 0 in 0.139s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:55:06 user nova-compute[71509]: DEBUG nova.virt.disk.api [None req-b9f99c7f-211e-4d58-af3e-c082518df402 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6f41f217-0df2-4205-9633-7dbe83f40c96/disk. size=1073741824 {{(pid=71509) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 10:55:06 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-b9f99c7f-211e-4d58-af3e-c082518df402 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f41f217-0df2-4205-9633-7dbe83f40c96/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:55:06 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-b9f99c7f-211e-4d58-af3e-c082518df402 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f41f217-0df2-4205-9633-7dbe83f40c96/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:55:06 user nova-compute[71509]: DEBUG nova.virt.disk.api [None req-b9f99c7f-211e-4d58-af3e-c082518df402 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Cannot resize image /opt/stack/data/nova/instances/6f41f217-0df2-4205-9633-7dbe83f40c96/disk to a smaller size. {{(pid=71509) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 10:55:06 user nova-compute[71509]: DEBUG nova.objects.instance [None req-b9f99c7f-211e-4d58-af3e-c082518df402 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Lazy-loading 'migration_context' on Instance uuid 6f41f217-0df2-4205-9633-7dbe83f40c96 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:55:06 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-b9f99c7f-211e-4d58-af3e-c082518df402 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] [instance: 6f41f217-0df2-4205-9633-7dbe83f40c96] Created local disks {{(pid=71509) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 10:55:06 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-b9f99c7f-211e-4d58-af3e-c082518df402 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] [instance: 6f41f217-0df2-4205-9633-7dbe83f40c96] Ensure instance console log exists: /opt/stack/data/nova/instances/6f41f217-0df2-4205-9633-7dbe83f40c96/console.log {{(pid=71509) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 10:55:06 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-b9f99c7f-211e-4d58-af3e-c082518df402 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:55:06 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-b9f99c7f-211e-4d58-af3e-c082518df402 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:55:06 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-b9f99c7f-211e-4d58-af3e-c082518df402 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:55:07 user nova-compute[71509]: DEBUG nova.network.neutron [None req-b9f99c7f-211e-4d58-af3e-c082518df402 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] [instance: 6f41f217-0df2-4205-9633-7dbe83f40c96] Successfully created port: e3d5b9ac-d641-478c-89cc-acbbf189ee2a {{(pid=71509) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 10:55:07 user nova-compute[71509]: INFO nova.compute.manager [None req-a8b665eb-426c-4502-9490-283d9c28f70a tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Unrescuing
Apr 14 10:55:07 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-a8b665eb-426c-4502-9490-283d9c28f70a tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Acquiring lock "refresh_cache-d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:55:07 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-a8b665eb-426c-4502-9490-283d9c28f70a tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Acquired lock "refresh_cache-d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:55:07 user nova-compute[71509]: DEBUG nova.network.neutron [None req-a8b665eb-426c-4502-9490-283d9c28f70a tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Building network info cache for instance {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 10:55:07 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:55:07 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:55:07 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:55:07 user nova-compute[71509]: DEBUG nova.compute.manager [req-8eccecd8-53b4-4fe8-8a85-390abd3d3d6e req-78b8815b-fda0-40c5-a77d-ec85c7bc623d service nova] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Received event network-vif-plugged-473d9af8-25a0-4e5a-9afb-7a0c843115cc {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:55:07 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-8eccecd8-53b4-4fe8-8a85-390abd3d3d6e req-78b8815b-fda0-40c5-a77d-ec85c7bc623d service nova] Acquiring lock "8586a70e-9855-4177-ac1b-cf707a4df871-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:55:07 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-8eccecd8-53b4-4fe8-8a85-390abd3d3d6e req-78b8815b-fda0-40c5-a77d-ec85c7bc623d service nova] Lock "8586a70e-9855-4177-ac1b-cf707a4df871-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:55:07 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-8eccecd8-53b4-4fe8-8a85-390abd3d3d6e req-78b8815b-fda0-40c5-a77d-ec85c7bc623d service nova] Lock "8586a70e-9855-4177-ac1b-cf707a4df871-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:55:07 user nova-compute[71509]: DEBUG nova.compute.manager [req-8eccecd8-53b4-4fe8-8a85-390abd3d3d6e req-78b8815b-fda0-40c5-a77d-ec85c7bc623d service nova] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] No waiting events found dispatching network-vif-plugged-473d9af8-25a0-4e5a-9afb-7a0c843115cc {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:55:07 user nova-compute[71509]: WARNING nova.compute.manager [req-8eccecd8-53b4-4fe8-8a85-390abd3d3d6e req-78b8815b-fda0-40c5-a77d-ec85c7bc623d service nova] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Received unexpected event network-vif-plugged-473d9af8-25a0-4e5a-9afb-7a0c843115cc for instance with vm_state stopped and task_state powering-on.
Apr 14 10:55:08 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:55:08 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:55:08 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:55:08 user nova-compute[71509]: DEBUG nova.network.neutron [None req-a8b665eb-426c-4502-9490-283d9c28f70a tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Updating instance_info_cache with network_info: [{"id": "f2196ef3-aada-48d6-b524-5e9cef6a9eda", "address": "fa:16:3e:e7:31:44", "network": {"id": "22eb5f87-be4d-447d-bafe-25e0284ea3ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-787804772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf93e5dac50342d0b65ef09711401e99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2196ef3-aa", "ovs_interfaceid": "f2196ef3-aada-48d6-b524-5e9cef6a9eda", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:55:08 user nova-compute[71509]: DEBUG nova.network.neutron [None req-b9f99c7f-211e-4d58-af3e-c082518df402 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] [instance: 6f41f217-0df2-4205-9633-7dbe83f40c96] Successfully updated port: e3d5b9ac-d641-478c-89cc-acbbf189ee2a {{(pid=71509) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 10:55:08 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-a8b665eb-426c-4502-9490-283d9c28f70a tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Releasing lock "refresh_cache-d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:55:08 user nova-compute[71509]: DEBUG nova.objects.instance [None req-a8b665eb-426c-4502-9490-283d9c28f70a tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lazy-loading 'flavor' on Instance uuid d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:55:08 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-b9f99c7f-211e-4d58-af3e-c082518df402 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Acquiring lock "refresh_cache-6f41f217-0df2-4205-9633-7dbe83f40c96" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:55:08 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-b9f99c7f-211e-4d58-af3e-c082518df402 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Acquired lock "refresh_cache-6f41f217-0df2-4205-9633-7dbe83f40c96" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:55:08 user nova-compute[71509]: DEBUG nova.network.neutron [None req-b9f99c7f-211e-4d58-af3e-c082518df402 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] [instance: 6f41f217-0df2-4205-9633-7dbe83f40c96] Building network info cache for instance {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 10:55:08 user nova-compute[71509]: DEBUG nova.compute.manager [req-e5d003f8-7a02-49b2-a1ce-a0dccffb7bdb req-14fa95f3-f3d5-4509-94c1-5c1b5a8dd6bd service nova] [instance: 6f41f217-0df2-4205-9633-7dbe83f40c96] Received event network-changed-e3d5b9ac-d641-478c-89cc-acbbf189ee2a {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:55:08 user nova-compute[71509]: DEBUG nova.compute.manager [req-e5d003f8-7a02-49b2-a1ce-a0dccffb7bdb req-14fa95f3-f3d5-4509-94c1-5c1b5a8dd6bd service nova] [instance: 6f41f217-0df2-4205-9633-7dbe83f40c96] Refreshing instance network info cache due to event network-changed-e3d5b9ac-d641-478c-89cc-acbbf189ee2a. {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 10:55:08 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-e5d003f8-7a02-49b2-a1ce-a0dccffb7bdb req-14fa95f3-f3d5-4509-94c1-5c1b5a8dd6bd service nova] Acquiring lock "refresh_cache-6f41f217-0df2-4205-9633-7dbe83f40c96" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:55:08 user nova-compute[71509]: DEBUG nova.network.neutron [None req-b9f99c7f-211e-4d58-af3e-c082518df402 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] [instance: 6f41f217-0df2-4205-9633-7dbe83f40c96] Instance cache missing network info. {{(pid=71509) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 10:55:08 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:55:08 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:55:08 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:55:08 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:55:08 user nova-compute[71509]: DEBUG nova.network.neutron [None req-b9f99c7f-211e-4d58-af3e-c082518df402 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] [instance: 6f41f217-0df2-4205-9633-7dbe83f40c96] Updating instance_info_cache with network_info: [{"id": "e3d5b9ac-d641-478c-89cc-acbbf189ee2a", "address": "fa:16:3e:2d:5c:30", "network": {"id": "0d829782-2ea4-4af3-8460-468b818423dc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2082561441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be1c0764b8a843808158644eb90704e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3d5b9ac-d6", "ovs_interfaceid": "e3d5b9ac-d641-478c-89cc-acbbf189ee2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:55:09 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-b9f99c7f-211e-4d58-af3e-c082518df402 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Releasing lock "refresh_cache-6f41f217-0df2-4205-9633-7dbe83f40c96" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:55:09 user nova-compute[71509]: DEBUG nova.compute.manager [None req-b9f99c7f-211e-4d58-af3e-c082518df402 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] [instance: 6f41f217-0df2-4205-9633-7dbe83f40c96] Instance network_info: |[{"id": "e3d5b9ac-d641-478c-89cc-acbbf189ee2a", "address": "fa:16:3e:2d:5c:30", "network": {"id": "0d829782-2ea4-4af3-8460-468b818423dc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2082561441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be1c0764b8a843808158644eb90704e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3d5b9ac-d6", "ovs_interfaceid": "e3d5b9ac-d641-478c-89cc-acbbf189ee2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71509) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 10:55:09 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-e5d003f8-7a02-49b2-a1ce-a0dccffb7bdb req-14fa95f3-f3d5-4509-94c1-5c1b5a8dd6bd service nova] Acquired lock "refresh_cache-6f41f217-0df2-4205-9633-7dbe83f40c96" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:55:09 user nova-compute[71509]: DEBUG nova.network.neutron [req-e5d003f8-7a02-49b2-a1ce-a0dccffb7bdb req-14fa95f3-f3d5-4509-94c1-5c1b5a8dd6bd service nova] [instance: 6f41f217-0df2-4205-9633-7dbe83f40c96] Refreshing network info cache for port e3d5b9ac-d641-478c-89cc-acbbf189ee2a {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 10:55:09 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-b9f99c7f-211e-4d58-af3e-c082518df402 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] [instance: 6f41f217-0df2-4205-9633-7dbe83f40c96] Start _get_guest_xml network_info=[{"id": "e3d5b9ac-d641-478c-89cc-acbbf189ee2a", "address": "fa:16:3e:2d:5c:30", "network": {"id": "0d829782-2ea4-4af3-8460-468b818423dc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2082561441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be1c0764b8a843808158644eb90704e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3d5b9ac-d6", "ovs_interfaceid": "e3d5b9ac-d641-478c-89cc-acbbf189ee2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T10:38:55Z,direct_url=<?>,disk_format='qcow2',id=048ec0ee-0465-448d-8b4c-f072acb101dc,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='9742d6ad20cf48d9bab0fdbcc9491db9',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T10:38:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '048ec0ee-0465-448d-8b4c-f072acb101dc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71509) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 10:55:09 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-b9f99c7f-211e-4d58-af3e-c082518df402 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:55:09 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-b9f99c7f-211e-4d58-af3e-c082518df402 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:55:09 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-b9f99c7f-211e-4d58-af3e-c082518df402 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71509) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 10:55:09 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-b9f99c7f-211e-4d58-af3e-c082518df402 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T10:40:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T10:38:55Z,direct_url=<?>,disk_format='qcow2',id=048ec0ee-0465-448d-8b4c-f072acb101dc,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='9742d6ad20cf48d9bab0fdbcc9491db9',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T10:38:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 10:55:09 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-b9f99c7f-211e-4d58-af3e-c082518df402 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Flavor limits 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 10:55:09 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-b9f99c7f-211e-4d58-af3e-c082518df402 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Image limits 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 10:55:09 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-b9f99c7f-211e-4d58-af3e-c082518df402 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Flavor pref 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 10:55:09 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-b9f99c7f-211e-4d58-af3e-c082518df402 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Image pref 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 10:55:09 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-b9f99c7f-211e-4d58-af3e-c082518df402 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 10:55:09 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-b9f99c7f-211e-4d58-af3e-c082518df402 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 10:55:09 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-b9f99c7f-211e-4d58-af3e-c082518df402 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71509) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 10:55:09 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-b9f99c7f-211e-4d58-af3e-c082518df402 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Got 1 possible topologies {{(pid=71509) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 10:55:09 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-b9f99c7f-211e-4d58-af3e-c082518df402 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 10:55:09 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-b9f99c7f-211e-4d58-af3e-c082518df402 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 10:55:09 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-b9f99c7f-211e-4d58-af3e-c082518df402 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T10:55:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1683745900',display_name='tempest-ServersNegativeTestJSON-server-1683745900',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1683745900',id=26,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='be1c0764b8a843808158644eb90704e6',ramdisk_id='',reservation_id='r-cr5mkbrz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1472676568',owner_user_name='tempest-ServersNegativeTestJSON-1472676568-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T10:55:06Z,user_data=None,user_id='b3f2157c5d4d441db80ea4a3ca60e4dc',uuid=6f41f217-0df2-4205-9633-7dbe83f40c96,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e3d5b9ac-d641-478c-89cc-acbbf189ee2a", "address": "fa:16:3e:2d:5c:30", "network": {"id": "0d829782-2ea4-4af3-8460-468b818423dc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2082561441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be1c0764b8a843808158644eb90704e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3d5b9ac-d6", "ovs_interfaceid": "e3d5b9ac-d641-478c-89cc-acbbf189ee2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71509) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 10:55:09 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-b9f99c7f-211e-4d58-af3e-c082518df402 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Converting VIF {"id": "e3d5b9ac-d641-478c-89cc-acbbf189ee2a", "address": "fa:16:3e:2d:5c:30", "network": {"id": "0d829782-2ea4-4af3-8460-468b818423dc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2082561441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be1c0764b8a843808158644eb90704e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3d5b9ac-d6", "ovs_interfaceid": "e3d5b9ac-d641-478c-89cc-acbbf189ee2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:55:09 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-b9f99c7f-211e-4d58-af3e-c082518df402 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:5c:30,bridge_name='br-int',has_traffic_filtering=True,id=e3d5b9ac-d641-478c-89cc-acbbf189ee2a,network=Network(0d829782-2ea4-4af3-8460-468b818423dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3d5b9ac-d6') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:55:09 user nova-compute[71509]: DEBUG nova.objects.instance [None req-b9f99c7f-211e-4d58-af3e-c082518df402 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Lazy-loading 'pci_devices' on Instance uuid 6f41f217-0df2-4205-9633-7dbe83f40c96 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:55:09 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-b9f99c7f-211e-4d58-af3e-c082518df402 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] [instance: 6f41f217-0df2-4205-9633-7dbe83f40c96] End _get_guest_xml xml=<domain type="kvm">
Apr 14 10:55:09 user nova-compute[71509]:   <uuid>6f41f217-0df2-4205-9633-7dbe83f40c96</uuid>
Apr 14 10:55:09 user nova-compute[71509]:   <name>instance-0000001a</name>
Apr 14 10:55:09 user nova-compute[71509]:   <memory>131072</memory>
Apr 14 10:55:09 user nova-compute[71509]:   <vcpu>1</vcpu>
Apr 14 10:55:09 user nova-compute[71509]:   <metadata>
Apr 14 10:55:09 user nova-compute[71509]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 10:55:09 user nova-compute[71509]:       <nova:package version="0.0.0"/>
Apr 14 10:55:09 user nova-compute[71509]:       <nova:name>tempest-ServersNegativeTestJSON-server-1683745900</nova:name>
Apr 14 10:55:09 user nova-compute[71509]:       <nova:creationTime>2023-04-14 10:55:09</nova:creationTime>
Apr 14 10:55:09 user nova-compute[71509]:       <nova:flavor name="m1.nano">
Apr 14 10:55:09 user nova-compute[71509]:         <nova:memory>128</nova:memory>
Apr 14 10:55:09 user nova-compute[71509]:         <nova:disk>1</nova:disk>
Apr 14 10:55:09 user nova-compute[71509]:         <nova:swap>0</nova:swap>
Apr 14 10:55:09 user nova-compute[71509]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 10:55:09 user nova-compute[71509]:         <nova:vcpus>1</nova:vcpus>
Apr 14 10:55:09 user nova-compute[71509]:       </nova:flavor>
Apr 14 10:55:09 user nova-compute[71509]:       <nova:owner>
Apr 14 10:55:09 user nova-compute[71509]:         <nova:user uuid="b3f2157c5d4d441db80ea4a3ca60e4dc">tempest-ServersNegativeTestJSON-1472676568-project-member</nova:user>
Apr 14 10:55:09 user nova-compute[71509]:         <nova:project uuid="be1c0764b8a843808158644eb90704e6">tempest-ServersNegativeTestJSON-1472676568</nova:project>
Apr 14 10:55:09 user nova-compute[71509]:       </nova:owner>
Apr 14 10:55:09 user nova-compute[71509]:       <nova:root type="image" uuid="048ec0ee-0465-448d-8b4c-f072acb101dc"/>
Apr 14 10:55:09 user nova-compute[71509]:       <nova:ports>
Apr 14 10:55:09 user nova-compute[71509]:         <nova:port uuid="e3d5b9ac-d641-478c-89cc-acbbf189ee2a">
Apr 14 10:55:09 user nova-compute[71509]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 14 10:55:09 user nova-compute[71509]:         </nova:port>
Apr 14 10:55:09 user nova-compute[71509]:       </nova:ports>
Apr 14 10:55:09 user nova-compute[71509]:     </nova:instance>
Apr 14 10:55:09 user nova-compute[71509]:   </metadata>
Apr 14 10:55:09 user nova-compute[71509]:   <sysinfo type="smbios">
Apr 14 10:55:09 user nova-compute[71509]:     <system>
Apr 14 10:55:09 user nova-compute[71509]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 10:55:09 user nova-compute[71509]:       <entry name="product">OpenStack Nova</entry>
Apr 14 10:55:09 user nova-compute[71509]:       <entry name="version">0.0.0</entry>
Apr 14 10:55:09 user nova-compute[71509]:       <entry name="serial">6f41f217-0df2-4205-9633-7dbe83f40c96</entry>
Apr 14 10:55:09 user nova-compute[71509]:       <entry name="uuid">6f41f217-0df2-4205-9633-7dbe83f40c96</entry>
Apr 14 10:55:09 user nova-compute[71509]:       <entry name="family">Virtual Machine</entry>
Apr 14 10:55:09 user nova-compute[71509]:     </system>
Apr 14 10:55:09 user nova-compute[71509]:   </sysinfo>
Apr 14 10:55:09 user nova-compute[71509]:   <os>
Apr 14 10:55:09 user nova-compute[71509]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 10:55:09 user nova-compute[71509]:     <boot dev="hd"/>
Apr 14 10:55:09 user nova-compute[71509]:     <smbios mode="sysinfo"/>
Apr 14 10:55:09 user nova-compute[71509]:   </os>
Apr 14 10:55:09 user nova-compute[71509]:   <features>
Apr 14 10:55:09 user nova-compute[71509]:     <acpi/>
Apr 14 10:55:09 user nova-compute[71509]:     <apic/>
Apr 14 10:55:09 user nova-compute[71509]:     <vmcoreinfo/>
Apr 14 10:55:09 user nova-compute[71509]:   </features>
Apr 14 10:55:09 user nova-compute[71509]:   <clock offset="utc">
Apr 14 10:55:09 user nova-compute[71509]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 10:55:09 user nova-compute[71509]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 10:55:09 user nova-compute[71509]:     <timer name="hpet" present="no"/>
Apr 14 10:55:09 user nova-compute[71509]:   </clock>
Apr 14 10:55:09 user nova-compute[71509]:   <cpu mode="custom" match="exact">
Apr 14 10:55:09 user nova-compute[71509]:     <model>Nehalem</model>
Apr 14 10:55:09 user nova-compute[71509]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 10:55:09 user nova-compute[71509]:   </cpu>
Apr 14 10:55:09 user nova-compute[71509]:   <devices>
Apr 14 10:55:09 user nova-compute[71509]:     <disk type="file" device="disk">
Apr 14 10:55:09 user nova-compute[71509]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 10:55:09 user nova-compute[71509]:       <source file="/opt/stack/data/nova/instances/6f41f217-0df2-4205-9633-7dbe83f40c96/disk"/>
Apr 14 10:55:09 user nova-compute[71509]:       <target dev="vda" bus="virtio"/>
Apr 14 10:55:09 user nova-compute[71509]:     </disk>
Apr 14 10:55:09 user nova-compute[71509]:     <interface type="ethernet">
Apr 14 10:55:09 user nova-compute[71509]:       <mac address="fa:16:3e:2d:5c:30"/>
Apr 14 10:55:09 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 10:55:09 user nova-compute[71509]:       <mtu size="1442"/>
Apr 14 10:55:09 user nova-compute[71509]:       <target dev="tape3d5b9ac-d6"/>
Apr 14 10:55:09 user nova-compute[71509]:     </interface>
Apr 14 10:55:09 user nova-compute[71509]:     <serial type="pty">
Apr 14 10:55:09 user nova-compute[71509]:       <log file="/opt/stack/data/nova/instances/6f41f217-0df2-4205-9633-7dbe83f40c96/console.log" append="off"/>
Apr 14 10:55:09 user nova-compute[71509]:     </serial>
Apr 14 10:55:09 user nova-compute[71509]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 10:55:09 user nova-compute[71509]:     <video>
Apr 14 10:55:09 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 10:55:09 user nova-compute[71509]:     </video>
Apr 14 10:55:09 user nova-compute[71509]:     <rng model="virtio">
Apr 14 10:55:09 user nova-compute[71509]:       <backend model="random">/dev/urandom</backend>
Apr 14 10:55:09 user nova-compute[71509]:     </rng>
Apr 14 10:55:09 user nova-compute[71509]:     <controller type="usb" index="0" model="none"/>
Apr 14 10:55:09 user nova-compute[71509]:     <memballoon model="virtio">
Apr 14 10:55:09 user nova-compute[71509]:       <stats period="10"/>
Apr 14 10:55:09 user nova-compute[71509]:     </memballoon>
Apr 14 10:55:09 user nova-compute[71509]:   </devices>
Apr 14 10:55:09 user nova-compute[71509]: </domain>
Apr 14 10:55:09 user nova-compute[71509]:  {{(pid=71509) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 10:55:09 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-b9f99c7f-211e-4d58-af3e-c082518df402 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T10:55:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1683745900',display_name='tempest-ServersNegativeTestJSON-server-1683745900',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1683745900',id=26,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='be1c0764b8a843808158644eb90704e6',ramdisk_id='',reservation_id='r-cr5mkbrz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1472676568',owner_user_name='tempest-ServersNegativeTestJSON-1472676568-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T10:55:06Z,user_data=None,user_id='b3f2157c5d4d441db80ea4a3ca60e4dc',uuid=6f41f217-0df2-4205-9633-7dbe83f40c96,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e3d5b9ac-d641-478c-89cc-acbbf189ee2a", "address": "fa:16:3e:2d:5c:30", "network": {"id": "0d829782-2ea4-4af3-8460-468b818423dc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2082561441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be1c0764b8a843808158644eb90704e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3d5b9ac-d6", "ovs_interfaceid": "e3d5b9ac-d641-478c-89cc-acbbf189ee2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 10:55:09 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-b9f99c7f-211e-4d58-af3e-c082518df402 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Converting VIF {"id": "e3d5b9ac-d641-478c-89cc-acbbf189ee2a", "address": "fa:16:3e:2d:5c:30", "network": {"id": "0d829782-2ea4-4af3-8460-468b818423dc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2082561441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be1c0764b8a843808158644eb90704e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3d5b9ac-d6", "ovs_interfaceid": "e3d5b9ac-d641-478c-89cc-acbbf189ee2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:55:09 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-b9f99c7f-211e-4d58-af3e-c082518df402 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:5c:30,bridge_name='br-int',has_traffic_filtering=True,id=e3d5b9ac-d641-478c-89cc-acbbf189ee2a,network=Network(0d829782-2ea4-4af3-8460-468b818423dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3d5b9ac-d6') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:55:09 user nova-compute[71509]: DEBUG os_vif [None req-b9f99c7f-211e-4d58-af3e-c082518df402 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:5c:30,bridge_name='br-int',has_traffic_filtering=True,id=e3d5b9ac-d641-478c-89cc-acbbf189ee2a,network=Network(0d829782-2ea4-4af3-8460-468b818423dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3d5b9ac-d6') {{(pid=71509) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 10:55:09 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:55:09 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:55:09 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 10:55:09 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:55:09 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape3d5b9ac-d6, may_exist=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:55:09 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape3d5b9ac-d6, col_values=(('external_ids', {'iface-id': 'e3d5b9ac-d641-478c-89cc-acbbf189ee2a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2d:5c:30', 'vm-uuid': '6f41f217-0df2-4205-9633-7dbe83f40c96'}),)) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:55:09 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:55:09 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 10:55:09 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:55:09 user nova-compute[71509]: INFO os_vif [None req-b9f99c7f-211e-4d58-af3e-c082518df402 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:5c:30,bridge_name='br-int',has_traffic_filtering=True,id=e3d5b9ac-d641-478c-89cc-acbbf189ee2a,network=Network(0d829782-2ea4-4af3-8460-468b818423dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3d5b9ac-d6')
Apr 14 10:55:09 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:55:09 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Instance destroyed successfully.
Apr 14 10:55:09 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-b9f99c7f-211e-4d58-af3e-c082518df402 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] No BDM found with device name vda, not building metadata. {{(pid=71509) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 10:55:09 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-b9f99c7f-211e-4d58-af3e-c082518df402 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] No VIF found with MAC fa:16:3e:2d:5c:30, not building metadata {{(pid=71509) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 10:55:09 user nova-compute[71509]: DEBUG nova.network.neutron [req-e5d003f8-7a02-49b2-a1ce-a0dccffb7bdb req-14fa95f3-f3d5-4509-94c1-5c1b5a8dd6bd service nova] [instance: 6f41f217-0df2-4205-9633-7dbe83f40c96] Updated VIF entry in instance network info cache for port e3d5b9ac-d641-478c-89cc-acbbf189ee2a. {{(pid=71509) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 10:55:09 user nova-compute[71509]: DEBUG nova.network.neutron [req-e5d003f8-7a02-49b2-a1ce-a0dccffb7bdb req-14fa95f3-f3d5-4509-94c1-5c1b5a8dd6bd service nova] [instance: 6f41f217-0df2-4205-9633-7dbe83f40c96] Updating instance_info_cache with network_info: [{"id": "e3d5b9ac-d641-478c-89cc-acbbf189ee2a", "address": "fa:16:3e:2d:5c:30", "network": {"id": "0d829782-2ea4-4af3-8460-468b818423dc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2082561441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be1c0764b8a843808158644eb90704e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3d5b9ac-d6", "ovs_interfaceid": "e3d5b9ac-d641-478c-89cc-acbbf189ee2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:55:09 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-e5d003f8-7a02-49b2-a1ce-a0dccffb7bdb req-14fa95f3-f3d5-4509-94c1-5c1b5a8dd6bd service nova] Releasing lock "refresh_cache-6f41f217-0df2-4205-9633-7dbe83f40c96" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:55:09 user nova-compute[71509]: DEBUG nova.compute.manager [req-70e142b0-e4c7-42bf-9a8d-18bf78ab430e req-10ef22ca-b10d-4779-88d6-7020d14b5481 service nova] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Received event network-vif-plugged-473d9af8-25a0-4e5a-9afb-7a0c843115cc {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:55:09 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-70e142b0-e4c7-42bf-9a8d-18bf78ab430e req-10ef22ca-b10d-4779-88d6-7020d14b5481 service nova] Acquiring lock "8586a70e-9855-4177-ac1b-cf707a4df871-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:55:09 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-70e142b0-e4c7-42bf-9a8d-18bf78ab430e req-10ef22ca-b10d-4779-88d6-7020d14b5481 service nova] Lock "8586a70e-9855-4177-ac1b-cf707a4df871-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:55:09 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-70e142b0-e4c7-42bf-9a8d-18bf78ab430e req-10ef22ca-b10d-4779-88d6-7020d14b5481 service nova] Lock "8586a70e-9855-4177-ac1b-cf707a4df871-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:55:10 user nova-compute[71509]: DEBUG nova.compute.manager [req-70e142b0-e4c7-42bf-9a8d-18bf78ab430e req-10ef22ca-b10d-4779-88d6-7020d14b5481 service nova] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] No waiting events found dispatching network-vif-plugged-473d9af8-25a0-4e5a-9afb-7a0c843115cc {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:55:10 user nova-compute[71509]: WARNING nova.compute.manager [req-70e142b0-e4c7-42bf-9a8d-18bf78ab430e req-10ef22ca-b10d-4779-88d6-7020d14b5481 service nova] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Received unexpected event network-vif-plugged-473d9af8-25a0-4e5a-9afb-7a0c843115cc for instance with vm_state stopped and task_state powering-on.
Apr 14 10:55:10 user nova-compute[71509]: DEBUG nova.compute.manager [req-70e142b0-e4c7-42bf-9a8d-18bf78ab430e req-10ef22ca-b10d-4779-88d6-7020d14b5481 service nova] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Received event network-vif-unplugged-f2196ef3-aada-48d6-b524-5e9cef6a9eda {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:55:10 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-70e142b0-e4c7-42bf-9a8d-18bf78ab430e req-10ef22ca-b10d-4779-88d6-7020d14b5481 service nova] Acquiring lock "d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:55:10 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-70e142b0-e4c7-42bf-9a8d-18bf78ab430e req-10ef22ca-b10d-4779-88d6-7020d14b5481 service nova] Lock "d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:55:10 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-70e142b0-e4c7-42bf-9a8d-18bf78ab430e req-10ef22ca-b10d-4779-88d6-7020d14b5481 service nova] Lock "d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:55:10 user nova-compute[71509]: DEBUG nova.compute.manager [req-70e142b0-e4c7-42bf-9a8d-18bf78ab430e req-10ef22ca-b10d-4779-88d6-7020d14b5481 service nova] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] No waiting events found dispatching network-vif-unplugged-f2196ef3-aada-48d6-b524-5e9cef6a9eda {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:55:10 user nova-compute[71509]: WARNING nova.compute.manager [req-70e142b0-e4c7-42bf-9a8d-18bf78ab430e req-10ef22ca-b10d-4779-88d6-7020d14b5481 service nova] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Received unexpected event network-vif-unplugged-f2196ef3-aada-48d6-b524-5e9cef6a9eda for instance with vm_state rescued and task_state unrescuing.
Apr 14 10:55:10 user nova-compute[71509]: DEBUG nova.compute.manager [req-70e142b0-e4c7-42bf-9a8d-18bf78ab430e req-10ef22ca-b10d-4779-88d6-7020d14b5481 service nova] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Received event network-vif-plugged-f2196ef3-aada-48d6-b524-5e9cef6a9eda {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:55:10 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-70e142b0-e4c7-42bf-9a8d-18bf78ab430e req-10ef22ca-b10d-4779-88d6-7020d14b5481 service nova] Acquiring lock "d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:55:10 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-70e142b0-e4c7-42bf-9a8d-18bf78ab430e req-10ef22ca-b10d-4779-88d6-7020d14b5481 service nova] Lock "d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:55:10 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-70e142b0-e4c7-42bf-9a8d-18bf78ab430e req-10ef22ca-b10d-4779-88d6-7020d14b5481 service nova] Lock "d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:55:10 user nova-compute[71509]: DEBUG nova.compute.manager [req-70e142b0-e4c7-42bf-9a8d-18bf78ab430e req-10ef22ca-b10d-4779-88d6-7020d14b5481 service nova] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] No waiting events found dispatching network-vif-plugged-f2196ef3-aada-48d6-b524-5e9cef6a9eda {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:55:10 user nova-compute[71509]: WARNING nova.compute.manager [req-70e142b0-e4c7-42bf-9a8d-18bf78ab430e req-10ef22ca-b10d-4779-88d6-7020d14b5481 service nova] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Received unexpected event network-vif-plugged-f2196ef3-aada-48d6-b524-5e9cef6a9eda for instance with vm_state rescued and task_state unrescuing.
Apr 14 10:55:10 user nova-compute[71509]: DEBUG nova.compute.manager [None req-67547f87-d0a9-4980-9fa2-7f83bf24957d tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Instance event wait completed in 0 seconds for  {{(pid=71509) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 10:55:10 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681469710.0356596, 8586a70e-9855-4177-ac1b-cf707a4df871 => Resumed> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 10:55:10 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] VM Resumed (Lifecycle Event)
Apr 14 10:55:10 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Instance rebooted successfully.
Apr 14 10:55:10 user nova-compute[71509]: DEBUG nova.compute.manager [None req-67547f87-d0a9-4980-9fa2-7f83bf24957d tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:55:10 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:55:10 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 10:55:10 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] During sync_power_state the instance has a pending task (powering-on). Skip.
Apr 14 10:55:10 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681469710.0358555, 8586a70e-9855-4177-ac1b-cf707a4df871 => Started> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 10:55:10 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] VM Started (Lifecycle Event)
Apr 14 10:55:10 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:55:10 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 10:55:11 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:55:11 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:55:11 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:55:11 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:55:11 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:55:11 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:55:11 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:55:11 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:55:11 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:55:11 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:55:12 user nova-compute[71509]: DEBUG nova.compute.manager [req-69cecfa6-7e8d-48d4-9cf6-05ff22b29c0a req-83b41a83-a09d-4a10-9f03-812614f2dd63 service nova] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] Received event network-changed-1a142b11-f1ec-41d4-9728-f9f0de9a96ff {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:55:12 user nova-compute[71509]: DEBUG nova.compute.manager [req-69cecfa6-7e8d-48d4-9cf6-05ff22b29c0a req-83b41a83-a09d-4a10-9f03-812614f2dd63 service nova] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] Refreshing instance network info cache due to event network-changed-1a142b11-f1ec-41d4-9728-f9f0de9a96ff. {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 10:55:12 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-69cecfa6-7e8d-48d4-9cf6-05ff22b29c0a req-83b41a83-a09d-4a10-9f03-812614f2dd63 service nova] Acquiring lock "refresh_cache-fe152ebd-4f99-4fa8-bfdb-8744cdf3f387" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:55:12 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-69cecfa6-7e8d-48d4-9cf6-05ff22b29c0a req-83b41a83-a09d-4a10-9f03-812614f2dd63 service nova] Acquired lock "refresh_cache-fe152ebd-4f99-4fa8-bfdb-8744cdf3f387" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:55:12 user nova-compute[71509]: DEBUG nova.network.neutron [req-69cecfa6-7e8d-48d4-9cf6-05ff22b29c0a req-83b41a83-a09d-4a10-9f03-812614f2dd63 service nova] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] Refreshing network info cache for port 1a142b11-f1ec-41d4-9728-f9f0de9a96ff {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 10:55:12 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:55:12 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:55:12 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:55:12 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:55:13 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:55:13 user nova-compute[71509]: DEBUG nova.network.neutron [req-69cecfa6-7e8d-48d4-9cf6-05ff22b29c0a req-83b41a83-a09d-4a10-9f03-812614f2dd63 service nova] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] Updated VIF entry in instance network info cache for port 1a142b11-f1ec-41d4-9728-f9f0de9a96ff. {{(pid=71509) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 10:55:13 user nova-compute[71509]: DEBUG nova.network.neutron [req-69cecfa6-7e8d-48d4-9cf6-05ff22b29c0a req-83b41a83-a09d-4a10-9f03-812614f2dd63 service nova] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] Updating instance_info_cache with network_info: [{"id": "1a142b11-f1ec-41d4-9728-f9f0de9a96ff", "address": "fa:16:3e:96:f1:e3", "network": {"id": "1cb09253-66a4-4c81-82d0-c6d948e0aed4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1557121746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8a9941095d445f48d70df26d8c90e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a142b11-f1", "ovs_interfaceid": "1a142b11-f1ec-41d4-9728-f9f0de9a96ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:55:13 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-69cecfa6-7e8d-48d4-9cf6-05ff22b29c0a req-83b41a83-a09d-4a10-9f03-812614f2dd63 service nova] Releasing lock "refresh_cache-fe152ebd-4f99-4fa8-bfdb-8744cdf3f387" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:55:14 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:55:14 user nova-compute[71509]: DEBUG nova.compute.manager [req-4cb9c959-65b7-412f-b9ae-2207a7805b9e req-12e8aa04-811b-4216-a002-f92f3c6d5af6 service nova] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Received event network-vif-plugged-f2196ef3-aada-48d6-b524-5e9cef6a9eda {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:55:14 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-4cb9c959-65b7-412f-b9ae-2207a7805b9e req-12e8aa04-811b-4216-a002-f92f3c6d5af6 service nova] Acquiring lock "d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:55:14 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-4cb9c959-65b7-412f-b9ae-2207a7805b9e req-12e8aa04-811b-4216-a002-f92f3c6d5af6 service nova] Lock "d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:55:14 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-4cb9c959-65b7-412f-b9ae-2207a7805b9e req-12e8aa04-811b-4216-a002-f92f3c6d5af6 service nova] Lock "d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:55:14 user nova-compute[71509]: DEBUG nova.compute.manager [req-4cb9c959-65b7-412f-b9ae-2207a7805b9e req-12e8aa04-811b-4216-a002-f92f3c6d5af6 service nova] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] No waiting events found dispatching network-vif-plugged-f2196ef3-aada-48d6-b524-5e9cef6a9eda {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:55:14 user nova-compute[71509]: WARNING nova.compute.manager [req-4cb9c959-65b7-412f-b9ae-2207a7805b9e req-12e8aa04-811b-4216-a002-f92f3c6d5af6 service nova] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Received unexpected event network-vif-plugged-f2196ef3-aada-48d6-b524-5e9cef6a9eda for instance with vm_state rescued and task_state unrescuing.
Apr 14 10:55:14 user nova-compute[71509]: DEBUG nova.compute.manager [req-4cb9c959-65b7-412f-b9ae-2207a7805b9e req-12e8aa04-811b-4216-a002-f92f3c6d5af6 service nova] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Received event network-vif-plugged-f2196ef3-aada-48d6-b524-5e9cef6a9eda {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:55:14 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-4cb9c959-65b7-412f-b9ae-2207a7805b9e req-12e8aa04-811b-4216-a002-f92f3c6d5af6 service nova] Acquiring lock "d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:55:14 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-4cb9c959-65b7-412f-b9ae-2207a7805b9e req-12e8aa04-811b-4216-a002-f92f3c6d5af6 service nova] Lock "d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:55:14 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-4cb9c959-65b7-412f-b9ae-2207a7805b9e req-12e8aa04-811b-4216-a002-f92f3c6d5af6 service nova] Lock "d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:55:14 user nova-compute[71509]: DEBUG nova.compute.manager [req-4cb9c959-65b7-412f-b9ae-2207a7805b9e req-12e8aa04-811b-4216-a002-f92f3c6d5af6 service nova] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] No waiting events found dispatching network-vif-plugged-f2196ef3-aada-48d6-b524-5e9cef6a9eda {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:55:14 user nova-compute[71509]: WARNING nova.compute.manager [req-4cb9c959-65b7-412f-b9ae-2207a7805b9e req-12e8aa04-811b-4216-a002-f92f3c6d5af6 service nova] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Received unexpected event network-vif-plugged-f2196ef3-aada-48d6-b524-5e9cef6a9eda for instance with vm_state rescued and task_state unrescuing.
Apr 14 10:55:14 user nova-compute[71509]: DEBUG nova.compute.manager [req-4cb9c959-65b7-412f-b9ae-2207a7805b9e req-12e8aa04-811b-4216-a002-f92f3c6d5af6 service nova] [instance: 6f41f217-0df2-4205-9633-7dbe83f40c96] Received event network-vif-plugged-e3d5b9ac-d641-478c-89cc-acbbf189ee2a {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:55:14 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-4cb9c959-65b7-412f-b9ae-2207a7805b9e req-12e8aa04-811b-4216-a002-f92f3c6d5af6 service nova] Acquiring lock "6f41f217-0df2-4205-9633-7dbe83f40c96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:55:14 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-4cb9c959-65b7-412f-b9ae-2207a7805b9e req-12e8aa04-811b-4216-a002-f92f3c6d5af6 service nova] Lock "6f41f217-0df2-4205-9633-7dbe83f40c96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:55:14 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-4cb9c959-65b7-412f-b9ae-2207a7805b9e req-12e8aa04-811b-4216-a002-f92f3c6d5af6 service nova] Lock "6f41f217-0df2-4205-9633-7dbe83f40c96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:55:14 user nova-compute[71509]: DEBUG nova.compute.manager [req-4cb9c959-65b7-412f-b9ae-2207a7805b9e req-12e8aa04-811b-4216-a002-f92f3c6d5af6 service nova] [instance: 6f41f217-0df2-4205-9633-7dbe83f40c96] No waiting events found dispatching network-vif-plugged-e3d5b9ac-d641-478c-89cc-acbbf189ee2a {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:55:14 user nova-compute[71509]: WARNING nova.compute.manager [req-4cb9c959-65b7-412f-b9ae-2207a7805b9e req-12e8aa04-811b-4216-a002-f92f3c6d5af6 service nova] [instance: 6f41f217-0df2-4205-9633-7dbe83f40c96] Received unexpected event network-vif-plugged-e3d5b9ac-d641-478c-89cc-acbbf189ee2a for instance with vm_state building and task_state spawning.
Apr 14 10:55:14 user nova-compute[71509]: DEBUG nova.compute.manager [req-4cb9c959-65b7-412f-b9ae-2207a7805b9e req-12e8aa04-811b-4216-a002-f92f3c6d5af6 service nova] [instance: 6f41f217-0df2-4205-9633-7dbe83f40c96] Received event network-vif-plugged-e3d5b9ac-d641-478c-89cc-acbbf189ee2a {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:55:14 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-4cb9c959-65b7-412f-b9ae-2207a7805b9e req-12e8aa04-811b-4216-a002-f92f3c6d5af6 service nova] Acquiring lock "6f41f217-0df2-4205-9633-7dbe83f40c96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:55:14 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-4cb9c959-65b7-412f-b9ae-2207a7805b9e req-12e8aa04-811b-4216-a002-f92f3c6d5af6 service nova] Lock "6f41f217-0df2-4205-9633-7dbe83f40c96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:55:14 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-4cb9c959-65b7-412f-b9ae-2207a7805b9e req-12e8aa04-811b-4216-a002-f92f3c6d5af6 service nova] Lock "6f41f217-0df2-4205-9633-7dbe83f40c96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:55:14 user nova-compute[71509]: DEBUG nova.compute.manager [req-4cb9c959-65b7-412f-b9ae-2207a7805b9e req-12e8aa04-811b-4216-a002-f92f3c6d5af6 service nova] [instance: 6f41f217-0df2-4205-9633-7dbe83f40c96] No waiting events found dispatching network-vif-plugged-e3d5b9ac-d641-478c-89cc-acbbf189ee2a {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:55:14 user nova-compute[71509]: WARNING nova.compute.manager [req-4cb9c959-65b7-412f-b9ae-2207a7805b9e req-12e8aa04-811b-4216-a002-f92f3c6d5af6 service nova] [instance: 6f41f217-0df2-4205-9633-7dbe83f40c96] Received unexpected event network-vif-plugged-e3d5b9ac-d641-478c-89cc-acbbf189ee2a for instance with vm_state building and task_state spawning.
Apr 14 10:55:14 user nova-compute[71509]: DEBUG nova.virt.libvirt.host [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Removed pending event for d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5 due to event {{(pid=71509) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 10:55:14 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681469714.667822, d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5 => Resumed> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 10:55:14 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] VM Resumed (Lifecycle Event)
Apr 14 10:55:14 user nova-compute[71509]: DEBUG nova.compute.manager [None req-b9f99c7f-211e-4d58-af3e-c082518df402 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] [instance: 6f41f217-0df2-4205-9633-7dbe83f40c96] Instance event wait completed in 0 seconds for  {{(pid=71509) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 10:55:14 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-b9f99c7f-211e-4d58-af3e-c082518df402 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] [instance: 6f41f217-0df2-4205-9633-7dbe83f40c96] Guest created on hypervisor {{(pid=71509) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 10:55:14 user nova-compute[71509]: DEBUG nova.compute.manager [None req-a8b665eb-426c-4502-9490-283d9c28f70a tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:55:14 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: 6f41f217-0df2-4205-9633-7dbe83f40c96] Instance spawned successfully.
Apr 14 10:55:14 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-b9f99c7f-211e-4d58-af3e-c082518df402 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] [instance: 6f41f217-0df2-4205-9633-7dbe83f40c96] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 10:55:14 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:55:14 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 10:55:14 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 14 10:55:14 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681469714.6680002, 6f41f217-0df2-4205-9633-7dbe83f40c96 => Resumed> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 10:55:14 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 6f41f217-0df2-4205-9633-7dbe83f40c96] VM Resumed (Lifecycle Event)
Apr 14 10:55:14 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-b9f99c7f-211e-4d58-af3e-c082518df402 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] [instance: 6f41f217-0df2-4205-9633-7dbe83f40c96] Found default for hw_cdrom_bus of ide {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:55:14 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-b9f99c7f-211e-4d58-af3e-c082518df402 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] [instance: 6f41f217-0df2-4205-9633-7dbe83f40c96] Found default for hw_disk_bus of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:55:14 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-b9f99c7f-211e-4d58-af3e-c082518df402 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] [instance: 6f41f217-0df2-4205-9633-7dbe83f40c96] Found default for hw_input_bus of None {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:55:14 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-b9f99c7f-211e-4d58-af3e-c082518df402 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] [instance: 6f41f217-0df2-4205-9633-7dbe83f40c96] Found default for hw_pointer_model of None {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:55:14 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-b9f99c7f-211e-4d58-af3e-c082518df402 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] [instance: 6f41f217-0df2-4205-9633-7dbe83f40c96] Found default for hw_video_model of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:55:14 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-b9f99c7f-211e-4d58-af3e-c082518df402 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] [instance: 6f41f217-0df2-4205-9633-7dbe83f40c96] Found default for hw_vif_model of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:55:14 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 6f41f217-0df2-4205-9633-7dbe83f40c96] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:55:14 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 6f41f217-0df2-4205-9633-7dbe83f40c96] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 10:55:14 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-91553644-31b5-426c-b97c-a0ea10cd27b4 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Acquiring lock "fe152ebd-4f99-4fa8-bfdb-8744cdf3f387" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:55:14 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-91553644-31b5-426c-b97c-a0ea10cd27b4 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "fe152ebd-4f99-4fa8-bfdb-8744cdf3f387" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:55:14 user nova-compute[71509]: INFO nova.compute.manager [None req-91553644-31b5-426c-b97c-a0ea10cd27b4 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] Shelving
Apr 14 10:55:14 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 6f41f217-0df2-4205-9633-7dbe83f40c96] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 10:55:14 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681469714.6694932, d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5 => Started> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 10:55:14 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] VM Started (Lifecycle Event)
Apr 14 10:55:14 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:55:14 user nova-compute[71509]: INFO nova.compute.manager [None req-b9f99c7f-211e-4d58-af3e-c082518df402 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] [instance: 6f41f217-0df2-4205-9633-7dbe83f40c96] Took 8.81 seconds to spawn the instance on the hypervisor.
Apr 14 10:55:14 user nova-compute[71509]: DEBUG nova.compute.manager [None req-b9f99c7f-211e-4d58-af3e-c082518df402 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] [instance: 6f41f217-0df2-4205-9633-7dbe83f40c96] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:55:14 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 10:55:14 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681469714.67296, 6f41f217-0df2-4205-9633-7dbe83f40c96 => Started> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 10:55:14 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 6f41f217-0df2-4205-9633-7dbe83f40c96] VM Started (Lifecycle Event)
Apr 14 10:55:14 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:55:14 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 6f41f217-0df2-4205-9633-7dbe83f40c96] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:55:14 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:55:14 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 6f41f217-0df2-4205-9633-7dbe83f40c96] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 10:55:14 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 6f41f217-0df2-4205-9633-7dbe83f40c96] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 10:55:14 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:55:14 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:55:14 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:55:14 user nova-compute[71509]: INFO nova.compute.manager [None req-b9f99c7f-211e-4d58-af3e-c082518df402 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] [instance: 6f41f217-0df2-4205-9633-7dbe83f40c96] Took 9.68 seconds to build instance.
Apr 14 10:55:15 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-b9f99c7f-211e-4d58-af3e-c082518df402 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Lock "6f41f217-0df2-4205-9633-7dbe83f40c96" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.774s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:55:15 user nova-compute[71509]: DEBUG nova.compute.manager [req-9a304502-a843-4c48-998b-9668d481b308 req-2a301011-1b4b-4f0d-a9bf-f685416d1637 service nova] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] Received event network-vif-unplugged-1a142b11-f1ec-41d4-9728-f9f0de9a96ff {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:55:15 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-9a304502-a843-4c48-998b-9668d481b308 req-2a301011-1b4b-4f0d-a9bf-f685416d1637 service nova] Acquiring lock "fe152ebd-4f99-4fa8-bfdb-8744cdf3f387-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:55:15 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-9a304502-a843-4c48-998b-9668d481b308 req-2a301011-1b4b-4f0d-a9bf-f685416d1637 service nova] Lock "fe152ebd-4f99-4fa8-bfdb-8744cdf3f387-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:55:15 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-9a304502-a843-4c48-998b-9668d481b308 req-2a301011-1b4b-4f0d-a9bf-f685416d1637 service nova] Lock "fe152ebd-4f99-4fa8-bfdb-8744cdf3f387-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:55:15 user nova-compute[71509]: DEBUG nova.compute.manager [req-9a304502-a843-4c48-998b-9668d481b308 req-2a301011-1b4b-4f0d-a9bf-f685416d1637 service nova] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] No waiting events found dispatching network-vif-unplugged-1a142b11-f1ec-41d4-9728-f9f0de9a96ff {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:55:15 user nova-compute[71509]: WARNING nova.compute.manager [req-9a304502-a843-4c48-998b-9668d481b308 req-2a301011-1b4b-4f0d-a9bf-f685416d1637 service nova] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] Received unexpected event network-vif-unplugged-1a142b11-f1ec-41d4-9728-f9f0de9a96ff for instance with vm_state active and task_state shelving.
Apr 14 10:55:15 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:55:15 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:55:15 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] Instance destroyed successfully.
Apr 14 10:55:15 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-91553644-31b5-426c-b97c-a0ea10cd27b4 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] Beginning cold snapshot process
Apr 14 10:55:15 user nova-compute[71509]: DEBUG nova.privsep.utils [None req-91553644-31b5-426c-b97c-a0ea10cd27b4 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71509) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 10:55:15 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-91553644-31b5-426c-b97c-a0ea10cd27b4 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/fe152ebd-4f99-4fa8-bfdb-8744cdf3f387/disk /opt/stack/data/nova/instances/snapshots/tmpalqbch17/ea03657d60ea4c6d965e0320ffa1b086 {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:55:16 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-91553644-31b5-426c-b97c-a0ea10cd27b4 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/fe152ebd-4f99-4fa8-bfdb-8744cdf3f387/disk /opt/stack/data/nova/instances/snapshots/tmpalqbch17/ea03657d60ea4c6d965e0320ffa1b086" returned: 0 in 0.627s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:55:16 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-91553644-31b5-426c-b97c-a0ea10cd27b4 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] Snapshot extracted, beginning image upload
Apr 14 10:55:17 user nova-compute[71509]: DEBUG nova.compute.manager [req-2ef1c403-0ad0-4342-8647-fefde4988072 req-0afce026-759a-42ad-99e1-09bd9552e728 service nova] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] Received event network-vif-plugged-1a142b11-f1ec-41d4-9728-f9f0de9a96ff {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:55:17 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-2ef1c403-0ad0-4342-8647-fefde4988072 req-0afce026-759a-42ad-99e1-09bd9552e728 service nova] Acquiring lock "fe152ebd-4f99-4fa8-bfdb-8744cdf3f387-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:55:17 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-2ef1c403-0ad0-4342-8647-fefde4988072 req-0afce026-759a-42ad-99e1-09bd9552e728 service nova] Lock "fe152ebd-4f99-4fa8-bfdb-8744cdf3f387-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:55:17 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-2ef1c403-0ad0-4342-8647-fefde4988072 req-0afce026-759a-42ad-99e1-09bd9552e728 service nova] Lock "fe152ebd-4f99-4fa8-bfdb-8744cdf3f387-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:55:17 user nova-compute[71509]: DEBUG nova.compute.manager [req-2ef1c403-0ad0-4342-8647-fefde4988072 req-0afce026-759a-42ad-99e1-09bd9552e728 service nova] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] No waiting events found dispatching network-vif-plugged-1a142b11-f1ec-41d4-9728-f9f0de9a96ff {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:55:17 user nova-compute[71509]: WARNING nova.compute.manager [req-2ef1c403-0ad0-4342-8647-fefde4988072 req-0afce026-759a-42ad-99e1-09bd9552e728 service nova] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] Received unexpected event network-vif-plugged-1a142b11-f1ec-41d4-9728-f9f0de9a96ff for instance with vm_state active and task_state shelving_image_uploading.
Apr 14 10:55:18 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:55:18 user nova-compute[71509]: DEBUG nova.compute.manager [req-d7a58c1f-6472-430f-ba47-5686282d143e req-574728ec-26fe-40dc-b384-7c95abf294a7 service nova] [instance: 3393be13-7d81-48da-b6dd-a427e8403b22] Received event network-changed-5c5720ce-d39a-4676-9116-0e5adf24d40f {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:55:18 user nova-compute[71509]: DEBUG nova.compute.manager [req-d7a58c1f-6472-430f-ba47-5686282d143e req-574728ec-26fe-40dc-b384-7c95abf294a7 service nova] [instance: 3393be13-7d81-48da-b6dd-a427e8403b22] Refreshing instance network info cache due to event network-changed-5c5720ce-d39a-4676-9116-0e5adf24d40f. {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 10:55:18 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-d7a58c1f-6472-430f-ba47-5686282d143e req-574728ec-26fe-40dc-b384-7c95abf294a7 service nova] Acquiring lock "refresh_cache-3393be13-7d81-48da-b6dd-a427e8403b22" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:55:18 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-d7a58c1f-6472-430f-ba47-5686282d143e req-574728ec-26fe-40dc-b384-7c95abf294a7 service nova] Acquired lock "refresh_cache-3393be13-7d81-48da-b6dd-a427e8403b22" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:55:18 user nova-compute[71509]: DEBUG nova.network.neutron [req-d7a58c1f-6472-430f-ba47-5686282d143e req-574728ec-26fe-40dc-b384-7c95abf294a7 service nova] [instance: 3393be13-7d81-48da-b6dd-a427e8403b22] Refreshing network info cache for port 5c5720ce-d39a-4676-9116-0e5adf24d40f {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 10:55:18 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-82400794-2a1c-4819-bbd4-d5545d062f13 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "3393be13-7d81-48da-b6dd-a427e8403b22" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:55:18 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-82400794-2a1c-4819-bbd4-d5545d062f13 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "3393be13-7d81-48da-b6dd-a427e8403b22" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:55:18 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-82400794-2a1c-4819-bbd4-d5545d062f13 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "3393be13-7d81-48da-b6dd-a427e8403b22-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:55:18 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-82400794-2a1c-4819-bbd4-d5545d062f13 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "3393be13-7d81-48da-b6dd-a427e8403b22-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:55:18 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-82400794-2a1c-4819-bbd4-d5545d062f13 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "3393be13-7d81-48da-b6dd-a427e8403b22-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:55:18 user nova-compute[71509]: INFO nova.compute.manager [None req-82400794-2a1c-4819-bbd4-d5545d062f13 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: 3393be13-7d81-48da-b6dd-a427e8403b22] Terminating instance
Apr 14 10:55:18 user nova-compute[71509]: DEBUG nova.compute.manager [None req-82400794-2a1c-4819-bbd4-d5545d062f13 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: 3393be13-7d81-48da-b6dd-a427e8403b22] Start destroying the instance on the hypervisor. {{(pid=71509) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 10:55:18 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:55:18 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-0d5605e9-fe30-4aad-8b3d-16b54e79ef4f tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Acquiring lock "e6580716-8a6a-4dfa-8978-ed54b92af1fe" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:55:18 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-0d5605e9-fe30-4aad-8b3d-16b54e79ef4f tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "e6580716-8a6a-4dfa-8978-ed54b92af1fe" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:55:18 user nova-compute[71509]: DEBUG nova.compute.manager [None req-0d5605e9-fe30-4aad-8b3d-16b54e79ef4f tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] [instance: e6580716-8a6a-4dfa-8978-ed54b92af1fe] Starting instance... {{(pid=71509) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 10:55:18 user nova-compute[71509]: DEBUG nova.network.neutron [req-d7a58c1f-6472-430f-ba47-5686282d143e req-574728ec-26fe-40dc-b384-7c95abf294a7 service nova] [instance: 3393be13-7d81-48da-b6dd-a427e8403b22] Updated VIF entry in instance network info cache for port 5c5720ce-d39a-4676-9116-0e5adf24d40f. {{(pid=71509) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 10:55:18 user nova-compute[71509]: DEBUG nova.network.neutron [req-d7a58c1f-6472-430f-ba47-5686282d143e req-574728ec-26fe-40dc-b384-7c95abf294a7 service nova] [instance: 3393be13-7d81-48da-b6dd-a427e8403b22] Updating instance_info_cache with network_info: [{"id": "5c5720ce-d39a-4676-9116-0e5adf24d40f", "address": "fa:16:3e:68:2b:29", "network": {"id": "b639a68a-2b4e-435c-b98b-65b5b4981c73", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1070821894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb8f294f957f4c74ae959c1e9f238427", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c5720ce-d3", "ovs_interfaceid": "5c5720ce-d39a-4676-9116-0e5adf24d40f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:55:18 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-d7a58c1f-6472-430f-ba47-5686282d143e req-574728ec-26fe-40dc-b384-7c95abf294a7 service nova] Releasing lock "refresh_cache-3393be13-7d81-48da-b6dd-a427e8403b22" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:55:18 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-0d5605e9-fe30-4aad-8b3d-16b54e79ef4f tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:55:18 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-0d5605e9-fe30-4aad-8b3d-16b54e79ef4f tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:55:18 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-0d5605e9-fe30-4aad-8b3d-16b54e79ef4f tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71509) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 10:55:18 user nova-compute[71509]: INFO nova.compute.claims [None req-0d5605e9-fe30-4aad-8b3d-16b54e79ef4f tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] [instance: e6580716-8a6a-4dfa-8978-ed54b92af1fe] Claim successful on node user
Apr 14 10:55:19 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:55:19 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:55:19 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:55:19 user nova-compute[71509]: DEBUG nova.compute.manager [req-1120ea9f-db2d-4abf-93f3-708634c0ac22 req-9c574a79-dc83-40af-bf6e-5e4c69021a72 service nova] [instance: 3393be13-7d81-48da-b6dd-a427e8403b22] Received event network-vif-unplugged-5c5720ce-d39a-4676-9116-0e5adf24d40f {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:55:19 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-1120ea9f-db2d-4abf-93f3-708634c0ac22 req-9c574a79-dc83-40af-bf6e-5e4c69021a72 service nova] Acquiring lock "3393be13-7d81-48da-b6dd-a427e8403b22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:55:19 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-1120ea9f-db2d-4abf-93f3-708634c0ac22 req-9c574a79-dc83-40af-bf6e-5e4c69021a72 service nova] Lock "3393be13-7d81-48da-b6dd-a427e8403b22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:55:19 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-1120ea9f-db2d-4abf-93f3-708634c0ac22 req-9c574a79-dc83-40af-bf6e-5e4c69021a72 service nova] Lock "3393be13-7d81-48da-b6dd-a427e8403b22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:55:19 user nova-compute[71509]: DEBUG nova.compute.manager [req-1120ea9f-db2d-4abf-93f3-708634c0ac22 req-9c574a79-dc83-40af-bf6e-5e4c69021a72 service nova] [instance: 3393be13-7d81-48da-b6dd-a427e8403b22] No waiting events found dispatching network-vif-unplugged-5c5720ce-d39a-4676-9116-0e5adf24d40f {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:55:19 user nova-compute[71509]: DEBUG nova.compute.manager [req-1120ea9f-db2d-4abf-93f3-708634c0ac22 req-9c574a79-dc83-40af-bf6e-5e4c69021a72 service nova] [instance: 3393be13-7d81-48da-b6dd-a427e8403b22] Received event network-vif-unplugged-5c5720ce-d39a-4676-9116-0e5adf24d40f for instance with task_state deleting. {{(pid=71509) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 10:55:19 user nova-compute[71509]: DEBUG nova.compute.manager [req-1120ea9f-db2d-4abf-93f3-708634c0ac22 req-9c574a79-dc83-40af-bf6e-5e4c69021a72 service nova] [instance: 3393be13-7d81-48da-b6dd-a427e8403b22] Received event network-vif-plugged-5c5720ce-d39a-4676-9116-0e5adf24d40f {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:55:19 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-1120ea9f-db2d-4abf-93f3-708634c0ac22 req-9c574a79-dc83-40af-bf6e-5e4c69021a72 service nova] Acquiring lock "3393be13-7d81-48da-b6dd-a427e8403b22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:55:19 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-1120ea9f-db2d-4abf-93f3-708634c0ac22 req-9c574a79-dc83-40af-bf6e-5e4c69021a72 service nova] Lock "3393be13-7d81-48da-b6dd-a427e8403b22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:55:19 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-1120ea9f-db2d-4abf-93f3-708634c0ac22 req-9c574a79-dc83-40af-bf6e-5e4c69021a72 service nova] Lock "3393be13-7d81-48da-b6dd-a427e8403b22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:55:19 user nova-compute[71509]: DEBUG nova.compute.manager [req-1120ea9f-db2d-4abf-93f3-708634c0ac22 req-9c574a79-dc83-40af-bf6e-5e4c69021a72 service nova] [instance: 3393be13-7d81-48da-b6dd-a427e8403b22] No waiting events found dispatching network-vif-plugged-5c5720ce-d39a-4676-9116-0e5adf24d40f {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:55:19 user nova-compute[71509]: WARNING nova.compute.manager [req-1120ea9f-db2d-4abf-93f3-708634c0ac22 req-9c574a79-dc83-40af-bf6e-5e4c69021a72 service nova] [instance: 3393be13-7d81-48da-b6dd-a427e8403b22] Received unexpected event network-vif-plugged-5c5720ce-d39a-4676-9116-0e5adf24d40f for instance with vm_state active and task_state deleting.
Apr 14 10:55:19 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: 3393be13-7d81-48da-b6dd-a427e8403b22] Instance destroyed successfully.
Apr 14 10:55:19 user nova-compute[71509]: DEBUG nova.objects.instance [None req-82400794-2a1c-4819-bbd4-d5545d062f13 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lazy-loading 'resources' on Instance uuid 3393be13-7d81-48da-b6dd-a427e8403b22 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:55:19 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-82400794-2a1c-4819-bbd4-d5545d062f13 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T10:53:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1573447995',display_name='tempest-AttachVolumeNegativeTest-server-1573447995',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1573447995',id=25,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBxakvNptBAyP1cjMVTNUR7Y9sIuqqQnSxaFT8xZj4eZ6vJiU+rnz3GVavCxzbNROb7vJOXXsA/chLaRy0bXyzzLXIsm6NEmtgSBCKwqRkZOoqmVz1nPd1tzgRdcn3tDVw==',key_name='tempest-keypair-160863978',keypairs=<?>,launch_index=0,launched_at=2023-04-14T10:53:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cb8f294f957f4c74ae959c1e9f238427',ramdisk_id='',reservation_id='r-lqlutgzh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-531644967',owner_user_name='tempest-AttachVolumeNegativeTest-531644967-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T10:53:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='78adbbdcd10e446daddde754e46309b2',uuid=3393be13-7d81-48da-b6dd-a427e8403b22,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5c5720ce-d39a-4676-9116-0e5adf24d40f", "address": "fa:16:3e:68:2b:29", "network": {"id": "b639a68a-2b4e-435c-b98b-65b5b4981c73", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1070821894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb8f294f957f4c74ae959c1e9f238427", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c5720ce-d3", "ovs_interfaceid": "5c5720ce-d39a-4676-9116-0e5adf24d40f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 10:55:19 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-82400794-2a1c-4819-bbd4-d5545d062f13 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Converting VIF {"id": "5c5720ce-d39a-4676-9116-0e5adf24d40f", "address": "fa:16:3e:68:2b:29", "network": {"id": "b639a68a-2b4e-435c-b98b-65b5b4981c73", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1070821894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb8f294f957f4c74ae959c1e9f238427", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c5720ce-d3", "ovs_interfaceid": "5c5720ce-d39a-4676-9116-0e5adf24d40f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:55:19 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-82400794-2a1c-4819-bbd4-d5545d062f13 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:2b:29,bridge_name='br-int',has_traffic_filtering=True,id=5c5720ce-d39a-4676-9116-0e5adf24d40f,network=Network(b639a68a-2b4e-435c-b98b-65b5b4981c73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c5720ce-d3') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:55:19 user nova-compute[71509]: DEBUG os_vif [None req-82400794-2a1c-4819-bbd4-d5545d062f13 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:2b:29,bridge_name='br-int',has_traffic_filtering=True,id=5c5720ce-d39a-4676-9116-0e5adf24d40f,network=Network(b639a68a-2b4e-435c-b98b-65b5b4981c73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c5720ce-d3') {{(pid=71509) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 10:55:19 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:55:19 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5c5720ce-d3, bridge=br-int, if_exists=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:55:19 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:55:19 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 10:55:19 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:55:19 user nova-compute[71509]: INFO os_vif [None req-82400794-2a1c-4819-bbd4-d5545d062f13 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:2b:29,bridge_name='br-int',has_traffic_filtering=True,id=5c5720ce-d39a-4676-9116-0e5adf24d40f,network=Network(b639a68a-2b4e-435c-b98b-65b5b4981c73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c5720ce-d3')
Apr 14 10:55:19 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-82400794-2a1c-4819-bbd4-d5545d062f13 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: 3393be13-7d81-48da-b6dd-a427e8403b22] Deleting instance files /opt/stack/data/nova/instances/3393be13-7d81-48da-b6dd-a427e8403b22_del
Apr 14 10:55:19 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-82400794-2a1c-4819-bbd4-d5545d062f13 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: 3393be13-7d81-48da-b6dd-a427e8403b22] Deletion of /opt/stack/data/nova/instances/3393be13-7d81-48da-b6dd-a427e8403b22_del complete
Apr 14 10:55:19 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-91553644-31b5-426c-b97c-a0ea10cd27b4 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] Snapshot image upload complete
Apr 14 10:55:19 user nova-compute[71509]: DEBUG nova.compute.manager [None req-91553644-31b5-426c-b97c-a0ea10cd27b4 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:55:19 user nova-compute[71509]: INFO nova.compute.manager [None req-82400794-2a1c-4819-bbd4-d5545d062f13 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: 3393be13-7d81-48da-b6dd-a427e8403b22] Took 1.05 seconds to destroy the instance on the hypervisor.
Apr 14 10:55:19 user nova-compute[71509]: DEBUG oslo.service.loopingcall [None req-82400794-2a1c-4819-bbd4-d5545d062f13 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71509) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 10:55:19 user nova-compute[71509]: DEBUG nova.compute.manager [-] [instance: 3393be13-7d81-48da-b6dd-a427e8403b22] Deallocating network for instance {{(pid=71509) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 10:55:19 user nova-compute[71509]: DEBUG nova.network.neutron [-] [instance: 3393be13-7d81-48da-b6dd-a427e8403b22] deallocate_for_instance() {{(pid=71509) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 10:55:19 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-0d5605e9-fe30-4aad-8b3d-16b54e79ef4f tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 10:55:19 user nova-compute[71509]: INFO nova.compute.manager [None req-91553644-31b5-426c-b97c-a0ea10cd27b4 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] Shelve offloading
Apr 14 10:55:19 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-0d5605e9-fe30-4aad-8b3d-16b54e79ef4f tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 10:55:19 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] Instance destroyed successfully.
Apr 14 10:55:19 user nova-compute[71509]: DEBUG nova.compute.manager [None req-91553644-31b5-426c-b97c-a0ea10cd27b4 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:55:19 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-91553644-31b5-426c-b97c-a0ea10cd27b4 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Acquiring lock "refresh_cache-fe152ebd-4f99-4fa8-bfdb-8744cdf3f387" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:55:19 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-91553644-31b5-426c-b97c-a0ea10cd27b4 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Acquired lock "refresh_cache-fe152ebd-4f99-4fa8-bfdb-8744cdf3f387" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:55:19 user nova-compute[71509]: DEBUG nova.network.neutron [None req-91553644-31b5-426c-b97c-a0ea10cd27b4 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] Building network info cache for instance {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 10:55:19 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-0d5605e9-fe30-4aad-8b3d-16b54e79ef4f tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.785s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:55:19 user nova-compute[71509]: DEBUG nova.compute.manager [None req-0d5605e9-fe30-4aad-8b3d-16b54e79ef4f tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] [instance: e6580716-8a6a-4dfa-8978-ed54b92af1fe] Start building networks asynchronously for instance. {{(pid=71509) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 10:55:19 user nova-compute[71509]: DEBUG nova.compute.manager [None req-0d5605e9-fe30-4aad-8b3d-16b54e79ef4f tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] [instance: e6580716-8a6a-4dfa-8978-ed54b92af1fe] Allocating IP information in the background. {{(pid=71509) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 10:55:19 user nova-compute[71509]: DEBUG nova.network.neutron [None req-0d5605e9-fe30-4aad-8b3d-16b54e79ef4f tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] [instance: e6580716-8a6a-4dfa-8978-ed54b92af1fe] allocate_for_instance() {{(pid=71509) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 10:55:19 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-0d5605e9-fe30-4aad-8b3d-16b54e79ef4f tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] [instance: e6580716-8a6a-4dfa-8978-ed54b92af1fe] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 10:55:19 user nova-compute[71509]: DEBUG nova.compute.manager [None req-0d5605e9-fe30-4aad-8b3d-16b54e79ef4f tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] [instance: e6580716-8a6a-4dfa-8978-ed54b92af1fe] Start building block device mappings for instance. {{(pid=71509) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 10:55:19 user nova-compute[71509]: DEBUG nova.policy [None req-0d5605e9-fe30-4aad-8b3d-16b54e79ef4f tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e3ad6531a67b4be58a195e1208157b0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f629ba0ab8074ed8bb4e59d545b74eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71509) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 10:55:20 user nova-compute[71509]: DEBUG nova.compute.manager [None req-0d5605e9-fe30-4aad-8b3d-16b54e79ef4f tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] [instance: e6580716-8a6a-4dfa-8978-ed54b92af1fe] Start spawning the instance on the hypervisor. {{(pid=71509) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 10:55:20 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-0d5605e9-fe30-4aad-8b3d-16b54e79ef4f tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] [instance: e6580716-8a6a-4dfa-8978-ed54b92af1fe] Creating instance directory {{(pid=71509) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 10:55:20 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-0d5605e9-fe30-4aad-8b3d-16b54e79ef4f tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] [instance: e6580716-8a6a-4dfa-8978-ed54b92af1fe] Creating image(s)
Apr 14 10:55:20 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-0d5605e9-fe30-4aad-8b3d-16b54e79ef4f tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Acquiring lock "/opt/stack/data/nova/instances/e6580716-8a6a-4dfa-8978-ed54b92af1fe/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:55:20 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-0d5605e9-fe30-4aad-8b3d-16b54e79ef4f tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "/opt/stack/data/nova/instances/e6580716-8a6a-4dfa-8978-ed54b92af1fe/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:55:20 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-0d5605e9-fe30-4aad-8b3d-16b54e79ef4f tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "/opt/stack/data/nova/instances/e6580716-8a6a-4dfa-8978-ed54b92af1fe/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.012s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:55:20 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-0d5605e9-fe30-4aad-8b3d-16b54e79ef4f tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:55:20 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-0d5605e9-fe30-4aad-8b3d-16b54e79ef4f tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json" returned: 0 in 0.167s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:55:20 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-0d5605e9-fe30-4aad-8b3d-16b54e79ef4f tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Acquiring lock "5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:55:20 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-0d5605e9-fe30-4aad-8b3d-16b54e79ef4f tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:55:20 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-0d5605e9-fe30-4aad-8b3d-16b54e79ef4f tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:55:20 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-0d5605e9-fe30-4aad-8b3d-16b54e79ef4f tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json" returned: 0 in 0.136s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:55:20 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-0d5605e9-fe30-4aad-8b3d-16b54e79ef4f tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18,backing_fmt=raw /opt/stack/data/nova/instances/e6580716-8a6a-4dfa-8978-ed54b92af1fe/disk 1073741824 {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:55:20 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-0d5605e9-fe30-4aad-8b3d-16b54e79ef4f tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18,backing_fmt=raw /opt/stack/data/nova/instances/e6580716-8a6a-4dfa-8978-ed54b92af1fe/disk 1073741824" returned: 0 in 0.055s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:55:20 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-0d5605e9-fe30-4aad-8b3d-16b54e79ef4f tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.198s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:55:20 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-0d5605e9-fe30-4aad-8b3d-16b54e79ef4f tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:55:20 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-0d5605e9-fe30-4aad-8b3d-16b54e79ef4f tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json" returned: 0 in 0.155s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:55:20 user nova-compute[71509]: DEBUG nova.virt.disk.api [None req-0d5605e9-fe30-4aad-8b3d-16b54e79ef4f tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e6580716-8a6a-4dfa-8978-ed54b92af1fe/disk. size=1073741824 {{(pid=71509) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 10:55:20 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-0d5605e9-fe30-4aad-8b3d-16b54e79ef4f tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6580716-8a6a-4dfa-8978-ed54b92af1fe/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:55:20 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-0d5605e9-fe30-4aad-8b3d-16b54e79ef4f tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6580716-8a6a-4dfa-8978-ed54b92af1fe/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:55:20 user nova-compute[71509]: DEBUG nova.virt.disk.api [None req-0d5605e9-fe30-4aad-8b3d-16b54e79ef4f tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Cannot resize image /opt/stack/data/nova/instances/e6580716-8a6a-4dfa-8978-ed54b92af1fe/disk to a smaller size. {{(pid=71509) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 10:55:20 user nova-compute[71509]: DEBUG nova.objects.instance [None req-0d5605e9-fe30-4aad-8b3d-16b54e79ef4f tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lazy-loading 'migration_context' on Instance uuid e6580716-8a6a-4dfa-8978-ed54b92af1fe {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:55:20 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-0d5605e9-fe30-4aad-8b3d-16b54e79ef4f tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] [instance: e6580716-8a6a-4dfa-8978-ed54b92af1fe] Created local disks {{(pid=71509) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 10:55:20 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-0d5605e9-fe30-4aad-8b3d-16b54e79ef4f tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] [instance: e6580716-8a6a-4dfa-8978-ed54b92af1fe] Ensure instance console log exists: /opt/stack/data/nova/instances/e6580716-8a6a-4dfa-8978-ed54b92af1fe/console.log {{(pid=71509) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 10:55:20 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-0d5605e9-fe30-4aad-8b3d-16b54e79ef4f tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:55:20 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-0d5605e9-fe30-4aad-8b3d-16b54e79ef4f tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:55:20 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-0d5605e9-fe30-4aad-8b3d-16b54e79ef4f tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:55:21 user nova-compute[71509]: DEBUG nova.network.neutron [None req-0d5605e9-fe30-4aad-8b3d-16b54e79ef4f tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] [instance: e6580716-8a6a-4dfa-8978-ed54b92af1fe] Successfully created port: 3019f976-f679-4826-8510-3de34b67807c {{(pid=71509) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 10:55:21 user nova-compute[71509]: DEBUG nova.network.neutron [None req-91553644-31b5-426c-b97c-a0ea10cd27b4 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] Updating instance_info_cache with network_info: [{"id": "1a142b11-f1ec-41d4-9728-f9f0de9a96ff", "address": "fa:16:3e:96:f1:e3", "network": {"id": "1cb09253-66a4-4c81-82d0-c6d948e0aed4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1557121746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8a9941095d445f48d70df26d8c90e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a142b11-f1", "ovs_interfaceid": "1a142b11-f1ec-41d4-9728-f9f0de9a96ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:55:21 user nova-compute[71509]: DEBUG nova.network.neutron [-] [instance: 3393be13-7d81-48da-b6dd-a427e8403b22] Updating instance_info_cache with network_info: [] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:55:21 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-91553644-31b5-426c-b97c-a0ea10cd27b4 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Releasing lock "refresh_cache-fe152ebd-4f99-4fa8-bfdb-8744cdf3f387" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:55:21 user nova-compute[71509]: INFO nova.compute.manager [-] [instance: 3393be13-7d81-48da-b6dd-a427e8403b22] Took 1.54 seconds to deallocate network for instance.
Apr 14 10:55:21 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-82400794-2a1c-4819-bbd4-d5545d062f13 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:55:21 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-82400794-2a1c-4819-bbd4-d5545d062f13 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.005s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:55:21 user nova-compute[71509]: DEBUG nova.compute.manager [req-63d74773-5f4b-4271-9787-e007f5b0ad01 req-fed76f29-4904-4dba-8f42-4d1dddf47eed service nova] [instance: 3393be13-7d81-48da-b6dd-a427e8403b22] Received event network-vif-deleted-5c5720ce-d39a-4676-9116-0e5adf24d40f {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:55:21 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-82400794-2a1c-4819-bbd4-d5545d062f13 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 10:55:21 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-82400794-2a1c-4819-bbd4-d5545d062f13 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 10:55:21 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-82400794-2a1c-4819-bbd4-d5545d062f13 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.511s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:55:21 user nova-compute[71509]: INFO nova.scheduler.client.report [None req-82400794-2a1c-4819-bbd4-d5545d062f13 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Deleted allocations for instance 3393be13-7d81-48da-b6dd-a427e8403b22
Apr 14 10:55:21 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] Instance destroyed successfully.
Apr 14 10:55:21 user nova-compute[71509]: DEBUG nova.objects.instance [None req-91553644-31b5-426c-b97c-a0ea10cd27b4 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lazy-loading 'resources' on Instance uuid fe152ebd-4f99-4fa8-bfdb-8744cdf3f387 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:55:21 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-91553644-31b5-426c-b97c-a0ea10cd27b4 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T10:53:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1556975659',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1556975659',id=24,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFLvBNTxhHSIubw0F7uDtXu3lrC4fQZkREwo5wOypbS5+Ne2y87VyX2V16fNDjYxnAH2TEtOojObi2Pe4MMNu8MWvc1u20HwRd46X6UXa7+BJMSqgQ2sXpyz9M+hNSfjsA==',key_name='tempest-keypair-2083532637',keypairs=<?>,launch_index=0,launched_at=2023-04-14T10:53:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='f8a9941095d445f48d70df26d8c90e6c',ramdisk_id='',reservation_id='r-tlsa2xby',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1250068675',owner_user_name='tempest-AttachVolumeShelveTestJSON-1250068675-project-member',shelved_at='2023-04-14T10:55:19.582584',shelved_host='user',shelved_image_id='87833300-56ce-406c-b6a0-555e2a239c9b'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T10:55:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5afd3930d3a14aff8124a4782ec79870',uuid=fe152ebd-4f99-4fa8-bfdb-8744cdf3f387,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "1a142b11-f1ec-41d4-9728-f9f0de9a96ff", "address": "fa:16:3e:96:f1:e3", "network": {"id": "1cb09253-66a4-4c81-82d0-c6d948e0aed4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1557121746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8a9941095d445f48d70df26d8c90e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a142b11-f1", "ovs_interfaceid": "1a142b11-f1ec-41d4-9728-f9f0de9a96ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 10:55:21 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-91553644-31b5-426c-b97c-a0ea10cd27b4 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Converting VIF {"id": "1a142b11-f1ec-41d4-9728-f9f0de9a96ff", "address": "fa:16:3e:96:f1:e3", "network": {"id": "1cb09253-66a4-4c81-82d0-c6d948e0aed4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1557121746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8a9941095d445f48d70df26d8c90e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a142b11-f1", "ovs_interfaceid": "1a142b11-f1ec-41d4-9728-f9f0de9a96ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:55:21 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-91553644-31b5-426c-b97c-a0ea10cd27b4 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:f1:e3,bridge_name='br-int',has_traffic_filtering=True,id=1a142b11-f1ec-41d4-9728-f9f0de9a96ff,network=Network(1cb09253-66a4-4c81-82d0-c6d948e0aed4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a142b11-f1') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:55:21 user nova-compute[71509]: DEBUG os_vif [None req-91553644-31b5-426c-b97c-a0ea10cd27b4 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:f1:e3,bridge_name='br-int',has_traffic_filtering=True,id=1a142b11-f1ec-41d4-9728-f9f0de9a96ff,network=Network(1cb09253-66a4-4c81-82d0-c6d948e0aed4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a142b11-f1') {{(pid=71509) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 10:55:21 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:55:21 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1a142b11-f1, bridge=br-int, if_exists=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:55:21 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:55:21 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 10:55:21 user nova-compute[71509]: INFO os_vif [None req-91553644-31b5-426c-b97c-a0ea10cd27b4 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:f1:e3,bridge_name='br-int',has_traffic_filtering=True,id=1a142b11-f1ec-41d4-9728-f9f0de9a96ff,network=Network(1cb09253-66a4-4c81-82d0-c6d948e0aed4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a142b11-f1')
Apr 14 10:55:21 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-91553644-31b5-426c-b97c-a0ea10cd27b4 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] Deleting instance files /opt/stack/data/nova/instances/fe152ebd-4f99-4fa8-bfdb-8744cdf3f387_del
Apr 14 10:55:21 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-91553644-31b5-426c-b97c-a0ea10cd27b4 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] Deletion of /opt/stack/data/nova/instances/fe152ebd-4f99-4fa8-bfdb-8744cdf3f387_del complete
Apr 14 10:55:21 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-82400794-2a1c-4819-bbd4-d5545d062f13 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "3393be13-7d81-48da-b6dd-a427e8403b22" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.336s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:55:22 user nova-compute[71509]: INFO nova.scheduler.client.report [None req-91553644-31b5-426c-b97c-a0ea10cd27b4 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Deleted allocations for instance fe152ebd-4f99-4fa8-bfdb-8744cdf3f387
Apr 14 10:55:22 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-91553644-31b5-426c-b97c-a0ea10cd27b4 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:55:22 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-91553644-31b5-426c-b97c-a0ea10cd27b4 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:55:22 user nova-compute[71509]: DEBUG nova.objects.instance [None req-91553644-31b5-426c-b97c-a0ea10cd27b4 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lazy-loading 'numa_topology' on Instance uuid fe152ebd-4f99-4fa8-bfdb-8744cdf3f387 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:55:22 user nova-compute[71509]: DEBUG nova.network.neutron [None req-0d5605e9-fe30-4aad-8b3d-16b54e79ef4f tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] [instance: e6580716-8a6a-4dfa-8978-ed54b92af1fe] Successfully updated port: 3019f976-f679-4826-8510-3de34b67807c {{(pid=71509) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 10:55:22 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-0d5605e9-fe30-4aad-8b3d-16b54e79ef4f tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Acquiring lock "refresh_cache-e6580716-8a6a-4dfa-8978-ed54b92af1fe" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:55:22 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-0d5605e9-fe30-4aad-8b3d-16b54e79ef4f tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Acquired lock "refresh_cache-e6580716-8a6a-4dfa-8978-ed54b92af1fe" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:55:22 user nova-compute[71509]: DEBUG nova.network.neutron [None req-0d5605e9-fe30-4aad-8b3d-16b54e79ef4f tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] [instance: e6580716-8a6a-4dfa-8978-ed54b92af1fe] Building network info cache for instance {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 10:55:22 user nova-compute[71509]: DEBUG nova.compute.manager [req-3c473a8f-8cd0-4de3-a8fb-a05b875c2c5f req-8d1a0c7c-2589-41a4-a6d8-89ccf340483c service nova] [instance: e6580716-8a6a-4dfa-8978-ed54b92af1fe] Received event network-changed-3019f976-f679-4826-8510-3de34b67807c {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:55:22 user nova-compute[71509]: DEBUG nova.compute.manager [req-3c473a8f-8cd0-4de3-a8fb-a05b875c2c5f req-8d1a0c7c-2589-41a4-a6d8-89ccf340483c service nova] [instance: e6580716-8a6a-4dfa-8978-ed54b92af1fe] Refreshing instance network info cache due to event network-changed-3019f976-f679-4826-8510-3de34b67807c. {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 10:55:22 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-3c473a8f-8cd0-4de3-a8fb-a05b875c2c5f req-8d1a0c7c-2589-41a4-a6d8-89ccf340483c service nova] Acquiring lock "refresh_cache-e6580716-8a6a-4dfa-8978-ed54b92af1fe" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:55:22 user nova-compute[71509]: DEBUG nova.network.neutron [None req-0d5605e9-fe30-4aad-8b3d-16b54e79ef4f tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] [instance: e6580716-8a6a-4dfa-8978-ed54b92af1fe] Instance cache missing network info. {{(pid=71509) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 10:55:22 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-91553644-31b5-426c-b97c-a0ea10cd27b4 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 10:55:22 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-91553644-31b5-426c-b97c-a0ea10cd27b4 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 10:55:22 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-91553644-31b5-426c-b97c-a0ea10cd27b4 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.400s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:55:22 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-91553644-31b5-426c-b97c-a0ea10cd27b4 tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "fe152ebd-4f99-4fa8-bfdb-8744cdf3f387" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.776s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:55:22 user nova-compute[71509]: DEBUG nova.network.neutron [None req-0d5605e9-fe30-4aad-8b3d-16b54e79ef4f tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] [instance: e6580716-8a6a-4dfa-8978-ed54b92af1fe] Updating instance_info_cache with network_info: [{"id": "3019f976-f679-4826-8510-3de34b67807c", "address": "fa:16:3e:57:1a:d3", "network": {"id": "1fdeb048-706a-45bf-8f2a-2cee21abb9ea", "bridge": "br-int", "label": "tempest-TestStampPattern-1337046138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f629ba0ab8074ed8bb4e59d545b74eb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3019f976-f6", "ovs_interfaceid": "3019f976-f679-4826-8510-3de34b67807c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:55:22 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-0d5605e9-fe30-4aad-8b3d-16b54e79ef4f tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Releasing lock "refresh_cache-e6580716-8a6a-4dfa-8978-ed54b92af1fe" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:55:22 user nova-compute[71509]: DEBUG nova.compute.manager [None req-0d5605e9-fe30-4aad-8b3d-16b54e79ef4f tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] [instance: e6580716-8a6a-4dfa-8978-ed54b92af1fe] Instance network_info: |[{"id": "3019f976-f679-4826-8510-3de34b67807c", "address": "fa:16:3e:57:1a:d3", "network": {"id": "1fdeb048-706a-45bf-8f2a-2cee21abb9ea", "bridge": "br-int", "label": "tempest-TestStampPattern-1337046138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f629ba0ab8074ed8bb4e59d545b74eb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3019f976-f6", "ovs_interfaceid": "3019f976-f679-4826-8510-3de34b67807c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71509) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 10:55:22 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-3c473a8f-8cd0-4de3-a8fb-a05b875c2c5f req-8d1a0c7c-2589-41a4-a6d8-89ccf340483c service nova] Acquired lock "refresh_cache-e6580716-8a6a-4dfa-8978-ed54b92af1fe" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:55:22 user nova-compute[71509]: DEBUG nova.network.neutron [req-3c473a8f-8cd0-4de3-a8fb-a05b875c2c5f req-8d1a0c7c-2589-41a4-a6d8-89ccf340483c service nova] [instance: e6580716-8a6a-4dfa-8978-ed54b92af1fe] Refreshing network info cache for port 3019f976-f679-4826-8510-3de34b67807c {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 10:55:22 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-0d5605e9-fe30-4aad-8b3d-16b54e79ef4f tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] [instance: e6580716-8a6a-4dfa-8978-ed54b92af1fe] Start _get_guest_xml network_info=[{"id": "3019f976-f679-4826-8510-3de34b67807c", "address": "fa:16:3e:57:1a:d3", "network": {"id": "1fdeb048-706a-45bf-8f2a-2cee21abb9ea", "bridge": "br-int", "label": "tempest-TestStampPattern-1337046138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f629ba0ab8074ed8bb4e59d545b74eb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3019f976-f6", "ovs_interfaceid": "3019f976-f679-4826-8510-3de34b67807c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T10:38:55Z,direct_url=<?>,disk_format='qcow2',id=048ec0ee-0465-448d-8b4c-f072acb101dc,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='9742d6ad20cf48d9bab0fdbcc9491db9',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T10:38:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '048ec0ee-0465-448d-8b4c-f072acb101dc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71509) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 10:55:22 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-0d5605e9-fe30-4aad-8b3d-16b54e79ef4f tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:55:22 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-0d5605e9-fe30-4aad-8b3d-16b54e79ef4f tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:55:22 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-0d5605e9-fe30-4aad-8b3d-16b54e79ef4f tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71509) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 10:55:22 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-0d5605e9-fe30-4aad-8b3d-16b54e79ef4f tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T10:40:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T10:38:55Z,direct_url=<?>,disk_format='qcow2',id=048ec0ee-0465-448d-8b4c-f072acb101dc,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='9742d6ad20cf48d9bab0fdbcc9491db9',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T10:38:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 10:55:22 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-0d5605e9-fe30-4aad-8b3d-16b54e79ef4f tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Flavor limits 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 10:55:22 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-0d5605e9-fe30-4aad-8b3d-16b54e79ef4f tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Image limits 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 10:55:22 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-0d5605e9-fe30-4aad-8b3d-16b54e79ef4f tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Flavor pref 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 10:55:22 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-0d5605e9-fe30-4aad-8b3d-16b54e79ef4f tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Image pref 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 10:55:22 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-0d5605e9-fe30-4aad-8b3d-16b54e79ef4f tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 10:55:22 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-0d5605e9-fe30-4aad-8b3d-16b54e79ef4f tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 10:55:22 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-0d5605e9-fe30-4aad-8b3d-16b54e79ef4f tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71509) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 10:55:22 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-0d5605e9-fe30-4aad-8b3d-16b54e79ef4f tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Got 1 possible topologies {{(pid=71509) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 10:55:22 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-0d5605e9-fe30-4aad-8b3d-16b54e79ef4f tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 10:55:22 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-0d5605e9-fe30-4aad-8b3d-16b54e79ef4f tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 10:55:22 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-0d5605e9-fe30-4aad-8b3d-16b54e79ef4f tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T10:55:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1925914153',display_name='tempest-TestStampPattern-server-1925914153',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-1925914153',id=27,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHGJbZqWmfze/VbD7AiTXpBSSC7JeSqxVieDSB69GsDRbeWrzeiKDuD8IXa8m1YPGpwzOjCM3hxDW4Au2iAbXYcYId85Kh55qCn9eiY+V5K3AjDmmJpdlP7IQxGR6pVCIA==',key_name='tempest-TestStampPattern-627373922',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f629ba0ab8074ed8bb4e59d545b74eb6',ramdisk_id='',reservation_id='r-0ma87v4t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1000870021',owner_user_name='tempest-TestStampPattern-1000870021-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T10:55:20Z,user_data=None,user_id='e3ad6531a67b4be58a195e1208157b0b',uuid=e6580716-8a6a-4dfa-8978-ed54b92af1fe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3019f976-f679-4826-8510-3de34b67807c", "address": "fa:16:3e:57:1a:d3", "network": {"id": "1fdeb048-706a-45bf-8f2a-2cee21abb9ea", "bridge": "br-int", "label": "tempest-TestStampPattern-1337046138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f629ba0ab8074ed8bb4e59d545b74eb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3019f976-f6", "ovs_interfaceid": "3019f976-f679-4826-8510-3de34b67807c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71509) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 10:55:22 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-0d5605e9-fe30-4aad-8b3d-16b54e79ef4f tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Converting VIF {"id": "3019f976-f679-4826-8510-3de34b67807c", "address": "fa:16:3e:57:1a:d3", "network": {"id": "1fdeb048-706a-45bf-8f2a-2cee21abb9ea", "bridge": "br-int", "label": "tempest-TestStampPattern-1337046138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f629ba0ab8074ed8bb4e59d545b74eb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3019f976-f6", "ovs_interfaceid": "3019f976-f679-4826-8510-3de34b67807c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:55:22 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-0d5605e9-fe30-4aad-8b3d-16b54e79ef4f tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:1a:d3,bridge_name='br-int',has_traffic_filtering=True,id=3019f976-f679-4826-8510-3de34b67807c,network=Network(1fdeb048-706a-45bf-8f2a-2cee21abb9ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3019f976-f6') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:55:22 user nova-compute[71509]: DEBUG nova.objects.instance [None req-0d5605e9-fe30-4aad-8b3d-16b54e79ef4f tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lazy-loading 'pci_devices' on Instance uuid e6580716-8a6a-4dfa-8978-ed54b92af1fe {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:55:22 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-0d5605e9-fe30-4aad-8b3d-16b54e79ef4f tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] [instance: e6580716-8a6a-4dfa-8978-ed54b92af1fe] End _get_guest_xml xml=<domain type="kvm">
Apr 14 10:55:22 user nova-compute[71509]:   <uuid>e6580716-8a6a-4dfa-8978-ed54b92af1fe</uuid>
Apr 14 10:55:22 user nova-compute[71509]:   <name>instance-0000001b</name>
Apr 14 10:55:22 user nova-compute[71509]:   <memory>131072</memory>
Apr 14 10:55:22 user nova-compute[71509]:   <vcpu>1</vcpu>
Apr 14 10:55:22 user nova-compute[71509]:   <metadata>
Apr 14 10:55:22 user nova-compute[71509]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 10:55:22 user nova-compute[71509]:       <nova:package version="0.0.0"/>
Apr 14 10:55:22 user nova-compute[71509]:       <nova:name>tempest-TestStampPattern-server-1925914153</nova:name>
Apr 14 10:55:22 user nova-compute[71509]:       <nova:creationTime>2023-04-14 10:55:22</nova:creationTime>
Apr 14 10:55:22 user nova-compute[71509]:       <nova:flavor name="m1.nano">
Apr 14 10:55:22 user nova-compute[71509]:         <nova:memory>128</nova:memory>
Apr 14 10:55:22 user nova-compute[71509]:         <nova:disk>1</nova:disk>
Apr 14 10:55:22 user nova-compute[71509]:         <nova:swap>0</nova:swap>
Apr 14 10:55:22 user nova-compute[71509]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 10:55:22 user nova-compute[71509]:         <nova:vcpus>1</nova:vcpus>
Apr 14 10:55:22 user nova-compute[71509]:       </nova:flavor>
Apr 14 10:55:22 user nova-compute[71509]:       <nova:owner>
Apr 14 10:55:22 user nova-compute[71509]:         <nova:user uuid="e3ad6531a67b4be58a195e1208157b0b">tempest-TestStampPattern-1000870021-project-member</nova:user>
Apr 14 10:55:22 user nova-compute[71509]:         <nova:project uuid="f629ba0ab8074ed8bb4e59d545b74eb6">tempest-TestStampPattern-1000870021</nova:project>
Apr 14 10:55:22 user nova-compute[71509]:       </nova:owner>
Apr 14 10:55:22 user nova-compute[71509]:       <nova:root type="image" uuid="048ec0ee-0465-448d-8b4c-f072acb101dc"/>
Apr 14 10:55:22 user nova-compute[71509]:       <nova:ports>
Apr 14 10:55:22 user nova-compute[71509]:         <nova:port uuid="3019f976-f679-4826-8510-3de34b67807c">
Apr 14 10:55:22 user nova-compute[71509]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Apr 14 10:55:22 user nova-compute[71509]:         </nova:port>
Apr 14 10:55:22 user nova-compute[71509]:       </nova:ports>
Apr 14 10:55:22 user nova-compute[71509]:     </nova:instance>
Apr 14 10:55:22 user nova-compute[71509]:   </metadata>
Apr 14 10:55:22 user nova-compute[71509]:   <sysinfo type="smbios">
Apr 14 10:55:22 user nova-compute[71509]:     <system>
Apr 14 10:55:22 user nova-compute[71509]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 10:55:22 user nova-compute[71509]:       <entry name="product">OpenStack Nova</entry>
Apr 14 10:55:22 user nova-compute[71509]:       <entry name="version">0.0.0</entry>
Apr 14 10:55:22 user nova-compute[71509]:       <entry name="serial">e6580716-8a6a-4dfa-8978-ed54b92af1fe</entry>
Apr 14 10:55:22 user nova-compute[71509]:       <entry name="uuid">e6580716-8a6a-4dfa-8978-ed54b92af1fe</entry>
Apr 14 10:55:22 user nova-compute[71509]:       <entry name="family">Virtual Machine</entry>
Apr 14 10:55:22 user nova-compute[71509]:     </system>
Apr 14 10:55:22 user nova-compute[71509]:   </sysinfo>
Apr 14 10:55:22 user nova-compute[71509]:   <os>
Apr 14 10:55:22 user nova-compute[71509]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 10:55:22 user nova-compute[71509]:     <boot dev="hd"/>
Apr 14 10:55:22 user nova-compute[71509]:     <smbios mode="sysinfo"/>
Apr 14 10:55:22 user nova-compute[71509]:   </os>
Apr 14 10:55:22 user nova-compute[71509]:   <features>
Apr 14 10:55:22 user nova-compute[71509]:     <acpi/>
Apr 14 10:55:22 user nova-compute[71509]:     <apic/>
Apr 14 10:55:22 user nova-compute[71509]:     <vmcoreinfo/>
Apr 14 10:55:22 user nova-compute[71509]:   </features>
Apr 14 10:55:22 user nova-compute[71509]:   <clock offset="utc">
Apr 14 10:55:22 user nova-compute[71509]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 10:55:22 user nova-compute[71509]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 10:55:22 user nova-compute[71509]:     <timer name="hpet" present="no"/>
Apr 14 10:55:22 user nova-compute[71509]:   </clock>
Apr 14 10:55:22 user nova-compute[71509]:   <cpu mode="custom" match="exact">
Apr 14 10:55:22 user nova-compute[71509]:     <model>Nehalem</model>
Apr 14 10:55:22 user nova-compute[71509]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 10:55:22 user nova-compute[71509]:   </cpu>
Apr 14 10:55:22 user nova-compute[71509]:   <devices>
Apr 14 10:55:22 user nova-compute[71509]:     <disk type="file" device="disk">
Apr 14 10:55:22 user nova-compute[71509]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 10:55:22 user nova-compute[71509]:       <source file="/opt/stack/data/nova/instances/e6580716-8a6a-4dfa-8978-ed54b92af1fe/disk"/>
Apr 14 10:55:22 user nova-compute[71509]:       <target dev="vda" bus="virtio"/>
Apr 14 10:55:22 user nova-compute[71509]:     </disk>
Apr 14 10:55:22 user nova-compute[71509]:     <interface type="ethernet">
Apr 14 10:55:22 user nova-compute[71509]:       <mac address="fa:16:3e:57:1a:d3"/>
Apr 14 10:55:22 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 10:55:22 user nova-compute[71509]:       <mtu size="1442"/>
Apr 14 10:55:22 user nova-compute[71509]:       <target dev="tap3019f976-f6"/>
Apr 14 10:55:22 user nova-compute[71509]:     </interface>
Apr 14 10:55:22 user nova-compute[71509]:     <serial type="pty">
Apr 14 10:55:22 user nova-compute[71509]:       <log file="/opt/stack/data/nova/instances/e6580716-8a6a-4dfa-8978-ed54b92af1fe/console.log" append="off"/>
Apr 14 10:55:22 user nova-compute[71509]:     </serial>
Apr 14 10:55:22 user nova-compute[71509]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 10:55:22 user nova-compute[71509]:     <video>
Apr 14 10:55:22 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 10:55:22 user nova-compute[71509]:     </video>
Apr 14 10:55:22 user nova-compute[71509]:     <rng model="virtio">
Apr 14 10:55:22 user nova-compute[71509]:       <backend model="random">/dev/urandom</backend>
Apr 14 10:55:22 user nova-compute[71509]:     </rng>
Apr 14 10:55:22 user nova-compute[71509]:     <controller type="usb" index="0" model="none"/>
Apr 14 10:55:22 user nova-compute[71509]:     <memballoon model="virtio">
Apr 14 10:55:22 user nova-compute[71509]:       <stats period="10"/>
Apr 14 10:55:22 user nova-compute[71509]:     </memballoon>
Apr 14 10:55:22 user nova-compute[71509]:   </devices>
Apr 14 10:55:22 user nova-compute[71509]: </domain>
Apr 14 10:55:22 user nova-compute[71509]:  {{(pid=71509) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 10:55:22 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-0d5605e9-fe30-4aad-8b3d-16b54e79ef4f tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T10:55:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1925914153',display_name='tempest-TestStampPattern-server-1925914153',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-1925914153',id=27,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHGJbZqWmfze/VbD7AiTXpBSSC7JeSqxVieDSB69GsDRbeWrzeiKDuD8IXa8m1YPGpwzOjCM3hxDW4Au2iAbXYcYId85Kh55qCn9eiY+V5K3AjDmmJpdlP7IQxGR6pVCIA==',key_name='tempest-TestStampPattern-627373922',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f629ba0ab8074ed8bb4e59d545b74eb6',ramdisk_id='',reservation_id='r-0ma87v4t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1000870021',owner_user_name='tempest-TestStampPattern-1000870021-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T10:55:20Z,user_data=None,user_id='e3ad6531a67b4be58a195e1208157b0b',uuid=e6580716-8a6a-4dfa-8978-ed54b92af1fe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3019f976-f679-4826-8510-3de34b67807c", "address": "fa:16:3e:57:1a:d3", "network": {"id": "1fdeb048-706a-45bf-8f2a-2cee21abb9ea", "bridge": "br-int", "label": "tempest-TestStampPattern-1337046138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f629ba0ab8074ed8bb4e59d545b74eb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3019f976-f6", "ovs_interfaceid": "3019f976-f679-4826-8510-3de34b67807c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 10:55:22 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-0d5605e9-fe30-4aad-8b3d-16b54e79ef4f tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Converting VIF {"id": "3019f976-f679-4826-8510-3de34b67807c", "address": "fa:16:3e:57:1a:d3", "network": {"id": "1fdeb048-706a-45bf-8f2a-2cee21abb9ea", "bridge": "br-int", "label": "tempest-TestStampPattern-1337046138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f629ba0ab8074ed8bb4e59d545b74eb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3019f976-f6", "ovs_interfaceid": "3019f976-f679-4826-8510-3de34b67807c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:55:22 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-0d5605e9-fe30-4aad-8b3d-16b54e79ef4f tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:1a:d3,bridge_name='br-int',has_traffic_filtering=True,id=3019f976-f679-4826-8510-3de34b67807c,network=Network(1fdeb048-706a-45bf-8f2a-2cee21abb9ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3019f976-f6') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:55:22 user nova-compute[71509]: DEBUG os_vif [None req-0d5605e9-fe30-4aad-8b3d-16b54e79ef4f tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:1a:d3,bridge_name='br-int',has_traffic_filtering=True,id=3019f976-f679-4826-8510-3de34b67807c,network=Network(1fdeb048-706a-45bf-8f2a-2cee21abb9ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3019f976-f6') {{(pid=71509) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 10:55:22 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:55:22 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:55:22 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 10:55:22 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:55:22 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3019f976-f6, may_exist=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:55:22 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3019f976-f6, col_values=(('external_ids', {'iface-id': '3019f976-f679-4826-8510-3de34b67807c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:57:1a:d3', 'vm-uuid': 'e6580716-8a6a-4dfa-8978-ed54b92af1fe'}),)) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:55:22 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:55:22 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 10:55:22 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:55:22 user nova-compute[71509]: INFO os_vif [None req-0d5605e9-fe30-4aad-8b3d-16b54e79ef4f tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:1a:d3,bridge_name='br-int',has_traffic_filtering=True,id=3019f976-f679-4826-8510-3de34b67807c,network=Network(1fdeb048-706a-45bf-8f2a-2cee21abb9ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3019f976-f6')
Apr 14 10:55:22 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-0d5605e9-fe30-4aad-8b3d-16b54e79ef4f tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] No BDM found with device name vda, not building metadata. {{(pid=71509) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 10:55:22 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-0d5605e9-fe30-4aad-8b3d-16b54e79ef4f tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] No VIF found with MAC fa:16:3e:57:1a:d3, not building metadata {{(pid=71509) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 10:55:23 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:55:23 user nova-compute[71509]: DEBUG nova.network.neutron [req-3c473a8f-8cd0-4de3-a8fb-a05b875c2c5f req-8d1a0c7c-2589-41a4-a6d8-89ccf340483c service nova] [instance: e6580716-8a6a-4dfa-8978-ed54b92af1fe] Updated VIF entry in instance network info cache for port 3019f976-f679-4826-8510-3de34b67807c. {{(pid=71509) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 10:55:23 user nova-compute[71509]: DEBUG nova.network.neutron [req-3c473a8f-8cd0-4de3-a8fb-a05b875c2c5f req-8d1a0c7c-2589-41a4-a6d8-89ccf340483c service nova] [instance: e6580716-8a6a-4dfa-8978-ed54b92af1fe] Updating instance_info_cache with network_info: [{"id": "3019f976-f679-4826-8510-3de34b67807c", "address": "fa:16:3e:57:1a:d3", "network": {"id": "1fdeb048-706a-45bf-8f2a-2cee21abb9ea", "bridge": "br-int", "label": "tempest-TestStampPattern-1337046138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f629ba0ab8074ed8bb4e59d545b74eb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3019f976-f6", "ovs_interfaceid": "3019f976-f679-4826-8510-3de34b67807c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:55:23 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-3c473a8f-8cd0-4de3-a8fb-a05b875c2c5f req-8d1a0c7c-2589-41a4-a6d8-89ccf340483c service nova] Releasing lock "refresh_cache-e6580716-8a6a-4dfa-8978-ed54b92af1fe" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:55:24 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:55:24 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:55:24 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:55:25 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:55:25 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:55:25 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:55:25 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:55:25 user nova-compute[71509]: DEBUG nova.compute.manager [req-e6df468d-7e84-4014-975f-d883efdf68e3 req-e28a5e5a-b805-4a7f-ad14-ce019e1eadbd service nova] [instance: e6580716-8a6a-4dfa-8978-ed54b92af1fe] Received event network-vif-plugged-3019f976-f679-4826-8510-3de34b67807c {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:55:25 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-e6df468d-7e84-4014-975f-d883efdf68e3 req-e28a5e5a-b805-4a7f-ad14-ce019e1eadbd service nova] Acquiring lock "e6580716-8a6a-4dfa-8978-ed54b92af1fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:55:25 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-e6df468d-7e84-4014-975f-d883efdf68e3 req-e28a5e5a-b805-4a7f-ad14-ce019e1eadbd service nova] Lock "e6580716-8a6a-4dfa-8978-ed54b92af1fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:55:25 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-e6df468d-7e84-4014-975f-d883efdf68e3 req-e28a5e5a-b805-4a7f-ad14-ce019e1eadbd service nova] Lock "e6580716-8a6a-4dfa-8978-ed54b92af1fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:55:25 user nova-compute[71509]: DEBUG nova.compute.manager [req-e6df468d-7e84-4014-975f-d883efdf68e3 req-e28a5e5a-b805-4a7f-ad14-ce019e1eadbd service nova] [instance: e6580716-8a6a-4dfa-8978-ed54b92af1fe] No waiting events found dispatching network-vif-plugged-3019f976-f679-4826-8510-3de34b67807c {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:55:25 user nova-compute[71509]: WARNING nova.compute.manager [req-e6df468d-7e84-4014-975f-d883efdf68e3 req-e28a5e5a-b805-4a7f-ad14-ce019e1eadbd service nova] [instance: e6580716-8a6a-4dfa-8978-ed54b92af1fe] Received unexpected event network-vif-plugged-3019f976-f679-4826-8510-3de34b67807c for instance with vm_state building and task_state spawning.
Apr 14 10:55:25 user nova-compute[71509]: DEBUG nova.compute.manager [req-e6df468d-7e84-4014-975f-d883efdf68e3 req-e28a5e5a-b805-4a7f-ad14-ce019e1eadbd service nova] [instance: e6580716-8a6a-4dfa-8978-ed54b92af1fe] Received event network-vif-plugged-3019f976-f679-4826-8510-3de34b67807c {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:55:25 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-e6df468d-7e84-4014-975f-d883efdf68e3 req-e28a5e5a-b805-4a7f-ad14-ce019e1eadbd service nova] Acquiring lock "e6580716-8a6a-4dfa-8978-ed54b92af1fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:55:25 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-e6df468d-7e84-4014-975f-d883efdf68e3 req-e28a5e5a-b805-4a7f-ad14-ce019e1eadbd service nova] Lock "e6580716-8a6a-4dfa-8978-ed54b92af1fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:55:25 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-e6df468d-7e84-4014-975f-d883efdf68e3 req-e28a5e5a-b805-4a7f-ad14-ce019e1eadbd service nova] Lock "e6580716-8a6a-4dfa-8978-ed54b92af1fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:55:25 user nova-compute[71509]: DEBUG nova.compute.manager [req-e6df468d-7e84-4014-975f-d883efdf68e3 req-e28a5e5a-b805-4a7f-ad14-ce019e1eadbd service nova] [instance: e6580716-8a6a-4dfa-8978-ed54b92af1fe] No waiting events found dispatching network-vif-plugged-3019f976-f679-4826-8510-3de34b67807c {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:55:25 user nova-compute[71509]: WARNING nova.compute.manager [req-e6df468d-7e84-4014-975f-d883efdf68e3 req-e28a5e5a-b805-4a7f-ad14-ce019e1eadbd service nova] [instance: e6580716-8a6a-4dfa-8978-ed54b92af1fe] Received unexpected event network-vif-plugged-3019f976-f679-4826-8510-3de34b67807c for instance with vm_state building and task_state spawning.
Apr 14 10:55:26 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681469726.4611962, e6580716-8a6a-4dfa-8978-ed54b92af1fe => Resumed> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 10:55:26 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: e6580716-8a6a-4dfa-8978-ed54b92af1fe] VM Resumed (Lifecycle Event)
Apr 14 10:55:26 user nova-compute[71509]: DEBUG nova.compute.manager [None req-0d5605e9-fe30-4aad-8b3d-16b54e79ef4f tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] [instance: e6580716-8a6a-4dfa-8978-ed54b92af1fe] Instance event wait completed in 0 seconds for  {{(pid=71509) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 10:55:26 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-0d5605e9-fe30-4aad-8b3d-16b54e79ef4f tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] [instance: e6580716-8a6a-4dfa-8978-ed54b92af1fe] Guest created on hypervisor {{(pid=71509) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 10:55:26 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: e6580716-8a6a-4dfa-8978-ed54b92af1fe] Instance spawned successfully.
Apr 14 10:55:26 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-0d5605e9-fe30-4aad-8b3d-16b54e79ef4f tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] [instance: e6580716-8a6a-4dfa-8978-ed54b92af1fe] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 10:55:26 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: e6580716-8a6a-4dfa-8978-ed54b92af1fe] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:55:26 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: e6580716-8a6a-4dfa-8978-ed54b92af1fe] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 10:55:26 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-0d5605e9-fe30-4aad-8b3d-16b54e79ef4f tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] [instance: e6580716-8a6a-4dfa-8978-ed54b92af1fe] Found default for hw_cdrom_bus of ide {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:55:26 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-0d5605e9-fe30-4aad-8b3d-16b54e79ef4f tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] [instance: e6580716-8a6a-4dfa-8978-ed54b92af1fe] Found default for hw_disk_bus of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:55:26 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-0d5605e9-fe30-4aad-8b3d-16b54e79ef4f tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] [instance: e6580716-8a6a-4dfa-8978-ed54b92af1fe] Found default for hw_input_bus of None {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:55:26 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-0d5605e9-fe30-4aad-8b3d-16b54e79ef4f tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] [instance: e6580716-8a6a-4dfa-8978-ed54b92af1fe] Found default for hw_pointer_model of None {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:55:26 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-0d5605e9-fe30-4aad-8b3d-16b54e79ef4f tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] [instance: e6580716-8a6a-4dfa-8978-ed54b92af1fe] Found default for hw_video_model of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:55:26 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-0d5605e9-fe30-4aad-8b3d-16b54e79ef4f tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] [instance: e6580716-8a6a-4dfa-8978-ed54b92af1fe] Found default for hw_vif_model of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:55:26 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: e6580716-8a6a-4dfa-8978-ed54b92af1fe] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 10:55:26 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681469726.4649932, e6580716-8a6a-4dfa-8978-ed54b92af1fe => Started> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 10:55:26 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: e6580716-8a6a-4dfa-8978-ed54b92af1fe] VM Started (Lifecycle Event)
Apr 14 10:55:26 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: e6580716-8a6a-4dfa-8978-ed54b92af1fe] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:55:26 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: e6580716-8a6a-4dfa-8978-ed54b92af1fe] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 10:55:26 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: e6580716-8a6a-4dfa-8978-ed54b92af1fe] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 10:55:26 user nova-compute[71509]: INFO nova.compute.manager [None req-0d5605e9-fe30-4aad-8b3d-16b54e79ef4f tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] [instance: e6580716-8a6a-4dfa-8978-ed54b92af1fe] Took 6.54 seconds to spawn the instance on the hypervisor.
Apr 14 10:55:26 user nova-compute[71509]: DEBUG nova.compute.manager [None req-0d5605e9-fe30-4aad-8b3d-16b54e79ef4f tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] [instance: e6580716-8a6a-4dfa-8978-ed54b92af1fe] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:55:26 user nova-compute[71509]: INFO nova.compute.manager [None req-0d5605e9-fe30-4aad-8b3d-16b54e79ef4f tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] [instance: e6580716-8a6a-4dfa-8978-ed54b92af1fe] Took 7.80 seconds to build instance.
Apr 14 10:55:26 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-0d5605e9-fe30-4aad-8b3d-16b54e79ef4f tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "e6580716-8a6a-4dfa-8978-ed54b92af1fe" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.987s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:55:27 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:55:28 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:55:30 user nova-compute[71509]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681469715.6294377, fe152ebd-4f99-4fa8-bfdb-8744cdf3f387 => Stopped> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 10:55:30 user nova-compute[71509]: INFO nova.compute.manager [-] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] VM Stopped (Lifecycle Event)
Apr 14 10:55:30 user nova-compute[71509]: DEBUG nova.compute.manager [None req-72e53b7a-269b-47ce-82d0-3baa887ec153 None None] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:55:32 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:55:33 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:55:34 user nova-compute[71509]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681469719.4895208, 3393be13-7d81-48da-b6dd-a427e8403b22 => Stopped> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 10:55:34 user nova-compute[71509]: INFO nova.compute.manager [-] [instance: 3393be13-7d81-48da-b6dd-a427e8403b22] VM Stopped (Lifecycle Event)
Apr 14 10:55:34 user nova-compute[71509]: DEBUG nova.compute.manager [None req-dce42016-769d-48b1-a4f4-f40d0cf2b8c6 None None] [instance: 3393be13-7d81-48da-b6dd-a427e8403b22] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:55:36 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:55:36 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71509) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 10:55:37 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:55:37 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:55:38 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:55:38 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:55:39 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:55:42 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:55:43 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:55:43 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:55:44 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:55:44 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:55:45 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:55:45 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Starting heal instance info cache {{(pid=71509) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 10:55:45 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Rebuilding the list of instances to heal {{(pid=71509) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 10:55:45 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "refresh_cache-97f20661-8b60-439e-b7af-2fc2013c5ade" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:55:45 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquired lock "refresh_cache-97f20661-8b60-439e-b7af-2fc2013c5ade" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:55:45 user nova-compute[71509]: DEBUG nova.network.neutron [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] Forcefully refreshing network info cache for instance {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 10:55:45 user nova-compute[71509]: DEBUG nova.objects.instance [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lazy-loading 'info_cache' on Instance uuid 97f20661-8b60-439e-b7af-2fc2013c5ade {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:55:46 user nova-compute[71509]: DEBUG nova.network.neutron [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] Updating instance_info_cache with network_info: [{"id": "270b85b0-1832-4118-a8b0-ff784587b58a", "address": "fa:16:3e:75:ba:ae", "network": {"id": "22eb5f87-be4d-447d-bafe-25e0284ea3ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-787804772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf93e5dac50342d0b65ef09711401e99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap270b85b0-18", "ovs_interfaceid": "270b85b0-1832-4118-a8b0-ff784587b58a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:55:46 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Releasing lock "refresh_cache-97f20661-8b60-439e-b7af-2fc2013c5ade" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:55:46 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] Updated the network info_cache for instance {{(pid=71509) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 10:55:46 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:55:46 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:55:46 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:55:46 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:55:46 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Auditing locally available compute resources for user (node: user) {{(pid=71509) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 10:55:46 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97820f17-22d1-4ec3-9721-1edadccc794a/disk.rescue --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:55:46 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97820f17-22d1-4ec3-9721-1edadccc794a/disk.rescue --force-share --output=json" returned: 0 in 0.143s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:55:46 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97820f17-22d1-4ec3-9721-1edadccc794a/disk.rescue --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:55:46 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97820f17-22d1-4ec3-9721-1edadccc794a/disk.rescue --force-share --output=json" returned: 0 in 0.145s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:55:46 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97820f17-22d1-4ec3-9721-1edadccc794a/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:55:47 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97820f17-22d1-4ec3-9721-1edadccc794a/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:55:47 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97820f17-22d1-4ec3-9721-1edadccc794a/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:55:47 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97820f17-22d1-4ec3-9721-1edadccc794a/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:55:47 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8586a70e-9855-4177-ac1b-cf707a4df871/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:55:47 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8586a70e-9855-4177-ac1b-cf707a4df871/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:55:47 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8586a70e-9855-4177-ac1b-cf707a4df871/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:55:47 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8586a70e-9855-4177-ac1b-cf707a4df871/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:55:47 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4abb549-8f36-40c5-971f-8accbb14ff86/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:55:47 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4abb549-8f36-40c5-971f-8accbb14ff86/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:55:47 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4abb549-8f36-40c5-971f-8accbb14ff86/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:55:47 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b4abb549-8f36-40c5-971f-8accbb14ff86/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:55:47 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71509) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 10:55:47 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd661ae0-c4bb-4117-847d-ef7e85d062fb/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:55:47 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:55:47 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd661ae0-c4bb-4117-847d-ef7e85d062fb/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:55:47 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd661ae0-c4bb-4117-847d-ef7e85d062fb/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:55:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd661ae0-c4bb-4117-847d-ef7e85d062fb/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:55:48 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=71509) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 10:55:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6580716-8a6a-4dfa-8978-ed54b92af1fe/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:55:48 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:55:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6580716-8a6a-4dfa-8978-ed54b92af1fe/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:55:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6580716-8a6a-4dfa-8978-ed54b92af1fe/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:55:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6580716-8a6a-4dfa-8978-ed54b92af1fe/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:55:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e479154a-acd6-47aa-9a5b-43c6e0feda07/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:55:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e479154a-acd6-47aa-9a5b-43c6e0feda07/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:55:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e479154a-acd6-47aa-9a5b-43c6e0feda07/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:55:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e479154a-acd6-47aa-9a5b-43c6e0feda07/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:55:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:55:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:55:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:55:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:55:48 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71509) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 10:55:49 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f41f217-0df2-4205-9633-7dbe83f40c96/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:55:49 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f41f217-0df2-4205-9633-7dbe83f40c96/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:55:49 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f41f217-0df2-4205-9633-7dbe83f40c96/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:55:49 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f41f217-0df2-4205-9633-7dbe83f40c96/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:55:49 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71509) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 10:55:49 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97f20661-8b60-439e-b7af-2fc2013c5ade/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:55:49 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97f20661-8b60-439e-b7af-2fc2013c5ade/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:55:49 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97f20661-8b60-439e-b7af-2fc2013c5ade/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:55:49 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97f20661-8b60-439e-b7af-2fc2013c5ade/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:55:50 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:55:50 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:55:50 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Hypervisor/Node resource view: name=user free_ram=7643MB free_disk=25.96276092529297GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71509) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 10:55:50 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:55:50 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:55:50 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 97f20661-8b60-439e-b7af-2fc2013c5ade actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:55:50 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 97820f17-22d1-4ec3-9721-1edadccc794a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:55:50 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance e479154a-acd6-47aa-9a5b-43c6e0feda07 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:55:50 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 8586a70e-9855-4177-ac1b-cf707a4df871 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:55:50 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 6cae9f61-763f-4671-a873-d15f01384416 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:55:50 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:55:50 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance cd661ae0-c4bb-4117-847d-ef7e85d062fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:55:50 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance b4abb549-8f36-40c5-971f-8accbb14ff86 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128, 'DISK_GB': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:55:50 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 6f41f217-0df2-4205-9633-7dbe83f40c96 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:55:50 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance e6580716-8a6a-4dfa-8978-ed54b92af1fe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:55:50 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=71509) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 10:55:50 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Final resource view: name=user phys_ram=16023MB used_ram=1792MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=71509) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 10:55:50 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 10:55:50 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 10:55:50 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Compute_service record updated for user:user {{(pid=71509) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 10:55:50 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.442s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:55:51 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-3ca90654-195e-47e9-b9ab-79b9aa4932db tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Acquiring lock "a936fb20-3f17-4114-829a-8659da6bc5f3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:55:51 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-3ca90654-195e-47e9-b9ab-79b9aa4932db tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "a936fb20-3f17-4114-829a-8659da6bc5f3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:55:51 user nova-compute[71509]: DEBUG nova.compute.manager [None req-3ca90654-195e-47e9-b9ab-79b9aa4932db tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: a936fb20-3f17-4114-829a-8659da6bc5f3] Starting instance... {{(pid=71509) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 10:55:52 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-3ca90654-195e-47e9-b9ab-79b9aa4932db tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:55:52 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-3ca90654-195e-47e9-b9ab-79b9aa4932db tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:55:52 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-3ca90654-195e-47e9-b9ab-79b9aa4932db tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71509) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 10:55:52 user nova-compute[71509]: INFO nova.compute.claims [None req-3ca90654-195e-47e9-b9ab-79b9aa4932db tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: a936fb20-3f17-4114-829a-8659da6bc5f3] Claim successful on node user
Apr 14 10:55:52 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-3ca90654-195e-47e9-b9ab-79b9aa4932db tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 10:55:52 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-3ca90654-195e-47e9-b9ab-79b9aa4932db tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 10:55:52 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-3ca90654-195e-47e9-b9ab-79b9aa4932db tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.391s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:55:52 user nova-compute[71509]: DEBUG nova.compute.manager [None req-3ca90654-195e-47e9-b9ab-79b9aa4932db tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: a936fb20-3f17-4114-829a-8659da6bc5f3] Start building networks asynchronously for instance. {{(pid=71509) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 10:55:52 user nova-compute[71509]: DEBUG nova.compute.manager [None req-3ca90654-195e-47e9-b9ab-79b9aa4932db tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: a936fb20-3f17-4114-829a-8659da6bc5f3] Allocating IP information in the background. {{(pid=71509) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 10:55:52 user nova-compute[71509]: DEBUG nova.network.neutron [None req-3ca90654-195e-47e9-b9ab-79b9aa4932db tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: a936fb20-3f17-4114-829a-8659da6bc5f3] allocate_for_instance() {{(pid=71509) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 10:55:52 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-3ca90654-195e-47e9-b9ab-79b9aa4932db tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: a936fb20-3f17-4114-829a-8659da6bc5f3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 10:55:52 user nova-compute[71509]: DEBUG nova.compute.manager [None req-3ca90654-195e-47e9-b9ab-79b9aa4932db tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: a936fb20-3f17-4114-829a-8659da6bc5f3] Start building block device mappings for instance. {{(pid=71509) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 10:55:52 user nova-compute[71509]: DEBUG nova.policy [None req-3ca90654-195e-47e9-b9ab-79b9aa4932db tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '395bc9d7007c4e01ac7effd418bcea19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71289f80a05141f482cb538dac3d7b38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71509) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 10:55:52 user nova-compute[71509]: DEBUG nova.compute.manager [None req-3ca90654-195e-47e9-b9ab-79b9aa4932db tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: a936fb20-3f17-4114-829a-8659da6bc5f3] Start spawning the instance on the hypervisor. {{(pid=71509) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 10:55:52 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-3ca90654-195e-47e9-b9ab-79b9aa4932db tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: a936fb20-3f17-4114-829a-8659da6bc5f3] Creating instance directory {{(pid=71509) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 10:55:52 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-3ca90654-195e-47e9-b9ab-79b9aa4932db tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: a936fb20-3f17-4114-829a-8659da6bc5f3] Creating image(s)
Apr 14 10:55:52 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-3ca90654-195e-47e9-b9ab-79b9aa4932db tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Acquiring lock "/opt/stack/data/nova/instances/a936fb20-3f17-4114-829a-8659da6bc5f3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:55:52 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-3ca90654-195e-47e9-b9ab-79b9aa4932db tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "/opt/stack/data/nova/instances/a936fb20-3f17-4114-829a-8659da6bc5f3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:55:52 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-3ca90654-195e-47e9-b9ab-79b9aa4932db tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "/opt/stack/data/nova/instances/a936fb20-3f17-4114-829a-8659da6bc5f3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:55:52 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-3ca90654-195e-47e9-b9ab-79b9aa4932db tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:55:52 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-3ca90654-195e-47e9-b9ab-79b9aa4932db tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json" returned: 0 in 0.131s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:55:52 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-3ca90654-195e-47e9-b9ab-79b9aa4932db tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Acquiring lock "5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:55:52 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-3ca90654-195e-47e9-b9ab-79b9aa4932db tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:55:52 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-3ca90654-195e-47e9-b9ab-79b9aa4932db tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:55:52 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:55:52 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-3ca90654-195e-47e9-b9ab-79b9aa4932db tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json" returned: 0 in 0.133s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:55:52 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-3ca90654-195e-47e9-b9ab-79b9aa4932db tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18,backing_fmt=raw /opt/stack/data/nova/instances/a936fb20-3f17-4114-829a-8659da6bc5f3/disk 1073741824 {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:55:52 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-3ca90654-195e-47e9-b9ab-79b9aa4932db tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18,backing_fmt=raw /opt/stack/data/nova/instances/a936fb20-3f17-4114-829a-8659da6bc5f3/disk 1073741824" returned: 0 in 0.047s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:55:52 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-3ca90654-195e-47e9-b9ab-79b9aa4932db tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.185s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:55:52 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-3ca90654-195e-47e9-b9ab-79b9aa4932db tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:55:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-3ca90654-195e-47e9-b9ab-79b9aa4932db tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json" returned: 0 in 0.131s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:55:53 user nova-compute[71509]: DEBUG nova.virt.disk.api [None req-3ca90654-195e-47e9-b9ab-79b9aa4932db tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a936fb20-3f17-4114-829a-8659da6bc5f3/disk. size=1073741824 {{(pid=71509) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 10:55:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-3ca90654-195e-47e9-b9ab-79b9aa4932db tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a936fb20-3f17-4114-829a-8659da6bc5f3/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:55:53 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:55:53 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:55:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-3ca90654-195e-47e9-b9ab-79b9aa4932db tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a936fb20-3f17-4114-829a-8659da6bc5f3/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:55:53 user nova-compute[71509]: DEBUG nova.virt.disk.api [None req-3ca90654-195e-47e9-b9ab-79b9aa4932db tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Cannot resize image /opt/stack/data/nova/instances/a936fb20-3f17-4114-829a-8659da6bc5f3/disk to a smaller size. {{(pid=71509) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 10:55:53 user nova-compute[71509]: DEBUG nova.objects.instance [None req-3ca90654-195e-47e9-b9ab-79b9aa4932db tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lazy-loading 'migration_context' on Instance uuid a936fb20-3f17-4114-829a-8659da6bc5f3 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:55:53 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-3ca90654-195e-47e9-b9ab-79b9aa4932db tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: a936fb20-3f17-4114-829a-8659da6bc5f3] Created local disks {{(pid=71509) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 10:55:53 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-3ca90654-195e-47e9-b9ab-79b9aa4932db tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: a936fb20-3f17-4114-829a-8659da6bc5f3] Ensure instance console log exists: /opt/stack/data/nova/instances/a936fb20-3f17-4114-829a-8659da6bc5f3/console.log {{(pid=71509) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 10:55:53 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-3ca90654-195e-47e9-b9ab-79b9aa4932db tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:55:53 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-3ca90654-195e-47e9-b9ab-79b9aa4932db tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:55:53 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-3ca90654-195e-47e9-b9ab-79b9aa4932db tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:55:53 user nova-compute[71509]: DEBUG nova.network.neutron [None req-3ca90654-195e-47e9-b9ab-79b9aa4932db tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: a936fb20-3f17-4114-829a-8659da6bc5f3] Successfully created port: 472fc537-2bff-4ebb-bfb7-f7973f9f8b81 {{(pid=71509) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 10:55:53 user nova-compute[71509]: DEBUG nova.network.neutron [None req-3ca90654-195e-47e9-b9ab-79b9aa4932db tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: a936fb20-3f17-4114-829a-8659da6bc5f3] Successfully updated port: 472fc537-2bff-4ebb-bfb7-f7973f9f8b81 {{(pid=71509) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 10:55:53 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-3ca90654-195e-47e9-b9ab-79b9aa4932db tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Acquiring lock "refresh_cache-a936fb20-3f17-4114-829a-8659da6bc5f3" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:55:53 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-3ca90654-195e-47e9-b9ab-79b9aa4932db tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Acquired lock "refresh_cache-a936fb20-3f17-4114-829a-8659da6bc5f3" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:55:53 user nova-compute[71509]: DEBUG nova.network.neutron [None req-3ca90654-195e-47e9-b9ab-79b9aa4932db tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: a936fb20-3f17-4114-829a-8659da6bc5f3] Building network info cache for instance {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 10:55:54 user nova-compute[71509]: DEBUG nova.compute.manager [req-9311ecfa-1625-4780-a5bd-9580829f0334 req-0461eafd-eadc-4495-a058-07d825e6721f service nova] [instance: a936fb20-3f17-4114-829a-8659da6bc5f3] Received event network-changed-472fc537-2bff-4ebb-bfb7-f7973f9f8b81 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:55:54 user nova-compute[71509]: DEBUG nova.compute.manager [req-9311ecfa-1625-4780-a5bd-9580829f0334 req-0461eafd-eadc-4495-a058-07d825e6721f service nova] [instance: a936fb20-3f17-4114-829a-8659da6bc5f3] Refreshing instance network info cache due to event network-changed-472fc537-2bff-4ebb-bfb7-f7973f9f8b81. {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 10:55:54 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-9311ecfa-1625-4780-a5bd-9580829f0334 req-0461eafd-eadc-4495-a058-07d825e6721f service nova] Acquiring lock "refresh_cache-a936fb20-3f17-4114-829a-8659da6bc5f3" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:55:54 user nova-compute[71509]: DEBUG nova.network.neutron [None req-3ca90654-195e-47e9-b9ab-79b9aa4932db tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: a936fb20-3f17-4114-829a-8659da6bc5f3] Instance cache missing network info. {{(pid=71509) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 10:55:54 user nova-compute[71509]: DEBUG nova.network.neutron [None req-3ca90654-195e-47e9-b9ab-79b9aa4932db tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: a936fb20-3f17-4114-829a-8659da6bc5f3] Updating instance_info_cache with network_info: [{"id": "472fc537-2bff-4ebb-bfb7-f7973f9f8b81", "address": "fa:16:3e:3d:95:64", "network": {"id": "07f1f39e-292a-4e73-b4ed-99e5799d6fa8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1339551596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71289f80a05141f482cb538dac3d7b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap472fc537-2b", "ovs_interfaceid": "472fc537-2bff-4ebb-bfb7-f7973f9f8b81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:55:54 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-3ca90654-195e-47e9-b9ab-79b9aa4932db tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Releasing lock "refresh_cache-a936fb20-3f17-4114-829a-8659da6bc5f3" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:55:54 user nova-compute[71509]: DEBUG nova.compute.manager [None req-3ca90654-195e-47e9-b9ab-79b9aa4932db tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: a936fb20-3f17-4114-829a-8659da6bc5f3] Instance network_info: |[{"id": "472fc537-2bff-4ebb-bfb7-f7973f9f8b81", "address": "fa:16:3e:3d:95:64", "network": {"id": "07f1f39e-292a-4e73-b4ed-99e5799d6fa8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1339551596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71289f80a05141f482cb538dac3d7b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap472fc537-2b", "ovs_interfaceid": "472fc537-2bff-4ebb-bfb7-f7973f9f8b81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71509) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 10:55:54 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-9311ecfa-1625-4780-a5bd-9580829f0334 req-0461eafd-eadc-4495-a058-07d825e6721f service nova] Acquired lock "refresh_cache-a936fb20-3f17-4114-829a-8659da6bc5f3" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:55:54 user nova-compute[71509]: DEBUG nova.network.neutron [req-9311ecfa-1625-4780-a5bd-9580829f0334 req-0461eafd-eadc-4495-a058-07d825e6721f service nova] [instance: a936fb20-3f17-4114-829a-8659da6bc5f3] Refreshing network info cache for port 472fc537-2bff-4ebb-bfb7-f7973f9f8b81 {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 10:55:54 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-3ca90654-195e-47e9-b9ab-79b9aa4932db tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: a936fb20-3f17-4114-829a-8659da6bc5f3] Start _get_guest_xml network_info=[{"id": "472fc537-2bff-4ebb-bfb7-f7973f9f8b81", "address": "fa:16:3e:3d:95:64", "network": {"id": "07f1f39e-292a-4e73-b4ed-99e5799d6fa8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1339551596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71289f80a05141f482cb538dac3d7b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap472fc537-2b", "ovs_interfaceid": "472fc537-2bff-4ebb-bfb7-f7973f9f8b81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T10:38:55Z,direct_url=<?>,disk_format='qcow2',id=048ec0ee-0465-448d-8b4c-f072acb101dc,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='9742d6ad20cf48d9bab0fdbcc9491db9',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T10:38:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '048ec0ee-0465-448d-8b4c-f072acb101dc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71509) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 10:55:54 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-3ca90654-195e-47e9-b9ab-79b9aa4932db tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:55:54 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-3ca90654-195e-47e9-b9ab-79b9aa4932db tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:55:54 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-3ca90654-195e-47e9-b9ab-79b9aa4932db tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71509) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 10:55:54 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-3ca90654-195e-47e9-b9ab-79b9aa4932db tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T10:40:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T10:38:55Z,direct_url=<?>,disk_format='qcow2',id=048ec0ee-0465-448d-8b4c-f072acb101dc,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='9742d6ad20cf48d9bab0fdbcc9491db9',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T10:38:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 10:55:54 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-3ca90654-195e-47e9-b9ab-79b9aa4932db tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Flavor limits 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 10:55:54 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-3ca90654-195e-47e9-b9ab-79b9aa4932db tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Image limits 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 10:55:54 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-3ca90654-195e-47e9-b9ab-79b9aa4932db tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Flavor pref 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 10:55:54 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-3ca90654-195e-47e9-b9ab-79b9aa4932db tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Image pref 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 10:55:54 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-3ca90654-195e-47e9-b9ab-79b9aa4932db tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 10:55:54 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-3ca90654-195e-47e9-b9ab-79b9aa4932db tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 10:55:54 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-3ca90654-195e-47e9-b9ab-79b9aa4932db tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71509) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 10:55:54 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-3ca90654-195e-47e9-b9ab-79b9aa4932db tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Got 1 possible topologies {{(pid=71509) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 10:55:54 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-3ca90654-195e-47e9-b9ab-79b9aa4932db tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 10:55:54 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-3ca90654-195e-47e9-b9ab-79b9aa4932db tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 10:55:54 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-3ca90654-195e-47e9-b9ab-79b9aa4932db tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T10:55:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-116763620',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-116763620',id=28,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='71289f80a05141f482cb538dac3d7b38',ramdisk_id='',reservation_id='r-051u8j4l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2130542140',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T10:55:53Z,user_data=None,user_id='395bc9d7007c4e01ac7effd418bcea19',uuid=a936fb20-3f17-4114-829a-8659da6bc5f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "472fc537-2bff-4ebb-bfb7-f7973f9f8b81", "address": "fa:16:3e:3d:95:64", "network": {"id": "07f1f39e-292a-4e73-b4ed-99e5799d6fa8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1339551596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71289f80a05141f482cb538dac3d7b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap472fc537-2b", "ovs_interfaceid": "472fc537-2bff-4ebb-bfb7-f7973f9f8b81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71509) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 10:55:54 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-3ca90654-195e-47e9-b9ab-79b9aa4932db tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Converting VIF {"id": "472fc537-2bff-4ebb-bfb7-f7973f9f8b81", "address": "fa:16:3e:3d:95:64", "network": {"id": "07f1f39e-292a-4e73-b4ed-99e5799d6fa8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1339551596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71289f80a05141f482cb538dac3d7b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap472fc537-2b", "ovs_interfaceid": "472fc537-2bff-4ebb-bfb7-f7973f9f8b81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:55:54 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-3ca90654-195e-47e9-b9ab-79b9aa4932db tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:95:64,bridge_name='br-int',has_traffic_filtering=True,id=472fc537-2bff-4ebb-bfb7-f7973f9f8b81,network=Network(07f1f39e-292a-4e73-b4ed-99e5799d6fa8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap472fc537-2b') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:55:54 user nova-compute[71509]: DEBUG nova.objects.instance [None req-3ca90654-195e-47e9-b9ab-79b9aa4932db tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lazy-loading 'pci_devices' on Instance uuid a936fb20-3f17-4114-829a-8659da6bc5f3 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:55:54 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-3ca90654-195e-47e9-b9ab-79b9aa4932db tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: a936fb20-3f17-4114-829a-8659da6bc5f3] End _get_guest_xml xml=<domain type="kvm">
Apr 14 10:55:54 user nova-compute[71509]:   <uuid>a936fb20-3f17-4114-829a-8659da6bc5f3</uuid>
Apr 14 10:55:54 user nova-compute[71509]:   <name>instance-0000001c</name>
Apr 14 10:55:54 user nova-compute[71509]:   <memory>131072</memory>
Apr 14 10:55:54 user nova-compute[71509]:   <vcpu>1</vcpu>
Apr 14 10:55:54 user nova-compute[71509]:   <metadata>
Apr 14 10:55:54 user nova-compute[71509]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 10:55:54 user nova-compute[71509]:       <nova:package version="0.0.0"/>
Apr 14 10:55:54 user nova-compute[71509]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-116763620</nova:name>
Apr 14 10:55:54 user nova-compute[71509]:       <nova:creationTime>2023-04-14 10:55:54</nova:creationTime>
Apr 14 10:55:54 user nova-compute[71509]:       <nova:flavor name="m1.nano">
Apr 14 10:55:54 user nova-compute[71509]:         <nova:memory>128</nova:memory>
Apr 14 10:55:54 user nova-compute[71509]:         <nova:disk>1</nova:disk>
Apr 14 10:55:54 user nova-compute[71509]:         <nova:swap>0</nova:swap>
Apr 14 10:55:54 user nova-compute[71509]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 10:55:54 user nova-compute[71509]:         <nova:vcpus>1</nova:vcpus>
Apr 14 10:55:54 user nova-compute[71509]:       </nova:flavor>
Apr 14 10:55:54 user nova-compute[71509]:       <nova:owner>
Apr 14 10:55:54 user nova-compute[71509]:         <nova:user uuid="395bc9d7007c4e01ac7effd418bcea19">tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member</nova:user>
Apr 14 10:55:54 user nova-compute[71509]:         <nova:project uuid="71289f80a05141f482cb538dac3d7b38">tempest-ServerBootFromVolumeStableRescueTest-2130542140</nova:project>
Apr 14 10:55:54 user nova-compute[71509]:       </nova:owner>
Apr 14 10:55:54 user nova-compute[71509]:       <nova:root type="image" uuid="048ec0ee-0465-448d-8b4c-f072acb101dc"/>
Apr 14 10:55:54 user nova-compute[71509]:       <nova:ports>
Apr 14 10:55:54 user nova-compute[71509]:         <nova:port uuid="472fc537-2bff-4ebb-bfb7-f7973f9f8b81">
Apr 14 10:55:54 user nova-compute[71509]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 14 10:55:54 user nova-compute[71509]:         </nova:port>
Apr 14 10:55:54 user nova-compute[71509]:       </nova:ports>
Apr 14 10:55:54 user nova-compute[71509]:     </nova:instance>
Apr 14 10:55:54 user nova-compute[71509]:   </metadata>
Apr 14 10:55:54 user nova-compute[71509]:   <sysinfo type="smbios">
Apr 14 10:55:54 user nova-compute[71509]:     <system>
Apr 14 10:55:54 user nova-compute[71509]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 10:55:54 user nova-compute[71509]:       <entry name="product">OpenStack Nova</entry>
Apr 14 10:55:54 user nova-compute[71509]:       <entry name="version">0.0.0</entry>
Apr 14 10:55:54 user nova-compute[71509]:       <entry name="serial">a936fb20-3f17-4114-829a-8659da6bc5f3</entry>
Apr 14 10:55:54 user nova-compute[71509]:       <entry name="uuid">a936fb20-3f17-4114-829a-8659da6bc5f3</entry>
Apr 14 10:55:54 user nova-compute[71509]:       <entry name="family">Virtual Machine</entry>
Apr 14 10:55:54 user nova-compute[71509]:     </system>
Apr 14 10:55:54 user nova-compute[71509]:   </sysinfo>
Apr 14 10:55:54 user nova-compute[71509]:   <os>
Apr 14 10:55:54 user nova-compute[71509]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 10:55:54 user nova-compute[71509]:     <boot dev="hd"/>
Apr 14 10:55:54 user nova-compute[71509]:     <smbios mode="sysinfo"/>
Apr 14 10:55:54 user nova-compute[71509]:   </os>
Apr 14 10:55:54 user nova-compute[71509]:   <features>
Apr 14 10:55:54 user nova-compute[71509]:     <acpi/>
Apr 14 10:55:54 user nova-compute[71509]:     <apic/>
Apr 14 10:55:54 user nova-compute[71509]:     <vmcoreinfo/>
Apr 14 10:55:54 user nova-compute[71509]:   </features>
Apr 14 10:55:54 user nova-compute[71509]:   <clock offset="utc">
Apr 14 10:55:54 user nova-compute[71509]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 10:55:54 user nova-compute[71509]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 10:55:54 user nova-compute[71509]:     <timer name="hpet" present="no"/>
Apr 14 10:55:54 user nova-compute[71509]:   </clock>
Apr 14 10:55:54 user nova-compute[71509]:   <cpu mode="custom" match="exact">
Apr 14 10:55:54 user nova-compute[71509]:     <model>Nehalem</model>
Apr 14 10:55:54 user nova-compute[71509]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 10:55:54 user nova-compute[71509]:   </cpu>
Apr 14 10:55:54 user nova-compute[71509]:   <devices>
Apr 14 10:55:54 user nova-compute[71509]:     <disk type="file" device="disk">
Apr 14 10:55:54 user nova-compute[71509]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 10:55:54 user nova-compute[71509]:       <source file="/opt/stack/data/nova/instances/a936fb20-3f17-4114-829a-8659da6bc5f3/disk"/>
Apr 14 10:55:54 user nova-compute[71509]:       <target dev="vda" bus="virtio"/>
Apr 14 10:55:54 user nova-compute[71509]:     </disk>
Apr 14 10:55:54 user nova-compute[71509]:     <interface type="ethernet">
Apr 14 10:55:54 user nova-compute[71509]:       <mac address="fa:16:3e:3d:95:64"/>
Apr 14 10:55:54 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 10:55:54 user nova-compute[71509]:       <mtu size="1442"/>
Apr 14 10:55:54 user nova-compute[71509]:       <target dev="tap472fc537-2b"/>
Apr 14 10:55:54 user nova-compute[71509]:     </interface>
Apr 14 10:55:54 user nova-compute[71509]:     <serial type="pty">
Apr 14 10:55:54 user nova-compute[71509]:       <log file="/opt/stack/data/nova/instances/a936fb20-3f17-4114-829a-8659da6bc5f3/console.log" append="off"/>
Apr 14 10:55:54 user nova-compute[71509]:     </serial>
Apr 14 10:55:54 user nova-compute[71509]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 10:55:54 user nova-compute[71509]:     <video>
Apr 14 10:55:54 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 10:55:54 user nova-compute[71509]:     </video>
Apr 14 10:55:54 user nova-compute[71509]:     <rng model="virtio">
Apr 14 10:55:54 user nova-compute[71509]:       <backend model="random">/dev/urandom</backend>
Apr 14 10:55:54 user nova-compute[71509]:     </rng>
Apr 14 10:55:54 user nova-compute[71509]:     <controller type="usb" index="0" model="none"/>
Apr 14 10:55:54 user nova-compute[71509]:     <memballoon model="virtio">
Apr 14 10:55:54 user nova-compute[71509]:       <stats period="10"/>
Apr 14 10:55:54 user nova-compute[71509]:     </memballoon>
Apr 14 10:55:54 user nova-compute[71509]:   </devices>
Apr 14 10:55:54 user nova-compute[71509]: </domain>
Apr 14 10:55:54 user nova-compute[71509]:  {{(pid=71509) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 10:55:54 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-3ca90654-195e-47e9-b9ab-79b9aa4932db tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T10:55:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-116763620',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-116763620',id=28,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='71289f80a05141f482cb538dac3d7b38',ramdisk_id='',reservation_id='r-051u8j4l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2130542140',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T10:55:53Z,user_data=None,user_id='395bc9d7007c4e01ac7effd418bcea19',uuid=a936fb20-3f17-4114-829a-8659da6bc5f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "472fc537-2bff-4ebb-bfb7-f7973f9f8b81", "address": "fa:16:3e:3d:95:64", "network": {"id": "07f1f39e-292a-4e73-b4ed-99e5799d6fa8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1339551596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71289f80a05141f482cb538dac3d7b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap472fc537-2b", "ovs_interfaceid": "472fc537-2bff-4ebb-bfb7-f7973f9f8b81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 10:55:54 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-3ca90654-195e-47e9-b9ab-79b9aa4932db tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Converting VIF {"id": "472fc537-2bff-4ebb-bfb7-f7973f9f8b81", "address": "fa:16:3e:3d:95:64", "network": {"id": "07f1f39e-292a-4e73-b4ed-99e5799d6fa8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1339551596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71289f80a05141f482cb538dac3d7b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap472fc537-2b", "ovs_interfaceid": "472fc537-2bff-4ebb-bfb7-f7973f9f8b81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:55:54 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-3ca90654-195e-47e9-b9ab-79b9aa4932db tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:95:64,bridge_name='br-int',has_traffic_filtering=True,id=472fc537-2bff-4ebb-bfb7-f7973f9f8b81,network=Network(07f1f39e-292a-4e73-b4ed-99e5799d6fa8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap472fc537-2b') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:55:54 user nova-compute[71509]: DEBUG os_vif [None req-3ca90654-195e-47e9-b9ab-79b9aa4932db tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:95:64,bridge_name='br-int',has_traffic_filtering=True,id=472fc537-2bff-4ebb-bfb7-f7973f9f8b81,network=Network(07f1f39e-292a-4e73-b4ed-99e5799d6fa8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap472fc537-2b') {{(pid=71509) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 10:55:54 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:55:54 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:55:54 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 10:55:54 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:55:54 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap472fc537-2b, may_exist=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:55:54 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap472fc537-2b, col_values=(('external_ids', {'iface-id': '472fc537-2bff-4ebb-bfb7-f7973f9f8b81', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3d:95:64', 'vm-uuid': 'a936fb20-3f17-4114-829a-8659da6bc5f3'}),)) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:55:54 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:55:54 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 10:55:54 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:55:54 user nova-compute[71509]: INFO os_vif [None req-3ca90654-195e-47e9-b9ab-79b9aa4932db tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:95:64,bridge_name='br-int',has_traffic_filtering=True,id=472fc537-2bff-4ebb-bfb7-f7973f9f8b81,network=Network(07f1f39e-292a-4e73-b4ed-99e5799d6fa8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap472fc537-2b')
Apr 14 10:55:54 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-3ca90654-195e-47e9-b9ab-79b9aa4932db tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] No BDM found with device name vda, not building metadata. {{(pid=71509) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 10:55:54 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-3ca90654-195e-47e9-b9ab-79b9aa4932db tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] No VIF found with MAC fa:16:3e:3d:95:64, not building metadata {{(pid=71509) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 10:55:54 user nova-compute[71509]: DEBUG nova.network.neutron [req-9311ecfa-1625-4780-a5bd-9580829f0334 req-0461eafd-eadc-4495-a058-07d825e6721f service nova] [instance: a936fb20-3f17-4114-829a-8659da6bc5f3] Updated VIF entry in instance network info cache for port 472fc537-2bff-4ebb-bfb7-f7973f9f8b81. {{(pid=71509) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 10:55:54 user nova-compute[71509]: DEBUG nova.network.neutron [req-9311ecfa-1625-4780-a5bd-9580829f0334 req-0461eafd-eadc-4495-a058-07d825e6721f service nova] [instance: a936fb20-3f17-4114-829a-8659da6bc5f3] Updating instance_info_cache with network_info: [{"id": "472fc537-2bff-4ebb-bfb7-f7973f9f8b81", "address": "fa:16:3e:3d:95:64", "network": {"id": "07f1f39e-292a-4e73-b4ed-99e5799d6fa8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1339551596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71289f80a05141f482cb538dac3d7b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap472fc537-2b", "ovs_interfaceid": "472fc537-2bff-4ebb-bfb7-f7973f9f8b81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:55:54 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-9311ecfa-1625-4780-a5bd-9580829f0334 req-0461eafd-eadc-4495-a058-07d825e6721f service nova] Releasing lock "refresh_cache-a936fb20-3f17-4114-829a-8659da6bc5f3" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:55:55 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:55:55 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:55:55 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:55:56 user nova-compute[71509]: DEBUG nova.compute.manager [req-b9ca0add-2b37-4677-9c0b-d2eabe9f4da0 req-c945eb7d-4913-4506-84e8-46205d8b46ca service nova] [instance: a936fb20-3f17-4114-829a-8659da6bc5f3] Received event network-vif-plugged-472fc537-2bff-4ebb-bfb7-f7973f9f8b81 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:55:56 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-b9ca0add-2b37-4677-9c0b-d2eabe9f4da0 req-c945eb7d-4913-4506-84e8-46205d8b46ca service nova] Acquiring lock "a936fb20-3f17-4114-829a-8659da6bc5f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:55:56 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-b9ca0add-2b37-4677-9c0b-d2eabe9f4da0 req-c945eb7d-4913-4506-84e8-46205d8b46ca service nova] Lock "a936fb20-3f17-4114-829a-8659da6bc5f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:55:56 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-b9ca0add-2b37-4677-9c0b-d2eabe9f4da0 req-c945eb7d-4913-4506-84e8-46205d8b46ca service nova] Lock "a936fb20-3f17-4114-829a-8659da6bc5f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:55:56 user nova-compute[71509]: DEBUG nova.compute.manager [req-b9ca0add-2b37-4677-9c0b-d2eabe9f4da0 req-c945eb7d-4913-4506-84e8-46205d8b46ca service nova] [instance: a936fb20-3f17-4114-829a-8659da6bc5f3] No waiting events found dispatching network-vif-plugged-472fc537-2bff-4ebb-bfb7-f7973f9f8b81 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:55:56 user nova-compute[71509]: WARNING nova.compute.manager [req-b9ca0add-2b37-4677-9c0b-d2eabe9f4da0 req-c945eb7d-4913-4506-84e8-46205d8b46ca service nova] [instance: a936fb20-3f17-4114-829a-8659da6bc5f3] Received unexpected event network-vif-plugged-472fc537-2bff-4ebb-bfb7-f7973f9f8b81 for instance with vm_state building and task_state spawning.
Apr 14 10:55:56 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:55:56 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:55:58 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681469758.0783007, a936fb20-3f17-4114-829a-8659da6bc5f3 => Resumed> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 10:55:58 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: a936fb20-3f17-4114-829a-8659da6bc5f3] VM Resumed (Lifecycle Event)
Apr 14 10:55:58 user nova-compute[71509]: DEBUG nova.compute.manager [None req-3ca90654-195e-47e9-b9ab-79b9aa4932db tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: a936fb20-3f17-4114-829a-8659da6bc5f3] Instance event wait completed in 0 seconds for  {{(pid=71509) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 10:55:58 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-3ca90654-195e-47e9-b9ab-79b9aa4932db tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: a936fb20-3f17-4114-829a-8659da6bc5f3] Guest created on hypervisor {{(pid=71509) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 10:55:58 user nova-compute[71509]: DEBUG nova.compute.manager [req-c323fb2c-5248-4fe3-9e84-9118ff3264f7 req-f34a0673-9dbf-4a52-aa4c-a239c5e45e47 service nova] [instance: a936fb20-3f17-4114-829a-8659da6bc5f3] Received event network-vif-plugged-472fc537-2bff-4ebb-bfb7-f7973f9f8b81 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:55:58 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-c323fb2c-5248-4fe3-9e84-9118ff3264f7 req-f34a0673-9dbf-4a52-aa4c-a239c5e45e47 service nova] Acquiring lock "a936fb20-3f17-4114-829a-8659da6bc5f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:55:58 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-c323fb2c-5248-4fe3-9e84-9118ff3264f7 req-f34a0673-9dbf-4a52-aa4c-a239c5e45e47 service nova] Lock "a936fb20-3f17-4114-829a-8659da6bc5f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:55:58 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-c323fb2c-5248-4fe3-9e84-9118ff3264f7 req-f34a0673-9dbf-4a52-aa4c-a239c5e45e47 service nova] Lock "a936fb20-3f17-4114-829a-8659da6bc5f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:55:58 user nova-compute[71509]: DEBUG nova.compute.manager [req-c323fb2c-5248-4fe3-9e84-9118ff3264f7 req-f34a0673-9dbf-4a52-aa4c-a239c5e45e47 service nova] [instance: a936fb20-3f17-4114-829a-8659da6bc5f3] No waiting events found dispatching network-vif-plugged-472fc537-2bff-4ebb-bfb7-f7973f9f8b81 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:55:58 user nova-compute[71509]: WARNING nova.compute.manager [req-c323fb2c-5248-4fe3-9e84-9118ff3264f7 req-f34a0673-9dbf-4a52-aa4c-a239c5e45e47 service nova] [instance: a936fb20-3f17-4114-829a-8659da6bc5f3] Received unexpected event network-vif-plugged-472fc537-2bff-4ebb-bfb7-f7973f9f8b81 for instance with vm_state building and task_state spawning.
Apr 14 10:55:58 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: a936fb20-3f17-4114-829a-8659da6bc5f3] Instance spawned successfully.
Apr 14 10:55:58 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-3ca90654-195e-47e9-b9ab-79b9aa4932db tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: a936fb20-3f17-4114-829a-8659da6bc5f3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 10:55:58 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: a936fb20-3f17-4114-829a-8659da6bc5f3] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:55:58 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: a936fb20-3f17-4114-829a-8659da6bc5f3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 10:55:58 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:55:58 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-3ca90654-195e-47e9-b9ab-79b9aa4932db tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: a936fb20-3f17-4114-829a-8659da6bc5f3] Found default for hw_cdrom_bus of ide {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:55:58 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-3ca90654-195e-47e9-b9ab-79b9aa4932db tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: a936fb20-3f17-4114-829a-8659da6bc5f3] Found default for hw_disk_bus of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:55:58 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-3ca90654-195e-47e9-b9ab-79b9aa4932db tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: a936fb20-3f17-4114-829a-8659da6bc5f3] Found default for hw_input_bus of None {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:55:58 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-3ca90654-195e-47e9-b9ab-79b9aa4932db tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: a936fb20-3f17-4114-829a-8659da6bc5f3] Found default for hw_pointer_model of None {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:55:58 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-3ca90654-195e-47e9-b9ab-79b9aa4932db tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: a936fb20-3f17-4114-829a-8659da6bc5f3] Found default for hw_video_model of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:55:58 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-3ca90654-195e-47e9-b9ab-79b9aa4932db tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: a936fb20-3f17-4114-829a-8659da6bc5f3] Found default for hw_vif_model of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:55:58 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: a936fb20-3f17-4114-829a-8659da6bc5f3] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 10:55:58 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681469758.0797143, a936fb20-3f17-4114-829a-8659da6bc5f3 => Started> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 10:55:58 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: a936fb20-3f17-4114-829a-8659da6bc5f3] VM Started (Lifecycle Event)
Apr 14 10:55:58 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: a936fb20-3f17-4114-829a-8659da6bc5f3] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:55:58 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: a936fb20-3f17-4114-829a-8659da6bc5f3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 10:55:58 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: a936fb20-3f17-4114-829a-8659da6bc5f3] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 10:55:58 user nova-compute[71509]: INFO nova.compute.manager [None req-3ca90654-195e-47e9-b9ab-79b9aa4932db tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: a936fb20-3f17-4114-829a-8659da6bc5f3] Took 5.58 seconds to spawn the instance on the hypervisor.
Apr 14 10:55:58 user nova-compute[71509]: DEBUG nova.compute.manager [None req-3ca90654-195e-47e9-b9ab-79b9aa4932db tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: a936fb20-3f17-4114-829a-8659da6bc5f3] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:55:58 user nova-compute[71509]: INFO nova.compute.manager [None req-3ca90654-195e-47e9-b9ab-79b9aa4932db tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: a936fb20-3f17-4114-829a-8659da6bc5f3] Took 6.27 seconds to build instance.
Apr 14 10:55:58 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-3ca90654-195e-47e9-b9ab-79b9aa4932db tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "a936fb20-3f17-4114-829a-8659da6bc5f3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.366s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:55:59 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:56:03 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:56:04 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:56:09 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 10:56:10 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-755f85c5-4cbb-4c60-8ffc-fa00a3e142e1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "cd661ae0-c4bb-4117-847d-ef7e85d062fb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:56:10 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-755f85c5-4cbb-4c60-8ffc-fa00a3e142e1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "cd661ae0-c4bb-4117-847d-ef7e85d062fb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:56:10 user nova-compute[71509]: INFO nova.compute.manager [None req-755f85c5-4cbb-4c60-8ffc-fa00a3e142e1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: cd661ae0-c4bb-4117-847d-ef7e85d062fb] Detaching volume e52b9d6a-ee3e-42b8-973e-d47c4ed33196
Apr 14 10:56:10 user nova-compute[71509]: INFO nova.virt.block_device [None req-755f85c5-4cbb-4c60-8ffc-fa00a3e142e1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: cd661ae0-c4bb-4117-847d-ef7e85d062fb] Attempting to driver detach volume e52b9d6a-ee3e-42b8-973e-d47c4ed33196 from mountpoint /dev/vdb
Apr 14 10:56:10 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-755f85c5-4cbb-4c60-8ffc-fa00a3e142e1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Attempting to detach device vdb from instance cd661ae0-c4bb-4117-847d-ef7e85d062fb from the persistent domain config. {{(pid=71509) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 10:56:10 user nova-compute[71509]: DEBUG nova.virt.libvirt.guest [None req-755f85c5-4cbb-4c60-8ffc-fa00a3e142e1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 10:56:10 user nova-compute[71509]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 10:56:10 user nova-compute[71509]:   <source dev="/dev/sdf"/>
Apr 14 10:56:10 user nova-compute[71509]:   <target dev="vdb" bus="virtio"/>
Apr 14 10:56:10 user nova-compute[71509]:   <serial>e52b9d6a-ee3e-42b8-973e-d47c4ed33196</serial>
Apr 14 10:56:10 user nova-compute[71509]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 10:56:10 user nova-compute[71509]: </disk>
Apr 14 10:56:10 user nova-compute[71509]:  {{(pid=71509) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 10:56:10 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-755f85c5-4cbb-4c60-8ffc-fa00a3e142e1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Successfully detached device vdb from instance cd661ae0-c4bb-4117-847d-ef7e85d062fb from the persistent domain config.
Apr 14 10:56:10 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-755f85c5-4cbb-4c60-8ffc-fa00a3e142e1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance cd661ae0-c4bb-4117-847d-ef7e85d062fb from the live domain config. {{(pid=71509) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 10:56:10 user nova-compute[71509]: DEBUG nova.virt.libvirt.guest [None req-755f85c5-4cbb-4c60-8ffc-fa00a3e142e1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 10:56:10 user nova-compute[71509]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 10:56:10 user nova-compute[71509]:   <source dev="/dev/sdf"/>
Apr 14 10:56:10 user nova-compute[71509]:   <target dev="vdb" bus="virtio"/>
Apr 14 10:56:10 user nova-compute[71509]:   <serial>e52b9d6a-ee3e-42b8-973e-d47c4ed33196</serial>
Apr 14 10:56:10 user nova-compute[71509]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 10:56:10 user nova-compute[71509]: </disk>
Apr 14 10:56:10 user nova-compute[71509]:  {{(pid=71509) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 10:56:10 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Received event <DeviceRemovedEvent: 1681469770.6246874, cd661ae0-c4bb-4117-847d-ef7e85d062fb => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71509) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 10:56:10 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-755f85c5-4cbb-4c60-8ffc-fa00a3e142e1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance cd661ae0-c4bb-4117-847d-ef7e85d062fb {{(pid=71509) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 10:56:10 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-755f85c5-4cbb-4c60-8ffc-fa00a3e142e1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Successfully detached device vdb from instance cd661ae0-c4bb-4117-847d-ef7e85d062fb from the live domain config.
Apr 14 10:56:10 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-755f85c5-4cbb-4c60-8ffc-fa00a3e142e1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: cd661ae0-c4bb-4117-847d-ef7e85d062fb] calling os-brick to detach iSCSI Volume {{(pid=71509) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 10:56:10 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-755f85c5-4cbb-4c60-8ffc-fa00a3e142e1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0bf0749390>, {'target_iqn': 'iqn.2010-10.org.openstack:e52b9d6a-ee3e-42b8-973e-d47c4ed33196', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YcfwqigL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 10:56:10 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-755f85c5-4cbb-4c60-8ffc-fa00a3e142e1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 10:56:10 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-755f85c5-4cbb-4c60-8ffc-fa00a3e142e1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 10:56:10 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-755f85c5-4cbb-4c60-8ffc-fa00a3e142e1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 10:56:10 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:56:10 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:56:10 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa0135ee-9490-446f-97ac-ec6b0acf2ba4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e52b9d6a-ee3e-42b8-973e-d47c4ed33196\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:08f71190-2402-402d-af67-edf9226e4fb8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:56:10 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-755f85c5-4cbb-4c60-8ffc-fa00a3e142e1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 10:56:10 user nova-compute[71509]: No targets found.
Apr 14 10:56:10 user nova-compute[71509]: iSNS:
Apr 14 10:56:10 user nova-compute[71509]: No targets found.
Apr 14 10:56:10 user nova-compute[71509]: STATIC:
Apr 14 10:56:10 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe
Apr 14 10:56:10 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:56:10 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:56:10 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:e52b9d6a-ee3e-42b8-973e-d47c4ed33196
Apr 14 10:56:10 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:56:10 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:56:10 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:08f71190-2402-402d-af67-edf9226e4fb8
Apr 14 10:56:10 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:56:10 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:56:10 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178
Apr 14 10:56:10 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:56:10 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:56:10 user nova-compute[71509]: FIRMWARE:
Apr 14 10:56:10 user nova-compute[71509]: No targets found.
Apr 14 10:56:10 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:56:10 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-755f85c5-4cbb-4c60-8ffc-fa00a3e142e1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 10:56:10 user nova-compute[71509]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 10:56:10 user nova-compute[71509]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71509) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 10:56:10 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-755f85c5-4cbb-4c60-8ffc-fa00a3e142e1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e52b9d6a-ee3e-42b8-973e-d47c4ed33196', 0)] {{(pid=71509) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 10:56:10 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:56:10 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:56:10 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[35d5bfef-daa5-4df2-bbeb-4dc9b9f6facc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:08f71190-2402-402d-af67-edf9226e4fb8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e52b9d6a-ee3e-42b8-973e-d47c4ed33196\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:56:10 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:56:10 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:56:10 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[83a0b484-06f8-45ab-8394-14cff00047b8]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08f71190-2402-402d-af67-edf9226e4fb8 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52b9d6a-ee3e-42b8-973e-d47c4ed33196 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:56:10 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-755f85c5-4cbb-4c60-8ffc-fa00a3e142e1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)
Apr 14 10:56:10 user nova-compute[71509]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08f71190-2402-402d-af67-edf9226e4fb8 (non-flash)
Apr 14 10:56:10 user nova-compute[71509]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52b9d6a-ee3e-42b8-973e-d47c4ed33196 (non-flash)
Apr 14 10:56:10 user nova-compute[71509]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe (non-flash)
Apr 14 10:56:10 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:56:10 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-755f85c5-4cbb-4c60-8ffc-fa00a3e142e1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)
Apr 14 10:56:10 user nova-compute[71509]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08f71190-2402-402d-af67-edf9226e4fb8 (non-flash)
Apr 14 10:56:10 user nova-compute[71509]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e52b9d6a-ee3e-42b8-973e-d47c4ed33196 (non-flash)
Apr 14 10:56:10 user nova-compute[71509]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe (non-flash)
Apr 14 10:56:10 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 10:56:10 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-755f85c5-4cbb-4c60-8ffc-fa00a3e142e1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0c3a7baef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e52b9d6a-ee3e-42b8-973e-d47c4ed33196'): ({'sdf'}, set())}) {{(pid=71509) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 10:56:10 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-755f85c5-4cbb-4c60-8ffc-fa00a3e142e1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Removing single pathed devices sdf {{(pid=71509) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 10:56:10 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:56:10 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:56:10 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bee34aa-ce32-4576-b527-247dbfdac435]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:56:10 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:56:10 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.023s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:56:10 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e3a2b05-b4e6-445e-9790-bf48360b9a12]: (4, ('ok\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:56:10 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-755f85c5-4cbb-4c60-8ffc-fa00a3e142e1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Flushing IO for device /dev/sdf {{(pid=71509) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 10:56:10 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:56:10 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:56:10 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fe46697-b734-43e9-bbbf-264ccad26bd9]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:56:10 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-755f85c5-4cbb-4c60-8ffc-fa00a3e142e1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71509) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 10:56:10 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:56:10 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.043s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:56:10 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[67178f1a-0792-4ad2-9e4e-e727afbda61c]: (4, ('1', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:56:10 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-755f85c5-4cbb-4c60-8ffc-fa00a3e142e1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=71509) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 10:56:10 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-755f85c5-4cbb-4c60-8ffc-fa00a3e142e1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] SCSI volumes sdf have been removed. {{(pid=71509) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 10:56:10 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-755f85c5-4cbb-4c60-8ffc-fa00a3e142e1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e52b9d6a-ee3e-42b8-973e-d47c4ed33196')] {{(pid=71509) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 10:56:10 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e52b9d6a-ee3e-42b8-973e-d47c4ed33196 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:56:10 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e52b9d6a-ee3e-42b8-973e-d47c4ed33196 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:56:10 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ad1192a-394c-4d40-ae5b-038153f52681]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:56:10 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-755f85c5-4cbb-4c60-8ffc-fa00a3e142e1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:56:10 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e52b9d6a-ee3e-42b8-973e-d47c4ed33196 -p 172.16.0.220:3260 --logout {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:56:10 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e52b9d6a-ee3e-42b8-973e-d47c4ed33196 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:56:10 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3e63d8e-4577-4a90-8f60-566dc0ea50d8]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:e52b9d6a-ee3e-42b8-973e-d47c4ed33196, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:e52b9d6a-ee3e-42b8-973e-d47c4ed33196, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:56:10 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-755f85c5-4cbb-4c60-8ffc-fa00a3e142e1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:e52b9d6a-ee3e-42b8-973e-d47c4ed33196, portal: 172.16.0.220,3260]
Apr 14 10:56:10 user nova-compute[71509]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:e52b9d6a-ee3e-42b8-973e-d47c4ed33196, portal: 172.16.0.220,3260] successful.
Apr 14 10:56:10 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:56:10 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e52b9d6a-ee3e-42b8-973e-d47c4ed33196 -p 172.16.0.220:3260 --op delete {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:56:10 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e52b9d6a-ee3e-42b8-973e-d47c4ed33196 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:56:10 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[a25ce3b7-a649-4bfa-9c4b-df61814817b4]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:56:10 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-755f85c5-4cbb-4c60-8ffc-fa00a3e142e1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:56:10 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-755f85c5-4cbb-4c60-8ffc-fa00a3e142e1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.288s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 10:56:10 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-755f85c5-4cbb-4c60-8ffc-fa00a3e142e1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] <== disconnect_volume: return (289ms) None {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 10:56:10 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-755f85c5-4cbb-4c60-8ffc-fa00a3e142e1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: cd661ae0-c4bb-4117-847d-ef7e85d062fb] Disconnected iSCSI Volume {{(pid=71509) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 10:56:11 user nova-compute[71509]: DEBUG nova.objects.instance [None req-755f85c5-4cbb-4c60-8ffc-fa00a3e142e1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lazy-loading 'flavor' on Instance uuid cd661ae0-c4bb-4117-847d-ef7e85d062fb {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:56:11 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-755f85c5-4cbb-4c60-8ffc-fa00a3e142e1 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "cd661ae0-c4bb-4117-847d-ef7e85d062fb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.736s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:56:13 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:56:14 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:56:18 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:56:19 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:56:23 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:56:23 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-19805e05-02f0-4807-994f-a439847d17c7 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "b4abb549-8f36-40c5-971f-8accbb14ff86" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:56:23 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-19805e05-02f0-4807-994f-a439847d17c7 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "b4abb549-8f36-40c5-971f-8accbb14ff86" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:56:23 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-19805e05-02f0-4807-994f-a439847d17c7 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "b4abb549-8f36-40c5-971f-8accbb14ff86-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:56:23 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-19805e05-02f0-4807-994f-a439847d17c7 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "b4abb549-8f36-40c5-971f-8accbb14ff86-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:56:23 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-19805e05-02f0-4807-994f-a439847d17c7 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "b4abb549-8f36-40c5-971f-8accbb14ff86-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:56:23 user nova-compute[71509]: INFO nova.compute.manager [None req-19805e05-02f0-4807-994f-a439847d17c7 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Terminating instance
Apr 14 10:56:23 user nova-compute[71509]: DEBUG nova.compute.manager [None req-19805e05-02f0-4807-994f-a439847d17c7 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Start destroying the instance on the hypervisor. {{(pid=71509) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 10:56:23 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:56:23 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:56:23 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:56:23 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:56:23 user nova-compute[71509]: DEBUG nova.compute.manager [req-581de955-9868-422e-8b3c-e4cfeb79bc52 req-e41b79f4-ff80-48d4-84fb-de94e84d335c service nova] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Received event network-vif-unplugged-608a2408-02df-474f-9006-260c8c97def1 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:56:23 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-581de955-9868-422e-8b3c-e4cfeb79bc52 req-e41b79f4-ff80-48d4-84fb-de94e84d335c service nova] Acquiring lock "b4abb549-8f36-40c5-971f-8accbb14ff86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:56:23 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-581de955-9868-422e-8b3c-e4cfeb79bc52 req-e41b79f4-ff80-48d4-84fb-de94e84d335c service nova] Lock "b4abb549-8f36-40c5-971f-8accbb14ff86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:56:23 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-581de955-9868-422e-8b3c-e4cfeb79bc52 req-e41b79f4-ff80-48d4-84fb-de94e84d335c service nova] Lock "b4abb549-8f36-40c5-971f-8accbb14ff86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:56:23 user nova-compute[71509]: DEBUG nova.compute.manager [req-581de955-9868-422e-8b3c-e4cfeb79bc52 req-e41b79f4-ff80-48d4-84fb-de94e84d335c service nova] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] No waiting events found dispatching network-vif-unplugged-608a2408-02df-474f-9006-260c8c97def1 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:56:23 user nova-compute[71509]: DEBUG nova.compute.manager [req-581de955-9868-422e-8b3c-e4cfeb79bc52 req-e41b79f4-ff80-48d4-84fb-de94e84d335c service nova] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Received event network-vif-unplugged-608a2408-02df-474f-9006-260c8c97def1 for instance with task_state deleting. {{(pid=71509) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 10:56:24 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Instance destroyed successfully.
Apr 14 10:56:24 user nova-compute[71509]: DEBUG nova.objects.instance [None req-19805e05-02f0-4807-994f-a439847d17c7 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lazy-loading 'resources' on Instance uuid b4abb549-8f36-40c5-971f-8accbb14ff86 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:56:24 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-19805e05-02f0-4807-994f-a439847d17c7 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T10:42:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-375061147',display_name='tempest-ServerActionsTestJSON-server-564468196',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-375061147',id=4,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNt/FyD1XXsxB5kJC+SJ1dgkjoXXHkL+KX0Cr5HvI72xTIz+DAtuVRPHeIpMNLt39mbbZ9KAoCJibRQza0Qbd8j8EEoV7QHombhWz2Mdusr+gJ2OYTqrrRzVbjIHACTFWw==',key_name='tempest-keypair-1544270235',keypairs=<?>,launch_index=0,launched_at=2023-04-14T10:53:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3ea2cb4dfa5b4a52b658efd8f5aefb36',ramdisk_id='',reservation_id='r-2qmryidz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-1923052090',owner_user_name='tempest-ServerActionsTestJSON-1923052090-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T10:53:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5873a358bf544691b12cd2979f5e36dc',uuid=b4abb549-8f36-40c5-971f-8accbb14ff86,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "608a2408-02df-474f-9006-260c8c97def1", "address": "fa:16:3e:e4:f7:87", "network": {"id": "18a91434-637b-4c19-a97b-736b32c1ea5a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1824162811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea2cb4dfa5b4a52b658efd8f5aefb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap608a2408-02", "ovs_interfaceid": "608a2408-02df-474f-9006-260c8c97def1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 10:56:24 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-19805e05-02f0-4807-994f-a439847d17c7 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Converting VIF {"id": "608a2408-02df-474f-9006-260c8c97def1", "address": "fa:16:3e:e4:f7:87", "network": {"id": "18a91434-637b-4c19-a97b-736b32c1ea5a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1824162811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea2cb4dfa5b4a52b658efd8f5aefb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap608a2408-02", "ovs_interfaceid": "608a2408-02df-474f-9006-260c8c97def1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:56:24 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-19805e05-02f0-4807-994f-a439847d17c7 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e4:f7:87,bridge_name='br-int',has_traffic_filtering=True,id=608a2408-02df-474f-9006-260c8c97def1,network=Network(18a91434-637b-4c19-a97b-736b32c1ea5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap608a2408-02') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:56:24 user nova-compute[71509]: DEBUG os_vif [None req-19805e05-02f0-4807-994f-a439847d17c7 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e4:f7:87,bridge_name='br-int',has_traffic_filtering=True,id=608a2408-02df-474f-9006-260c8c97def1,network=Network(18a91434-637b-4c19-a97b-736b32c1ea5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap608a2408-02') {{(pid=71509) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 10:56:24 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:56:24 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap608a2408-02, bridge=br-int, if_exists=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:56:24 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:56:24 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:56:24 user nova-compute[71509]: INFO os_vif [None req-19805e05-02f0-4807-994f-a439847d17c7 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e4:f7:87,bridge_name='br-int',has_traffic_filtering=True,id=608a2408-02df-474f-9006-260c8c97def1,network=Network(18a91434-637b-4c19-a97b-736b32c1ea5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap608a2408-02')
Apr 14 10:56:24 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19805e05-02f0-4807-994f-a439847d17c7 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] calling os-brick to detach iSCSI Volume {{(pid=71509) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 10:56:24 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-19805e05-02f0-4807-994f-a439847d17c7 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0bf0749390>, {'target_iqn': 'iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KDNjCusQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 10:56:24 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-19805e05-02f0-4807-994f-a439847d17c7 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 10:56:24 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-19805e05-02f0-4807-994f-a439847d17c7 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 10:56:24 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-19805e05-02f0-4807-994f-a439847d17c7 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 10:56:24 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:56:24 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:56:24 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b1b73ac-0849-4080-919f-179896e4fb97]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:08f71190-2402-402d-af67-edf9226e4fb8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:56:24 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-19805e05-02f0-4807-994f-a439847d17c7 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 10:56:24 user nova-compute[71509]: No targets found.
Apr 14 10:56:24 user nova-compute[71509]: iSNS:
Apr 14 10:56:24 user nova-compute[71509]: No targets found.
Apr 14 10:56:24 user nova-compute[71509]: STATIC:
Apr 14 10:56:24 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe
Apr 14 10:56:24 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:56:24 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:56:24 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:08f71190-2402-402d-af67-edf9226e4fb8
Apr 14 10:56:24 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:56:24 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:56:24 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178
Apr 14 10:56:24 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:56:24 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:56:24 user nova-compute[71509]: FIRMWARE:
Apr 14 10:56:24 user nova-compute[71509]: No targets found.
Apr 14 10:56:24 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:56:24 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-19805e05-02f0-4807-994f-a439847d17c7 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 10:56:24 user nova-compute[71509]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 10:56:24 user nova-compute[71509]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71509) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 10:56:24 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-19805e05-02f0-4807-994f-a439847d17c7 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe', 0)] {{(pid=71509) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 10:56:24 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:56:24 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:56:24 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8bc4c38-abb3-4f44-9c35-9a15ff88df29]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:08f71190-2402-402d-af67-edf9226e4fb8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:56:24 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:56:24 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:56:24 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[53ff6e1d-c882-49d6-af28-95b35755cb9b]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08f71190-2402-402d-af67-edf9226e4fb8 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:56:24 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-19805e05-02f0-4807-994f-a439847d17c7 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)
Apr 14 10:56:24 user nova-compute[71509]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08f71190-2402-402d-af67-edf9226e4fb8 (non-flash)
Apr 14 10:56:24 user nova-compute[71509]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe (non-flash)
Apr 14 10:56:24 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:56:24 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-19805e05-02f0-4807-994f-a439847d17c7 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)
Apr 14 10:56:24 user nova-compute[71509]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08f71190-2402-402d-af67-edf9226e4fb8 (non-flash)
Apr 14 10:56:24 user nova-compute[71509]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe (non-flash)
Apr 14 10:56:24 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 10:56:24 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-19805e05-02f0-4807-994f-a439847d17c7 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0c2c204790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe'): ({'sdb'}, set())}) {{(pid=71509) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 10:56:24 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-19805e05-02f0-4807-994f-a439847d17c7 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Removing single pathed devices sdb {{(pid=71509) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 10:56:24 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:56:24 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:56:24 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a1dd14b-76f3-4032-abd3-97f2afaead9b]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:56:24 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:56:24 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:56:24 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cff2f14-c206-4752-9461-d4fc83fed233]: (4, ('ok\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:56:24 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-19805e05-02f0-4807-994f-a439847d17c7 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Flushing IO for device /dev/sdb {{(pid=71509) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 10:56:24 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:56:24 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:56:24 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[15195beb-ab08-4b9b-a9e7-dce754fcbe2a]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:56:24 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-19805e05-02f0-4807-994f-a439847d17c7 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71509) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 10:56:24 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:56:24 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:56:24 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c907b4d-a3f9-4a73-82fb-b4150c506510]: (4, ('1', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:56:24 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-19805e05-02f0-4807-994f-a439847d17c7 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71509) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 10:56:24 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-19805e05-02f0-4807-994f-a439847d17c7 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] SCSI volumes sdb have been removed. {{(pid=71509) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 10:56:24 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-19805e05-02f0-4807-994f-a439847d17c7 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe')] {{(pid=71509) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 10:56:24 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:56:24 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:56:24 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b461f16-78ab-4df8-886d-84cfeb4077a1]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:56:24 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-19805e05-02f0-4807-994f-a439847d17c7 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:56:24 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe -p 172.16.0.220:3260 --logout {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:56:24 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:56:24 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc9836b1-2781-47d6-822d-dbf38e9a0cf8]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:56:24 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-19805e05-02f0-4807-994f-a439847d17c7 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe, portal: 172.16.0.220,3260]
Apr 14 10:56:24 user nova-compute[71509]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe, portal: 172.16.0.220,3260] successful.
Apr 14 10:56:24 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:56:24 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe -p 172.16.0.220:3260 --op delete {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:56:24 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d04b1b6-01e7-4c6b-9e4f-c843ee297dfe -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:56:24 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[a09d6f55-5928-4ffa-a800-78ad289c178b]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:56:24 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-19805e05-02f0-4807-994f-a439847d17c7 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:56:24 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-19805e05-02f0-4807-994f-a439847d17c7 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 10:56:24 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-19805e05-02f0-4807-994f-a439847d17c7 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] <== disconnect_volume: return (312ms) None {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 10:56:24 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19805e05-02f0-4807-994f-a439847d17c7 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Disconnected iSCSI Volume {{(pid=71509) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 10:56:24 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-19805e05-02f0-4807-994f-a439847d17c7 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Deleting instance files /opt/stack/data/nova/instances/b4abb549-8f36-40c5-971f-8accbb14ff86_del
Apr 14 10:56:24 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-19805e05-02f0-4807-994f-a439847d17c7 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Deletion of /opt/stack/data/nova/instances/b4abb549-8f36-40c5-971f-8accbb14ff86_del complete
Apr 14 10:56:24 user nova-compute[71509]: INFO nova.compute.manager [None req-19805e05-02f0-4807-994f-a439847d17c7 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Took 1.22 seconds to destroy the instance on the hypervisor.
Apr 14 10:56:24 user nova-compute[71509]: DEBUG oslo.service.loopingcall [None req-19805e05-02f0-4807-994f-a439847d17c7 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71509) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 10:56:24 user nova-compute[71509]: DEBUG nova.compute.manager [-] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Deallocating network for instance {{(pid=71509) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 10:56:24 user nova-compute[71509]: DEBUG nova.network.neutron [-] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] deallocate_for_instance() {{(pid=71509) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 10:56:25 user nova-compute[71509]: DEBUG nova.network.neutron [-] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Updating instance_info_cache with network_info: [] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:56:25 user nova-compute[71509]: INFO nova.compute.manager [-] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Took 0.72 seconds to deallocate network for instance.
Apr 14 10:56:25 user nova-compute[71509]: DEBUG nova.compute.manager [req-7b5ddec3-b0ba-4682-b168-be189b93ccc7 req-fe528e78-6da6-428c-bd7a-8e11b57b69a0 service nova] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Received event network-vif-deleted-608a2408-02df-474f-9006-260c8c97def1 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:56:25 user nova-compute[71509]: DEBUG nova.compute.manager [req-cc3712c3-e50f-416b-b947-17a189a0c7c5 req-173b7305-61d1-4624-a542-2d2842b25762 service nova] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Received event network-vif-plugged-608a2408-02df-474f-9006-260c8c97def1 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:56:25 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-cc3712c3-e50f-416b-b947-17a189a0c7c5 req-173b7305-61d1-4624-a542-2d2842b25762 service nova] Acquiring lock "b4abb549-8f36-40c5-971f-8accbb14ff86-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:56:25 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-cc3712c3-e50f-416b-b947-17a189a0c7c5 req-173b7305-61d1-4624-a542-2d2842b25762 service nova] Lock "b4abb549-8f36-40c5-971f-8accbb14ff86-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:56:25 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-cc3712c3-e50f-416b-b947-17a189a0c7c5 req-173b7305-61d1-4624-a542-2d2842b25762 service nova] Lock "b4abb549-8f36-40c5-971f-8accbb14ff86-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:56:25 user nova-compute[71509]: DEBUG nova.compute.manager [req-cc3712c3-e50f-416b-b947-17a189a0c7c5 req-173b7305-61d1-4624-a542-2d2842b25762 service nova] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] No waiting events found dispatching network-vif-plugged-608a2408-02df-474f-9006-260c8c97def1 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:56:25 user nova-compute[71509]: WARNING nova.compute.manager [req-cc3712c3-e50f-416b-b947-17a189a0c7c5 req-173b7305-61d1-4624-a542-2d2842b25762 service nova] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Received unexpected event network-vif-plugged-608a2408-02df-474f-9006-260c8c97def1 for instance with vm_state active and task_state deleting.
Apr 14 10:56:26 user nova-compute[71509]: INFO nova.compute.manager [None req-19805e05-02f0-4807-994f-a439847d17c7 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Took 0.80 seconds to detach 1 volumes for instance.
Apr 14 10:56:26 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-19805e05-02f0-4807-994f-a439847d17c7 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:56:26 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-19805e05-02f0-4807-994f-a439847d17c7 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:56:26 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-19805e05-02f0-4807-994f-a439847d17c7 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 10:56:26 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-19805e05-02f0-4807-994f-a439847d17c7 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 10:56:26 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-19805e05-02f0-4807-994f-a439847d17c7 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.329s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:56:26 user nova-compute[71509]: INFO nova.scheduler.client.report [None req-19805e05-02f0-4807-994f-a439847d17c7 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Deleted allocations for instance b4abb549-8f36-40c5-971f-8accbb14ff86
Apr 14 10:56:26 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-19805e05-02f0-4807-994f-a439847d17c7 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "b4abb549-8f36-40c5-971f-8accbb14ff86" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.254s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:56:28 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:56:29 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:56:33 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:56:34 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:56:38 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:56:39 user nova-compute[71509]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681469784.2921221, b4abb549-8f36-40c5-971f-8accbb14ff86 => Stopped> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 10:56:39 user nova-compute[71509]: INFO nova.compute.manager [-] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] VM Stopped (Lifecycle Event)
Apr 14 10:56:39 user nova-compute[71509]: DEBUG nova.compute.manager [None req-a9cba766-4727-4a28-a774-f26edeafc3f2 None None] [instance: b4abb549-8f36-40c5-971f-8accbb14ff86] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:56:39 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:56:41 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:56:41 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:56:41 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:56:41 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:56:41 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71509) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 10:56:43 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:56:44 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:56:44 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:56:45 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:56:46 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:56:46 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Starting heal instance info cache {{(pid=71509) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 10:56:46 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "refresh_cache-97820f17-22d1-4ec3-9721-1edadccc794a" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:56:46 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquired lock "refresh_cache-97820f17-22d1-4ec3-9721-1edadccc794a" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:56:46 user nova-compute[71509]: DEBUG nova.network.neutron [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] [instance: 97820f17-22d1-4ec3-9721-1edadccc794a] Forcefully refreshing network info cache for instance {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 10:56:47 user nova-compute[71509]: DEBUG nova.network.neutron [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] [instance: 97820f17-22d1-4ec3-9721-1edadccc794a] Updating instance_info_cache with network_info: [{"id": "dea3830d-9f49-4d5e-953b-eec2ee969b02", "address": "fa:16:3e:77:58:9a", "network": {"id": "22eb5f87-be4d-447d-bafe-25e0284ea3ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-787804772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf93e5dac50342d0b65ef09711401e99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdea3830d-9f", "ovs_interfaceid": "dea3830d-9f49-4d5e-953b-eec2ee969b02", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:56:47 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Releasing lock "refresh_cache-97820f17-22d1-4ec3-9721-1edadccc794a" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:56:47 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] [instance: 97820f17-22d1-4ec3-9721-1edadccc794a] Updated the network info_cache for instance {{(pid=71509) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 10:56:47 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:56:48 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:56:48 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:56:48 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:56:48 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:56:48 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:56:48 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Auditing locally available compute resources for user (node: user) {{(pid=71509) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 10:56:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97820f17-22d1-4ec3-9721-1edadccc794a/disk.rescue --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:56:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97820f17-22d1-4ec3-9721-1edadccc794a/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:56:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97820f17-22d1-4ec3-9721-1edadccc794a/disk.rescue --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:56:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97820f17-22d1-4ec3-9721-1edadccc794a/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:56:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97820f17-22d1-4ec3-9721-1edadccc794a/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:56:49 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97820f17-22d1-4ec3-9721-1edadccc794a/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:56:49 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97820f17-22d1-4ec3-9721-1edadccc794a/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:56:49 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97820f17-22d1-4ec3-9721-1edadccc794a/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:56:49 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8586a70e-9855-4177-ac1b-cf707a4df871/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:56:49 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 10:56:49 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8586a70e-9855-4177-ac1b-cf707a4df871/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:56:49 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8586a70e-9855-4177-ac1b-cf707a4df871/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:56:49 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8586a70e-9855-4177-ac1b-cf707a4df871/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:56:49 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd661ae0-c4bb-4117-847d-ef7e85d062fb/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:56:49 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd661ae0-c4bb-4117-847d-ef7e85d062fb/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:56:49 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd661ae0-c4bb-4117-847d-ef7e85d062fb/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:56:49 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd661ae0-c4bb-4117-847d-ef7e85d062fb/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:56:49 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6580716-8a6a-4dfa-8978-ed54b92af1fe/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:56:49 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6580716-8a6a-4dfa-8978-ed54b92af1fe/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:56:49 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6580716-8a6a-4dfa-8978-ed54b92af1fe/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:56:50 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6580716-8a6a-4dfa-8978-ed54b92af1fe/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:56:50 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e479154a-acd6-47aa-9a5b-43c6e0feda07/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:56:50 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e479154a-acd6-47aa-9a5b-43c6e0feda07/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:56:50 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e479154a-acd6-47aa-9a5b-43c6e0feda07/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:56:50 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e479154a-acd6-47aa-9a5b-43c6e0feda07/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:56:50 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:56:50 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:56:50 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:56:50 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:56:50 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=71509) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 10:56:50 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f41f217-0df2-4205-9633-7dbe83f40c96/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:56:50 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f41f217-0df2-4205-9633-7dbe83f40c96/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:56:50 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f41f217-0df2-4205-9633-7dbe83f40c96/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:56:50 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f41f217-0df2-4205-9633-7dbe83f40c96/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:56:50 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71509) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 10:56:50 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97f20661-8b60-439e-b7af-2fc2013c5ade/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:56:51 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97f20661-8b60-439e-b7af-2fc2013c5ade/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:56:51 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97f20661-8b60-439e-b7af-2fc2013c5ade/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:56:51 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97f20661-8b60-439e-b7af-2fc2013c5ade/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:56:51 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a936fb20-3f17-4114-829a-8659da6bc5f3/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:56:51 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a936fb20-3f17-4114-829a-8659da6bc5f3/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:56:51 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a936fb20-3f17-4114-829a-8659da6bc5f3/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:56:51 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a936fb20-3f17-4114-829a-8659da6bc5f3/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:56:52 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:56:52 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:56:52 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Hypervisor/Node resource view: name=user free_ram=7661MB free_disk=25.960723876953125GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71509) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 10:56:52 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:56:52 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:56:52 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 97f20661-8b60-439e-b7af-2fc2013c5ade actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:56:52 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 97820f17-22d1-4ec3-9721-1edadccc794a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:56:52 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance e479154a-acd6-47aa-9a5b-43c6e0feda07 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:56:52 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 8586a70e-9855-4177-ac1b-cf707a4df871 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:56:52 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 6cae9f61-763f-4671-a873-d15f01384416 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:56:52 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:56:52 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance cd661ae0-c4bb-4117-847d-ef7e85d062fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:56:52 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 6f41f217-0df2-4205-9633-7dbe83f40c96 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:56:52 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance e6580716-8a6a-4dfa-8978-ed54b92af1fe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:56:52 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance a936fb20-3f17-4114-829a-8659da6bc5f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:56:52 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=71509) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 10:56:52 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Final resource view: name=user phys_ram=16023MB used_ram=1792MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=71509) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 10:56:52 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 10:56:52 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 10:56:52 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Compute_service record updated for user:user {{(pid=71509) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 10:56:52 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.453s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:56:54 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 10:56:55 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-77e5bcb5-77b1-4831-ba71-8136b8af2e00 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Acquiring lock "8586a70e-9855-4177-ac1b-cf707a4df871" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:56:55 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-77e5bcb5-77b1-4831-ba71-8136b8af2e00 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "8586a70e-9855-4177-ac1b-cf707a4df871" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:56:55 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-77e5bcb5-77b1-4831-ba71-8136b8af2e00 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Acquiring lock "8586a70e-9855-4177-ac1b-cf707a4df871-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:56:55 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-77e5bcb5-77b1-4831-ba71-8136b8af2e00 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "8586a70e-9855-4177-ac1b-cf707a4df871-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:56:55 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-77e5bcb5-77b1-4831-ba71-8136b8af2e00 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "8586a70e-9855-4177-ac1b-cf707a4df871-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:56:55 user nova-compute[71509]: INFO nova.compute.manager [None req-77e5bcb5-77b1-4831-ba71-8136b8af2e00 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Terminating instance
Apr 14 10:56:55 user nova-compute[71509]: DEBUG nova.compute.manager [None req-77e5bcb5-77b1-4831-ba71-8136b8af2e00 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Start destroying the instance on the hypervisor. {{(pid=71509) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 10:56:55 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:56:56 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:56:56 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:56:56 user nova-compute[71509]: DEBUG nova.compute.manager [req-36787019-6b73-4406-9a7b-52026d578e73 req-d17340e3-881d-40fb-92bb-b6dbb8583724 service nova] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Received event network-vif-unplugged-473d9af8-25a0-4e5a-9afb-7a0c843115cc {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:56:56 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-36787019-6b73-4406-9a7b-52026d578e73 req-d17340e3-881d-40fb-92bb-b6dbb8583724 service nova] Acquiring lock "8586a70e-9855-4177-ac1b-cf707a4df871-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:56:56 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-36787019-6b73-4406-9a7b-52026d578e73 req-d17340e3-881d-40fb-92bb-b6dbb8583724 service nova] Lock "8586a70e-9855-4177-ac1b-cf707a4df871-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:56:56 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-36787019-6b73-4406-9a7b-52026d578e73 req-d17340e3-881d-40fb-92bb-b6dbb8583724 service nova] Lock "8586a70e-9855-4177-ac1b-cf707a4df871-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:56:56 user nova-compute[71509]: DEBUG nova.compute.manager [req-36787019-6b73-4406-9a7b-52026d578e73 req-d17340e3-881d-40fb-92bb-b6dbb8583724 service nova] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] No waiting events found dispatching network-vif-unplugged-473d9af8-25a0-4e5a-9afb-7a0c843115cc {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:56:56 user nova-compute[71509]: DEBUG nova.compute.manager [req-36787019-6b73-4406-9a7b-52026d578e73 req-d17340e3-881d-40fb-92bb-b6dbb8583724 service nova] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Received event network-vif-unplugged-473d9af8-25a0-4e5a-9afb-7a0c843115cc for instance with task_state deleting. {{(pid=71509) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 10:56:56 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-5904b8c6-b5af-4fb7-9a49-579ce19120a7 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Acquiring lock "ade9eacb-d4f9-406d-85c4-043037a4b6ba" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:56:56 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-5904b8c6-b5af-4fb7-9a49-579ce19120a7 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Lock "ade9eacb-d4f9-406d-85c4-043037a4b6ba" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:56:56 user nova-compute[71509]: DEBUG nova.compute.manager [None req-5904b8c6-b5af-4fb7-9a49-579ce19120a7 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] [instance: ade9eacb-d4f9-406d-85c4-043037a4b6ba] Starting instance... {{(pid=71509) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 10:56:56 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:56:56 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-5904b8c6-b5af-4fb7-9a49-579ce19120a7 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:56:56 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-5904b8c6-b5af-4fb7-9a49-579ce19120a7 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:56:56 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-5904b8c6-b5af-4fb7-9a49-579ce19120a7 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71509) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 10:56:56 user nova-compute[71509]: INFO nova.compute.claims [None req-5904b8c6-b5af-4fb7-9a49-579ce19120a7 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] [instance: ade9eacb-d4f9-406d-85c4-043037a4b6ba] Claim successful on node user
Apr 14 10:56:56 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Instance destroyed successfully.
Apr 14 10:56:56 user nova-compute[71509]: DEBUG nova.objects.instance [None req-77e5bcb5-77b1-4831-ba71-8136b8af2e00 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lazy-loading 'resources' on Instance uuid 8586a70e-9855-4177-ac1b-cf707a4df871 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:56:56 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-77e5bcb5-77b1-4831-ba71-8136b8af2e00 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T10:47:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1909620947',display_name='tempest-AttachVolumeTestJSON-server-1909620947',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1909620947',id=16,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB8cubhYj6kalSkwto2AOwwQ8SwXu5MQ/cjSK0TQBgPs7qiNcfKtpFOEItZcvi+VTwGeXlKnu4SiqcBNrbUUIw9hxThGtWyniX5k6WeMBHziH1L0bIiIvkr1gDZ6mYbTMQ==',key_name='tempest-keypair-1352311307',keypairs=<?>,launch_index=0,launched_at=2023-04-14T10:47:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eb9b9fc4f2e244879502006bb844761c',ramdisk_id='',reservation_id='r-043k765a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-821788322',owner_user_name='tempest-AttachVolumeTestJSON-821788322-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T10:55:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11cb4a1e78d447dbb18cde5453fe499c',uuid=8586a70e-9855-4177-ac1b-cf707a4df871,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "473d9af8-25a0-4e5a-9afb-7a0c843115cc", "address": "fa:16:3e:b0:12:bf", "network": {"id": "653f0c81-1afd-4ca6-9639-675ead1a6127", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-932652547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb9b9fc4f2e244879502006bb844761c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap473d9af8-25", "ovs_interfaceid": "473d9af8-25a0-4e5a-9afb-7a0c843115cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 10:56:56 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-77e5bcb5-77b1-4831-ba71-8136b8af2e00 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Converting VIF {"id": "473d9af8-25a0-4e5a-9afb-7a0c843115cc", "address": "fa:16:3e:b0:12:bf", "network": {"id": "653f0c81-1afd-4ca6-9639-675ead1a6127", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-932652547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb9b9fc4f2e244879502006bb844761c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap473d9af8-25", "ovs_interfaceid": "473d9af8-25a0-4e5a-9afb-7a0c843115cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:56:56 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-77e5bcb5-77b1-4831-ba71-8136b8af2e00 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:12:bf,bridge_name='br-int',has_traffic_filtering=True,id=473d9af8-25a0-4e5a-9afb-7a0c843115cc,network=Network(653f0c81-1afd-4ca6-9639-675ead1a6127),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap473d9af8-25') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:56:56 user nova-compute[71509]: DEBUG os_vif [None req-77e5bcb5-77b1-4831-ba71-8136b8af2e00 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:12:bf,bridge_name='br-int',has_traffic_filtering=True,id=473d9af8-25a0-4e5a-9afb-7a0c843115cc,network=Network(653f0c81-1afd-4ca6-9639-675ead1a6127),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap473d9af8-25') {{(pid=71509) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 10:56:56 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:56:56 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap473d9af8-25, bridge=br-int, if_exists=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:56:56 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:56:56 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 10:56:56 user nova-compute[71509]: INFO os_vif [None req-77e5bcb5-77b1-4831-ba71-8136b8af2e00 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:12:bf,bridge_name='br-int',has_traffic_filtering=True,id=473d9af8-25a0-4e5a-9afb-7a0c843115cc,network=Network(653f0c81-1afd-4ca6-9639-675ead1a6127),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap473d9af8-25')
Apr 14 10:56:56 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-77e5bcb5-77b1-4831-ba71-8136b8af2e00 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Deleting instance files /opt/stack/data/nova/instances/8586a70e-9855-4177-ac1b-cf707a4df871_del
Apr 14 10:56:56 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-77e5bcb5-77b1-4831-ba71-8136b8af2e00 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Deletion of /opt/stack/data/nova/instances/8586a70e-9855-4177-ac1b-cf707a4df871_del complete
Apr 14 10:56:56 user nova-compute[71509]: INFO nova.compute.manager [None req-77e5bcb5-77b1-4831-ba71-8136b8af2e00 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Took 0.87 seconds to destroy the instance on the hypervisor.
Apr 14 10:56:56 user nova-compute[71509]: DEBUG oslo.service.loopingcall [None req-77e5bcb5-77b1-4831-ba71-8136b8af2e00 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71509) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 10:56:56 user nova-compute[71509]: DEBUG nova.compute.manager [-] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Deallocating network for instance {{(pid=71509) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 10:56:56 user nova-compute[71509]: DEBUG nova.network.neutron [-] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] deallocate_for_instance() {{(pid=71509) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 10:56:56 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-5904b8c6-b5af-4fb7-9a49-579ce19120a7 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 10:56:56 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-5904b8c6-b5af-4fb7-9a49-579ce19120a7 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 10:56:56 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-5904b8c6-b5af-4fb7-9a49-579ce19120a7 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.440s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:56:56 user nova-compute[71509]: DEBUG nova.compute.manager [None req-5904b8c6-b5af-4fb7-9a49-579ce19120a7 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] [instance: ade9eacb-d4f9-406d-85c4-043037a4b6ba] Start building networks asynchronously for instance. {{(pid=71509) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 10:56:56 user nova-compute[71509]: DEBUG nova.compute.manager [None req-5904b8c6-b5af-4fb7-9a49-579ce19120a7 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] [instance: ade9eacb-d4f9-406d-85c4-043037a4b6ba] Allocating IP information in the background. {{(pid=71509) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 10:56:56 user nova-compute[71509]: DEBUG nova.network.neutron [None req-5904b8c6-b5af-4fb7-9a49-579ce19120a7 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] [instance: ade9eacb-d4f9-406d-85c4-043037a4b6ba] allocate_for_instance() {{(pid=71509) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 10:56:57 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-5904b8c6-b5af-4fb7-9a49-579ce19120a7 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] [instance: ade9eacb-d4f9-406d-85c4-043037a4b6ba] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 10:56:57 user nova-compute[71509]: DEBUG nova.compute.manager [None req-5904b8c6-b5af-4fb7-9a49-579ce19120a7 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] [instance: ade9eacb-d4f9-406d-85c4-043037a4b6ba] Start building block device mappings for instance. {{(pid=71509) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 10:56:57 user nova-compute[71509]: DEBUG nova.compute.manager [None req-5904b8c6-b5af-4fb7-9a49-579ce19120a7 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] [instance: ade9eacb-d4f9-406d-85c4-043037a4b6ba] Start spawning the instance on the hypervisor. {{(pid=71509) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 10:56:57 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-5904b8c6-b5af-4fb7-9a49-579ce19120a7 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] [instance: ade9eacb-d4f9-406d-85c4-043037a4b6ba] Creating instance directory {{(pid=71509) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 10:56:57 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-5904b8c6-b5af-4fb7-9a49-579ce19120a7 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] [instance: ade9eacb-d4f9-406d-85c4-043037a4b6ba] Creating image(s)
Apr 14 10:56:57 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-5904b8c6-b5af-4fb7-9a49-579ce19120a7 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Acquiring lock "/opt/stack/data/nova/instances/ade9eacb-d4f9-406d-85c4-043037a4b6ba/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:56:57 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-5904b8c6-b5af-4fb7-9a49-579ce19120a7 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Lock "/opt/stack/data/nova/instances/ade9eacb-d4f9-406d-85c4-043037a4b6ba/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:56:57 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-5904b8c6-b5af-4fb7-9a49-579ce19120a7 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Lock "/opt/stack/data/nova/instances/ade9eacb-d4f9-406d-85c4-043037a4b6ba/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:56:57 user nova-compute[71509]: DEBUG nova.policy [None req-5904b8c6-b5af-4fb7-9a49-579ce19120a7 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b3f2157c5d4d441db80ea4a3ca60e4dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1c0764b8a843808158644eb90704e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71509) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 10:56:57 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-5904b8c6-b5af-4fb7-9a49-579ce19120a7 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:56:57 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-5904b8c6-b5af-4fb7-9a49-579ce19120a7 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json" returned: 0 in 0.145s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:56:57 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-5904b8c6-b5af-4fb7-9a49-579ce19120a7 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Acquiring lock "5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:56:57 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-5904b8c6-b5af-4fb7-9a49-579ce19120a7 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Lock "5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:56:57 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-5904b8c6-b5af-4fb7-9a49-579ce19120a7 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:56:57 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-5904b8c6-b5af-4fb7-9a49-579ce19120a7 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json" returned: 0 in 0.195s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:56:57 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-5904b8c6-b5af-4fb7-9a49-579ce19120a7 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18,backing_fmt=raw /opt/stack/data/nova/instances/ade9eacb-d4f9-406d-85c4-043037a4b6ba/disk 1073741824 {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:56:57 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-5904b8c6-b5af-4fb7-9a49-579ce19120a7 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18,backing_fmt=raw /opt/stack/data/nova/instances/ade9eacb-d4f9-406d-85c4-043037a4b6ba/disk 1073741824" returned: 0 in 0.053s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:56:57 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-5904b8c6-b5af-4fb7-9a49-579ce19120a7 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Lock "5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.254s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:56:57 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-5904b8c6-b5af-4fb7-9a49-579ce19120a7 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:56:57 user nova-compute[71509]: DEBUG nova.network.neutron [-] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Updating instance_info_cache with network_info: [] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:56:57 user nova-compute[71509]: INFO nova.compute.manager [-] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Took 0.89 seconds to deallocate network for instance.
Apr 14 10:56:57 user nova-compute[71509]: DEBUG nova.compute.manager [req-2a7bfd31-0643-4786-b11f-729a000348e7 req-159edd66-6172-4215-8d72-714d27fe9e94 service nova] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Received event network-vif-deleted-473d9af8-25a0-4e5a-9afb-7a0c843115cc {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:56:57 user nova-compute[71509]: INFO nova.compute.manager [req-2a7bfd31-0643-4786-b11f-729a000348e7 req-159edd66-6172-4215-8d72-714d27fe9e94 service nova] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Neutron deleted interface 473d9af8-25a0-4e5a-9afb-7a0c843115cc; detaching it from the instance and deleting it from the info cache
Apr 14 10:56:57 user nova-compute[71509]: DEBUG nova.network.neutron [req-2a7bfd31-0643-4786-b11f-729a000348e7 req-159edd66-6172-4215-8d72-714d27fe9e94 service nova] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Updating instance_info_cache with network_info: [] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:56:57 user nova-compute[71509]: DEBUG nova.compute.manager [req-2a7bfd31-0643-4786-b11f-729a000348e7 req-159edd66-6172-4215-8d72-714d27fe9e94 service nova] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Detach interface failed, port_id=473d9af8-25a0-4e5a-9afb-7a0c843115cc, reason: Instance 8586a70e-9855-4177-ac1b-cf707a4df871 could not be found. {{(pid=71509) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 10:56:57 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-5904b8c6-b5af-4fb7-9a49-579ce19120a7 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json" returned: 0 in 0.153s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:56:57 user nova-compute[71509]: DEBUG nova.virt.disk.api [None req-5904b8c6-b5af-4fb7-9a49-579ce19120a7 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ade9eacb-d4f9-406d-85c4-043037a4b6ba/disk. size=1073741824 {{(pid=71509) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 10:56:57 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-5904b8c6-b5af-4fb7-9a49-579ce19120a7 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ade9eacb-d4f9-406d-85c4-043037a4b6ba/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:56:57 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-77e5bcb5-77b1-4831-ba71-8136b8af2e00 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:56:57 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-77e5bcb5-77b1-4831-ba71-8136b8af2e00 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:56:57 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-5904b8c6-b5af-4fb7-9a49-579ce19120a7 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ade9eacb-d4f9-406d-85c4-043037a4b6ba/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:56:57 user nova-compute[71509]: DEBUG nova.virt.disk.api [None req-5904b8c6-b5af-4fb7-9a49-579ce19120a7 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Cannot resize image /opt/stack/data/nova/instances/ade9eacb-d4f9-406d-85c4-043037a4b6ba/disk to a smaller size. {{(pid=71509) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 10:56:57 user nova-compute[71509]: DEBUG nova.objects.instance [None req-5904b8c6-b5af-4fb7-9a49-579ce19120a7 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Lazy-loading 'migration_context' on Instance uuid ade9eacb-d4f9-406d-85c4-043037a4b6ba {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:56:57 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-5904b8c6-b5af-4fb7-9a49-579ce19120a7 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] [instance: ade9eacb-d4f9-406d-85c4-043037a4b6ba] Created local disks {{(pid=71509) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 10:56:57 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-5904b8c6-b5af-4fb7-9a49-579ce19120a7 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] [instance: ade9eacb-d4f9-406d-85c4-043037a4b6ba] Ensure instance console log exists: /opt/stack/data/nova/instances/ade9eacb-d4f9-406d-85c4-043037a4b6ba/console.log {{(pid=71509) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 10:56:57 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-5904b8c6-b5af-4fb7-9a49-579ce19120a7 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:56:57 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-5904b8c6-b5af-4fb7-9a49-579ce19120a7 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:56:57 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-5904b8c6-b5af-4fb7-9a49-579ce19120a7 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:56:58 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-77e5bcb5-77b1-4831-ba71-8136b8af2e00 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 10:56:58 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-77e5bcb5-77b1-4831-ba71-8136b8af2e00 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 10:56:58 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-77e5bcb5-77b1-4831-ba71-8136b8af2e00 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.335s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:56:58 user nova-compute[71509]: INFO nova.scheduler.client.report [None req-77e5bcb5-77b1-4831-ba71-8136b8af2e00 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Deleted allocations for instance 8586a70e-9855-4177-ac1b-cf707a4df871
Apr 14 10:56:58 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:56:58 user nova-compute[71509]: DEBUG nova.network.neutron [None req-5904b8c6-b5af-4fb7-9a49-579ce19120a7 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] [instance: ade9eacb-d4f9-406d-85c4-043037a4b6ba] Successfully created port: 2d3b8886-7cd5-44ff-a36d-e576e7b0eabb {{(pid=71509) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 10:56:58 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-77e5bcb5-77b1-4831-ba71-8136b8af2e00 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "8586a70e-9855-4177-ac1b-cf707a4df871" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.342s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:56:58 user nova-compute[71509]: DEBUG nova.compute.manager [req-d14612b3-f3d5-4ddb-bd22-93b239fb667d req-888d4510-dd24-4d5d-b51b-f65ce1ef11f3 service nova] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Received event network-vif-plugged-473d9af8-25a0-4e5a-9afb-7a0c843115cc {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:56:58 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-d14612b3-f3d5-4ddb-bd22-93b239fb667d req-888d4510-dd24-4d5d-b51b-f65ce1ef11f3 service nova] Acquiring lock "8586a70e-9855-4177-ac1b-cf707a4df871-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:56:58 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-d14612b3-f3d5-4ddb-bd22-93b239fb667d req-888d4510-dd24-4d5d-b51b-f65ce1ef11f3 service nova] Lock "8586a70e-9855-4177-ac1b-cf707a4df871-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:56:58 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-d14612b3-f3d5-4ddb-bd22-93b239fb667d req-888d4510-dd24-4d5d-b51b-f65ce1ef11f3 service nova] Lock "8586a70e-9855-4177-ac1b-cf707a4df871-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:56:58 user nova-compute[71509]: DEBUG nova.compute.manager [req-d14612b3-f3d5-4ddb-bd22-93b239fb667d req-888d4510-dd24-4d5d-b51b-f65ce1ef11f3 service nova] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] No waiting events found dispatching network-vif-plugged-473d9af8-25a0-4e5a-9afb-7a0c843115cc {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:56:58 user nova-compute[71509]: WARNING nova.compute.manager [req-d14612b3-f3d5-4ddb-bd22-93b239fb667d req-888d4510-dd24-4d5d-b51b-f65ce1ef11f3 service nova] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Received unexpected event network-vif-plugged-473d9af8-25a0-4e5a-9afb-7a0c843115cc for instance with vm_state deleted and task_state None.
Apr 14 10:56:59 user nova-compute[71509]: DEBUG nova.network.neutron [None req-5904b8c6-b5af-4fb7-9a49-579ce19120a7 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] [instance: ade9eacb-d4f9-406d-85c4-043037a4b6ba] Successfully updated port: 2d3b8886-7cd5-44ff-a36d-e576e7b0eabb {{(pid=71509) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 10:56:59 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-5904b8c6-b5af-4fb7-9a49-579ce19120a7 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Acquiring lock "refresh_cache-ade9eacb-d4f9-406d-85c4-043037a4b6ba" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:56:59 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-5904b8c6-b5af-4fb7-9a49-579ce19120a7 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Acquired lock "refresh_cache-ade9eacb-d4f9-406d-85c4-043037a4b6ba" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:56:59 user nova-compute[71509]: DEBUG nova.network.neutron [None req-5904b8c6-b5af-4fb7-9a49-579ce19120a7 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] [instance: ade9eacb-d4f9-406d-85c4-043037a4b6ba] Building network info cache for instance {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 10:56:59 user nova-compute[71509]: DEBUG nova.compute.manager [req-e6cfea50-a754-4f74-90a1-a2665fbf9397 req-2eabe6cf-d308-45f1-b682-7b634967c568 service nova] [instance: ade9eacb-d4f9-406d-85c4-043037a4b6ba] Received event network-changed-2d3b8886-7cd5-44ff-a36d-e576e7b0eabb {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:56:59 user nova-compute[71509]: DEBUG nova.compute.manager [req-e6cfea50-a754-4f74-90a1-a2665fbf9397 req-2eabe6cf-d308-45f1-b682-7b634967c568 service nova] [instance: ade9eacb-d4f9-406d-85c4-043037a4b6ba] Refreshing instance network info cache due to event network-changed-2d3b8886-7cd5-44ff-a36d-e576e7b0eabb. {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 10:56:59 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-e6cfea50-a754-4f74-90a1-a2665fbf9397 req-2eabe6cf-d308-45f1-b682-7b634967c568 service nova] Acquiring lock "refresh_cache-ade9eacb-d4f9-406d-85c4-043037a4b6ba" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:56:59 user nova-compute[71509]: DEBUG nova.network.neutron [None req-5904b8c6-b5af-4fb7-9a49-579ce19120a7 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] [instance: ade9eacb-d4f9-406d-85c4-043037a4b6ba] Instance cache missing network info. {{(pid=71509) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 10:56:59 user nova-compute[71509]: DEBUG nova.network.neutron [None req-5904b8c6-b5af-4fb7-9a49-579ce19120a7 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] [instance: ade9eacb-d4f9-406d-85c4-043037a4b6ba] Updating instance_info_cache with network_info: [{"id": "2d3b8886-7cd5-44ff-a36d-e576e7b0eabb", "address": "fa:16:3e:4f:aa:d3", "network": {"id": "0d829782-2ea4-4af3-8460-468b818423dc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2082561441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be1c0764b8a843808158644eb90704e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d3b8886-7c", "ovs_interfaceid": "2d3b8886-7cd5-44ff-a36d-e576e7b0eabb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:56:59 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-5904b8c6-b5af-4fb7-9a49-579ce19120a7 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Releasing lock "refresh_cache-ade9eacb-d4f9-406d-85c4-043037a4b6ba" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:56:59 user nova-compute[71509]: DEBUG nova.compute.manager [None req-5904b8c6-b5af-4fb7-9a49-579ce19120a7 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] [instance: ade9eacb-d4f9-406d-85c4-043037a4b6ba] Instance network_info: |[{"id": "2d3b8886-7cd5-44ff-a36d-e576e7b0eabb", "address": "fa:16:3e:4f:aa:d3", "network": {"id": "0d829782-2ea4-4af3-8460-468b818423dc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2082561441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be1c0764b8a843808158644eb90704e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d3b8886-7c", "ovs_interfaceid": "2d3b8886-7cd5-44ff-a36d-e576e7b0eabb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71509) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 10:56:59 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-e6cfea50-a754-4f74-90a1-a2665fbf9397 req-2eabe6cf-d308-45f1-b682-7b634967c568 service nova] Acquired lock "refresh_cache-ade9eacb-d4f9-406d-85c4-043037a4b6ba" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:56:59 user nova-compute[71509]: DEBUG nova.network.neutron [req-e6cfea50-a754-4f74-90a1-a2665fbf9397 req-2eabe6cf-d308-45f1-b682-7b634967c568 service nova] [instance: ade9eacb-d4f9-406d-85c4-043037a4b6ba] Refreshing network info cache for port 2d3b8886-7cd5-44ff-a36d-e576e7b0eabb {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 10:56:59 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-5904b8c6-b5af-4fb7-9a49-579ce19120a7 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] [instance: ade9eacb-d4f9-406d-85c4-043037a4b6ba] Start _get_guest_xml network_info=[{"id": "2d3b8886-7cd5-44ff-a36d-e576e7b0eabb", "address": "fa:16:3e:4f:aa:d3", "network": {"id": "0d829782-2ea4-4af3-8460-468b818423dc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2082561441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be1c0764b8a843808158644eb90704e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d3b8886-7c", "ovs_interfaceid": "2d3b8886-7cd5-44ff-a36d-e576e7b0eabb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T10:38:55Z,direct_url=<?>,disk_format='qcow2',id=048ec0ee-0465-448d-8b4c-f072acb101dc,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='9742d6ad20cf48d9bab0fdbcc9491db9',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T10:38:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '048ec0ee-0465-448d-8b4c-f072acb101dc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71509) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 10:56:59 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-5904b8c6-b5af-4fb7-9a49-579ce19120a7 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:56:59 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-5904b8c6-b5af-4fb7-9a49-579ce19120a7 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:56:59 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-5904b8c6-b5af-4fb7-9a49-579ce19120a7 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71509) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 10:56:59 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-5904b8c6-b5af-4fb7-9a49-579ce19120a7 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T10:40:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T10:38:55Z,direct_url=<?>,disk_format='qcow2',id=048ec0ee-0465-448d-8b4c-f072acb101dc,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='9742d6ad20cf48d9bab0fdbcc9491db9',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T10:38:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 10:56:59 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-5904b8c6-b5af-4fb7-9a49-579ce19120a7 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Flavor limits 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 10:56:59 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-5904b8c6-b5af-4fb7-9a49-579ce19120a7 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Image limits 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 10:56:59 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-5904b8c6-b5af-4fb7-9a49-579ce19120a7 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Flavor pref 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 10:56:59 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-5904b8c6-b5af-4fb7-9a49-579ce19120a7 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Image pref 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 10:56:59 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-5904b8c6-b5af-4fb7-9a49-579ce19120a7 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 10:56:59 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-5904b8c6-b5af-4fb7-9a49-579ce19120a7 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 10:56:59 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-5904b8c6-b5af-4fb7-9a49-579ce19120a7 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71509) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 10:56:59 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-5904b8c6-b5af-4fb7-9a49-579ce19120a7 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Got 1 possible topologies {{(pid=71509) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 10:56:59 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-5904b8c6-b5af-4fb7-9a49-579ce19120a7 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 10:56:59 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-5904b8c6-b5af-4fb7-9a49-579ce19120a7 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 10:56:59 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-5904b8c6-b5af-4fb7-9a49-579ce19120a7 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T10:56:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-810949699',display_name='tempest-ServersNegativeTestJSON-server-810949699',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-810949699',id=29,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='be1c0764b8a843808158644eb90704e6',ramdisk_id='',reservation_id='r-74z5pkh1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1472676568',owner_user_name='tempest-ServersNegativeTestJSON-1472676568-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T10:56:57Z,user_data=None,user_id='b3f2157c5d4d441db80ea4a3ca60e4dc',uuid=ade9eacb-d4f9-406d-85c4-043037a4b6ba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2d3b8886-7cd5-44ff-a36d-e576e7b0eabb", "address": "fa:16:3e:4f:aa:d3", "network": {"id": "0d829782-2ea4-4af3-8460-468b818423dc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2082561441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be1c0764b8a843808158644eb90704e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d3b8886-7c", "ovs_interfaceid": "2d3b8886-7cd5-44ff-a36d-e576e7b0eabb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71509) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 10:56:59 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-5904b8c6-b5af-4fb7-9a49-579ce19120a7 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Converting VIF {"id": "2d3b8886-7cd5-44ff-a36d-e576e7b0eabb", "address": "fa:16:3e:4f:aa:d3", "network": {"id": "0d829782-2ea4-4af3-8460-468b818423dc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2082561441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be1c0764b8a843808158644eb90704e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d3b8886-7c", "ovs_interfaceid": "2d3b8886-7cd5-44ff-a36d-e576e7b0eabb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:56:59 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-5904b8c6-b5af-4fb7-9a49-579ce19120a7 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:aa:d3,bridge_name='br-int',has_traffic_filtering=True,id=2d3b8886-7cd5-44ff-a36d-e576e7b0eabb,network=Network(0d829782-2ea4-4af3-8460-468b818423dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d3b8886-7c') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:56:59 user nova-compute[71509]: DEBUG nova.objects.instance [None req-5904b8c6-b5af-4fb7-9a49-579ce19120a7 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Lazy-loading 'pci_devices' on Instance uuid ade9eacb-d4f9-406d-85c4-043037a4b6ba {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:56:59 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-5904b8c6-b5af-4fb7-9a49-579ce19120a7 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] [instance: ade9eacb-d4f9-406d-85c4-043037a4b6ba] End _get_guest_xml xml=<domain type="kvm">
Apr 14 10:56:59 user nova-compute[71509]:   <uuid>ade9eacb-d4f9-406d-85c4-043037a4b6ba</uuid>
Apr 14 10:56:59 user nova-compute[71509]:   <name>instance-0000001d</name>
Apr 14 10:56:59 user nova-compute[71509]:   <memory>131072</memory>
Apr 14 10:56:59 user nova-compute[71509]:   <vcpu>1</vcpu>
Apr 14 10:56:59 user nova-compute[71509]:   <metadata>
Apr 14 10:56:59 user nova-compute[71509]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 10:56:59 user nova-compute[71509]:       <nova:package version="0.0.0"/>
Apr 14 10:56:59 user nova-compute[71509]:       <nova:name>tempest-ServersNegativeTestJSON-server-810949699</nova:name>
Apr 14 10:56:59 user nova-compute[71509]:       <nova:creationTime>2023-04-14 10:56:59</nova:creationTime>
Apr 14 10:56:59 user nova-compute[71509]:       <nova:flavor name="m1.nano">
Apr 14 10:56:59 user nova-compute[71509]:         <nova:memory>128</nova:memory>
Apr 14 10:56:59 user nova-compute[71509]:         <nova:disk>1</nova:disk>
Apr 14 10:56:59 user nova-compute[71509]:         <nova:swap>0</nova:swap>
Apr 14 10:56:59 user nova-compute[71509]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 10:56:59 user nova-compute[71509]:         <nova:vcpus>1</nova:vcpus>
Apr 14 10:56:59 user nova-compute[71509]:       </nova:flavor>
Apr 14 10:56:59 user nova-compute[71509]:       <nova:owner>
Apr 14 10:56:59 user nova-compute[71509]:         <nova:user uuid="b3f2157c5d4d441db80ea4a3ca60e4dc">tempest-ServersNegativeTestJSON-1472676568-project-member</nova:user>
Apr 14 10:56:59 user nova-compute[71509]:         <nova:project uuid="be1c0764b8a843808158644eb90704e6">tempest-ServersNegativeTestJSON-1472676568</nova:project>
Apr 14 10:56:59 user nova-compute[71509]:       </nova:owner>
Apr 14 10:56:59 user nova-compute[71509]:       <nova:root type="image" uuid="048ec0ee-0465-448d-8b4c-f072acb101dc"/>
Apr 14 10:56:59 user nova-compute[71509]:       <nova:ports>
Apr 14 10:56:59 user nova-compute[71509]:         <nova:port uuid="2d3b8886-7cd5-44ff-a36d-e576e7b0eabb">
Apr 14 10:56:59 user nova-compute[71509]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 14 10:56:59 user nova-compute[71509]:         </nova:port>
Apr 14 10:56:59 user nova-compute[71509]:       </nova:ports>
Apr 14 10:56:59 user nova-compute[71509]:     </nova:instance>
Apr 14 10:56:59 user nova-compute[71509]:   </metadata>
Apr 14 10:56:59 user nova-compute[71509]:   <sysinfo type="smbios">
Apr 14 10:56:59 user nova-compute[71509]:     <system>
Apr 14 10:56:59 user nova-compute[71509]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 10:56:59 user nova-compute[71509]:       <entry name="product">OpenStack Nova</entry>
Apr 14 10:56:59 user nova-compute[71509]:       <entry name="version">0.0.0</entry>
Apr 14 10:56:59 user nova-compute[71509]:       <entry name="serial">ade9eacb-d4f9-406d-85c4-043037a4b6ba</entry>
Apr 14 10:56:59 user nova-compute[71509]:       <entry name="uuid">ade9eacb-d4f9-406d-85c4-043037a4b6ba</entry>
Apr 14 10:56:59 user nova-compute[71509]:       <entry name="family">Virtual Machine</entry>
Apr 14 10:56:59 user nova-compute[71509]:     </system>
Apr 14 10:56:59 user nova-compute[71509]:   </sysinfo>
Apr 14 10:56:59 user nova-compute[71509]:   <os>
Apr 14 10:56:59 user nova-compute[71509]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 10:56:59 user nova-compute[71509]:     <boot dev="hd"/>
Apr 14 10:56:59 user nova-compute[71509]:     <smbios mode="sysinfo"/>
Apr 14 10:56:59 user nova-compute[71509]:   </os>
Apr 14 10:56:59 user nova-compute[71509]:   <features>
Apr 14 10:56:59 user nova-compute[71509]:     <acpi/>
Apr 14 10:56:59 user nova-compute[71509]:     <apic/>
Apr 14 10:56:59 user nova-compute[71509]:     <vmcoreinfo/>
Apr 14 10:56:59 user nova-compute[71509]:   </features>
Apr 14 10:56:59 user nova-compute[71509]:   <clock offset="utc">
Apr 14 10:56:59 user nova-compute[71509]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 10:56:59 user nova-compute[71509]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 10:56:59 user nova-compute[71509]:     <timer name="hpet" present="no"/>
Apr 14 10:56:59 user nova-compute[71509]:   </clock>
Apr 14 10:56:59 user nova-compute[71509]:   <cpu mode="custom" match="exact">
Apr 14 10:56:59 user nova-compute[71509]:     <model>Nehalem</model>
Apr 14 10:56:59 user nova-compute[71509]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 10:56:59 user nova-compute[71509]:   </cpu>
Apr 14 10:56:59 user nova-compute[71509]:   <devices>
Apr 14 10:56:59 user nova-compute[71509]:     <disk type="file" device="disk">
Apr 14 10:56:59 user nova-compute[71509]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 10:56:59 user nova-compute[71509]:       <source file="/opt/stack/data/nova/instances/ade9eacb-d4f9-406d-85c4-043037a4b6ba/disk"/>
Apr 14 10:56:59 user nova-compute[71509]:       <target dev="vda" bus="virtio"/>
Apr 14 10:56:59 user nova-compute[71509]:     </disk>
Apr 14 10:56:59 user nova-compute[71509]:     <interface type="ethernet">
Apr 14 10:56:59 user nova-compute[71509]:       <mac address="fa:16:3e:4f:aa:d3"/>
Apr 14 10:56:59 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 10:56:59 user nova-compute[71509]:       <mtu size="1442"/>
Apr 14 10:56:59 user nova-compute[71509]:       <target dev="tap2d3b8886-7c"/>
Apr 14 10:56:59 user nova-compute[71509]:     </interface>
Apr 14 10:56:59 user nova-compute[71509]:     <serial type="pty">
Apr 14 10:56:59 user nova-compute[71509]:       <log file="/opt/stack/data/nova/instances/ade9eacb-d4f9-406d-85c4-043037a4b6ba/console.log" append="off"/>
Apr 14 10:56:59 user nova-compute[71509]:     </serial>
Apr 14 10:56:59 user nova-compute[71509]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 10:56:59 user nova-compute[71509]:     <video>
Apr 14 10:56:59 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 10:56:59 user nova-compute[71509]:     </video>
Apr 14 10:56:59 user nova-compute[71509]:     <rng model="virtio">
Apr 14 10:56:59 user nova-compute[71509]:       <backend model="random">/dev/urandom</backend>
Apr 14 10:56:59 user nova-compute[71509]:     </rng>
Apr 14 10:56:59 user nova-compute[71509]:     <controller type="usb" index="0" model="none"/>
Apr 14 10:56:59 user nova-compute[71509]:     <memballoon model="virtio">
Apr 14 10:56:59 user nova-compute[71509]:       <stats period="10"/>
Apr 14 10:56:59 user nova-compute[71509]:     </memballoon>
Apr 14 10:56:59 user nova-compute[71509]:   </devices>
Apr 14 10:56:59 user nova-compute[71509]: </domain>
Apr 14 10:56:59 user nova-compute[71509]:  {{(pid=71509) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 10:56:59 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-5904b8c6-b5af-4fb7-9a49-579ce19120a7 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T10:56:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-810949699',display_name='tempest-ServersNegativeTestJSON-server-810949699',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-810949699',id=29,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='be1c0764b8a843808158644eb90704e6',ramdisk_id='',reservation_id='r-74z5pkh1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1472676568',owner_user_name='tempest-ServersNegativeTestJSON-1472676568-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T10:56:57Z,user_data=None,user_id='b3f2157c5d4d441db80ea4a3ca60e4dc',uuid=ade9eacb-d4f9-406d-85c4-043037a4b6ba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2d3b8886-7cd5-44ff-a36d-e576e7b0eabb", "address": "fa:16:3e:4f:aa:d3", "network": {"id": "0d829782-2ea4-4af3-8460-468b818423dc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2082561441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be1c0764b8a843808158644eb90704e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d3b8886-7c", "ovs_interfaceid": "2d3b8886-7cd5-44ff-a36d-e576e7b0eabb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 10:56:59 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-5904b8c6-b5af-4fb7-9a49-579ce19120a7 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Converting VIF {"id": "2d3b8886-7cd5-44ff-a36d-e576e7b0eabb", "address": "fa:16:3e:4f:aa:d3", "network": {"id": "0d829782-2ea4-4af3-8460-468b818423dc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2082561441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be1c0764b8a843808158644eb90704e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d3b8886-7c", "ovs_interfaceid": "2d3b8886-7cd5-44ff-a36d-e576e7b0eabb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:56:59 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-5904b8c6-b5af-4fb7-9a49-579ce19120a7 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:aa:d3,bridge_name='br-int',has_traffic_filtering=True,id=2d3b8886-7cd5-44ff-a36d-e576e7b0eabb,network=Network(0d829782-2ea4-4af3-8460-468b818423dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d3b8886-7c') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:56:59 user nova-compute[71509]: DEBUG os_vif [None req-5904b8c6-b5af-4fb7-9a49-579ce19120a7 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:aa:d3,bridge_name='br-int',has_traffic_filtering=True,id=2d3b8886-7cd5-44ff-a36d-e576e7b0eabb,network=Network(0d829782-2ea4-4af3-8460-468b818423dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d3b8886-7c') {{(pid=71509) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 10:56:59 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:56:59 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:56:59 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 10:56:59 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:56:59 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2d3b8886-7c, may_exist=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:56:59 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2d3b8886-7c, col_values=(('external_ids', {'iface-id': '2d3b8886-7cd5-44ff-a36d-e576e7b0eabb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4f:aa:d3', 'vm-uuid': 'ade9eacb-d4f9-406d-85c4-043037a4b6ba'}),)) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:56:59 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:56:59 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 10:56:59 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-78ab7c60-0a50-4958-a4bf-bfab1f18334f tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Acquiring lock "d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:56:59 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-78ab7c60-0a50-4958-a4bf-bfab1f18334f tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:56:59 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:56:59 user nova-compute[71509]: INFO os_vif [None req-5904b8c6-b5af-4fb7-9a49-579ce19120a7 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:aa:d3,bridge_name='br-int',has_traffic_filtering=True,id=2d3b8886-7cd5-44ff-a36d-e576e7b0eabb,network=Network(0d829782-2ea4-4af3-8460-468b818423dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d3b8886-7c')
Apr 14 10:56:59 user nova-compute[71509]: INFO nova.compute.manager [None req-78ab7c60-0a50-4958-a4bf-bfab1f18334f tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Detaching volume 08f71190-2402-402d-af67-edf9226e4fb8
Apr 14 10:56:59 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-5904b8c6-b5af-4fb7-9a49-579ce19120a7 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] No BDM found with device name vda, not building metadata. {{(pid=71509) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 10:56:59 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-5904b8c6-b5af-4fb7-9a49-579ce19120a7 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] No VIF found with MAC fa:16:3e:4f:aa:d3, not building metadata {{(pid=71509) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 10:56:59 user nova-compute[71509]: INFO nova.virt.block_device [None req-78ab7c60-0a50-4958-a4bf-bfab1f18334f tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Attempting to driver detach volume 08f71190-2402-402d-af67-edf9226e4fb8 from mountpoint /dev/vdb
Apr 14 10:56:59 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-78ab7c60-0a50-4958-a4bf-bfab1f18334f tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Attempting to detach device vdb from instance d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5 from the persistent domain config. {{(pid=71509) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 10:56:59 user nova-compute[71509]: DEBUG nova.virt.libvirt.guest [None req-78ab7c60-0a50-4958-a4bf-bfab1f18334f tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 10:56:59 user nova-compute[71509]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 10:56:59 user nova-compute[71509]:   <source dev="/dev/sdc"/>
Apr 14 10:56:59 user nova-compute[71509]:   <target dev="vdb" bus="virtio"/>
Apr 14 10:56:59 user nova-compute[71509]:   <serial>08f71190-2402-402d-af67-edf9226e4fb8</serial>
Apr 14 10:56:59 user nova-compute[71509]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 10:56:59 user nova-compute[71509]: </disk>
Apr 14 10:56:59 user nova-compute[71509]:  {{(pid=71509) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 10:56:59 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-78ab7c60-0a50-4958-a4bf-bfab1f18334f tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Successfully detached device vdb from instance d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5 from the persistent domain config.
Apr 14 10:56:59 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-78ab7c60-0a50-4958-a4bf-bfab1f18334f tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5 from the live domain config. {{(pid=71509) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 10:56:59 user nova-compute[71509]: DEBUG nova.virt.libvirt.guest [None req-78ab7c60-0a50-4958-a4bf-bfab1f18334f tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 10:56:59 user nova-compute[71509]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 10:56:59 user nova-compute[71509]:   <source dev="/dev/sdc"/>
Apr 14 10:56:59 user nova-compute[71509]:   <target dev="vdb" bus="virtio"/>
Apr 14 10:56:59 user nova-compute[71509]:   <serial>08f71190-2402-402d-af67-edf9226e4fb8</serial>
Apr 14 10:56:59 user nova-compute[71509]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 10:56:59 user nova-compute[71509]: </disk>
Apr 14 10:56:59 user nova-compute[71509]:  {{(pid=71509) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 10:57:00 user nova-compute[71509]: DEBUG nova.compute.manager [req-baaf5148-1a4c-4d12-a281-120d7b62df19 req-00c7c07c-862e-4e32-97a1-a9dcfb44ff1d service nova] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Received event network-changed-f2196ef3-aada-48d6-b524-5e9cef6a9eda {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:57:00 user nova-compute[71509]: DEBUG nova.compute.manager [req-baaf5148-1a4c-4d12-a281-120d7b62df19 req-00c7c07c-862e-4e32-97a1-a9dcfb44ff1d service nova] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Refreshing instance network info cache due to event network-changed-f2196ef3-aada-48d6-b524-5e9cef6a9eda. {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 10:57:00 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-baaf5148-1a4c-4d12-a281-120d7b62df19 req-00c7c07c-862e-4e32-97a1-a9dcfb44ff1d service nova] Acquiring lock "refresh_cache-d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:57:00 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-baaf5148-1a4c-4d12-a281-120d7b62df19 req-00c7c07c-862e-4e32-97a1-a9dcfb44ff1d service nova] Acquired lock "refresh_cache-d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:57:00 user nova-compute[71509]: DEBUG nova.network.neutron [req-baaf5148-1a4c-4d12-a281-120d7b62df19 req-00c7c07c-862e-4e32-97a1-a9dcfb44ff1d service nova] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Refreshing network info cache for port f2196ef3-aada-48d6-b524-5e9cef6a9eda {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 10:57:00 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Received event <DeviceRemovedEvent: 1681469820.393577, d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71509) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 10:57:00 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-78ab7c60-0a50-4958-a4bf-bfab1f18334f tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5 {{(pid=71509) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 10:57:00 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-78ab7c60-0a50-4958-a4bf-bfab1f18334f tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Successfully detached device vdb from instance d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5 from the live domain config.
Apr 14 10:57:00 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78ab7c60-0a50-4958-a4bf-bfab1f18334f tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] calling os-brick to detach iSCSI Volume {{(pid=71509) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 10:57:00 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-78ab7c60-0a50-4958-a4bf-bfab1f18334f tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0bf0749390>, {'target_iqn': 'iqn.2010-10.org.openstack:08f71190-2402-402d-af67-edf9226e4fb8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UrvhzlJj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 10:57:00 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-78ab7c60-0a50-4958-a4bf-bfab1f18334f tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 10:57:00 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-78ab7c60-0a50-4958-a4bf-bfab1f18334f tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 10:57:00 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-78ab7c60-0a50-4958-a4bf-bfab1f18334f tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 10:57:00 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:57:00 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:57:00 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[221cd14f-ab5f-45db-9f48-919827659521]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:08f71190-2402-402d-af67-edf9226e4fb8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:57:00 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-78ab7c60-0a50-4958-a4bf-bfab1f18334f tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 10:57:00 user nova-compute[71509]: No targets found.
Apr 14 10:57:00 user nova-compute[71509]: iSNS:
Apr 14 10:57:00 user nova-compute[71509]: No targets found.
Apr 14 10:57:00 user nova-compute[71509]: STATIC:
Apr 14 10:57:00 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:08f71190-2402-402d-af67-edf9226e4fb8
Apr 14 10:57:00 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:57:00 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:57:00 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178
Apr 14 10:57:00 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:57:00 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:57:00 user nova-compute[71509]: FIRMWARE:
Apr 14 10:57:00 user nova-compute[71509]: No targets found.
Apr 14 10:57:00 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:57:00 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-78ab7c60-0a50-4958-a4bf-bfab1f18334f tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 10:57:00 user nova-compute[71509]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 10:57:00 user nova-compute[71509]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71509) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 10:57:00 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-78ab7c60-0a50-4958-a4bf-bfab1f18334f tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:08f71190-2402-402d-af67-edf9226e4fb8', 0)] {{(pid=71509) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 10:57:00 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:57:00 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:57:00 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[1df1be19-ccfd-49ac-82eb-ebdf76d197c7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:08f71190-2402-402d-af67-edf9226e4fb8\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:57:00 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:57:00 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:57:00 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[85ec6e5e-34f5-45c3-916c-ccd95bce2d34]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08f71190-2402-402d-af67-edf9226e4fb8 (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:57:00 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-78ab7c60-0a50-4958-a4bf-bfab1f18334f tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)
Apr 14 10:57:00 user nova-compute[71509]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08f71190-2402-402d-af67-edf9226e4fb8 (non-flash)
Apr 14 10:57:00 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:57:00 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-78ab7c60-0a50-4958-a4bf-bfab1f18334f tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)
Apr 14 10:57:00 user nova-compute[71509]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08f71190-2402-402d-af67-edf9226e4fb8 (non-flash)
Apr 14 10:57:00 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 10:57:00 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-78ab7c60-0a50-4958-a4bf-bfab1f18334f tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0c141c2cb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:08f71190-2402-402d-af67-edf9226e4fb8'): ({'sdc'}, set())}) {{(pid=71509) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 10:57:00 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-78ab7c60-0a50-4958-a4bf-bfab1f18334f tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Removing single pathed devices sdc {{(pid=71509) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 10:57:00 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:57:00 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:57:00 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3431c36-6b13-405a-bc3c-8e0b43b0ab89]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:57:00 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:57:00 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:57:00 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[22b97b41-3244-4fa4-a367-e4eab8104ef4]: (4, ('ok\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:57:00 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-78ab7c60-0a50-4958-a4bf-bfab1f18334f tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Flushing IO for device /dev/sdc {{(pid=71509) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 10:57:00 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:57:00 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:57:00 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[06592c7d-2dc2-4da6-a2ec-8866fcca9063]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:57:00 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-78ab7c60-0a50-4958-a4bf-bfab1f18334f tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71509) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 10:57:00 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:57:00 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-a0a5eea0-ae83-4433-8b68-873dc5ef9456 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "cd661ae0-c4bb-4117-847d-ef7e85d062fb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:57:00 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-a0a5eea0-ae83-4433-8b68-873dc5ef9456 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "cd661ae0-c4bb-4117-847d-ef7e85d062fb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:57:00 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-a0a5eea0-ae83-4433-8b68-873dc5ef9456 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "cd661ae0-c4bb-4117-847d-ef7e85d062fb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:57:00 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-a0a5eea0-ae83-4433-8b68-873dc5ef9456 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "cd661ae0-c4bb-4117-847d-ef7e85d062fb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:57:00 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-a0a5eea0-ae83-4433-8b68-873dc5ef9456 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "cd661ae0-c4bb-4117-847d-ef7e85d062fb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:57:00 user nova-compute[71509]: INFO nova.compute.manager [None req-a0a5eea0-ae83-4433-8b68-873dc5ef9456 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: cd661ae0-c4bb-4117-847d-ef7e85d062fb] Terminating instance
Apr 14 10:57:00 user nova-compute[71509]: DEBUG nova.compute.manager [None req-a0a5eea0-ae83-4433-8b68-873dc5ef9456 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: cd661ae0-c4bb-4117-847d-ef7e85d062fb] Start destroying the instance on the hypervisor. {{(pid=71509) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 10:57:00 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.052s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:57:00 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[7125cbf1-dc8c-427f-b6e2-9e8f09a22680]: (4, ('1', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:57:00 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-78ab7c60-0a50-4958-a4bf-bfab1f18334f tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71509) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 10:57:00 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-78ab7c60-0a50-4958-a4bf-bfab1f18334f tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] SCSI volumes sdc have been removed. {{(pid=71509) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 10:57:00 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-78ab7c60-0a50-4958-a4bf-bfab1f18334f tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:08f71190-2402-402d-af67-edf9226e4fb8')] {{(pid=71509) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 10:57:00 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08f71190-2402-402d-af67-edf9226e4fb8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:57:00 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08f71190-2402-402d-af67-edf9226e4fb8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:57:00 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[73da2e0d-0779-4db1-8f9b-2bcb299554c8]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:57:00 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-78ab7c60-0a50-4958-a4bf-bfab1f18334f tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:57:00 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08f71190-2402-402d-af67-edf9226e4fb8 -p 172.16.0.220:3260 --logout {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:57:00 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:57:00 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:57:00 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:57:00 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:57:00 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08f71190-2402-402d-af67-edf9226e4fb8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.085s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:57:00 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[a41f6608-9784-4f4f-b736-27d964780322]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:08f71190-2402-402d-af67-edf9226e4fb8, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:08f71190-2402-402d-af67-edf9226e4fb8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:57:00 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-78ab7c60-0a50-4958-a4bf-bfab1f18334f tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:08f71190-2402-402d-af67-edf9226e4fb8, portal: 172.16.0.220,3260]
Apr 14 10:57:00 user nova-compute[71509]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:08f71190-2402-402d-af67-edf9226e4fb8, portal: 172.16.0.220,3260] successful.
Apr 14 10:57:00 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:57:00 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08f71190-2402-402d-af67-edf9226e4fb8 -p 172.16.0.220:3260 --op delete {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:57:00 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:57:00 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08f71190-2402-402d-af67-edf9226e4fb8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:57:00 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[d27483d3-be34-4905-b63c-30fbc3e308ec]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:57:00 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-78ab7c60-0a50-4958-a4bf-bfab1f18334f tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:57:00 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-78ab7c60-0a50-4958-a4bf-bfab1f18334f tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.348s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 10:57:00 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-78ab7c60-0a50-4958-a4bf-bfab1f18334f tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] <== disconnect_volume: return (349ms) None {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 10:57:00 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78ab7c60-0a50-4958-a4bf-bfab1f18334f tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Disconnected iSCSI Volume {{(pid=71509) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 10:57:00 user nova-compute[71509]: DEBUG nova.network.neutron [req-e6cfea50-a754-4f74-90a1-a2665fbf9397 req-2eabe6cf-d308-45f1-b682-7b634967c568 service nova] [instance: ade9eacb-d4f9-406d-85c4-043037a4b6ba] Updated VIF entry in instance network info cache for port 2d3b8886-7cd5-44ff-a36d-e576e7b0eabb. {{(pid=71509) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 10:57:00 user nova-compute[71509]: DEBUG nova.network.neutron [req-e6cfea50-a754-4f74-90a1-a2665fbf9397 req-2eabe6cf-d308-45f1-b682-7b634967c568 service nova] [instance: ade9eacb-d4f9-406d-85c4-043037a4b6ba] Updating instance_info_cache with network_info: [{"id": "2d3b8886-7cd5-44ff-a36d-e576e7b0eabb", "address": "fa:16:3e:4f:aa:d3", "network": {"id": "0d829782-2ea4-4af3-8460-468b818423dc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2082561441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be1c0764b8a843808158644eb90704e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d3b8886-7c", "ovs_interfaceid": "2d3b8886-7cd5-44ff-a36d-e576e7b0eabb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:57:00 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-e6cfea50-a754-4f74-90a1-a2665fbf9397 req-2eabe6cf-d308-45f1-b682-7b634967c568 service nova] Releasing lock "refresh_cache-ade9eacb-d4f9-406d-85c4-043037a4b6ba" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:57:00 user nova-compute[71509]: DEBUG nova.network.neutron [req-baaf5148-1a4c-4d12-a281-120d7b62df19 req-00c7c07c-862e-4e32-97a1-a9dcfb44ff1d service nova] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Updated VIF entry in instance network info cache for port f2196ef3-aada-48d6-b524-5e9cef6a9eda. {{(pid=71509) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 10:57:00 user nova-compute[71509]: DEBUG nova.network.neutron [req-baaf5148-1a4c-4d12-a281-120d7b62df19 req-00c7c07c-862e-4e32-97a1-a9dcfb44ff1d service nova] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Updating instance_info_cache with network_info: [{"id": "f2196ef3-aada-48d6-b524-5e9cef6a9eda", "address": "fa:16:3e:e7:31:44", "network": {"id": "22eb5f87-be4d-447d-bafe-25e0284ea3ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-787804772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf93e5dac50342d0b65ef09711401e99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2196ef3-aa", "ovs_interfaceid": "f2196ef3-aada-48d6-b524-5e9cef6a9eda", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:57:01 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-baaf5148-1a4c-4d12-a281-120d7b62df19 req-00c7c07c-862e-4e32-97a1-a9dcfb44ff1d service nova] Releasing lock "refresh_cache-d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:57:01 user nova-compute[71509]: DEBUG nova.compute.manager [req-baaf5148-1a4c-4d12-a281-120d7b62df19 req-00c7c07c-862e-4e32-97a1-a9dcfb44ff1d service nova] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Received event network-changed-f2196ef3-aada-48d6-b524-5e9cef6a9eda {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:57:01 user nova-compute[71509]: DEBUG nova.compute.manager [req-baaf5148-1a4c-4d12-a281-120d7b62df19 req-00c7c07c-862e-4e32-97a1-a9dcfb44ff1d service nova] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Refreshing instance network info cache due to event network-changed-f2196ef3-aada-48d6-b524-5e9cef6a9eda. {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 10:57:01 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-baaf5148-1a4c-4d12-a281-120d7b62df19 req-00c7c07c-862e-4e32-97a1-a9dcfb44ff1d service nova] Acquiring lock "refresh_cache-d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:57:01 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-baaf5148-1a4c-4d12-a281-120d7b62df19 req-00c7c07c-862e-4e32-97a1-a9dcfb44ff1d service nova] Acquired lock "refresh_cache-d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:57:01 user nova-compute[71509]: DEBUG nova.network.neutron [req-baaf5148-1a4c-4d12-a281-120d7b62df19 req-00c7c07c-862e-4e32-97a1-a9dcfb44ff1d service nova] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Refreshing network info cache for port f2196ef3-aada-48d6-b524-5e9cef6a9eda {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 10:57:01 user nova-compute[71509]: DEBUG nova.compute.manager [req-9f2fc4eb-883d-4e8f-bf72-f4ece1b7ccd1 req-109fea85-7b63-4611-b809-dd2388f5fd95 service nova] [instance: cd661ae0-c4bb-4117-847d-ef7e85d062fb] Received event network-vif-unplugged-e2fa8ebc-482c-460c-924a-26111123a1d5 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:57:01 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-9f2fc4eb-883d-4e8f-bf72-f4ece1b7ccd1 req-109fea85-7b63-4611-b809-dd2388f5fd95 service nova] Acquiring lock "cd661ae0-c4bb-4117-847d-ef7e85d062fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:57:01 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-9f2fc4eb-883d-4e8f-bf72-f4ece1b7ccd1 req-109fea85-7b63-4611-b809-dd2388f5fd95 service nova] Lock "cd661ae0-c4bb-4117-847d-ef7e85d062fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:57:01 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-9f2fc4eb-883d-4e8f-bf72-f4ece1b7ccd1 req-109fea85-7b63-4611-b809-dd2388f5fd95 service nova] Lock "cd661ae0-c4bb-4117-847d-ef7e85d062fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:57:01 user nova-compute[71509]: DEBUG nova.compute.manager [req-9f2fc4eb-883d-4e8f-bf72-f4ece1b7ccd1 req-109fea85-7b63-4611-b809-dd2388f5fd95 service nova] [instance: cd661ae0-c4bb-4117-847d-ef7e85d062fb] No waiting events found dispatching network-vif-unplugged-e2fa8ebc-482c-460c-924a-26111123a1d5 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:57:01 user nova-compute[71509]: DEBUG nova.compute.manager [req-9f2fc4eb-883d-4e8f-bf72-f4ece1b7ccd1 req-109fea85-7b63-4611-b809-dd2388f5fd95 service nova] [instance: cd661ae0-c4bb-4117-847d-ef7e85d062fb] Received event network-vif-unplugged-e2fa8ebc-482c-460c-924a-26111123a1d5 for instance with task_state deleting. {{(pid=71509) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 10:57:01 user nova-compute[71509]: DEBUG nova.compute.manager [req-9f2fc4eb-883d-4e8f-bf72-f4ece1b7ccd1 req-109fea85-7b63-4611-b809-dd2388f5fd95 service nova] [instance: cd661ae0-c4bb-4117-847d-ef7e85d062fb] Received event network-vif-plugged-e2fa8ebc-482c-460c-924a-26111123a1d5 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:57:01 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-9f2fc4eb-883d-4e8f-bf72-f4ece1b7ccd1 req-109fea85-7b63-4611-b809-dd2388f5fd95 service nova] Acquiring lock "cd661ae0-c4bb-4117-847d-ef7e85d062fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:57:01 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-9f2fc4eb-883d-4e8f-bf72-f4ece1b7ccd1 req-109fea85-7b63-4611-b809-dd2388f5fd95 service nova] Lock "cd661ae0-c4bb-4117-847d-ef7e85d062fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:57:01 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-9f2fc4eb-883d-4e8f-bf72-f4ece1b7ccd1 req-109fea85-7b63-4611-b809-dd2388f5fd95 service nova] Lock "cd661ae0-c4bb-4117-847d-ef7e85d062fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:57:01 user nova-compute[71509]: DEBUG nova.compute.manager [req-9f2fc4eb-883d-4e8f-bf72-f4ece1b7ccd1 req-109fea85-7b63-4611-b809-dd2388f5fd95 service nova] [instance: cd661ae0-c4bb-4117-847d-ef7e85d062fb] No waiting events found dispatching network-vif-plugged-e2fa8ebc-482c-460c-924a-26111123a1d5 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:57:01 user nova-compute[71509]: WARNING nova.compute.manager [req-9f2fc4eb-883d-4e8f-bf72-f4ece1b7ccd1 req-109fea85-7b63-4611-b809-dd2388f5fd95 service nova] [instance: cd661ae0-c4bb-4117-847d-ef7e85d062fb] Received unexpected event network-vif-plugged-e2fa8ebc-482c-460c-924a-26111123a1d5 for instance with vm_state active and task_state deleting.
Apr 14 10:57:01 user nova-compute[71509]: DEBUG nova.network.neutron [req-baaf5148-1a4c-4d12-a281-120d7b62df19 req-00c7c07c-862e-4e32-97a1-a9dcfb44ff1d service nova] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Updated VIF entry in instance network info cache for port f2196ef3-aada-48d6-b524-5e9cef6a9eda. {{(pid=71509) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 10:57:01 user nova-compute[71509]: DEBUG nova.network.neutron [req-baaf5148-1a4c-4d12-a281-120d7b62df19 req-00c7c07c-862e-4e32-97a1-a9dcfb44ff1d service nova] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Updating instance_info_cache with network_info: [{"id": "f2196ef3-aada-48d6-b524-5e9cef6a9eda", "address": "fa:16:3e:e7:31:44", "network": {"id": "22eb5f87-be4d-447d-bafe-25e0284ea3ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-787804772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf93e5dac50342d0b65ef09711401e99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2196ef3-aa", "ovs_interfaceid": "f2196ef3-aada-48d6-b524-5e9cef6a9eda", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:57:01 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-baaf5148-1a4c-4d12-a281-120d7b62df19 req-00c7c07c-862e-4e32-97a1-a9dcfb44ff1d service nova] Releasing lock "refresh_cache-d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:57:01 user nova-compute[71509]: DEBUG nova.objects.instance [None req-78ab7c60-0a50-4958-a4bf-bfab1f18334f tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lazy-loading 'flavor' on Instance uuid d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:57:01 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: cd661ae0-c4bb-4117-847d-ef7e85d062fb] Instance destroyed successfully.
Apr 14 10:57:01 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-78ab7c60-0a50-4958-a4bf-bfab1f18334f tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.973s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:57:01 user nova-compute[71509]: DEBUG nova.objects.instance [None req-a0a5eea0-ae83-4433-8b68-873dc5ef9456 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lazy-loading 'resources' on Instance uuid cd661ae0-c4bb-4117-847d-ef7e85d062fb {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:57:01 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:57:01 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-a0a5eea0-ae83-4433-8b68-873dc5ef9456 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T10:51:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-917305574',display_name='tempest-AttachVolumeNegativeTest-server-917305574',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-917305574',id=23,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNeYGYiTcJWVdyGLLXUUtNmeqpPAuLbYzcQtlw/K/cx7u5I+/z+BFqZ/Q85m4vszeUjxdAJi787/sHm5PWAgol4M4ijgjZBMAK6LdEVj2SxKBuOkTED+u+J8G5CKwgGGjA==',key_name='tempest-keypair-388083155',keypairs=<?>,launch_index=0,launched_at=2023-04-14T10:51:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cb8f294f957f4c74ae959c1e9f238427',ramdisk_id='',reservation_id='r-908kfe5a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-531644967',owner_user_name='tempest-AttachVolumeNegativeTest-531644967-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T10:51:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='78adbbdcd10e446daddde754e46309b2',uuid=cd661ae0-c4bb-4117-847d-ef7e85d062fb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e2fa8ebc-482c-460c-924a-26111123a1d5", "address": "fa:16:3e:d2:b7:64", "network": {"id": "b639a68a-2b4e-435c-b98b-65b5b4981c73", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1070821894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb8f294f957f4c74ae959c1e9f238427", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2fa8ebc-48", "ovs_interfaceid": "e2fa8ebc-482c-460c-924a-26111123a1d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 10:57:01 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-a0a5eea0-ae83-4433-8b68-873dc5ef9456 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Converting VIF {"id": "e2fa8ebc-482c-460c-924a-26111123a1d5", "address": "fa:16:3e:d2:b7:64", "network": {"id": "b639a68a-2b4e-435c-b98b-65b5b4981c73", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1070821894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb8f294f957f4c74ae959c1e9f238427", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2fa8ebc-48", "ovs_interfaceid": "e2fa8ebc-482c-460c-924a-26111123a1d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:57:01 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-a0a5eea0-ae83-4433-8b68-873dc5ef9456 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d2:b7:64,bridge_name='br-int',has_traffic_filtering=True,id=e2fa8ebc-482c-460c-924a-26111123a1d5,network=Network(b639a68a-2b4e-435c-b98b-65b5b4981c73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2fa8ebc-48') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:57:01 user nova-compute[71509]: DEBUG os_vif [None req-a0a5eea0-ae83-4433-8b68-873dc5ef9456 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d2:b7:64,bridge_name='br-int',has_traffic_filtering=True,id=e2fa8ebc-482c-460c-924a-26111123a1d5,network=Network(b639a68a-2b4e-435c-b98b-65b5b4981c73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2fa8ebc-48') {{(pid=71509) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 10:57:01 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:57:01 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape2fa8ebc-48, bridge=br-int, if_exists=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:57:01 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:57:01 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 10:57:01 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:57:01 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:57:01 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:57:01 user nova-compute[71509]: INFO os_vif [None req-a0a5eea0-ae83-4433-8b68-873dc5ef9456 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d2:b7:64,bridge_name='br-int',has_traffic_filtering=True,id=e2fa8ebc-482c-460c-924a-26111123a1d5,network=Network(b639a68a-2b4e-435c-b98b-65b5b4981c73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2fa8ebc-48')
Apr 14 10:57:01 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-a0a5eea0-ae83-4433-8b68-873dc5ef9456 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: cd661ae0-c4bb-4117-847d-ef7e85d062fb] Deleting instance files /opt/stack/data/nova/instances/cd661ae0-c4bb-4117-847d-ef7e85d062fb_del
Apr 14 10:57:01 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-a0a5eea0-ae83-4433-8b68-873dc5ef9456 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: cd661ae0-c4bb-4117-847d-ef7e85d062fb] Deletion of /opt/stack/data/nova/instances/cd661ae0-c4bb-4117-847d-ef7e85d062fb_del complete
Apr 14 10:57:01 user nova-compute[71509]: INFO nova.compute.manager [None req-a0a5eea0-ae83-4433-8b68-873dc5ef9456 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: cd661ae0-c4bb-4117-847d-ef7e85d062fb] Took 1.21 seconds to destroy the instance on the hypervisor.
Apr 14 10:57:01 user nova-compute[71509]: DEBUG oslo.service.loopingcall [None req-a0a5eea0-ae83-4433-8b68-873dc5ef9456 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71509) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 10:57:01 user nova-compute[71509]: DEBUG nova.compute.manager [-] [instance: cd661ae0-c4bb-4117-847d-ef7e85d062fb] Deallocating network for instance {{(pid=71509) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 10:57:01 user nova-compute[71509]: DEBUG nova.network.neutron [-] [instance: cd661ae0-c4bb-4117-847d-ef7e85d062fb] deallocate_for_instance() {{(pid=71509) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 10:57:01 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:57:01 user nova-compute[71509]: DEBUG nova.compute.manager [req-46b23aa7-7166-4f0c-b986-5287bc8760d6 req-549671b2-e747-4263-86d9-6c94aceaba05 service nova] [instance: ade9eacb-d4f9-406d-85c4-043037a4b6ba] Received event network-vif-plugged-2d3b8886-7cd5-44ff-a36d-e576e7b0eabb {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:57:01 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-46b23aa7-7166-4f0c-b986-5287bc8760d6 req-549671b2-e747-4263-86d9-6c94aceaba05 service nova] Acquiring lock "ade9eacb-d4f9-406d-85c4-043037a4b6ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:57:01 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-46b23aa7-7166-4f0c-b986-5287bc8760d6 req-549671b2-e747-4263-86d9-6c94aceaba05 service nova] Lock "ade9eacb-d4f9-406d-85c4-043037a4b6ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:57:01 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-46b23aa7-7166-4f0c-b986-5287bc8760d6 req-549671b2-e747-4263-86d9-6c94aceaba05 service nova] Lock "ade9eacb-d4f9-406d-85c4-043037a4b6ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:57:01 user nova-compute[71509]: DEBUG nova.compute.manager [req-46b23aa7-7166-4f0c-b986-5287bc8760d6 req-549671b2-e747-4263-86d9-6c94aceaba05 service nova] [instance: ade9eacb-d4f9-406d-85c4-043037a4b6ba] No waiting events found dispatching network-vif-plugged-2d3b8886-7cd5-44ff-a36d-e576e7b0eabb {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:57:01 user nova-compute[71509]: WARNING nova.compute.manager [req-46b23aa7-7166-4f0c-b986-5287bc8760d6 req-549671b2-e747-4263-86d9-6c94aceaba05 service nova] [instance: ade9eacb-d4f9-406d-85c4-043037a4b6ba] Received unexpected event network-vif-plugged-2d3b8886-7cd5-44ff-a36d-e576e7b0eabb for instance with vm_state building and task_state spawning.
Apr 14 10:57:02 user nova-compute[71509]: DEBUG nova.network.neutron [-] [instance: cd661ae0-c4bb-4117-847d-ef7e85d062fb] Updating instance_info_cache with network_info: [] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:57:02 user nova-compute[71509]: INFO nova.compute.manager [-] [instance: cd661ae0-c4bb-4117-847d-ef7e85d062fb] Took 1.09 seconds to deallocate network for instance.
Apr 14 10:57:02 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-a0a5eea0-ae83-4433-8b68-873dc5ef9456 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:57:02 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-a0a5eea0-ae83-4433-8b68-873dc5ef9456 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:57:03 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:57:03 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-a0a5eea0-ae83-4433-8b68-873dc5ef9456 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 10:57:03 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-a0a5eea0-ae83-4433-8b68-873dc5ef9456 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 10:57:03 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-a0a5eea0-ae83-4433-8b68-873dc5ef9456 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.329s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:57:03 user nova-compute[71509]: INFO nova.scheduler.client.report [None req-a0a5eea0-ae83-4433-8b68-873dc5ef9456 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Deleted allocations for instance cd661ae0-c4bb-4117-847d-ef7e85d062fb
Apr 14 10:57:03 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-a0a5eea0-ae83-4433-8b68-873dc5ef9456 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "cd661ae0-c4bb-4117-847d-ef7e85d062fb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.821s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:57:03 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681469823.8709602, ade9eacb-d4f9-406d-85c4-043037a4b6ba => Resumed> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 10:57:03 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: ade9eacb-d4f9-406d-85c4-043037a4b6ba] VM Resumed (Lifecycle Event)
Apr 14 10:57:03 user nova-compute[71509]: DEBUG nova.compute.manager [None req-5904b8c6-b5af-4fb7-9a49-579ce19120a7 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] [instance: ade9eacb-d4f9-406d-85c4-043037a4b6ba] Instance event wait completed in 0 seconds for  {{(pid=71509) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 10:57:03 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-5904b8c6-b5af-4fb7-9a49-579ce19120a7 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] [instance: ade9eacb-d4f9-406d-85c4-043037a4b6ba] Guest created on hypervisor {{(pid=71509) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 10:57:03 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: ade9eacb-d4f9-406d-85c4-043037a4b6ba] Instance spawned successfully.
Apr 14 10:57:03 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-5904b8c6-b5af-4fb7-9a49-579ce19120a7 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] [instance: ade9eacb-d4f9-406d-85c4-043037a4b6ba] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 10:57:03 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: ade9eacb-d4f9-406d-85c4-043037a4b6ba] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:57:03 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: ade9eacb-d4f9-406d-85c4-043037a4b6ba] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 10:57:03 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-5904b8c6-b5af-4fb7-9a49-579ce19120a7 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] [instance: ade9eacb-d4f9-406d-85c4-043037a4b6ba] Found default for hw_cdrom_bus of ide {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:57:03 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-5904b8c6-b5af-4fb7-9a49-579ce19120a7 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] [instance: ade9eacb-d4f9-406d-85c4-043037a4b6ba] Found default for hw_disk_bus of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:57:03 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-5904b8c6-b5af-4fb7-9a49-579ce19120a7 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] [instance: ade9eacb-d4f9-406d-85c4-043037a4b6ba] Found default for hw_input_bus of None {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:57:03 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-5904b8c6-b5af-4fb7-9a49-579ce19120a7 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] [instance: ade9eacb-d4f9-406d-85c4-043037a4b6ba] Found default for hw_pointer_model of None {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:57:03 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-5904b8c6-b5af-4fb7-9a49-579ce19120a7 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] [instance: ade9eacb-d4f9-406d-85c4-043037a4b6ba] Found default for hw_video_model of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:57:03 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-5904b8c6-b5af-4fb7-9a49-579ce19120a7 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] [instance: ade9eacb-d4f9-406d-85c4-043037a4b6ba] Found default for hw_vif_model of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:57:03 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: ade9eacb-d4f9-406d-85c4-043037a4b6ba] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 10:57:03 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681469823.87231, ade9eacb-d4f9-406d-85c4-043037a4b6ba => Started> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 10:57:03 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: ade9eacb-d4f9-406d-85c4-043037a4b6ba] VM Started (Lifecycle Event)
Apr 14 10:57:03 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: ade9eacb-d4f9-406d-85c4-043037a4b6ba] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:57:03 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: ade9eacb-d4f9-406d-85c4-043037a4b6ba] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 10:57:03 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: ade9eacb-d4f9-406d-85c4-043037a4b6ba] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 10:57:03 user nova-compute[71509]: INFO nova.compute.manager [None req-5904b8c6-b5af-4fb7-9a49-579ce19120a7 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] [instance: ade9eacb-d4f9-406d-85c4-043037a4b6ba] Took 6.81 seconds to spawn the instance on the hypervisor.
Apr 14 10:57:03 user nova-compute[71509]: DEBUG nova.compute.manager [None req-5904b8c6-b5af-4fb7-9a49-579ce19120a7 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] [instance: ade9eacb-d4f9-406d-85c4-043037a4b6ba] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:57:04 user nova-compute[71509]: DEBUG nova.compute.manager [req-93f9d55d-692f-428a-9c8d-166b80ad304e req-7bc89970-7b7a-4415-aa1f-b3f1ab5067a3 service nova] [instance: ade9eacb-d4f9-406d-85c4-043037a4b6ba] Received event network-vif-plugged-2d3b8886-7cd5-44ff-a36d-e576e7b0eabb {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:57:04 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-93f9d55d-692f-428a-9c8d-166b80ad304e req-7bc89970-7b7a-4415-aa1f-b3f1ab5067a3 service nova] Acquiring lock "ade9eacb-d4f9-406d-85c4-043037a4b6ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:57:04 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-93f9d55d-692f-428a-9c8d-166b80ad304e req-7bc89970-7b7a-4415-aa1f-b3f1ab5067a3 service nova] Lock "ade9eacb-d4f9-406d-85c4-043037a4b6ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:57:04 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-93f9d55d-692f-428a-9c8d-166b80ad304e req-7bc89970-7b7a-4415-aa1f-b3f1ab5067a3 service nova] Lock "ade9eacb-d4f9-406d-85c4-043037a4b6ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:57:04 user nova-compute[71509]: DEBUG nova.compute.manager [req-93f9d55d-692f-428a-9c8d-166b80ad304e req-7bc89970-7b7a-4415-aa1f-b3f1ab5067a3 service nova] [instance: ade9eacb-d4f9-406d-85c4-043037a4b6ba] No waiting events found dispatching network-vif-plugged-2d3b8886-7cd5-44ff-a36d-e576e7b0eabb {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:57:04 user nova-compute[71509]: WARNING nova.compute.manager [req-93f9d55d-692f-428a-9c8d-166b80ad304e req-7bc89970-7b7a-4415-aa1f-b3f1ab5067a3 service nova] [instance: ade9eacb-d4f9-406d-85c4-043037a4b6ba] Received unexpected event network-vif-plugged-2d3b8886-7cd5-44ff-a36d-e576e7b0eabb for instance with vm_state building and task_state spawning.
Apr 14 10:57:04 user nova-compute[71509]: DEBUG nova.compute.manager [req-93f9d55d-692f-428a-9c8d-166b80ad304e req-7bc89970-7b7a-4415-aa1f-b3f1ab5067a3 service nova] [instance: cd661ae0-c4bb-4117-847d-ef7e85d062fb] Received event network-vif-deleted-e2fa8ebc-482c-460c-924a-26111123a1d5 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:57:04 user nova-compute[71509]: INFO nova.compute.manager [None req-5904b8c6-b5af-4fb7-9a49-579ce19120a7 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] [instance: ade9eacb-d4f9-406d-85c4-043037a4b6ba] Took 7.58 seconds to build instance.
Apr 14 10:57:04 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-5904b8c6-b5af-4fb7-9a49-579ce19120a7 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Lock "ade9eacb-d4f9-406d-85c4-043037a4b6ba" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.668s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:57:06 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:57:07 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-5c9d6003-9cb7-4736-ae86-70756540a01f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Acquiring lock "fe152ebd-4f99-4fa8-bfdb-8744cdf3f387" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:57:07 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-5c9d6003-9cb7-4736-ae86-70756540a01f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "fe152ebd-4f99-4fa8-bfdb-8744cdf3f387" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:57:07 user nova-compute[71509]: INFO nova.compute.manager [None req-5c9d6003-9cb7-4736-ae86-70756540a01f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] Unshelving
Apr 14 10:57:07 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-5c9d6003-9cb7-4736-ae86-70756540a01f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:57:07 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-5c9d6003-9cb7-4736-ae86-70756540a01f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:57:07 user nova-compute[71509]: DEBUG nova.objects.instance [None req-5c9d6003-9cb7-4736-ae86-70756540a01f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lazy-loading 'pci_requests' on Instance uuid fe152ebd-4f99-4fa8-bfdb-8744cdf3f387 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:57:07 user nova-compute[71509]: DEBUG nova.objects.instance [None req-5c9d6003-9cb7-4736-ae86-70756540a01f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lazy-loading 'numa_topology' on Instance uuid fe152ebd-4f99-4fa8-bfdb-8744cdf3f387 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:57:07 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-5c9d6003-9cb7-4736-ae86-70756540a01f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71509) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 10:57:07 user nova-compute[71509]: INFO nova.compute.claims [None req-5c9d6003-9cb7-4736-ae86-70756540a01f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] Claim successful on node user
Apr 14 10:57:07 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-5c9d6003-9cb7-4736-ae86-70756540a01f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 10:57:07 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-5c9d6003-9cb7-4736-ae86-70756540a01f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 10:57:07 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-5c9d6003-9cb7-4736-ae86-70756540a01f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.407s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:57:07 user nova-compute[71509]: INFO nova.network.neutron [None req-5c9d6003-9cb7-4736-ae86-70756540a01f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] Updating port 1a142b11-f1ec-41d4-9728-f9f0de9a96ff with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Apr 14 10:57:08 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:57:08 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-5c9d6003-9cb7-4736-ae86-70756540a01f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Acquiring lock "refresh_cache-fe152ebd-4f99-4fa8-bfdb-8744cdf3f387" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:57:08 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-5c9d6003-9cb7-4736-ae86-70756540a01f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Acquired lock "refresh_cache-fe152ebd-4f99-4fa8-bfdb-8744cdf3f387" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:57:08 user nova-compute[71509]: DEBUG nova.network.neutron [None req-5c9d6003-9cb7-4736-ae86-70756540a01f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] Building network info cache for instance {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 10:57:08 user nova-compute[71509]: DEBUG nova.compute.manager [req-36232f41-ad04-43be-a04d-6d43f8777355 req-cf7ad858-95bc-4445-a3eb-0f546527771f service nova] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] Received event network-changed-1a142b11-f1ec-41d4-9728-f9f0de9a96ff {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:57:08 user nova-compute[71509]: DEBUG nova.compute.manager [req-36232f41-ad04-43be-a04d-6d43f8777355 req-cf7ad858-95bc-4445-a3eb-0f546527771f service nova] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] Refreshing instance network info cache due to event network-changed-1a142b11-f1ec-41d4-9728-f9f0de9a96ff. {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 10:57:08 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-36232f41-ad04-43be-a04d-6d43f8777355 req-cf7ad858-95bc-4445-a3eb-0f546527771f service nova] Acquiring lock "refresh_cache-fe152ebd-4f99-4fa8-bfdb-8744cdf3f387" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:57:09 user nova-compute[71509]: DEBUG nova.network.neutron [None req-5c9d6003-9cb7-4736-ae86-70756540a01f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] Updating instance_info_cache with network_info: [{"id": "1a142b11-f1ec-41d4-9728-f9f0de9a96ff", "address": "fa:16:3e:96:f1:e3", "network": {"id": "1cb09253-66a4-4c81-82d0-c6d948e0aed4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1557121746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8a9941095d445f48d70df26d8c90e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a142b11-f1", "ovs_interfaceid": "1a142b11-f1ec-41d4-9728-f9f0de9a96ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:57:09 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-5c9d6003-9cb7-4736-ae86-70756540a01f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Releasing lock "refresh_cache-fe152ebd-4f99-4fa8-bfdb-8744cdf3f387" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:57:09 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-5c9d6003-9cb7-4736-ae86-70756540a01f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] Creating instance directory {{(pid=71509) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 10:57:09 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-5c9d6003-9cb7-4736-ae86-70756540a01f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] Creating image(s)
Apr 14 10:57:09 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-5c9d6003-9cb7-4736-ae86-70756540a01f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Acquiring lock "/opt/stack/data/nova/instances/fe152ebd-4f99-4fa8-bfdb-8744cdf3f387/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:57:09 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-5c9d6003-9cb7-4736-ae86-70756540a01f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "/opt/stack/data/nova/instances/fe152ebd-4f99-4fa8-bfdb-8744cdf3f387/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:57:09 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-5c9d6003-9cb7-4736-ae86-70756540a01f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "/opt/stack/data/nova/instances/fe152ebd-4f99-4fa8-bfdb-8744cdf3f387/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:57:09 user nova-compute[71509]: DEBUG nova.objects.instance [None req-5c9d6003-9cb7-4736-ae86-70756540a01f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lazy-loading 'trusted_certs' on Instance uuid fe152ebd-4f99-4fa8-bfdb-8744cdf3f387 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:57:09 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-36232f41-ad04-43be-a04d-6d43f8777355 req-cf7ad858-95bc-4445-a3eb-0f546527771f service nova] Acquired lock "refresh_cache-fe152ebd-4f99-4fa8-bfdb-8744cdf3f387" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:57:09 user nova-compute[71509]: DEBUG nova.network.neutron [req-36232f41-ad04-43be-a04d-6d43f8777355 req-cf7ad858-95bc-4445-a3eb-0f546527771f service nova] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] Refreshing network info cache for port 1a142b11-f1ec-41d4-9728-f9f0de9a96ff {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 10:57:09 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-5c9d6003-9cb7-4736-ae86-70756540a01f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Acquiring lock "da9e2fc411325a89fa8ca14eb35fd7f347f4bb02" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:57:09 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-5c9d6003-9cb7-4736-ae86-70756540a01f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "da9e2fc411325a89fa8ca14eb35fd7f347f4bb02" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:57:10 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-5c9d6003-9cb7-4736-ae86-70756540a01f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da9e2fc411325a89fa8ca14eb35fd7f347f4bb02.part --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:57:10 user nova-compute[71509]: DEBUG nova.compute.manager [req-f8793eae-b0e4-46de-9c4c-423d41683a56 req-138d76d3-e10d-4405-90ef-7b9f1b7e54d6 service nova] [instance: e6580716-8a6a-4dfa-8978-ed54b92af1fe] Received event network-changed-3019f976-f679-4826-8510-3de34b67807c {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:57:10 user nova-compute[71509]: DEBUG nova.compute.manager [req-f8793eae-b0e4-46de-9c4c-423d41683a56 req-138d76d3-e10d-4405-90ef-7b9f1b7e54d6 service nova] [instance: e6580716-8a6a-4dfa-8978-ed54b92af1fe] Refreshing instance network info cache due to event network-changed-3019f976-f679-4826-8510-3de34b67807c. {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 10:57:10 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-f8793eae-b0e4-46de-9c4c-423d41683a56 req-138d76d3-e10d-4405-90ef-7b9f1b7e54d6 service nova] Acquiring lock "refresh_cache-e6580716-8a6a-4dfa-8978-ed54b92af1fe" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:57:10 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-f8793eae-b0e4-46de-9c4c-423d41683a56 req-138d76d3-e10d-4405-90ef-7b9f1b7e54d6 service nova] Acquired lock "refresh_cache-e6580716-8a6a-4dfa-8978-ed54b92af1fe" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:57:10 user nova-compute[71509]: DEBUG nova.network.neutron [req-f8793eae-b0e4-46de-9c4c-423d41683a56 req-138d76d3-e10d-4405-90ef-7b9f1b7e54d6 service nova] [instance: e6580716-8a6a-4dfa-8978-ed54b92af1fe] Refreshing network info cache for port 3019f976-f679-4826-8510-3de34b67807c {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 10:57:10 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-5c9d6003-9cb7-4736-ae86-70756540a01f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da9e2fc411325a89fa8ca14eb35fd7f347f4bb02.part --force-share --output=json" returned: 0 in 0.151s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:57:10 user nova-compute[71509]: DEBUG nova.virt.images [None req-5c9d6003-9cb7-4736-ae86-70756540a01f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] 87833300-56ce-406c-b6a0-555e2a239c9b was qcow2, converting to raw {{(pid=71509) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 14 10:57:10 user nova-compute[71509]: DEBUG nova.privsep.utils [None req-5c9d6003-9cb7-4736-ae86-70756540a01f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71509) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 10:57:10 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-5c9d6003-9cb7-4736-ae86-70756540a01f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/da9e2fc411325a89fa8ca14eb35fd7f347f4bb02.part /opt/stack/data/nova/instances/_base/da9e2fc411325a89fa8ca14eb35fd7f347f4bb02.converted {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:57:11 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-287cd5f9-e61f-4733-8828-d3c52ef4846a tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Acquiring lock "e6580716-8a6a-4dfa-8978-ed54b92af1fe" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:57:11 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-287cd5f9-e61f-4733-8828-d3c52ef4846a tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "e6580716-8a6a-4dfa-8978-ed54b92af1fe" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:57:11 user nova-compute[71509]: DEBUG nova.objects.instance [None req-287cd5f9-e61f-4733-8828-d3c52ef4846a tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lazy-loading 'flavor' on Instance uuid e6580716-8a6a-4dfa-8978-ed54b92af1fe {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:57:11 user nova-compute[71509]: DEBUG nova.network.neutron [req-36232f41-ad04-43be-a04d-6d43f8777355 req-cf7ad858-95bc-4445-a3eb-0f546527771f service nova] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] Updated VIF entry in instance network info cache for port 1a142b11-f1ec-41d4-9728-f9f0de9a96ff. {{(pid=71509) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 10:57:11 user nova-compute[71509]: DEBUG nova.network.neutron [req-36232f41-ad04-43be-a04d-6d43f8777355 req-cf7ad858-95bc-4445-a3eb-0f546527771f service nova] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] Updating instance_info_cache with network_info: [{"id": "1a142b11-f1ec-41d4-9728-f9f0de9a96ff", "address": "fa:16:3e:96:f1:e3", "network": {"id": "1cb09253-66a4-4c81-82d0-c6d948e0aed4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1557121746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8a9941095d445f48d70df26d8c90e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a142b11-f1", "ovs_interfaceid": "1a142b11-f1ec-41d4-9728-f9f0de9a96ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:57:11 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-5c9d6003-9cb7-4736-ae86-70756540a01f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/da9e2fc411325a89fa8ca14eb35fd7f347f4bb02.part /opt/stack/data/nova/instances/_base/da9e2fc411325a89fa8ca14eb35fd7f347f4bb02.converted" returned: 0 in 0.559s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:57:11 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-5c9d6003-9cb7-4736-ae86-70756540a01f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da9e2fc411325a89fa8ca14eb35fd7f347f4bb02.converted --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:57:11 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-287cd5f9-e61f-4733-8828-d3c52ef4846a tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "e6580716-8a6a-4dfa-8978-ed54b92af1fe" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.328s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:57:11 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-36232f41-ad04-43be-a04d-6d43f8777355 req-cf7ad858-95bc-4445-a3eb-0f546527771f service nova] Releasing lock "refresh_cache-fe152ebd-4f99-4fa8-bfdb-8744cdf3f387" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:57:11 user nova-compute[71509]: DEBUG nova.network.neutron [req-f8793eae-b0e4-46de-9c4c-423d41683a56 req-138d76d3-e10d-4405-90ef-7b9f1b7e54d6 service nova] [instance: e6580716-8a6a-4dfa-8978-ed54b92af1fe] Updated VIF entry in instance network info cache for port 3019f976-f679-4826-8510-3de34b67807c. {{(pid=71509) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 10:57:11 user nova-compute[71509]: DEBUG nova.network.neutron [req-f8793eae-b0e4-46de-9c4c-423d41683a56 req-138d76d3-e10d-4405-90ef-7b9f1b7e54d6 service nova] [instance: e6580716-8a6a-4dfa-8978-ed54b92af1fe] Updating instance_info_cache with network_info: [{"id": "3019f976-f679-4826-8510-3de34b67807c", "address": "fa:16:3e:57:1a:d3", "network": {"id": "1fdeb048-706a-45bf-8f2a-2cee21abb9ea", "bridge": "br-int", "label": "tempest-TestStampPattern-1337046138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f629ba0ab8074ed8bb4e59d545b74eb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3019f976-f6", "ovs_interfaceid": "3019f976-f679-4826-8510-3de34b67807c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:57:11 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-f8793eae-b0e4-46de-9c4c-423d41683a56 req-138d76d3-e10d-4405-90ef-7b9f1b7e54d6 service nova] Releasing lock "refresh_cache-e6580716-8a6a-4dfa-8978-ed54b92af1fe" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:57:11 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-5c9d6003-9cb7-4736-ae86-70756540a01f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da9e2fc411325a89fa8ca14eb35fd7f347f4bb02.converted --force-share --output=json" returned: 0 in 0.141s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:57:11 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-5c9d6003-9cb7-4736-ae86-70756540a01f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "da9e2fc411325a89fa8ca14eb35fd7f347f4bb02" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.703s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:57:11 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-5c9d6003-9cb7-4736-ae86-70756540a01f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da9e2fc411325a89fa8ca14eb35fd7f347f4bb02 --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:57:11 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-287cd5f9-e61f-4733-8828-d3c52ef4846a tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Acquiring lock "e6580716-8a6a-4dfa-8978-ed54b92af1fe" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:57:11 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-287cd5f9-e61f-4733-8828-d3c52ef4846a tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "e6580716-8a6a-4dfa-8978-ed54b92af1fe" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:57:11 user nova-compute[71509]: INFO nova.compute.manager [None req-287cd5f9-e61f-4733-8828-d3c52ef4846a tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] [instance: e6580716-8a6a-4dfa-8978-ed54b92af1fe] Attaching volume f488d00e-998a-40d7-9e77-1bca2436fd95 to /dev/vdb
Apr 14 10:57:11 user nova-compute[71509]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681469816.653154, 8586a70e-9855-4177-ac1b-cf707a4df871 => Stopped> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 10:57:11 user nova-compute[71509]: INFO nova.compute.manager [-] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] VM Stopped (Lifecycle Event)
Apr 14 10:57:11 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-5c9d6003-9cb7-4736-ae86-70756540a01f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da9e2fc411325a89fa8ca14eb35fd7f347f4bb02 --force-share --output=json" returned: 0 in 0.147s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:57:11 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-5c9d6003-9cb7-4736-ae86-70756540a01f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Acquiring lock "da9e2fc411325a89fa8ca14eb35fd7f347f4bb02" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:57:11 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-5c9d6003-9cb7-4736-ae86-70756540a01f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "da9e2fc411325a89fa8ca14eb35fd7f347f4bb02" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:57:11 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-5c9d6003-9cb7-4736-ae86-70756540a01f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da9e2fc411325a89fa8ca14eb35fd7f347f4bb02 --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:57:11 user nova-compute[71509]: DEBUG os_brick.utils [None req-287cd5f9-e61f-4733-8828-d3c52ef4846a tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 10:57:11 user nova-compute[71509]: DEBUG nova.compute.manager [None req-c15b03df-8139-46fc-82c3-a0b7183dd488 None None] [instance: 8586a70e-9855-4177-ac1b-cf707a4df871] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:57:11 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:57:11 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:57:11 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:57:11 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[44b22b7b-98bf-4214-bd4d-54ed78f024cc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50119df3c417\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:57:11 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:57:11 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:57:11 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9247efa-8cda-4d0c-a2c5-6ad4870d43f9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:57:11 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:57:11 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:57:11 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[21f08ade-c50a-41b9-ad9f-c824aef13ebd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:57:11 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[36845aef-1032-42f8-8d51-8606dfa9d88c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:57:11 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-287cd5f9-e61f-4733-8828-d3c52ef4846a tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Running cmd (subprocess): nvme version {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:57:11 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-287cd5f9-e61f-4733-8828-d3c52ef4846a tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] 'nvme version' failed. Not Retrying. {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 10:57:11 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.nvmeof [None req-287cd5f9-e61f-4733-8828-d3c52ef4846a tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] nvme not present on system {{(pid=71509) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 10:57:11 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-5c9d6003-9cb7-4736-ae86-70756540a01f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da9e2fc411325a89fa8ca14eb35fd7f347f4bb02 --force-share --output=json" returned: 0 in 0.164s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:57:11 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-5c9d6003-9cb7-4736-ae86-70756540a01f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/da9e2fc411325a89fa8ca14eb35fd7f347f4bb02,backing_fmt=raw /opt/stack/data/nova/instances/fe152ebd-4f99-4fa8-bfdb-8744cdf3f387/disk 1073741824 {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:57:11 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:57:11 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 10:57:11 user nova-compute[71509]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 10:57:11 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[d32f59ac-6c60-40b8-a438-bd7929bce179]: (4, '') {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:57:11 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-287cd5f9-e61f-4733-8828-d3c52ef4846a tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71509) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 10:57:11 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-287cd5f9-e61f-4733-8828-d3c52ef4846a tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71509) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 10:57:11 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-287cd5f9-e61f-4733-8828-d3c52ef4846a tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] LIGHTOS: no hostnqn found. {{(pid=71509) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 10:57:11 user nova-compute[71509]: DEBUG os_brick.utils [None req-287cd5f9-e61f-4733-8828-d3c52ef4846a tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] <== get_connector_properties: return (179ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50119df3c417', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 10:57:11 user nova-compute[71509]: DEBUG nova.virt.block_device [None req-287cd5f9-e61f-4733-8828-d3c52ef4846a tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] [instance: e6580716-8a6a-4dfa-8978-ed54b92af1fe] Updating existing volume attachment record: 50ba1c9a-ba9a-483d-b2b7-c54a568d0982 {{(pid=71509) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 10:57:11 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-5c9d6003-9cb7-4736-ae86-70756540a01f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/da9e2fc411325a89fa8ca14eb35fd7f347f4bb02,backing_fmt=raw /opt/stack/data/nova/instances/fe152ebd-4f99-4fa8-bfdb-8744cdf3f387/disk 1073741824" returned: 0 in 0.078s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:57:11 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-5c9d6003-9cb7-4736-ae86-70756540a01f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "da9e2fc411325a89fa8ca14eb35fd7f347f4bb02" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:57:11 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-5c9d6003-9cb7-4736-ae86-70756540a01f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da9e2fc411325a89fa8ca14eb35fd7f347f4bb02 --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:57:12 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-5c9d6003-9cb7-4736-ae86-70756540a01f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da9e2fc411325a89fa8ca14eb35fd7f347f4bb02 --force-share --output=json" returned: 0 in 0.143s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:57:12 user nova-compute[71509]: DEBUG nova.objects.instance [None req-5c9d6003-9cb7-4736-ae86-70756540a01f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lazy-loading 'migration_context' on Instance uuid fe152ebd-4f99-4fa8-bfdb-8744cdf3f387 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:57:12 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-5c9d6003-9cb7-4736-ae86-70756540a01f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] Rebasing disk image.
Apr 14 10:57:12 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-5c9d6003-9cb7-4736-ae86-70756540a01f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:57:12 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-5c9d6003-9cb7-4736-ae86-70756540a01f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json" returned: 0 in 0.138s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:57:12 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-5c9d6003-9cb7-4736-ae86-70756540a01f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 -F raw /opt/stack/data/nova/instances/fe152ebd-4f99-4fa8-bfdb-8744cdf3f387/disk {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:57:13 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:57:14 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-5c9d6003-9cb7-4736-ae86-70756540a01f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 -F raw /opt/stack/data/nova/instances/fe152ebd-4f99-4fa8-bfdb-8744cdf3f387/disk" returned: 0 in 2.036s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:57:14 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-5c9d6003-9cb7-4736-ae86-70756540a01f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] Created local disks {{(pid=71509) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 10:57:14 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-5c9d6003-9cb7-4736-ae86-70756540a01f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] Ensure instance console log exists: /opt/stack/data/nova/instances/fe152ebd-4f99-4fa8-bfdb-8744cdf3f387/console.log {{(pid=71509) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 10:57:14 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-5c9d6003-9cb7-4736-ae86-70756540a01f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:57:14 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-5c9d6003-9cb7-4736-ae86-70756540a01f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:57:14 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-5c9d6003-9cb7-4736-ae86-70756540a01f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:57:14 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-5c9d6003-9cb7-4736-ae86-70756540a01f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] Start _get_guest_xml network_info=[{"id": "1a142b11-f1ec-41d4-9728-f9f0de9a96ff", "address": "fa:16:3e:96:f1:e3", "network": {"id": "1cb09253-66a4-4c81-82d0-c6d948e0aed4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1557121746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8a9941095d445f48d70df26d8c90e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a142b11-f1", "ovs_interfaceid": "1a142b11-f1ec-41d4-9728-f9f0de9a96ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='3029ce52d5b4163472a1ab249462499b',container_format='bare',created_at=2023-04-14T10:55:15Z,direct_url=<?>,disk_format='qcow2',id=87833300-56ce-406c-b6a0-555e2a239c9b,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1556975659-shelved',owner='f8a9941095d445f48d70df26d8c90e6c',properties=ImageMetaProps,protected=<?>,size=38600704,status='active',tags=<?>,updated_at=2023-04-14T10:55:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '048ec0ee-0465-448d-8b4c-f072acb101dc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71509) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 10:57:14 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-5c9d6003-9cb7-4736-ae86-70756540a01f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:57:14 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-5c9d6003-9cb7-4736-ae86-70756540a01f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:57:14 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-5c9d6003-9cb7-4736-ae86-70756540a01f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71509) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 10:57:14 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-5c9d6003-9cb7-4736-ae86-70756540a01f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T10:40:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='3029ce52d5b4163472a1ab249462499b',container_format='bare',created_at=2023-04-14T10:55:15Z,direct_url=<?>,disk_format='qcow2',id=87833300-56ce-406c-b6a0-555e2a239c9b,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1556975659-shelved',owner='f8a9941095d445f48d70df26d8c90e6c',properties=ImageMetaProps,protected=<?>,size=38600704,status='active',tags=<?>,updated_at=2023-04-14T10:55:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 10:57:14 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-5c9d6003-9cb7-4736-ae86-70756540a01f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Flavor limits 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 10:57:14 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-5c9d6003-9cb7-4736-ae86-70756540a01f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Image limits 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 10:57:14 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-5c9d6003-9cb7-4736-ae86-70756540a01f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Flavor pref 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 10:57:14 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-5c9d6003-9cb7-4736-ae86-70756540a01f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Image pref 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 10:57:14 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-5c9d6003-9cb7-4736-ae86-70756540a01f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 10:57:14 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-5c9d6003-9cb7-4736-ae86-70756540a01f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 10:57:14 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-5c9d6003-9cb7-4736-ae86-70756540a01f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71509) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 10:57:14 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-5c9d6003-9cb7-4736-ae86-70756540a01f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Got 1 possible topologies {{(pid=71509) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 10:57:14 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-5c9d6003-9cb7-4736-ae86-70756540a01f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 10:57:14 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-5c9d6003-9cb7-4736-ae86-70756540a01f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 10:57:14 user nova-compute[71509]: DEBUG nova.objects.instance [None req-5c9d6003-9cb7-4736-ae86-70756540a01f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lazy-loading 'vcpu_model' on Instance uuid fe152ebd-4f99-4fa8-bfdb-8744cdf3f387 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:57:14 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-5c9d6003-9cb7-4736-ae86-70756540a01f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T10:53:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1556975659',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1556975659',id=24,image_ref='87833300-56ce-406c-b6a0-555e2a239c9b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-2083532637',keypairs=<?>,launch_index=0,launched_at=2023-04-14T10:53:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='f8a9941095d445f48d70df26d8c90e6c',ramdisk_id='',reservation_id='r-tlsa2xby',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1250068675',owner_user_name='tempest-AttachVolumeShelveTestJSON-1250068675-project-member',shelved_at='2023-04-14T10:55:19.582584',shelved_host='user',shelved_image_id='87833300-56ce-406c-b6a0-555e2a239c9b'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T10:57:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5afd3930d3a14aff8124a4782ec79870',uuid=fe152ebd-4f99-4fa8-bfdb-8744cdf3f387,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "1a142b11-f1ec-41d4-9728-f9f0de9a96ff", "address": "fa:16:3e:96:f1:e3", "network": {"id": "1cb09253-66a4-4c81-82d0-c6d948e0aed4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1557121746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8a9941095d445f48d70df26d8c90e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a142b11-f1", "ovs_interfaceid": "1a142b11-f1ec-41d4-9728-f9f0de9a96ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71509) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 10:57:14 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-5c9d6003-9cb7-4736-ae86-70756540a01f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Converting VIF {"id": "1a142b11-f1ec-41d4-9728-f9f0de9a96ff", "address": "fa:16:3e:96:f1:e3", "network": {"id": "1cb09253-66a4-4c81-82d0-c6d948e0aed4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1557121746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8a9941095d445f48d70df26d8c90e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a142b11-f1", "ovs_interfaceid": "1a142b11-f1ec-41d4-9728-f9f0de9a96ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:57:14 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-5c9d6003-9cb7-4736-ae86-70756540a01f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:f1:e3,bridge_name='br-int',has_traffic_filtering=True,id=1a142b11-f1ec-41d4-9728-f9f0de9a96ff,network=Network(1cb09253-66a4-4c81-82d0-c6d948e0aed4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a142b11-f1') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:57:14 user nova-compute[71509]: DEBUG nova.objects.instance [None req-5c9d6003-9cb7-4736-ae86-70756540a01f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lazy-loading 'pci_devices' on Instance uuid fe152ebd-4f99-4fa8-bfdb-8744cdf3f387 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:57:14 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-5c9d6003-9cb7-4736-ae86-70756540a01f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] End _get_guest_xml xml=<domain type="kvm">
Apr 14 10:57:14 user nova-compute[71509]:   <uuid>fe152ebd-4f99-4fa8-bfdb-8744cdf3f387</uuid>
Apr 14 10:57:14 user nova-compute[71509]:   <name>instance-00000018</name>
Apr 14 10:57:14 user nova-compute[71509]:   <memory>131072</memory>
Apr 14 10:57:14 user nova-compute[71509]:   <vcpu>1</vcpu>
Apr 14 10:57:14 user nova-compute[71509]:   <metadata>
Apr 14 10:57:14 user nova-compute[71509]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 10:57:14 user nova-compute[71509]:       <nova:package version="0.0.0"/>
Apr 14 10:57:14 user nova-compute[71509]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1556975659</nova:name>
Apr 14 10:57:14 user nova-compute[71509]:       <nova:creationTime>2023-04-14 10:57:14</nova:creationTime>
Apr 14 10:57:14 user nova-compute[71509]:       <nova:flavor name="m1.nano">
Apr 14 10:57:14 user nova-compute[71509]:         <nova:memory>128</nova:memory>
Apr 14 10:57:14 user nova-compute[71509]:         <nova:disk>1</nova:disk>
Apr 14 10:57:14 user nova-compute[71509]:         <nova:swap>0</nova:swap>
Apr 14 10:57:14 user nova-compute[71509]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 10:57:14 user nova-compute[71509]:         <nova:vcpus>1</nova:vcpus>
Apr 14 10:57:14 user nova-compute[71509]:       </nova:flavor>
Apr 14 10:57:14 user nova-compute[71509]:       <nova:owner>
Apr 14 10:57:14 user nova-compute[71509]:         <nova:user uuid="5afd3930d3a14aff8124a4782ec79870">tempest-AttachVolumeShelveTestJSON-1250068675-project-member</nova:user>
Apr 14 10:57:14 user nova-compute[71509]:         <nova:project uuid="f8a9941095d445f48d70df26d8c90e6c">tempest-AttachVolumeShelveTestJSON-1250068675</nova:project>
Apr 14 10:57:14 user nova-compute[71509]:       </nova:owner>
Apr 14 10:57:14 user nova-compute[71509]:       <nova:root type="image" uuid="87833300-56ce-406c-b6a0-555e2a239c9b"/>
Apr 14 10:57:14 user nova-compute[71509]:       <nova:ports>
Apr 14 10:57:14 user nova-compute[71509]:         <nova:port uuid="1a142b11-f1ec-41d4-9728-f9f0de9a96ff">
Apr 14 10:57:14 user nova-compute[71509]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 14 10:57:14 user nova-compute[71509]:         </nova:port>
Apr 14 10:57:14 user nova-compute[71509]:       </nova:ports>
Apr 14 10:57:14 user nova-compute[71509]:     </nova:instance>
Apr 14 10:57:14 user nova-compute[71509]:   </metadata>
Apr 14 10:57:14 user nova-compute[71509]:   <sysinfo type="smbios">
Apr 14 10:57:14 user nova-compute[71509]:     <system>
Apr 14 10:57:14 user nova-compute[71509]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 10:57:14 user nova-compute[71509]:       <entry name="product">OpenStack Nova</entry>
Apr 14 10:57:14 user nova-compute[71509]:       <entry name="version">0.0.0</entry>
Apr 14 10:57:14 user nova-compute[71509]:       <entry name="serial">fe152ebd-4f99-4fa8-bfdb-8744cdf3f387</entry>
Apr 14 10:57:14 user nova-compute[71509]:       <entry name="uuid">fe152ebd-4f99-4fa8-bfdb-8744cdf3f387</entry>
Apr 14 10:57:14 user nova-compute[71509]:       <entry name="family">Virtual Machine</entry>
Apr 14 10:57:14 user nova-compute[71509]:     </system>
Apr 14 10:57:14 user nova-compute[71509]:   </sysinfo>
Apr 14 10:57:14 user nova-compute[71509]:   <os>
Apr 14 10:57:14 user nova-compute[71509]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 10:57:14 user nova-compute[71509]:     <boot dev="hd"/>
Apr 14 10:57:14 user nova-compute[71509]:     <smbios mode="sysinfo"/>
Apr 14 10:57:14 user nova-compute[71509]:   </os>
Apr 14 10:57:14 user nova-compute[71509]:   <features>
Apr 14 10:57:14 user nova-compute[71509]:     <acpi/>
Apr 14 10:57:14 user nova-compute[71509]:     <apic/>
Apr 14 10:57:14 user nova-compute[71509]:     <vmcoreinfo/>
Apr 14 10:57:14 user nova-compute[71509]:   </features>
Apr 14 10:57:14 user nova-compute[71509]:   <clock offset="utc">
Apr 14 10:57:14 user nova-compute[71509]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 10:57:14 user nova-compute[71509]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 10:57:14 user nova-compute[71509]:     <timer name="hpet" present="no"/>
Apr 14 10:57:14 user nova-compute[71509]:   </clock>
Apr 14 10:57:14 user nova-compute[71509]:   <cpu mode="custom" match="exact">
Apr 14 10:57:14 user nova-compute[71509]:     <model>Nehalem</model>
Apr 14 10:57:14 user nova-compute[71509]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 10:57:14 user nova-compute[71509]:   </cpu>
Apr 14 10:57:14 user nova-compute[71509]:   <devices>
Apr 14 10:57:14 user nova-compute[71509]:     <disk type="file" device="disk">
Apr 14 10:57:14 user nova-compute[71509]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 10:57:14 user nova-compute[71509]:       <source file="/opt/stack/data/nova/instances/fe152ebd-4f99-4fa8-bfdb-8744cdf3f387/disk"/>
Apr 14 10:57:14 user nova-compute[71509]:       <target dev="vda" bus="virtio"/>
Apr 14 10:57:14 user nova-compute[71509]:     </disk>
Apr 14 10:57:14 user nova-compute[71509]:     <interface type="ethernet">
Apr 14 10:57:14 user nova-compute[71509]:       <mac address="fa:16:3e:96:f1:e3"/>
Apr 14 10:57:14 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 10:57:14 user nova-compute[71509]:       <mtu size="1442"/>
Apr 14 10:57:14 user nova-compute[71509]:       <target dev="tap1a142b11-f1"/>
Apr 14 10:57:14 user nova-compute[71509]:     </interface>
Apr 14 10:57:14 user nova-compute[71509]:     <serial type="pty">
Apr 14 10:57:14 user nova-compute[71509]:       <log file="/opt/stack/data/nova/instances/fe152ebd-4f99-4fa8-bfdb-8744cdf3f387/console.log" append="off"/>
Apr 14 10:57:14 user nova-compute[71509]:     </serial>
Apr 14 10:57:14 user nova-compute[71509]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 10:57:14 user nova-compute[71509]:     <video>
Apr 14 10:57:14 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 10:57:14 user nova-compute[71509]:     </video>
Apr 14 10:57:14 user nova-compute[71509]:     <rng model="virtio">
Apr 14 10:57:14 user nova-compute[71509]:       <backend model="random">/dev/urandom</backend>
Apr 14 10:57:14 user nova-compute[71509]:     </rng>
Apr 14 10:57:14 user nova-compute[71509]:     <controller type="usb" index="0" model="none"/>
Apr 14 10:57:14 user nova-compute[71509]:     <memballoon model="virtio">
Apr 14 10:57:14 user nova-compute[71509]:       <stats period="10"/>
Apr 14 10:57:14 user nova-compute[71509]:     </memballoon>
Apr 14 10:57:14 user nova-compute[71509]:   </devices>
Apr 14 10:57:14 user nova-compute[71509]: </domain>
Apr 14 10:57:14 user nova-compute[71509]:  {{(pid=71509) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 10:57:14 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-5c9d6003-9cb7-4736-ae86-70756540a01f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T10:53:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1556975659',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1556975659',id=24,image_ref='87833300-56ce-406c-b6a0-555e2a239c9b',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-2083532637',keypairs=<?>,launch_index=0,launched_at=2023-04-14T10:53:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='f8a9941095d445f48d70df26d8c90e6c',ramdisk_id='',reservation_id='r-tlsa2xby',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1250068675',owner_user_name='tempest-AttachVolumeShelveTestJSON-1250068675-project-member',shelved_at='2023-04-14T10:55:19.582584',shelved_host='user',shelved_image_id='87833300-56ce-406c-b6a0-555e2a239c9b'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T10:57:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5afd3930d3a14aff8124a4782ec79870',uuid=fe152ebd-4f99-4fa8-bfdb-8744cdf3f387,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "1a142b11-f1ec-41d4-9728-f9f0de9a96ff", "address": "fa:16:3e:96:f1:e3", "network": {"id": "1cb09253-66a4-4c81-82d0-c6d948e0aed4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1557121746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8a9941095d445f48d70df26d8c90e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a142b11-f1", "ovs_interfaceid": "1a142b11-f1ec-41d4-9728-f9f0de9a96ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 10:57:14 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-5c9d6003-9cb7-4736-ae86-70756540a01f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Converting VIF {"id": "1a142b11-f1ec-41d4-9728-f9f0de9a96ff", "address": "fa:16:3e:96:f1:e3", "network": {"id": "1cb09253-66a4-4c81-82d0-c6d948e0aed4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1557121746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8a9941095d445f48d70df26d8c90e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a142b11-f1", "ovs_interfaceid": "1a142b11-f1ec-41d4-9728-f9f0de9a96ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:57:14 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-5c9d6003-9cb7-4736-ae86-70756540a01f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:f1:e3,bridge_name='br-int',has_traffic_filtering=True,id=1a142b11-f1ec-41d4-9728-f9f0de9a96ff,network=Network(1cb09253-66a4-4c81-82d0-c6d948e0aed4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a142b11-f1') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:57:14 user nova-compute[71509]: DEBUG os_vif [None req-5c9d6003-9cb7-4736-ae86-70756540a01f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:f1:e3,bridge_name='br-int',has_traffic_filtering=True,id=1a142b11-f1ec-41d4-9728-f9f0de9a96ff,network=Network(1cb09253-66a4-4c81-82d0-c6d948e0aed4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a142b11-f1') {{(pid=71509) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 10:57:14 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:57:14 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:57:14 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 10:57:14 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:57:14 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1a142b11-f1, may_exist=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:57:14 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1a142b11-f1, col_values=(('external_ids', {'iface-id': '1a142b11-f1ec-41d4-9728-f9f0de9a96ff', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:96:f1:e3', 'vm-uuid': 'fe152ebd-4f99-4fa8-bfdb-8744cdf3f387'}),)) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:57:14 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:57:14 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 10:57:14 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:57:14 user nova-compute[71509]: INFO os_vif [None req-5c9d6003-9cb7-4736-ae86-70756540a01f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:f1:e3,bridge_name='br-int',has_traffic_filtering=True,id=1a142b11-f1ec-41d4-9728-f9f0de9a96ff,network=Network(1cb09253-66a4-4c81-82d0-c6d948e0aed4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a142b11-f1')
Apr 14 10:57:14 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-5c9d6003-9cb7-4736-ae86-70756540a01f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] No BDM found with device name vda, not building metadata. {{(pid=71509) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 10:57:14 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-5c9d6003-9cb7-4736-ae86-70756540a01f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] No VIF found with MAC fa:16:3e:96:f1:e3, not building metadata {{(pid=71509) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 10:57:15 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-f3124171-4bdf-44cd-93c1-71021b4ff843 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "0dd9e11f-1fed-42af-ad5c-9cdd051b93e7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:57:15 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-f3124171-4bdf-44cd-93c1-71021b4ff843 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "0dd9e11f-1fed-42af-ad5c-9cdd051b93e7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:57:15 user nova-compute[71509]: DEBUG nova.compute.manager [None req-f3124171-4bdf-44cd-93c1-71021b4ff843 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 0dd9e11f-1fed-42af-ad5c-9cdd051b93e7] Starting instance... {{(pid=71509) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 10:57:15 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-f3124171-4bdf-44cd-93c1-71021b4ff843 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:57:15 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-f3124171-4bdf-44cd-93c1-71021b4ff843 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:57:15 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-f3124171-4bdf-44cd-93c1-71021b4ff843 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71509) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 10:57:15 user nova-compute[71509]: INFO nova.compute.claims [None req-f3124171-4bdf-44cd-93c1-71021b4ff843 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 0dd9e11f-1fed-42af-ad5c-9cdd051b93e7] Claim successful on node user
Apr 14 10:57:15 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:57:15 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:57:15 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:57:15 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-f3124171-4bdf-44cd-93c1-71021b4ff843 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 10:57:15 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-f3124171-4bdf-44cd-93c1-71021b4ff843 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 10:57:16 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-f3124171-4bdf-44cd-93c1-71021b4ff843 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.639s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:57:16 user nova-compute[71509]: DEBUG nova.compute.manager [None req-f3124171-4bdf-44cd-93c1-71021b4ff843 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 0dd9e11f-1fed-42af-ad5c-9cdd051b93e7] Start building networks asynchronously for instance. {{(pid=71509) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 10:57:16 user nova-compute[71509]: DEBUG nova.compute.manager [None req-f3124171-4bdf-44cd-93c1-71021b4ff843 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 0dd9e11f-1fed-42af-ad5c-9cdd051b93e7] Allocating IP information in the background. {{(pid=71509) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 10:57:16 user nova-compute[71509]: DEBUG nova.network.neutron [None req-f3124171-4bdf-44cd-93c1-71021b4ff843 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 0dd9e11f-1fed-42af-ad5c-9cdd051b93e7] allocate_for_instance() {{(pid=71509) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 10:57:16 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-f3124171-4bdf-44cd-93c1-71021b4ff843 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 0dd9e11f-1fed-42af-ad5c-9cdd051b93e7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 10:57:16 user nova-compute[71509]: DEBUG nova.compute.manager [None req-f3124171-4bdf-44cd-93c1-71021b4ff843 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 0dd9e11f-1fed-42af-ad5c-9cdd051b93e7] Start building block device mappings for instance. {{(pid=71509) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 10:57:16 user nova-compute[71509]: DEBUG nova.compute.manager [None req-f3124171-4bdf-44cd-93c1-71021b4ff843 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 0dd9e11f-1fed-42af-ad5c-9cdd051b93e7] Start spawning the instance on the hypervisor. {{(pid=71509) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 10:57:16 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-f3124171-4bdf-44cd-93c1-71021b4ff843 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 0dd9e11f-1fed-42af-ad5c-9cdd051b93e7] Creating instance directory {{(pid=71509) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 10:57:16 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-f3124171-4bdf-44cd-93c1-71021b4ff843 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 0dd9e11f-1fed-42af-ad5c-9cdd051b93e7] Creating image(s)
Apr 14 10:57:16 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-f3124171-4bdf-44cd-93c1-71021b4ff843 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "/opt/stack/data/nova/instances/0dd9e11f-1fed-42af-ad5c-9cdd051b93e7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:57:16 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-f3124171-4bdf-44cd-93c1-71021b4ff843 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "/opt/stack/data/nova/instances/0dd9e11f-1fed-42af-ad5c-9cdd051b93e7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:57:16 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-f3124171-4bdf-44cd-93c1-71021b4ff843 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "/opt/stack/data/nova/instances/0dd9e11f-1fed-42af-ad5c-9cdd051b93e7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:57:16 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-f3124171-4bdf-44cd-93c1-71021b4ff843 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:57:16 user nova-compute[71509]: DEBUG nova.compute.manager [req-cab6c7b3-8c18-40d9-831e-2072c9ef78c3 req-ff3c9fd6-c178-4b62-a268-ec3d8832bedb service nova] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] Received event network-vif-plugged-1a142b11-f1ec-41d4-9728-f9f0de9a96ff {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:57:16 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-cab6c7b3-8c18-40d9-831e-2072c9ef78c3 req-ff3c9fd6-c178-4b62-a268-ec3d8832bedb service nova] Acquiring lock "fe152ebd-4f99-4fa8-bfdb-8744cdf3f387-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:57:16 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-cab6c7b3-8c18-40d9-831e-2072c9ef78c3 req-ff3c9fd6-c178-4b62-a268-ec3d8832bedb service nova] Lock "fe152ebd-4f99-4fa8-bfdb-8744cdf3f387-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:57:16 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-cab6c7b3-8c18-40d9-831e-2072c9ef78c3 req-ff3c9fd6-c178-4b62-a268-ec3d8832bedb service nova] Lock "fe152ebd-4f99-4fa8-bfdb-8744cdf3f387-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:57:16 user nova-compute[71509]: DEBUG nova.compute.manager [req-cab6c7b3-8c18-40d9-831e-2072c9ef78c3 req-ff3c9fd6-c178-4b62-a268-ec3d8832bedb service nova] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] No waiting events found dispatching network-vif-plugged-1a142b11-f1ec-41d4-9728-f9f0de9a96ff {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:57:16 user nova-compute[71509]: WARNING nova.compute.manager [req-cab6c7b3-8c18-40d9-831e-2072c9ef78c3 req-ff3c9fd6-c178-4b62-a268-ec3d8832bedb service nova] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] Received unexpected event network-vif-plugged-1a142b11-f1ec-41d4-9728-f9f0de9a96ff for instance with vm_state shelved_offloaded and task_state spawning.
Apr 14 10:57:16 user nova-compute[71509]: DEBUG nova.policy [None req-f3124171-4bdf-44cd-93c1-71021b4ff843 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5873a358bf544691b12cd2979f5e36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea2cb4dfa5b4a52b658efd8f5aefb36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71509) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 10:57:16 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-f3124171-4bdf-44cd-93c1-71021b4ff843 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json" returned: 0 in 0.175s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:57:16 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-f3124171-4bdf-44cd-93c1-71021b4ff843 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:57:16 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-f3124171-4bdf-44cd-93c1-71021b4ff843 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:57:16 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-f3124171-4bdf-44cd-93c1-71021b4ff843 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:57:16 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:57:16 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:57:16 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-f3124171-4bdf-44cd-93c1-71021b4ff843 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json" returned: 0 in 0.135s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:57:16 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-f3124171-4bdf-44cd-93c1-71021b4ff843 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18,backing_fmt=raw /opt/stack/data/nova/instances/0dd9e11f-1fed-42af-ad5c-9cdd051b93e7/disk 1073741824 {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:57:16 user nova-compute[71509]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681469821.667273, cd661ae0-c4bb-4117-847d-ef7e85d062fb => Stopped> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 10:57:16 user nova-compute[71509]: INFO nova.compute.manager [-] [instance: cd661ae0-c4bb-4117-847d-ef7e85d062fb] VM Stopped (Lifecycle Event)
Apr 14 10:57:16 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-287cd5f9-e61f-4733-8828-d3c52ef4846a tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] [instance: e6580716-8a6a-4dfa-8978-ed54b92af1fe] Calling os-brick to attach iSCSI Volume {{(pid=71509) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 10:57:16 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-287cd5f9-e61f-4733-8828-d3c52ef4846a tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0bf0749390>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f488d00e-998a-40d7-9e77-1bca2436fd95', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qTtNzySX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 10:57:16 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-287cd5f9-e61f-4733-8828-d3c52ef4846a tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 10:57:16 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-287cd5f9-e61f-4733-8828-d3c52ef4846a tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 10:57:16 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-287cd5f9-e61f-4733-8828-d3c52ef4846a tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 10:57:16 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-287cd5f9-e61f-4733-8828-d3c52ef4846a tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 10:57:16 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-287cd5f9-e61f-4733-8828-d3c52ef4846a tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f488d00e-998a-40d7-9e77-1bca2436fd95" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 10:57:16 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-287cd5f9-e61f-4733-8828-d3c52ef4846a tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f488d00e-998a-40d7-9e77-1bca2436fd95" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 10:57:16 user nova-compute[71509]: INFO os_brick.initiator.connectors.iscsi [None req-287cd5f9-e61f-4733-8828-d3c52ef4846a tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 10:57:16 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-f3124171-4bdf-44cd-93c1-71021b4ff843 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18,backing_fmt=raw /opt/stack/data/nova/instances/0dd9e11f-1fed-42af-ad5c-9cdd051b93e7/disk 1073741824" returned: 0 in 0.068s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:57:16 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-f3124171-4bdf-44cd-93c1-71021b4ff843 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.206s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:57:16 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-f3124171-4bdf-44cd-93c1-71021b4ff843 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:57:16 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f488d00e-998a-40d7-9e77-1bca2436fd95 -p 172.16.0.220:3260 {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:57:16 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f488d00e-998a-40d7-9e77-1bca2436fd95 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:57:16 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6fdf415-8f69-4ebe-bcf0-5a11a6f525af]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:57:16 user nova-compute[71509]: DEBUG nova.compute.manager [None req-28e266f4-425b-4c68-a504-447e26877cad None None] [instance: cd661ae0-c4bb-4117-847d-ef7e85d062fb] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:57:16 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-287cd5f9-e61f-4733-8828-d3c52ef4846a tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 10:57:16 user nova-compute[71509]:  {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:57:16 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f488d00e-998a-40d7-9e77-1bca2436fd95 -p 172.16.0.220:3260 --interface default --op new {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:57:16 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f488d00e-998a-40d7-9e77-1bca2436fd95 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:57:16 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[77d652a3-551d-40d8-969d-db59d739ed8e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f488d00e-998a-40d7-9e77-1bca2436fd95] added\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:57:16 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-287cd5f9-e61f-4733-8828-d3c52ef4846a tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f488d00e-998a-40d7-9e77-1bca2436fd95] added
Apr 14 10:57:16 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:57:16 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f488d00e-998a-40d7-9e77-1bca2436fd95 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:57:16 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f488d00e-998a-40d7-9e77-1bca2436fd95 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:57:16 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[c80c20b1-9617-48b7-95e7-959f2a905d33]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:57:16 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-287cd5f9-e61f-4733-8828-d3c52ef4846a tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:57:16 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f488d00e-998a-40d7-9e77-1bca2436fd95 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:57:16 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f488d00e-998a-40d7-9e77-1bca2436fd95 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:57:16 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[41c494d7-0527-4342-8ff2-df35df4e540b]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:57:16 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-287cd5f9-e61f-4733-8828-d3c52ef4846a tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:57:16 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f488d00e-998a-40d7-9e77-1bca2436fd95 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qTtNzySX {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:57:16 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-f3124171-4bdf-44cd-93c1-71021b4ff843 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json" returned: 0 in 0.136s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:57:16 user nova-compute[71509]: DEBUG nova.virt.disk.api [None req-f3124171-4bdf-44cd-93c1-71021b4ff843 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0dd9e11f-1fed-42af-ad5c-9cdd051b93e7/disk. size=1073741824 {{(pid=71509) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 10:57:16 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-f3124171-4bdf-44cd-93c1-71021b4ff843 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dd9e11f-1fed-42af-ad5c-9cdd051b93e7/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:57:16 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f488d00e-998a-40d7-9e77-1bca2436fd95 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qTtNzySX" returned: 0 in 0.025s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:57:16 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0f49848-5150-42a7-be77-932c18655b12]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:57:16 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-287cd5f9-e61f-4733-8828-d3c52ef4846a tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qTtNzySX'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:57:16 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f488d00e-998a-40d7-9e77-1bca2436fd95 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:57:16 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f488d00e-998a-40d7-9e77-1bca2436fd95 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:57:16 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f5a16f2-b536-412f-8068-81cb5efe9d03]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:57:16 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-287cd5f9-e61f-4733-8828-d3c52ef4846a tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:57:16 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:57:16 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:57:16 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e751c19-5b12-4648-ad6d-57455b83b582]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:57:16 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-287cd5f9-e61f-4733-8828-d3c52ef4846a tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)
Apr 14 10:57:16 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:57:16 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-287cd5f9-e61f-4733-8828-d3c52ef4846a tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)
Apr 14 10:57:16 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 10:57:16 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f488d00e-998a-40d7-9e77-1bca2436fd95 -p 172.16.0.220:3260 --login {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:57:17 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f488d00e-998a-40d7-9e77-1bca2436fd95 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:57:17 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6c44cc5-0c77-40f7-ab05-1653d24e5eea]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f488d00e-998a-40d7-9e77-1bca2436fd95, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f488d00e-998a-40d7-9e77-1bca2436fd95, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:57:17 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-287cd5f9-e61f-4733-8828-d3c52ef4846a tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f488d00e-998a-40d7-9e77-1bca2436fd95, portal: 172.16.0.220,3260]
Apr 14 10:57:17 user nova-compute[71509]: Login to [iface: default, target: iqn.2010-10.org.openstack:f488d00e-998a-40d7-9e77-1bca2436fd95, portal: 172.16.0.220,3260] successful.
Apr 14 10:57:17 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:57:17 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-f3124171-4bdf-44cd-93c1-71021b4ff843 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dd9e11f-1fed-42af-ad5c-9cdd051b93e7/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:57:17 user nova-compute[71509]: DEBUG nova.virt.disk.api [None req-f3124171-4bdf-44cd-93c1-71021b4ff843 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Cannot resize image /opt/stack/data/nova/instances/0dd9e11f-1fed-42af-ad5c-9cdd051b93e7/disk to a smaller size. {{(pid=71509) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 10:57:17 user nova-compute[71509]: DEBUG nova.objects.instance [None req-f3124171-4bdf-44cd-93c1-71021b4ff843 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lazy-loading 'migration_context' on Instance uuid 0dd9e11f-1fed-42af-ad5c-9cdd051b93e7 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:57:17 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f488d00e-998a-40d7-9e77-1bca2436fd95 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:57:17 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f488d00e-998a-40d7-9e77-1bca2436fd95 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:57:17 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-f3124171-4bdf-44cd-93c1-71021b4ff843 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 0dd9e11f-1fed-42af-ad5c-9cdd051b93e7] Created local disks {{(pid=71509) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 10:57:17 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-f3124171-4bdf-44cd-93c1-71021b4ff843 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 0dd9e11f-1fed-42af-ad5c-9cdd051b93e7] Ensure instance console log exists: /opt/stack/data/nova/instances/0dd9e11f-1fed-42af-ad5c-9cdd051b93e7/console.log {{(pid=71509) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 10:57:17 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-f3124171-4bdf-44cd-93c1-71021b4ff843 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:57:17 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-f3124171-4bdf-44cd-93c1-71021b4ff843 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:57:17 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-f3124171-4bdf-44cd-93c1-71021b4ff843 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:57:17 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e5a4208-b48c-456c-a87c-fa899357c607]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:57:17 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-287cd5f9-e61f-4733-8828-d3c52ef4846a tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:57:17 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:57:17 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:57:17 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[61322161-6576-4171-b7ba-c083b11e88b3]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f488d00e-998a-40d7-9e77-1bca2436fd95 (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:57:17 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-287cd5f9-e61f-4733-8828-d3c52ef4846a tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)
Apr 14 10:57:17 user nova-compute[71509]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f488d00e-998a-40d7-9e77-1bca2436fd95 (non-flash)
Apr 14 10:57:17 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:57:17 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-287cd5f9-e61f-4733-8828-d3c52ef4846a tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)
Apr 14 10:57:17 user nova-compute[71509]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f488d00e-998a-40d7-9e77-1bca2436fd95 (non-flash)
Apr 14 10:57:17 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 10:57:17 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-287cd5f9-e61f-4733-8828-d3c52ef4846a tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f488d00e-998a-40d7-9e77-1bca2436fd95" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.373s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 10:57:17 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-287cd5f9-e61f-4733-8828-d3c52ef4846a tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Connected to 172.16.0.220:3260 {{(pid=71509) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 10:57:17 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-287cd5f9-e61f-4733-8828-d3c52ef4846a tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] HCTL ('33', '-', '-', 0) found on session 36 with lun 0 {{(pid=71509) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 10:57:17 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-287cd5f9-e61f-4733-8828-d3c52ef4846a tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71509) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 10:57:17 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:57:17 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:57:17 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd35af25-07e1-41e7-a481-58e2b396d806]: (4, ('- - 0', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:57:17 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-287cd5f9-e61f-4733-8828-d3c52ef4846a tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Searching for a device in session 36 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71509) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 10:57:17 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-287cd5f9-e61f-4733-8828-d3c52ef4846a tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:f488d00e-998a-40d7-9e77-1bca2436fd95', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qTtNzySX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71509) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 10:57:17 user nova-compute[71509]: DEBUG nova.network.neutron [None req-f3124171-4bdf-44cd-93c1-71021b4ff843 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 0dd9e11f-1fed-42af-ad5c-9cdd051b93e7] Successfully created port: ec941aab-7c95-415b-96bc-e74ebaeb9385 {{(pid=71509) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 10:57:18 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-287cd5f9-e61f-4733-8828-d3c52ef4846a tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.412s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 10:57:18 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-287cd5f9-e61f-4733-8828-d3c52ef4846a tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] <== connect_volume: return (1414ms) {'type': 'block', 'scsi_wwn': '23365373034623732', 'path': '/dev/sdb'} {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 10:57:18 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-287cd5f9-e61f-4733-8828-d3c52ef4846a tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] [instance: e6580716-8a6a-4dfa-8978-ed54b92af1fe] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23365373034623732', 'path': '/dev/sdb'} {{(pid=71509) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 10:57:18 user nova-compute[71509]: DEBUG nova.objects.instance [None req-287cd5f9-e61f-4733-8828-d3c52ef4846a tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lazy-loading 'flavor' on Instance uuid e6580716-8a6a-4dfa-8978-ed54b92af1fe {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:57:18 user nova-compute[71509]: DEBUG nova.virt.libvirt.guest [None req-287cd5f9-e61f-4733-8828-d3c52ef4846a tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 10:57:18 user nova-compute[71509]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 10:57:18 user nova-compute[71509]:   <source dev="/dev/sdb"/>
Apr 14 10:57:18 user nova-compute[71509]:   <target dev="vdb" bus="virtio"/>
Apr 14 10:57:18 user nova-compute[71509]:   <serial>f488d00e-998a-40d7-9e77-1bca2436fd95</serial>
Apr 14 10:57:18 user nova-compute[71509]: </disk>
Apr 14 10:57:18 user nova-compute[71509]:  {{(pid=71509) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 10:57:18 user nova-compute[71509]: DEBUG nova.network.neutron [None req-f3124171-4bdf-44cd-93c1-71021b4ff843 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 0dd9e11f-1fed-42af-ad5c-9cdd051b93e7] Successfully updated port: ec941aab-7c95-415b-96bc-e74ebaeb9385 {{(pid=71509) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 10:57:18 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-f3124171-4bdf-44cd-93c1-71021b4ff843 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "refresh_cache-0dd9e11f-1fed-42af-ad5c-9cdd051b93e7" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:57:18 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-f3124171-4bdf-44cd-93c1-71021b4ff843 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquired lock "refresh_cache-0dd9e11f-1fed-42af-ad5c-9cdd051b93e7" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:57:18 user nova-compute[71509]: DEBUG nova.network.neutron [None req-f3124171-4bdf-44cd-93c1-71021b4ff843 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 0dd9e11f-1fed-42af-ad5c-9cdd051b93e7] Building network info cache for instance {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 10:57:18 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:57:18 user nova-compute[71509]: DEBUG nova.compute.manager [None req-5c9d6003-9cb7-4736-ae86-70756540a01f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] Instance event wait completed in 0 seconds for  {{(pid=71509) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 10:57:18 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-5c9d6003-9cb7-4736-ae86-70756540a01f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] Guest created on hypervisor {{(pid=71509) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 10:57:18 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] Instance spawned successfully.
Apr 14 10:57:18 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681469838.2156549, fe152ebd-4f99-4fa8-bfdb-8744cdf3f387 => Resumed> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 10:57:18 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] VM Resumed (Lifecycle Event)
Apr 14 10:57:18 user nova-compute[71509]: DEBUG nova.network.neutron [None req-f3124171-4bdf-44cd-93c1-71021b4ff843 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 0dd9e11f-1fed-42af-ad5c-9cdd051b93e7] Instance cache missing network info. {{(pid=71509) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 10:57:18 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:57:18 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 10:57:18 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 10:57:18 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681469838.2158413, fe152ebd-4f99-4fa8-bfdb-8744cdf3f387 => Started> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 10:57:18 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] VM Started (Lifecycle Event)
Apr 14 10:57:18 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:57:18 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 10:57:18 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 10:57:18 user nova-compute[71509]: DEBUG nova.compute.manager [req-732b2fcc-fb3a-44d9-9363-4194dc6b756b req-8360f5b1-7157-48ab-9f4a-f951f363c2a5 service nova] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] Received event network-vif-plugged-1a142b11-f1ec-41d4-9728-f9f0de9a96ff {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:57:18 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-732b2fcc-fb3a-44d9-9363-4194dc6b756b req-8360f5b1-7157-48ab-9f4a-f951f363c2a5 service nova] Acquiring lock "fe152ebd-4f99-4fa8-bfdb-8744cdf3f387-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:57:18 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-732b2fcc-fb3a-44d9-9363-4194dc6b756b req-8360f5b1-7157-48ab-9f4a-f951f363c2a5 service nova] Lock "fe152ebd-4f99-4fa8-bfdb-8744cdf3f387-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:57:18 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-732b2fcc-fb3a-44d9-9363-4194dc6b756b req-8360f5b1-7157-48ab-9f4a-f951f363c2a5 service nova] Lock "fe152ebd-4f99-4fa8-bfdb-8744cdf3f387-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:57:18 user nova-compute[71509]: DEBUG nova.compute.manager [req-732b2fcc-fb3a-44d9-9363-4194dc6b756b req-8360f5b1-7157-48ab-9f4a-f951f363c2a5 service nova] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] No waiting events found dispatching network-vif-plugged-1a142b11-f1ec-41d4-9728-f9f0de9a96ff {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:57:18 user nova-compute[71509]: WARNING nova.compute.manager [req-732b2fcc-fb3a-44d9-9363-4194dc6b756b req-8360f5b1-7157-48ab-9f4a-f951f363c2a5 service nova] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] Received unexpected event network-vif-plugged-1a142b11-f1ec-41d4-9728-f9f0de9a96ff for instance with vm_state shelved_offloaded and task_state spawning.
Apr 14 10:57:18 user nova-compute[71509]: DEBUG nova.compute.manager [req-732b2fcc-fb3a-44d9-9363-4194dc6b756b req-8360f5b1-7157-48ab-9f4a-f951f363c2a5 service nova] [instance: 0dd9e11f-1fed-42af-ad5c-9cdd051b93e7] Received event network-changed-ec941aab-7c95-415b-96bc-e74ebaeb9385 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:57:18 user nova-compute[71509]: DEBUG nova.compute.manager [req-732b2fcc-fb3a-44d9-9363-4194dc6b756b req-8360f5b1-7157-48ab-9f4a-f951f363c2a5 service nova] [instance: 0dd9e11f-1fed-42af-ad5c-9cdd051b93e7] Refreshing instance network info cache due to event network-changed-ec941aab-7c95-415b-96bc-e74ebaeb9385. {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 10:57:18 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-732b2fcc-fb3a-44d9-9363-4194dc6b756b req-8360f5b1-7157-48ab-9f4a-f951f363c2a5 service nova] Acquiring lock "refresh_cache-0dd9e11f-1fed-42af-ad5c-9cdd051b93e7" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:57:18 user nova-compute[71509]: DEBUG nova.compute.manager [None req-5c9d6003-9cb7-4736-ae86-70756540a01f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:57:18 user nova-compute[71509]: DEBUG nova.network.neutron [None req-f3124171-4bdf-44cd-93c1-71021b4ff843 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 0dd9e11f-1fed-42af-ad5c-9cdd051b93e7] Updating instance_info_cache with network_info: [{"id": "ec941aab-7c95-415b-96bc-e74ebaeb9385", "address": "fa:16:3e:31:a2:13", "network": {"id": "18a91434-637b-4c19-a97b-736b32c1ea5a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1824162811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea2cb4dfa5b4a52b658efd8f5aefb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec941aab-7c", "ovs_interfaceid": "ec941aab-7c95-415b-96bc-e74ebaeb9385", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:57:18 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-5c9d6003-9cb7-4736-ae86-70756540a01f tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "fe152ebd-4f99-4fa8-bfdb-8744cdf3f387" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 11.278s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:57:18 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-287cd5f9-e61f-4733-8828-d3c52ef4846a tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] No BDM found with device name vda, not building metadata. {{(pid=71509) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 10:57:18 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-287cd5f9-e61f-4733-8828-d3c52ef4846a tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71509) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 10:57:18 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-287cd5f9-e61f-4733-8828-d3c52ef4846a tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] No VIF found with MAC fa:16:3e:57:1a:d3, not building metadata {{(pid=71509) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 10:57:18 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-f3124171-4bdf-44cd-93c1-71021b4ff843 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Releasing lock "refresh_cache-0dd9e11f-1fed-42af-ad5c-9cdd051b93e7" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:57:18 user nova-compute[71509]: DEBUG nova.compute.manager [None req-f3124171-4bdf-44cd-93c1-71021b4ff843 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 0dd9e11f-1fed-42af-ad5c-9cdd051b93e7] Instance network_info: |[{"id": "ec941aab-7c95-415b-96bc-e74ebaeb9385", "address": "fa:16:3e:31:a2:13", "network": {"id": "18a91434-637b-4c19-a97b-736b32c1ea5a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1824162811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea2cb4dfa5b4a52b658efd8f5aefb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec941aab-7c", "ovs_interfaceid": "ec941aab-7c95-415b-96bc-e74ebaeb9385", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71509) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 10:57:18 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-732b2fcc-fb3a-44d9-9363-4194dc6b756b req-8360f5b1-7157-48ab-9f4a-f951f363c2a5 service nova] Acquired lock "refresh_cache-0dd9e11f-1fed-42af-ad5c-9cdd051b93e7" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:57:18 user nova-compute[71509]: DEBUG nova.network.neutron [req-732b2fcc-fb3a-44d9-9363-4194dc6b756b req-8360f5b1-7157-48ab-9f4a-f951f363c2a5 service nova] [instance: 0dd9e11f-1fed-42af-ad5c-9cdd051b93e7] Refreshing network info cache for port ec941aab-7c95-415b-96bc-e74ebaeb9385 {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 10:57:18 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-f3124171-4bdf-44cd-93c1-71021b4ff843 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 0dd9e11f-1fed-42af-ad5c-9cdd051b93e7] Start _get_guest_xml network_info=[{"id": "ec941aab-7c95-415b-96bc-e74ebaeb9385", "address": "fa:16:3e:31:a2:13", "network": {"id": "18a91434-637b-4c19-a97b-736b32c1ea5a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1824162811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea2cb4dfa5b4a52b658efd8f5aefb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec941aab-7c", "ovs_interfaceid": "ec941aab-7c95-415b-96bc-e74ebaeb9385", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T10:38:55Z,direct_url=<?>,disk_format='qcow2',id=048ec0ee-0465-448d-8b4c-f072acb101dc,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='9742d6ad20cf48d9bab0fdbcc9491db9',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T10:38:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '048ec0ee-0465-448d-8b4c-f072acb101dc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71509) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 10:57:18 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-f3124171-4bdf-44cd-93c1-71021b4ff843 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:57:18 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-f3124171-4bdf-44cd-93c1-71021b4ff843 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:57:18 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-f3124171-4bdf-44cd-93c1-71021b4ff843 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71509) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 10:57:18 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-f3124171-4bdf-44cd-93c1-71021b4ff843 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T10:40:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T10:38:55Z,direct_url=<?>,disk_format='qcow2',id=048ec0ee-0465-448d-8b4c-f072acb101dc,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='9742d6ad20cf48d9bab0fdbcc9491db9',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T10:38:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 10:57:18 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-f3124171-4bdf-44cd-93c1-71021b4ff843 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Flavor limits 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 10:57:18 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-f3124171-4bdf-44cd-93c1-71021b4ff843 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Image limits 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 10:57:18 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-f3124171-4bdf-44cd-93c1-71021b4ff843 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Flavor pref 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 10:57:18 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-f3124171-4bdf-44cd-93c1-71021b4ff843 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Image pref 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 10:57:18 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-f3124171-4bdf-44cd-93c1-71021b4ff843 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 10:57:18 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-f3124171-4bdf-44cd-93c1-71021b4ff843 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 10:57:18 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-f3124171-4bdf-44cd-93c1-71021b4ff843 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71509) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 10:57:18 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-f3124171-4bdf-44cd-93c1-71021b4ff843 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Got 1 possible topologies {{(pid=71509) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 10:57:18 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-f3124171-4bdf-44cd-93c1-71021b4ff843 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 10:57:18 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-f3124171-4bdf-44cd-93c1-71021b4ff843 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 10:57:18 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-f3124171-4bdf-44cd-93c1-71021b4ff843 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T10:57:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1174054965',display_name='tempest-ServerActionsTestJSON-server-1174054965',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1174054965',id=30,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNt/FyD1XXsxB5kJC+SJ1dgkjoXXHkL+KX0Cr5HvI72xTIz+DAtuVRPHeIpMNLt39mbbZ9KAoCJibRQza0Qbd8j8EEoV7QHombhWz2Mdusr+gJ2OYTqrrRzVbjIHACTFWw==',key_name='tempest-keypair-1544270235',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ea2cb4dfa5b4a52b658efd8f5aefb36',ramdisk_id='',reservation_id='r-bb9gxkx7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-1923052090',owner_user_name='tempest-ServerActionsTestJSON-1923052090-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T10:57:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5873a358bf544691b12cd2979f5e36dc',uuid=0dd9e11f-1fed-42af-ad5c-9cdd051b93e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ec941aab-7c95-415b-96bc-e74ebaeb9385", "address": "fa:16:3e:31:a2:13", "network": {"id": "18a91434-637b-4c19-a97b-736b32c1ea5a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1824162811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea2cb4dfa5b4a52b658efd8f5aefb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec941aab-7c", "ovs_interfaceid": "ec941aab-7c95-415b-96bc-e74ebaeb9385", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71509) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 10:57:18 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-f3124171-4bdf-44cd-93c1-71021b4ff843 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Converting VIF {"id": "ec941aab-7c95-415b-96bc-e74ebaeb9385", "address": "fa:16:3e:31:a2:13", "network": {"id": "18a91434-637b-4c19-a97b-736b32c1ea5a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1824162811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea2cb4dfa5b4a52b658efd8f5aefb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec941aab-7c", "ovs_interfaceid": "ec941aab-7c95-415b-96bc-e74ebaeb9385", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:57:18 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-f3124171-4bdf-44cd-93c1-71021b4ff843 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:a2:13,bridge_name='br-int',has_traffic_filtering=True,id=ec941aab-7c95-415b-96bc-e74ebaeb9385,network=Network(18a91434-637b-4c19-a97b-736b32c1ea5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec941aab-7c') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:57:18 user nova-compute[71509]: DEBUG nova.objects.instance [None req-f3124171-4bdf-44cd-93c1-71021b4ff843 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lazy-loading 'pci_devices' on Instance uuid 0dd9e11f-1fed-42af-ad5c-9cdd051b93e7 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:57:18 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-f3124171-4bdf-44cd-93c1-71021b4ff843 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 0dd9e11f-1fed-42af-ad5c-9cdd051b93e7] End _get_guest_xml xml=<domain type="kvm">
Apr 14 10:57:18 user nova-compute[71509]:   <uuid>0dd9e11f-1fed-42af-ad5c-9cdd051b93e7</uuid>
Apr 14 10:57:18 user nova-compute[71509]:   <name>instance-0000001e</name>
Apr 14 10:57:18 user nova-compute[71509]:   <memory>131072</memory>
Apr 14 10:57:18 user nova-compute[71509]:   <vcpu>1</vcpu>
Apr 14 10:57:18 user nova-compute[71509]:   <metadata>
Apr 14 10:57:18 user nova-compute[71509]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 10:57:18 user nova-compute[71509]:       <nova:package version="0.0.0"/>
Apr 14 10:57:18 user nova-compute[71509]:       <nova:name>tempest-ServerActionsTestJSON-server-1174054965</nova:name>
Apr 14 10:57:18 user nova-compute[71509]:       <nova:creationTime>2023-04-14 10:57:18</nova:creationTime>
Apr 14 10:57:18 user nova-compute[71509]:       <nova:flavor name="m1.nano">
Apr 14 10:57:18 user nova-compute[71509]:         <nova:memory>128</nova:memory>
Apr 14 10:57:18 user nova-compute[71509]:         <nova:disk>1</nova:disk>
Apr 14 10:57:18 user nova-compute[71509]:         <nova:swap>0</nova:swap>
Apr 14 10:57:18 user nova-compute[71509]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 10:57:18 user nova-compute[71509]:         <nova:vcpus>1</nova:vcpus>
Apr 14 10:57:18 user nova-compute[71509]:       </nova:flavor>
Apr 14 10:57:18 user nova-compute[71509]:       <nova:owner>
Apr 14 10:57:18 user nova-compute[71509]:         <nova:user uuid="5873a358bf544691b12cd2979f5e36dc">tempest-ServerActionsTestJSON-1923052090-project-member</nova:user>
Apr 14 10:57:18 user nova-compute[71509]:         <nova:project uuid="3ea2cb4dfa5b4a52b658efd8f5aefb36">tempest-ServerActionsTestJSON-1923052090</nova:project>
Apr 14 10:57:18 user nova-compute[71509]:       </nova:owner>
Apr 14 10:57:18 user nova-compute[71509]:       <nova:root type="image" uuid="048ec0ee-0465-448d-8b4c-f072acb101dc"/>
Apr 14 10:57:18 user nova-compute[71509]:       <nova:ports>
Apr 14 10:57:18 user nova-compute[71509]:         <nova:port uuid="ec941aab-7c95-415b-96bc-e74ebaeb9385">
Apr 14 10:57:18 user nova-compute[71509]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 14 10:57:18 user nova-compute[71509]:         </nova:port>
Apr 14 10:57:18 user nova-compute[71509]:       </nova:ports>
Apr 14 10:57:18 user nova-compute[71509]:     </nova:instance>
Apr 14 10:57:18 user nova-compute[71509]:   </metadata>
Apr 14 10:57:18 user nova-compute[71509]:   <sysinfo type="smbios">
Apr 14 10:57:18 user nova-compute[71509]:     <system>
Apr 14 10:57:18 user nova-compute[71509]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 10:57:18 user nova-compute[71509]:       <entry name="product">OpenStack Nova</entry>
Apr 14 10:57:18 user nova-compute[71509]:       <entry name="version">0.0.0</entry>
Apr 14 10:57:18 user nova-compute[71509]:       <entry name="serial">0dd9e11f-1fed-42af-ad5c-9cdd051b93e7</entry>
Apr 14 10:57:18 user nova-compute[71509]:       <entry name="uuid">0dd9e11f-1fed-42af-ad5c-9cdd051b93e7</entry>
Apr 14 10:57:18 user nova-compute[71509]:       <entry name="family">Virtual Machine</entry>
Apr 14 10:57:18 user nova-compute[71509]:     </system>
Apr 14 10:57:18 user nova-compute[71509]:   </sysinfo>
Apr 14 10:57:18 user nova-compute[71509]:   <os>
Apr 14 10:57:18 user nova-compute[71509]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 10:57:18 user nova-compute[71509]:     <boot dev="hd"/>
Apr 14 10:57:18 user nova-compute[71509]:     <smbios mode="sysinfo"/>
Apr 14 10:57:18 user nova-compute[71509]:   </os>
Apr 14 10:57:18 user nova-compute[71509]:   <features>
Apr 14 10:57:18 user nova-compute[71509]:     <acpi/>
Apr 14 10:57:18 user nova-compute[71509]:     <apic/>
Apr 14 10:57:18 user nova-compute[71509]:     <vmcoreinfo/>
Apr 14 10:57:18 user nova-compute[71509]:   </features>
Apr 14 10:57:18 user nova-compute[71509]:   <clock offset="utc">
Apr 14 10:57:18 user nova-compute[71509]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 10:57:18 user nova-compute[71509]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 10:57:18 user nova-compute[71509]:     <timer name="hpet" present="no"/>
Apr 14 10:57:18 user nova-compute[71509]:   </clock>
Apr 14 10:57:18 user nova-compute[71509]:   <cpu mode="custom" match="exact">
Apr 14 10:57:18 user nova-compute[71509]:     <model>Nehalem</model>
Apr 14 10:57:18 user nova-compute[71509]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 10:57:18 user nova-compute[71509]:   </cpu>
Apr 14 10:57:18 user nova-compute[71509]:   <devices>
Apr 14 10:57:18 user nova-compute[71509]:     <disk type="file" device="disk">
Apr 14 10:57:18 user nova-compute[71509]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 10:57:18 user nova-compute[71509]:       <source file="/opt/stack/data/nova/instances/0dd9e11f-1fed-42af-ad5c-9cdd051b93e7/disk"/>
Apr 14 10:57:18 user nova-compute[71509]:       <target dev="vda" bus="virtio"/>
Apr 14 10:57:18 user nova-compute[71509]:     </disk>
Apr 14 10:57:18 user nova-compute[71509]:     <interface type="ethernet">
Apr 14 10:57:18 user nova-compute[71509]:       <mac address="fa:16:3e:31:a2:13"/>
Apr 14 10:57:18 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 10:57:18 user nova-compute[71509]:       <mtu size="1442"/>
Apr 14 10:57:18 user nova-compute[71509]:       <target dev="tapec941aab-7c"/>
Apr 14 10:57:18 user nova-compute[71509]:     </interface>
Apr 14 10:57:18 user nova-compute[71509]:     <serial type="pty">
Apr 14 10:57:18 user nova-compute[71509]:       <log file="/opt/stack/data/nova/instances/0dd9e11f-1fed-42af-ad5c-9cdd051b93e7/console.log" append="off"/>
Apr 14 10:57:18 user nova-compute[71509]:     </serial>
Apr 14 10:57:18 user nova-compute[71509]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 10:57:18 user nova-compute[71509]:     <video>
Apr 14 10:57:18 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 10:57:18 user nova-compute[71509]:     </video>
Apr 14 10:57:18 user nova-compute[71509]:     <rng model="virtio">
Apr 14 10:57:18 user nova-compute[71509]:       <backend model="random">/dev/urandom</backend>
Apr 14 10:57:18 user nova-compute[71509]:     </rng>
Apr 14 10:57:18 user nova-compute[71509]:     <controller type="usb" index="0" model="none"/>
Apr 14 10:57:18 user nova-compute[71509]:     <memballoon model="virtio">
Apr 14 10:57:18 user nova-compute[71509]:       <stats period="10"/>
Apr 14 10:57:18 user nova-compute[71509]:     </memballoon>
Apr 14 10:57:18 user nova-compute[71509]:   </devices>
Apr 14 10:57:18 user nova-compute[71509]: </domain>
Apr 14 10:57:18 user nova-compute[71509]:  {{(pid=71509) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 10:57:18 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-f3124171-4bdf-44cd-93c1-71021b4ff843 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T10:57:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1174054965',display_name='tempest-ServerActionsTestJSON-server-1174054965',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1174054965',id=30,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNt/FyD1XXsxB5kJC+SJ1dgkjoXXHkL+KX0Cr5HvI72xTIz+DAtuVRPHeIpMNLt39mbbZ9KAoCJibRQza0Qbd8j8EEoV7QHombhWz2Mdusr+gJ2OYTqrrRzVbjIHACTFWw==',key_name='tempest-keypair-1544270235',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ea2cb4dfa5b4a52b658efd8f5aefb36',ramdisk_id='',reservation_id='r-bb9gxkx7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-1923052090',owner_user_name='tempest-ServerActionsTestJSON-1923052090-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T10:57:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5873a358bf544691b12cd2979f5e36dc',uuid=0dd9e11f-1fed-42af-ad5c-9cdd051b93e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ec941aab-7c95-415b-96bc-e74ebaeb9385", "address": "fa:16:3e:31:a2:13", "network": {"id": "18a91434-637b-4c19-a97b-736b32c1ea5a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1824162811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea2cb4dfa5b4a52b658efd8f5aefb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec941aab-7c", "ovs_interfaceid": "ec941aab-7c95-415b-96bc-e74ebaeb9385", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 10:57:18 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-f3124171-4bdf-44cd-93c1-71021b4ff843 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Converting VIF {"id": "ec941aab-7c95-415b-96bc-e74ebaeb9385", "address": "fa:16:3e:31:a2:13", "network": {"id": "18a91434-637b-4c19-a97b-736b32c1ea5a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1824162811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea2cb4dfa5b4a52b658efd8f5aefb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec941aab-7c", "ovs_interfaceid": "ec941aab-7c95-415b-96bc-e74ebaeb9385", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:57:18 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-f3124171-4bdf-44cd-93c1-71021b4ff843 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:a2:13,bridge_name='br-int',has_traffic_filtering=True,id=ec941aab-7c95-415b-96bc-e74ebaeb9385,network=Network(18a91434-637b-4c19-a97b-736b32c1ea5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec941aab-7c') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:57:18 user nova-compute[71509]: DEBUG os_vif [None req-f3124171-4bdf-44cd-93c1-71021b4ff843 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:a2:13,bridge_name='br-int',has_traffic_filtering=True,id=ec941aab-7c95-415b-96bc-e74ebaeb9385,network=Network(18a91434-637b-4c19-a97b-736b32c1ea5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec941aab-7c') {{(pid=71509) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 10:57:18 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:57:18 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:57:18 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 10:57:18 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:57:18 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapec941aab-7c, may_exist=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:57:18 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapec941aab-7c, col_values=(('external_ids', {'iface-id': 'ec941aab-7c95-415b-96bc-e74ebaeb9385', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:31:a2:13', 'vm-uuid': '0dd9e11f-1fed-42af-ad5c-9cdd051b93e7'}),)) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:57:18 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:57:18 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 10:57:18 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:57:18 user nova-compute[71509]: INFO os_vif [None req-f3124171-4bdf-44cd-93c1-71021b4ff843 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:a2:13,bridge_name='br-int',has_traffic_filtering=True,id=ec941aab-7c95-415b-96bc-e74ebaeb9385,network=Network(18a91434-637b-4c19-a97b-736b32c1ea5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec941aab-7c')
Apr 14 10:57:18 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-f3124171-4bdf-44cd-93c1-71021b4ff843 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] No BDM found with device name vda, not building metadata. {{(pid=71509) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 10:57:18 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-f3124171-4bdf-44cd-93c1-71021b4ff843 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] No VIF found with MAC fa:16:3e:31:a2:13, not building metadata {{(pid=71509) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 10:57:18 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-287cd5f9-e61f-4733-8828-d3c52ef4846a tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "e6580716-8a6a-4dfa-8978-ed54b92af1fe" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.194s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:57:19 user nova-compute[71509]: DEBUG nova.network.neutron [req-732b2fcc-fb3a-44d9-9363-4194dc6b756b req-8360f5b1-7157-48ab-9f4a-f951f363c2a5 service nova] [instance: 0dd9e11f-1fed-42af-ad5c-9cdd051b93e7] Updated VIF entry in instance network info cache for port ec941aab-7c95-415b-96bc-e74ebaeb9385. {{(pid=71509) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 10:57:19 user nova-compute[71509]: DEBUG nova.network.neutron [req-732b2fcc-fb3a-44d9-9363-4194dc6b756b req-8360f5b1-7157-48ab-9f4a-f951f363c2a5 service nova] [instance: 0dd9e11f-1fed-42af-ad5c-9cdd051b93e7] Updating instance_info_cache with network_info: [{"id": "ec941aab-7c95-415b-96bc-e74ebaeb9385", "address": "fa:16:3e:31:a2:13", "network": {"id": "18a91434-637b-4c19-a97b-736b32c1ea5a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1824162811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea2cb4dfa5b4a52b658efd8f5aefb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec941aab-7c", "ovs_interfaceid": "ec941aab-7c95-415b-96bc-e74ebaeb9385", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:57:19 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-732b2fcc-fb3a-44d9-9363-4194dc6b756b req-8360f5b1-7157-48ab-9f4a-f951f363c2a5 service nova] Releasing lock "refresh_cache-0dd9e11f-1fed-42af-ad5c-9cdd051b93e7" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:57:20 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:57:20 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:57:20 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:57:20 user nova-compute[71509]: DEBUG nova.compute.manager [req-4b02bb2c-94ac-4148-b372-acbf76e0bdef req-40bfde2b-c490-4705-b31c-39dad5c634a3 service nova] [instance: 0dd9e11f-1fed-42af-ad5c-9cdd051b93e7] Received event network-vif-plugged-ec941aab-7c95-415b-96bc-e74ebaeb9385 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:57:20 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-4b02bb2c-94ac-4148-b372-acbf76e0bdef req-40bfde2b-c490-4705-b31c-39dad5c634a3 service nova] Acquiring lock "0dd9e11f-1fed-42af-ad5c-9cdd051b93e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:57:20 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-4b02bb2c-94ac-4148-b372-acbf76e0bdef req-40bfde2b-c490-4705-b31c-39dad5c634a3 service nova] Lock "0dd9e11f-1fed-42af-ad5c-9cdd051b93e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:57:20 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-4b02bb2c-94ac-4148-b372-acbf76e0bdef req-40bfde2b-c490-4705-b31c-39dad5c634a3 service nova] Lock "0dd9e11f-1fed-42af-ad5c-9cdd051b93e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:57:20 user nova-compute[71509]: DEBUG nova.compute.manager [req-4b02bb2c-94ac-4148-b372-acbf76e0bdef req-40bfde2b-c490-4705-b31c-39dad5c634a3 service nova] [instance: 0dd9e11f-1fed-42af-ad5c-9cdd051b93e7] No waiting events found dispatching network-vif-plugged-ec941aab-7c95-415b-96bc-e74ebaeb9385 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:57:20 user nova-compute[71509]: WARNING nova.compute.manager [req-4b02bb2c-94ac-4148-b372-acbf76e0bdef req-40bfde2b-c490-4705-b31c-39dad5c634a3 service nova] [instance: 0dd9e11f-1fed-42af-ad5c-9cdd051b93e7] Received unexpected event network-vif-plugged-ec941aab-7c95-415b-96bc-e74ebaeb9385 for instance with vm_state building and task_state spawning.
Apr 14 10:57:20 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-7a511933-0f46-4b75-beda-f7bda65d8e39 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Acquiring lock "e6580716-8a6a-4dfa-8978-ed54b92af1fe" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:57:20 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-7a511933-0f46-4b75-beda-f7bda65d8e39 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "e6580716-8a6a-4dfa-8978-ed54b92af1fe" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:57:20 user nova-compute[71509]: INFO nova.compute.manager [None req-7a511933-0f46-4b75-beda-f7bda65d8e39 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] [instance: e6580716-8a6a-4dfa-8978-ed54b92af1fe] Detaching volume f488d00e-998a-40d7-9e77-1bca2436fd95
Apr 14 10:57:20 user nova-compute[71509]: INFO nova.virt.block_device [None req-7a511933-0f46-4b75-beda-f7bda65d8e39 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] [instance: e6580716-8a6a-4dfa-8978-ed54b92af1fe] Attempting to driver detach volume f488d00e-998a-40d7-9e77-1bca2436fd95 from mountpoint /dev/vdb
Apr 14 10:57:20 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-7a511933-0f46-4b75-beda-f7bda65d8e39 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Attempting to detach device vdb from instance e6580716-8a6a-4dfa-8978-ed54b92af1fe from the persistent domain config. {{(pid=71509) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 10:57:20 user nova-compute[71509]: DEBUG nova.virt.libvirt.guest [None req-7a511933-0f46-4b75-beda-f7bda65d8e39 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 10:57:20 user nova-compute[71509]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 10:57:20 user nova-compute[71509]:   <source dev="/dev/sdb"/>
Apr 14 10:57:20 user nova-compute[71509]:   <target dev="vdb" bus="virtio"/>
Apr 14 10:57:20 user nova-compute[71509]:   <serial>f488d00e-998a-40d7-9e77-1bca2436fd95</serial>
Apr 14 10:57:20 user nova-compute[71509]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 10:57:20 user nova-compute[71509]: </disk>
Apr 14 10:57:20 user nova-compute[71509]:  {{(pid=71509) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 10:57:20 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-7a511933-0f46-4b75-beda-f7bda65d8e39 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Successfully detached device vdb from instance e6580716-8a6a-4dfa-8978-ed54b92af1fe from the persistent domain config.
Apr 14 10:57:20 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-7a511933-0f46-4b75-beda-f7bda65d8e39 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e6580716-8a6a-4dfa-8978-ed54b92af1fe from the live domain config. {{(pid=71509) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 10:57:20 user nova-compute[71509]: DEBUG nova.virt.libvirt.guest [None req-7a511933-0f46-4b75-beda-f7bda65d8e39 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 10:57:20 user nova-compute[71509]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 10:57:20 user nova-compute[71509]:   <source dev="/dev/sdb"/>
Apr 14 10:57:20 user nova-compute[71509]:   <target dev="vdb" bus="virtio"/>
Apr 14 10:57:20 user nova-compute[71509]:   <serial>f488d00e-998a-40d7-9e77-1bca2436fd95</serial>
Apr 14 10:57:20 user nova-compute[71509]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 10:57:20 user nova-compute[71509]: </disk>
Apr 14 10:57:20 user nova-compute[71509]:  {{(pid=71509) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 10:57:20 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:57:20 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:57:20 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:57:20 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:57:21 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Received event <DeviceRemovedEvent: 1681469841.1571054, e6580716-8a6a-4dfa-8978-ed54b92af1fe => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71509) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 10:57:21 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-7a511933-0f46-4b75-beda-f7bda65d8e39 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e6580716-8a6a-4dfa-8978-ed54b92af1fe {{(pid=71509) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 10:57:21 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-7a511933-0f46-4b75-beda-f7bda65d8e39 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Successfully detached device vdb from instance e6580716-8a6a-4dfa-8978-ed54b92af1fe from the live domain config.
Apr 14 10:57:21 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a511933-0f46-4b75-beda-f7bda65d8e39 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] [instance: e6580716-8a6a-4dfa-8978-ed54b92af1fe] calling os-brick to detach iSCSI Volume {{(pid=71509) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 10:57:21 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a511933-0f46-4b75-beda-f7bda65d8e39 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0bf0749390>, {'target_iqn': 'iqn.2010-10.org.openstack:f488d00e-998a-40d7-9e77-1bca2436fd95', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qTtNzySX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 10:57:21 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-7a511933-0f46-4b75-beda-f7bda65d8e39 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 10:57:21 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-7a511933-0f46-4b75-beda-f7bda65d8e39 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 10:57:21 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-7a511933-0f46-4b75-beda-f7bda65d8e39 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 10:57:21 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:57:21 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:57:21 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[31048d47-2f09-4951-8057-04fcd10ba0d5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f488d00e-998a-40d7-9e77-1bca2436fd95\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:57:21 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a511933-0f46-4b75-beda-f7bda65d8e39 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 10:57:21 user nova-compute[71509]: No targets found.
Apr 14 10:57:21 user nova-compute[71509]: iSNS:
Apr 14 10:57:21 user nova-compute[71509]: No targets found.
Apr 14 10:57:21 user nova-compute[71509]: STATIC:
Apr 14 10:57:21 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:f488d00e-998a-40d7-9e77-1bca2436fd95
Apr 14 10:57:21 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:57:21 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:57:21 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178
Apr 14 10:57:21 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:57:21 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:57:21 user nova-compute[71509]: FIRMWARE:
Apr 14 10:57:21 user nova-compute[71509]: No targets found.
Apr 14 10:57:21 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:57:21 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a511933-0f46-4b75-beda-f7bda65d8e39 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 10:57:21 user nova-compute[71509]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 10:57:21 user nova-compute[71509]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71509) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 10:57:21 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a511933-0f46-4b75-beda-f7bda65d8e39 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f488d00e-998a-40d7-9e77-1bca2436fd95', 0)] {{(pid=71509) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 10:57:21 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:57:21 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:57:21 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9b360d6-fd0c-426f-8bfc-e6d076beda4a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f488d00e-998a-40d7-9e77-1bca2436fd95\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:57:21 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:57:21 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:57:21 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf220e05-0bdc-40c1-8961-42b1853ec4dc]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f488d00e-998a-40d7-9e77-1bca2436fd95 (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:57:21 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a511933-0f46-4b75-beda-f7bda65d8e39 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)
Apr 14 10:57:21 user nova-compute[71509]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f488d00e-998a-40d7-9e77-1bca2436fd95 (non-flash)
Apr 14 10:57:21 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:57:21 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a511933-0f46-4b75-beda-f7bda65d8e39 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)
Apr 14 10:57:21 user nova-compute[71509]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f488d00e-998a-40d7-9e77-1bca2436fd95 (non-flash)
Apr 14 10:57:21 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 10:57:21 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a511933-0f46-4b75-beda-f7bda65d8e39 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0c375bb130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f488d00e-998a-40d7-9e77-1bca2436fd95'): ({'sdb'}, set())}) {{(pid=71509) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 10:57:21 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-7a511933-0f46-4b75-beda-f7bda65d8e39 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Removing single pathed devices sdb {{(pid=71509) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 10:57:21 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:57:21 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:57:21 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa746a22-0317-4af0-8a63-2d74207b6ea3]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:57:21 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:57:21 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:57:21 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[b619cf39-29b6-4164-be87-55bab45f5f46]: (4, ('ok\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:57:21 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-7a511933-0f46-4b75-beda-f7bda65d8e39 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Flushing IO for device /dev/sdb {{(pid=71509) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 10:57:21 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:57:21 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:57:21 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe345dcb-9a66-44b7-99a0-24d14a300b9b]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:57:21 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-7a511933-0f46-4b75-beda-f7bda65d8e39 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71509) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 10:57:21 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:57:21 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:57:21 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5e2c23c-2fed-4a9e-b513-16f3483996cb]: (4, ('1', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:57:21 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-7a511933-0f46-4b75-beda-f7bda65d8e39 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71509) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 10:57:21 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-7a511933-0f46-4b75-beda-f7bda65d8e39 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] SCSI volumes sdb have been removed. {{(pid=71509) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 10:57:21 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a511933-0f46-4b75-beda-f7bda65d8e39 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f488d00e-998a-40d7-9e77-1bca2436fd95')] {{(pid=71509) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 10:57:21 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f488d00e-998a-40d7-9e77-1bca2436fd95 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:57:21 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f488d00e-998a-40d7-9e77-1bca2436fd95 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:57:21 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ec6d12e-92c4-4c7a-85df-01ac48e2a4a7]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:57:21 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a511933-0f46-4b75-beda-f7bda65d8e39 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:57:21 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f488d00e-998a-40d7-9e77-1bca2436fd95 -p 172.16.0.220:3260 --logout {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:57:21 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f488d00e-998a-40d7-9e77-1bca2436fd95 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:57:21 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[f548fe63-c24e-4d6e-aaec-439b7f3cf667]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:f488d00e-998a-40d7-9e77-1bca2436fd95, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:f488d00e-998a-40d7-9e77-1bca2436fd95, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:57:21 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a511933-0f46-4b75-beda-f7bda65d8e39 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:f488d00e-998a-40d7-9e77-1bca2436fd95, portal: 172.16.0.220,3260]
Apr 14 10:57:21 user nova-compute[71509]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:f488d00e-998a-40d7-9e77-1bca2436fd95, portal: 172.16.0.220,3260] successful.
Apr 14 10:57:21 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:57:21 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f488d00e-998a-40d7-9e77-1bca2436fd95 -p 172.16.0.220:3260 --op delete {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:57:21 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f488d00e-998a-40d7-9e77-1bca2436fd95 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:57:21 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[e87f0ab5-a76e-4f46-8a63-1c03b568328b]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:57:21 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a511933-0f46-4b75-beda-f7bda65d8e39 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:57:21 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-7a511933-0f46-4b75-beda-f7bda65d8e39 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 10:57:21 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a511933-0f46-4b75-beda-f7bda65d8e39 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] <== disconnect_volume: return (307ms) None {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 10:57:21 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a511933-0f46-4b75-beda-f7bda65d8e39 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] [instance: e6580716-8a6a-4dfa-8978-ed54b92af1fe] Disconnected iSCSI Volume {{(pid=71509) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 10:57:22 user nova-compute[71509]: DEBUG nova.objects.instance [None req-7a511933-0f46-4b75-beda-f7bda65d8e39 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lazy-loading 'flavor' on Instance uuid e6580716-8a6a-4dfa-8978-ed54b92af1fe {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:57:22 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-7a511933-0f46-4b75-beda-f7bda65d8e39 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "e6580716-8a6a-4dfa-8978-ed54b92af1fe" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.879s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:57:22 user nova-compute[71509]: DEBUG nova.compute.manager [req-4468a6db-97ae-4c51-8172-b90c139ae34f req-c6129df8-59d3-4b12-bd84-4dee1a3659da service nova] [instance: 0dd9e11f-1fed-42af-ad5c-9cdd051b93e7] Received event network-vif-plugged-ec941aab-7c95-415b-96bc-e74ebaeb9385 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:57:22 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-4468a6db-97ae-4c51-8172-b90c139ae34f req-c6129df8-59d3-4b12-bd84-4dee1a3659da service nova] Acquiring lock "0dd9e11f-1fed-42af-ad5c-9cdd051b93e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:57:22 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-4468a6db-97ae-4c51-8172-b90c139ae34f req-c6129df8-59d3-4b12-bd84-4dee1a3659da service nova] Lock "0dd9e11f-1fed-42af-ad5c-9cdd051b93e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:57:22 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-4468a6db-97ae-4c51-8172-b90c139ae34f req-c6129df8-59d3-4b12-bd84-4dee1a3659da service nova] Lock "0dd9e11f-1fed-42af-ad5c-9cdd051b93e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:57:22 user nova-compute[71509]: DEBUG nova.compute.manager [req-4468a6db-97ae-4c51-8172-b90c139ae34f req-c6129df8-59d3-4b12-bd84-4dee1a3659da service nova] [instance: 0dd9e11f-1fed-42af-ad5c-9cdd051b93e7] No waiting events found dispatching network-vif-plugged-ec941aab-7c95-415b-96bc-e74ebaeb9385 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:57:22 user nova-compute[71509]: WARNING nova.compute.manager [req-4468a6db-97ae-4c51-8172-b90c139ae34f req-c6129df8-59d3-4b12-bd84-4dee1a3659da service nova] [instance: 0dd9e11f-1fed-42af-ad5c-9cdd051b93e7] Received unexpected event network-vif-plugged-ec941aab-7c95-415b-96bc-e74ebaeb9385 for instance with vm_state building and task_state spawning.
Apr 14 10:57:22 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681469842.5782917, 0dd9e11f-1fed-42af-ad5c-9cdd051b93e7 => Resumed> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 10:57:22 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 0dd9e11f-1fed-42af-ad5c-9cdd051b93e7] VM Resumed (Lifecycle Event)
Apr 14 10:57:22 user nova-compute[71509]: DEBUG nova.compute.manager [None req-f3124171-4bdf-44cd-93c1-71021b4ff843 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 0dd9e11f-1fed-42af-ad5c-9cdd051b93e7] Instance event wait completed in 0 seconds for  {{(pid=71509) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 10:57:22 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-f3124171-4bdf-44cd-93c1-71021b4ff843 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 0dd9e11f-1fed-42af-ad5c-9cdd051b93e7] Guest created on hypervisor {{(pid=71509) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 10:57:22 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: 0dd9e11f-1fed-42af-ad5c-9cdd051b93e7] Instance spawned successfully.
Apr 14 10:57:22 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-f3124171-4bdf-44cd-93c1-71021b4ff843 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 0dd9e11f-1fed-42af-ad5c-9cdd051b93e7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 10:57:22 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 0dd9e11f-1fed-42af-ad5c-9cdd051b93e7] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:57:22 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 0dd9e11f-1fed-42af-ad5c-9cdd051b93e7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 10:57:22 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-f3124171-4bdf-44cd-93c1-71021b4ff843 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 0dd9e11f-1fed-42af-ad5c-9cdd051b93e7] Found default for hw_cdrom_bus of ide {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:57:22 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-f3124171-4bdf-44cd-93c1-71021b4ff843 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 0dd9e11f-1fed-42af-ad5c-9cdd051b93e7] Found default for hw_disk_bus of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:57:22 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-f3124171-4bdf-44cd-93c1-71021b4ff843 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 0dd9e11f-1fed-42af-ad5c-9cdd051b93e7] Found default for hw_input_bus of None {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:57:22 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-f3124171-4bdf-44cd-93c1-71021b4ff843 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 0dd9e11f-1fed-42af-ad5c-9cdd051b93e7] Found default for hw_pointer_model of None {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:57:22 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-f3124171-4bdf-44cd-93c1-71021b4ff843 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 0dd9e11f-1fed-42af-ad5c-9cdd051b93e7] Found default for hw_video_model of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:57:22 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-f3124171-4bdf-44cd-93c1-71021b4ff843 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 0dd9e11f-1fed-42af-ad5c-9cdd051b93e7] Found default for hw_vif_model of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:57:22 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 0dd9e11f-1fed-42af-ad5c-9cdd051b93e7] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 10:57:22 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681469842.580881, 0dd9e11f-1fed-42af-ad5c-9cdd051b93e7 => Started> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 10:57:22 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 0dd9e11f-1fed-42af-ad5c-9cdd051b93e7] VM Started (Lifecycle Event)
Apr 14 10:57:22 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 0dd9e11f-1fed-42af-ad5c-9cdd051b93e7] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:57:22 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 0dd9e11f-1fed-42af-ad5c-9cdd051b93e7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 10:57:22 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 0dd9e11f-1fed-42af-ad5c-9cdd051b93e7] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 10:57:22 user nova-compute[71509]: INFO nova.compute.manager [None req-f3124171-4bdf-44cd-93c1-71021b4ff843 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 0dd9e11f-1fed-42af-ad5c-9cdd051b93e7] Took 6.38 seconds to spawn the instance on the hypervisor.
Apr 14 10:57:22 user nova-compute[71509]: DEBUG nova.compute.manager [None req-f3124171-4bdf-44cd-93c1-71021b4ff843 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 0dd9e11f-1fed-42af-ad5c-9cdd051b93e7] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:57:22 user nova-compute[71509]: INFO nova.compute.manager [None req-f3124171-4bdf-44cd-93c1-71021b4ff843 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 0dd9e11f-1fed-42af-ad5c-9cdd051b93e7] Took 7.42 seconds to build instance.
Apr 14 10:57:22 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-f3124171-4bdf-44cd-93c1-71021b4ff843 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "0dd9e11f-1fed-42af-ad5c-9cdd051b93e7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.550s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:57:23 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:57:23 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:57:28 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:57:28 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:57:33 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:57:33 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:57:38 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:57:38 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:57:42 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:57:42 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:57:42 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:57:42 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:57:42 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71509) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 10:57:43 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:57:43 user nova-compute[71509]: DEBUG nova.compute.manager [None req-074c6016-5dc2-41dc-a88a-208427ac486c tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: a936fb20-3f17-4114-829a-8659da6bc5f3] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:57:43 user nova-compute[71509]: INFO nova.compute.manager [None req-074c6016-5dc2-41dc-a88a-208427ac486c tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: a936fb20-3f17-4114-829a-8659da6bc5f3] instance snapshotting
Apr 14 10:57:43 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-074c6016-5dc2-41dc-a88a-208427ac486c tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: a936fb20-3f17-4114-829a-8659da6bc5f3] Beginning live snapshot process
Apr 14 10:57:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-074c6016-5dc2-41dc-a88a-208427ac486c tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a936fb20-3f17-4114-829a-8659da6bc5f3/disk --force-share --output=json -f qcow2 {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:57:43 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:57:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-074c6016-5dc2-41dc-a88a-208427ac486c tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a936fb20-3f17-4114-829a-8659da6bc5f3/disk --force-share --output=json -f qcow2" returned: 0 in 0.141s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:57:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-074c6016-5dc2-41dc-a88a-208427ac486c tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a936fb20-3f17-4114-829a-8659da6bc5f3/disk --force-share --output=json -f qcow2 {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:57:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-074c6016-5dc2-41dc-a88a-208427ac486c tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a936fb20-3f17-4114-829a-8659da6bc5f3/disk --force-share --output=json -f qcow2" returned: 0 in 0.134s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:57:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-074c6016-5dc2-41dc-a88a-208427ac486c tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:57:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-074c6016-5dc2-41dc-a88a-208427ac486c tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json" returned: 0 in 0.142s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:57:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-074c6016-5dc2-41dc-a88a-208427ac486c tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpxw8dyd8v/03c4985d551a4a3fa1be61b82fb8020b.delta 1073741824 {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:57:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-074c6016-5dc2-41dc-a88a-208427ac486c tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpxw8dyd8v/03c4985d551a4a3fa1be61b82fb8020b.delta 1073741824" returned: 0 in 0.048s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:57:44 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-074c6016-5dc2-41dc-a88a-208427ac486c tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: a936fb20-3f17-4114-829a-8659da6bc5f3] Quiescing instance not available: QEMU guest agent is not enabled.
Apr 14 10:57:44 user nova-compute[71509]: DEBUG nova.virt.libvirt.guest [None req-074c6016-5dc2-41dc-a88a-208427ac486c tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] COPY block job progress, current cursor: 0 final cursor: 43778048 {{(pid=71509) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 10:57:45 user nova-compute[71509]: DEBUG nova.virt.libvirt.guest [None req-074c6016-5dc2-41dc-a88a-208427ac486c tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] COPY block job progress, current cursor: 43778048 final cursor: 43778048 {{(pid=71509) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 10:57:45 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-074c6016-5dc2-41dc-a88a-208427ac486c tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: a936fb20-3f17-4114-829a-8659da6bc5f3] Skipping quiescing instance: QEMU guest agent is not enabled.
Apr 14 10:57:45 user nova-compute[71509]: DEBUG nova.privsep.utils [None req-074c6016-5dc2-41dc-a88a-208427ac486c tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71509) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 10:57:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-074c6016-5dc2-41dc-a88a-208427ac486c tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpxw8dyd8v/03c4985d551a4a3fa1be61b82fb8020b.delta /opt/stack/data/nova/instances/snapshots/tmpxw8dyd8v/03c4985d551a4a3fa1be61b82fb8020b {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:57:45 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:57:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-074c6016-5dc2-41dc-a88a-208427ac486c tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpxw8dyd8v/03c4985d551a4a3fa1be61b82fb8020b.delta /opt/stack/data/nova/instances/snapshots/tmpxw8dyd8v/03c4985d551a4a3fa1be61b82fb8020b" returned: 0 in 0.354s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:57:45 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-074c6016-5dc2-41dc-a88a-208427ac486c tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: a936fb20-3f17-4114-829a-8659da6bc5f3] Snapshot extracted, beginning image upload
Apr 14 10:57:46 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:57:46 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:57:47 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-074c6016-5dc2-41dc-a88a-208427ac486c tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: a936fb20-3f17-4114-829a-8659da6bc5f3] Snapshot image upload complete
Apr 14 10:57:47 user nova-compute[71509]: INFO nova.compute.manager [None req-074c6016-5dc2-41dc-a88a-208427ac486c tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: a936fb20-3f17-4114-829a-8659da6bc5f3] Took 4.57 seconds to snapshot the instance on the hypervisor.
Apr 14 10:57:48 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:57:48 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:57:48 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Starting heal instance info cache {{(pid=71509) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 10:57:48 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "refresh_cache-e479154a-acd6-47aa-9a5b-43c6e0feda07" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:57:48 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquired lock "refresh_cache-e479154a-acd6-47aa-9a5b-43c6e0feda07" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:57:48 user nova-compute[71509]: DEBUG nova.network.neutron [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] [instance: e479154a-acd6-47aa-9a5b-43c6e0feda07] Forcefully refreshing network info cache for instance {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 10:57:48 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:57:49 user nova-compute[71509]: DEBUG nova.network.neutron [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] [instance: e479154a-acd6-47aa-9a5b-43c6e0feda07] Updating instance_info_cache with network_info: [{"id": "2fbfd894-8e16-4039-b726-638e802602c5", "address": "fa:16:3e:4d:3b:0d", "network": {"id": "07f1f39e-292a-4e73-b4ed-99e5799d6fa8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1339551596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71289f80a05141f482cb538dac3d7b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fbfd894-8e", "ovs_interfaceid": "2fbfd894-8e16-4039-b726-638e802602c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:57:49 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Releasing lock "refresh_cache-e479154a-acd6-47aa-9a5b-43c6e0feda07" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:57:49 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] [instance: e479154a-acd6-47aa-9a5b-43c6e0feda07] Updated the network info_cache for instance {{(pid=71509) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 10:57:49 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-8b70663a-ec56-446d-97ce-cc021794630e tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Acquiring lock "0bb99276-64ba-4641-8869-3f35eea2f76e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:57:49 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-8b70663a-ec56-446d-97ce-cc021794630e tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "0bb99276-64ba-4641-8869-3f35eea2f76e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:57:49 user nova-compute[71509]: DEBUG nova.compute.manager [None req-8b70663a-ec56-446d-97ce-cc021794630e tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 0bb99276-64ba-4641-8869-3f35eea2f76e] Starting instance... {{(pid=71509) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 10:57:49 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-8b70663a-ec56-446d-97ce-cc021794630e tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:57:49 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-8b70663a-ec56-446d-97ce-cc021794630e tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:57:49 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-8b70663a-ec56-446d-97ce-cc021794630e tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71509) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 10:57:49 user nova-compute[71509]: INFO nova.compute.claims [None req-8b70663a-ec56-446d-97ce-cc021794630e tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 0bb99276-64ba-4641-8869-3f35eea2f76e] Claim successful on node user
Apr 14 10:57:50 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-4eabd2cf-2e0c-404c-9349-4a002956c002 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Acquiring lock "d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:57:50 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-4eabd2cf-2e0c-404c-9349-4a002956c002 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:57:50 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-4eabd2cf-2e0c-404c-9349-4a002956c002 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Acquiring lock "d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:57:50 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-4eabd2cf-2e0c-404c-9349-4a002956c002 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:57:50 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-4eabd2cf-2e0c-404c-9349-4a002956c002 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:57:50 user nova-compute[71509]: INFO nova.compute.manager [None req-4eabd2cf-2e0c-404c-9349-4a002956c002 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Terminating instance
Apr 14 10:57:50 user nova-compute[71509]: DEBUG nova.compute.manager [None req-4eabd2cf-2e0c-404c-9349-4a002956c002 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Start destroying the instance on the hypervisor. {{(pid=71509) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 10:57:50 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:57:50 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:57:50 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-8b70663a-ec56-446d-97ce-cc021794630e tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 10:57:50 user nova-compute[71509]: DEBUG nova.compute.manager [req-570e8bf1-f409-4653-80dd-4dc8058decc1 req-ef0b8780-66d4-45b5-b57b-6f4b355ba3c8 service nova] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Received event network-vif-unplugged-f2196ef3-aada-48d6-b524-5e9cef6a9eda {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:57:50 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-570e8bf1-f409-4653-80dd-4dc8058decc1 req-ef0b8780-66d4-45b5-b57b-6f4b355ba3c8 service nova] Acquiring lock "d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:57:50 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-570e8bf1-f409-4653-80dd-4dc8058decc1 req-ef0b8780-66d4-45b5-b57b-6f4b355ba3c8 service nova] Lock "d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:57:50 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-570e8bf1-f409-4653-80dd-4dc8058decc1 req-ef0b8780-66d4-45b5-b57b-6f4b355ba3c8 service nova] Lock "d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:57:50 user nova-compute[71509]: DEBUG nova.compute.manager [req-570e8bf1-f409-4653-80dd-4dc8058decc1 req-ef0b8780-66d4-45b5-b57b-6f4b355ba3c8 service nova] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] No waiting events found dispatching network-vif-unplugged-f2196ef3-aada-48d6-b524-5e9cef6a9eda {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:57:50 user nova-compute[71509]: DEBUG nova.compute.manager [req-570e8bf1-f409-4653-80dd-4dc8058decc1 req-ef0b8780-66d4-45b5-b57b-6f4b355ba3c8 service nova] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Received event network-vif-unplugged-f2196ef3-aada-48d6-b524-5e9cef6a9eda for instance with task_state deleting. {{(pid=71509) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 10:57:50 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-8b70663a-ec56-446d-97ce-cc021794630e tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 10:57:50 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-8b70663a-ec56-446d-97ce-cc021794630e tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.506s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:57:50 user nova-compute[71509]: DEBUG nova.compute.manager [None req-8b70663a-ec56-446d-97ce-cc021794630e tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 0bb99276-64ba-4641-8869-3f35eea2f76e] Start building networks asynchronously for instance. {{(pid=71509) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 10:57:50 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:57:50 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:57:50 user nova-compute[71509]: DEBUG nova.compute.manager [None req-8b70663a-ec56-446d-97ce-cc021794630e tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 0bb99276-64ba-4641-8869-3f35eea2f76e] Allocating IP information in the background. {{(pid=71509) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 10:57:50 user nova-compute[71509]: DEBUG nova.network.neutron [None req-8b70663a-ec56-446d-97ce-cc021794630e tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 0bb99276-64ba-4641-8869-3f35eea2f76e] allocate_for_instance() {{(pid=71509) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 10:57:50 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-8b70663a-ec56-446d-97ce-cc021794630e tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 0bb99276-64ba-4641-8869-3f35eea2f76e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 10:57:50 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:57:50 user nova-compute[71509]: DEBUG nova.compute.manager [None req-8b70663a-ec56-446d-97ce-cc021794630e tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 0bb99276-64ba-4641-8869-3f35eea2f76e] Start building block device mappings for instance. {{(pid=71509) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 10:57:50 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:57:50 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:57:50 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:57:50 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Auditing locally available compute resources for user (node: user) {{(pid=71509) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 10:57:50 user nova-compute[71509]: DEBUG nova.policy [None req-8b70663a-ec56-446d-97ce-cc021794630e tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '11cb4a1e78d447dbb18cde5453fe499c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9b9fc4f2e244879502006bb844761c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71509) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 10:57:50 user nova-compute[71509]: DEBUG nova.compute.manager [None req-8b70663a-ec56-446d-97ce-cc021794630e tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 0bb99276-64ba-4641-8869-3f35eea2f76e] Start spawning the instance on the hypervisor. {{(pid=71509) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 10:57:50 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-8b70663a-ec56-446d-97ce-cc021794630e tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 0bb99276-64ba-4641-8869-3f35eea2f76e] Creating instance directory {{(pid=71509) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 10:57:50 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-8b70663a-ec56-446d-97ce-cc021794630e tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 0bb99276-64ba-4641-8869-3f35eea2f76e] Creating image(s)
Apr 14 10:57:50 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-8b70663a-ec56-446d-97ce-cc021794630e tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Acquiring lock "/opt/stack/data/nova/instances/0bb99276-64ba-4641-8869-3f35eea2f76e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:57:50 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-8b70663a-ec56-446d-97ce-cc021794630e tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "/opt/stack/data/nova/instances/0bb99276-64ba-4641-8869-3f35eea2f76e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:57:50 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-8b70663a-ec56-446d-97ce-cc021794630e tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "/opt/stack/data/nova/instances/0bb99276-64ba-4641-8869-3f35eea2f76e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:57:50 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-8b70663a-ec56-446d-97ce-cc021794630e tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:57:50 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-8b70663a-ec56-446d-97ce-cc021794630e tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json" returned: 0 in 0.133s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:57:50 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-8b70663a-ec56-446d-97ce-cc021794630e tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Acquiring lock "5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:57:50 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-8b70663a-ec56-446d-97ce-cc021794630e tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:57:50 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-8b70663a-ec56-446d-97ce-cc021794630e tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:57:50 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Instance destroyed successfully.
Apr 14 10:57:50 user nova-compute[71509]: DEBUG nova.objects.instance [None req-4eabd2cf-2e0c-404c-9349-4a002956c002 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lazy-loading 'resources' on Instance uuid d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:57:50 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-4eabd2cf-2e0c-404c-9349-4a002956c002 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T10:51:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1793508079',display_name='tempest-ServerRescueNegativeTestJSON-server-1793508079',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1793508079',id=22,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPCWcovyJGJoU2VVqBXHmxw2WqzQwe3JweQ4DFCyMODxzU7SfyIb92ARO4ehF+n8xN2UWQPLSSsVS3f1Va86nHzHvrj9cePHzTOq5SnHeWVBXyUULcZytrQgbP7FG6mgKQ==',key_name='tempest-keypair-1550009007',keypairs=<?>,launch_index=0,launched_at=2023-04-14T10:53:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bf93e5dac50342d0b65ef09711401e99',ramdisk_id='',reservation_id='r-qz8mgt4t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-563868574',owner_user_name='tempest-ServerRescueNegativeTestJSON-563868574-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T10:55:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e359578dcbb24755a216415053d415ef',uuid=d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f2196ef3-aada-48d6-b524-5e9cef6a9eda", "address": "fa:16:3e:e7:31:44", "network": {"id": "22eb5f87-be4d-447d-bafe-25e0284ea3ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-787804772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf93e5dac50342d0b65ef09711401e99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2196ef3-aa", "ovs_interfaceid": "f2196ef3-aada-48d6-b524-5e9cef6a9eda", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 10:57:50 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-4eabd2cf-2e0c-404c-9349-4a002956c002 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Converting VIF {"id": "f2196ef3-aada-48d6-b524-5e9cef6a9eda", "address": "fa:16:3e:e7:31:44", "network": {"id": "22eb5f87-be4d-447d-bafe-25e0284ea3ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-787804772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf93e5dac50342d0b65ef09711401e99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2196ef3-aa", "ovs_interfaceid": "f2196ef3-aada-48d6-b524-5e9cef6a9eda", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:57:50 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-4eabd2cf-2e0c-404c-9349-4a002956c002 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e7:31:44,bridge_name='br-int',has_traffic_filtering=True,id=f2196ef3-aada-48d6-b524-5e9cef6a9eda,network=Network(22eb5f87-be4d-447d-bafe-25e0284ea3ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2196ef3-aa') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:57:50 user nova-compute[71509]: DEBUG os_vif [None req-4eabd2cf-2e0c-404c-9349-4a002956c002 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e7:31:44,bridge_name='br-int',has_traffic_filtering=True,id=f2196ef3-aada-48d6-b524-5e9cef6a9eda,network=Network(22eb5f87-be4d-447d-bafe-25e0284ea3ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2196ef3-aa') {{(pid=71509) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 10:57:50 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:57:50 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf2196ef3-aa, bridge=br-int, if_exists=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:57:50 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 10:57:50 user nova-compute[71509]: INFO os_vif [None req-4eabd2cf-2e0c-404c-9349-4a002956c002 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e7:31:44,bridge_name='br-int',has_traffic_filtering=True,id=f2196ef3-aada-48d6-b524-5e9cef6a9eda,network=Network(22eb5f87-be4d-447d-bafe-25e0284ea3ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2196ef3-aa')
Apr 14 10:57:50 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-4eabd2cf-2e0c-404c-9349-4a002956c002 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Deleting instance files /opt/stack/data/nova/instances/d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5_del
Apr 14 10:57:50 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-4eabd2cf-2e0c-404c-9349-4a002956c002 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Deletion of /opt/stack/data/nova/instances/d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5_del complete
Apr 14 10:57:50 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-8b70663a-ec56-446d-97ce-cc021794630e tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json" returned: 0 in 0.144s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:57:50 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-8b70663a-ec56-446d-97ce-cc021794630e tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18,backing_fmt=raw /opt/stack/data/nova/instances/0bb99276-64ba-4641-8869-3f35eea2f76e/disk 1073741824 {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:57:50 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-8b70663a-ec56-446d-97ce-cc021794630e tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18,backing_fmt=raw /opt/stack/data/nova/instances/0bb99276-64ba-4641-8869-3f35eea2f76e/disk 1073741824" returned: 0 in 0.056s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:57:50 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-8b70663a-ec56-446d-97ce-cc021794630e tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.205s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:57:50 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-8b70663a-ec56-446d-97ce-cc021794630e tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:57:51 user nova-compute[71509]: INFO nova.compute.manager [None req-4eabd2cf-2e0c-404c-9349-4a002956c002 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Took 0.99 seconds to destroy the instance on the hypervisor.
Apr 14 10:57:51 user nova-compute[71509]: DEBUG oslo.service.loopingcall [None req-4eabd2cf-2e0c-404c-9349-4a002956c002 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71509) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 10:57:51 user nova-compute[71509]: DEBUG nova.compute.manager [-] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Deallocating network for instance {{(pid=71509) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 10:57:51 user nova-compute[71509]: DEBUG nova.network.neutron [-] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] deallocate_for_instance() {{(pid=71509) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 10:57:51 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-8b70663a-ec56-446d-97ce-cc021794630e tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json" returned: 0 in 0.152s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:57:51 user nova-compute[71509]: DEBUG nova.virt.disk.api [None req-8b70663a-ec56-446d-97ce-cc021794630e tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0bb99276-64ba-4641-8869-3f35eea2f76e/disk. size=1073741824 {{(pid=71509) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 10:57:51 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-8b70663a-ec56-446d-97ce-cc021794630e tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bb99276-64ba-4641-8869-3f35eea2f76e/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:57:51 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97820f17-22d1-4ec3-9721-1edadccc794a/disk.rescue --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:57:51 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-8b70663a-ec56-446d-97ce-cc021794630e tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bb99276-64ba-4641-8869-3f35eea2f76e/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:57:51 user nova-compute[71509]: DEBUG nova.virt.disk.api [None req-8b70663a-ec56-446d-97ce-cc021794630e tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Cannot resize image /opt/stack/data/nova/instances/0bb99276-64ba-4641-8869-3f35eea2f76e/disk to a smaller size. {{(pid=71509) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 10:57:51 user nova-compute[71509]: DEBUG nova.objects.instance [None req-8b70663a-ec56-446d-97ce-cc021794630e tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lazy-loading 'migration_context' on Instance uuid 0bb99276-64ba-4641-8869-3f35eea2f76e {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:57:51 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-8b70663a-ec56-446d-97ce-cc021794630e tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 0bb99276-64ba-4641-8869-3f35eea2f76e] Created local disks {{(pid=71509) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 10:57:51 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-8b70663a-ec56-446d-97ce-cc021794630e tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 0bb99276-64ba-4641-8869-3f35eea2f76e] Ensure instance console log exists: /opt/stack/data/nova/instances/0bb99276-64ba-4641-8869-3f35eea2f76e/console.log {{(pid=71509) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 10:57:51 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-8b70663a-ec56-446d-97ce-cc021794630e tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:57:51 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-8b70663a-ec56-446d-97ce-cc021794630e tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:57:51 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-8b70663a-ec56-446d-97ce-cc021794630e tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:57:51 user nova-compute[71509]: DEBUG nova.network.neutron [None req-8b70663a-ec56-446d-97ce-cc021794630e tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 0bb99276-64ba-4641-8869-3f35eea2f76e] Successfully created port: 7e4a1964-f2d0-4a4f-81fc-adf97c621209 {{(pid=71509) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 10:57:51 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97820f17-22d1-4ec3-9721-1edadccc794a/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:57:51 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97820f17-22d1-4ec3-9721-1edadccc794a/disk.rescue --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:57:51 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97820f17-22d1-4ec3-9721-1edadccc794a/disk.rescue --force-share --output=json" returned: 0 in 0.147s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:57:51 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97820f17-22d1-4ec3-9721-1edadccc794a/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:57:51 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97820f17-22d1-4ec3-9721-1edadccc794a/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:57:51 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97820f17-22d1-4ec3-9721-1edadccc794a/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:57:51 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97820f17-22d1-4ec3-9721-1edadccc794a/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:57:51 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ade9eacb-d4f9-406d-85c4-043037a4b6ba/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:57:51 user nova-compute[71509]: DEBUG nova.compute.manager [req-8bdf08c4-5720-4a61-89ca-ea9aeebc8fd1 req-40cfa371-138c-4a85-8d1a-fc73270d6a0b service nova] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Received event network-vif-deleted-f2196ef3-aada-48d6-b524-5e9cef6a9eda {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:57:51 user nova-compute[71509]: INFO nova.compute.manager [req-8bdf08c4-5720-4a61-89ca-ea9aeebc8fd1 req-40cfa371-138c-4a85-8d1a-fc73270d6a0b service nova] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Neutron deleted interface f2196ef3-aada-48d6-b524-5e9cef6a9eda; detaching it from the instance and deleting it from the info cache
Apr 14 10:57:51 user nova-compute[71509]: DEBUG nova.network.neutron [req-8bdf08c4-5720-4a61-89ca-ea9aeebc8fd1 req-40cfa371-138c-4a85-8d1a-fc73270d6a0b service nova] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Updating instance_info_cache with network_info: [] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:57:51 user nova-compute[71509]: DEBUG nova.network.neutron [-] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Updating instance_info_cache with network_info: [] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:57:51 user nova-compute[71509]: INFO nova.compute.manager [-] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Took 0.85 seconds to deallocate network for instance.
Apr 14 10:57:51 user nova-compute[71509]: DEBUG nova.compute.manager [req-8bdf08c4-5720-4a61-89ca-ea9aeebc8fd1 req-40cfa371-138c-4a85-8d1a-fc73270d6a0b service nova] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Detach interface failed, port_id=f2196ef3-aada-48d6-b524-5e9cef6a9eda, reason: Instance d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5 could not be found. {{(pid=71509) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 10:57:51 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-4eabd2cf-2e0c-404c-9349-4a002956c002 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:57:51 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-4eabd2cf-2e0c-404c-9349-4a002956c002 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:57:51 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ade9eacb-d4f9-406d-85c4-043037a4b6ba/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:57:51 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ade9eacb-d4f9-406d-85c4-043037a4b6ba/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:57:52 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ade9eacb-d4f9-406d-85c4-043037a4b6ba/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:57:52 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6580716-8a6a-4dfa-8978-ed54b92af1fe/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:57:52 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6580716-8a6a-4dfa-8978-ed54b92af1fe/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:57:52 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6580716-8a6a-4dfa-8978-ed54b92af1fe/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:57:52 user nova-compute[71509]: DEBUG nova.compute.manager [req-a9f46065-9d32-44d3-b7f0-260536ce1c81 req-e2789677-d409-451b-8365-28d8522b9807 service nova] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Received event network-vif-plugged-f2196ef3-aada-48d6-b524-5e9cef6a9eda {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:57:52 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-a9f46065-9d32-44d3-b7f0-260536ce1c81 req-e2789677-d409-451b-8365-28d8522b9807 service nova] Acquiring lock "d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:57:52 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-a9f46065-9d32-44d3-b7f0-260536ce1c81 req-e2789677-d409-451b-8365-28d8522b9807 service nova] Lock "d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:57:52 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-a9f46065-9d32-44d3-b7f0-260536ce1c81 req-e2789677-d409-451b-8365-28d8522b9807 service nova] Lock "d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:57:52 user nova-compute[71509]: DEBUG nova.compute.manager [req-a9f46065-9d32-44d3-b7f0-260536ce1c81 req-e2789677-d409-451b-8365-28d8522b9807 service nova] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] No waiting events found dispatching network-vif-plugged-f2196ef3-aada-48d6-b524-5e9cef6a9eda {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:57:52 user nova-compute[71509]: WARNING nova.compute.manager [req-a9f46065-9d32-44d3-b7f0-260536ce1c81 req-e2789677-d409-451b-8365-28d8522b9807 service nova] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Received unexpected event network-vif-plugged-f2196ef3-aada-48d6-b524-5e9cef6a9eda for instance with vm_state deleted and task_state None.
Apr 14 10:57:52 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-4eabd2cf-2e0c-404c-9349-4a002956c002 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 10:57:52 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-4eabd2cf-2e0c-404c-9349-4a002956c002 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 10:57:52 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6580716-8a6a-4dfa-8978-ed54b92af1fe/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:57:52 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e479154a-acd6-47aa-9a5b-43c6e0feda07/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:57:52 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-4eabd2cf-2e0c-404c-9349-4a002956c002 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.575s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:57:52 user nova-compute[71509]: INFO nova.scheduler.client.report [None req-4eabd2cf-2e0c-404c-9349-4a002956c002 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Deleted allocations for instance d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5
Apr 14 10:57:52 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-4eabd2cf-2e0c-404c-9349-4a002956c002 tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.615s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:57:52 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e479154a-acd6-47aa-9a5b-43c6e0feda07/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:57:52 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e479154a-acd6-47aa-9a5b-43c6e0feda07/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:57:52 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e479154a-acd6-47aa-9a5b-43c6e0feda07/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:57:52 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f41f217-0df2-4205-9633-7dbe83f40c96/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:57:52 user nova-compute[71509]: DEBUG nova.network.neutron [None req-8b70663a-ec56-446d-97ce-cc021794630e tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 0bb99276-64ba-4641-8869-3f35eea2f76e] Successfully updated port: 7e4a1964-f2d0-4a4f-81fc-adf97c621209 {{(pid=71509) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 10:57:52 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f41f217-0df2-4205-9633-7dbe83f40c96/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:57:52 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f41f217-0df2-4205-9633-7dbe83f40c96/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:57:52 user nova-compute[71509]: DEBUG nova.compute.manager [req-a7a9097e-34f9-4d39-89b8-352f311bd3a5 req-66dd9cd1-ac70-45fa-8116-d92997eac405 service nova] [instance: 0bb99276-64ba-4641-8869-3f35eea2f76e] Received event network-changed-7e4a1964-f2d0-4a4f-81fc-adf97c621209 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:57:52 user nova-compute[71509]: DEBUG nova.compute.manager [req-a7a9097e-34f9-4d39-89b8-352f311bd3a5 req-66dd9cd1-ac70-45fa-8116-d92997eac405 service nova] [instance: 0bb99276-64ba-4641-8869-3f35eea2f76e] Refreshing instance network info cache due to event network-changed-7e4a1964-f2d0-4a4f-81fc-adf97c621209. {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 10:57:52 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-a7a9097e-34f9-4d39-89b8-352f311bd3a5 req-66dd9cd1-ac70-45fa-8116-d92997eac405 service nova] Acquiring lock "refresh_cache-0bb99276-64ba-4641-8869-3f35eea2f76e" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:57:52 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-a7a9097e-34f9-4d39-89b8-352f311bd3a5 req-66dd9cd1-ac70-45fa-8116-d92997eac405 service nova] Acquired lock "refresh_cache-0bb99276-64ba-4641-8869-3f35eea2f76e" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:57:52 user nova-compute[71509]: DEBUG nova.network.neutron [req-a7a9097e-34f9-4d39-89b8-352f311bd3a5 req-66dd9cd1-ac70-45fa-8116-d92997eac405 service nova] [instance: 0bb99276-64ba-4641-8869-3f35eea2f76e] Refreshing network info cache for port 7e4a1964-f2d0-4a4f-81fc-adf97c621209 {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 10:57:53 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-8b70663a-ec56-446d-97ce-cc021794630e tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Acquiring lock "refresh_cache-0bb99276-64ba-4641-8869-3f35eea2f76e" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:57:53 user nova-compute[71509]: DEBUG nova.network.neutron [req-a7a9097e-34f9-4d39-89b8-352f311bd3a5 req-66dd9cd1-ac70-45fa-8116-d92997eac405 service nova] [instance: 0bb99276-64ba-4641-8869-3f35eea2f76e] Instance cache missing network info. {{(pid=71509) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 10:57:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f41f217-0df2-4205-9633-7dbe83f40c96/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:57:53 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71509) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 10:57:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97f20661-8b60-439e-b7af-2fc2013c5ade/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:57:53 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:57:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97f20661-8b60-439e-b7af-2fc2013c5ade/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:57:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97f20661-8b60-439e-b7af-2fc2013c5ade/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:57:53 user nova-compute[71509]: DEBUG nova.network.neutron [req-a7a9097e-34f9-4d39-89b8-352f311bd3a5 req-66dd9cd1-ac70-45fa-8116-d92997eac405 service nova] [instance: 0bb99276-64ba-4641-8869-3f35eea2f76e] Updating instance_info_cache with network_info: [] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:57:53 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-a7a9097e-34f9-4d39-89b8-352f311bd3a5 req-66dd9cd1-ac70-45fa-8116-d92997eac405 service nova] Releasing lock "refresh_cache-0bb99276-64ba-4641-8869-3f35eea2f76e" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:57:53 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-8b70663a-ec56-446d-97ce-cc021794630e tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Acquired lock "refresh_cache-0bb99276-64ba-4641-8869-3f35eea2f76e" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:57:53 user nova-compute[71509]: DEBUG nova.network.neutron [None req-8b70663a-ec56-446d-97ce-cc021794630e tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 0bb99276-64ba-4641-8869-3f35eea2f76e] Building network info cache for instance {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 10:57:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97f20661-8b60-439e-b7af-2fc2013c5ade/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:57:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe152ebd-4f99-4fa8-bfdb-8744cdf3f387/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:57:53 user nova-compute[71509]: DEBUG nova.network.neutron [None req-8b70663a-ec56-446d-97ce-cc021794630e tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 0bb99276-64ba-4641-8869-3f35eea2f76e] Instance cache missing network info. {{(pid=71509) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 10:57:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe152ebd-4f99-4fa8-bfdb-8744cdf3f387/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:57:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe152ebd-4f99-4fa8-bfdb-8744cdf3f387/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:57:53 user nova-compute[71509]: DEBUG nova.network.neutron [None req-8b70663a-ec56-446d-97ce-cc021794630e tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 0bb99276-64ba-4641-8869-3f35eea2f76e] Updating instance_info_cache with network_info: [{"id": "7e4a1964-f2d0-4a4f-81fc-adf97c621209", "address": "fa:16:3e:3f:d7:0d", "network": {"id": "653f0c81-1afd-4ca6-9639-675ead1a6127", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-932652547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb9b9fc4f2e244879502006bb844761c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e4a1964-f2", "ovs_interfaceid": "7e4a1964-f2d0-4a4f-81fc-adf97c621209", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:57:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe152ebd-4f99-4fa8-bfdb-8744cdf3f387/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:57:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a936fb20-3f17-4114-829a-8659da6bc5f3/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:57:53 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-8b70663a-ec56-446d-97ce-cc021794630e tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Releasing lock "refresh_cache-0bb99276-64ba-4641-8869-3f35eea2f76e" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:57:53 user nova-compute[71509]: DEBUG nova.compute.manager [None req-8b70663a-ec56-446d-97ce-cc021794630e tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 0bb99276-64ba-4641-8869-3f35eea2f76e] Instance network_info: |[{"id": "7e4a1964-f2d0-4a4f-81fc-adf97c621209", "address": "fa:16:3e:3f:d7:0d", "network": {"id": "653f0c81-1afd-4ca6-9639-675ead1a6127", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-932652547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb9b9fc4f2e244879502006bb844761c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e4a1964-f2", "ovs_interfaceid": "7e4a1964-f2d0-4a4f-81fc-adf97c621209", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71509) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 10:57:53 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-8b70663a-ec56-446d-97ce-cc021794630e tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 0bb99276-64ba-4641-8869-3f35eea2f76e] Start _get_guest_xml network_info=[{"id": "7e4a1964-f2d0-4a4f-81fc-adf97c621209", "address": "fa:16:3e:3f:d7:0d", "network": {"id": "653f0c81-1afd-4ca6-9639-675ead1a6127", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-932652547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb9b9fc4f2e244879502006bb844761c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e4a1964-f2", "ovs_interfaceid": "7e4a1964-f2d0-4a4f-81fc-adf97c621209", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T10:38:55Z,direct_url=<?>,disk_format='qcow2',id=048ec0ee-0465-448d-8b4c-f072acb101dc,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='9742d6ad20cf48d9bab0fdbcc9491db9',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T10:38:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '048ec0ee-0465-448d-8b4c-f072acb101dc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71509) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 10:57:53 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-8b70663a-ec56-446d-97ce-cc021794630e tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:57:53 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-8b70663a-ec56-446d-97ce-cc021794630e tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:57:53 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-8b70663a-ec56-446d-97ce-cc021794630e tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71509) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 10:57:53 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-8b70663a-ec56-446d-97ce-cc021794630e tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T10:40:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T10:38:55Z,direct_url=<?>,disk_format='qcow2',id=048ec0ee-0465-448d-8b4c-f072acb101dc,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='9742d6ad20cf48d9bab0fdbcc9491db9',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T10:38:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 10:57:53 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-8b70663a-ec56-446d-97ce-cc021794630e tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Flavor limits 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 10:57:53 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-8b70663a-ec56-446d-97ce-cc021794630e tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Image limits 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 10:57:53 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-8b70663a-ec56-446d-97ce-cc021794630e tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Flavor pref 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 10:57:53 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-8b70663a-ec56-446d-97ce-cc021794630e tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Image pref 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 10:57:53 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-8b70663a-ec56-446d-97ce-cc021794630e tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 10:57:53 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-8b70663a-ec56-446d-97ce-cc021794630e tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 10:57:53 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-8b70663a-ec56-446d-97ce-cc021794630e tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71509) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 10:57:53 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-8b70663a-ec56-446d-97ce-cc021794630e tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Got 1 possible topologies {{(pid=71509) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 10:57:53 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-8b70663a-ec56-446d-97ce-cc021794630e tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 10:57:53 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-8b70663a-ec56-446d-97ce-cc021794630e tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 10:57:53 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-8b70663a-ec56-446d-97ce-cc021794630e tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T10:57:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1620846551',display_name='tempest-AttachVolumeTestJSON-server-1620846551',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1620846551',id=31,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDFX4psVsnJ7YiVMlmDva54tVnsB3EA7ThlyG0DNat7parQ+EKTGjR4spXyHIu1F0sE5iuPdm8WruPRGM1gtmd8ovAAupZwja/Lb7SJjV4yMTxDx05zIxkiT3ZZ1VUWZmA==',key_name='tempest-keypair-1954654699',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eb9b9fc4f2e244879502006bb844761c',ramdisk_id='',reservation_id='r-09nrco14',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-821788322',owner_user_name='tempest-AttachVolumeTestJSON-821788322-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T10:57:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11cb4a1e78d447dbb18cde5453fe499c',uuid=0bb99276-64ba-4641-8869-3f35eea2f76e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7e4a1964-f2d0-4a4f-81fc-adf97c621209", "address": "fa:16:3e:3f:d7:0d", "network": {"id": "653f0c81-1afd-4ca6-9639-675ead1a6127", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-932652547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb9b9fc4f2e244879502006bb844761c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e4a1964-f2", "ovs_interfaceid": "7e4a1964-f2d0-4a4f-81fc-adf97c621209", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71509) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 10:57:53 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-8b70663a-ec56-446d-97ce-cc021794630e tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Converting VIF {"id": "7e4a1964-f2d0-4a4f-81fc-adf97c621209", "address": "fa:16:3e:3f:d7:0d", "network": {"id": "653f0c81-1afd-4ca6-9639-675ead1a6127", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-932652547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb9b9fc4f2e244879502006bb844761c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e4a1964-f2", "ovs_interfaceid": "7e4a1964-f2d0-4a4f-81fc-adf97c621209", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:57:53 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-8b70663a-ec56-446d-97ce-cc021794630e tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:d7:0d,bridge_name='br-int',has_traffic_filtering=True,id=7e4a1964-f2d0-4a4f-81fc-adf97c621209,network=Network(653f0c81-1afd-4ca6-9639-675ead1a6127),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e4a1964-f2') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:57:53 user nova-compute[71509]: DEBUG nova.objects.instance [None req-8b70663a-ec56-446d-97ce-cc021794630e tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lazy-loading 'pci_devices' on Instance uuid 0bb99276-64ba-4641-8869-3f35eea2f76e {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:57:53 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-8b70663a-ec56-446d-97ce-cc021794630e tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 0bb99276-64ba-4641-8869-3f35eea2f76e] End _get_guest_xml xml=<domain type="kvm">
Apr 14 10:57:53 user nova-compute[71509]:   <uuid>0bb99276-64ba-4641-8869-3f35eea2f76e</uuid>
Apr 14 10:57:53 user nova-compute[71509]:   <name>instance-0000001f</name>
Apr 14 10:57:53 user nova-compute[71509]:   <memory>131072</memory>
Apr 14 10:57:53 user nova-compute[71509]:   <vcpu>1</vcpu>
Apr 14 10:57:53 user nova-compute[71509]:   <metadata>
Apr 14 10:57:53 user nova-compute[71509]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 10:57:53 user nova-compute[71509]:       <nova:package version="0.0.0"/>
Apr 14 10:57:53 user nova-compute[71509]:       <nova:name>tempest-AttachVolumeTestJSON-server-1620846551</nova:name>
Apr 14 10:57:53 user nova-compute[71509]:       <nova:creationTime>2023-04-14 10:57:53</nova:creationTime>
Apr 14 10:57:53 user nova-compute[71509]:       <nova:flavor name="m1.nano">
Apr 14 10:57:53 user nova-compute[71509]:         <nova:memory>128</nova:memory>
Apr 14 10:57:53 user nova-compute[71509]:         <nova:disk>1</nova:disk>
Apr 14 10:57:53 user nova-compute[71509]:         <nova:swap>0</nova:swap>
Apr 14 10:57:53 user nova-compute[71509]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 10:57:53 user nova-compute[71509]:         <nova:vcpus>1</nova:vcpus>
Apr 14 10:57:53 user nova-compute[71509]:       </nova:flavor>
Apr 14 10:57:53 user nova-compute[71509]:       <nova:owner>
Apr 14 10:57:53 user nova-compute[71509]:         <nova:user uuid="11cb4a1e78d447dbb18cde5453fe499c">tempest-AttachVolumeTestJSON-821788322-project-member</nova:user>
Apr 14 10:57:53 user nova-compute[71509]:         <nova:project uuid="eb9b9fc4f2e244879502006bb844761c">tempest-AttachVolumeTestJSON-821788322</nova:project>
Apr 14 10:57:53 user nova-compute[71509]:       </nova:owner>
Apr 14 10:57:53 user nova-compute[71509]:       <nova:root type="image" uuid="048ec0ee-0465-448d-8b4c-f072acb101dc"/>
Apr 14 10:57:53 user nova-compute[71509]:       <nova:ports>
Apr 14 10:57:53 user nova-compute[71509]:         <nova:port uuid="7e4a1964-f2d0-4a4f-81fc-adf97c621209">
Apr 14 10:57:53 user nova-compute[71509]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 14 10:57:53 user nova-compute[71509]:         </nova:port>
Apr 14 10:57:53 user nova-compute[71509]:       </nova:ports>
Apr 14 10:57:53 user nova-compute[71509]:     </nova:instance>
Apr 14 10:57:53 user nova-compute[71509]:   </metadata>
Apr 14 10:57:53 user nova-compute[71509]:   <sysinfo type="smbios">
Apr 14 10:57:53 user nova-compute[71509]:     <system>
Apr 14 10:57:53 user nova-compute[71509]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 10:57:53 user nova-compute[71509]:       <entry name="product">OpenStack Nova</entry>
Apr 14 10:57:53 user nova-compute[71509]:       <entry name="version">0.0.0</entry>
Apr 14 10:57:53 user nova-compute[71509]:       <entry name="serial">0bb99276-64ba-4641-8869-3f35eea2f76e</entry>
Apr 14 10:57:53 user nova-compute[71509]:       <entry name="uuid">0bb99276-64ba-4641-8869-3f35eea2f76e</entry>
Apr 14 10:57:53 user nova-compute[71509]:       <entry name="family">Virtual Machine</entry>
Apr 14 10:57:53 user nova-compute[71509]:     </system>
Apr 14 10:57:53 user nova-compute[71509]:   </sysinfo>
Apr 14 10:57:53 user nova-compute[71509]:   <os>
Apr 14 10:57:53 user nova-compute[71509]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 10:57:53 user nova-compute[71509]:     <boot dev="hd"/>
Apr 14 10:57:53 user nova-compute[71509]:     <smbios mode="sysinfo"/>
Apr 14 10:57:53 user nova-compute[71509]:   </os>
Apr 14 10:57:53 user nova-compute[71509]:   <features>
Apr 14 10:57:53 user nova-compute[71509]:     <acpi/>
Apr 14 10:57:53 user nova-compute[71509]:     <apic/>
Apr 14 10:57:53 user nova-compute[71509]:     <vmcoreinfo/>
Apr 14 10:57:53 user nova-compute[71509]:   </features>
Apr 14 10:57:53 user nova-compute[71509]:   <clock offset="utc">
Apr 14 10:57:53 user nova-compute[71509]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 10:57:53 user nova-compute[71509]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 10:57:53 user nova-compute[71509]:     <timer name="hpet" present="no"/>
Apr 14 10:57:53 user nova-compute[71509]:   </clock>
Apr 14 10:57:53 user nova-compute[71509]:   <cpu mode="custom" match="exact">
Apr 14 10:57:53 user nova-compute[71509]:     <model>Nehalem</model>
Apr 14 10:57:53 user nova-compute[71509]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 10:57:53 user nova-compute[71509]:   </cpu>
Apr 14 10:57:53 user nova-compute[71509]:   <devices>
Apr 14 10:57:53 user nova-compute[71509]:     <disk type="file" device="disk">
Apr 14 10:57:53 user nova-compute[71509]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 10:57:53 user nova-compute[71509]:       <source file="/opt/stack/data/nova/instances/0bb99276-64ba-4641-8869-3f35eea2f76e/disk"/>
Apr 14 10:57:53 user nova-compute[71509]:       <target dev="vda" bus="virtio"/>
Apr 14 10:57:53 user nova-compute[71509]:     </disk>
Apr 14 10:57:53 user nova-compute[71509]:     <interface type="ethernet">
Apr 14 10:57:53 user nova-compute[71509]:       <mac address="fa:16:3e:3f:d7:0d"/>
Apr 14 10:57:53 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 10:57:53 user nova-compute[71509]:       <mtu size="1442"/>
Apr 14 10:57:53 user nova-compute[71509]:       <target dev="tap7e4a1964-f2"/>
Apr 14 10:57:53 user nova-compute[71509]:     </interface>
Apr 14 10:57:53 user nova-compute[71509]:     <serial type="pty">
Apr 14 10:57:53 user nova-compute[71509]:       <log file="/opt/stack/data/nova/instances/0bb99276-64ba-4641-8869-3f35eea2f76e/console.log" append="off"/>
Apr 14 10:57:53 user nova-compute[71509]:     </serial>
Apr 14 10:57:53 user nova-compute[71509]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 10:57:53 user nova-compute[71509]:     <video>
Apr 14 10:57:53 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 10:57:53 user nova-compute[71509]:     </video>
Apr 14 10:57:53 user nova-compute[71509]:     <rng model="virtio">
Apr 14 10:57:53 user nova-compute[71509]:       <backend model="random">/dev/urandom</backend>
Apr 14 10:57:53 user nova-compute[71509]:     </rng>
Apr 14 10:57:53 user nova-compute[71509]:     <controller type="usb" index="0" model="none"/>
Apr 14 10:57:53 user nova-compute[71509]:     <memballoon model="virtio">
Apr 14 10:57:53 user nova-compute[71509]:       <stats period="10"/>
Apr 14 10:57:53 user nova-compute[71509]:     </memballoon>
Apr 14 10:57:53 user nova-compute[71509]:   </devices>
Apr 14 10:57:53 user nova-compute[71509]: </domain>
Apr 14 10:57:53 user nova-compute[71509]:  {{(pid=71509) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 10:57:53 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-8b70663a-ec56-446d-97ce-cc021794630e tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T10:57:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1620846551',display_name='tempest-AttachVolumeTestJSON-server-1620846551',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1620846551',id=31,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDFX4psVsnJ7YiVMlmDva54tVnsB3EA7ThlyG0DNat7parQ+EKTGjR4spXyHIu1F0sE5iuPdm8WruPRGM1gtmd8ovAAupZwja/Lb7SJjV4yMTxDx05zIxkiT3ZZ1VUWZmA==',key_name='tempest-keypair-1954654699',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eb9b9fc4f2e244879502006bb844761c',ramdisk_id='',reservation_id='r-09nrco14',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-821788322',owner_user_name='tempest-AttachVolumeTestJSON-821788322-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T10:57:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11cb4a1e78d447dbb18cde5453fe499c',uuid=0bb99276-64ba-4641-8869-3f35eea2f76e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7e4a1964-f2d0-4a4f-81fc-adf97c621209", "address": "fa:16:3e:3f:d7:0d", "network": {"id": "653f0c81-1afd-4ca6-9639-675ead1a6127", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-932652547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb9b9fc4f2e244879502006bb844761c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e4a1964-f2", "ovs_interfaceid": "7e4a1964-f2d0-4a4f-81fc-adf97c621209", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 10:57:53 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-8b70663a-ec56-446d-97ce-cc021794630e tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Converting VIF {"id": "7e4a1964-f2d0-4a4f-81fc-adf97c621209", "address": "fa:16:3e:3f:d7:0d", "network": {"id": "653f0c81-1afd-4ca6-9639-675ead1a6127", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-932652547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb9b9fc4f2e244879502006bb844761c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e4a1964-f2", "ovs_interfaceid": "7e4a1964-f2d0-4a4f-81fc-adf97c621209", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:57:53 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-8b70663a-ec56-446d-97ce-cc021794630e tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:d7:0d,bridge_name='br-int',has_traffic_filtering=True,id=7e4a1964-f2d0-4a4f-81fc-adf97c621209,network=Network(653f0c81-1afd-4ca6-9639-675ead1a6127),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e4a1964-f2') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:57:53 user nova-compute[71509]: DEBUG os_vif [None req-8b70663a-ec56-446d-97ce-cc021794630e tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:d7:0d,bridge_name='br-int',has_traffic_filtering=True,id=7e4a1964-f2d0-4a4f-81fc-adf97c621209,network=Network(653f0c81-1afd-4ca6-9639-675ead1a6127),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e4a1964-f2') {{(pid=71509) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 10:57:53 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:57:53 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:57:53 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 10:57:53 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:57:53 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7e4a1964-f2, may_exist=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:57:53 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7e4a1964-f2, col_values=(('external_ids', {'iface-id': '7e4a1964-f2d0-4a4f-81fc-adf97c621209', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3f:d7:0d', 'vm-uuid': '0bb99276-64ba-4641-8869-3f35eea2f76e'}),)) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:57:53 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:57:53 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 10:57:53 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:57:53 user nova-compute[71509]: INFO os_vif [None req-8b70663a-ec56-446d-97ce-cc021794630e tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:d7:0d,bridge_name='br-int',has_traffic_filtering=True,id=7e4a1964-f2d0-4a4f-81fc-adf97c621209,network=Network(653f0c81-1afd-4ca6-9639-675ead1a6127),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e4a1964-f2')
Apr 14 10:57:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a936fb20-3f17-4114-829a-8659da6bc5f3/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:57:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a936fb20-3f17-4114-829a-8659da6bc5f3/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:57:53 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-8b70663a-ec56-446d-97ce-cc021794630e tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] No BDM found with device name vda, not building metadata. {{(pid=71509) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 10:57:53 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-8b70663a-ec56-446d-97ce-cc021794630e tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] No VIF found with MAC fa:16:3e:3f:d7:0d, not building metadata {{(pid=71509) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 10:57:54 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a936fb20-3f17-4114-829a-8659da6bc5f3/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:57:54 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dd9e11f-1fed-42af-ad5c-9cdd051b93e7/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:57:54 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dd9e11f-1fed-42af-ad5c-9cdd051b93e7/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:57:54 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dd9e11f-1fed-42af-ad5c-9cdd051b93e7/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:57:54 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dd9e11f-1fed-42af-ad5c-9cdd051b93e7/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:57:57 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681469877.5991366, 0bb99276-64ba-4641-8869-3f35eea2f76e => Resumed> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 10:57:57 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 0bb99276-64ba-4641-8869-3f35eea2f76e] VM Resumed (Lifecycle Event)
Apr 14 10:57:57 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:57:57 user nova-compute[71509]: DEBUG nova.compute.manager [req-87992b7c-d172-4227-8dd1-4d7255e09091 req-b9636479-0b91-4578-b196-52a9c2275133 service nova] [instance: 0bb99276-64ba-4641-8869-3f35eea2f76e] Received event network-vif-plugged-7e4a1964-f2d0-4a4f-81fc-adf97c621209 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:57:57 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-87992b7c-d172-4227-8dd1-4d7255e09091 req-b9636479-0b91-4578-b196-52a9c2275133 service nova] Acquiring lock "0bb99276-64ba-4641-8869-3f35eea2f76e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:57:57 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-87992b7c-d172-4227-8dd1-4d7255e09091 req-b9636479-0b91-4578-b196-52a9c2275133 service nova] Lock "0bb99276-64ba-4641-8869-3f35eea2f76e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:57:57 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-87992b7c-d172-4227-8dd1-4d7255e09091 req-b9636479-0b91-4578-b196-52a9c2275133 service nova] Lock "0bb99276-64ba-4641-8869-3f35eea2f76e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:57:57 user nova-compute[71509]: DEBUG nova.compute.manager [req-87992b7c-d172-4227-8dd1-4d7255e09091 req-b9636479-0b91-4578-b196-52a9c2275133 service nova] [instance: 0bb99276-64ba-4641-8869-3f35eea2f76e] No waiting events found dispatching network-vif-plugged-7e4a1964-f2d0-4a4f-81fc-adf97c621209 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:57:57 user nova-compute[71509]: WARNING nova.compute.manager [req-87992b7c-d172-4227-8dd1-4d7255e09091 req-b9636479-0b91-4578-b196-52a9c2275133 service nova] [instance: 0bb99276-64ba-4641-8869-3f35eea2f76e] Received unexpected event network-vif-plugged-7e4a1964-f2d0-4a4f-81fc-adf97c621209 for instance with vm_state building and task_state spawning.
Apr 14 10:57:57 user nova-compute[71509]: DEBUG nova.compute.manager [req-1d68c8bb-b19a-4f4f-9a97-c74440a02d77 req-71ad06ea-7357-4f51-ad88-68028f2e3c61 service nova] [instance: 0bb99276-64ba-4641-8869-3f35eea2f76e] Received event network-vif-plugged-7e4a1964-f2d0-4a4f-81fc-adf97c621209 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:57:57 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-1d68c8bb-b19a-4f4f-9a97-c74440a02d77 req-71ad06ea-7357-4f51-ad88-68028f2e3c61 service nova] Acquiring lock "0bb99276-64ba-4641-8869-3f35eea2f76e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:57:57 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-1d68c8bb-b19a-4f4f-9a97-c74440a02d77 req-71ad06ea-7357-4f51-ad88-68028f2e3c61 service nova] Lock "0bb99276-64ba-4641-8869-3f35eea2f76e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:57:57 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-1d68c8bb-b19a-4f4f-9a97-c74440a02d77 req-71ad06ea-7357-4f51-ad88-68028f2e3c61 service nova] Lock "0bb99276-64ba-4641-8869-3f35eea2f76e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:57:57 user nova-compute[71509]: DEBUG nova.compute.manager [req-1d68c8bb-b19a-4f4f-9a97-c74440a02d77 req-71ad06ea-7357-4f51-ad88-68028f2e3c61 service nova] [instance: 0bb99276-64ba-4641-8869-3f35eea2f76e] No waiting events found dispatching network-vif-plugged-7e4a1964-f2d0-4a4f-81fc-adf97c621209 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:57:57 user nova-compute[71509]: WARNING nova.compute.manager [req-1d68c8bb-b19a-4f4f-9a97-c74440a02d77 req-71ad06ea-7357-4f51-ad88-68028f2e3c61 service nova] [instance: 0bb99276-64ba-4641-8869-3f35eea2f76e] Received unexpected event network-vif-plugged-7e4a1964-f2d0-4a4f-81fc-adf97c621209 for instance with vm_state building and task_state spawning.
Apr 14 10:57:57 user nova-compute[71509]: DEBUG nova.compute.manager [None req-8b70663a-ec56-446d-97ce-cc021794630e tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 0bb99276-64ba-4641-8869-3f35eea2f76e] Instance event wait completed in 0 seconds for  {{(pid=71509) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 10:57:57 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-8b70663a-ec56-446d-97ce-cc021794630e tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 0bb99276-64ba-4641-8869-3f35eea2f76e] Guest created on hypervisor {{(pid=71509) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 10:57:57 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 0bb99276-64ba-4641-8869-3f35eea2f76e] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:57:57 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-dd9d7d40-3087-4102-9895-2e169e668fe3 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "ef413492-c781-459e-b99c-46a530034c94" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:57:57 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-dd9d7d40-3087-4102-9895-2e169e668fe3 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "ef413492-c781-459e-b99c-46a530034c94" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:57:58 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 0bb99276-64ba-4641-8869-3f35eea2f76e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 10:57:58 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: 0bb99276-64ba-4641-8869-3f35eea2f76e] Instance spawned successfully.
Apr 14 10:57:58 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:57:58 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:57:58 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Hypervisor/Node resource view: name=user free_ram=7610MB free_disk=25.902729034423828GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71509) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 10:57:58 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:57:58 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:57:58 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-8b70663a-ec56-446d-97ce-cc021794630e tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 0bb99276-64ba-4641-8869-3f35eea2f76e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 10:57:58 user nova-compute[71509]: DEBUG nova.compute.manager [None req-dd9d7d40-3087-4102-9895-2e169e668fe3 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: ef413492-c781-459e-b99c-46a530034c94] Starting instance... {{(pid=71509) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 10:57:58 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 0bb99276-64ba-4641-8869-3f35eea2f76e] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 10:57:58 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681469877.5998313, 0bb99276-64ba-4641-8869-3f35eea2f76e => Started> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 10:57:58 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 0bb99276-64ba-4641-8869-3f35eea2f76e] VM Started (Lifecycle Event)
Apr 14 10:57:58 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-8b70663a-ec56-446d-97ce-cc021794630e tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 0bb99276-64ba-4641-8869-3f35eea2f76e] Found default for hw_cdrom_bus of ide {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:57:58 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-8b70663a-ec56-446d-97ce-cc021794630e tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 0bb99276-64ba-4641-8869-3f35eea2f76e] Found default for hw_disk_bus of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:57:58 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-8b70663a-ec56-446d-97ce-cc021794630e tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 0bb99276-64ba-4641-8869-3f35eea2f76e] Found default for hw_input_bus of None {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:57:58 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-8b70663a-ec56-446d-97ce-cc021794630e tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 0bb99276-64ba-4641-8869-3f35eea2f76e] Found default for hw_pointer_model of None {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:57:58 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-8b70663a-ec56-446d-97ce-cc021794630e tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 0bb99276-64ba-4641-8869-3f35eea2f76e] Found default for hw_video_model of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:57:58 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-8b70663a-ec56-446d-97ce-cc021794630e tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 0bb99276-64ba-4641-8869-3f35eea2f76e] Found default for hw_vif_model of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:57:58 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 0bb99276-64ba-4641-8869-3f35eea2f76e] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:57:58 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 0bb99276-64ba-4641-8869-3f35eea2f76e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 10:57:58 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 0bb99276-64ba-4641-8869-3f35eea2f76e] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 10:57:58 user nova-compute[71509]: INFO nova.compute.manager [None req-8b70663a-ec56-446d-97ce-cc021794630e tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 0bb99276-64ba-4641-8869-3f35eea2f76e] Took 7.57 seconds to spawn the instance on the hypervisor.
Apr 14 10:57:58 user nova-compute[71509]: DEBUG nova.compute.manager [None req-8b70663a-ec56-446d-97ce-cc021794630e tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 0bb99276-64ba-4641-8869-3f35eea2f76e] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:57:58 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-dd9d7d40-3087-4102-9895-2e169e668fe3 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:57:58 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 97f20661-8b60-439e-b7af-2fc2013c5ade actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:57:58 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 97820f17-22d1-4ec3-9721-1edadccc794a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:57:58 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance e479154a-acd6-47aa-9a5b-43c6e0feda07 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:57:58 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 6cae9f61-763f-4671-a873-d15f01384416 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:57:58 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 6f41f217-0df2-4205-9633-7dbe83f40c96 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:57:58 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance e6580716-8a6a-4dfa-8978-ed54b92af1fe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:57:58 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance a936fb20-3f17-4114-829a-8659da6bc5f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:57:58 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance ade9eacb-d4f9-406d-85c4-043037a4b6ba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:57:58 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance fe152ebd-4f99-4fa8-bfdb-8744cdf3f387 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:57:58 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 0dd9e11f-1fed-42af-ad5c-9cdd051b93e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:57:58 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 0bb99276-64ba-4641-8869-3f35eea2f76e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:57:58 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance ef413492-c781-459e-b99c-46a530034c94 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1689}}
Apr 14 10:57:58 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=71509) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 10:57:58 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Final resource view: name=user phys_ram=16023MB used_ram=1920MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=71509) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 10:57:58 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:57:58 user nova-compute[71509]: INFO nova.compute.manager [None req-8b70663a-ec56-446d-97ce-cc021794630e tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 0bb99276-64ba-4641-8869-3f35eea2f76e] Took 8.41 seconds to build instance.
Apr 14 10:57:58 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-8b70663a-ec56-446d-97ce-cc021794630e tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "0bb99276-64ba-4641-8869-3f35eea2f76e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.496s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:57:58 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 10:57:58 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 10:57:58 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Compute_service record updated for user:user {{(pid=71509) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 10:57:58 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.539s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:57:58 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-dd9d7d40-3087-4102-9895-2e169e668fe3 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.394s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:57:58 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-dd9d7d40-3087-4102-9895-2e169e668fe3 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71509) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 10:57:58 user nova-compute[71509]: INFO nova.compute.claims [None req-dd9d7d40-3087-4102-9895-2e169e668fe3 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: ef413492-c781-459e-b99c-46a530034c94] Claim successful on node user
Apr 14 10:57:58 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:57:58 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-dd9d7d40-3087-4102-9895-2e169e668fe3 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 10:57:58 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-dd9d7d40-3087-4102-9895-2e169e668fe3 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 10:57:58 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-dd9d7d40-3087-4102-9895-2e169e668fe3 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.433s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:57:58 user nova-compute[71509]: DEBUG nova.compute.manager [None req-dd9d7d40-3087-4102-9895-2e169e668fe3 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: ef413492-c781-459e-b99c-46a530034c94] Start building networks asynchronously for instance. {{(pid=71509) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 10:57:59 user nova-compute[71509]: DEBUG nova.compute.manager [None req-dd9d7d40-3087-4102-9895-2e169e668fe3 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: ef413492-c781-459e-b99c-46a530034c94] Allocating IP information in the background. {{(pid=71509) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 10:57:59 user nova-compute[71509]: DEBUG nova.network.neutron [None req-dd9d7d40-3087-4102-9895-2e169e668fe3 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: ef413492-c781-459e-b99c-46a530034c94] allocate_for_instance() {{(pid=71509) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 10:57:59 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-dd9d7d40-3087-4102-9895-2e169e668fe3 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: ef413492-c781-459e-b99c-46a530034c94] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 10:57:59 user nova-compute[71509]: DEBUG nova.compute.manager [None req-dd9d7d40-3087-4102-9895-2e169e668fe3 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: ef413492-c781-459e-b99c-46a530034c94] Start building block device mappings for instance. {{(pid=71509) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 10:57:59 user nova-compute[71509]: DEBUG nova.compute.manager [None req-dd9d7d40-3087-4102-9895-2e169e668fe3 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: ef413492-c781-459e-b99c-46a530034c94] Start spawning the instance on the hypervisor. {{(pid=71509) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 10:57:59 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-dd9d7d40-3087-4102-9895-2e169e668fe3 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: ef413492-c781-459e-b99c-46a530034c94] Creating instance directory {{(pid=71509) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 10:57:59 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-dd9d7d40-3087-4102-9895-2e169e668fe3 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: ef413492-c781-459e-b99c-46a530034c94] Creating image(s)
Apr 14 10:57:59 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-dd9d7d40-3087-4102-9895-2e169e668fe3 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "/opt/stack/data/nova/instances/ef413492-c781-459e-b99c-46a530034c94/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:57:59 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-dd9d7d40-3087-4102-9895-2e169e668fe3 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "/opt/stack/data/nova/instances/ef413492-c781-459e-b99c-46a530034c94/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:57:59 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-dd9d7d40-3087-4102-9895-2e169e668fe3 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "/opt/stack/data/nova/instances/ef413492-c781-459e-b99c-46a530034c94/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:57:59 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-dd9d7d40-3087-4102-9895-2e169e668fe3 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:57:59 user nova-compute[71509]: DEBUG nova.policy [None req-dd9d7d40-3087-4102-9895-2e169e668fe3 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '78adbbdcd10e446daddde754e46309b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8f294f957f4c74ae959c1e9f238427', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71509) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 10:57:59 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-dd9d7d40-3087-4102-9895-2e169e668fe3 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json" returned: 0 in 0.149s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:57:59 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-dd9d7d40-3087-4102-9895-2e169e668fe3 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:57:59 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-dd9d7d40-3087-4102-9895-2e169e668fe3 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:57:59 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-dd9d7d40-3087-4102-9895-2e169e668fe3 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:57:59 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-dd9d7d40-3087-4102-9895-2e169e668fe3 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json" returned: 0 in 0.147s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:57:59 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-dd9d7d40-3087-4102-9895-2e169e668fe3 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18,backing_fmt=raw /opt/stack/data/nova/instances/ef413492-c781-459e-b99c-46a530034c94/disk 1073741824 {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:57:59 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-dd9d7d40-3087-4102-9895-2e169e668fe3 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18,backing_fmt=raw /opt/stack/data/nova/instances/ef413492-c781-459e-b99c-46a530034c94/disk 1073741824" returned: 0 in 0.053s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:57:59 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-dd9d7d40-3087-4102-9895-2e169e668fe3 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.207s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:57:59 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-dd9d7d40-3087-4102-9895-2e169e668fe3 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:57:59 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-dd9d7d40-3087-4102-9895-2e169e668fe3 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json" returned: 0 in 0.180s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:57:59 user nova-compute[71509]: DEBUG nova.virt.disk.api [None req-dd9d7d40-3087-4102-9895-2e169e668fe3 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ef413492-c781-459e-b99c-46a530034c94/disk. size=1073741824 {{(pid=71509) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 10:57:59 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-dd9d7d40-3087-4102-9895-2e169e668fe3 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef413492-c781-459e-b99c-46a530034c94/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:57:59 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-dd9d7d40-3087-4102-9895-2e169e668fe3 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef413492-c781-459e-b99c-46a530034c94/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:57:59 user nova-compute[71509]: DEBUG nova.virt.disk.api [None req-dd9d7d40-3087-4102-9895-2e169e668fe3 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Cannot resize image /opt/stack/data/nova/instances/ef413492-c781-459e-b99c-46a530034c94/disk to a smaller size. {{(pid=71509) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 10:57:59 user nova-compute[71509]: DEBUG nova.objects.instance [None req-dd9d7d40-3087-4102-9895-2e169e668fe3 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lazy-loading 'migration_context' on Instance uuid ef413492-c781-459e-b99c-46a530034c94 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:57:59 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-dd9d7d40-3087-4102-9895-2e169e668fe3 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: ef413492-c781-459e-b99c-46a530034c94] Created local disks {{(pid=71509) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 10:57:59 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-dd9d7d40-3087-4102-9895-2e169e668fe3 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: ef413492-c781-459e-b99c-46a530034c94] Ensure instance console log exists: /opt/stack/data/nova/instances/ef413492-c781-459e-b99c-46a530034c94/console.log {{(pid=71509) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 10:57:59 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-dd9d7d40-3087-4102-9895-2e169e668fe3 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:57:59 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-dd9d7d40-3087-4102-9895-2e169e668fe3 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:57:59 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-dd9d7d40-3087-4102-9895-2e169e668fe3 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:57:59 user nova-compute[71509]: DEBUG nova.network.neutron [None req-dd9d7d40-3087-4102-9895-2e169e668fe3 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: ef413492-c781-459e-b99c-46a530034c94] Successfully created port: 9e57c0d8-8572-4355-b3c0-d2b74196fc0d {{(pid=71509) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 10:58:00 user nova-compute[71509]: DEBUG nova.network.neutron [None req-dd9d7d40-3087-4102-9895-2e169e668fe3 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: ef413492-c781-459e-b99c-46a530034c94] Successfully updated port: 9e57c0d8-8572-4355-b3c0-d2b74196fc0d {{(pid=71509) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 10:58:00 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-dd9d7d40-3087-4102-9895-2e169e668fe3 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "refresh_cache-ef413492-c781-459e-b99c-46a530034c94" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:58:00 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-dd9d7d40-3087-4102-9895-2e169e668fe3 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquired lock "refresh_cache-ef413492-c781-459e-b99c-46a530034c94" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:58:00 user nova-compute[71509]: DEBUG nova.network.neutron [None req-dd9d7d40-3087-4102-9895-2e169e668fe3 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: ef413492-c781-459e-b99c-46a530034c94] Building network info cache for instance {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 10:58:00 user nova-compute[71509]: DEBUG nova.compute.manager [req-bef7a554-0e28-4de1-901e-c940379f2ba7 req-19ed5ddf-8b58-411b-9619-e4944c86c6af service nova] [instance: ef413492-c781-459e-b99c-46a530034c94] Received event network-changed-9e57c0d8-8572-4355-b3c0-d2b74196fc0d {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:58:00 user nova-compute[71509]: DEBUG nova.compute.manager [req-bef7a554-0e28-4de1-901e-c940379f2ba7 req-19ed5ddf-8b58-411b-9619-e4944c86c6af service nova] [instance: ef413492-c781-459e-b99c-46a530034c94] Refreshing instance network info cache due to event network-changed-9e57c0d8-8572-4355-b3c0-d2b74196fc0d. {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 10:58:00 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-bef7a554-0e28-4de1-901e-c940379f2ba7 req-19ed5ddf-8b58-411b-9619-e4944c86c6af service nova] Acquiring lock "refresh_cache-ef413492-c781-459e-b99c-46a530034c94" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:58:00 user nova-compute[71509]: DEBUG nova.network.neutron [None req-dd9d7d40-3087-4102-9895-2e169e668fe3 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: ef413492-c781-459e-b99c-46a530034c94] Instance cache missing network info. {{(pid=71509) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 10:58:01 user nova-compute[71509]: DEBUG nova.network.neutron [None req-dd9d7d40-3087-4102-9895-2e169e668fe3 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: ef413492-c781-459e-b99c-46a530034c94] Updating instance_info_cache with network_info: [{"id": "9e57c0d8-8572-4355-b3c0-d2b74196fc0d", "address": "fa:16:3e:6e:1f:b0", "network": {"id": "b639a68a-2b4e-435c-b98b-65b5b4981c73", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1070821894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb8f294f957f4c74ae959c1e9f238427", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e57c0d8-85", "ovs_interfaceid": "9e57c0d8-8572-4355-b3c0-d2b74196fc0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:58:01 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-dd9d7d40-3087-4102-9895-2e169e668fe3 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Releasing lock "refresh_cache-ef413492-c781-459e-b99c-46a530034c94" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:58:01 user nova-compute[71509]: DEBUG nova.compute.manager [None req-dd9d7d40-3087-4102-9895-2e169e668fe3 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: ef413492-c781-459e-b99c-46a530034c94] Instance network_info: |[{"id": "9e57c0d8-8572-4355-b3c0-d2b74196fc0d", "address": "fa:16:3e:6e:1f:b0", "network": {"id": "b639a68a-2b4e-435c-b98b-65b5b4981c73", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1070821894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb8f294f957f4c74ae959c1e9f238427", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e57c0d8-85", "ovs_interfaceid": "9e57c0d8-8572-4355-b3c0-d2b74196fc0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71509) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 10:58:01 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-bef7a554-0e28-4de1-901e-c940379f2ba7 req-19ed5ddf-8b58-411b-9619-e4944c86c6af service nova] Acquired lock "refresh_cache-ef413492-c781-459e-b99c-46a530034c94" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:58:01 user nova-compute[71509]: DEBUG nova.network.neutron [req-bef7a554-0e28-4de1-901e-c940379f2ba7 req-19ed5ddf-8b58-411b-9619-e4944c86c6af service nova] [instance: ef413492-c781-459e-b99c-46a530034c94] Refreshing network info cache for port 9e57c0d8-8572-4355-b3c0-d2b74196fc0d {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 10:58:01 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-dd9d7d40-3087-4102-9895-2e169e668fe3 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: ef413492-c781-459e-b99c-46a530034c94] Start _get_guest_xml network_info=[{"id": "9e57c0d8-8572-4355-b3c0-d2b74196fc0d", "address": "fa:16:3e:6e:1f:b0", "network": {"id": "b639a68a-2b4e-435c-b98b-65b5b4981c73", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1070821894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb8f294f957f4c74ae959c1e9f238427", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e57c0d8-85", "ovs_interfaceid": "9e57c0d8-8572-4355-b3c0-d2b74196fc0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T10:38:55Z,direct_url=<?>,disk_format='qcow2',id=048ec0ee-0465-448d-8b4c-f072acb101dc,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='9742d6ad20cf48d9bab0fdbcc9491db9',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T10:38:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '048ec0ee-0465-448d-8b4c-f072acb101dc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71509) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 10:58:01 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-dd9d7d40-3087-4102-9895-2e169e668fe3 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:58:01 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-dd9d7d40-3087-4102-9895-2e169e668fe3 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:58:01 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-dd9d7d40-3087-4102-9895-2e169e668fe3 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71509) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 10:58:01 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-dd9d7d40-3087-4102-9895-2e169e668fe3 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T10:40:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T10:38:55Z,direct_url=<?>,disk_format='qcow2',id=048ec0ee-0465-448d-8b4c-f072acb101dc,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='9742d6ad20cf48d9bab0fdbcc9491db9',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T10:38:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 10:58:01 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-dd9d7d40-3087-4102-9895-2e169e668fe3 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Flavor limits 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 10:58:01 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-dd9d7d40-3087-4102-9895-2e169e668fe3 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Image limits 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 10:58:01 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-dd9d7d40-3087-4102-9895-2e169e668fe3 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Flavor pref 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 10:58:01 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-dd9d7d40-3087-4102-9895-2e169e668fe3 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Image pref 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 10:58:01 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-dd9d7d40-3087-4102-9895-2e169e668fe3 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 10:58:01 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-dd9d7d40-3087-4102-9895-2e169e668fe3 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 10:58:01 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-dd9d7d40-3087-4102-9895-2e169e668fe3 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71509) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 10:58:01 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-dd9d7d40-3087-4102-9895-2e169e668fe3 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Got 1 possible topologies {{(pid=71509) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 10:58:01 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-dd9d7d40-3087-4102-9895-2e169e668fe3 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 10:58:01 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-dd9d7d40-3087-4102-9895-2e169e668fe3 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 10:58:01 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-dd9d7d40-3087-4102-9895-2e169e668fe3 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T10:57:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2120803394',display_name='tempest-AttachVolumeNegativeTest-server-2120803394',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2120803394',id=32,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNw2SbFQpaxlXMigCU4SqREng1yFr8b6iVL8PJBLSwkK3b0e1hzyI9V2EhI2s6XMdqIXAYQuGjq1aeQdXx9cKlSvkg7nGGryoncSoq6eFhl2+423Xeuz3aQWMczJJSdSEQ==',key_name='tempest-keypair-880478313',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cb8f294f957f4c74ae959c1e9f238427',ramdisk_id='',reservation_id='r-yeps261o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-531644967',owner_user_name='tempest-AttachVolumeNegativeTest-531644967-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T10:57:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='78adbbdcd10e446daddde754e46309b2',uuid=ef413492-c781-459e-b99c-46a530034c94,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9e57c0d8-8572-4355-b3c0-d2b74196fc0d", "address": "fa:16:3e:6e:1f:b0", "network": {"id": "b639a68a-2b4e-435c-b98b-65b5b4981c73", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1070821894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb8f294f957f4c74ae959c1e9f238427", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e57c0d8-85", "ovs_interfaceid": "9e57c0d8-8572-4355-b3c0-d2b74196fc0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71509) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 10:58:01 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-dd9d7d40-3087-4102-9895-2e169e668fe3 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Converting VIF {"id": "9e57c0d8-8572-4355-b3c0-d2b74196fc0d", "address": "fa:16:3e:6e:1f:b0", "network": {"id": "b639a68a-2b4e-435c-b98b-65b5b4981c73", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1070821894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb8f294f957f4c74ae959c1e9f238427", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e57c0d8-85", "ovs_interfaceid": "9e57c0d8-8572-4355-b3c0-d2b74196fc0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:58:01 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-dd9d7d40-3087-4102-9895-2e169e668fe3 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:1f:b0,bridge_name='br-int',has_traffic_filtering=True,id=9e57c0d8-8572-4355-b3c0-d2b74196fc0d,network=Network(b639a68a-2b4e-435c-b98b-65b5b4981c73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e57c0d8-85') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:58:01 user nova-compute[71509]: DEBUG nova.objects.instance [None req-dd9d7d40-3087-4102-9895-2e169e668fe3 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lazy-loading 'pci_devices' on Instance uuid ef413492-c781-459e-b99c-46a530034c94 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:58:01 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-dd9d7d40-3087-4102-9895-2e169e668fe3 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: ef413492-c781-459e-b99c-46a530034c94] End _get_guest_xml xml=<domain type="kvm">
Apr 14 10:58:01 user nova-compute[71509]:   <uuid>ef413492-c781-459e-b99c-46a530034c94</uuid>
Apr 14 10:58:01 user nova-compute[71509]:   <name>instance-00000020</name>
Apr 14 10:58:01 user nova-compute[71509]:   <memory>131072</memory>
Apr 14 10:58:01 user nova-compute[71509]:   <vcpu>1</vcpu>
Apr 14 10:58:01 user nova-compute[71509]:   <metadata>
Apr 14 10:58:01 user nova-compute[71509]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 10:58:01 user nova-compute[71509]:       <nova:package version="0.0.0"/>
Apr 14 10:58:01 user nova-compute[71509]:       <nova:name>tempest-AttachVolumeNegativeTest-server-2120803394</nova:name>
Apr 14 10:58:01 user nova-compute[71509]:       <nova:creationTime>2023-04-14 10:58:01</nova:creationTime>
Apr 14 10:58:01 user nova-compute[71509]:       <nova:flavor name="m1.nano">
Apr 14 10:58:01 user nova-compute[71509]:         <nova:memory>128</nova:memory>
Apr 14 10:58:01 user nova-compute[71509]:         <nova:disk>1</nova:disk>
Apr 14 10:58:01 user nova-compute[71509]:         <nova:swap>0</nova:swap>
Apr 14 10:58:01 user nova-compute[71509]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 10:58:01 user nova-compute[71509]:         <nova:vcpus>1</nova:vcpus>
Apr 14 10:58:01 user nova-compute[71509]:       </nova:flavor>
Apr 14 10:58:01 user nova-compute[71509]:       <nova:owner>
Apr 14 10:58:01 user nova-compute[71509]:         <nova:user uuid="78adbbdcd10e446daddde754e46309b2">tempest-AttachVolumeNegativeTest-531644967-project-member</nova:user>
Apr 14 10:58:01 user nova-compute[71509]:         <nova:project uuid="cb8f294f957f4c74ae959c1e9f238427">tempest-AttachVolumeNegativeTest-531644967</nova:project>
Apr 14 10:58:01 user nova-compute[71509]:       </nova:owner>
Apr 14 10:58:01 user nova-compute[71509]:       <nova:root type="image" uuid="048ec0ee-0465-448d-8b4c-f072acb101dc"/>
Apr 14 10:58:01 user nova-compute[71509]:       <nova:ports>
Apr 14 10:58:01 user nova-compute[71509]:         <nova:port uuid="9e57c0d8-8572-4355-b3c0-d2b74196fc0d">
Apr 14 10:58:01 user nova-compute[71509]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 14 10:58:01 user nova-compute[71509]:         </nova:port>
Apr 14 10:58:01 user nova-compute[71509]:       </nova:ports>
Apr 14 10:58:01 user nova-compute[71509]:     </nova:instance>
Apr 14 10:58:01 user nova-compute[71509]:   </metadata>
Apr 14 10:58:01 user nova-compute[71509]:   <sysinfo type="smbios">
Apr 14 10:58:01 user nova-compute[71509]:     <system>
Apr 14 10:58:01 user nova-compute[71509]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 10:58:01 user nova-compute[71509]:       <entry name="product">OpenStack Nova</entry>
Apr 14 10:58:01 user nova-compute[71509]:       <entry name="version">0.0.0</entry>
Apr 14 10:58:01 user nova-compute[71509]:       <entry name="serial">ef413492-c781-459e-b99c-46a530034c94</entry>
Apr 14 10:58:01 user nova-compute[71509]:       <entry name="uuid">ef413492-c781-459e-b99c-46a530034c94</entry>
Apr 14 10:58:01 user nova-compute[71509]:       <entry name="family">Virtual Machine</entry>
Apr 14 10:58:01 user nova-compute[71509]:     </system>
Apr 14 10:58:01 user nova-compute[71509]:   </sysinfo>
Apr 14 10:58:01 user nova-compute[71509]:   <os>
Apr 14 10:58:01 user nova-compute[71509]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 10:58:01 user nova-compute[71509]:     <boot dev="hd"/>
Apr 14 10:58:01 user nova-compute[71509]:     <smbios mode="sysinfo"/>
Apr 14 10:58:01 user nova-compute[71509]:   </os>
Apr 14 10:58:01 user nova-compute[71509]:   <features>
Apr 14 10:58:01 user nova-compute[71509]:     <acpi/>
Apr 14 10:58:01 user nova-compute[71509]:     <apic/>
Apr 14 10:58:01 user nova-compute[71509]:     <vmcoreinfo/>
Apr 14 10:58:01 user nova-compute[71509]:   </features>
Apr 14 10:58:01 user nova-compute[71509]:   <clock offset="utc">
Apr 14 10:58:01 user nova-compute[71509]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 10:58:01 user nova-compute[71509]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 10:58:01 user nova-compute[71509]:     <timer name="hpet" present="no"/>
Apr 14 10:58:01 user nova-compute[71509]:   </clock>
Apr 14 10:58:01 user nova-compute[71509]:   <cpu mode="custom" match="exact">
Apr 14 10:58:01 user nova-compute[71509]:     <model>Nehalem</model>
Apr 14 10:58:01 user nova-compute[71509]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 10:58:01 user nova-compute[71509]:   </cpu>
Apr 14 10:58:01 user nova-compute[71509]:   <devices>
Apr 14 10:58:01 user nova-compute[71509]:     <disk type="file" device="disk">
Apr 14 10:58:01 user nova-compute[71509]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 10:58:01 user nova-compute[71509]:       <source file="/opt/stack/data/nova/instances/ef413492-c781-459e-b99c-46a530034c94/disk"/>
Apr 14 10:58:01 user nova-compute[71509]:       <target dev="vda" bus="virtio"/>
Apr 14 10:58:01 user nova-compute[71509]:     </disk>
Apr 14 10:58:01 user nova-compute[71509]:     <interface type="ethernet">
Apr 14 10:58:01 user nova-compute[71509]:       <mac address="fa:16:3e:6e:1f:b0"/>
Apr 14 10:58:01 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 10:58:01 user nova-compute[71509]:       <mtu size="1442"/>
Apr 14 10:58:01 user nova-compute[71509]:       <target dev="tap9e57c0d8-85"/>
Apr 14 10:58:01 user nova-compute[71509]:     </interface>
Apr 14 10:58:01 user nova-compute[71509]:     <serial type="pty">
Apr 14 10:58:01 user nova-compute[71509]:       <log file="/opt/stack/data/nova/instances/ef413492-c781-459e-b99c-46a530034c94/console.log" append="off"/>
Apr 14 10:58:01 user nova-compute[71509]:     </serial>
Apr 14 10:58:01 user nova-compute[71509]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 10:58:01 user nova-compute[71509]:     <video>
Apr 14 10:58:01 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 10:58:01 user nova-compute[71509]:     </video>
Apr 14 10:58:01 user nova-compute[71509]:     <rng model="virtio">
Apr 14 10:58:01 user nova-compute[71509]:       <backend model="random">/dev/urandom</backend>
Apr 14 10:58:01 user nova-compute[71509]:     </rng>
Apr 14 10:58:01 user nova-compute[71509]:     <controller type="usb" index="0" model="none"/>
Apr 14 10:58:01 user nova-compute[71509]:     <memballoon model="virtio">
Apr 14 10:58:01 user nova-compute[71509]:       <stats period="10"/>
Apr 14 10:58:01 user nova-compute[71509]:     </memballoon>
Apr 14 10:58:01 user nova-compute[71509]:   </devices>
Apr 14 10:58:01 user nova-compute[71509]: </domain>
Apr 14 10:58:01 user nova-compute[71509]:  {{(pid=71509) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 10:58:01 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-dd9d7d40-3087-4102-9895-2e169e668fe3 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T10:57:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2120803394',display_name='tempest-AttachVolumeNegativeTest-server-2120803394',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2120803394',id=32,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNw2SbFQpaxlXMigCU4SqREng1yFr8b6iVL8PJBLSwkK3b0e1hzyI9V2EhI2s6XMdqIXAYQuGjq1aeQdXx9cKlSvkg7nGGryoncSoq6eFhl2+423Xeuz3aQWMczJJSdSEQ==',key_name='tempest-keypair-880478313',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cb8f294f957f4c74ae959c1e9f238427',ramdisk_id='',reservation_id='r-yeps261o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-531644967',owner_user_name='tempest-AttachVolumeNegativeTest-531644967-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T10:57:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='78adbbdcd10e446daddde754e46309b2',uuid=ef413492-c781-459e-b99c-46a530034c94,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9e57c0d8-8572-4355-b3c0-d2b74196fc0d", "address": "fa:16:3e:6e:1f:b0", "network": {"id": "b639a68a-2b4e-435c-b98b-65b5b4981c73", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1070821894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb8f294f957f4c74ae959c1e9f238427", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e57c0d8-85", "ovs_interfaceid": "9e57c0d8-8572-4355-b3c0-d2b74196fc0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 10:58:01 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-dd9d7d40-3087-4102-9895-2e169e668fe3 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Converting VIF {"id": "9e57c0d8-8572-4355-b3c0-d2b74196fc0d", "address": "fa:16:3e:6e:1f:b0", "network": {"id": "b639a68a-2b4e-435c-b98b-65b5b4981c73", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1070821894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb8f294f957f4c74ae959c1e9f238427", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e57c0d8-85", "ovs_interfaceid": "9e57c0d8-8572-4355-b3c0-d2b74196fc0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:58:01 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-dd9d7d40-3087-4102-9895-2e169e668fe3 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:1f:b0,bridge_name='br-int',has_traffic_filtering=True,id=9e57c0d8-8572-4355-b3c0-d2b74196fc0d,network=Network(b639a68a-2b4e-435c-b98b-65b5b4981c73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e57c0d8-85') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:58:01 user nova-compute[71509]: DEBUG os_vif [None req-dd9d7d40-3087-4102-9895-2e169e668fe3 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:1f:b0,bridge_name='br-int',has_traffic_filtering=True,id=9e57c0d8-8572-4355-b3c0-d2b74196fc0d,network=Network(b639a68a-2b4e-435c-b98b-65b5b4981c73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e57c0d8-85') {{(pid=71509) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 10:58:01 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:58:01 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:58:01 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 10:58:01 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:58:01 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9e57c0d8-85, may_exist=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:58:01 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9e57c0d8-85, col_values=(('external_ids', {'iface-id': '9e57c0d8-8572-4355-b3c0-d2b74196fc0d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6e:1f:b0', 'vm-uuid': 'ef413492-c781-459e-b99c-46a530034c94'}),)) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:58:01 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:58:01 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 10:58:01 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:58:01 user nova-compute[71509]: INFO os_vif [None req-dd9d7d40-3087-4102-9895-2e169e668fe3 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:1f:b0,bridge_name='br-int',has_traffic_filtering=True,id=9e57c0d8-8572-4355-b3c0-d2b74196fc0d,network=Network(b639a68a-2b4e-435c-b98b-65b5b4981c73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e57c0d8-85')
Apr 14 10:58:01 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-dd9d7d40-3087-4102-9895-2e169e668fe3 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] No BDM found with device name vda, not building metadata. {{(pid=71509) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 10:58:01 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-dd9d7d40-3087-4102-9895-2e169e668fe3 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] No VIF found with MAC fa:16:3e:6e:1f:b0, not building metadata {{(pid=71509) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 10:58:01 user nova-compute[71509]: DEBUG nova.network.neutron [req-bef7a554-0e28-4de1-901e-c940379f2ba7 req-19ed5ddf-8b58-411b-9619-e4944c86c6af service nova] [instance: ef413492-c781-459e-b99c-46a530034c94] Updated VIF entry in instance network info cache for port 9e57c0d8-8572-4355-b3c0-d2b74196fc0d. {{(pid=71509) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 10:58:01 user nova-compute[71509]: DEBUG nova.network.neutron [req-bef7a554-0e28-4de1-901e-c940379f2ba7 req-19ed5ddf-8b58-411b-9619-e4944c86c6af service nova] [instance: ef413492-c781-459e-b99c-46a530034c94] Updating instance_info_cache with network_info: [{"id": "9e57c0d8-8572-4355-b3c0-d2b74196fc0d", "address": "fa:16:3e:6e:1f:b0", "network": {"id": "b639a68a-2b4e-435c-b98b-65b5b4981c73", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1070821894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb8f294f957f4c74ae959c1e9f238427", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e57c0d8-85", "ovs_interfaceid": "9e57c0d8-8572-4355-b3c0-d2b74196fc0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:58:01 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-bef7a554-0e28-4de1-901e-c940379f2ba7 req-19ed5ddf-8b58-411b-9619-e4944c86c6af service nova] Releasing lock "refresh_cache-ef413492-c781-459e-b99c-46a530034c94" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:58:02 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:58:02 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:58:02 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:58:02 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:58:02 user nova-compute[71509]: DEBUG nova.compute.manager [req-68356f2a-2276-43fb-8619-2f72e9dba214 req-4d2a8470-1363-43f5-af11-eba557a1877d service nova] [instance: ef413492-c781-459e-b99c-46a530034c94] Received event network-vif-plugged-9e57c0d8-8572-4355-b3c0-d2b74196fc0d {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:58:02 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-68356f2a-2276-43fb-8619-2f72e9dba214 req-4d2a8470-1363-43f5-af11-eba557a1877d service nova] Acquiring lock "ef413492-c781-459e-b99c-46a530034c94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:58:02 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-68356f2a-2276-43fb-8619-2f72e9dba214 req-4d2a8470-1363-43f5-af11-eba557a1877d service nova] Lock "ef413492-c781-459e-b99c-46a530034c94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:58:02 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-68356f2a-2276-43fb-8619-2f72e9dba214 req-4d2a8470-1363-43f5-af11-eba557a1877d service nova] Lock "ef413492-c781-459e-b99c-46a530034c94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:58:02 user nova-compute[71509]: DEBUG nova.compute.manager [req-68356f2a-2276-43fb-8619-2f72e9dba214 req-4d2a8470-1363-43f5-af11-eba557a1877d service nova] [instance: ef413492-c781-459e-b99c-46a530034c94] No waiting events found dispatching network-vif-plugged-9e57c0d8-8572-4355-b3c0-d2b74196fc0d {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:58:02 user nova-compute[71509]: WARNING nova.compute.manager [req-68356f2a-2276-43fb-8619-2f72e9dba214 req-4d2a8470-1363-43f5-af11-eba557a1877d service nova] [instance: ef413492-c781-459e-b99c-46a530034c94] Received unexpected event network-vif-plugged-9e57c0d8-8572-4355-b3c0-d2b74196fc0d for instance with vm_state building and task_state spawning.
Apr 14 10:58:03 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:58:03 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:58:03 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:58:03 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:58:03 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:58:04 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681469884.6669471, ef413492-c781-459e-b99c-46a530034c94 => Resumed> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 10:58:04 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: ef413492-c781-459e-b99c-46a530034c94] VM Resumed (Lifecycle Event)
Apr 14 10:58:04 user nova-compute[71509]: DEBUG nova.compute.manager [None req-dd9d7d40-3087-4102-9895-2e169e668fe3 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: ef413492-c781-459e-b99c-46a530034c94] Instance event wait completed in 0 seconds for  {{(pid=71509) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 10:58:04 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-dd9d7d40-3087-4102-9895-2e169e668fe3 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: ef413492-c781-459e-b99c-46a530034c94] Guest created on hypervisor {{(pid=71509) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 10:58:04 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: ef413492-c781-459e-b99c-46a530034c94] Instance spawned successfully.
Apr 14 10:58:04 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-dd9d7d40-3087-4102-9895-2e169e668fe3 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: ef413492-c781-459e-b99c-46a530034c94] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 10:58:04 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: ef413492-c781-459e-b99c-46a530034c94] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:58:04 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: ef413492-c781-459e-b99c-46a530034c94] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 10:58:04 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-dd9d7d40-3087-4102-9895-2e169e668fe3 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: ef413492-c781-459e-b99c-46a530034c94] Found default for hw_cdrom_bus of ide {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:58:04 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-dd9d7d40-3087-4102-9895-2e169e668fe3 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: ef413492-c781-459e-b99c-46a530034c94] Found default for hw_disk_bus of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:58:04 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-dd9d7d40-3087-4102-9895-2e169e668fe3 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: ef413492-c781-459e-b99c-46a530034c94] Found default for hw_input_bus of None {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:58:04 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-dd9d7d40-3087-4102-9895-2e169e668fe3 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: ef413492-c781-459e-b99c-46a530034c94] Found default for hw_pointer_model of None {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:58:04 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-dd9d7d40-3087-4102-9895-2e169e668fe3 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: ef413492-c781-459e-b99c-46a530034c94] Found default for hw_video_model of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:58:04 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-dd9d7d40-3087-4102-9895-2e169e668fe3 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: ef413492-c781-459e-b99c-46a530034c94] Found default for hw_vif_model of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:58:04 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: ef413492-c781-459e-b99c-46a530034c94] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 10:58:04 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681469884.6697345, ef413492-c781-459e-b99c-46a530034c94 => Started> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 10:58:04 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: ef413492-c781-459e-b99c-46a530034c94] VM Started (Lifecycle Event)
Apr 14 10:58:04 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: ef413492-c781-459e-b99c-46a530034c94] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:58:04 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: ef413492-c781-459e-b99c-46a530034c94] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 10:58:04 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: ef413492-c781-459e-b99c-46a530034c94] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 10:58:04 user nova-compute[71509]: INFO nova.compute.manager [None req-dd9d7d40-3087-4102-9895-2e169e668fe3 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: ef413492-c781-459e-b99c-46a530034c94] Took 5.57 seconds to spawn the instance on the hypervisor.
Apr 14 10:58:04 user nova-compute[71509]: DEBUG nova.compute.manager [None req-dd9d7d40-3087-4102-9895-2e169e668fe3 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: ef413492-c781-459e-b99c-46a530034c94] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:58:04 user nova-compute[71509]: INFO nova.compute.manager [None req-dd9d7d40-3087-4102-9895-2e169e668fe3 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: ef413492-c781-459e-b99c-46a530034c94] Took 6.72 seconds to build instance.
Apr 14 10:58:04 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-dd9d7d40-3087-4102-9895-2e169e668fe3 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "ef413492-c781-459e-b99c-46a530034c94" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.868s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:58:04 user nova-compute[71509]: DEBUG nova.compute.manager [req-631f7ceb-754c-4728-9a8e-c03cf9c7ae57 req-7f372671-1972-41a2-8eb3-646e97d51993 service nova] [instance: ef413492-c781-459e-b99c-46a530034c94] Received event network-vif-plugged-9e57c0d8-8572-4355-b3c0-d2b74196fc0d {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:58:04 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-631f7ceb-754c-4728-9a8e-c03cf9c7ae57 req-7f372671-1972-41a2-8eb3-646e97d51993 service nova] Acquiring lock "ef413492-c781-459e-b99c-46a530034c94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:58:04 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-631f7ceb-754c-4728-9a8e-c03cf9c7ae57 req-7f372671-1972-41a2-8eb3-646e97d51993 service nova] Lock "ef413492-c781-459e-b99c-46a530034c94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:58:04 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-631f7ceb-754c-4728-9a8e-c03cf9c7ae57 req-7f372671-1972-41a2-8eb3-646e97d51993 service nova] Lock "ef413492-c781-459e-b99c-46a530034c94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:58:04 user nova-compute[71509]: DEBUG nova.compute.manager [req-631f7ceb-754c-4728-9a8e-c03cf9c7ae57 req-7f372671-1972-41a2-8eb3-646e97d51993 service nova] [instance: ef413492-c781-459e-b99c-46a530034c94] No waiting events found dispatching network-vif-plugged-9e57c0d8-8572-4355-b3c0-d2b74196fc0d {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:58:04 user nova-compute[71509]: WARNING nova.compute.manager [req-631f7ceb-754c-4728-9a8e-c03cf9c7ae57 req-7f372671-1972-41a2-8eb3-646e97d51993 service nova] [instance: ef413492-c781-459e-b99c-46a530034c94] Received unexpected event network-vif-plugged-9e57c0d8-8572-4355-b3c0-d2b74196fc0d for instance with vm_state active and task_state None.
Apr 14 10:58:05 user nova-compute[71509]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681469870.7934349, d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5 => Stopped> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 10:58:05 user nova-compute[71509]: INFO nova.compute.manager [-] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] VM Stopped (Lifecycle Event)
Apr 14 10:58:05 user nova-compute[71509]: DEBUG nova.compute.manager [None req-95eccfca-1474-4dd9-875b-00055dd60cd1 None None] [instance: d8e00388-b9f1-4c73-ad0a-3a1c8e0207d5] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:58:06 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:58:08 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:58:11 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:58:13 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:58:14 user nova-compute[71509]: DEBUG nova.compute.manager [None req-a24a4f1f-25ec-4818-b86b-1203e3cf76de tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] [instance: e6580716-8a6a-4dfa-8978-ed54b92af1fe] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:58:15 user nova-compute[71509]: INFO nova.compute.manager [None req-a24a4f1f-25ec-4818-b86b-1203e3cf76de tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] [instance: e6580716-8a6a-4dfa-8978-ed54b92af1fe] instance snapshotting
Apr 14 10:58:15 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-a24a4f1f-25ec-4818-b86b-1203e3cf76de tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] [instance: e6580716-8a6a-4dfa-8978-ed54b92af1fe] Beginning live snapshot process
Apr 14 10:58:15 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-a24a4f1f-25ec-4818-b86b-1203e3cf76de tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6580716-8a6a-4dfa-8978-ed54b92af1fe/disk --force-share --output=json -f qcow2 {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:58:15 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-a24a4f1f-25ec-4818-b86b-1203e3cf76de tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6580716-8a6a-4dfa-8978-ed54b92af1fe/disk --force-share --output=json -f qcow2" returned: 0 in 0.137s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:58:15 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-a24a4f1f-25ec-4818-b86b-1203e3cf76de tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6580716-8a6a-4dfa-8978-ed54b92af1fe/disk --force-share --output=json -f qcow2 {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:58:15 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-a24a4f1f-25ec-4818-b86b-1203e3cf76de tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6580716-8a6a-4dfa-8978-ed54b92af1fe/disk --force-share --output=json -f qcow2" returned: 0 in 0.148s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:58:15 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-a24a4f1f-25ec-4818-b86b-1203e3cf76de tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:58:15 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-a24a4f1f-25ec-4818-b86b-1203e3cf76de tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json" returned: 0 in 0.134s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:58:15 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-a24a4f1f-25ec-4818-b86b-1203e3cf76de tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpl5ts3fsh/a79581d7a25c48d59b1d036830ccf397.delta 1073741824 {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:58:15 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-a24a4f1f-25ec-4818-b86b-1203e3cf76de tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpl5ts3fsh/a79581d7a25c48d59b1d036830ccf397.delta 1073741824" returned: 0 in 0.048s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:58:15 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-a24a4f1f-25ec-4818-b86b-1203e3cf76de tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] [instance: e6580716-8a6a-4dfa-8978-ed54b92af1fe] Quiescing instance not available: QEMU guest agent is not enabled.
Apr 14 10:58:16 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:58:16 user nova-compute[71509]: DEBUG nova.virt.libvirt.guest [None req-a24a4f1f-25ec-4818-b86b-1203e3cf76de tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] COPY block job progress, current cursor: 0 final cursor: 43843584 {{(pid=71509) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 10:58:16 user nova-compute[71509]: DEBUG nova.virt.libvirt.guest [None req-a24a4f1f-25ec-4818-b86b-1203e3cf76de tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] COPY block job progress, current cursor: 43843584 final cursor: 43843584 {{(pid=71509) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Apr 14 10:58:16 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-a24a4f1f-25ec-4818-b86b-1203e3cf76de tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] [instance: e6580716-8a6a-4dfa-8978-ed54b92af1fe] Skipping quiescing instance: QEMU guest agent is not enabled.
Apr 14 10:58:17 user nova-compute[71509]: DEBUG nova.privsep.utils [None req-a24a4f1f-25ec-4818-b86b-1203e3cf76de tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71509) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 10:58:17 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-a24a4f1f-25ec-4818-b86b-1203e3cf76de tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpl5ts3fsh/a79581d7a25c48d59b1d036830ccf397.delta /opt/stack/data/nova/instances/snapshots/tmpl5ts3fsh/a79581d7a25c48d59b1d036830ccf397 {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:58:17 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-a24a4f1f-25ec-4818-b86b-1203e3cf76de tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpl5ts3fsh/a79581d7a25c48d59b1d036830ccf397.delta /opt/stack/data/nova/instances/snapshots/tmpl5ts3fsh/a79581d7a25c48d59b1d036830ccf397" returned: 0 in 0.208s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:58:17 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-a24a4f1f-25ec-4818-b86b-1203e3cf76de tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] [instance: e6580716-8a6a-4dfa-8978-ed54b92af1fe] Snapshot extracted, beginning image upload
Apr 14 10:58:18 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:58:19 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-a24a4f1f-25ec-4818-b86b-1203e3cf76de tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] [instance: e6580716-8a6a-4dfa-8978-ed54b92af1fe] Snapshot image upload complete
Apr 14 10:58:19 user nova-compute[71509]: INFO nova.compute.manager [None req-a24a4f1f-25ec-4818-b86b-1203e3cf76de tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] [instance: e6580716-8a6a-4dfa-8978-ed54b92af1fe] Took 4.46 seconds to snapshot the instance on the hypervisor.
Apr 14 10:58:21 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:58:23 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:58:25 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-0f8575ce-f533-4dd9-a9c5-4d5ee9b84bd3 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Acquiring lock "3d6a53c3-6e32-456c-a056-fbf1bef3b656" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:58:25 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-0f8575ce-f533-4dd9-a9c5-4d5ee9b84bd3 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "3d6a53c3-6e32-456c-a056-fbf1bef3b656" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:58:25 user nova-compute[71509]: DEBUG nova.compute.manager [None req-0f8575ce-f533-4dd9-a9c5-4d5ee9b84bd3 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] [instance: 3d6a53c3-6e32-456c-a056-fbf1bef3b656] Starting instance... {{(pid=71509) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 10:58:25 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-0f8575ce-f533-4dd9-a9c5-4d5ee9b84bd3 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:58:25 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-0f8575ce-f533-4dd9-a9c5-4d5ee9b84bd3 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:58:25 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-0f8575ce-f533-4dd9-a9c5-4d5ee9b84bd3 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71509) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 10:58:25 user nova-compute[71509]: INFO nova.compute.claims [None req-0f8575ce-f533-4dd9-a9c5-4d5ee9b84bd3 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] [instance: 3d6a53c3-6e32-456c-a056-fbf1bef3b656] Claim successful on node user
Apr 14 10:58:25 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-0f8575ce-f533-4dd9-a9c5-4d5ee9b84bd3 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 10:58:25 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-0f8575ce-f533-4dd9-a9c5-4d5ee9b84bd3 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 10:58:25 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-0f8575ce-f533-4dd9-a9c5-4d5ee9b84bd3 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.479s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:58:25 user nova-compute[71509]: DEBUG nova.compute.manager [None req-0f8575ce-f533-4dd9-a9c5-4d5ee9b84bd3 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] [instance: 3d6a53c3-6e32-456c-a056-fbf1bef3b656] Start building networks asynchronously for instance. {{(pid=71509) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 10:58:25 user nova-compute[71509]: DEBUG nova.compute.manager [None req-0f8575ce-f533-4dd9-a9c5-4d5ee9b84bd3 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] [instance: 3d6a53c3-6e32-456c-a056-fbf1bef3b656] Allocating IP information in the background. {{(pid=71509) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 10:58:25 user nova-compute[71509]: DEBUG nova.network.neutron [None req-0f8575ce-f533-4dd9-a9c5-4d5ee9b84bd3 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] [instance: 3d6a53c3-6e32-456c-a056-fbf1bef3b656] allocate_for_instance() {{(pid=71509) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 10:58:25 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-0f8575ce-f533-4dd9-a9c5-4d5ee9b84bd3 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] [instance: 3d6a53c3-6e32-456c-a056-fbf1bef3b656] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 10:58:25 user nova-compute[71509]: DEBUG nova.compute.manager [None req-0f8575ce-f533-4dd9-a9c5-4d5ee9b84bd3 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] [instance: 3d6a53c3-6e32-456c-a056-fbf1bef3b656] Start building block device mappings for instance. {{(pid=71509) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 10:58:25 user nova-compute[71509]: DEBUG nova.policy [None req-0f8575ce-f533-4dd9-a9c5-4d5ee9b84bd3 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e3ad6531a67b4be58a195e1208157b0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f629ba0ab8074ed8bb4e59d545b74eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71509) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 10:58:25 user nova-compute[71509]: DEBUG nova.compute.manager [None req-0f8575ce-f533-4dd9-a9c5-4d5ee9b84bd3 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] [instance: 3d6a53c3-6e32-456c-a056-fbf1bef3b656] Start spawning the instance on the hypervisor. {{(pid=71509) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 10:58:25 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-0f8575ce-f533-4dd9-a9c5-4d5ee9b84bd3 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] [instance: 3d6a53c3-6e32-456c-a056-fbf1bef3b656] Creating instance directory {{(pid=71509) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 10:58:25 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-0f8575ce-f533-4dd9-a9c5-4d5ee9b84bd3 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] [instance: 3d6a53c3-6e32-456c-a056-fbf1bef3b656] Creating image(s)
Apr 14 10:58:25 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-0f8575ce-f533-4dd9-a9c5-4d5ee9b84bd3 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Acquiring lock "/opt/stack/data/nova/instances/3d6a53c3-6e32-456c-a056-fbf1bef3b656/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:58:25 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-0f8575ce-f533-4dd9-a9c5-4d5ee9b84bd3 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "/opt/stack/data/nova/instances/3d6a53c3-6e32-456c-a056-fbf1bef3b656/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:58:25 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-0f8575ce-f533-4dd9-a9c5-4d5ee9b84bd3 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "/opt/stack/data/nova/instances/3d6a53c3-6e32-456c-a056-fbf1bef3b656/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:58:25 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-0f8575ce-f533-4dd9-a9c5-4d5ee9b84bd3 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Acquiring lock "8d6ec48071dda9a86c9aff1c8830099f36f2c011" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:58:25 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-0f8575ce-f533-4dd9-a9c5-4d5ee9b84bd3 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "8d6ec48071dda9a86c9aff1c8830099f36f2c011" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:58:26 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-0f8575ce-f533-4dd9-a9c5-4d5ee9b84bd3 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8d6ec48071dda9a86c9aff1c8830099f36f2c011.part --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:58:26 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:58:26 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 10:58:26 user nova-compute[71509]: DEBUG nova.network.neutron [None req-0f8575ce-f533-4dd9-a9c5-4d5ee9b84bd3 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] [instance: 3d6a53c3-6e32-456c-a056-fbf1bef3b656] Successfully created port: c18cf2ba-f230-4684-a95c-14af689d7981 {{(pid=71509) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 10:58:26 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-0f8575ce-f533-4dd9-a9c5-4d5ee9b84bd3 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8d6ec48071dda9a86c9aff1c8830099f36f2c011.part --force-share --output=json" returned: 0 in 0.151s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:58:26 user nova-compute[71509]: DEBUG nova.virt.images [None req-0f8575ce-f533-4dd9-a9c5-4d5ee9b84bd3 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] b87baa1b-a18b-4e25-8812-8e4876470ade was qcow2, converting to raw {{(pid=71509) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 14 10:58:26 user nova-compute[71509]: DEBUG nova.privsep.utils [None req-0f8575ce-f533-4dd9-a9c5-4d5ee9b84bd3 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71509) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 10:58:26 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-0f8575ce-f533-4dd9-a9c5-4d5ee9b84bd3 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8d6ec48071dda9a86c9aff1c8830099f36f2c011.part /opt/stack/data/nova/instances/_base/8d6ec48071dda9a86c9aff1c8830099f36f2c011.converted {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:58:27 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-0f8575ce-f533-4dd9-a9c5-4d5ee9b84bd3 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8d6ec48071dda9a86c9aff1c8830099f36f2c011.part /opt/stack/data/nova/instances/_base/8d6ec48071dda9a86c9aff1c8830099f36f2c011.converted" returned: 0 in 0.293s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:58:27 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-0f8575ce-f533-4dd9-a9c5-4d5ee9b84bd3 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8d6ec48071dda9a86c9aff1c8830099f36f2c011.converted --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:58:27 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-0f8575ce-f533-4dd9-a9c5-4d5ee9b84bd3 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8d6ec48071dda9a86c9aff1c8830099f36f2c011.converted --force-share --output=json" returned: 0 in 0.134s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:58:27 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-0f8575ce-f533-4dd9-a9c5-4d5ee9b84bd3 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "8d6ec48071dda9a86c9aff1c8830099f36f2c011" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.384s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:58:27 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-0f8575ce-f533-4dd9-a9c5-4d5ee9b84bd3 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8d6ec48071dda9a86c9aff1c8830099f36f2c011 --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:58:27 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-0f8575ce-f533-4dd9-a9c5-4d5ee9b84bd3 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8d6ec48071dda9a86c9aff1c8830099f36f2c011 --force-share --output=json" returned: 0 in 0.133s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:58:27 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-0f8575ce-f533-4dd9-a9c5-4d5ee9b84bd3 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Acquiring lock "8d6ec48071dda9a86c9aff1c8830099f36f2c011" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:58:27 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-0f8575ce-f533-4dd9-a9c5-4d5ee9b84bd3 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "8d6ec48071dda9a86c9aff1c8830099f36f2c011" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:58:27 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-0f8575ce-f533-4dd9-a9c5-4d5ee9b84bd3 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8d6ec48071dda9a86c9aff1c8830099f36f2c011 --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:58:27 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-0f8575ce-f533-4dd9-a9c5-4d5ee9b84bd3 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8d6ec48071dda9a86c9aff1c8830099f36f2c011 --force-share --output=json" returned: 0 in 0.140s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:58:27 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-0f8575ce-f533-4dd9-a9c5-4d5ee9b84bd3 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8d6ec48071dda9a86c9aff1c8830099f36f2c011,backing_fmt=raw /opt/stack/data/nova/instances/3d6a53c3-6e32-456c-a056-fbf1bef3b656/disk 1073741824 {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:58:27 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-0f8575ce-f533-4dd9-a9c5-4d5ee9b84bd3 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8d6ec48071dda9a86c9aff1c8830099f36f2c011,backing_fmt=raw /opt/stack/data/nova/instances/3d6a53c3-6e32-456c-a056-fbf1bef3b656/disk 1073741824" returned: 0 in 0.053s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:58:27 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-0f8575ce-f533-4dd9-a9c5-4d5ee9b84bd3 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "8d6ec48071dda9a86c9aff1c8830099f36f2c011" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.201s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:58:27 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-0f8575ce-f533-4dd9-a9c5-4d5ee9b84bd3 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8d6ec48071dda9a86c9aff1c8830099f36f2c011 --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:58:27 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-0f8575ce-f533-4dd9-a9c5-4d5ee9b84bd3 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8d6ec48071dda9a86c9aff1c8830099f36f2c011 --force-share --output=json" returned: 0 in 0.130s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:58:27 user nova-compute[71509]: DEBUG nova.objects.instance [None req-0f8575ce-f533-4dd9-a9c5-4d5ee9b84bd3 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lazy-loading 'migration_context' on Instance uuid 3d6a53c3-6e32-456c-a056-fbf1bef3b656 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:58:27 user nova-compute[71509]: DEBUG nova.network.neutron [None req-0f8575ce-f533-4dd9-a9c5-4d5ee9b84bd3 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] [instance: 3d6a53c3-6e32-456c-a056-fbf1bef3b656] Successfully updated port: c18cf2ba-f230-4684-a95c-14af689d7981 {{(pid=71509) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 10:58:27 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-0f8575ce-f533-4dd9-a9c5-4d5ee9b84bd3 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] [instance: 3d6a53c3-6e32-456c-a056-fbf1bef3b656] Created local disks {{(pid=71509) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 10:58:27 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-0f8575ce-f533-4dd9-a9c5-4d5ee9b84bd3 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] [instance: 3d6a53c3-6e32-456c-a056-fbf1bef3b656] Ensure instance console log exists: /opt/stack/data/nova/instances/3d6a53c3-6e32-456c-a056-fbf1bef3b656/console.log {{(pid=71509) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 10:58:27 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-0f8575ce-f533-4dd9-a9c5-4d5ee9b84bd3 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:58:27 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-0f8575ce-f533-4dd9-a9c5-4d5ee9b84bd3 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:58:27 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-0f8575ce-f533-4dd9-a9c5-4d5ee9b84bd3 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:58:27 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-0f8575ce-f533-4dd9-a9c5-4d5ee9b84bd3 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Acquiring lock "refresh_cache-3d6a53c3-6e32-456c-a056-fbf1bef3b656" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:58:27 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-0f8575ce-f533-4dd9-a9c5-4d5ee9b84bd3 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Acquired lock "refresh_cache-3d6a53c3-6e32-456c-a056-fbf1bef3b656" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:58:27 user nova-compute[71509]: DEBUG nova.network.neutron [None req-0f8575ce-f533-4dd9-a9c5-4d5ee9b84bd3 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] [instance: 3d6a53c3-6e32-456c-a056-fbf1bef3b656] Building network info cache for instance {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 10:58:27 user nova-compute[71509]: DEBUG nova.compute.manager [req-580fac7d-8955-4772-854c-1d829b588cab req-7bd90ac9-b02d-4d62-baa3-9da766025481 service nova] [instance: 3d6a53c3-6e32-456c-a056-fbf1bef3b656] Received event network-changed-c18cf2ba-f230-4684-a95c-14af689d7981 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:58:27 user nova-compute[71509]: DEBUG nova.compute.manager [req-580fac7d-8955-4772-854c-1d829b588cab req-7bd90ac9-b02d-4d62-baa3-9da766025481 service nova] [instance: 3d6a53c3-6e32-456c-a056-fbf1bef3b656] Refreshing instance network info cache due to event network-changed-c18cf2ba-f230-4684-a95c-14af689d7981. {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 10:58:27 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-580fac7d-8955-4772-854c-1d829b588cab req-7bd90ac9-b02d-4d62-baa3-9da766025481 service nova] Acquiring lock "refresh_cache-3d6a53c3-6e32-456c-a056-fbf1bef3b656" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:58:27 user nova-compute[71509]: DEBUG nova.network.neutron [None req-0f8575ce-f533-4dd9-a9c5-4d5ee9b84bd3 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] [instance: 3d6a53c3-6e32-456c-a056-fbf1bef3b656] Instance cache missing network info. {{(pid=71509) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 10:58:28 user nova-compute[71509]: DEBUG nova.network.neutron [None req-0f8575ce-f533-4dd9-a9c5-4d5ee9b84bd3 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] [instance: 3d6a53c3-6e32-456c-a056-fbf1bef3b656] Updating instance_info_cache with network_info: [{"id": "c18cf2ba-f230-4684-a95c-14af689d7981", "address": "fa:16:3e:ad:2f:9a", "network": {"id": "1fdeb048-706a-45bf-8f2a-2cee21abb9ea", "bridge": "br-int", "label": "tempest-TestStampPattern-1337046138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f629ba0ab8074ed8bb4e59d545b74eb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc18cf2ba-f2", "ovs_interfaceid": "c18cf2ba-f230-4684-a95c-14af689d7981", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:58:28 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-0f8575ce-f533-4dd9-a9c5-4d5ee9b84bd3 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Releasing lock "refresh_cache-3d6a53c3-6e32-456c-a056-fbf1bef3b656" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:58:28 user nova-compute[71509]: DEBUG nova.compute.manager [None req-0f8575ce-f533-4dd9-a9c5-4d5ee9b84bd3 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] [instance: 3d6a53c3-6e32-456c-a056-fbf1bef3b656] Instance network_info: |[{"id": "c18cf2ba-f230-4684-a95c-14af689d7981", "address": "fa:16:3e:ad:2f:9a", "network": {"id": "1fdeb048-706a-45bf-8f2a-2cee21abb9ea", "bridge": "br-int", "label": "tempest-TestStampPattern-1337046138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f629ba0ab8074ed8bb4e59d545b74eb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc18cf2ba-f2", "ovs_interfaceid": "c18cf2ba-f230-4684-a95c-14af689d7981", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71509) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 10:58:28 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-580fac7d-8955-4772-854c-1d829b588cab req-7bd90ac9-b02d-4d62-baa3-9da766025481 service nova] Acquired lock "refresh_cache-3d6a53c3-6e32-456c-a056-fbf1bef3b656" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:58:28 user nova-compute[71509]: DEBUG nova.network.neutron [req-580fac7d-8955-4772-854c-1d829b588cab req-7bd90ac9-b02d-4d62-baa3-9da766025481 service nova] [instance: 3d6a53c3-6e32-456c-a056-fbf1bef3b656] Refreshing network info cache for port c18cf2ba-f230-4684-a95c-14af689d7981 {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 10:58:28 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-0f8575ce-f533-4dd9-a9c5-4d5ee9b84bd3 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] [instance: 3d6a53c3-6e32-456c-a056-fbf1bef3b656] Start _get_guest_xml network_info=[{"id": "c18cf2ba-f230-4684-a95c-14af689d7981", "address": "fa:16:3e:ad:2f:9a", "network": {"id": "1fdeb048-706a-45bf-8f2a-2cee21abb9ea", "bridge": "br-int", "label": "tempest-TestStampPattern-1337046138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f629ba0ab8074ed8bb4e59d545b74eb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc18cf2ba-f2", "ovs_interfaceid": "c18cf2ba-f230-4684-a95c-14af689d7981", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='cdb8ab64237d3c6dd46f3c43386416ec',container_format='bare',created_at=2023-04-14T10:58:15Z,direct_url=<?>,disk_format='qcow2',id=b87baa1b-a18b-4e25-8812-8e4876470ade,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-336900456',owner='f629ba0ab8074ed8bb4e59d545b74eb6',properties=ImageMetaProps,protected=<?>,size=38666240,status='active',tags=<?>,updated_at=2023-04-14T10:58:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': 'b87baa1b-a18b-4e25-8812-8e4876470ade'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71509) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 10:58:28 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-0f8575ce-f533-4dd9-a9c5-4d5ee9b84bd3 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:58:28 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-0f8575ce-f533-4dd9-a9c5-4d5ee9b84bd3 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:58:28 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-0f8575ce-f533-4dd9-a9c5-4d5ee9b84bd3 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71509) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 10:58:28 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-0f8575ce-f533-4dd9-a9c5-4d5ee9b84bd3 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T10:40:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='cdb8ab64237d3c6dd46f3c43386416ec',container_format='bare',created_at=2023-04-14T10:58:15Z,direct_url=<?>,disk_format='qcow2',id=b87baa1b-a18b-4e25-8812-8e4876470ade,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-336900456',owner='f629ba0ab8074ed8bb4e59d545b74eb6',properties=ImageMetaProps,protected=<?>,size=38666240,status='active',tags=<?>,updated_at=2023-04-14T10:58:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 10:58:28 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-0f8575ce-f533-4dd9-a9c5-4d5ee9b84bd3 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Flavor limits 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 10:58:28 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-0f8575ce-f533-4dd9-a9c5-4d5ee9b84bd3 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Image limits 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 10:58:28 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-0f8575ce-f533-4dd9-a9c5-4d5ee9b84bd3 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Flavor pref 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 10:58:28 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-0f8575ce-f533-4dd9-a9c5-4d5ee9b84bd3 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Image pref 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 10:58:28 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-0f8575ce-f533-4dd9-a9c5-4d5ee9b84bd3 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 10:58:28 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-0f8575ce-f533-4dd9-a9c5-4d5ee9b84bd3 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 10:58:28 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-0f8575ce-f533-4dd9-a9c5-4d5ee9b84bd3 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71509) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 10:58:28 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-0f8575ce-f533-4dd9-a9c5-4d5ee9b84bd3 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Got 1 possible topologies {{(pid=71509) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 10:58:28 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-0f8575ce-f533-4dd9-a9c5-4d5ee9b84bd3 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 10:58:28 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-0f8575ce-f533-4dd9-a9c5-4d5ee9b84bd3 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 10:58:28 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-0f8575ce-f533-4dd9-a9c5-4d5ee9b84bd3 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T10:58:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-809706283',display_name='tempest-TestStampPattern-server-809706283',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-809706283',id=33,image_ref='b87baa1b-a18b-4e25-8812-8e4876470ade',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHGJbZqWmfze/VbD7AiTXpBSSC7JeSqxVieDSB69GsDRbeWrzeiKDuD8IXa8m1YPGpwzOjCM3hxDW4Au2iAbXYcYId85Kh55qCn9eiY+V5K3AjDmmJpdlP7IQxGR6pVCIA==',key_name='tempest-TestStampPattern-627373922',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f629ba0ab8074ed8bb4e59d545b74eb6',ramdisk_id='',reservation_id='r-v0vov0ja',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='e6580716-8a6a-4dfa-8978-ed54b92af1fe',image_min_disk='1',image_min_ram='0',image_owner_id='f629ba0ab8074ed8bb4e59d545b74eb6',image_owner_project_name='tempest-TestStampPattern-1000870021',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1000870021-project-member',image_user_id='e3ad6531a67b4be58a195e1208157b0b',network_allocated='True',owner_project_name='tempest-TestStampPattern-1000870021',owner_user_name='tempest-TestStampPattern-1000870021-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T10:58:26Z,user_data=None,user_id='e3ad6531a67b4be58a195e1208157b0b',uuid=3d6a53c3-6e32-456c-a056-fbf1bef3b656,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c18cf2ba-f230-4684-a95c-14af689d7981", "address": "fa:16:3e:ad:2f:9a", "network": {"id": "1fdeb048-706a-45bf-8f2a-2cee21abb9ea", "bridge": "br-int", "label": "tempest-TestStampPattern-1337046138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f629ba0ab8074ed8bb4e59d545b74eb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc18cf2ba-f2", "ovs_interfaceid": "c18cf2ba-f230-4684-a95c-14af689d7981", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71509) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 10:58:28 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-0f8575ce-f533-4dd9-a9c5-4d5ee9b84bd3 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Converting VIF {"id": "c18cf2ba-f230-4684-a95c-14af689d7981", "address": "fa:16:3e:ad:2f:9a", "network": {"id": "1fdeb048-706a-45bf-8f2a-2cee21abb9ea", "bridge": "br-int", "label": "tempest-TestStampPattern-1337046138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f629ba0ab8074ed8bb4e59d545b74eb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc18cf2ba-f2", "ovs_interfaceid": "c18cf2ba-f230-4684-a95c-14af689d7981", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:58:28 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-0f8575ce-f533-4dd9-a9c5-4d5ee9b84bd3 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:2f:9a,bridge_name='br-int',has_traffic_filtering=True,id=c18cf2ba-f230-4684-a95c-14af689d7981,network=Network(1fdeb048-706a-45bf-8f2a-2cee21abb9ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc18cf2ba-f2') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:58:28 user nova-compute[71509]: DEBUG nova.objects.instance [None req-0f8575ce-f533-4dd9-a9c5-4d5ee9b84bd3 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lazy-loading 'pci_devices' on Instance uuid 3d6a53c3-6e32-456c-a056-fbf1bef3b656 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:58:28 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-0f8575ce-f533-4dd9-a9c5-4d5ee9b84bd3 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] [instance: 3d6a53c3-6e32-456c-a056-fbf1bef3b656] End _get_guest_xml xml=<domain type="kvm">
Apr 14 10:58:28 user nova-compute[71509]:   <uuid>3d6a53c3-6e32-456c-a056-fbf1bef3b656</uuid>
Apr 14 10:58:28 user nova-compute[71509]:   <name>instance-00000021</name>
Apr 14 10:58:28 user nova-compute[71509]:   <memory>131072</memory>
Apr 14 10:58:28 user nova-compute[71509]:   <vcpu>1</vcpu>
Apr 14 10:58:28 user nova-compute[71509]:   <metadata>
Apr 14 10:58:28 user nova-compute[71509]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 10:58:28 user nova-compute[71509]:       <nova:package version="0.0.0"/>
Apr 14 10:58:28 user nova-compute[71509]:       <nova:name>tempest-TestStampPattern-server-809706283</nova:name>
Apr 14 10:58:28 user nova-compute[71509]:       <nova:creationTime>2023-04-14 10:58:28</nova:creationTime>
Apr 14 10:58:28 user nova-compute[71509]:       <nova:flavor name="m1.nano">
Apr 14 10:58:28 user nova-compute[71509]:         <nova:memory>128</nova:memory>
Apr 14 10:58:28 user nova-compute[71509]:         <nova:disk>1</nova:disk>
Apr 14 10:58:28 user nova-compute[71509]:         <nova:swap>0</nova:swap>
Apr 14 10:58:28 user nova-compute[71509]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 10:58:28 user nova-compute[71509]:         <nova:vcpus>1</nova:vcpus>
Apr 14 10:58:28 user nova-compute[71509]:       </nova:flavor>
Apr 14 10:58:28 user nova-compute[71509]:       <nova:owner>
Apr 14 10:58:28 user nova-compute[71509]:         <nova:user uuid="e3ad6531a67b4be58a195e1208157b0b">tempest-TestStampPattern-1000870021-project-member</nova:user>
Apr 14 10:58:28 user nova-compute[71509]:         <nova:project uuid="f629ba0ab8074ed8bb4e59d545b74eb6">tempest-TestStampPattern-1000870021</nova:project>
Apr 14 10:58:28 user nova-compute[71509]:       </nova:owner>
Apr 14 10:58:28 user nova-compute[71509]:       <nova:root type="image" uuid="b87baa1b-a18b-4e25-8812-8e4876470ade"/>
Apr 14 10:58:28 user nova-compute[71509]:       <nova:ports>
Apr 14 10:58:28 user nova-compute[71509]:         <nova:port uuid="c18cf2ba-f230-4684-a95c-14af689d7981">
Apr 14 10:58:28 user nova-compute[71509]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 14 10:58:28 user nova-compute[71509]:         </nova:port>
Apr 14 10:58:28 user nova-compute[71509]:       </nova:ports>
Apr 14 10:58:28 user nova-compute[71509]:     </nova:instance>
Apr 14 10:58:28 user nova-compute[71509]:   </metadata>
Apr 14 10:58:28 user nova-compute[71509]:   <sysinfo type="smbios">
Apr 14 10:58:28 user nova-compute[71509]:     <system>
Apr 14 10:58:28 user nova-compute[71509]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 10:58:28 user nova-compute[71509]:       <entry name="product">OpenStack Nova</entry>
Apr 14 10:58:28 user nova-compute[71509]:       <entry name="version">0.0.0</entry>
Apr 14 10:58:28 user nova-compute[71509]:       <entry name="serial">3d6a53c3-6e32-456c-a056-fbf1bef3b656</entry>
Apr 14 10:58:28 user nova-compute[71509]:       <entry name="uuid">3d6a53c3-6e32-456c-a056-fbf1bef3b656</entry>
Apr 14 10:58:28 user nova-compute[71509]:       <entry name="family">Virtual Machine</entry>
Apr 14 10:58:28 user nova-compute[71509]:     </system>
Apr 14 10:58:28 user nova-compute[71509]:   </sysinfo>
Apr 14 10:58:28 user nova-compute[71509]:   <os>
Apr 14 10:58:28 user nova-compute[71509]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 10:58:28 user nova-compute[71509]:     <boot dev="hd"/>
Apr 14 10:58:28 user nova-compute[71509]:     <smbios mode="sysinfo"/>
Apr 14 10:58:28 user nova-compute[71509]:   </os>
Apr 14 10:58:28 user nova-compute[71509]:   <features>
Apr 14 10:58:28 user nova-compute[71509]:     <acpi/>
Apr 14 10:58:28 user nova-compute[71509]:     <apic/>
Apr 14 10:58:28 user nova-compute[71509]:     <vmcoreinfo/>
Apr 14 10:58:28 user nova-compute[71509]:   </features>
Apr 14 10:58:28 user nova-compute[71509]:   <clock offset="utc">
Apr 14 10:58:28 user nova-compute[71509]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 10:58:28 user nova-compute[71509]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 10:58:28 user nova-compute[71509]:     <timer name="hpet" present="no"/>
Apr 14 10:58:28 user nova-compute[71509]:   </clock>
Apr 14 10:58:28 user nova-compute[71509]:   <cpu mode="custom" match="exact">
Apr 14 10:58:28 user nova-compute[71509]:     <model>Nehalem</model>
Apr 14 10:58:28 user nova-compute[71509]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 10:58:28 user nova-compute[71509]:   </cpu>
Apr 14 10:58:28 user nova-compute[71509]:   <devices>
Apr 14 10:58:28 user nova-compute[71509]:     <disk type="file" device="disk">
Apr 14 10:58:28 user nova-compute[71509]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 10:58:28 user nova-compute[71509]:       <source file="/opt/stack/data/nova/instances/3d6a53c3-6e32-456c-a056-fbf1bef3b656/disk"/>
Apr 14 10:58:28 user nova-compute[71509]:       <target dev="vda" bus="virtio"/>
Apr 14 10:58:28 user nova-compute[71509]:     </disk>
Apr 14 10:58:28 user nova-compute[71509]:     <interface type="ethernet">
Apr 14 10:58:28 user nova-compute[71509]:       <mac address="fa:16:3e:ad:2f:9a"/>
Apr 14 10:58:28 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 10:58:28 user nova-compute[71509]:       <mtu size="1442"/>
Apr 14 10:58:28 user nova-compute[71509]:       <target dev="tapc18cf2ba-f2"/>
Apr 14 10:58:28 user nova-compute[71509]:     </interface>
Apr 14 10:58:28 user nova-compute[71509]:     <serial type="pty">
Apr 14 10:58:28 user nova-compute[71509]:       <log file="/opt/stack/data/nova/instances/3d6a53c3-6e32-456c-a056-fbf1bef3b656/console.log" append="off"/>
Apr 14 10:58:28 user nova-compute[71509]:     </serial>
Apr 14 10:58:28 user nova-compute[71509]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 10:58:28 user nova-compute[71509]:     <video>
Apr 14 10:58:28 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 10:58:28 user nova-compute[71509]:     </video>
Apr 14 10:58:28 user nova-compute[71509]:     <rng model="virtio">
Apr 14 10:58:28 user nova-compute[71509]:       <backend model="random">/dev/urandom</backend>
Apr 14 10:58:28 user nova-compute[71509]:     </rng>
Apr 14 10:58:28 user nova-compute[71509]:     <controller type="usb" index="0" model="none"/>
Apr 14 10:58:28 user nova-compute[71509]:     <memballoon model="virtio">
Apr 14 10:58:28 user nova-compute[71509]:       <stats period="10"/>
Apr 14 10:58:28 user nova-compute[71509]:     </memballoon>
Apr 14 10:58:28 user nova-compute[71509]:   </devices>
Apr 14 10:58:28 user nova-compute[71509]: </domain>
Apr 14 10:58:28 user nova-compute[71509]:  {{(pid=71509) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 10:58:28 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-0f8575ce-f533-4dd9-a9c5-4d5ee9b84bd3 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T10:58:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-809706283',display_name='tempest-TestStampPattern-server-809706283',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-809706283',id=33,image_ref='b87baa1b-a18b-4e25-8812-8e4876470ade',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHGJbZqWmfze/VbD7AiTXpBSSC7JeSqxVieDSB69GsDRbeWrzeiKDuD8IXa8m1YPGpwzOjCM3hxDW4Au2iAbXYcYId85Kh55qCn9eiY+V5K3AjDmmJpdlP7IQxGR6pVCIA==',key_name='tempest-TestStampPattern-627373922',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f629ba0ab8074ed8bb4e59d545b74eb6',ramdisk_id='',reservation_id='r-v0vov0ja',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='e6580716-8a6a-4dfa-8978-ed54b92af1fe',image_min_disk='1',image_min_ram='0',image_owner_id='f629ba0ab8074ed8bb4e59d545b74eb6',image_owner_project_name='tempest-TestStampPattern-1000870021',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1000870021-project-member',image_user_id='e3ad6531a67b4be58a195e1208157b0b',network_allocated='True',owner_project_name='tempest-TestStampPattern-1000870021',owner_user_name='tempest-TestStampPattern-1000870021-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T10:58:26Z,user_data=None,user_id='e3ad6531a67b4be58a195e1208157b0b',uuid=3d6a53c3-6e32-456c-a056-fbf1bef3b656,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c18cf2ba-f230-4684-a95c-14af689d7981", "address": "fa:16:3e:ad:2f:9a", "network": {"id": "1fdeb048-706a-45bf-8f2a-2cee21abb9ea", "bridge": "br-int", "label": "tempest-TestStampPattern-1337046138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f629ba0ab8074ed8bb4e59d545b74eb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc18cf2ba-f2", "ovs_interfaceid": "c18cf2ba-f230-4684-a95c-14af689d7981", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 10:58:28 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-0f8575ce-f533-4dd9-a9c5-4d5ee9b84bd3 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Converting VIF {"id": "c18cf2ba-f230-4684-a95c-14af689d7981", "address": "fa:16:3e:ad:2f:9a", "network": {"id": "1fdeb048-706a-45bf-8f2a-2cee21abb9ea", "bridge": "br-int", "label": "tempest-TestStampPattern-1337046138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f629ba0ab8074ed8bb4e59d545b74eb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc18cf2ba-f2", "ovs_interfaceid": "c18cf2ba-f230-4684-a95c-14af689d7981", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:58:28 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-0f8575ce-f533-4dd9-a9c5-4d5ee9b84bd3 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:2f:9a,bridge_name='br-int',has_traffic_filtering=True,id=c18cf2ba-f230-4684-a95c-14af689d7981,network=Network(1fdeb048-706a-45bf-8f2a-2cee21abb9ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc18cf2ba-f2') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:58:28 user nova-compute[71509]: DEBUG os_vif [None req-0f8575ce-f533-4dd9-a9c5-4d5ee9b84bd3 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:2f:9a,bridge_name='br-int',has_traffic_filtering=True,id=c18cf2ba-f230-4684-a95c-14af689d7981,network=Network(1fdeb048-706a-45bf-8f2a-2cee21abb9ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc18cf2ba-f2') {{(pid=71509) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 10:58:28 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:58:28 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:58:28 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 10:58:28 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:58:28 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc18cf2ba-f2, may_exist=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:58:28 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc18cf2ba-f2, col_values=(('external_ids', {'iface-id': 'c18cf2ba-f230-4684-a95c-14af689d7981', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ad:2f:9a', 'vm-uuid': '3d6a53c3-6e32-456c-a056-fbf1bef3b656'}),)) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:58:28 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:58:28 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 10:58:28 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:58:28 user nova-compute[71509]: INFO os_vif [None req-0f8575ce-f533-4dd9-a9c5-4d5ee9b84bd3 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:2f:9a,bridge_name='br-int',has_traffic_filtering=True,id=c18cf2ba-f230-4684-a95c-14af689d7981,network=Network(1fdeb048-706a-45bf-8f2a-2cee21abb9ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc18cf2ba-f2')
Apr 14 10:58:28 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:58:28 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-0f8575ce-f533-4dd9-a9c5-4d5ee9b84bd3 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] No BDM found with device name vda, not building metadata. {{(pid=71509) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 10:58:28 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-0f8575ce-f533-4dd9-a9c5-4d5ee9b84bd3 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] No VIF found with MAC fa:16:3e:ad:2f:9a, not building metadata {{(pid=71509) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 10:58:29 user nova-compute[71509]: DEBUG nova.network.neutron [req-580fac7d-8955-4772-854c-1d829b588cab req-7bd90ac9-b02d-4d62-baa3-9da766025481 service nova] [instance: 3d6a53c3-6e32-456c-a056-fbf1bef3b656] Updated VIF entry in instance network info cache for port c18cf2ba-f230-4684-a95c-14af689d7981. {{(pid=71509) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 10:58:29 user nova-compute[71509]: DEBUG nova.network.neutron [req-580fac7d-8955-4772-854c-1d829b588cab req-7bd90ac9-b02d-4d62-baa3-9da766025481 service nova] [instance: 3d6a53c3-6e32-456c-a056-fbf1bef3b656] Updating instance_info_cache with network_info: [{"id": "c18cf2ba-f230-4684-a95c-14af689d7981", "address": "fa:16:3e:ad:2f:9a", "network": {"id": "1fdeb048-706a-45bf-8f2a-2cee21abb9ea", "bridge": "br-int", "label": "tempest-TestStampPattern-1337046138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f629ba0ab8074ed8bb4e59d545b74eb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc18cf2ba-f2", "ovs_interfaceid": "c18cf2ba-f230-4684-a95c-14af689d7981", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:58:29 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-580fac7d-8955-4772-854c-1d829b588cab req-7bd90ac9-b02d-4d62-baa3-9da766025481 service nova] Releasing lock "refresh_cache-3d6a53c3-6e32-456c-a056-fbf1bef3b656" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:58:29 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:58:29 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:58:29 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:58:29 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:58:29 user nova-compute[71509]: DEBUG nova.compute.manager [req-e89db5e2-12da-4685-b08a-2768b509d8a6 req-ee7bc7b2-d403-4a12-8ca3-cdbd94462ce7 service nova] [instance: 3d6a53c3-6e32-456c-a056-fbf1bef3b656] Received event network-vif-plugged-c18cf2ba-f230-4684-a95c-14af689d7981 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:58:29 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-e89db5e2-12da-4685-b08a-2768b509d8a6 req-ee7bc7b2-d403-4a12-8ca3-cdbd94462ce7 service nova] Acquiring lock "3d6a53c3-6e32-456c-a056-fbf1bef3b656-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:58:29 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-e89db5e2-12da-4685-b08a-2768b509d8a6 req-ee7bc7b2-d403-4a12-8ca3-cdbd94462ce7 service nova] Lock "3d6a53c3-6e32-456c-a056-fbf1bef3b656-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:58:29 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-e89db5e2-12da-4685-b08a-2768b509d8a6 req-ee7bc7b2-d403-4a12-8ca3-cdbd94462ce7 service nova] Lock "3d6a53c3-6e32-456c-a056-fbf1bef3b656-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:58:29 user nova-compute[71509]: DEBUG nova.compute.manager [req-e89db5e2-12da-4685-b08a-2768b509d8a6 req-ee7bc7b2-d403-4a12-8ca3-cdbd94462ce7 service nova] [instance: 3d6a53c3-6e32-456c-a056-fbf1bef3b656] No waiting events found dispatching network-vif-plugged-c18cf2ba-f230-4684-a95c-14af689d7981 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:58:29 user nova-compute[71509]: WARNING nova.compute.manager [req-e89db5e2-12da-4685-b08a-2768b509d8a6 req-ee7bc7b2-d403-4a12-8ca3-cdbd94462ce7 service nova] [instance: 3d6a53c3-6e32-456c-a056-fbf1bef3b656] Received unexpected event network-vif-plugged-c18cf2ba-f230-4684-a95c-14af689d7981 for instance with vm_state building and task_state spawning.
Apr 14 10:58:31 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681469911.7131705, 3d6a53c3-6e32-456c-a056-fbf1bef3b656 => Resumed> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 10:58:31 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 3d6a53c3-6e32-456c-a056-fbf1bef3b656] VM Resumed (Lifecycle Event)
Apr 14 10:58:31 user nova-compute[71509]: DEBUG nova.compute.manager [None req-0f8575ce-f533-4dd9-a9c5-4d5ee9b84bd3 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] [instance: 3d6a53c3-6e32-456c-a056-fbf1bef3b656] Instance event wait completed in 0 seconds for  {{(pid=71509) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 10:58:31 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-0f8575ce-f533-4dd9-a9c5-4d5ee9b84bd3 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] [instance: 3d6a53c3-6e32-456c-a056-fbf1bef3b656] Guest created on hypervisor {{(pid=71509) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 10:58:31 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: 3d6a53c3-6e32-456c-a056-fbf1bef3b656] Instance spawned successfully.
Apr 14 10:58:31 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-0f8575ce-f533-4dd9-a9c5-4d5ee9b84bd3 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] [instance: 3d6a53c3-6e32-456c-a056-fbf1bef3b656] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 10:58:31 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-0f8575ce-f533-4dd9-a9c5-4d5ee9b84bd3 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] [instance: 3d6a53c3-6e32-456c-a056-fbf1bef3b656] Found default for hw_input_bus of None {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:58:31 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-0f8575ce-f533-4dd9-a9c5-4d5ee9b84bd3 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] [instance: 3d6a53c3-6e32-456c-a056-fbf1bef3b656] Found default for hw_pointer_model of None {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:58:31 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 3d6a53c3-6e32-456c-a056-fbf1bef3b656] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:58:31 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 3d6a53c3-6e32-456c-a056-fbf1bef3b656] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 10:58:31 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 3d6a53c3-6e32-456c-a056-fbf1bef3b656] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 10:58:31 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681469911.7146616, 3d6a53c3-6e32-456c-a056-fbf1bef3b656 => Started> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 10:58:31 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 3d6a53c3-6e32-456c-a056-fbf1bef3b656] VM Started (Lifecycle Event)
Apr 14 10:58:31 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 3d6a53c3-6e32-456c-a056-fbf1bef3b656] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:58:31 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 3d6a53c3-6e32-456c-a056-fbf1bef3b656] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 10:58:31 user nova-compute[71509]: INFO nova.compute.manager [None req-0f8575ce-f533-4dd9-a9c5-4d5ee9b84bd3 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] [instance: 3d6a53c3-6e32-456c-a056-fbf1bef3b656] Took 5.99 seconds to spawn the instance on the hypervisor.
Apr 14 10:58:31 user nova-compute[71509]: DEBUG nova.compute.manager [None req-0f8575ce-f533-4dd9-a9c5-4d5ee9b84bd3 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] [instance: 3d6a53c3-6e32-456c-a056-fbf1bef3b656] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:58:31 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 3d6a53c3-6e32-456c-a056-fbf1bef3b656] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 10:58:31 user nova-compute[71509]: DEBUG nova.compute.manager [req-b71d2559-3467-4812-a4b9-2d90813c7e88 req-f4f35a82-cf35-47cf-9fdd-9665057b5acc service nova] [instance: 3d6a53c3-6e32-456c-a056-fbf1bef3b656] Received event network-vif-plugged-c18cf2ba-f230-4684-a95c-14af689d7981 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:58:31 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-b71d2559-3467-4812-a4b9-2d90813c7e88 req-f4f35a82-cf35-47cf-9fdd-9665057b5acc service nova] Acquiring lock "3d6a53c3-6e32-456c-a056-fbf1bef3b656-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:58:31 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-b71d2559-3467-4812-a4b9-2d90813c7e88 req-f4f35a82-cf35-47cf-9fdd-9665057b5acc service nova] Lock "3d6a53c3-6e32-456c-a056-fbf1bef3b656-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:58:31 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-b71d2559-3467-4812-a4b9-2d90813c7e88 req-f4f35a82-cf35-47cf-9fdd-9665057b5acc service nova] Lock "3d6a53c3-6e32-456c-a056-fbf1bef3b656-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:58:31 user nova-compute[71509]: DEBUG nova.compute.manager [req-b71d2559-3467-4812-a4b9-2d90813c7e88 req-f4f35a82-cf35-47cf-9fdd-9665057b5acc service nova] [instance: 3d6a53c3-6e32-456c-a056-fbf1bef3b656] No waiting events found dispatching network-vif-plugged-c18cf2ba-f230-4684-a95c-14af689d7981 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:58:31 user nova-compute[71509]: WARNING nova.compute.manager [req-b71d2559-3467-4812-a4b9-2d90813c7e88 req-f4f35a82-cf35-47cf-9fdd-9665057b5acc service nova] [instance: 3d6a53c3-6e32-456c-a056-fbf1bef3b656] Received unexpected event network-vif-plugged-c18cf2ba-f230-4684-a95c-14af689d7981 for instance with vm_state building and task_state spawning.
Apr 14 10:58:31 user nova-compute[71509]: INFO nova.compute.manager [None req-0f8575ce-f533-4dd9-a9c5-4d5ee9b84bd3 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] [instance: 3d6a53c3-6e32-456c-a056-fbf1bef3b656] Took 6.84 seconds to build instance.
Apr 14 10:58:31 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-0f8575ce-f533-4dd9-a9c5-4d5ee9b84bd3 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "3d6a53c3-6e32-456c-a056-fbf1bef3b656" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.934s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:58:33 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:58:33 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:58:38 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:58:38 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:58:39 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:58:39 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:58:39 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71509) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 10:58:39 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:58:39 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Cleaning up deleted instances {{(pid=71509) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 14 10:58:39 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] There are 0 instances to clean {{(pid=71509) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 14 10:58:40 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:58:41 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:58:43 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:58:43 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:58:43 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:58:45 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:58:46 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:58:46 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:58:46 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:58:46 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71509) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 14 10:58:46 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-4a996323-50e0-4863-9173-b8b3ba094979 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Acquiring lock "ade9eacb-d4f9-406d-85c4-043037a4b6ba" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:58:46 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-4a996323-50e0-4863-9173-b8b3ba094979 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Lock "ade9eacb-d4f9-406d-85c4-043037a4b6ba" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:58:46 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-4a996323-50e0-4863-9173-b8b3ba094979 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Acquiring lock "ade9eacb-d4f9-406d-85c4-043037a4b6ba-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:58:46 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-4a996323-50e0-4863-9173-b8b3ba094979 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Lock "ade9eacb-d4f9-406d-85c4-043037a4b6ba-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:58:46 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-4a996323-50e0-4863-9173-b8b3ba094979 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Lock "ade9eacb-d4f9-406d-85c4-043037a4b6ba-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:58:46 user nova-compute[71509]: INFO nova.compute.manager [None req-4a996323-50e0-4863-9173-b8b3ba094979 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] [instance: ade9eacb-d4f9-406d-85c4-043037a4b6ba] Terminating instance
Apr 14 10:58:46 user nova-compute[71509]: DEBUG nova.compute.manager [None req-4a996323-50e0-4863-9173-b8b3ba094979 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] [instance: ade9eacb-d4f9-406d-85c4-043037a4b6ba] Start destroying the instance on the hypervisor. {{(pid=71509) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 10:58:46 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:58:46 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:58:46 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:58:46 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:58:47 user nova-compute[71509]: DEBUG nova.compute.manager [req-fa73b4aa-d915-4d3e-b1a9-82ff39b36640 req-0dc21684-e962-46eb-8852-0b64d4ce5148 service nova] [instance: ade9eacb-d4f9-406d-85c4-043037a4b6ba] Received event network-vif-unplugged-2d3b8886-7cd5-44ff-a36d-e576e7b0eabb {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:58:47 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-fa73b4aa-d915-4d3e-b1a9-82ff39b36640 req-0dc21684-e962-46eb-8852-0b64d4ce5148 service nova] Acquiring lock "ade9eacb-d4f9-406d-85c4-043037a4b6ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:58:47 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-fa73b4aa-d915-4d3e-b1a9-82ff39b36640 req-0dc21684-e962-46eb-8852-0b64d4ce5148 service nova] Lock "ade9eacb-d4f9-406d-85c4-043037a4b6ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:58:47 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-fa73b4aa-d915-4d3e-b1a9-82ff39b36640 req-0dc21684-e962-46eb-8852-0b64d4ce5148 service nova] Lock "ade9eacb-d4f9-406d-85c4-043037a4b6ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:58:47 user nova-compute[71509]: DEBUG nova.compute.manager [req-fa73b4aa-d915-4d3e-b1a9-82ff39b36640 req-0dc21684-e962-46eb-8852-0b64d4ce5148 service nova] [instance: ade9eacb-d4f9-406d-85c4-043037a4b6ba] No waiting events found dispatching network-vif-unplugged-2d3b8886-7cd5-44ff-a36d-e576e7b0eabb {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:58:47 user nova-compute[71509]: DEBUG nova.compute.manager [req-fa73b4aa-d915-4d3e-b1a9-82ff39b36640 req-0dc21684-e962-46eb-8852-0b64d4ce5148 service nova] [instance: ade9eacb-d4f9-406d-85c4-043037a4b6ba] Received event network-vif-unplugged-2d3b8886-7cd5-44ff-a36d-e576e7b0eabb for instance with task_state deleting. {{(pid=71509) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 10:58:47 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: ade9eacb-d4f9-406d-85c4-043037a4b6ba] Instance destroyed successfully.
Apr 14 10:58:47 user nova-compute[71509]: DEBUG nova.objects.instance [None req-4a996323-50e0-4863-9173-b8b3ba094979 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Lazy-loading 'resources' on Instance uuid ade9eacb-d4f9-406d-85c4-043037a4b6ba {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:58:47 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-4a996323-50e0-4863-9173-b8b3ba094979 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T10:56:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-810949699',display_name='tempest-ServersNegativeTestJSON-server-810949699',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-810949699',id=29,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T10:57:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='be1c0764b8a843808158644eb90704e6',ramdisk_id='',reservation_id='r-74z5pkh1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1472676568',owner_user_name='tempest-ServersNegativeTestJSON-1472676568-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T10:57:04Z,user_data=None,user_id='b3f2157c5d4d441db80ea4a3ca60e4dc',uuid=ade9eacb-d4f9-406d-85c4-043037a4b6ba,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2d3b8886-7cd5-44ff-a36d-e576e7b0eabb", "address": "fa:16:3e:4f:aa:d3", "network": {"id": "0d829782-2ea4-4af3-8460-468b818423dc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2082561441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be1c0764b8a843808158644eb90704e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d3b8886-7c", "ovs_interfaceid": "2d3b8886-7cd5-44ff-a36d-e576e7b0eabb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 10:58:47 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-4a996323-50e0-4863-9173-b8b3ba094979 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Converting VIF {"id": "2d3b8886-7cd5-44ff-a36d-e576e7b0eabb", "address": "fa:16:3e:4f:aa:d3", "network": {"id": "0d829782-2ea4-4af3-8460-468b818423dc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2082561441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be1c0764b8a843808158644eb90704e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d3b8886-7c", "ovs_interfaceid": "2d3b8886-7cd5-44ff-a36d-e576e7b0eabb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:58:47 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-4a996323-50e0-4863-9173-b8b3ba094979 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:aa:d3,bridge_name='br-int',has_traffic_filtering=True,id=2d3b8886-7cd5-44ff-a36d-e576e7b0eabb,network=Network(0d829782-2ea4-4af3-8460-468b818423dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d3b8886-7c') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:58:47 user nova-compute[71509]: DEBUG os_vif [None req-4a996323-50e0-4863-9173-b8b3ba094979 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:aa:d3,bridge_name='br-int',has_traffic_filtering=True,id=2d3b8886-7cd5-44ff-a36d-e576e7b0eabb,network=Network(0d829782-2ea4-4af3-8460-468b818423dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d3b8886-7c') {{(pid=71509) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 10:58:47 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:58:47 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2d3b8886-7c, bridge=br-int, if_exists=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:58:47 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:58:47 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:58:47 user nova-compute[71509]: INFO os_vif [None req-4a996323-50e0-4863-9173-b8b3ba094979 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:aa:d3,bridge_name='br-int',has_traffic_filtering=True,id=2d3b8886-7cd5-44ff-a36d-e576e7b0eabb,network=Network(0d829782-2ea4-4af3-8460-468b818423dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d3b8886-7c')
Apr 14 10:58:47 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-4a996323-50e0-4863-9173-b8b3ba094979 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] [instance: ade9eacb-d4f9-406d-85c4-043037a4b6ba] Deleting instance files /opt/stack/data/nova/instances/ade9eacb-d4f9-406d-85c4-043037a4b6ba_del
Apr 14 10:58:47 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-4a996323-50e0-4863-9173-b8b3ba094979 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] [instance: ade9eacb-d4f9-406d-85c4-043037a4b6ba] Deletion of /opt/stack/data/nova/instances/ade9eacb-d4f9-406d-85c4-043037a4b6ba_del complete
Apr 14 10:58:47 user nova-compute[71509]: INFO nova.compute.manager [None req-4a996323-50e0-4863-9173-b8b3ba094979 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] [instance: ade9eacb-d4f9-406d-85c4-043037a4b6ba] Took 0.80 seconds to destroy the instance on the hypervisor.
Apr 14 10:58:47 user nova-compute[71509]: DEBUG oslo.service.loopingcall [None req-4a996323-50e0-4863-9173-b8b3ba094979 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71509) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 10:58:47 user nova-compute[71509]: DEBUG nova.compute.manager [-] [instance: ade9eacb-d4f9-406d-85c4-043037a4b6ba] Deallocating network for instance {{(pid=71509) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 10:58:47 user nova-compute[71509]: DEBUG nova.network.neutron [-] [instance: ade9eacb-d4f9-406d-85c4-043037a4b6ba] deallocate_for_instance() {{(pid=71509) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 10:58:47 user nova-compute[71509]: DEBUG nova.network.neutron [-] [instance: ade9eacb-d4f9-406d-85c4-043037a4b6ba] Updating instance_info_cache with network_info: [] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:58:47 user nova-compute[71509]: INFO nova.compute.manager [-] [instance: ade9eacb-d4f9-406d-85c4-043037a4b6ba] Took 0.54 seconds to deallocate network for instance.
Apr 14 10:58:47 user nova-compute[71509]: DEBUG nova.compute.manager [req-964379fc-b09c-4e01-892b-e2ac1f91b204 req-506ce345-b0f1-4469-9b24-b563f4b9a4e9 service nova] [instance: ade9eacb-d4f9-406d-85c4-043037a4b6ba] Received event network-vif-deleted-2d3b8886-7cd5-44ff-a36d-e576e7b0eabb {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:58:47 user nova-compute[71509]: INFO nova.compute.manager [req-964379fc-b09c-4e01-892b-e2ac1f91b204 req-506ce345-b0f1-4469-9b24-b563f4b9a4e9 service nova] [instance: ade9eacb-d4f9-406d-85c4-043037a4b6ba] Neutron deleted interface 2d3b8886-7cd5-44ff-a36d-e576e7b0eabb; detaching it from the instance and deleting it from the info cache
Apr 14 10:58:47 user nova-compute[71509]: DEBUG nova.network.neutron [req-964379fc-b09c-4e01-892b-e2ac1f91b204 req-506ce345-b0f1-4469-9b24-b563f4b9a4e9 service nova] [instance: ade9eacb-d4f9-406d-85c4-043037a4b6ba] Updating instance_info_cache with network_info: [] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:58:47 user nova-compute[71509]: DEBUG nova.compute.manager [req-964379fc-b09c-4e01-892b-e2ac1f91b204 req-506ce345-b0f1-4469-9b24-b563f4b9a4e9 service nova] [instance: ade9eacb-d4f9-406d-85c4-043037a4b6ba] Detach interface failed, port_id=2d3b8886-7cd5-44ff-a36d-e576e7b0eabb, reason: Instance ade9eacb-d4f9-406d-85c4-043037a4b6ba could not be found. {{(pid=71509) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 10:58:47 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-4a996323-50e0-4863-9173-b8b3ba094979 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:58:47 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-4a996323-50e0-4863-9173-b8b3ba094979 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:58:48 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:58:48 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-4a996323-50e0-4863-9173-b8b3ba094979 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 10:58:48 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-4a996323-50e0-4863-9173-b8b3ba094979 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 10:58:48 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-4a996323-50e0-4863-9173-b8b3ba094979 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.451s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:58:48 user nova-compute[71509]: INFO nova.scheduler.client.report [None req-4a996323-50e0-4863-9173-b8b3ba094979 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Deleted allocations for instance ade9eacb-d4f9-406d-85c4-043037a4b6ba
Apr 14 10:58:48 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-4a996323-50e0-4863-9173-b8b3ba094979 tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Lock "ade9eacb-d4f9-406d-85c4-043037a4b6ba" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.976s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:58:49 user nova-compute[71509]: DEBUG nova.compute.manager [req-60d06d05-a465-41b8-b4ab-3c56aaf65dfe req-2dcaf530-c0b4-4b69-b201-6a752bf0233d service nova] [instance: ade9eacb-d4f9-406d-85c4-043037a4b6ba] Received event network-vif-plugged-2d3b8886-7cd5-44ff-a36d-e576e7b0eabb {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:58:49 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-60d06d05-a465-41b8-b4ab-3c56aaf65dfe req-2dcaf530-c0b4-4b69-b201-6a752bf0233d service nova] Acquiring lock "ade9eacb-d4f9-406d-85c4-043037a4b6ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:58:49 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-60d06d05-a465-41b8-b4ab-3c56aaf65dfe req-2dcaf530-c0b4-4b69-b201-6a752bf0233d service nova] Lock "ade9eacb-d4f9-406d-85c4-043037a4b6ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:58:49 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-60d06d05-a465-41b8-b4ab-3c56aaf65dfe req-2dcaf530-c0b4-4b69-b201-6a752bf0233d service nova] Lock "ade9eacb-d4f9-406d-85c4-043037a4b6ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:58:49 user nova-compute[71509]: DEBUG nova.compute.manager [req-60d06d05-a465-41b8-b4ab-3c56aaf65dfe req-2dcaf530-c0b4-4b69-b201-6a752bf0233d service nova] [instance: ade9eacb-d4f9-406d-85c4-043037a4b6ba] No waiting events found dispatching network-vif-plugged-2d3b8886-7cd5-44ff-a36d-e576e7b0eabb {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:58:49 user nova-compute[71509]: WARNING nova.compute.manager [req-60d06d05-a465-41b8-b4ab-3c56aaf65dfe req-2dcaf530-c0b4-4b69-b201-6a752bf0233d service nova] [instance: ade9eacb-d4f9-406d-85c4-043037a4b6ba] Received unexpected event network-vif-plugged-2d3b8886-7cd5-44ff-a36d-e576e7b0eabb for instance with vm_state deleted and task_state None.
Apr 14 10:58:49 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:58:49 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-388d1506-a572-48ab-829b-ad8fd611af15 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Acquiring lock "fbcca78c-fe73-4ef1-92f9-4c8061cad177" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:58:49 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-388d1506-a572-48ab-829b-ad8fd611af15 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "fbcca78c-fe73-4ef1-92f9-4c8061cad177" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:58:49 user nova-compute[71509]: DEBUG nova.compute.manager [None req-388d1506-a572-48ab-829b-ad8fd611af15 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] Starting instance... {{(pid=71509) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 10:58:49 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-388d1506-a572-48ab-829b-ad8fd611af15 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:58:49 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-388d1506-a572-48ab-829b-ad8fd611af15 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:58:49 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-388d1506-a572-48ab-829b-ad8fd611af15 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71509) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 10:58:49 user nova-compute[71509]: INFO nova.compute.claims [None req-388d1506-a572-48ab-829b-ad8fd611af15 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] Claim successful on node user
Apr 14 10:58:49 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-bb2c547b-6841-464e-8cbf-9d0f1f24186d tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Acquiring lock "97820f17-22d1-4ec3-9721-1edadccc794a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:58:49 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-bb2c547b-6841-464e-8cbf-9d0f1f24186d tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "97820f17-22d1-4ec3-9721-1edadccc794a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:58:49 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-bb2c547b-6841-464e-8cbf-9d0f1f24186d tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Acquiring lock "97820f17-22d1-4ec3-9721-1edadccc794a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:58:49 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-bb2c547b-6841-464e-8cbf-9d0f1f24186d tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "97820f17-22d1-4ec3-9721-1edadccc794a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:58:49 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-bb2c547b-6841-464e-8cbf-9d0f1f24186d tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "97820f17-22d1-4ec3-9721-1edadccc794a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:58:49 user nova-compute[71509]: INFO nova.compute.manager [None req-bb2c547b-6841-464e-8cbf-9d0f1f24186d tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: 97820f17-22d1-4ec3-9721-1edadccc794a] Terminating instance
Apr 14 10:58:49 user nova-compute[71509]: DEBUG nova.compute.manager [None req-bb2c547b-6841-464e-8cbf-9d0f1f24186d tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: 97820f17-22d1-4ec3-9721-1edadccc794a] Start destroying the instance on the hypervisor. {{(pid=71509) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 10:58:50 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:58:50 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:58:50 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-388d1506-a572-48ab-829b-ad8fd611af15 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 10:58:50 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:58:50 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-388d1506-a572-48ab-829b-ad8fd611af15 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 10:58:50 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:58:50 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Starting heal instance info cache {{(pid=71509) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 10:58:50 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-388d1506-a572-48ab-829b-ad8fd611af15 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.658s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:58:50 user nova-compute[71509]: DEBUG nova.compute.manager [None req-388d1506-a572-48ab-829b-ad8fd611af15 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] Start building networks asynchronously for instance. {{(pid=71509) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 10:58:50 user nova-compute[71509]: DEBUG nova.compute.manager [None req-388d1506-a572-48ab-829b-ad8fd611af15 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] Allocating IP information in the background. {{(pid=71509) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 10:58:50 user nova-compute[71509]: DEBUG nova.network.neutron [None req-388d1506-a572-48ab-829b-ad8fd611af15 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] allocate_for_instance() {{(pid=71509) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 10:58:50 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "refresh_cache-6cae9f61-763f-4671-a873-d15f01384416" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:58:50 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquired lock "refresh_cache-6cae9f61-763f-4671-a873-d15f01384416" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:58:50 user nova-compute[71509]: DEBUG nova.network.neutron [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] [instance: 6cae9f61-763f-4671-a873-d15f01384416] Forcefully refreshing network info cache for instance {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 10:58:50 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-388d1506-a572-48ab-829b-ad8fd611af15 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 10:58:50 user nova-compute[71509]: DEBUG nova.compute.manager [None req-388d1506-a572-48ab-829b-ad8fd611af15 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] Start building block device mappings for instance. {{(pid=71509) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 10:58:50 user nova-compute[71509]: INFO nova.virt.block_device [None req-388d1506-a572-48ab-829b-ad8fd611af15 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] Booting with volume-backed-image 048ec0ee-0465-448d-8b4c-f072acb101dc at /dev/vda
Apr 14 10:58:50 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: 97820f17-22d1-4ec3-9721-1edadccc794a] Instance destroyed successfully.
Apr 14 10:58:50 user nova-compute[71509]: DEBUG nova.objects.instance [None req-bb2c547b-6841-464e-8cbf-9d0f1f24186d tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lazy-loading 'resources' on Instance uuid 97820f17-22d1-4ec3-9721-1edadccc794a {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:58:50 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-bb2c547b-6841-464e-8cbf-9d0f1f24186d tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T10:42:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-97128358',display_name='tempest-ServerRescueNegativeTestJSON-server-97128358',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-97128358',id=3,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T10:44:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bf93e5dac50342d0b65ef09711401e99',ramdisk_id='',reservation_id='r-1drc6j5k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-563868574',owner_user_name='tempest-ServerRescueNegativeTestJSON-563868574-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T10:44:41Z,user_data=None,user_id='e359578dcbb24755a216415053d415ef',uuid=97820f17-22d1-4ec3-9721-1edadccc794a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "dea3830d-9f49-4d5e-953b-eec2ee969b02", "address": "fa:16:3e:77:58:9a", "network": {"id": "22eb5f87-be4d-447d-bafe-25e0284ea3ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-787804772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf93e5dac50342d0b65ef09711401e99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdea3830d-9f", "ovs_interfaceid": "dea3830d-9f49-4d5e-953b-eec2ee969b02", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 10:58:50 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-bb2c547b-6841-464e-8cbf-9d0f1f24186d tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Converting VIF {"id": "dea3830d-9f49-4d5e-953b-eec2ee969b02", "address": "fa:16:3e:77:58:9a", "network": {"id": "22eb5f87-be4d-447d-bafe-25e0284ea3ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-787804772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf93e5dac50342d0b65ef09711401e99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdea3830d-9f", "ovs_interfaceid": "dea3830d-9f49-4d5e-953b-eec2ee969b02", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:58:50 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-bb2c547b-6841-464e-8cbf-9d0f1f24186d tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:77:58:9a,bridge_name='br-int',has_traffic_filtering=True,id=dea3830d-9f49-4d5e-953b-eec2ee969b02,network=Network(22eb5f87-be4d-447d-bafe-25e0284ea3ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdea3830d-9f') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:58:50 user nova-compute[71509]: DEBUG os_vif [None req-bb2c547b-6841-464e-8cbf-9d0f1f24186d tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:77:58:9a,bridge_name='br-int',has_traffic_filtering=True,id=dea3830d-9f49-4d5e-953b-eec2ee969b02,network=Network(22eb5f87-be4d-447d-bafe-25e0284ea3ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdea3830d-9f') {{(pid=71509) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 10:58:50 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:58:50 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdea3830d-9f, bridge=br-int, if_exists=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:58:50 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:58:50 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:58:50 user nova-compute[71509]: INFO os_vif [None req-bb2c547b-6841-464e-8cbf-9d0f1f24186d tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:77:58:9a,bridge_name='br-int',has_traffic_filtering=True,id=dea3830d-9f49-4d5e-953b-eec2ee969b02,network=Network(22eb5f87-be4d-447d-bafe-25e0284ea3ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdea3830d-9f')
Apr 14 10:58:50 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-bb2c547b-6841-464e-8cbf-9d0f1f24186d tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: 97820f17-22d1-4ec3-9721-1edadccc794a] Deleting instance files /opt/stack/data/nova/instances/97820f17-22d1-4ec3-9721-1edadccc794a_del
Apr 14 10:58:50 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-bb2c547b-6841-464e-8cbf-9d0f1f24186d tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: 97820f17-22d1-4ec3-9721-1edadccc794a] Deletion of /opt/stack/data/nova/instances/97820f17-22d1-4ec3-9721-1edadccc794a_del complete
Apr 14 10:58:50 user nova-compute[71509]: INFO nova.compute.manager [None req-bb2c547b-6841-464e-8cbf-9d0f1f24186d tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: 97820f17-22d1-4ec3-9721-1edadccc794a] Took 0.92 seconds to destroy the instance on the hypervisor.
Apr 14 10:58:50 user nova-compute[71509]: DEBUG oslo.service.loopingcall [None req-bb2c547b-6841-464e-8cbf-9d0f1f24186d tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71509) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 10:58:50 user nova-compute[71509]: DEBUG nova.compute.manager [-] [instance: 97820f17-22d1-4ec3-9721-1edadccc794a] Deallocating network for instance {{(pid=71509) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 10:58:50 user nova-compute[71509]: DEBUG nova.network.neutron [-] [instance: 97820f17-22d1-4ec3-9721-1edadccc794a] deallocate_for_instance() {{(pid=71509) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 10:58:51 user nova-compute[71509]: DEBUG nova.compute.manager [req-519fbf21-8fd2-4418-8a40-26ff8f48c645 req-5e1804d6-202b-42bc-85c1-4acf490c9641 service nova] [instance: 97820f17-22d1-4ec3-9721-1edadccc794a] Received event network-vif-unplugged-dea3830d-9f49-4d5e-953b-eec2ee969b02 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:58:51 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-519fbf21-8fd2-4418-8a40-26ff8f48c645 req-5e1804d6-202b-42bc-85c1-4acf490c9641 service nova] Acquiring lock "97820f17-22d1-4ec3-9721-1edadccc794a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:58:51 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-519fbf21-8fd2-4418-8a40-26ff8f48c645 req-5e1804d6-202b-42bc-85c1-4acf490c9641 service nova] Lock "97820f17-22d1-4ec3-9721-1edadccc794a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:58:51 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-519fbf21-8fd2-4418-8a40-26ff8f48c645 req-5e1804d6-202b-42bc-85c1-4acf490c9641 service nova] Lock "97820f17-22d1-4ec3-9721-1edadccc794a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:58:51 user nova-compute[71509]: DEBUG nova.compute.manager [req-519fbf21-8fd2-4418-8a40-26ff8f48c645 req-5e1804d6-202b-42bc-85c1-4acf490c9641 service nova] [instance: 97820f17-22d1-4ec3-9721-1edadccc794a] No waiting events found dispatching network-vif-unplugged-dea3830d-9f49-4d5e-953b-eec2ee969b02 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:58:51 user nova-compute[71509]: DEBUG nova.compute.manager [req-519fbf21-8fd2-4418-8a40-26ff8f48c645 req-5e1804d6-202b-42bc-85c1-4acf490c9641 service nova] [instance: 97820f17-22d1-4ec3-9721-1edadccc794a] Received event network-vif-unplugged-dea3830d-9f49-4d5e-953b-eec2ee969b02 for instance with task_state deleting. {{(pid=71509) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 10:58:51 user nova-compute[71509]: DEBUG nova.compute.manager [req-519fbf21-8fd2-4418-8a40-26ff8f48c645 req-5e1804d6-202b-42bc-85c1-4acf490c9641 service nova] [instance: 97820f17-22d1-4ec3-9721-1edadccc794a] Received event network-vif-plugged-dea3830d-9f49-4d5e-953b-eec2ee969b02 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:58:51 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-519fbf21-8fd2-4418-8a40-26ff8f48c645 req-5e1804d6-202b-42bc-85c1-4acf490c9641 service nova] Acquiring lock "97820f17-22d1-4ec3-9721-1edadccc794a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:58:51 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-519fbf21-8fd2-4418-8a40-26ff8f48c645 req-5e1804d6-202b-42bc-85c1-4acf490c9641 service nova] Lock "97820f17-22d1-4ec3-9721-1edadccc794a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:58:51 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-519fbf21-8fd2-4418-8a40-26ff8f48c645 req-5e1804d6-202b-42bc-85c1-4acf490c9641 service nova] Lock "97820f17-22d1-4ec3-9721-1edadccc794a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:58:51 user nova-compute[71509]: DEBUG nova.compute.manager [req-519fbf21-8fd2-4418-8a40-26ff8f48c645 req-5e1804d6-202b-42bc-85c1-4acf490c9641 service nova] [instance: 97820f17-22d1-4ec3-9721-1edadccc794a] No waiting events found dispatching network-vif-plugged-dea3830d-9f49-4d5e-953b-eec2ee969b02 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:58:51 user nova-compute[71509]: WARNING nova.compute.manager [req-519fbf21-8fd2-4418-8a40-26ff8f48c645 req-5e1804d6-202b-42bc-85c1-4acf490c9641 service nova] [instance: 97820f17-22d1-4ec3-9721-1edadccc794a] Received unexpected event network-vif-plugged-dea3830d-9f49-4d5e-953b-eec2ee969b02 for instance with vm_state rescued and task_state deleting.
Apr 14 10:58:51 user nova-compute[71509]: DEBUG nova.policy [None req-388d1506-a572-48ab-829b-ad8fd611af15 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '395bc9d7007c4e01ac7effd418bcea19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71289f80a05141f482cb538dac3d7b38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71509) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 10:58:51 user nova-compute[71509]: DEBUG nova.network.neutron [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] [instance: 6cae9f61-763f-4671-a873-d15f01384416] Updating instance_info_cache with network_info: [{"id": "30d57100-3321-41fe-9335-d53c8c5e291c", "address": "fa:16:3e:57:7d:4b", "network": {"id": "07f1f39e-292a-4e73-b4ed-99e5799d6fa8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1339551596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71289f80a05141f482cb538dac3d7b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30d57100-33", "ovs_interfaceid": "30d57100-3321-41fe-9335-d53c8c5e291c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:58:51 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Releasing lock "refresh_cache-6cae9f61-763f-4671-a873-d15f01384416" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:58:51 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] [instance: 6cae9f61-763f-4671-a873-d15f01384416] Updated the network info_cache for instance {{(pid=71509) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 10:58:51 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:58:51 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:58:51 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:58:51 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:58:51 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Auditing locally available compute resources for user (node: user) {{(pid=71509) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 10:58:51 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bb99276-64ba-4641-8869-3f35eea2f76e/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:58:51 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bb99276-64ba-4641-8869-3f35eea2f76e/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:58:51 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bb99276-64ba-4641-8869-3f35eea2f76e/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:58:51 user nova-compute[71509]: DEBUG nova.network.neutron [None req-388d1506-a572-48ab-829b-ad8fd611af15 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] Successfully created port: 845cc40f-1b03-4b85-8d19-fea731fe7f89 {{(pid=71509) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 10:58:51 user nova-compute[71509]: DEBUG nova.network.neutron [-] [instance: 97820f17-22d1-4ec3-9721-1edadccc794a] Updating instance_info_cache with network_info: [] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:58:51 user nova-compute[71509]: DEBUG nova.compute.manager [req-88cb3257-8b15-41a0-8274-d5614ba9e364 req-58055a9f-0c34-48c2-ae35-d5dc4847b315 service nova] [instance: 97820f17-22d1-4ec3-9721-1edadccc794a] Received event network-vif-deleted-dea3830d-9f49-4d5e-953b-eec2ee969b02 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:58:51 user nova-compute[71509]: INFO nova.compute.manager [req-88cb3257-8b15-41a0-8274-d5614ba9e364 req-58055a9f-0c34-48c2-ae35-d5dc4847b315 service nova] [instance: 97820f17-22d1-4ec3-9721-1edadccc794a] Neutron deleted interface dea3830d-9f49-4d5e-953b-eec2ee969b02; detaching it from the instance and deleting it from the info cache
Apr 14 10:58:51 user nova-compute[71509]: DEBUG nova.network.neutron [req-88cb3257-8b15-41a0-8274-d5614ba9e364 req-58055a9f-0c34-48c2-ae35-d5dc4847b315 service nova] [instance: 97820f17-22d1-4ec3-9721-1edadccc794a] Updating instance_info_cache with network_info: [] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:58:51 user nova-compute[71509]: INFO nova.compute.manager [-] [instance: 97820f17-22d1-4ec3-9721-1edadccc794a] Took 1.04 seconds to deallocate network for instance.
Apr 14 10:58:51 user nova-compute[71509]: DEBUG nova.compute.manager [req-88cb3257-8b15-41a0-8274-d5614ba9e364 req-58055a9f-0c34-48c2-ae35-d5dc4847b315 service nova] [instance: 97820f17-22d1-4ec3-9721-1edadccc794a] Detach interface failed, port_id=dea3830d-9f49-4d5e-953b-eec2ee969b02, reason: Instance 97820f17-22d1-4ec3-9721-1edadccc794a could not be found. {{(pid=71509) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 10:58:51 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-bb2c547b-6841-464e-8cbf-9d0f1f24186d tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:58:51 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-bb2c547b-6841-464e-8cbf-9d0f1f24186d tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:58:51 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bb99276-64ba-4641-8869-3f35eea2f76e/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:58:51 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef413492-c781-459e-b99c-46a530034c94/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:58:52 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-bb2c547b-6841-464e-8cbf-9d0f1f24186d tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Refreshing inventories for resource provider 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 14 10:58:52 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef413492-c781-459e-b99c-46a530034c94/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:58:52 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef413492-c781-459e-b99c-46a530034c94/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:58:52 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-bb2c547b-6841-464e-8cbf-9d0f1f24186d tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Updating ProviderTree inventory for provider 52209f7e-594e-4cf4-9018-18636056cd6b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 14 10:58:52 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-bb2c547b-6841-464e-8cbf-9d0f1f24186d tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Updating inventory in ProviderTree for provider 52209f7e-594e-4cf4-9018-18636056cd6b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 14 10:58:52 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-bb2c547b-6841-464e-8cbf-9d0f1f24186d tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Refreshing aggregate associations for resource provider 52209f7e-594e-4cf4-9018-18636056cd6b, aggregates: None {{(pid=71509) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 14 10:58:52 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-bb2c547b-6841-464e-8cbf-9d0f1f24186d tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Refreshing trait associations for resource provider 52209f7e-594e-4cf4-9018-18636056cd6b, traits: COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE42,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_SATA {{(pid=71509) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 14 10:58:52 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef413492-c781-459e-b99c-46a530034c94/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:58:52 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6580716-8a6a-4dfa-8978-ed54b92af1fe/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:58:52 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6580716-8a6a-4dfa-8978-ed54b92af1fe/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:58:52 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6580716-8a6a-4dfa-8978-ed54b92af1fe/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:58:52 user nova-compute[71509]: DEBUG nova.network.neutron [None req-388d1506-a572-48ab-829b-ad8fd611af15 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] Successfully updated port: 845cc40f-1b03-4b85-8d19-fea731fe7f89 {{(pid=71509) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 10:58:52 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6580716-8a6a-4dfa-8978-ed54b92af1fe/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:58:52 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-388d1506-a572-48ab-829b-ad8fd611af15 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Acquiring lock "refresh_cache-fbcca78c-fe73-4ef1-92f9-4c8061cad177" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:58:52 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-388d1506-a572-48ab-829b-ad8fd611af15 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Acquired lock "refresh_cache-fbcca78c-fe73-4ef1-92f9-4c8061cad177" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:58:52 user nova-compute[71509]: DEBUG nova.network.neutron [None req-388d1506-a572-48ab-829b-ad8fd611af15 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] Building network info cache for instance {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 10:58:52 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e479154a-acd6-47aa-9a5b-43c6e0feda07/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:58:52 user nova-compute[71509]: DEBUG nova.network.neutron [None req-388d1506-a572-48ab-829b-ad8fd611af15 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] Instance cache missing network info. {{(pid=71509) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 10:58:52 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-bb2c547b-6841-464e-8cbf-9d0f1f24186d tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 10:58:52 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-bb2c547b-6841-464e-8cbf-9d0f1f24186d tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 10:58:52 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e479154a-acd6-47aa-9a5b-43c6e0feda07/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:58:52 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e479154a-acd6-47aa-9a5b-43c6e0feda07/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:58:52 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-bb2c547b-6841-464e-8cbf-9d0f1f24186d tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.857s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:58:52 user nova-compute[71509]: INFO nova.scheduler.client.report [None req-bb2c547b-6841-464e-8cbf-9d0f1f24186d tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Deleted allocations for instance 97820f17-22d1-4ec3-9721-1edadccc794a
Apr 14 10:58:52 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e479154a-acd6-47aa-9a5b-43c6e0feda07/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:58:52 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f41f217-0df2-4205-9633-7dbe83f40c96/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:58:52 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-bb2c547b-6841-464e-8cbf-9d0f1f24186d tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "97820f17-22d1-4ec3-9721-1edadccc794a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.065s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:58:53 user nova-compute[71509]: DEBUG nova.network.neutron [None req-388d1506-a572-48ab-829b-ad8fd611af15 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] Updating instance_info_cache with network_info: [{"id": "845cc40f-1b03-4b85-8d19-fea731fe7f89", "address": "fa:16:3e:45:59:73", "network": {"id": "07f1f39e-292a-4e73-b4ed-99e5799d6fa8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1339551596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71289f80a05141f482cb538dac3d7b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap845cc40f-1b", "ovs_interfaceid": "845cc40f-1b03-4b85-8d19-fea731fe7f89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:58:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f41f217-0df2-4205-9633-7dbe83f40c96/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:58:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f41f217-0df2-4205-9633-7dbe83f40c96/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:58:53 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-388d1506-a572-48ab-829b-ad8fd611af15 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Releasing lock "refresh_cache-fbcca78c-fe73-4ef1-92f9-4c8061cad177" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:58:53 user nova-compute[71509]: DEBUG nova.compute.manager [None req-388d1506-a572-48ab-829b-ad8fd611af15 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] Instance network_info: |[{"id": "845cc40f-1b03-4b85-8d19-fea731fe7f89", "address": "fa:16:3e:45:59:73", "network": {"id": "07f1f39e-292a-4e73-b4ed-99e5799d6fa8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1339551596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71289f80a05141f482cb538dac3d7b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap845cc40f-1b", "ovs_interfaceid": "845cc40f-1b03-4b85-8d19-fea731fe7f89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71509) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 10:58:53 user nova-compute[71509]: DEBUG nova.compute.manager [req-f861e460-710a-428e-bd9f-a1ddcedbda95 req-2c4f3c47-fa0c-4add-9db4-5cdff7d92224 service nova] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] Received event network-changed-845cc40f-1b03-4b85-8d19-fea731fe7f89 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:58:53 user nova-compute[71509]: DEBUG nova.compute.manager [req-f861e460-710a-428e-bd9f-a1ddcedbda95 req-2c4f3c47-fa0c-4add-9db4-5cdff7d92224 service nova] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] Refreshing instance network info cache due to event network-changed-845cc40f-1b03-4b85-8d19-fea731fe7f89. {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 10:58:53 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-f861e460-710a-428e-bd9f-a1ddcedbda95 req-2c4f3c47-fa0c-4add-9db4-5cdff7d92224 service nova] Acquiring lock "refresh_cache-fbcca78c-fe73-4ef1-92f9-4c8061cad177" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:58:53 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-f861e460-710a-428e-bd9f-a1ddcedbda95 req-2c4f3c47-fa0c-4add-9db4-5cdff7d92224 service nova] Acquired lock "refresh_cache-fbcca78c-fe73-4ef1-92f9-4c8061cad177" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:58:53 user nova-compute[71509]: DEBUG nova.network.neutron [req-f861e460-710a-428e-bd9f-a1ddcedbda95 req-2c4f3c47-fa0c-4add-9db4-5cdff7d92224 service nova] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] Refreshing network info cache for port 845cc40f-1b03-4b85-8d19-fea731fe7f89 {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 10:58:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f41f217-0df2-4205-9633-7dbe83f40c96/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:58:53 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71509) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 10:58:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97f20661-8b60-439e-b7af-2fc2013c5ade/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:58:53 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:58:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97f20661-8b60-439e-b7af-2fc2013c5ade/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:58:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97f20661-8b60-439e-b7af-2fc2013c5ade/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:58:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97f20661-8b60-439e-b7af-2fc2013c5ade/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:58:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe152ebd-4f99-4fa8-bfdb-8744cdf3f387/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:58:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe152ebd-4f99-4fa8-bfdb-8744cdf3f387/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:58:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe152ebd-4f99-4fa8-bfdb-8744cdf3f387/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:58:53 user nova-compute[71509]: DEBUG nova.network.neutron [req-f861e460-710a-428e-bd9f-a1ddcedbda95 req-2c4f3c47-fa0c-4add-9db4-5cdff7d92224 service nova] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] Updated VIF entry in instance network info cache for port 845cc40f-1b03-4b85-8d19-fea731fe7f89. {{(pid=71509) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 10:58:53 user nova-compute[71509]: DEBUG nova.network.neutron [req-f861e460-710a-428e-bd9f-a1ddcedbda95 req-2c4f3c47-fa0c-4add-9db4-5cdff7d92224 service nova] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] Updating instance_info_cache with network_info: [{"id": "845cc40f-1b03-4b85-8d19-fea731fe7f89", "address": "fa:16:3e:45:59:73", "network": {"id": "07f1f39e-292a-4e73-b4ed-99e5799d6fa8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1339551596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71289f80a05141f482cb538dac3d7b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap845cc40f-1b", "ovs_interfaceid": "845cc40f-1b03-4b85-8d19-fea731fe7f89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:58:53 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-f861e460-710a-428e-bd9f-a1ddcedbda95 req-2c4f3c47-fa0c-4add-9db4-5cdff7d92224 service nova] Releasing lock "refresh_cache-fbcca78c-fe73-4ef1-92f9-4c8061cad177" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:58:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe152ebd-4f99-4fa8-bfdb-8744cdf3f387/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:58:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a936fb20-3f17-4114-829a-8659da6bc5f3/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:58:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a936fb20-3f17-4114-829a-8659da6bc5f3/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:58:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a936fb20-3f17-4114-829a-8659da6bc5f3/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:58:54 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a936fb20-3f17-4114-829a-8659da6bc5f3/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:58:54 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dd9e11f-1fed-42af-ad5c-9cdd051b93e7/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:58:54 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dd9e11f-1fed-42af-ad5c-9cdd051b93e7/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:58:54 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dd9e11f-1fed-42af-ad5c-9cdd051b93e7/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:58:54 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dd9e11f-1fed-42af-ad5c-9cdd051b93e7/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:58:54 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d6a53c3-6e32-456c-a056-fbf1bef3b656/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:58:54 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d6a53c3-6e32-456c-a056-fbf1bef3b656/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:58:54 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d6a53c3-6e32-456c-a056-fbf1bef3b656/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:58:54 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d6a53c3-6e32-456c-a056-fbf1bef3b656/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:58:55 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:58:55 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:58:55 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Hypervisor/Node resource view: name=user free_ram=7547MB free_disk=25.82278823852539GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71509) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 10:58:55 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:58:55 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:58:55 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 97f20661-8b60-439e-b7af-2fc2013c5ade actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:58:55 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance e479154a-acd6-47aa-9a5b-43c6e0feda07 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:58:55 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 6cae9f61-763f-4671-a873-d15f01384416 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:58:55 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 6f41f217-0df2-4205-9633-7dbe83f40c96 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:58:55 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance e6580716-8a6a-4dfa-8978-ed54b92af1fe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:58:55 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance a936fb20-3f17-4114-829a-8659da6bc5f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:58:55 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance fe152ebd-4f99-4fa8-bfdb-8744cdf3f387 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:58:55 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 0dd9e11f-1fed-42af-ad5c-9cdd051b93e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:58:55 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 0bb99276-64ba-4641-8869-3f35eea2f76e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:58:55 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance ef413492-c781-459e-b99c-46a530034c94 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:58:55 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 3d6a53c3-6e32-456c-a056-fbf1bef3b656 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:58:55 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance fbcca78c-fe73-4ef1-92f9-4c8061cad177 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:58:55 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=71509) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 10:58:55 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Final resource view: name=user phys_ram=16023MB used_ram=2048MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=71509) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 10:58:55 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 10:58:55 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 10:58:55 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:58:55 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Compute_service record updated for user:user {{(pid=71509) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 10:58:55 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.638s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:58:56 user nova-compute[71509]: DEBUG os_brick.utils [None req-388d1506-a572-48ab-829b-ad8fd611af15 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 10:58:56 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:58:56 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:58:56 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c25ddd9-a26c-4576-9774-5eef30fca7dd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50119df3c417\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:58:56 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:58:56 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:58:56 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fcf53a6-0da0-4c92-8783-2644a0763ee5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:58:56 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:58:56 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:58:56 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[52a17684-4b3f-4184-9b49-fcbfb9d4f447]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:58:56 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[7db10292-5628-4d2a-9c16-bae196643447]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:58:56 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-388d1506-a572-48ab-829b-ad8fd611af15 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Running cmd (subprocess): nvme version {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:58:56 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-388d1506-a572-48ab-829b-ad8fd611af15 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] 'nvme version' failed. Not Retrying. {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 10:58:56 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.nvmeof [None req-388d1506-a572-48ab-829b-ad8fd611af15 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] nvme not present on system {{(pid=71509) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 10:58:56 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:58:56 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 10:58:56 user nova-compute[71509]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 10:58:56 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[fadb9847-9c48-46ce-b6d1-93b3ed7610a7]: (4, '') {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:58:56 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-388d1506-a572-48ab-829b-ad8fd611af15 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71509) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 10:58:56 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-388d1506-a572-48ab-829b-ad8fd611af15 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71509) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 10:58:56 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-388d1506-a572-48ab-829b-ad8fd611af15 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] LIGHTOS: no hostnqn found. {{(pid=71509) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 10:58:56 user nova-compute[71509]: DEBUG os_brick.utils [None req-388d1506-a572-48ab-829b-ad8fd611af15 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50119df3c417', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 10:58:56 user nova-compute[71509]: DEBUG nova.virt.block_device [None req-388d1506-a572-48ab-829b-ad8fd611af15 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] Updating existing volume attachment record: deefa7ce-3b9b-4649-873b-96abadaf35b8 {{(pid=71509) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 10:58:57 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-9f734ee0-95cb-48fd-87a5-416bcb93e4fb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Acquiring lock "fe152ebd-4f99-4fa8-bfdb-8744cdf3f387" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:58:57 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-9f734ee0-95cb-48fd-87a5-416bcb93e4fb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "fe152ebd-4f99-4fa8-bfdb-8744cdf3f387" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:58:57 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-9f734ee0-95cb-48fd-87a5-416bcb93e4fb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Acquiring lock "fe152ebd-4f99-4fa8-bfdb-8744cdf3f387-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:58:57 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-9f734ee0-95cb-48fd-87a5-416bcb93e4fb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "fe152ebd-4f99-4fa8-bfdb-8744cdf3f387-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:58:57 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-9f734ee0-95cb-48fd-87a5-416bcb93e4fb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "fe152ebd-4f99-4fa8-bfdb-8744cdf3f387-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:58:57 user nova-compute[71509]: INFO nova.compute.manager [None req-9f734ee0-95cb-48fd-87a5-416bcb93e4fb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] Terminating instance
Apr 14 10:58:57 user nova-compute[71509]: DEBUG nova.compute.manager [None req-9f734ee0-95cb-48fd-87a5-416bcb93e4fb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] Start destroying the instance on the hypervisor. {{(pid=71509) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 10:58:57 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:58:57 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:58:57 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:58:57 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:58:58 user nova-compute[71509]: DEBUG nova.compute.manager [req-6a531573-a405-41e4-bb64-a0ce3738f879 req-b247fb0f-3e41-4d96-805d-8930c4bf71df service nova] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] Received event network-vif-unplugged-1a142b11-f1ec-41d4-9728-f9f0de9a96ff {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:58:58 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-6a531573-a405-41e4-bb64-a0ce3738f879 req-b247fb0f-3e41-4d96-805d-8930c4bf71df service nova] Acquiring lock "fe152ebd-4f99-4fa8-bfdb-8744cdf3f387-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:58:58 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-6a531573-a405-41e4-bb64-a0ce3738f879 req-b247fb0f-3e41-4d96-805d-8930c4bf71df service nova] Lock "fe152ebd-4f99-4fa8-bfdb-8744cdf3f387-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:58:58 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-6a531573-a405-41e4-bb64-a0ce3738f879 req-b247fb0f-3e41-4d96-805d-8930c4bf71df service nova] Lock "fe152ebd-4f99-4fa8-bfdb-8744cdf3f387-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:58:58 user nova-compute[71509]: DEBUG nova.compute.manager [req-6a531573-a405-41e4-bb64-a0ce3738f879 req-b247fb0f-3e41-4d96-805d-8930c4bf71df service nova] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] No waiting events found dispatching network-vif-unplugged-1a142b11-f1ec-41d4-9728-f9f0de9a96ff {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:58:58 user nova-compute[71509]: DEBUG nova.compute.manager [req-6a531573-a405-41e4-bb64-a0ce3738f879 req-b247fb0f-3e41-4d96-805d-8930c4bf71df service nova] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] Received event network-vif-unplugged-1a142b11-f1ec-41d4-9728-f9f0de9a96ff for instance with task_state deleting. {{(pid=71509) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 10:58:58 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:58:58 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] Instance destroyed successfully.
Apr 14 10:58:58 user nova-compute[71509]: DEBUG nova.objects.instance [None req-9f734ee0-95cb-48fd-87a5-416bcb93e4fb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lazy-loading 'resources' on Instance uuid fe152ebd-4f99-4fa8-bfdb-8744cdf3f387 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:58:58 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-9f734ee0-95cb-48fd-87a5-416bcb93e4fb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,config_drive='',created_at=2023-04-14T10:53:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1556975659',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1556975659',id=24,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFLvBNTxhHSIubw0F7uDtXu3lrC4fQZkREwo5wOypbS5+Ne2y87VyX2V16fNDjYxnAH2TEtOojObi2Pe4MMNu8MWvc1u20HwRd46X6UXa7+BJMSqgQ2sXpyz9M+hNSfjsA==',key_name='tempest-keypair-2083532637',keypairs=<?>,launch_index=0,launched_at=2023-04-14T10:57:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f8a9941095d445f48d70df26d8c90e6c',ramdisk_id='',reservation_id='r-tlsa2xby',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1250068675',owner_user_name='tempest-AttachVolumeShelveTestJSON-1250068675-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T10:57:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5afd3930d3a14aff8124a4782ec79870',uuid=fe152ebd-4f99-4fa8-bfdb-8744cdf3f387,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1a142b11-f1ec-41d4-9728-f9f0de9a96ff", "address": "fa:16:3e:96:f1:e3", "network": {"id": "1cb09253-66a4-4c81-82d0-c6d948e0aed4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1557121746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8a9941095d445f48d70df26d8c90e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a142b11-f1", "ovs_interfaceid": "1a142b11-f1ec-41d4-9728-f9f0de9a96ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 10:58:58 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-9f734ee0-95cb-48fd-87a5-416bcb93e4fb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Converting VIF {"id": "1a142b11-f1ec-41d4-9728-f9f0de9a96ff", "address": "fa:16:3e:96:f1:e3", "network": {"id": "1cb09253-66a4-4c81-82d0-c6d948e0aed4", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1557121746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f8a9941095d445f48d70df26d8c90e6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a142b11-f1", "ovs_interfaceid": "1a142b11-f1ec-41d4-9728-f9f0de9a96ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:58:58 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-9f734ee0-95cb-48fd-87a5-416bcb93e4fb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:f1:e3,bridge_name='br-int',has_traffic_filtering=True,id=1a142b11-f1ec-41d4-9728-f9f0de9a96ff,network=Network(1cb09253-66a4-4c81-82d0-c6d948e0aed4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a142b11-f1') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:58:58 user nova-compute[71509]: DEBUG os_vif [None req-9f734ee0-95cb-48fd-87a5-416bcb93e4fb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:f1:e3,bridge_name='br-int',has_traffic_filtering=True,id=1a142b11-f1ec-41d4-9728-f9f0de9a96ff,network=Network(1cb09253-66a4-4c81-82d0-c6d948e0aed4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a142b11-f1') {{(pid=71509) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 10:58:58 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:58:58 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1a142b11-f1, bridge=br-int, if_exists=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:58:58 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:58:58 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 10:58:58 user nova-compute[71509]: INFO os_vif [None req-9f734ee0-95cb-48fd-87a5-416bcb93e4fb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:f1:e3,bridge_name='br-int',has_traffic_filtering=True,id=1a142b11-f1ec-41d4-9728-f9f0de9a96ff,network=Network(1cb09253-66a4-4c81-82d0-c6d948e0aed4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a142b11-f1')
Apr 14 10:58:58 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-9f734ee0-95cb-48fd-87a5-416bcb93e4fb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] Deleting instance files /opt/stack/data/nova/instances/fe152ebd-4f99-4fa8-bfdb-8744cdf3f387_del
Apr 14 10:58:58 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-9f734ee0-95cb-48fd-87a5-416bcb93e4fb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] Deletion of /opt/stack/data/nova/instances/fe152ebd-4f99-4fa8-bfdb-8744cdf3f387_del complete
Apr 14 10:58:58 user nova-compute[71509]: INFO nova.compute.manager [None req-9f734ee0-95cb-48fd-87a5-416bcb93e4fb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] Took 0.85 seconds to destroy the instance on the hypervisor.
Apr 14 10:58:58 user nova-compute[71509]: DEBUG oslo.service.loopingcall [None req-9f734ee0-95cb-48fd-87a5-416bcb93e4fb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71509) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 10:58:58 user nova-compute[71509]: DEBUG nova.compute.manager [-] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] Deallocating network for instance {{(pid=71509) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 10:58:58 user nova-compute[71509]: DEBUG nova.network.neutron [-] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] deallocate_for_instance() {{(pid=71509) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 10:58:59 user nova-compute[71509]: DEBUG nova.network.neutron [-] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] Updating instance_info_cache with network_info: [] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:58:59 user nova-compute[71509]: INFO nova.compute.manager [-] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] Took 0.76 seconds to deallocate network for instance.
Apr 14 10:58:59 user nova-compute[71509]: DEBUG nova.compute.manager [req-4dbc3b2a-75a2-4ad0-b406-3c5425c30204 req-7bf964fe-bbf9-4e71-a226-33c0c4431e3a service nova] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] Received event network-vif-deleted-1a142b11-f1ec-41d4-9728-f9f0de9a96ff {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:58:59 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-9f734ee0-95cb-48fd-87a5-416bcb93e4fb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:58:59 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-9f734ee0-95cb-48fd-87a5-416bcb93e4fb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:58:59 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-9f734ee0-95cb-48fd-87a5-416bcb93e4fb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 10:58:59 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-9f734ee0-95cb-48fd-87a5-416bcb93e4fb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 10:58:59 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-9f734ee0-95cb-48fd-87a5-416bcb93e4fb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.355s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:58:59 user nova-compute[71509]: INFO nova.scheduler.client.report [None req-9f734ee0-95cb-48fd-87a5-416bcb93e4fb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Deleted allocations for instance fe152ebd-4f99-4fa8-bfdb-8744cdf3f387
Apr 14 10:58:59 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-9f734ee0-95cb-48fd-87a5-416bcb93e4fb tempest-AttachVolumeShelveTestJSON-1250068675 tempest-AttachVolumeShelveTestJSON-1250068675-project-member] Lock "fe152ebd-4f99-4fa8-bfdb-8744cdf3f387" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.144s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:59:00 user nova-compute[71509]: DEBUG nova.compute.manager [req-87e8c875-32dd-41c3-9447-2bd5a1aa378c req-2d5abb4f-898f-4abc-8f01-5495e2bfd3e5 service nova] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] Received event network-vif-plugged-1a142b11-f1ec-41d4-9728-f9f0de9a96ff {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:59:00 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-87e8c875-32dd-41c3-9447-2bd5a1aa378c req-2d5abb4f-898f-4abc-8f01-5495e2bfd3e5 service nova] Acquiring lock "fe152ebd-4f99-4fa8-bfdb-8744cdf3f387-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:59:00 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-87e8c875-32dd-41c3-9447-2bd5a1aa378c req-2d5abb4f-898f-4abc-8f01-5495e2bfd3e5 service nova] Lock "fe152ebd-4f99-4fa8-bfdb-8744cdf3f387-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:59:00 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-87e8c875-32dd-41c3-9447-2bd5a1aa378c req-2d5abb4f-898f-4abc-8f01-5495e2bfd3e5 service nova] Lock "fe152ebd-4f99-4fa8-bfdb-8744cdf3f387-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:59:00 user nova-compute[71509]: DEBUG nova.compute.manager [req-87e8c875-32dd-41c3-9447-2bd5a1aa378c req-2d5abb4f-898f-4abc-8f01-5495e2bfd3e5 service nova] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] No waiting events found dispatching network-vif-plugged-1a142b11-f1ec-41d4-9728-f9f0de9a96ff {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:59:00 user nova-compute[71509]: WARNING nova.compute.manager [req-87e8c875-32dd-41c3-9447-2bd5a1aa378c req-2d5abb4f-898f-4abc-8f01-5495e2bfd3e5 service nova] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] Received unexpected event network-vif-plugged-1a142b11-f1ec-41d4-9728-f9f0de9a96ff for instance with vm_state deleted and task_state None.
Apr 14 10:59:01 user nova-compute[71509]: DEBUG nova.compute.manager [None req-388d1506-a572-48ab-829b-ad8fd611af15 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] Start spawning the instance on the hypervisor. {{(pid=71509) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 10:59:01 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-388d1506-a572-48ab-829b-ad8fd611af15 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] Creating instance directory {{(pid=71509) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 10:59:01 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-388d1506-a572-48ab-829b-ad8fd611af15 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] Creating image(s)
Apr 14 10:59:01 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-388d1506-a572-48ab-829b-ad8fd611af15 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] Did not create local disks {{(pid=71509) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 10:59:01 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-388d1506-a572-48ab-829b-ad8fd611af15 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] Ensure instance console log exists: /opt/stack/data/nova/instances/fbcca78c-fe73-4ef1-92f9-4c8061cad177/console.log {{(pid=71509) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 10:59:01 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-388d1506-a572-48ab-829b-ad8fd611af15 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:59:01 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-388d1506-a572-48ab-829b-ad8fd611af15 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:59:01 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-388d1506-a572-48ab-829b-ad8fd611af15 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:59:01 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-388d1506-a572-48ab-829b-ad8fd611af15 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] Start _get_guest_xml network_info=[{"id": "845cc40f-1b03-4b85-8d19-fea731fe7f89", "address": "fa:16:3e:45:59:73", "network": {"id": "07f1f39e-292a-4e73-b4ed-99e5799d6fa8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1339551596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71289f80a05141f482cb538dac3d7b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap845cc40f-1b", "ovs_interfaceid": "845cc40f-1b03-4b85-8d19-fea731fe7f89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T10:38:55Z,direct_url=<?>,disk_format='qcow2',id=048ec0ee-0465-448d-8b4c-f072acb101dc,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='9742d6ad20cf48d9bab0fdbcc9491db9',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T10:38:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'attachment_id': 'deefa7ce-3b9b-4649-873b-96abadaf35b8', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xoNByDPq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'fbcca78c-fe73-4ef1-92f9-4c8061cad177', 'attached_at': '', 'detached_at': '', 'volume_id': '5accb380-f5d8-4a81-b266-df7390893219', 'serial': '5accb380-f5d8-4a81-b266-df7390893219'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'volume_type': None} {{(pid=71509) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 10:59:01 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-388d1506-a572-48ab-829b-ad8fd611af15 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:59:01 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-388d1506-a572-48ab-829b-ad8fd611af15 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:59:01 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-388d1506-a572-48ab-829b-ad8fd611af15 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71509) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 10:59:01 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-388d1506-a572-48ab-829b-ad8fd611af15 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T10:40:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T10:38:55Z,direct_url=<?>,disk_format='qcow2',id=048ec0ee-0465-448d-8b4c-f072acb101dc,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='9742d6ad20cf48d9bab0fdbcc9491db9',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T10:38:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 10:59:01 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-388d1506-a572-48ab-829b-ad8fd611af15 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Flavor limits 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 10:59:01 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-388d1506-a572-48ab-829b-ad8fd611af15 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Image limits 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 10:59:01 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-388d1506-a572-48ab-829b-ad8fd611af15 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Flavor pref 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 10:59:01 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-388d1506-a572-48ab-829b-ad8fd611af15 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Image pref 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 10:59:01 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-388d1506-a572-48ab-829b-ad8fd611af15 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 10:59:01 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-388d1506-a572-48ab-829b-ad8fd611af15 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 10:59:01 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-388d1506-a572-48ab-829b-ad8fd611af15 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71509) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 10:59:01 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-388d1506-a572-48ab-829b-ad8fd611af15 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Got 1 possible topologies {{(pid=71509) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 10:59:01 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-388d1506-a572-48ab-829b-ad8fd611af15 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 10:59:01 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-388d1506-a572-48ab-829b-ad8fd611af15 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 10:59:01 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-388d1506-a572-48ab-829b-ad8fd611af15 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] Calling os-brick to attach iSCSI Volume {{(pid=71509) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 10:59:01 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-388d1506-a572-48ab-829b-ad8fd611af15 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0bf0749390>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xoNByDPq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 10:59:01 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-388d1506-a572-48ab-829b-ad8fd611af15 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 10:59:01 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-388d1506-a572-48ab-829b-ad8fd611af15 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 10:59:01 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-388d1506-a572-48ab-829b-ad8fd611af15 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 10:59:01 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-388d1506-a572-48ab-829b-ad8fd611af15 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 10:59:01 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-388d1506-a572-48ab-829b-ad8fd611af15 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 10:59:01 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-388d1506-a572-48ab-829b-ad8fd611af15 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 10:59:01 user nova-compute[71509]: INFO os_brick.initiator.connectors.iscsi [None req-388d1506-a572-48ab-829b-ad8fd611af15 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 10:59:01 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219 -p 172.16.0.220:3260 {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:59:01 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:59:01 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[7388796a-1c00-4e9a-b059-6dd47db68da2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:59:01 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-388d1506-a572-48ab-829b-ad8fd611af15 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 10:59:01 user nova-compute[71509]:  {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:59:01 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219 -p 172.16.0.220:3260 --interface default --op new {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:59:01 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:59:01 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[c92d34f9-de36-4d76-97f0-d29ddba125ee]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219] added\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:59:01 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-388d1506-a572-48ab-829b-ad8fd611af15 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219] added
Apr 14 10:59:01 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:59:01 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:59:01 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:59:01 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebb0c425-900b-4595-8922-b201dc35a449]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:59:01 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-388d1506-a572-48ab-829b-ad8fd611af15 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:59:01 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:59:01 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:59:01 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[06f663ed-42df-455e-8464-d0177cd47f0d]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:59:01 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-388d1506-a572-48ab-829b-ad8fd611af15 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:59:01 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xoNByDPq {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:59:01 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xoNByDPq" returned: 0 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:59:01 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f32df60-e175-4ba1-bf83-61b6709d38bb]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:59:01 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-388d1506-a572-48ab-829b-ad8fd611af15 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xoNByDPq'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:59:01 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:59:01 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:59:01 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[f98a2c32-1071-429e-a3b9-b5b42561e460]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:59:01 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-388d1506-a572-48ab-829b-ad8fd611af15 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:59:01 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:59:01 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:59:01 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[09d0f732-3568-4d5d-a3ae-d731319164e3]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:59:01 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-388d1506-a572-48ab-829b-ad8fd611af15 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)
Apr 14 10:59:01 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:59:01 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-388d1506-a572-48ab-829b-ad8fd611af15 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)
Apr 14 10:59:01 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 10:59:01 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219 -p 172.16.0.220:3260 --login {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:59:01 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:59:01 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[22623877-64cd-4555-9fe0-a6876de71f3b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:59:01 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-388d1506-a572-48ab-829b-ad8fd611af15 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219, portal: 172.16.0.220,3260]
Apr 14 10:59:01 user nova-compute[71509]: Login to [iface: default, target: iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219, portal: 172.16.0.220,3260] successful.
Apr 14 10:59:01 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:59:01 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:59:01 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:59:01 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[12c01c55-a2b3-47cf-a6b1-9a1284e3467d]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:59:01 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-388d1506-a572-48ab-829b-ad8fd611af15 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:59:01 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:59:01 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:59:01 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c43c19a-e3e5-4ecf-871a-5664893e8e2b]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219 (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:59:01 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-388d1506-a572-48ab-829b-ad8fd611af15 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)
Apr 14 10:59:01 user nova-compute[71509]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219 (non-flash)
Apr 14 10:59:01 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:59:01 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-388d1506-a572-48ab-829b-ad8fd611af15 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)
Apr 14 10:59:01 user nova-compute[71509]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219 (non-flash)
Apr 14 10:59:01 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 10:59:01 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-388d1506-a572-48ab-829b-ad8fd611af15 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.266s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 10:59:01 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-388d1506-a572-48ab-829b-ad8fd611af15 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Connected to 172.16.0.220:3260 {{(pid=71509) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 10:59:01 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-388d1506-a572-48ab-829b-ad8fd611af15 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] HCTL ('33', '-', '-', 0) found on session 37 with lun 0 {{(pid=71509) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 10:59:01 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-388d1506-a572-48ab-829b-ad8fd611af15 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71509) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 10:59:01 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:59:01 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:59:01 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[85f19f7e-8af4-4487-9815-8568fe6cb8fd]: (4, ('- - 0', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:59:01 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-388d1506-a572-48ab-829b-ad8fd611af15 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Searching for a device in session 37 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71509) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 10:59:01 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-388d1506-a572-48ab-829b-ad8fd611af15 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xoNByDPq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71509) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 10:59:02 user nova-compute[71509]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681469927.131467, ade9eacb-d4f9-406d-85c4-043037a4b6ba => Stopped> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 10:59:02 user nova-compute[71509]: INFO nova.compute.manager [-] [instance: ade9eacb-d4f9-406d-85c4-043037a4b6ba] VM Stopped (Lifecycle Event)
Apr 14 10:59:02 user nova-compute[71509]: DEBUG nova.compute.manager [None req-dee77fd4-a355-4e2c-9872-bf0d6a36e95a None None] [instance: ade9eacb-d4f9-406d-85c4-043037a4b6ba] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:59:02 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-388d1506-a572-48ab-829b-ad8fd611af15 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.297s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 10:59:02 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-388d1506-a572-48ab-829b-ad8fd611af15 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] <== connect_volume: return (1299ms) {'type': 'block', 'scsi_wwn': '26338356463316566', 'path': '/dev/sdb'} {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 10:59:02 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-388d1506-a572-48ab-829b-ad8fd611af15 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26338356463316566', 'path': '/dev/sdb'} {{(pid=71509) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 10:59:02 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-388d1506-a572-48ab-829b-ad8fd611af15 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T10:58:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1915851503',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1915851503',id=34,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='71289f80a05141f482cb538dac3d7b38',ramdisk_id='',reservation_id='r-n81abyyd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2130542140',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T10:58:51Z,user_data=None,user_id='395bc9d7007c4e01ac7effd418bcea19',uuid=fbcca78c-fe73-4ef1-92f9-4c8061cad177,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "845cc40f-1b03-4b85-8d19-fea731fe7f89", "address": "fa:16:3e:45:59:73", "network": {"id": "07f1f39e-292a-4e73-b4ed-99e5799d6fa8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1339551596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71289f80a05141f482cb538dac3d7b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap845cc40f-1b", "ovs_interfaceid": "845cc40f-1b03-4b85-8d19-fea731fe7f89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71509) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 10:59:02 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-388d1506-a572-48ab-829b-ad8fd611af15 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Converting VIF {"id": "845cc40f-1b03-4b85-8d19-fea731fe7f89", "address": "fa:16:3e:45:59:73", "network": {"id": "07f1f39e-292a-4e73-b4ed-99e5799d6fa8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1339551596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71289f80a05141f482cb538dac3d7b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap845cc40f-1b", "ovs_interfaceid": "845cc40f-1b03-4b85-8d19-fea731fe7f89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:59:02 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-388d1506-a572-48ab-829b-ad8fd611af15 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:59:73,bridge_name='br-int',has_traffic_filtering=True,id=845cc40f-1b03-4b85-8d19-fea731fe7f89,network=Network(07f1f39e-292a-4e73-b4ed-99e5799d6fa8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap845cc40f-1b') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:59:02 user nova-compute[71509]: DEBUG nova.objects.instance [None req-388d1506-a572-48ab-829b-ad8fd611af15 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lazy-loading 'pci_devices' on Instance uuid fbcca78c-fe73-4ef1-92f9-4c8061cad177 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:59:02 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-388d1506-a572-48ab-829b-ad8fd611af15 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] End _get_guest_xml xml=<domain type="kvm">
Apr 14 10:59:02 user nova-compute[71509]:   <uuid>fbcca78c-fe73-4ef1-92f9-4c8061cad177</uuid>
Apr 14 10:59:02 user nova-compute[71509]:   <name>instance-00000022</name>
Apr 14 10:59:02 user nova-compute[71509]:   <memory>131072</memory>
Apr 14 10:59:02 user nova-compute[71509]:   <vcpu>1</vcpu>
Apr 14 10:59:02 user nova-compute[71509]:   <metadata>
Apr 14 10:59:02 user nova-compute[71509]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 10:59:02 user nova-compute[71509]:       <nova:package version="0.0.0"/>
Apr 14 10:59:02 user nova-compute[71509]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1915851503</nova:name>
Apr 14 10:59:02 user nova-compute[71509]:       <nova:creationTime>2023-04-14 10:59:01</nova:creationTime>
Apr 14 10:59:02 user nova-compute[71509]:       <nova:flavor name="m1.nano">
Apr 14 10:59:02 user nova-compute[71509]:         <nova:memory>128</nova:memory>
Apr 14 10:59:02 user nova-compute[71509]:         <nova:disk>1</nova:disk>
Apr 14 10:59:02 user nova-compute[71509]:         <nova:swap>0</nova:swap>
Apr 14 10:59:02 user nova-compute[71509]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 10:59:02 user nova-compute[71509]:         <nova:vcpus>1</nova:vcpus>
Apr 14 10:59:02 user nova-compute[71509]:       </nova:flavor>
Apr 14 10:59:02 user nova-compute[71509]:       <nova:owner>
Apr 14 10:59:02 user nova-compute[71509]:         <nova:user uuid="395bc9d7007c4e01ac7effd418bcea19">tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member</nova:user>
Apr 14 10:59:02 user nova-compute[71509]:         <nova:project uuid="71289f80a05141f482cb538dac3d7b38">tempest-ServerBootFromVolumeStableRescueTest-2130542140</nova:project>
Apr 14 10:59:02 user nova-compute[71509]:       </nova:owner>
Apr 14 10:59:02 user nova-compute[71509]:       <nova:root type="image" uuid="048ec0ee-0465-448d-8b4c-f072acb101dc"/>
Apr 14 10:59:02 user nova-compute[71509]:       <nova:ports>
Apr 14 10:59:02 user nova-compute[71509]:         <nova:port uuid="845cc40f-1b03-4b85-8d19-fea731fe7f89">
Apr 14 10:59:02 user nova-compute[71509]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 14 10:59:02 user nova-compute[71509]:         </nova:port>
Apr 14 10:59:02 user nova-compute[71509]:       </nova:ports>
Apr 14 10:59:02 user nova-compute[71509]:     </nova:instance>
Apr 14 10:59:02 user nova-compute[71509]:   </metadata>
Apr 14 10:59:02 user nova-compute[71509]:   <sysinfo type="smbios">
Apr 14 10:59:02 user nova-compute[71509]:     <system>
Apr 14 10:59:02 user nova-compute[71509]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 10:59:02 user nova-compute[71509]:       <entry name="product">OpenStack Nova</entry>
Apr 14 10:59:02 user nova-compute[71509]:       <entry name="version">0.0.0</entry>
Apr 14 10:59:02 user nova-compute[71509]:       <entry name="serial">fbcca78c-fe73-4ef1-92f9-4c8061cad177</entry>
Apr 14 10:59:02 user nova-compute[71509]:       <entry name="uuid">fbcca78c-fe73-4ef1-92f9-4c8061cad177</entry>
Apr 14 10:59:02 user nova-compute[71509]:       <entry name="family">Virtual Machine</entry>
Apr 14 10:59:02 user nova-compute[71509]:     </system>
Apr 14 10:59:02 user nova-compute[71509]:   </sysinfo>
Apr 14 10:59:02 user nova-compute[71509]:   <os>
Apr 14 10:59:02 user nova-compute[71509]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 10:59:02 user nova-compute[71509]:     <boot dev="hd"/>
Apr 14 10:59:02 user nova-compute[71509]:     <smbios mode="sysinfo"/>
Apr 14 10:59:02 user nova-compute[71509]:   </os>
Apr 14 10:59:02 user nova-compute[71509]:   <features>
Apr 14 10:59:02 user nova-compute[71509]:     <acpi/>
Apr 14 10:59:02 user nova-compute[71509]:     <apic/>
Apr 14 10:59:02 user nova-compute[71509]:     <vmcoreinfo/>
Apr 14 10:59:02 user nova-compute[71509]:   </features>
Apr 14 10:59:02 user nova-compute[71509]:   <clock offset="utc">
Apr 14 10:59:02 user nova-compute[71509]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 10:59:02 user nova-compute[71509]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 10:59:02 user nova-compute[71509]:     <timer name="hpet" present="no"/>
Apr 14 10:59:02 user nova-compute[71509]:   </clock>
Apr 14 10:59:02 user nova-compute[71509]:   <cpu mode="custom" match="exact">
Apr 14 10:59:02 user nova-compute[71509]:     <model>Nehalem</model>
Apr 14 10:59:02 user nova-compute[71509]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 10:59:02 user nova-compute[71509]:   </cpu>
Apr 14 10:59:02 user nova-compute[71509]:   <devices>
Apr 14 10:59:02 user nova-compute[71509]:     <disk type="block" device="disk">
Apr 14 10:59:02 user nova-compute[71509]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 10:59:02 user nova-compute[71509]:       <source dev="/dev/sdb"/>
Apr 14 10:59:02 user nova-compute[71509]:       <target dev="vda" bus="virtio"/>
Apr 14 10:59:02 user nova-compute[71509]:       <serial>5accb380-f5d8-4a81-b266-df7390893219</serial>
Apr 14 10:59:02 user nova-compute[71509]:     </disk>
Apr 14 10:59:02 user nova-compute[71509]:     <interface type="ethernet">
Apr 14 10:59:02 user nova-compute[71509]:       <mac address="fa:16:3e:45:59:73"/>
Apr 14 10:59:02 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 10:59:02 user nova-compute[71509]:       <mtu size="1442"/>
Apr 14 10:59:02 user nova-compute[71509]:       <target dev="tap845cc40f-1b"/>
Apr 14 10:59:02 user nova-compute[71509]:     </interface>
Apr 14 10:59:02 user nova-compute[71509]:     <serial type="pty">
Apr 14 10:59:02 user nova-compute[71509]:       <log file="/opt/stack/data/nova/instances/fbcca78c-fe73-4ef1-92f9-4c8061cad177/console.log" append="off"/>
Apr 14 10:59:02 user nova-compute[71509]:     </serial>
Apr 14 10:59:02 user nova-compute[71509]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 10:59:02 user nova-compute[71509]:     <video>
Apr 14 10:59:02 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 10:59:02 user nova-compute[71509]:     </video>
Apr 14 10:59:02 user nova-compute[71509]:     <rng model="virtio">
Apr 14 10:59:02 user nova-compute[71509]:       <backend model="random">/dev/urandom</backend>
Apr 14 10:59:02 user nova-compute[71509]:     </rng>
Apr 14 10:59:02 user nova-compute[71509]:     <controller type="usb" index="0" model="none"/>
Apr 14 10:59:02 user nova-compute[71509]:     <memballoon model="virtio">
Apr 14 10:59:02 user nova-compute[71509]:       <stats period="10"/>
Apr 14 10:59:02 user nova-compute[71509]:     </memballoon>
Apr 14 10:59:02 user nova-compute[71509]:   </devices>
Apr 14 10:59:02 user nova-compute[71509]: </domain>
Apr 14 10:59:02 user nova-compute[71509]:  {{(pid=71509) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 10:59:02 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-388d1506-a572-48ab-829b-ad8fd611af15 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T10:58:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1915851503',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1915851503',id=34,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='71289f80a05141f482cb538dac3d7b38',ramdisk_id='',reservation_id='r-n81abyyd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2130542140',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T10:58:51Z,user_data=None,user_id='395bc9d7007c4e01ac7effd418bcea19',uuid=fbcca78c-fe73-4ef1-92f9-4c8061cad177,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "845cc40f-1b03-4b85-8d19-fea731fe7f89", "address": "fa:16:3e:45:59:73", "network": {"id": "07f1f39e-292a-4e73-b4ed-99e5799d6fa8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1339551596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71289f80a05141f482cb538dac3d7b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap845cc40f-1b", "ovs_interfaceid": "845cc40f-1b03-4b85-8d19-fea731fe7f89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 10:59:02 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-388d1506-a572-48ab-829b-ad8fd611af15 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Converting VIF {"id": "845cc40f-1b03-4b85-8d19-fea731fe7f89", "address": "fa:16:3e:45:59:73", "network": {"id": "07f1f39e-292a-4e73-b4ed-99e5799d6fa8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1339551596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71289f80a05141f482cb538dac3d7b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap845cc40f-1b", "ovs_interfaceid": "845cc40f-1b03-4b85-8d19-fea731fe7f89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:59:02 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-388d1506-a572-48ab-829b-ad8fd611af15 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:59:73,bridge_name='br-int',has_traffic_filtering=True,id=845cc40f-1b03-4b85-8d19-fea731fe7f89,network=Network(07f1f39e-292a-4e73-b4ed-99e5799d6fa8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap845cc40f-1b') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:59:02 user nova-compute[71509]: DEBUG os_vif [None req-388d1506-a572-48ab-829b-ad8fd611af15 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:59:73,bridge_name='br-int',has_traffic_filtering=True,id=845cc40f-1b03-4b85-8d19-fea731fe7f89,network=Network(07f1f39e-292a-4e73-b4ed-99e5799d6fa8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap845cc40f-1b') {{(pid=71509) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 10:59:02 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:59:02 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:59:02 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 10:59:02 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:59:02 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap845cc40f-1b, may_exist=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:59:02 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap845cc40f-1b, col_values=(('external_ids', {'iface-id': '845cc40f-1b03-4b85-8d19-fea731fe7f89', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:45:59:73', 'vm-uuid': 'fbcca78c-fe73-4ef1-92f9-4c8061cad177'}),)) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:59:02 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:59:02 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 10:59:02 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:59:02 user nova-compute[71509]: INFO os_vif [None req-388d1506-a572-48ab-829b-ad8fd611af15 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:59:73,bridge_name='br-int',has_traffic_filtering=True,id=845cc40f-1b03-4b85-8d19-fea731fe7f89,network=Network(07f1f39e-292a-4e73-b4ed-99e5799d6fa8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap845cc40f-1b')
Apr 14 10:59:02 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-388d1506-a572-48ab-829b-ad8fd611af15 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] No BDM found with device name vda, not building metadata. {{(pid=71509) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 10:59:02 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-388d1506-a572-48ab-829b-ad8fd611af15 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] No VIF found with MAC fa:16:3e:45:59:73, not building metadata {{(pid=71509) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 10:59:03 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:59:03 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:59:03 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:59:03 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:59:04 user nova-compute[71509]: DEBUG nova.compute.manager [req-7fee115c-b35d-4055-a2ac-b15106a26232 req-7d005d80-6f42-4033-9187-2842e9a13872 service nova] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] Received event network-vif-plugged-845cc40f-1b03-4b85-8d19-fea731fe7f89 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:59:04 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-7fee115c-b35d-4055-a2ac-b15106a26232 req-7d005d80-6f42-4033-9187-2842e9a13872 service nova] Acquiring lock "fbcca78c-fe73-4ef1-92f9-4c8061cad177-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:59:04 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-7fee115c-b35d-4055-a2ac-b15106a26232 req-7d005d80-6f42-4033-9187-2842e9a13872 service nova] Lock "fbcca78c-fe73-4ef1-92f9-4c8061cad177-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:59:04 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-7fee115c-b35d-4055-a2ac-b15106a26232 req-7d005d80-6f42-4033-9187-2842e9a13872 service nova] Lock "fbcca78c-fe73-4ef1-92f9-4c8061cad177-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:59:04 user nova-compute[71509]: DEBUG nova.compute.manager [req-7fee115c-b35d-4055-a2ac-b15106a26232 req-7d005d80-6f42-4033-9187-2842e9a13872 service nova] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] No waiting events found dispatching network-vif-plugged-845cc40f-1b03-4b85-8d19-fea731fe7f89 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:59:04 user nova-compute[71509]: WARNING nova.compute.manager [req-7fee115c-b35d-4055-a2ac-b15106a26232 req-7d005d80-6f42-4033-9187-2842e9a13872 service nova] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] Received unexpected event network-vif-plugged-845cc40f-1b03-4b85-8d19-fea731fe7f89 for instance with vm_state building and task_state spawning.
Apr 14 10:59:04 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:59:04 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:59:05 user nova-compute[71509]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681469930.7193768, 97820f17-22d1-4ec3-9721-1edadccc794a => Stopped> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 10:59:05 user nova-compute[71509]: INFO nova.compute.manager [-] [instance: 97820f17-22d1-4ec3-9721-1edadccc794a] VM Stopped (Lifecycle Event)
Apr 14 10:59:05 user nova-compute[71509]: DEBUG nova.compute.manager [None req-00e84988-aadb-49da-9e80-4740300d832a None None] [instance: 97820f17-22d1-4ec3-9721-1edadccc794a] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:59:05 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681469945.9455323, fbcca78c-fe73-4ef1-92f9-4c8061cad177 => Resumed> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 10:59:05 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] VM Resumed (Lifecycle Event)
Apr 14 10:59:05 user nova-compute[71509]: DEBUG nova.compute.manager [None req-388d1506-a572-48ab-829b-ad8fd611af15 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] Instance event wait completed in 0 seconds for  {{(pid=71509) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 10:59:05 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-388d1506-a572-48ab-829b-ad8fd611af15 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] Guest created on hypervisor {{(pid=71509) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 10:59:05 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] Instance spawned successfully.
Apr 14 10:59:05 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-388d1506-a572-48ab-829b-ad8fd611af15 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 10:59:06 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:59:06 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 10:59:06 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-388d1506-a572-48ab-829b-ad8fd611af15 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] Found default for hw_cdrom_bus of ide {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:59:06 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-388d1506-a572-48ab-829b-ad8fd611af15 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] Found default for hw_disk_bus of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:59:06 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-388d1506-a572-48ab-829b-ad8fd611af15 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] Found default for hw_input_bus of None {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:59:06 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-388d1506-a572-48ab-829b-ad8fd611af15 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] Found default for hw_pointer_model of None {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:59:06 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-388d1506-a572-48ab-829b-ad8fd611af15 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] Found default for hw_video_model of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:59:06 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-388d1506-a572-48ab-829b-ad8fd611af15 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] Found default for hw_vif_model of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:59:06 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 10:59:06 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681469945.9465039, fbcca78c-fe73-4ef1-92f9-4c8061cad177 => Started> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 10:59:06 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] VM Started (Lifecycle Event)
Apr 14 10:59:06 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:59:06 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 10:59:06 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 10:59:06 user nova-compute[71509]: DEBUG nova.compute.manager [req-ebd06c09-40f6-4de9-a6e1-7af93309d846 req-97ef8c93-e8a1-4d45-8614-c8398bfa20e2 service nova] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] Received event network-vif-plugged-845cc40f-1b03-4b85-8d19-fea731fe7f89 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:59:06 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-ebd06c09-40f6-4de9-a6e1-7af93309d846 req-97ef8c93-e8a1-4d45-8614-c8398bfa20e2 service nova] Acquiring lock "fbcca78c-fe73-4ef1-92f9-4c8061cad177-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:59:06 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-ebd06c09-40f6-4de9-a6e1-7af93309d846 req-97ef8c93-e8a1-4d45-8614-c8398bfa20e2 service nova] Lock "fbcca78c-fe73-4ef1-92f9-4c8061cad177-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:59:06 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-ebd06c09-40f6-4de9-a6e1-7af93309d846 req-97ef8c93-e8a1-4d45-8614-c8398bfa20e2 service nova] Lock "fbcca78c-fe73-4ef1-92f9-4c8061cad177-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:59:06 user nova-compute[71509]: DEBUG nova.compute.manager [req-ebd06c09-40f6-4de9-a6e1-7af93309d846 req-97ef8c93-e8a1-4d45-8614-c8398bfa20e2 service nova] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] No waiting events found dispatching network-vif-plugged-845cc40f-1b03-4b85-8d19-fea731fe7f89 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:59:06 user nova-compute[71509]: WARNING nova.compute.manager [req-ebd06c09-40f6-4de9-a6e1-7af93309d846 req-97ef8c93-e8a1-4d45-8614-c8398bfa20e2 service nova] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] Received unexpected event network-vif-plugged-845cc40f-1b03-4b85-8d19-fea731fe7f89 for instance with vm_state building and task_state spawning.
Apr 14 10:59:06 user nova-compute[71509]: DEBUG nova.compute.manager [req-be996d6f-9078-454c-bbc8-9fd92a232794 req-7649b748-0efd-4cfa-9fdb-79864ef1d9bc service nova] [instance: 0dd9e11f-1fed-42af-ad5c-9cdd051b93e7] Received event network-changed-ec941aab-7c95-415b-96bc-e74ebaeb9385 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:59:06 user nova-compute[71509]: DEBUG nova.compute.manager [req-be996d6f-9078-454c-bbc8-9fd92a232794 req-7649b748-0efd-4cfa-9fdb-79864ef1d9bc service nova] [instance: 0dd9e11f-1fed-42af-ad5c-9cdd051b93e7] Refreshing instance network info cache due to event network-changed-ec941aab-7c95-415b-96bc-e74ebaeb9385. {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 10:59:06 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-be996d6f-9078-454c-bbc8-9fd92a232794 req-7649b748-0efd-4cfa-9fdb-79864ef1d9bc service nova] Acquiring lock "refresh_cache-0dd9e11f-1fed-42af-ad5c-9cdd051b93e7" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:59:06 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-be996d6f-9078-454c-bbc8-9fd92a232794 req-7649b748-0efd-4cfa-9fdb-79864ef1d9bc service nova] Acquired lock "refresh_cache-0dd9e11f-1fed-42af-ad5c-9cdd051b93e7" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:59:06 user nova-compute[71509]: DEBUG nova.network.neutron [req-be996d6f-9078-454c-bbc8-9fd92a232794 req-7649b748-0efd-4cfa-9fdb-79864ef1d9bc service nova] [instance: 0dd9e11f-1fed-42af-ad5c-9cdd051b93e7] Refreshing network info cache for port ec941aab-7c95-415b-96bc-e74ebaeb9385 {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 10:59:06 user nova-compute[71509]: INFO nova.compute.manager [None req-388d1506-a572-48ab-829b-ad8fd611af15 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] Took 5.03 seconds to spawn the instance on the hypervisor.
Apr 14 10:59:06 user nova-compute[71509]: DEBUG nova.compute.manager [None req-388d1506-a572-48ab-829b-ad8fd611af15 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:59:06 user nova-compute[71509]: INFO nova.compute.manager [None req-388d1506-a572-48ab-829b-ad8fd611af15 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] Took 16.49 seconds to build instance.
Apr 14 10:59:06 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-388d1506-a572-48ab-829b-ad8fd611af15 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "fbcca78c-fe73-4ef1-92f9-4c8061cad177" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.588s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:59:06 user nova-compute[71509]: DEBUG nova.network.neutron [req-be996d6f-9078-454c-bbc8-9fd92a232794 req-7649b748-0efd-4cfa-9fdb-79864ef1d9bc service nova] [instance: 0dd9e11f-1fed-42af-ad5c-9cdd051b93e7] Updated VIF entry in instance network info cache for port ec941aab-7c95-415b-96bc-e74ebaeb9385. {{(pid=71509) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 10:59:06 user nova-compute[71509]: DEBUG nova.network.neutron [req-be996d6f-9078-454c-bbc8-9fd92a232794 req-7649b748-0efd-4cfa-9fdb-79864ef1d9bc service nova] [instance: 0dd9e11f-1fed-42af-ad5c-9cdd051b93e7] Updating instance_info_cache with network_info: [{"id": "ec941aab-7c95-415b-96bc-e74ebaeb9385", "address": "fa:16:3e:31:a2:13", "network": {"id": "18a91434-637b-4c19-a97b-736b32c1ea5a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1824162811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea2cb4dfa5b4a52b658efd8f5aefb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec941aab-7c", "ovs_interfaceid": "ec941aab-7c95-415b-96bc-e74ebaeb9385", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:59:06 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-be996d6f-9078-454c-bbc8-9fd92a232794 req-7649b748-0efd-4cfa-9fdb-79864ef1d9bc service nova] Releasing lock "refresh_cache-0dd9e11f-1fed-42af-ad5c-9cdd051b93e7" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:59:07 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:59:08 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:59:11 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-e60ef001-4e22-4d46-b664-19d2ac0482ad tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "3db2e71c-939b-4d2f-b1be-c2122f7cd73e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:59:11 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-e60ef001-4e22-4d46-b664-19d2ac0482ad tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "3db2e71c-939b-4d2f-b1be-c2122f7cd73e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:59:11 user nova-compute[71509]: DEBUG nova.compute.manager [None req-e60ef001-4e22-4d46-b664-19d2ac0482ad tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] Starting instance... {{(pid=71509) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 10:59:11 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-e60ef001-4e22-4d46-b664-19d2ac0482ad tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:59:11 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-e60ef001-4e22-4d46-b664-19d2ac0482ad tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:59:11 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-e60ef001-4e22-4d46-b664-19d2ac0482ad tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71509) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 10:59:11 user nova-compute[71509]: INFO nova.compute.claims [None req-e60ef001-4e22-4d46-b664-19d2ac0482ad tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] Claim successful on node user
Apr 14 10:59:11 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-e60ef001-4e22-4d46-b664-19d2ac0482ad tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 10:59:11 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-e60ef001-4e22-4d46-b664-19d2ac0482ad tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 10:59:11 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-e60ef001-4e22-4d46-b664-19d2ac0482ad tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.491s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:59:11 user nova-compute[71509]: DEBUG nova.compute.manager [None req-e60ef001-4e22-4d46-b664-19d2ac0482ad tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] Start building networks asynchronously for instance. {{(pid=71509) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 10:59:11 user nova-compute[71509]: DEBUG nova.compute.manager [None req-e60ef001-4e22-4d46-b664-19d2ac0482ad tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] Allocating IP information in the background. {{(pid=71509) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 10:59:11 user nova-compute[71509]: DEBUG nova.network.neutron [None req-e60ef001-4e22-4d46-b664-19d2ac0482ad tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] allocate_for_instance() {{(pid=71509) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 10:59:11 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-e60ef001-4e22-4d46-b664-19d2ac0482ad tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 10:59:11 user nova-compute[71509]: DEBUG nova.compute.manager [None req-e60ef001-4e22-4d46-b664-19d2ac0482ad tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] Start building block device mappings for instance. {{(pid=71509) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 10:59:11 user nova-compute[71509]: INFO nova.virt.block_device [None req-e60ef001-4e22-4d46-b664-19d2ac0482ad tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] Booting with volume 64198cbd-5b4a-4ca5-bb06-b6553335edb3 at /dev/vda
Apr 14 10:59:11 user nova-compute[71509]: DEBUG nova.policy [None req-e60ef001-4e22-4d46-b664-19d2ac0482ad tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5873a358bf544691b12cd2979f5e36dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ea2cb4dfa5b4a52b658efd8f5aefb36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71509) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 10:59:11 user nova-compute[71509]: DEBUG os_brick.utils [None req-e60ef001-4e22-4d46-b664-19d2ac0482ad tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 10:59:11 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:59:11 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:59:11 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdd249ab-6776-48e3-bb94-c9ab658c376b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50119df3c417\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:59:11 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:59:11 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:59:11 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[47cde77c-d59d-456a-abb3-9120ce80ca32]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:59:11 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:59:11 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:59:11 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d3dcba7-22ca-434b-9f07-3221acaf617e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:59:11 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c08a7d1-82c8-47fc-944d-de53b2adfa00]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:59:11 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-e60ef001-4e22-4d46-b664-19d2ac0482ad tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Running cmd (subprocess): nvme version {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:59:11 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-e60ef001-4e22-4d46-b664-19d2ac0482ad tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] 'nvme version' failed. Not Retrying. {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 10:59:11 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e60ef001-4e22-4d46-b664-19d2ac0482ad tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] nvme not present on system {{(pid=71509) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 10:59:11 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:59:11 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 10:59:11 user nova-compute[71509]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 10:59:11 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab3ffae6-7fc6-407b-9e85-6f39379bd7cb]: (4, '') {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:59:12 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-e60ef001-4e22-4d46-b664-19d2ac0482ad tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71509) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 10:59:12 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-e60ef001-4e22-4d46-b664-19d2ac0482ad tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71509) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 10:59:12 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-e60ef001-4e22-4d46-b664-19d2ac0482ad tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] LIGHTOS: no hostnqn found. {{(pid=71509) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 10:59:12 user nova-compute[71509]: DEBUG os_brick.utils [None req-e60ef001-4e22-4d46-b664-19d2ac0482ad tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50119df3c417', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 10:59:12 user nova-compute[71509]: DEBUG nova.virt.block_device [None req-e60ef001-4e22-4d46-b664-19d2ac0482ad tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] Updating existing volume attachment record: 9b0b2922-489f-4202-8bd3-bc90baf0d2f4 {{(pid=71509) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 10:59:12 user nova-compute[71509]: DEBUG nova.network.neutron [None req-e60ef001-4e22-4d46-b664-19d2ac0482ad tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] Successfully created port: 1e547ec7-7efd-480f-84be-806c8cf25b90 {{(pid=71509) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 10:59:12 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:59:13 user nova-compute[71509]: DEBUG nova.network.neutron [None req-e60ef001-4e22-4d46-b664-19d2ac0482ad tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] Successfully updated port: 1e547ec7-7efd-480f-84be-806c8cf25b90 {{(pid=71509) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 10:59:13 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:59:13 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-e60ef001-4e22-4d46-b664-19d2ac0482ad tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "refresh_cache-3db2e71c-939b-4d2f-b1be-c2122f7cd73e" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:59:13 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-e60ef001-4e22-4d46-b664-19d2ac0482ad tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquired lock "refresh_cache-3db2e71c-939b-4d2f-b1be-c2122f7cd73e" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:59:13 user nova-compute[71509]: DEBUG nova.network.neutron [None req-e60ef001-4e22-4d46-b664-19d2ac0482ad tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] Building network info cache for instance {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 10:59:13 user nova-compute[71509]: DEBUG nova.compute.manager [req-e1a1d86b-b067-41da-8670-b45fee9697e5 req-5b9ad1d7-ba5e-45ef-9f21-b2598b038d65 service nova] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] Received event network-changed-1e547ec7-7efd-480f-84be-806c8cf25b90 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:59:13 user nova-compute[71509]: DEBUG nova.compute.manager [req-e1a1d86b-b067-41da-8670-b45fee9697e5 req-5b9ad1d7-ba5e-45ef-9f21-b2598b038d65 service nova] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] Refreshing instance network info cache due to event network-changed-1e547ec7-7efd-480f-84be-806c8cf25b90. {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 10:59:13 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-e1a1d86b-b067-41da-8670-b45fee9697e5 req-5b9ad1d7-ba5e-45ef-9f21-b2598b038d65 service nova] Acquiring lock "refresh_cache-3db2e71c-939b-4d2f-b1be-c2122f7cd73e" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:59:13 user nova-compute[71509]: DEBUG nova.network.neutron [None req-e60ef001-4e22-4d46-b664-19d2ac0482ad tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] Instance cache missing network info. {{(pid=71509) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 10:59:13 user nova-compute[71509]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681469938.3504288, fe152ebd-4f99-4fa8-bfdb-8744cdf3f387 => Stopped> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 10:59:13 user nova-compute[71509]: INFO nova.compute.manager [-] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] VM Stopped (Lifecycle Event)
Apr 14 10:59:13 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1b84baca-76f3-44be-a39c-0073c80807de None None] [instance: fe152ebd-4f99-4fa8-bfdb-8744cdf3f387] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:59:13 user nova-compute[71509]: DEBUG nova.network.neutron [None req-e60ef001-4e22-4d46-b664-19d2ac0482ad tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] Updating instance_info_cache with network_info: [{"id": "1e547ec7-7efd-480f-84be-806c8cf25b90", "address": "fa:16:3e:34:08:47", "network": {"id": "18a91434-637b-4c19-a97b-736b32c1ea5a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1824162811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea2cb4dfa5b4a52b658efd8f5aefb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e547ec7-7e", "ovs_interfaceid": "1e547ec7-7efd-480f-84be-806c8cf25b90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:59:13 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-e60ef001-4e22-4d46-b664-19d2ac0482ad tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Releasing lock "refresh_cache-3db2e71c-939b-4d2f-b1be-c2122f7cd73e" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:59:13 user nova-compute[71509]: DEBUG nova.compute.manager [None req-e60ef001-4e22-4d46-b664-19d2ac0482ad tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] Instance network_info: |[{"id": "1e547ec7-7efd-480f-84be-806c8cf25b90", "address": "fa:16:3e:34:08:47", "network": {"id": "18a91434-637b-4c19-a97b-736b32c1ea5a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1824162811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea2cb4dfa5b4a52b658efd8f5aefb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e547ec7-7e", "ovs_interfaceid": "1e547ec7-7efd-480f-84be-806c8cf25b90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71509) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 10:59:13 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-e1a1d86b-b067-41da-8670-b45fee9697e5 req-5b9ad1d7-ba5e-45ef-9f21-b2598b038d65 service nova] Acquired lock "refresh_cache-3db2e71c-939b-4d2f-b1be-c2122f7cd73e" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:59:13 user nova-compute[71509]: DEBUG nova.network.neutron [req-e1a1d86b-b067-41da-8670-b45fee9697e5 req-5b9ad1d7-ba5e-45ef-9f21-b2598b038d65 service nova] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] Refreshing network info cache for port 1e547ec7-7efd-480f-84be-806c8cf25b90 {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 10:59:14 user nova-compute[71509]: DEBUG nova.network.neutron [req-e1a1d86b-b067-41da-8670-b45fee9697e5 req-5b9ad1d7-ba5e-45ef-9f21-b2598b038d65 service nova] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] Updated VIF entry in instance network info cache for port 1e547ec7-7efd-480f-84be-806c8cf25b90. {{(pid=71509) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 10:59:14 user nova-compute[71509]: DEBUG nova.network.neutron [req-e1a1d86b-b067-41da-8670-b45fee9697e5 req-5b9ad1d7-ba5e-45ef-9f21-b2598b038d65 service nova] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] Updating instance_info_cache with network_info: [{"id": "1e547ec7-7efd-480f-84be-806c8cf25b90", "address": "fa:16:3e:34:08:47", "network": {"id": "18a91434-637b-4c19-a97b-736b32c1ea5a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1824162811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea2cb4dfa5b4a52b658efd8f5aefb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e547ec7-7e", "ovs_interfaceid": "1e547ec7-7efd-480f-84be-806c8cf25b90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:59:14 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-e1a1d86b-b067-41da-8670-b45fee9697e5 req-5b9ad1d7-ba5e-45ef-9f21-b2598b038d65 service nova] Releasing lock "refresh_cache-3db2e71c-939b-4d2f-b1be-c2122f7cd73e" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:59:16 user nova-compute[71509]: DEBUG nova.compute.manager [None req-e60ef001-4e22-4d46-b664-19d2ac0482ad tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] Start spawning the instance on the hypervisor. {{(pid=71509) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 10:59:16 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-e60ef001-4e22-4d46-b664-19d2ac0482ad tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] Creating instance directory {{(pid=71509) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 10:59:16 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-e60ef001-4e22-4d46-b664-19d2ac0482ad tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] Creating image(s)
Apr 14 10:59:16 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-e60ef001-4e22-4d46-b664-19d2ac0482ad tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] Did not create local disks {{(pid=71509) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 10:59:16 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-e60ef001-4e22-4d46-b664-19d2ac0482ad tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] Ensure instance console log exists: /opt/stack/data/nova/instances/3db2e71c-939b-4d2f-b1be-c2122f7cd73e/console.log {{(pid=71509) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 10:59:16 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-e60ef001-4e22-4d46-b664-19d2ac0482ad tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:59:16 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-e60ef001-4e22-4d46-b664-19d2ac0482ad tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:59:16 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-e60ef001-4e22-4d46-b664-19d2ac0482ad tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:59:16 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-e60ef001-4e22-4d46-b664-19d2ac0482ad tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] Start _get_guest_xml network_info=[{"id": "1e547ec7-7efd-480f-84be-806c8cf25b90", "address": "fa:16:3e:34:08:47", "network": {"id": "18a91434-637b-4c19-a97b-736b32c1ea5a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1824162811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea2cb4dfa5b4a52b658efd8f5aefb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e547ec7-7e", "ovs_interfaceid": "1e547ec7-7efd-480f-84be-806c8cf25b90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'attachment_id': '9b0b2922-489f-4202-8bd3-bc90baf0d2f4', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vfPCIMcj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3db2e71c-939b-4d2f-b1be-c2122f7cd73e', 'attached_at': '', 'detached_at': '', 'volume_id': '64198cbd-5b4a-4ca5-bb06-b6553335edb3', 'serial': '64198cbd-5b4a-4ca5-bb06-b6553335edb3'}, 'disk_bus': 'virtio', 'delete_on_termination': True, 'volume_type': None} {{(pid=71509) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 10:59:16 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-e60ef001-4e22-4d46-b664-19d2ac0482ad tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:59:16 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-e60ef001-4e22-4d46-b664-19d2ac0482ad tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:59:16 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-e60ef001-4e22-4d46-b664-19d2ac0482ad tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71509) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 10:59:16 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-e60ef001-4e22-4d46-b664-19d2ac0482ad tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T10:40:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 10:59:16 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-e60ef001-4e22-4d46-b664-19d2ac0482ad tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Flavor limits 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 10:59:16 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-e60ef001-4e22-4d46-b664-19d2ac0482ad tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Image limits 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 10:59:16 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-e60ef001-4e22-4d46-b664-19d2ac0482ad tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Flavor pref 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 10:59:16 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-e60ef001-4e22-4d46-b664-19d2ac0482ad tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Image pref 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 10:59:16 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-e60ef001-4e22-4d46-b664-19d2ac0482ad tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 10:59:16 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-e60ef001-4e22-4d46-b664-19d2ac0482ad tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 10:59:16 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-e60ef001-4e22-4d46-b664-19d2ac0482ad tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71509) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 10:59:16 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-e60ef001-4e22-4d46-b664-19d2ac0482ad tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Got 1 possible topologies {{(pid=71509) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 10:59:16 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-e60ef001-4e22-4d46-b664-19d2ac0482ad tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 10:59:16 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-e60ef001-4e22-4d46-b664-19d2ac0482ad tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 10:59:16 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e60ef001-4e22-4d46-b664-19d2ac0482ad tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] Calling os-brick to attach iSCSI Volume {{(pid=71509) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 10:59:16 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-e60ef001-4e22-4d46-b664-19d2ac0482ad tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0bf0749390>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vfPCIMcj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 10:59:16 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-e60ef001-4e22-4d46-b664-19d2ac0482ad tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 10:59:16 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-e60ef001-4e22-4d46-b664-19d2ac0482ad tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 10:59:16 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-e60ef001-4e22-4d46-b664-19d2ac0482ad tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 10:59:16 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-e60ef001-4e22-4d46-b664-19d2ac0482ad tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 10:59:16 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-e60ef001-4e22-4d46-b664-19d2ac0482ad tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 10:59:16 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-e60ef001-4e22-4d46-b664-19d2ac0482ad tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 10:59:16 user nova-compute[71509]: INFO os_brick.initiator.connectors.iscsi [None req-e60ef001-4e22-4d46-b664-19d2ac0482ad tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 10:59:16 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3 -p 172.16.0.220:3260 {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:59:16 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:59:16 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5a3af4d-10e3-4e8a-b53c-33ded171a557]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:59:16 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-e60ef001-4e22-4d46-b664-19d2ac0482ad tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 10:59:16 user nova-compute[71509]:  {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:59:16 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3 -p 172.16.0.220:3260 --interface default --op new {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:59:16 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:59:16 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[67845b02-ea92-4b0b-a1d2-e2f1465fede7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3] added\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:59:16 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-e60ef001-4e22-4d46-b664-19d2ac0482ad tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3] added
Apr 14 10:59:16 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:59:16 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:59:16 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:59:16 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a033d13-1bc6-45f2-9ed3-199155bffae8]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:59:16 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-e60ef001-4e22-4d46-b664-19d2ac0482ad tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:59:16 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:59:16 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:59:16 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fa68e1e-1e36-4d1f-acc3-ebaa3d2b5bd9]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:59:16 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-e60ef001-4e22-4d46-b664-19d2ac0482ad tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:59:16 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vfPCIMcj {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:59:16 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vfPCIMcj" returned: 0 in 0.023s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:59:16 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[59901cf9-1fd7-4110-9e4b-1bcb235d9c1e]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:59:16 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-e60ef001-4e22-4d46-b664-19d2ac0482ad tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vfPCIMcj'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:59:16 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:59:16 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:59:16 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[8abd222a-21c1-469d-9ea2-cc498f270105]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:59:16 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-e60ef001-4e22-4d46-b664-19d2ac0482ad tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:59:16 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:59:16 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:59:16 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b4e02d2-c75f-4a0f-a87c-8981b13ef279]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219 (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:59:16 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-e60ef001-4e22-4d46-b664-19d2ac0482ad tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)
Apr 14 10:59:16 user nova-compute[71509]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219 (non-flash)
Apr 14 10:59:16 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:59:16 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-e60ef001-4e22-4d46-b664-19d2ac0482ad tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)
Apr 14 10:59:16 user nova-compute[71509]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219 (non-flash)
Apr 14 10:59:16 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 10:59:16 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3 -p 172.16.0.220:3260 --login {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:59:16 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:59:16 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fc267f5-83ff-4c38-a4b4-f1a0aa9ebd2d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:59:16 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-e60ef001-4e22-4d46-b664-19d2ac0482ad tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3, portal: 172.16.0.220,3260]
Apr 14 10:59:16 user nova-compute[71509]: Login to [iface: default, target: iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3, portal: 172.16.0.220,3260] successful.
Apr 14 10:59:16 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:59:16 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:59:16 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.063s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:59:16 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[3129f368-4426-4425-a386-720e9cd76610]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:59:16 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-e60ef001-4e22-4d46-b664-19d2ac0482ad tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:59:16 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:59:17 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:59:17 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[871d99a2-3ee2-4b13-bbf4-faf3ef955825]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3 (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:59:17 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-e60ef001-4e22-4d46-b664-19d2ac0482ad tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)
Apr 14 10:59:17 user nova-compute[71509]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219 (non-flash)
Apr 14 10:59:17 user nova-compute[71509]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3 (non-flash)
Apr 14 10:59:17 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:59:17 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-e60ef001-4e22-4d46-b664-19d2ac0482ad tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)
Apr 14 10:59:17 user nova-compute[71509]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219 (non-flash)
Apr 14 10:59:17 user nova-compute[71509]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3 (non-flash)
Apr 14 10:59:17 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 10:59:17 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-e60ef001-4e22-4d46-b664-19d2ac0482ad tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.327s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 10:59:17 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-e60ef001-4e22-4d46-b664-19d2ac0482ad tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Connected to 172.16.0.220:3260 {{(pid=71509) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 10:59:17 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-e60ef001-4e22-4d46-b664-19d2ac0482ad tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] HCTL ('34', '-', '-', 0) found on session 38 with lun 0 {{(pid=71509) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 10:59:17 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-e60ef001-4e22-4d46-b664-19d2ac0482ad tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71509) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 10:59:17 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:59:17 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:59:17 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b3ec789-7f2e-4fe1-9b11-adb2e2db48c6]: (4, ('- - 0', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:59:17 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-e60ef001-4e22-4d46-b664-19d2ac0482ad tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Searching for a device in session 38 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71509) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 10:59:17 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-e60ef001-4e22-4d46-b664-19d2ac0482ad tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vfPCIMcj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71509) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 10:59:17 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:59:18 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-e60ef001-4e22-4d46-b664-19d2ac0482ad tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.360s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 10:59:18 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-e60ef001-4e22-4d46-b664-19d2ac0482ad tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] <== connect_volume: return (1362ms) {'type': 'block', 'scsi_wwn': '26664386137333064', 'path': '/dev/sdc'} {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 10:59:18 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e60ef001-4e22-4d46-b664-19d2ac0482ad tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26664386137333064', 'path': '/dev/sdc'} {{(pid=71509) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 10:59:18 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-e60ef001-4e22-4d46-b664-19d2ac0482ad tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T10:59:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1613655632',display_name='tempest-ServerActionsTestJSON-server-1613655632',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1613655632',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNt/FyD1XXsxB5kJC+SJ1dgkjoXXHkL+KX0Cr5HvI72xTIz+DAtuVRPHeIpMNLt39mbbZ9KAoCJibRQza0Qbd8j8EEoV7QHombhWz2Mdusr+gJ2OYTqrrRzVbjIHACTFWw==',key_name='tempest-keypair-1544270235',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ea2cb4dfa5b4a52b658efd8f5aefb36',ramdisk_id='',reservation_id='r-fwmcktqp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-1923052090',owner_user_name='tempest-ServerActionsTestJSON-1923052090-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T10:59:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5873a358bf544691b12cd2979f5e36dc',uuid=3db2e71c-939b-4d2f-b1be-c2122f7cd73e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1e547ec7-7efd-480f-84be-806c8cf25b90", "address": "fa:16:3e:34:08:47", "network": {"id": "18a91434-637b-4c19-a97b-736b32c1ea5a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1824162811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea2cb4dfa5b4a52b658efd8f5aefb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e547ec7-7e", "ovs_interfaceid": "1e547ec7-7efd-480f-84be-806c8cf25b90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71509) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 10:59:18 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-e60ef001-4e22-4d46-b664-19d2ac0482ad tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Converting VIF {"id": "1e547ec7-7efd-480f-84be-806c8cf25b90", "address": "fa:16:3e:34:08:47", "network": {"id": "18a91434-637b-4c19-a97b-736b32c1ea5a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1824162811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea2cb4dfa5b4a52b658efd8f5aefb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e547ec7-7e", "ovs_interfaceid": "1e547ec7-7efd-480f-84be-806c8cf25b90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:59:18 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-e60ef001-4e22-4d46-b664-19d2ac0482ad tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:08:47,bridge_name='br-int',has_traffic_filtering=True,id=1e547ec7-7efd-480f-84be-806c8cf25b90,network=Network(18a91434-637b-4c19-a97b-736b32c1ea5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e547ec7-7e') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:59:18 user nova-compute[71509]: DEBUG nova.objects.instance [None req-e60ef001-4e22-4d46-b664-19d2ac0482ad tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lazy-loading 'pci_devices' on Instance uuid 3db2e71c-939b-4d2f-b1be-c2122f7cd73e {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:59:18 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-e60ef001-4e22-4d46-b664-19d2ac0482ad tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] End _get_guest_xml xml=<domain type="kvm">
Apr 14 10:59:18 user nova-compute[71509]:   <uuid>3db2e71c-939b-4d2f-b1be-c2122f7cd73e</uuid>
Apr 14 10:59:18 user nova-compute[71509]:   <name>instance-00000023</name>
Apr 14 10:59:18 user nova-compute[71509]:   <memory>131072</memory>
Apr 14 10:59:18 user nova-compute[71509]:   <vcpu>1</vcpu>
Apr 14 10:59:18 user nova-compute[71509]:   <metadata>
Apr 14 10:59:18 user nova-compute[71509]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 10:59:18 user nova-compute[71509]:       <nova:package version="0.0.0"/>
Apr 14 10:59:18 user nova-compute[71509]:       <nova:name>tempest-ServerActionsTestJSON-server-1613655632</nova:name>
Apr 14 10:59:18 user nova-compute[71509]:       <nova:creationTime>2023-04-14 10:59:16</nova:creationTime>
Apr 14 10:59:18 user nova-compute[71509]:       <nova:flavor name="m1.nano">
Apr 14 10:59:18 user nova-compute[71509]:         <nova:memory>128</nova:memory>
Apr 14 10:59:18 user nova-compute[71509]:         <nova:disk>1</nova:disk>
Apr 14 10:59:18 user nova-compute[71509]:         <nova:swap>0</nova:swap>
Apr 14 10:59:18 user nova-compute[71509]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 10:59:18 user nova-compute[71509]:         <nova:vcpus>1</nova:vcpus>
Apr 14 10:59:18 user nova-compute[71509]:       </nova:flavor>
Apr 14 10:59:18 user nova-compute[71509]:       <nova:owner>
Apr 14 10:59:18 user nova-compute[71509]:         <nova:user uuid="5873a358bf544691b12cd2979f5e36dc">tempest-ServerActionsTestJSON-1923052090-project-member</nova:user>
Apr 14 10:59:18 user nova-compute[71509]:         <nova:project uuid="3ea2cb4dfa5b4a52b658efd8f5aefb36">tempest-ServerActionsTestJSON-1923052090</nova:project>
Apr 14 10:59:18 user nova-compute[71509]:       </nova:owner>
Apr 14 10:59:18 user nova-compute[71509]:       <nova:ports>
Apr 14 10:59:18 user nova-compute[71509]:         <nova:port uuid="1e547ec7-7efd-480f-84be-806c8cf25b90">
Apr 14 10:59:18 user nova-compute[71509]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 14 10:59:18 user nova-compute[71509]:         </nova:port>
Apr 14 10:59:18 user nova-compute[71509]:       </nova:ports>
Apr 14 10:59:18 user nova-compute[71509]:     </nova:instance>
Apr 14 10:59:18 user nova-compute[71509]:   </metadata>
Apr 14 10:59:18 user nova-compute[71509]:   <sysinfo type="smbios">
Apr 14 10:59:18 user nova-compute[71509]:     <system>
Apr 14 10:59:18 user nova-compute[71509]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 10:59:18 user nova-compute[71509]:       <entry name="product">OpenStack Nova</entry>
Apr 14 10:59:18 user nova-compute[71509]:       <entry name="version">0.0.0</entry>
Apr 14 10:59:18 user nova-compute[71509]:       <entry name="serial">3db2e71c-939b-4d2f-b1be-c2122f7cd73e</entry>
Apr 14 10:59:18 user nova-compute[71509]:       <entry name="uuid">3db2e71c-939b-4d2f-b1be-c2122f7cd73e</entry>
Apr 14 10:59:18 user nova-compute[71509]:       <entry name="family">Virtual Machine</entry>
Apr 14 10:59:18 user nova-compute[71509]:     </system>
Apr 14 10:59:18 user nova-compute[71509]:   </sysinfo>
Apr 14 10:59:18 user nova-compute[71509]:   <os>
Apr 14 10:59:18 user nova-compute[71509]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 10:59:18 user nova-compute[71509]:     <boot dev="hd"/>
Apr 14 10:59:18 user nova-compute[71509]:     <smbios mode="sysinfo"/>
Apr 14 10:59:18 user nova-compute[71509]:   </os>
Apr 14 10:59:18 user nova-compute[71509]:   <features>
Apr 14 10:59:18 user nova-compute[71509]:     <acpi/>
Apr 14 10:59:18 user nova-compute[71509]:     <apic/>
Apr 14 10:59:18 user nova-compute[71509]:     <vmcoreinfo/>
Apr 14 10:59:18 user nova-compute[71509]:   </features>
Apr 14 10:59:18 user nova-compute[71509]:   <clock offset="utc">
Apr 14 10:59:18 user nova-compute[71509]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 10:59:18 user nova-compute[71509]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 10:59:18 user nova-compute[71509]:     <timer name="hpet" present="no"/>
Apr 14 10:59:18 user nova-compute[71509]:   </clock>
Apr 14 10:59:18 user nova-compute[71509]:   <cpu mode="custom" match="exact">
Apr 14 10:59:18 user nova-compute[71509]:     <model>Nehalem</model>
Apr 14 10:59:18 user nova-compute[71509]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 10:59:18 user nova-compute[71509]:   </cpu>
Apr 14 10:59:18 user nova-compute[71509]:   <devices>
Apr 14 10:59:18 user nova-compute[71509]:     <disk type="block" device="disk">
Apr 14 10:59:18 user nova-compute[71509]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 10:59:18 user nova-compute[71509]:       <source dev="/dev/sdc"/>
Apr 14 10:59:18 user nova-compute[71509]:       <target dev="vda" bus="virtio"/>
Apr 14 10:59:18 user nova-compute[71509]:       <serial>64198cbd-5b4a-4ca5-bb06-b6553335edb3</serial>
Apr 14 10:59:18 user nova-compute[71509]:     </disk>
Apr 14 10:59:18 user nova-compute[71509]:     <interface type="ethernet">
Apr 14 10:59:18 user nova-compute[71509]:       <mac address="fa:16:3e:34:08:47"/>
Apr 14 10:59:18 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 10:59:18 user nova-compute[71509]:       <mtu size="1442"/>
Apr 14 10:59:18 user nova-compute[71509]:       <target dev="tap1e547ec7-7e"/>
Apr 14 10:59:18 user nova-compute[71509]:     </interface>
Apr 14 10:59:18 user nova-compute[71509]:     <serial type="pty">
Apr 14 10:59:18 user nova-compute[71509]:       <log file="/opt/stack/data/nova/instances/3db2e71c-939b-4d2f-b1be-c2122f7cd73e/console.log" append="off"/>
Apr 14 10:59:18 user nova-compute[71509]:     </serial>
Apr 14 10:59:18 user nova-compute[71509]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 10:59:18 user nova-compute[71509]:     <video>
Apr 14 10:59:18 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 10:59:18 user nova-compute[71509]:     </video>
Apr 14 10:59:18 user nova-compute[71509]:     <rng model="virtio">
Apr 14 10:59:18 user nova-compute[71509]:       <backend model="random">/dev/urandom</backend>
Apr 14 10:59:18 user nova-compute[71509]:     </rng>
Apr 14 10:59:18 user nova-compute[71509]:     <controller type="usb" index="0" model="none"/>
Apr 14 10:59:18 user nova-compute[71509]:     <memballoon model="virtio">
Apr 14 10:59:18 user nova-compute[71509]:       <stats period="10"/>
Apr 14 10:59:18 user nova-compute[71509]:     </memballoon>
Apr 14 10:59:18 user nova-compute[71509]:   </devices>
Apr 14 10:59:18 user nova-compute[71509]: </domain>
Apr 14 10:59:18 user nova-compute[71509]:  {{(pid=71509) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 10:59:18 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-e60ef001-4e22-4d46-b664-19d2ac0482ad tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T10:59:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1613655632',display_name='tempest-ServerActionsTestJSON-server-1613655632',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1613655632',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNt/FyD1XXsxB5kJC+SJ1dgkjoXXHkL+KX0Cr5HvI72xTIz+DAtuVRPHeIpMNLt39mbbZ9KAoCJibRQza0Qbd8j8EEoV7QHombhWz2Mdusr+gJ2OYTqrrRzVbjIHACTFWw==',key_name='tempest-keypair-1544270235',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ea2cb4dfa5b4a52b658efd8f5aefb36',ramdisk_id='',reservation_id='r-fwmcktqp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestJSON-1923052090',owner_user_name='tempest-ServerActionsTestJSON-1923052090-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T10:59:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5873a358bf544691b12cd2979f5e36dc',uuid=3db2e71c-939b-4d2f-b1be-c2122f7cd73e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1e547ec7-7efd-480f-84be-806c8cf25b90", "address": "fa:16:3e:34:08:47", "network": {"id": "18a91434-637b-4c19-a97b-736b32c1ea5a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1824162811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea2cb4dfa5b4a52b658efd8f5aefb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e547ec7-7e", "ovs_interfaceid": "1e547ec7-7efd-480f-84be-806c8cf25b90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 10:59:18 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-e60ef001-4e22-4d46-b664-19d2ac0482ad tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Converting VIF {"id": "1e547ec7-7efd-480f-84be-806c8cf25b90", "address": "fa:16:3e:34:08:47", "network": {"id": "18a91434-637b-4c19-a97b-736b32c1ea5a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1824162811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea2cb4dfa5b4a52b658efd8f5aefb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e547ec7-7e", "ovs_interfaceid": "1e547ec7-7efd-480f-84be-806c8cf25b90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:59:18 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-e60ef001-4e22-4d46-b664-19d2ac0482ad tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:08:47,bridge_name='br-int',has_traffic_filtering=True,id=1e547ec7-7efd-480f-84be-806c8cf25b90,network=Network(18a91434-637b-4c19-a97b-736b32c1ea5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e547ec7-7e') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:59:18 user nova-compute[71509]: DEBUG os_vif [None req-e60ef001-4e22-4d46-b664-19d2ac0482ad tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:08:47,bridge_name='br-int',has_traffic_filtering=True,id=1e547ec7-7efd-480f-84be-806c8cf25b90,network=Network(18a91434-637b-4c19-a97b-736b32c1ea5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e547ec7-7e') {{(pid=71509) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 10:59:18 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:59:18 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:59:18 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 10:59:18 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:59:18 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1e547ec7-7e, may_exist=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:59:18 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1e547ec7-7e, col_values=(('external_ids', {'iface-id': '1e547ec7-7efd-480f-84be-806c8cf25b90', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:34:08:47', 'vm-uuid': '3db2e71c-939b-4d2f-b1be-c2122f7cd73e'}),)) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:59:18 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:59:18 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 10:59:18 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:59:18 user nova-compute[71509]: INFO os_vif [None req-e60ef001-4e22-4d46-b664-19d2ac0482ad tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:08:47,bridge_name='br-int',has_traffic_filtering=True,id=1e547ec7-7efd-480f-84be-806c8cf25b90,network=Network(18a91434-637b-4c19-a97b-736b32c1ea5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e547ec7-7e')
Apr 14 10:59:18 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-e60ef001-4e22-4d46-b664-19d2ac0482ad tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] No BDM found with device name vda, not building metadata. {{(pid=71509) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 10:59:18 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-e60ef001-4e22-4d46-b664-19d2ac0482ad tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] No VIF found with MAC fa:16:3e:34:08:47, not building metadata {{(pid=71509) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 10:59:18 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._sync_power_states {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:59:18 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:59:19 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:59:19 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:59:19 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:59:19 user nova-compute[71509]: DEBUG nova.compute.manager [req-5ede43f3-92e2-432f-8b3b-2ef983919b5e req-c79c4ab3-d4ee-4a12-820e-2bc0542d50c6 service nova] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] Received event network-vif-plugged-1e547ec7-7efd-480f-84be-806c8cf25b90 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:59:19 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-5ede43f3-92e2-432f-8b3b-2ef983919b5e req-c79c4ab3-d4ee-4a12-820e-2bc0542d50c6 service nova] Acquiring lock "3db2e71c-939b-4d2f-b1be-c2122f7cd73e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:59:19 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-5ede43f3-92e2-432f-8b3b-2ef983919b5e req-c79c4ab3-d4ee-4a12-820e-2bc0542d50c6 service nova] Lock "3db2e71c-939b-4d2f-b1be-c2122f7cd73e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:59:19 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-5ede43f3-92e2-432f-8b3b-2ef983919b5e req-c79c4ab3-d4ee-4a12-820e-2bc0542d50c6 service nova] Lock "3db2e71c-939b-4d2f-b1be-c2122f7cd73e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:59:19 user nova-compute[71509]: DEBUG nova.compute.manager [req-5ede43f3-92e2-432f-8b3b-2ef983919b5e req-c79c4ab3-d4ee-4a12-820e-2bc0542d50c6 service nova] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] No waiting events found dispatching network-vif-plugged-1e547ec7-7efd-480f-84be-806c8cf25b90 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:59:19 user nova-compute[71509]: WARNING nova.compute.manager [req-5ede43f3-92e2-432f-8b3b-2ef983919b5e req-c79c4ab3-d4ee-4a12-820e-2bc0542d50c6 service nova] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] Received unexpected event network-vif-plugged-1e547ec7-7efd-480f-84be-806c8cf25b90 for instance with vm_state building and task_state spawning.
Apr 14 10:59:19 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:59:19 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:59:19 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Triggering sync for uuid 97f20661-8b60-439e-b7af-2fc2013c5ade {{(pid=71509) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 10:59:19 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Triggering sync for uuid e479154a-acd6-47aa-9a5b-43c6e0feda07 {{(pid=71509) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 10:59:19 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Triggering sync for uuid 6cae9f61-763f-4671-a873-d15f01384416 {{(pid=71509) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 10:59:19 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Triggering sync for uuid 6f41f217-0df2-4205-9633-7dbe83f40c96 {{(pid=71509) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 10:59:19 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Triggering sync for uuid e6580716-8a6a-4dfa-8978-ed54b92af1fe {{(pid=71509) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 10:59:19 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Triggering sync for uuid a936fb20-3f17-4114-829a-8659da6bc5f3 {{(pid=71509) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 10:59:19 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Triggering sync for uuid 0dd9e11f-1fed-42af-ad5c-9cdd051b93e7 {{(pid=71509) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 10:59:19 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Triggering sync for uuid 0bb99276-64ba-4641-8869-3f35eea2f76e {{(pid=71509) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 10:59:19 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Triggering sync for uuid ef413492-c781-459e-b99c-46a530034c94 {{(pid=71509) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 10:59:19 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Triggering sync for uuid 3d6a53c3-6e32-456c-a056-fbf1bef3b656 {{(pid=71509) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 10:59:19 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Triggering sync for uuid fbcca78c-fe73-4ef1-92f9-4c8061cad177 {{(pid=71509) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 10:59:19 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Triggering sync for uuid 3db2e71c-939b-4d2f-b1be-c2122f7cd73e {{(pid=71509) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 10:59:19 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "97f20661-8b60-439e-b7af-2fc2013c5ade" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:59:19 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "97f20661-8b60-439e-b7af-2fc2013c5ade" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:59:19 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "e479154a-acd6-47aa-9a5b-43c6e0feda07" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:59:19 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "e479154a-acd6-47aa-9a5b-43c6e0feda07" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:59:19 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "6cae9f61-763f-4671-a873-d15f01384416" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:59:19 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "6cae9f61-763f-4671-a873-d15f01384416" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:59:19 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "6f41f217-0df2-4205-9633-7dbe83f40c96" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:59:19 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "6f41f217-0df2-4205-9633-7dbe83f40c96" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:59:19 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "e6580716-8a6a-4dfa-8978-ed54b92af1fe" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:59:19 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "e6580716-8a6a-4dfa-8978-ed54b92af1fe" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:59:19 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "a936fb20-3f17-4114-829a-8659da6bc5f3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:59:19 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "a936fb20-3f17-4114-829a-8659da6bc5f3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:59:19 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "0dd9e11f-1fed-42af-ad5c-9cdd051b93e7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:59:19 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "0dd9e11f-1fed-42af-ad5c-9cdd051b93e7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:59:19 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "0bb99276-64ba-4641-8869-3f35eea2f76e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:59:19 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "0bb99276-64ba-4641-8869-3f35eea2f76e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:59:19 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "ef413492-c781-459e-b99c-46a530034c94" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:59:19 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "ef413492-c781-459e-b99c-46a530034c94" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:59:19 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "3d6a53c3-6e32-456c-a056-fbf1bef3b656" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:59:19 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "3d6a53c3-6e32-456c-a056-fbf1bef3b656" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:59:19 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "fbcca78c-fe73-4ef1-92f9-4c8061cad177" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:59:19 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "fbcca78c-fe73-4ef1-92f9-4c8061cad177" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:59:19 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "3db2e71c-939b-4d2f-b1be-c2122f7cd73e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:59:19 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "97f20661-8b60-439e-b7af-2fc2013c5ade" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.040s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:59:19 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "6cae9f61-763f-4671-a873-d15f01384416" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.042s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:59:19 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "e479154a-acd6-47aa-9a5b-43c6e0feda07" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.053s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:59:19 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "6f41f217-0df2-4205-9633-7dbe83f40c96" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.051s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:59:19 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "e6580716-8a6a-4dfa-8978-ed54b92af1fe" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.055s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:59:19 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "0bb99276-64ba-4641-8869-3f35eea2f76e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.061s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:59:19 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "0dd9e11f-1fed-42af-ad5c-9cdd051b93e7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.065s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:59:19 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "ef413492-c781-459e-b99c-46a530034c94" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.074s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:59:19 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "3d6a53c3-6e32-456c-a056-fbf1bef3b656" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.077s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:59:19 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "a936fb20-3f17-4114-829a-8659da6bc5f3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.081s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:59:19 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "fbcca78c-fe73-4ef1-92f9-4c8061cad177" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.085s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:59:21 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681469961.5480165, 3db2e71c-939b-4d2f-b1be-c2122f7cd73e => Resumed> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 10:59:21 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] VM Resumed (Lifecycle Event)
Apr 14 10:59:21 user nova-compute[71509]: DEBUG nova.compute.manager [None req-e60ef001-4e22-4d46-b664-19d2ac0482ad tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] Instance event wait completed in 0 seconds for  {{(pid=71509) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 10:59:21 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-e60ef001-4e22-4d46-b664-19d2ac0482ad tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] Guest created on hypervisor {{(pid=71509) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 10:59:21 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] Instance spawned successfully.
Apr 14 10:59:21 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-e60ef001-4e22-4d46-b664-19d2ac0482ad tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 10:59:21 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:59:21 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 10:59:21 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-e60ef001-4e22-4d46-b664-19d2ac0482ad tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] Found default for hw_cdrom_bus of ide {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:59:21 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-e60ef001-4e22-4d46-b664-19d2ac0482ad tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] Found default for hw_disk_bus of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:59:21 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-e60ef001-4e22-4d46-b664-19d2ac0482ad tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] Found default for hw_input_bus of None {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:59:21 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-e60ef001-4e22-4d46-b664-19d2ac0482ad tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] Found default for hw_pointer_model of None {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:59:21 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-e60ef001-4e22-4d46-b664-19d2ac0482ad tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] Found default for hw_video_model of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:59:21 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-e60ef001-4e22-4d46-b664-19d2ac0482ad tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] Found default for hw_vif_model of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 10:59:21 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 10:59:21 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681469961.5516732, 3db2e71c-939b-4d2f-b1be-c2122f7cd73e => Started> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 10:59:21 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] VM Started (Lifecycle Event)
Apr 14 10:59:21 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:59:21 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 10:59:21 user nova-compute[71509]: DEBUG nova.compute.manager [req-4a1d1596-3afb-42b5-9767-450fa1b59fc4 req-96066298-4723-4039-9846-3bdfe72aed64 service nova] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] Received event network-vif-plugged-1e547ec7-7efd-480f-84be-806c8cf25b90 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:59:21 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-4a1d1596-3afb-42b5-9767-450fa1b59fc4 req-96066298-4723-4039-9846-3bdfe72aed64 service nova] Acquiring lock "3db2e71c-939b-4d2f-b1be-c2122f7cd73e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:59:21 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-4a1d1596-3afb-42b5-9767-450fa1b59fc4 req-96066298-4723-4039-9846-3bdfe72aed64 service nova] Lock "3db2e71c-939b-4d2f-b1be-c2122f7cd73e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:59:21 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-4a1d1596-3afb-42b5-9767-450fa1b59fc4 req-96066298-4723-4039-9846-3bdfe72aed64 service nova] Lock "3db2e71c-939b-4d2f-b1be-c2122f7cd73e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:59:21 user nova-compute[71509]: DEBUG nova.compute.manager [req-4a1d1596-3afb-42b5-9767-450fa1b59fc4 req-96066298-4723-4039-9846-3bdfe72aed64 service nova] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] No waiting events found dispatching network-vif-plugged-1e547ec7-7efd-480f-84be-806c8cf25b90 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:59:21 user nova-compute[71509]: WARNING nova.compute.manager [req-4a1d1596-3afb-42b5-9767-450fa1b59fc4 req-96066298-4723-4039-9846-3bdfe72aed64 service nova] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] Received unexpected event network-vif-plugged-1e547ec7-7efd-480f-84be-806c8cf25b90 for instance with vm_state building and task_state spawning.
Apr 14 10:59:21 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 10:59:21 user nova-compute[71509]: INFO nova.compute.manager [None req-e60ef001-4e22-4d46-b664-19d2ac0482ad tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] Took 5.05 seconds to spawn the instance on the hypervisor.
Apr 14 10:59:21 user nova-compute[71509]: DEBUG nova.compute.manager [None req-e60ef001-4e22-4d46-b664-19d2ac0482ad tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:59:21 user nova-compute[71509]: INFO nova.compute.manager [None req-e60ef001-4e22-4d46-b664-19d2ac0482ad tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] Took 10.59 seconds to build instance.
Apr 14 10:59:21 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-e60ef001-4e22-4d46-b664-19d2ac0482ad tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "3db2e71c-939b-4d2f-b1be-c2122f7cd73e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.677s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:59:21 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "3db2e71c-939b-4d2f-b1be-c2122f7cd73e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 1.945s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:59:21 user nova-compute[71509]: INFO nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 10:59:21 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "3db2e71c-939b-4d2f-b1be-c2122f7cd73e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:59:23 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:59:23 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:59:28 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:59:28 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:59:33 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:59:33 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:59:38 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:59:38 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:59:39 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:59:39 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:59:39 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71509) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 10:59:40 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-64e8acd4-6c75-4b88-a91f-0d86f5bc6ace tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Acquiring lock "97f20661-8b60-439e-b7af-2fc2013c5ade" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:59:40 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-64e8acd4-6c75-4b88-a91f-0d86f5bc6ace tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "97f20661-8b60-439e-b7af-2fc2013c5ade" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:59:40 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-64e8acd4-6c75-4b88-a91f-0d86f5bc6ace tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Acquiring lock "97f20661-8b60-439e-b7af-2fc2013c5ade-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:59:40 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-64e8acd4-6c75-4b88-a91f-0d86f5bc6ace tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "97f20661-8b60-439e-b7af-2fc2013c5ade-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:59:40 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-64e8acd4-6c75-4b88-a91f-0d86f5bc6ace tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "97f20661-8b60-439e-b7af-2fc2013c5ade-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:59:40 user nova-compute[71509]: INFO nova.compute.manager [None req-64e8acd4-6c75-4b88-a91f-0d86f5bc6ace tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] Terminating instance
Apr 14 10:59:40 user nova-compute[71509]: DEBUG nova.compute.manager [None req-64e8acd4-6c75-4b88-a91f-0d86f5bc6ace tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] Start destroying the instance on the hypervisor. {{(pid=71509) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 10:59:40 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:59:40 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:59:40 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:59:40 user nova-compute[71509]: DEBUG nova.compute.manager [req-3d2843ec-f4d4-4bdb-b7e0-7c77266f49c3 req-2a6d3e92-3484-498d-9998-e9e41513100d service nova] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] Received event network-vif-unplugged-270b85b0-1832-4118-a8b0-ff784587b58a {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:59:40 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-3d2843ec-f4d4-4bdb-b7e0-7c77266f49c3 req-2a6d3e92-3484-498d-9998-e9e41513100d service nova] Acquiring lock "97f20661-8b60-439e-b7af-2fc2013c5ade-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:59:40 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-3d2843ec-f4d4-4bdb-b7e0-7c77266f49c3 req-2a6d3e92-3484-498d-9998-e9e41513100d service nova] Lock "97f20661-8b60-439e-b7af-2fc2013c5ade-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:59:40 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-3d2843ec-f4d4-4bdb-b7e0-7c77266f49c3 req-2a6d3e92-3484-498d-9998-e9e41513100d service nova] Lock "97f20661-8b60-439e-b7af-2fc2013c5ade-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:59:40 user nova-compute[71509]: DEBUG nova.compute.manager [req-3d2843ec-f4d4-4bdb-b7e0-7c77266f49c3 req-2a6d3e92-3484-498d-9998-e9e41513100d service nova] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] No waiting events found dispatching network-vif-unplugged-270b85b0-1832-4118-a8b0-ff784587b58a {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:59:40 user nova-compute[71509]: DEBUG nova.compute.manager [req-3d2843ec-f4d4-4bdb-b7e0-7c77266f49c3 req-2a6d3e92-3484-498d-9998-e9e41513100d service nova] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] Received event network-vif-unplugged-270b85b0-1832-4118-a8b0-ff784587b58a for instance with task_state deleting. {{(pid=71509) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 10:59:41 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] Instance destroyed successfully.
Apr 14 10:59:41 user nova-compute[71509]: DEBUG nova.objects.instance [None req-64e8acd4-6c75-4b88-a91f-0d86f5bc6ace tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lazy-loading 'resources' on Instance uuid 97f20661-8b60-439e-b7af-2fc2013c5ade {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:59:41 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:59:41 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-64e8acd4-6c75-4b88-a91f-0d86f5bc6ace tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T10:42:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1197292957',display_name='tempest-ServerRescueNegativeTestJSON-server-1197292957',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1197292957',id=2,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T10:47:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bf93e5dac50342d0b65ef09711401e99',ramdisk_id='',reservation_id='r-0zxo4k30',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-563868574',owner_user_name='tempest-ServerRescueNegativeTestJSON-563868574-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T10:49:24Z,user_data=None,user_id='e359578dcbb24755a216415053d415ef',uuid=97f20661-8b60-439e-b7af-2fc2013c5ade,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "270b85b0-1832-4118-a8b0-ff784587b58a", "address": "fa:16:3e:75:ba:ae", "network": {"id": "22eb5f87-be4d-447d-bafe-25e0284ea3ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-787804772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf93e5dac50342d0b65ef09711401e99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap270b85b0-18", "ovs_interfaceid": "270b85b0-1832-4118-a8b0-ff784587b58a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 10:59:41 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-64e8acd4-6c75-4b88-a91f-0d86f5bc6ace tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Converting VIF {"id": "270b85b0-1832-4118-a8b0-ff784587b58a", "address": "fa:16:3e:75:ba:ae", "network": {"id": "22eb5f87-be4d-447d-bafe-25e0284ea3ca", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-787804772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bf93e5dac50342d0b65ef09711401e99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap270b85b0-18", "ovs_interfaceid": "270b85b0-1832-4118-a8b0-ff784587b58a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 10:59:41 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-64e8acd4-6c75-4b88-a91f-0d86f5bc6ace tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:75:ba:ae,bridge_name='br-int',has_traffic_filtering=True,id=270b85b0-1832-4118-a8b0-ff784587b58a,network=Network(22eb5f87-be4d-447d-bafe-25e0284ea3ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap270b85b0-18') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 10:59:41 user nova-compute[71509]: DEBUG os_vif [None req-64e8acd4-6c75-4b88-a91f-0d86f5bc6ace tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:75:ba:ae,bridge_name='br-int',has_traffic_filtering=True,id=270b85b0-1832-4118-a8b0-ff784587b58a,network=Network(22eb5f87-be4d-447d-bafe-25e0284ea3ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap270b85b0-18') {{(pid=71509) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 10:59:41 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:59:41 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap270b85b0-18, bridge=br-int, if_exists=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 10:59:41 user nova-compute[71509]: DEBUG nova.compute.manager [req-bd9438d0-aef6-4f65-a559-2cab921ee6e6 req-73f65c6f-9444-400b-b6e0-872f0df132b8 service nova] [instance: 0bb99276-64ba-4641-8869-3f35eea2f76e] Received event network-changed-7e4a1964-f2d0-4a4f-81fc-adf97c621209 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:59:41 user nova-compute[71509]: DEBUG nova.compute.manager [req-bd9438d0-aef6-4f65-a559-2cab921ee6e6 req-73f65c6f-9444-400b-b6e0-872f0df132b8 service nova] [instance: 0bb99276-64ba-4641-8869-3f35eea2f76e] Refreshing instance network info cache due to event network-changed-7e4a1964-f2d0-4a4f-81fc-adf97c621209. {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 10:59:41 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-bd9438d0-aef6-4f65-a559-2cab921ee6e6 req-73f65c6f-9444-400b-b6e0-872f0df132b8 service nova] Acquiring lock "refresh_cache-0bb99276-64ba-4641-8869-3f35eea2f76e" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:59:41 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-bd9438d0-aef6-4f65-a559-2cab921ee6e6 req-73f65c6f-9444-400b-b6e0-872f0df132b8 service nova] Acquired lock "refresh_cache-0bb99276-64ba-4641-8869-3f35eea2f76e" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:59:41 user nova-compute[71509]: DEBUG nova.network.neutron [req-bd9438d0-aef6-4f65-a559-2cab921ee6e6 req-73f65c6f-9444-400b-b6e0-872f0df132b8 service nova] [instance: 0bb99276-64ba-4641-8869-3f35eea2f76e] Refreshing network info cache for port 7e4a1964-f2d0-4a4f-81fc-adf97c621209 {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 10:59:41 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:59:41 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 10:59:41 user nova-compute[71509]: INFO os_vif [None req-64e8acd4-6c75-4b88-a91f-0d86f5bc6ace tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:75:ba:ae,bridge_name='br-int',has_traffic_filtering=True,id=270b85b0-1832-4118-a8b0-ff784587b58a,network=Network(22eb5f87-be4d-447d-bafe-25e0284ea3ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap270b85b0-18')
Apr 14 10:59:41 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-64e8acd4-6c75-4b88-a91f-0d86f5bc6ace tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] Deleting instance files /opt/stack/data/nova/instances/97f20661-8b60-439e-b7af-2fc2013c5ade_del
Apr 14 10:59:41 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-64e8acd4-6c75-4b88-a91f-0d86f5bc6ace tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] Deletion of /opt/stack/data/nova/instances/97f20661-8b60-439e-b7af-2fc2013c5ade_del complete
Apr 14 10:59:41 user nova-compute[71509]: INFO nova.compute.manager [None req-64e8acd4-6c75-4b88-a91f-0d86f5bc6ace tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] Took 0.95 seconds to destroy the instance on the hypervisor.
Apr 14 10:59:41 user nova-compute[71509]: DEBUG oslo.service.loopingcall [None req-64e8acd4-6c75-4b88-a91f-0d86f5bc6ace tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71509) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 10:59:41 user nova-compute[71509]: DEBUG nova.compute.manager [-] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] Deallocating network for instance {{(pid=71509) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 10:59:41 user nova-compute[71509]: DEBUG nova.network.neutron [-] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] deallocate_for_instance() {{(pid=71509) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 10:59:41 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:59:41 user nova-compute[71509]: DEBUG nova.network.neutron [req-bd9438d0-aef6-4f65-a559-2cab921ee6e6 req-73f65c6f-9444-400b-b6e0-872f0df132b8 service nova] [instance: 0bb99276-64ba-4641-8869-3f35eea2f76e] Updated VIF entry in instance network info cache for port 7e4a1964-f2d0-4a4f-81fc-adf97c621209. {{(pid=71509) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 10:59:41 user nova-compute[71509]: DEBUG nova.network.neutron [req-bd9438d0-aef6-4f65-a559-2cab921ee6e6 req-73f65c6f-9444-400b-b6e0-872f0df132b8 service nova] [instance: 0bb99276-64ba-4641-8869-3f35eea2f76e] Updating instance_info_cache with network_info: [{"id": "7e4a1964-f2d0-4a4f-81fc-adf97c621209", "address": "fa:16:3e:3f:d7:0d", "network": {"id": "653f0c81-1afd-4ca6-9639-675ead1a6127", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-932652547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb9b9fc4f2e244879502006bb844761c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e4a1964-f2", "ovs_interfaceid": "7e4a1964-f2d0-4a4f-81fc-adf97c621209", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:59:41 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-bd9438d0-aef6-4f65-a559-2cab921ee6e6 req-73f65c6f-9444-400b-b6e0-872f0df132b8 service nova] Releasing lock "refresh_cache-0bb99276-64ba-4641-8869-3f35eea2f76e" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:59:41 user nova-compute[71509]: DEBUG nova.network.neutron [-] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] Updating instance_info_cache with network_info: [] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:59:41 user nova-compute[71509]: INFO nova.compute.manager [-] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] Took 0.56 seconds to deallocate network for instance.
Apr 14 10:59:42 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-64e8acd4-6c75-4b88-a91f-0d86f5bc6ace tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:59:42 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-64e8acd4-6c75-4b88-a91f-0d86f5bc6ace tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:59:42 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:59:42 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-64e8acd4-6c75-4b88-a91f-0d86f5bc6ace tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 10:59:42 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-64e8acd4-6c75-4b88-a91f-0d86f5bc6ace tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 10:59:42 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-64e8acd4-6c75-4b88-a91f-0d86f5bc6ace tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.381s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:59:42 user nova-compute[71509]: INFO nova.scheduler.client.report [None req-64e8acd4-6c75-4b88-a91f-0d86f5bc6ace tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Deleted allocations for instance 97f20661-8b60-439e-b7af-2fc2013c5ade
Apr 14 10:59:42 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-64e8acd4-6c75-4b88-a91f-0d86f5bc6ace tempest-ServerRescueNegativeTestJSON-563868574 tempest-ServerRescueNegativeTestJSON-563868574-project-member] Lock "97f20661-8b60-439e-b7af-2fc2013c5ade" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.307s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:59:42 user nova-compute[71509]: DEBUG nova.compute.manager [req-98a32554-0837-41b3-89d6-afa2ad706fce req-2dca3081-d5a2-471f-84d0-fa6025631c55 service nova] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] Received event network-vif-plugged-270b85b0-1832-4118-a8b0-ff784587b58a {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:59:42 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-98a32554-0837-41b3-89d6-afa2ad706fce req-2dca3081-d5a2-471f-84d0-fa6025631c55 service nova] Acquiring lock "97f20661-8b60-439e-b7af-2fc2013c5ade-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:59:42 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-98a32554-0837-41b3-89d6-afa2ad706fce req-2dca3081-d5a2-471f-84d0-fa6025631c55 service nova] Lock "97f20661-8b60-439e-b7af-2fc2013c5ade-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:59:42 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-98a32554-0837-41b3-89d6-afa2ad706fce req-2dca3081-d5a2-471f-84d0-fa6025631c55 service nova] Lock "97f20661-8b60-439e-b7af-2fc2013c5ade-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:59:42 user nova-compute[71509]: DEBUG nova.compute.manager [req-98a32554-0837-41b3-89d6-afa2ad706fce req-2dca3081-d5a2-471f-84d0-fa6025631c55 service nova] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] No waiting events found dispatching network-vif-plugged-270b85b0-1832-4118-a8b0-ff784587b58a {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 10:59:42 user nova-compute[71509]: WARNING nova.compute.manager [req-98a32554-0837-41b3-89d6-afa2ad706fce req-2dca3081-d5a2-471f-84d0-fa6025631c55 service nova] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] Received unexpected event network-vif-plugged-270b85b0-1832-4118-a8b0-ff784587b58a for instance with vm_state deleted and task_state None.
Apr 14 10:59:42 user nova-compute[71509]: DEBUG nova.compute.manager [req-98a32554-0837-41b3-89d6-afa2ad706fce req-2dca3081-d5a2-471f-84d0-fa6025631c55 service nova] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] Received event network-vif-deleted-270b85b0-1832-4118-a8b0-ff784587b58a {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:59:43 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:59:43 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-11ccffe7-1699-431e-9c15-4de7e8379452 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Acquiring lock "0bb99276-64ba-4641-8869-3f35eea2f76e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:59:43 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-11ccffe7-1699-431e-9c15-4de7e8379452 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "0bb99276-64ba-4641-8869-3f35eea2f76e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:59:43 user nova-compute[71509]: DEBUG nova.objects.instance [None req-11ccffe7-1699-431e-9c15-4de7e8379452 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lazy-loading 'flavor' on Instance uuid 0bb99276-64ba-4641-8869-3f35eea2f76e {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:59:43 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-11ccffe7-1699-431e-9c15-4de7e8379452 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "0bb99276-64ba-4641-8869-3f35eea2f76e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.047s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:59:43 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-11ccffe7-1699-431e-9c15-4de7e8379452 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Acquiring lock "0bb99276-64ba-4641-8869-3f35eea2f76e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:59:43 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-11ccffe7-1699-431e-9c15-4de7e8379452 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "0bb99276-64ba-4641-8869-3f35eea2f76e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:59:43 user nova-compute[71509]: INFO nova.compute.manager [None req-11ccffe7-1699-431e-9c15-4de7e8379452 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 0bb99276-64ba-4641-8869-3f35eea2f76e] Attaching volume 7979d4e6-ecf8-4e89-897f-13d8a1a7afdd to /dev/vdb
Apr 14 10:59:44 user nova-compute[71509]: DEBUG os_brick.utils [None req-11ccffe7-1699-431e-9c15-4de7e8379452 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 10:59:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:59:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:59:44 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[723b5227-eb4a-4b84-8835-d9c552a27b37]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50119df3c417\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:59:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:59:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:59:44 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f0625f2-68f2-4e9d-801b-78dab2be3556]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:59:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:59:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:59:44 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0c73177-cb50-44f0-8d3b-037edc255e2e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:59:44 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc74e1e7-d71f-479c-acdd-023541720bf3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:59:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-11ccffe7-1699-431e-9c15-4de7e8379452 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Running cmd (subprocess): nvme version {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:59:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-11ccffe7-1699-431e-9c15-4de7e8379452 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] 'nvme version' failed. Not Retrying. {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 10:59:44 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.nvmeof [None req-11ccffe7-1699-431e-9c15-4de7e8379452 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] nvme not present on system {{(pid=71509) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 10:59:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:59:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 10:59:44 user nova-compute[71509]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 10:59:44 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce6084b5-4813-4c42-a0c9-27eaf9e9747c]: (4, '') {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:59:44 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-11ccffe7-1699-431e-9c15-4de7e8379452 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71509) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 10:59:44 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-11ccffe7-1699-431e-9c15-4de7e8379452 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71509) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 10:59:44 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-11ccffe7-1699-431e-9c15-4de7e8379452 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] LIGHTOS: no hostnqn found. {{(pid=71509) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 10:59:44 user nova-compute[71509]: DEBUG os_brick.utils [None req-11ccffe7-1699-431e-9c15-4de7e8379452 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50119df3c417', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 10:59:44 user nova-compute[71509]: DEBUG nova.virt.block_device [None req-11ccffe7-1699-431e-9c15-4de7e8379452 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 0bb99276-64ba-4641-8869-3f35eea2f76e] Updating existing volume attachment record: ff22c1a6-d654-4db4-adf1-01e8357bfdb8 {{(pid=71509) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 10:59:45 user nova-compute[71509]: DEBUG nova.compute.manager [req-ef67670a-491f-4dda-9489-afce0cb14f5f req-16f63d3e-b963-4d3d-94d0-47832420d827 service nova] [instance: ef413492-c781-459e-b99c-46a530034c94] Received event network-changed-9e57c0d8-8572-4355-b3c0-d2b74196fc0d {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 10:59:45 user nova-compute[71509]: DEBUG nova.compute.manager [req-ef67670a-491f-4dda-9489-afce0cb14f5f req-16f63d3e-b963-4d3d-94d0-47832420d827 service nova] [instance: ef413492-c781-459e-b99c-46a530034c94] Refreshing instance network info cache due to event network-changed-9e57c0d8-8572-4355-b3c0-d2b74196fc0d. {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 10:59:45 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-ef67670a-491f-4dda-9489-afce0cb14f5f req-16f63d3e-b963-4d3d-94d0-47832420d827 service nova] Acquiring lock "refresh_cache-ef413492-c781-459e-b99c-46a530034c94" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:59:45 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-ef67670a-491f-4dda-9489-afce0cb14f5f req-16f63d3e-b963-4d3d-94d0-47832420d827 service nova] Acquired lock "refresh_cache-ef413492-c781-459e-b99c-46a530034c94" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:59:45 user nova-compute[71509]: DEBUG nova.network.neutron [req-ef67670a-491f-4dda-9489-afce0cb14f5f req-16f63d3e-b963-4d3d-94d0-47832420d827 service nova] [instance: ef413492-c781-459e-b99c-46a530034c94] Refreshing network info cache for port 9e57c0d8-8572-4355-b3c0-d2b74196fc0d {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 10:59:46 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:59:46 user nova-compute[71509]: DEBUG nova.network.neutron [req-ef67670a-491f-4dda-9489-afce0cb14f5f req-16f63d3e-b963-4d3d-94d0-47832420d827 service nova] [instance: ef413492-c781-459e-b99c-46a530034c94] Updated VIF entry in instance network info cache for port 9e57c0d8-8572-4355-b3c0-d2b74196fc0d. {{(pid=71509) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 10:59:46 user nova-compute[71509]: DEBUG nova.network.neutron [req-ef67670a-491f-4dda-9489-afce0cb14f5f req-16f63d3e-b963-4d3d-94d0-47832420d827 service nova] [instance: ef413492-c781-459e-b99c-46a530034c94] Updating instance_info_cache with network_info: [{"id": "9e57c0d8-8572-4355-b3c0-d2b74196fc0d", "address": "fa:16:3e:6e:1f:b0", "network": {"id": "b639a68a-2b4e-435c-b98b-65b5b4981c73", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1070821894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb8f294f957f4c74ae959c1e9f238427", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e57c0d8-85", "ovs_interfaceid": "9e57c0d8-8572-4355-b3c0-d2b74196fc0d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:59:46 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-ef67670a-491f-4dda-9489-afce0cb14f5f req-16f63d3e-b963-4d3d-94d0-47832420d827 service nova] Releasing lock "refresh_cache-ef413492-c781-459e-b99c-46a530034c94" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:59:47 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:59:47 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:59:47 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:59:48 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:59:48 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-25158a07-4caa-4445-b764-9bb9c6559e57 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "ef413492-c781-459e-b99c-46a530034c94" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:59:48 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-25158a07-4caa-4445-b764-9bb9c6559e57 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "ef413492-c781-459e-b99c-46a530034c94" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:59:48 user nova-compute[71509]: DEBUG nova.objects.instance [None req-25158a07-4caa-4445-b764-9bb9c6559e57 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lazy-loading 'flavor' on Instance uuid ef413492-c781-459e-b99c-46a530034c94 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:59:48 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-25158a07-4caa-4445-b764-9bb9c6559e57 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "ef413492-c781-459e-b99c-46a530034c94" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:59:48 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-25158a07-4caa-4445-b764-9bb9c6559e57 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "ef413492-c781-459e-b99c-46a530034c94" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:59:48 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-25158a07-4caa-4445-b764-9bb9c6559e57 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "ef413492-c781-459e-b99c-46a530034c94" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:59:48 user nova-compute[71509]: INFO nova.compute.manager [None req-25158a07-4caa-4445-b764-9bb9c6559e57 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: ef413492-c781-459e-b99c-46a530034c94] Attaching volume a762c7f3-c92d-42e9-8c00-610d87eb4fcb to /dev/vdb
Apr 14 10:59:48 user nova-compute[71509]: DEBUG os_brick.utils [None req-25158a07-4caa-4445-b764-9bb9c6559e57 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 10:59:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:59:48 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11ccffe7-1699-431e-9c15-4de7e8379452 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 0bb99276-64ba-4641-8869-3f35eea2f76e] Calling os-brick to attach iSCSI Volume {{(pid=71509) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 10:59:48 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-11ccffe7-1699-431e-9c15-4de7e8379452 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0bf0749390>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7979d4e6-ecf8-4e89-897f-13d8a1a7afdd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zeVxFUHG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 10:59:48 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-11ccffe7-1699-431e-9c15-4de7e8379452 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 10:59:48 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-11ccffe7-1699-431e-9c15-4de7e8379452 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 10:59:48 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-11ccffe7-1699-431e-9c15-4de7e8379452 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 10:59:48 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-11ccffe7-1699-431e-9c15-4de7e8379452 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 10:59:48 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-11ccffe7-1699-431e-9c15-4de7e8379452 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7979d4e6-ecf8-4e89-897f-13d8a1a7afdd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 10:59:48 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-11ccffe7-1699-431e-9c15-4de7e8379452 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7979d4e6-ecf8-4e89-897f-13d8a1a7afdd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 10:59:48 user nova-compute[71509]: INFO os_brick.initiator.connectors.iscsi [None req-11ccffe7-1699-431e-9c15-4de7e8379452 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 10:59:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7979d4e6-ecf8-4e89-897f-13d8a1a7afdd -p 172.16.0.220:3260 {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:59:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.023s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:59:48 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bc8e96f-dd41-4871-a994-38386fdedee9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50119df3c417\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:59:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:59:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7979d4e6-ecf8-4e89-897f-13d8a1a7afdd -p 172.16.0.220:3260" returned: 21 in 0.029s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:59:48 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[bedf812a-dff2-4491-b1de-ec45820a3a51]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:59:48 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-11ccffe7-1699-431e-9c15-4de7e8379452 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 10:59:48 user nova-compute[71509]:  {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:59:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7979d4e6-ecf8-4e89-897f-13d8a1a7afdd -p 172.16.0.220:3260 --interface default --op new {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:59:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.026s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:59:48 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[80bec4d0-0d5d-4d25-a5b0-bcd135eb9c37]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:59:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:59:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7979d4e6-ecf8-4e89-897f-13d8a1a7afdd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:59:48 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c1cff44-e4ff-4224-83d6-23c767c88ed6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7979d4e6-ecf8-4e89-897f-13d8a1a7afdd] added\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:59:48 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-11ccffe7-1699-431e-9c15-4de7e8379452 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7979d4e6-ecf8-4e89-897f-13d8a1a7afdd] added
Apr 14 10:59:48 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:59:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7979d4e6-ecf8-4e89-897f-13d8a1a7afdd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:59:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:59:48 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[5055807d-5f2a-4691-b056-e7e14832d11f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:59:48 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5288b1d-1b7e-45fd-a24a-06f018cb36cd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:59:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-25158a07-4caa-4445-b764-9bb9c6559e57 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Running cmd (subprocess): nvme version {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:59:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-25158a07-4caa-4445-b764-9bb9c6559e57 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] 'nvme version' failed. Not Retrying. {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 10:59:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7979d4e6-ecf8-4e89-897f-13d8a1a7afdd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:59:48 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[77d9ccf1-4f4f-4f83-8fd0-3af32b608fa6]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:59:48 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.nvmeof [None req-25158a07-4caa-4445-b764-9bb9c6559e57 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] nvme not present on system {{(pid=71509) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 10:59:48 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-11ccffe7-1699-431e-9c15-4de7e8379452 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:59:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:59:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7979d4e6-ecf8-4e89-897f-13d8a1a7afdd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:59:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 10:59:48 user nova-compute[71509]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 10:59:48 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[48649bde-a281-4200-b73f-86cc50607798]: (4, '') {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:59:48 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-25158a07-4caa-4445-b764-9bb9c6559e57 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71509) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 10:59:48 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-25158a07-4caa-4445-b764-9bb9c6559e57 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71509) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 10:59:48 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-25158a07-4caa-4445-b764-9bb9c6559e57 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] LIGHTOS: no hostnqn found. {{(pid=71509) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 10:59:48 user nova-compute[71509]: DEBUG os_brick.utils [None req-25158a07-4caa-4445-b764-9bb9c6559e57 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] <== get_connector_properties: return (154ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50119df3c417', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 10:59:48 user nova-compute[71509]: DEBUG nova.virt.block_device [None req-25158a07-4caa-4445-b764-9bb9c6559e57 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: ef413492-c781-459e-b99c-46a530034c94] Updating existing volume attachment record: f55c0acd-8edb-43a8-b037-2b44558cb555 {{(pid=71509) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 10:59:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7979d4e6-ecf8-4e89-897f-13d8a1a7afdd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:59:48 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[910cec22-1742-4fde-b58c-8cb7ccef00b7]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:59:48 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-11ccffe7-1699-431e-9c15-4de7e8379452 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:59:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7979d4e6-ecf8-4e89-897f-13d8a1a7afdd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zeVxFUHG {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:59:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7979d4e6-ecf8-4e89-897f-13d8a1a7afdd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zeVxFUHG" returned: 0 in 0.017s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:59:48 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[13299dee-efb9-46c7-a022-e3e3a739a5d4]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:59:48 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-11ccffe7-1699-431e-9c15-4de7e8379452 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zeVxFUHG'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:59:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7979d4e6-ecf8-4e89-897f-13d8a1a7afdd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:59:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7979d4e6-ecf8-4e89-897f-13d8a1a7afdd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:59:48 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[d84e8293-1749-42f3-813e-12f607177b57]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:59:48 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-11ccffe7-1699-431e-9c15-4de7e8379452 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:59:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:59:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:59:48 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ffcf6ad-1c42-430f-87d4-9215fa98f6f4]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3 (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:59:48 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-11ccffe7-1699-431e-9c15-4de7e8379452 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)
Apr 14 10:59:48 user nova-compute[71509]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219 (non-flash)
Apr 14 10:59:48 user nova-compute[71509]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3 (non-flash)
Apr 14 10:59:48 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:59:48 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-11ccffe7-1699-431e-9c15-4de7e8379452 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)
Apr 14 10:59:48 user nova-compute[71509]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219 (non-flash)
Apr 14 10:59:48 user nova-compute[71509]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3 (non-flash)
Apr 14 10:59:48 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 10:59:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7979d4e6-ecf8-4e89-897f-13d8a1a7afdd -p 172.16.0.220:3260 --login {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:59:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7979d4e6-ecf8-4e89-897f-13d8a1a7afdd -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:59:48 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[28274b1f-a8fe-4acc-8cf6-90e7c0bc5b45]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7979d4e6-ecf8-4e89-897f-13d8a1a7afdd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7979d4e6-ecf8-4e89-897f-13d8a1a7afdd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:59:48 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-11ccffe7-1699-431e-9c15-4de7e8379452 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7979d4e6-ecf8-4e89-897f-13d8a1a7afdd, portal: 172.16.0.220,3260]
Apr 14 10:59:48 user nova-compute[71509]: Login to [iface: default, target: iqn.2010-10.org.openstack:7979d4e6-ecf8-4e89-897f-13d8a1a7afdd, portal: 172.16.0.220,3260] successful.
Apr 14 10:59:48 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:59:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7979d4e6-ecf8-4e89-897f-13d8a1a7afdd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:59:49 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7979d4e6-ecf8-4e89-897f-13d8a1a7afdd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:59:49 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[8facd4d3-d493-4036-8b2f-8cb164ee710b]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:59:49 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-11ccffe7-1699-431e-9c15-4de7e8379452 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:59:49 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:59:49 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:59:49 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[d24dab34-94a5-439a-bc64-004d02d774d5]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7979d4e6-ecf8-4e89-897f-13d8a1a7afdd (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:59:49 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-11ccffe7-1699-431e-9c15-4de7e8379452 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)
Apr 14 10:59:49 user nova-compute[71509]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219 (non-flash)
Apr 14 10:59:49 user nova-compute[71509]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3 (non-flash)
Apr 14 10:59:49 user nova-compute[71509]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7979d4e6-ecf8-4e89-897f-13d8a1a7afdd (non-flash)
Apr 14 10:59:49 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:59:49 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-11ccffe7-1699-431e-9c15-4de7e8379452 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)
Apr 14 10:59:49 user nova-compute[71509]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219 (non-flash)
Apr 14 10:59:49 user nova-compute[71509]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3 (non-flash)
Apr 14 10:59:49 user nova-compute[71509]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7979d4e6-ecf8-4e89-897f-13d8a1a7afdd (non-flash)
Apr 14 10:59:49 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 10:59:49 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-11ccffe7-1699-431e-9c15-4de7e8379452 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7979d4e6-ecf8-4e89-897f-13d8a1a7afdd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.358s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 10:59:49 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-11ccffe7-1699-431e-9c15-4de7e8379452 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Connected to 172.16.0.220:3260 {{(pid=71509) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 10:59:49 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-11ccffe7-1699-431e-9c15-4de7e8379452 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] HCTL ('36', '-', '-', 0) found on session 39 with lun 0 {{(pid=71509) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 10:59:49 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-11ccffe7-1699-431e-9c15-4de7e8379452 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71509) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 10:59:49 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:59:49 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:59:49 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4d1ca00-95b1-45c9-9ce1-5891c0219a04]: (4, ('- - 0', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:59:49 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-11ccffe7-1699-431e-9c15-4de7e8379452 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Searching for a device in session 39 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71509) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 10:59:49 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-11ccffe7-1699-431e-9c15-4de7e8379452 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:7979d4e6-ecf8-4e89-897f-13d8a1a7afdd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zeVxFUHG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71509) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 10:59:50 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-11ccffe7-1699-431e-9c15-4de7e8379452 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.395s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 10:59:50 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-11ccffe7-1699-431e-9c15-4de7e8379452 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] <== connect_volume: return (1396ms) {'type': 'block', 'scsi_wwn': '23265333338643938', 'path': '/dev/sde'} {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 10:59:50 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11ccffe7-1699-431e-9c15-4de7e8379452 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 0bb99276-64ba-4641-8869-3f35eea2f76e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23265333338643938', 'path': '/dev/sde'} {{(pid=71509) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 10:59:50 user nova-compute[71509]: DEBUG nova.objects.instance [None req-11ccffe7-1699-431e-9c15-4de7e8379452 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lazy-loading 'flavor' on Instance uuid 0bb99276-64ba-4641-8869-3f35eea2f76e {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:59:50 user nova-compute[71509]: DEBUG nova.virt.libvirt.guest [None req-11ccffe7-1699-431e-9c15-4de7e8379452 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 10:59:50 user nova-compute[71509]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 10:59:50 user nova-compute[71509]:   <source dev="/dev/sde"/>
Apr 14 10:59:50 user nova-compute[71509]:   <target dev="vdb" bus="virtio"/>
Apr 14 10:59:50 user nova-compute[71509]:   <serial>7979d4e6-ecf8-4e89-897f-13d8a1a7afdd</serial>
Apr 14 10:59:50 user nova-compute[71509]: </disk>
Apr 14 10:59:50 user nova-compute[71509]:  {{(pid=71509) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 10:59:50 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-11ccffe7-1699-431e-9c15-4de7e8379452 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] No BDM found with device name vda, not building metadata. {{(pid=71509) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 10:59:50 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-11ccffe7-1699-431e-9c15-4de7e8379452 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71509) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 10:59:50 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-11ccffe7-1699-431e-9c15-4de7e8379452 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] No VIF found with MAC fa:16:3e:3f:d7:0d, not building metadata {{(pid=71509) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 10:59:50 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-11ccffe7-1699-431e-9c15-4de7e8379452 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "0bb99276-64ba-4641-8869-3f35eea2f76e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.664s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:59:51 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:59:51 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:59:51 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:59:51 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:59:51 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:59:51 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Auditing locally available compute resources for user (node: user) {{(pid=71509) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 10:59:51 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bb99276-64ba-4641-8869-3f35eea2f76e/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:59:51 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bb99276-64ba-4641-8869-3f35eea2f76e/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:59:51 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bb99276-64ba-4641-8869-3f35eea2f76e/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:59:51 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0bb99276-64ba-4641-8869-3f35eea2f76e/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:59:51 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=71509) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 10:59:51 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef413492-c781-459e-b99c-46a530034c94/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:59:52 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef413492-c781-459e-b99c-46a530034c94/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:59:52 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef413492-c781-459e-b99c-46a530034c94/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:59:52 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef413492-c781-459e-b99c-46a530034c94/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:59:52 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6580716-8a6a-4dfa-8978-ed54b92af1fe/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:59:52 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6580716-8a6a-4dfa-8978-ed54b92af1fe/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:59:52 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6580716-8a6a-4dfa-8978-ed54b92af1fe/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:59:52 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6580716-8a6a-4dfa-8978-ed54b92af1fe/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:59:52 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e479154a-acd6-47aa-9a5b-43c6e0feda07/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:59:52 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e479154a-acd6-47aa-9a5b-43c6e0feda07/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:59:52 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e479154a-acd6-47aa-9a5b-43c6e0feda07/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:59:52 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e479154a-acd6-47aa-9a5b-43c6e0feda07/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:59:52 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f41f217-0df2-4205-9633-7dbe83f40c96/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:59:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f41f217-0df2-4205-9633-7dbe83f40c96/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:59:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f41f217-0df2-4205-9633-7dbe83f40c96/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:59:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f41f217-0df2-4205-9633-7dbe83f40c96/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:59:53 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:59:53 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71509) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 10:59:53 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71509) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 10:59:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a936fb20-3f17-4114-829a-8659da6bc5f3/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:59:53 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25158a07-4caa-4445-b764-9bb9c6559e57 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: ef413492-c781-459e-b99c-46a530034c94] Calling os-brick to attach iSCSI Volume {{(pid=71509) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 10:59:53 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-25158a07-4caa-4445-b764-9bb9c6559e57 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0bf0749390>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a762c7f3-c92d-42e9-8c00-610d87eb4fcb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MRZOBInU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 10:59:53 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-25158a07-4caa-4445-b764-9bb9c6559e57 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 10:59:53 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-25158a07-4caa-4445-b764-9bb9c6559e57 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 10:59:53 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-25158a07-4caa-4445-b764-9bb9c6559e57 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 10:59:53 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-25158a07-4caa-4445-b764-9bb9c6559e57 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 10:59:53 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-25158a07-4caa-4445-b764-9bb9c6559e57 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a762c7f3-c92d-42e9-8c00-610d87eb4fcb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 10:59:53 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-25158a07-4caa-4445-b764-9bb9c6559e57 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a762c7f3-c92d-42e9-8c00-610d87eb4fcb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 10:59:53 user nova-compute[71509]: INFO os_brick.initiator.connectors.iscsi [None req-25158a07-4caa-4445-b764-9bb9c6559e57 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 10:59:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a762c7f3-c92d-42e9-8c00-610d87eb4fcb -p 172.16.0.220:3260 {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:59:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a762c7f3-c92d-42e9-8c00-610d87eb4fcb -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:59:53 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[77dee130-22b6-4623-b57c-e1b70c43935d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:59:53 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-25158a07-4caa-4445-b764-9bb9c6559e57 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 10:59:53 user nova-compute[71509]:  {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:59:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a762c7f3-c92d-42e9-8c00-610d87eb4fcb -p 172.16.0.220:3260 --interface default --op new {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:59:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a762c7f3-c92d-42e9-8c00-610d87eb4fcb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:59:53 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e365f13-2996-4aaf-a491-c0cf028efbff]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a762c7f3-c92d-42e9-8c00-610d87eb4fcb] added\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:59:53 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-25158a07-4caa-4445-b764-9bb9c6559e57 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a762c7f3-c92d-42e9-8c00-610d87eb4fcb] added
Apr 14 10:59:53 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:59:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a762c7f3-c92d-42e9-8c00-610d87eb4fcb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:59:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a762c7f3-c92d-42e9-8c00-610d87eb4fcb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:59:53 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b4096b8-244c-4bfb-b2f6-7eaa62937618]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:59:53 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-25158a07-4caa-4445-b764-9bb9c6559e57 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:59:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a762c7f3-c92d-42e9-8c00-610d87eb4fcb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:59:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a936fb20-3f17-4114-829a-8659da6bc5f3/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:59:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a936fb20-3f17-4114-829a-8659da6bc5f3/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:59:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a762c7f3-c92d-42e9-8c00-610d87eb4fcb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:59:53 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebd97f33-20f6-43d7-bae9-5410ef3e420c]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:59:53 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-25158a07-4caa-4445-b764-9bb9c6559e57 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:59:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a762c7f3-c92d-42e9-8c00-610d87eb4fcb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MRZOBInU {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:59:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a762c7f3-c92d-42e9-8c00-610d87eb4fcb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MRZOBInU" returned: 0 in 0.022s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:59:53 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[6937e486-5f83-4d7e-8bc1-75f8870d0868]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:59:53 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-25158a07-4caa-4445-b764-9bb9c6559e57 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MRZOBInU'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:59:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a762c7f3-c92d-42e9-8c00-610d87eb4fcb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:59:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a762c7f3-c92d-42e9-8c00-610d87eb4fcb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:59:53 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f6f7190-c4c4-44b9-a8fd-09970920e562]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:59:53 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-25158a07-4caa-4445-b764-9bb9c6559e57 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:59:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:59:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:59:53 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9bfd044-5df8-4ff6-8ace-17e9b203ea8f]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7979d4e6-ecf8-4e89-897f-13d8a1a7afdd (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:59:53 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-25158a07-4caa-4445-b764-9bb9c6559e57 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)
Apr 14 10:59:53 user nova-compute[71509]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219 (non-flash)
Apr 14 10:59:53 user nova-compute[71509]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3 (non-flash)
Apr 14 10:59:53 user nova-compute[71509]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7979d4e6-ecf8-4e89-897f-13d8a1a7afdd (non-flash)
Apr 14 10:59:53 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:59:53 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-25158a07-4caa-4445-b764-9bb9c6559e57 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)
Apr 14 10:59:53 user nova-compute[71509]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219 (non-flash)
Apr 14 10:59:53 user nova-compute[71509]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3 (non-flash)
Apr 14 10:59:53 user nova-compute[71509]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7979d4e6-ecf8-4e89-897f-13d8a1a7afdd (non-flash)
Apr 14 10:59:53 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 10:59:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a762c7f3-c92d-42e9-8c00-610d87eb4fcb -p 172.16.0.220:3260 --login {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:59:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a936fb20-3f17-4114-829a-8659da6bc5f3/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:59:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dd9e11f-1fed-42af-ad5c-9cdd051b93e7/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:59:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a762c7f3-c92d-42e9-8c00-610d87eb4fcb -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:59:53 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c007054-a4cf-4421-9fcf-38c54163ff26]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a762c7f3-c92d-42e9-8c00-610d87eb4fcb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a762c7f3-c92d-42e9-8c00-610d87eb4fcb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:59:53 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-25158a07-4caa-4445-b764-9bb9c6559e57 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a762c7f3-c92d-42e9-8c00-610d87eb4fcb, portal: 172.16.0.220,3260]
Apr 14 10:59:53 user nova-compute[71509]: Login to [iface: default, target: iqn.2010-10.org.openstack:a762c7f3-c92d-42e9-8c00-610d87eb4fcb, portal: 172.16.0.220,3260] successful.
Apr 14 10:59:53 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:59:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a762c7f3-c92d-42e9-8c00-610d87eb4fcb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:59:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a762c7f3-c92d-42e9-8c00-610d87eb4fcb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:59:53 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a108743-cc6a-4137-b9f8-276ed982ed57]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:59:53 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-25158a07-4caa-4445-b764-9bb9c6559e57 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:59:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:59:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:59:53 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3249b4d-d6a0-436a-978f-61fc7438019a]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7979d4e6-ecf8-4e89-897f-13d8a1a7afdd (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a762c7f3-c92d-42e9-8c00-610d87eb4fcb (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:59:53 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-25158a07-4caa-4445-b764-9bb9c6559e57 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)
Apr 14 10:59:53 user nova-compute[71509]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219 (non-flash)
Apr 14 10:59:53 user nova-compute[71509]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3 (non-flash)
Apr 14 10:59:53 user nova-compute[71509]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7979d4e6-ecf8-4e89-897f-13d8a1a7afdd (non-flash)
Apr 14 10:59:53 user nova-compute[71509]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a762c7f3-c92d-42e9-8c00-610d87eb4fcb (non-flash)
Apr 14 10:59:53 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:59:53 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-25158a07-4caa-4445-b764-9bb9c6559e57 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)
Apr 14 10:59:53 user nova-compute[71509]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219 (non-flash)
Apr 14 10:59:53 user nova-compute[71509]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3 (non-flash)
Apr 14 10:59:53 user nova-compute[71509]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7979d4e6-ecf8-4e89-897f-13d8a1a7afdd (non-flash)
Apr 14 10:59:53 user nova-compute[71509]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a762c7f3-c92d-42e9-8c00-610d87eb4fcb (non-flash)
Apr 14 10:59:53 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 10:59:53 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-25158a07-4caa-4445-b764-9bb9c6559e57 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a762c7f3-c92d-42e9-8c00-610d87eb4fcb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.362s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 10:59:53 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-25158a07-4caa-4445-b764-9bb9c6559e57 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Connected to 172.16.0.220:3260 {{(pid=71509) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 10:59:53 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-25158a07-4caa-4445-b764-9bb9c6559e57 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] HCTL ('37', '-', '-', 0) found on session 40 with lun 0 {{(pid=71509) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 10:59:53 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-25158a07-4caa-4445-b764-9bb9c6559e57 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=71509) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 10:59:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:59:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dd9e11f-1fed-42af-ad5c-9cdd051b93e7/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:59:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dd9e11f-1fed-42af-ad5c-9cdd051b93e7/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:59:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:59:53 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ddd51d9-0526-41d2-a91f-c4274bb21c93]: (4, ('- - 0', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:59:53 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-25158a07-4caa-4445-b764-9bb9c6559e57 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Searching for a device in session 40 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71509) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 10:59:53 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-25158a07-4caa-4445-b764-9bb9c6559e57 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:a762c7f3-c92d-42e9-8c00-610d87eb4fcb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MRZOBInU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71509) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 10:59:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dd9e11f-1fed-42af-ad5c-9cdd051b93e7/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:59:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d6a53c3-6e32-456c-a056-fbf1bef3b656/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:59:54 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d6a53c3-6e32-456c-a056-fbf1bef3b656/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:59:54 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d6a53c3-6e32-456c-a056-fbf1bef3b656/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:59:54 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d6a53c3-6e32-456c-a056-fbf1bef3b656/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:59:54 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71509) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 10:59:54 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-c493603c-1d87-41a1-9e76-fb5b39252ffb tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Acquiring lock "0bb99276-64ba-4641-8869-3f35eea2f76e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:59:54 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-c493603c-1d87-41a1-9e76-fb5b39252ffb tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "0bb99276-64ba-4641-8869-3f35eea2f76e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.003s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:59:54 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:59:54 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 10:59:54 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Hypervisor/Node resource view: name=user free_ram=7570MB free_disk=25.858234405517578GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71509) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 10:59:54 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:59:54 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:59:54 user nova-compute[71509]: DEBUG nova.objects.instance [None req-c493603c-1d87-41a1-9e76-fb5b39252ffb tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lazy-loading 'flavor' on Instance uuid 0bb99276-64ba-4641-8869-3f35eea2f76e {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:59:54 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-c493603c-1d87-41a1-9e76-fb5b39252ffb tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "0bb99276-64ba-4641-8869-3f35eea2f76e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:59:54 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-25158a07-4caa-4445-b764-9bb9c6559e57 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.438s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 10:59:54 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-25158a07-4caa-4445-b764-9bb9c6559e57 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] <== connect_volume: return (1440ms) {'type': 'block', 'scsi_wwn': '23063326132623665', 'path': '/dev/sdf'} {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 10:59:54 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25158a07-4caa-4445-b764-9bb9c6559e57 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: ef413492-c781-459e-b99c-46a530034c94] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23063326132623665', 'path': '/dev/sdf'} {{(pid=71509) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 10:59:54 user nova-compute[71509]: DEBUG nova.objects.instance [None req-25158a07-4caa-4445-b764-9bb9c6559e57 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lazy-loading 'flavor' on Instance uuid ef413492-c781-459e-b99c-46a530034c94 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:59:54 user nova-compute[71509]: DEBUG nova.virt.libvirt.guest [None req-25158a07-4caa-4445-b764-9bb9c6559e57 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 10:59:54 user nova-compute[71509]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 10:59:54 user nova-compute[71509]:   <source dev="/dev/sdf"/>
Apr 14 10:59:54 user nova-compute[71509]:   <target dev="vdb" bus="virtio"/>
Apr 14 10:59:54 user nova-compute[71509]:   <serial>a762c7f3-c92d-42e9-8c00-610d87eb4fcb</serial>
Apr 14 10:59:54 user nova-compute[71509]: </disk>
Apr 14 10:59:54 user nova-compute[71509]:  {{(pid=71509) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 10:59:54 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance e479154a-acd6-47aa-9a5b-43c6e0feda07 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:59:54 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 6cae9f61-763f-4671-a873-d15f01384416 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:59:54 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 6f41f217-0df2-4205-9633-7dbe83f40c96 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:59:54 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance e6580716-8a6a-4dfa-8978-ed54b92af1fe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:59:54 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance a936fb20-3f17-4114-829a-8659da6bc5f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:59:54 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 0dd9e11f-1fed-42af-ad5c-9cdd051b93e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:59:54 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 0bb99276-64ba-4641-8869-3f35eea2f76e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:59:54 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance ef413492-c781-459e-b99c-46a530034c94 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:59:54 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 3d6a53c3-6e32-456c-a056-fbf1bef3b656 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:59:54 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance fbcca78c-fe73-4ef1-92f9-4c8061cad177 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:59:54 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 3db2e71c-939b-4d2f-b1be-c2122f7cd73e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 10:59:54 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=71509) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 10:59:54 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Final resource view: name=user phys_ram=16023MB used_ram=1920MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=71509) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 10:59:54 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-c493603c-1d87-41a1-9e76-fb5b39252ffb tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Acquiring lock "0bb99276-64ba-4641-8869-3f35eea2f76e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:59:54 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-c493603c-1d87-41a1-9e76-fb5b39252ffb tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "0bb99276-64ba-4641-8869-3f35eea2f76e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:59:54 user nova-compute[71509]: INFO nova.compute.manager [None req-c493603c-1d87-41a1-9e76-fb5b39252ffb tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 0bb99276-64ba-4641-8869-3f35eea2f76e] Attaching volume 46bd9d4e-4a8e-47d8-8b69-aed30d0e5f7b to /dev/vdc
Apr 14 10:59:55 user nova-compute[71509]: DEBUG os_brick.utils [None req-c493603c-1d87-41a1-9e76-fb5b39252ffb tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 10:59:55 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:59:55 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:59:55 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[e985e1eb-3c35-48d7-8c98-8705acee9e2c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50119df3c417\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:59:55 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:59:55 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:59:55 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[70d0735a-806a-40d8-bb41-cc3e30f90c10]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:59:55 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:59:55 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:59:55 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[3529648c-504a-45dd-b0df-480475523fcf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:59:55 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[782684ab-ee2e-415d-9026-cfdf7224195a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:59:55 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-c493603c-1d87-41a1-9e76-fb5b39252ffb tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Running cmd (subprocess): nvme version {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:59:55 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-c493603c-1d87-41a1-9e76-fb5b39252ffb tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] 'nvme version' failed. Not Retrying. {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 10:59:55 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c493603c-1d87-41a1-9e76-fb5b39252ffb tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] nvme not present on system {{(pid=71509) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 10:59:55 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:59:55 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 10:59:55 user nova-compute[71509]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 10:59:55 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[163dedf3-fbfa-4a48-be64-31dcc099eaf6]: (4, '') {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:59:55 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-c493603c-1d87-41a1-9e76-fb5b39252ffb tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71509) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 10:59:55 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-c493603c-1d87-41a1-9e76-fb5b39252ffb tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71509) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 10:59:55 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-c493603c-1d87-41a1-9e76-fb5b39252ffb tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] LIGHTOS: no hostnqn found. {{(pid=71509) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 10:59:55 user nova-compute[71509]: DEBUG os_brick.utils [None req-c493603c-1d87-41a1-9e76-fb5b39252ffb tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50119df3c417', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 10:59:55 user nova-compute[71509]: DEBUG nova.virt.block_device [None req-c493603c-1d87-41a1-9e76-fb5b39252ffb tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 0bb99276-64ba-4641-8869-3f35eea2f76e] Updating existing volume attachment record: 3b06f359-51dc-4c76-b0f7-23810afcc2d1 {{(pid=71509) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 10:59:55 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 10:59:55 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 10:59:55 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Compute_service record updated for user:user {{(pid=71509) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 10:59:55 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.623s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:59:55 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-25158a07-4caa-4445-b764-9bb9c6559e57 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] No BDM found with device name vda, not building metadata. {{(pid=71509) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 10:59:55 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-25158a07-4caa-4445-b764-9bb9c6559e57 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71509) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 10:59:55 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-25158a07-4caa-4445-b764-9bb9c6559e57 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] No VIF found with MAC fa:16:3e:6e:1f:b0, not building metadata {{(pid=71509) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 10:59:55 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-25158a07-4caa-4445-b764-9bb9c6559e57 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "ef413492-c781-459e-b99c-46a530034c94" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.906s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:59:56 user nova-compute[71509]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681469981.2381554, 97f20661-8b60-439e-b7af-2fc2013c5ade => Stopped> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 10:59:56 user nova-compute[71509]: INFO nova.compute.manager [-] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] VM Stopped (Lifecycle Event)
Apr 14 10:59:56 user nova-compute[71509]: DEBUG nova.compute.manager [None req-84657549-27c4-41dc-8702-8e4ac1d1b3e0 None None] [instance: 97f20661-8b60-439e-b7af-2fc2013c5ade] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 10:59:56 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:59:56 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 10:59:56 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Starting heal instance info cache {{(pid=71509) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 10:59:56 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "refresh_cache-6f41f217-0df2-4205-9633-7dbe83f40c96" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 10:59:56 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquired lock "refresh_cache-6f41f217-0df2-4205-9633-7dbe83f40c96" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 10:59:56 user nova-compute[71509]: DEBUG nova.network.neutron [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] [instance: 6f41f217-0df2-4205-9633-7dbe83f40c96] Forcefully refreshing network info cache for instance {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 10:59:56 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccd5738-1a04-4f31-a58b-47f5a5427799 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "ef413492-c781-459e-b99c-46a530034c94" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 10:59:56 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccd5738-1a04-4f31-a58b-47f5a5427799 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "ef413492-c781-459e-b99c-46a530034c94" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 10:59:56 user nova-compute[71509]: INFO nova.compute.manager [None req-1ccd5738-1a04-4f31-a58b-47f5a5427799 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: ef413492-c781-459e-b99c-46a530034c94] Detaching volume a762c7f3-c92d-42e9-8c00-610d87eb4fcb
Apr 14 10:59:56 user nova-compute[71509]: INFO nova.virt.block_device [None req-1ccd5738-1a04-4f31-a58b-47f5a5427799 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: ef413492-c781-459e-b99c-46a530034c94] Attempting to driver detach volume a762c7f3-c92d-42e9-8c00-610d87eb4fcb from mountpoint /dev/vdb
Apr 14 10:59:56 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-1ccd5738-1a04-4f31-a58b-47f5a5427799 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Attempting to detach device vdb from instance ef413492-c781-459e-b99c-46a530034c94 from the persistent domain config. {{(pid=71509) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 10:59:56 user nova-compute[71509]: DEBUG nova.virt.libvirt.guest [None req-1ccd5738-1a04-4f31-a58b-47f5a5427799 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 10:59:56 user nova-compute[71509]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 10:59:56 user nova-compute[71509]:   <source dev="/dev/sdf"/>
Apr 14 10:59:56 user nova-compute[71509]:   <target dev="vdb" bus="virtio"/>
Apr 14 10:59:56 user nova-compute[71509]:   <serial>a762c7f3-c92d-42e9-8c00-610d87eb4fcb</serial>
Apr 14 10:59:56 user nova-compute[71509]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 10:59:56 user nova-compute[71509]: </disk>
Apr 14 10:59:56 user nova-compute[71509]:  {{(pid=71509) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 10:59:56 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-1ccd5738-1a04-4f31-a58b-47f5a5427799 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Successfully detached device vdb from instance ef413492-c781-459e-b99c-46a530034c94 from the persistent domain config.
Apr 14 10:59:56 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-1ccd5738-1a04-4f31-a58b-47f5a5427799 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ef413492-c781-459e-b99c-46a530034c94 from the live domain config. {{(pid=71509) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 10:59:56 user nova-compute[71509]: DEBUG nova.virt.libvirt.guest [None req-1ccd5738-1a04-4f31-a58b-47f5a5427799 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 10:59:56 user nova-compute[71509]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 10:59:56 user nova-compute[71509]:   <source dev="/dev/sdf"/>
Apr 14 10:59:56 user nova-compute[71509]:   <target dev="vdb" bus="virtio"/>
Apr 14 10:59:56 user nova-compute[71509]:   <serial>a762c7f3-c92d-42e9-8c00-610d87eb4fcb</serial>
Apr 14 10:59:56 user nova-compute[71509]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 10:59:56 user nova-compute[71509]: </disk>
Apr 14 10:59:56 user nova-compute[71509]:  {{(pid=71509) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 10:59:57 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Received event <DeviceRemovedEvent: 1681469997.1383872, ef413492-c781-459e-b99c-46a530034c94 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71509) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 10:59:57 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-1ccd5738-1a04-4f31-a58b-47f5a5427799 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ef413492-c781-459e-b99c-46a530034c94 {{(pid=71509) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 10:59:57 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-1ccd5738-1a04-4f31-a58b-47f5a5427799 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Successfully detached device vdb from instance ef413492-c781-459e-b99c-46a530034c94 from the live domain config.
Apr 14 10:59:57 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ccd5738-1a04-4f31-a58b-47f5a5427799 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: ef413492-c781-459e-b99c-46a530034c94] calling os-brick to detach iSCSI Volume {{(pid=71509) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 10:59:57 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ccd5738-1a04-4f31-a58b-47f5a5427799 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0bf0749390>, {'target_iqn': 'iqn.2010-10.org.openstack:a762c7f3-c92d-42e9-8c00-610d87eb4fcb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MRZOBInU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 10:59:57 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-1ccd5738-1a04-4f31-a58b-47f5a5427799 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 10:59:57 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-1ccd5738-1a04-4f31-a58b-47f5a5427799 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 10:59:57 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-1ccd5738-1a04-4f31-a58b-47f5a5427799 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 10:59:57 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:59:57 user nova-compute[71509]: DEBUG nova.network.neutron [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] [instance: 6f41f217-0df2-4205-9633-7dbe83f40c96] Updating instance_info_cache with network_info: [{"id": "e3d5b9ac-d641-478c-89cc-acbbf189ee2a", "address": "fa:16:3e:2d:5c:30", "network": {"id": "0d829782-2ea4-4af3-8460-468b818423dc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2082561441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be1c0764b8a843808158644eb90704e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3d5b9ac-d6", "ovs_interfaceid": "e3d5b9ac-d641-478c-89cc-acbbf189ee2a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 10:59:57 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.094s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:59:57 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f4dfca2-1b6d-4185-9aa3-67f1e029cd62]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a762c7f3-c92d-42e9-8c00-610d87eb4fcb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7979d4e6-ecf8-4e89-897f-13d8a1a7afdd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:59:57 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ccd5738-1a04-4f31-a58b-47f5a5427799 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 10:59:57 user nova-compute[71509]: No targets found.
Apr 14 10:59:57 user nova-compute[71509]: iSNS:
Apr 14 10:59:57 user nova-compute[71509]: No targets found.
Apr 14 10:59:57 user nova-compute[71509]: STATIC:
Apr 14 10:59:57 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3
Apr 14 10:59:57 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:59:57 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:59:57 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:a762c7f3-c92d-42e9-8c00-610d87eb4fcb
Apr 14 10:59:57 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:59:57 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:59:57 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178
Apr 14 10:59:57 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:59:57 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:59:57 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219
Apr 14 10:59:57 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:59:57 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:59:57 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:7979d4e6-ecf8-4e89-897f-13d8a1a7afdd
Apr 14 10:59:57 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 10:59:57 user nova-compute[71509]:                 Iface Name: default
Apr 14 10:59:57 user nova-compute[71509]: FIRMWARE:
Apr 14 10:59:57 user nova-compute[71509]: No targets found.
Apr 14 10:59:57 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:59:57 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ccd5738-1a04-4f31-a58b-47f5a5427799 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 10:59:57 user nova-compute[71509]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 10:59:57 user nova-compute[71509]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71509) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 10:59:57 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ccd5738-1a04-4f31-a58b-47f5a5427799 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a762c7f3-c92d-42e9-8c00-610d87eb4fcb', 0)] {{(pid=71509) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 10:59:57 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:59:57 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Releasing lock "refresh_cache-6f41f217-0df2-4205-9633-7dbe83f40c96" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 10:59:57 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] [instance: 6f41f217-0df2-4205-9633-7dbe83f40c96] Updated the network info_cache for instance {{(pid=71509) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 10:59:57 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:59:57 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[07eb1767-9b1f-47c0-99d6-25e296d4af9d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7979d4e6-ecf8-4e89-897f-13d8a1a7afdd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a762c7f3-c92d-42e9-8c00-610d87eb4fcb\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:59:57 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:59:57 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:59:57 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc253523-704e-4e4e-bd89-4ef1bf0600ff]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7979d4e6-ecf8-4e89-897f-13d8a1a7afdd (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a762c7f3-c92d-42e9-8c00-610d87eb4fcb (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:59:57 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ccd5738-1a04-4f31-a58b-47f5a5427799 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)
Apr 14 10:59:57 user nova-compute[71509]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219 (non-flash)
Apr 14 10:59:57 user nova-compute[71509]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3 (non-flash)
Apr 14 10:59:57 user nova-compute[71509]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7979d4e6-ecf8-4e89-897f-13d8a1a7afdd (non-flash)
Apr 14 10:59:57 user nova-compute[71509]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a762c7f3-c92d-42e9-8c00-610d87eb4fcb (non-flash)
Apr 14 10:59:57 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 10:59:57 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ccd5738-1a04-4f31-a58b-47f5a5427799 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)
Apr 14 10:59:57 user nova-compute[71509]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219 (non-flash)
Apr 14 10:59:57 user nova-compute[71509]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3 (non-flash)
Apr 14 10:59:57 user nova-compute[71509]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7979d4e6-ecf8-4e89-897f-13d8a1a7afdd (non-flash)
Apr 14 10:59:57 user nova-compute[71509]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a762c7f3-c92d-42e9-8c00-610d87eb4fcb (non-flash)
Apr 14 10:59:57 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 10:59:57 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ccd5738-1a04-4f31-a58b-47f5a5427799 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0c2c3d3640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a762c7f3-c92d-42e9-8c00-610d87eb4fcb'): ({'sdf'}, set())}) {{(pid=71509) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 10:59:57 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-1ccd5738-1a04-4f31-a58b-47f5a5427799 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Removing single pathed devices sdf {{(pid=71509) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 10:59:57 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:59:57 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:59:57 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1cf5f20-630e-49a8-8043-0c414a629f62]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:59:57 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:59:57 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.025s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:59:57 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbea8de1-03f8-4489-8f3a-16ea56a81d78]: (4, ('ok\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:59:57 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-1ccd5738-1a04-4f31-a58b-47f5a5427799 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Flushing IO for device /dev/sdf {{(pid=71509) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 10:59:57 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:59:57 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:59:57 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f0c268b-c442-4f39-acf6-e50369b1c575]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:59:57 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-1ccd5738-1a04-4f31-a58b-47f5a5427799 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71509) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 10:59:57 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:59:57 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.044s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:59:57 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8278ebb-5283-4438-a607-1d61d51a1865]: (4, ('1', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:59:57 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-1ccd5738-1a04-4f31-a58b-47f5a5427799 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=71509) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 10:59:57 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-1ccd5738-1a04-4f31-a58b-47f5a5427799 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] SCSI volumes sdf have been removed. {{(pid=71509) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 10:59:57 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ccd5738-1a04-4f31-a58b-47f5a5427799 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a762c7f3-c92d-42e9-8c00-610d87eb4fcb')] {{(pid=71509) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 10:59:57 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a762c7f3-c92d-42e9-8c00-610d87eb4fcb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:59:57 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a762c7f3-c92d-42e9-8c00-610d87eb4fcb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:59:57 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[30b468c7-eca5-46ec-8731-774f4acf5073]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:59:57 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ccd5738-1a04-4f31-a58b-47f5a5427799 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:59:57 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a762c7f3-c92d-42e9-8c00-610d87eb4fcb -p 172.16.0.220:3260 --logout {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:59:57 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a762c7f3-c92d-42e9-8c00-610d87eb4fcb -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:59:57 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd66b9fb-d99a-4de5-b2a2-c26841287fab]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:a762c7f3-c92d-42e9-8c00-610d87eb4fcb, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:a762c7f3-c92d-42e9-8c00-610d87eb4fcb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:59:57 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ccd5738-1a04-4f31-a58b-47f5a5427799 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:a762c7f3-c92d-42e9-8c00-610d87eb4fcb, portal: 172.16.0.220,3260]
Apr 14 10:59:57 user nova-compute[71509]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:a762c7f3-c92d-42e9-8c00-610d87eb4fcb, portal: 172.16.0.220,3260] successful.
Apr 14 10:59:57 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:59:57 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a762c7f3-c92d-42e9-8c00-610d87eb4fcb -p 172.16.0.220:3260 --op delete {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 10:59:57 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a762c7f3-c92d-42e9-8c00-610d87eb4fcb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 10:59:57 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[a049e1e4-b07a-4dc9-bd0c-39f0876bb9b0]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 10:59:57 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ccd5738-1a04-4f31-a58b-47f5a5427799 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 10:59:57 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-1ccd5738-1a04-4f31-a58b-47f5a5427799 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.431s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 10:59:57 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ccd5738-1a04-4f31-a58b-47f5a5427799 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] <== disconnect_volume: return (433ms) None {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 10:59:57 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ccd5738-1a04-4f31-a58b-47f5a5427799 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: ef413492-c781-459e-b99c-46a530034c94] Disconnected iSCSI Volume {{(pid=71509) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 10:59:58 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 10:59:58 user nova-compute[71509]: DEBUG nova.objects.instance [None req-1ccd5738-1a04-4f31-a58b-47f5a5427799 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lazy-loading 'flavor' on Instance uuid ef413492-c781-459e-b99c-46a530034c94 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 10:59:58 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccd5738-1a04-4f31-a58b-47f5a5427799 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "ef413492-c781-459e-b99c-46a530034c94" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.036s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 10:59:59 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:00:01 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:00:01 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c493603c-1d87-41a1-9e76-fb5b39252ffb tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 0bb99276-64ba-4641-8869-3f35eea2f76e] Calling os-brick to attach iSCSI Volume {{(pid=71509) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 11:00:01 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-c493603c-1d87-41a1-9e76-fb5b39252ffb tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0bf0749390>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:46bd9d4e-4a8e-47d8-8b69-aed30d0e5f7b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gKdFXLSs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 11:00:01 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-c493603c-1d87-41a1-9e76-fb5b39252ffb tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 11:00:01 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-c493603c-1d87-41a1-9e76-fb5b39252ffb tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 11:00:01 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-c493603c-1d87-41a1-9e76-fb5b39252ffb tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 11:00:01 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-c493603c-1d87-41a1-9e76-fb5b39252ffb tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 11:00:01 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-c493603c-1d87-41a1-9e76-fb5b39252ffb tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46bd9d4e-4a8e-47d8-8b69-aed30d0e5f7b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 11:00:01 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-c493603c-1d87-41a1-9e76-fb5b39252ffb tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46bd9d4e-4a8e-47d8-8b69-aed30d0e5f7b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 11:00:01 user nova-compute[71509]: INFO os_brick.initiator.connectors.iscsi [None req-c493603c-1d87-41a1-9e76-fb5b39252ffb tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 11:00:01 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46bd9d4e-4a8e-47d8-8b69-aed30d0e5f7b -p 172.16.0.220:3260 {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:00:01 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46bd9d4e-4a8e-47d8-8b69-aed30d0e5f7b -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:00:01 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9cc3f55-7261-464f-9884-43abdcd428dc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:00:01 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-c493603c-1d87-41a1-9e76-fb5b39252ffb tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 11:00:01 user nova-compute[71509]:  {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:00:01 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46bd9d4e-4a8e-47d8-8b69-aed30d0e5f7b -p 172.16.0.220:3260 --interface default --op new {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:00:01 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46bd9d4e-4a8e-47d8-8b69-aed30d0e5f7b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:00:01 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[68d0dba0-f76e-468b-964c-aac8f8083518]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:46bd9d4e-4a8e-47d8-8b69-aed30d0e5f7b] added\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:00:01 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-c493603c-1d87-41a1-9e76-fb5b39252ffb tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:46bd9d4e-4a8e-47d8-8b69-aed30d0e5f7b] added
Apr 14 11:00:01 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:00:01 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46bd9d4e-4a8e-47d8-8b69-aed30d0e5f7b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:00:01 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46bd9d4e-4a8e-47d8-8b69-aed30d0e5f7b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:00:01 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[db9a2e5d-a1af-494b-b210-bf97e5b55c7d]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:00:01 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-c493603c-1d87-41a1-9e76-fb5b39252ffb tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:00:01 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46bd9d4e-4a8e-47d8-8b69-aed30d0e5f7b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:00:01 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46bd9d4e-4a8e-47d8-8b69-aed30d0e5f7b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:00:01 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fd65c3f-65fe-4b69-8436-99f6db4a6a84]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:00:01 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-c493603c-1d87-41a1-9e76-fb5b39252ffb tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:00:01 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46bd9d4e-4a8e-47d8-8b69-aed30d0e5f7b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gKdFXLSs {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:00:01 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46bd9d4e-4a8e-47d8-8b69-aed30d0e5f7b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gKdFXLSs" returned: 0 in 0.022s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:00:01 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[05f2716d-667d-4b70-902c-181d291ae5de]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:00:01 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-c493603c-1d87-41a1-9e76-fb5b39252ffb tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gKdFXLSs'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:00:01 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46bd9d4e-4a8e-47d8-8b69-aed30d0e5f7b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:00:01 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46bd9d4e-4a8e-47d8-8b69-aed30d0e5f7b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:00:01 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a3112d1-cf46-4c51-8321-38c6c58355bc]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:00:01 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-c493603c-1d87-41a1-9e76-fb5b39252ffb tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:00:01 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:00:01 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:00:01 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[a35d3742-57a4-4fa0-814a-f2ea529f2abd]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7979d4e6-ecf8-4e89-897f-13d8a1a7afdd (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:00:01 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-c493603c-1d87-41a1-9e76-fb5b39252ffb tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)
Apr 14 11:00:01 user nova-compute[71509]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219 (non-flash)
Apr 14 11:00:01 user nova-compute[71509]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3 (non-flash)
Apr 14 11:00:01 user nova-compute[71509]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7979d4e6-ecf8-4e89-897f-13d8a1a7afdd (non-flash)
Apr 14 11:00:01 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 11:00:01 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-c493603c-1d87-41a1-9e76-fb5b39252ffb tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)
Apr 14 11:00:01 user nova-compute[71509]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219 (non-flash)
Apr 14 11:00:01 user nova-compute[71509]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3 (non-flash)
Apr 14 11:00:01 user nova-compute[71509]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7979d4e6-ecf8-4e89-897f-13d8a1a7afdd (non-flash)
Apr 14 11:00:01 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 11:00:01 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46bd9d4e-4a8e-47d8-8b69-aed30d0e5f7b -p 172.16.0.220:3260 --login {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:00:01 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46bd9d4e-4a8e-47d8-8b69-aed30d0e5f7b -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:00:01 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdfe60d9-87b3-42c4-8421-0a9f2b1f6e82]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:46bd9d4e-4a8e-47d8-8b69-aed30d0e5f7b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:46bd9d4e-4a8e-47d8-8b69-aed30d0e5f7b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:00:01 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-c493603c-1d87-41a1-9e76-fb5b39252ffb tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:46bd9d4e-4a8e-47d8-8b69-aed30d0e5f7b, portal: 172.16.0.220,3260]
Apr 14 11:00:01 user nova-compute[71509]: Login to [iface: default, target: iqn.2010-10.org.openstack:46bd9d4e-4a8e-47d8-8b69-aed30d0e5f7b, portal: 172.16.0.220,3260] successful.
Apr 14 11:00:01 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:00:01 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46bd9d4e-4a8e-47d8-8b69-aed30d0e5f7b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:00:01 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46bd9d4e-4a8e-47d8-8b69-aed30d0e5f7b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:00:01 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[8604f538-2bbb-4bd5-b6f7-0b88fa8329bc]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:00:01 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-c493603c-1d87-41a1-9e76-fb5b39252ffb tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:00:01 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:00:01 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:00:01 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[02b307e7-643c-4143-aca3-48aa5b266620]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7979d4e6-ecf8-4e89-897f-13d8a1a7afdd (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46bd9d4e-4a8e-47d8-8b69-aed30d0e5f7b (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:00:01 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-c493603c-1d87-41a1-9e76-fb5b39252ffb tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)
Apr 14 11:00:01 user nova-compute[71509]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219 (non-flash)
Apr 14 11:00:01 user nova-compute[71509]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3 (non-flash)
Apr 14 11:00:01 user nova-compute[71509]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7979d4e6-ecf8-4e89-897f-13d8a1a7afdd (non-flash)
Apr 14 11:00:01 user nova-compute[71509]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46bd9d4e-4a8e-47d8-8b69-aed30d0e5f7b (non-flash)
Apr 14 11:00:01 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 11:00:01 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-c493603c-1d87-41a1-9e76-fb5b39252ffb tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)
Apr 14 11:00:01 user nova-compute[71509]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219 (non-flash)
Apr 14 11:00:01 user nova-compute[71509]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3 (non-flash)
Apr 14 11:00:01 user nova-compute[71509]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7979d4e6-ecf8-4e89-897f-13d8a1a7afdd (non-flash)
Apr 14 11:00:01 user nova-compute[71509]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46bd9d4e-4a8e-47d8-8b69-aed30d0e5f7b (non-flash)
Apr 14 11:00:01 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 11:00:01 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-c493603c-1d87-41a1-9e76-fb5b39252ffb tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:46bd9d4e-4a8e-47d8-8b69-aed30d0e5f7b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.312s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 11:00:01 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-c493603c-1d87-41a1-9e76-fb5b39252ffb tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Connected to 172.16.0.220:3260 {{(pid=71509) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 11:00:01 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-c493603c-1d87-41a1-9e76-fb5b39252ffb tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] HCTL ('37', '-', '-', 0) found on session 41 with lun 0 {{(pid=71509) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 11:00:01 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-c493603c-1d87-41a1-9e76-fb5b39252ffb tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=71509) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 11:00:01 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:00:02 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:00:02 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[2634538f-8028-4f62-b536-efa32cada071]: (4, ('- - 0', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:00:02 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-c493603c-1d87-41a1-9e76-fb5b39252ffb tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Searching for a device in session 41 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71509) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 11:00:02 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-c493603c-1d87-41a1-9e76-fb5b39252ffb tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:46bd9d4e-4a8e-47d8-8b69-aed30d0e5f7b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gKdFXLSs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71509) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 11:00:03 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-c493603c-1d87-41a1-9e76-fb5b39252ffb tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.346s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 11:00:03 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-c493603c-1d87-41a1-9e76-fb5b39252ffb tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] <== connect_volume: return (1348ms) {'type': 'block', 'scsi_wwn': '26631323861646434', 'path': '/dev/sdf'} {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 11:00:03 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c493603c-1d87-41a1-9e76-fb5b39252ffb tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 0bb99276-64ba-4641-8869-3f35eea2f76e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26631323861646434', 'path': '/dev/sdf'} {{(pid=71509) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 11:00:03 user nova-compute[71509]: DEBUG nova.objects.instance [None req-c493603c-1d87-41a1-9e76-fb5b39252ffb tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lazy-loading 'flavor' on Instance uuid 0bb99276-64ba-4641-8869-3f35eea2f76e {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 11:00:03 user nova-compute[71509]: DEBUG nova.virt.libvirt.guest [None req-c493603c-1d87-41a1-9e76-fb5b39252ffb tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 11:00:03 user nova-compute[71509]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 11:00:03 user nova-compute[71509]:   <source dev="/dev/sdf"/>
Apr 14 11:00:03 user nova-compute[71509]:   <target dev="vdc" bus="virtio"/>
Apr 14 11:00:03 user nova-compute[71509]:   <serial>46bd9d4e-4a8e-47d8-8b69-aed30d0e5f7b</serial>
Apr 14 11:00:03 user nova-compute[71509]: </disk>
Apr 14 11:00:03 user nova-compute[71509]:  {{(pid=71509) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 11:00:03 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:00:03 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-c493603c-1d87-41a1-9e76-fb5b39252ffb tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] No BDM found with device name vda, not building metadata. {{(pid=71509) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 11:00:03 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-c493603c-1d87-41a1-9e76-fb5b39252ffb tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71509) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 11:00:03 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-c493603c-1d87-41a1-9e76-fb5b39252ffb tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] No BDM found with device name vdc, not building metadata. {{(pid=71509) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 11:00:03 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-c493603c-1d87-41a1-9e76-fb5b39252ffb tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] No VIF found with MAC fa:16:3e:3f:d7:0d, not building metadata {{(pid=71509) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 11:00:03 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-c493603c-1d87-41a1-9e76-fb5b39252ffb tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "0bb99276-64ba-4641-8869-3f35eea2f76e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.664s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:00:04 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-fe2ae9c4-1c99-4ef5-b11d-3141bfe4899f tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Acquiring lock "0bb99276-64ba-4641-8869-3f35eea2f76e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:00:04 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-fe2ae9c4-1c99-4ef5-b11d-3141bfe4899f tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "0bb99276-64ba-4641-8869-3f35eea2f76e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:00:04 user nova-compute[71509]: INFO nova.compute.manager [None req-fe2ae9c4-1c99-4ef5-b11d-3141bfe4899f tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 0bb99276-64ba-4641-8869-3f35eea2f76e] Detaching volume 7979d4e6-ecf8-4e89-897f-13d8a1a7afdd
Apr 14 11:00:05 user nova-compute[71509]: INFO nova.virt.block_device [None req-fe2ae9c4-1c99-4ef5-b11d-3141bfe4899f tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 0bb99276-64ba-4641-8869-3f35eea2f76e] Attempting to driver detach volume 7979d4e6-ecf8-4e89-897f-13d8a1a7afdd from mountpoint /dev/vdb
Apr 14 11:00:05 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-fe2ae9c4-1c99-4ef5-b11d-3141bfe4899f tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Attempting to detach device vdb from instance 0bb99276-64ba-4641-8869-3f35eea2f76e from the persistent domain config. {{(pid=71509) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 11:00:05 user nova-compute[71509]: DEBUG nova.virt.libvirt.guest [None req-fe2ae9c4-1c99-4ef5-b11d-3141bfe4899f tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 11:00:05 user nova-compute[71509]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 11:00:05 user nova-compute[71509]:   <source dev="/dev/sde"/>
Apr 14 11:00:05 user nova-compute[71509]:   <target dev="vdb" bus="virtio"/>
Apr 14 11:00:05 user nova-compute[71509]:   <serial>7979d4e6-ecf8-4e89-897f-13d8a1a7afdd</serial>
Apr 14 11:00:05 user nova-compute[71509]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 11:00:05 user nova-compute[71509]: </disk>
Apr 14 11:00:05 user nova-compute[71509]:  {{(pid=71509) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 11:00:05 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-fe2ae9c4-1c99-4ef5-b11d-3141bfe4899f tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Successfully detached device vdb from instance 0bb99276-64ba-4641-8869-3f35eea2f76e from the persistent domain config.
Apr 14 11:00:05 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-fe2ae9c4-1c99-4ef5-b11d-3141bfe4899f tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0bb99276-64ba-4641-8869-3f35eea2f76e from the live domain config. {{(pid=71509) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 11:00:05 user nova-compute[71509]: DEBUG nova.virt.libvirt.guest [None req-fe2ae9c4-1c99-4ef5-b11d-3141bfe4899f tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 11:00:05 user nova-compute[71509]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 11:00:05 user nova-compute[71509]:   <source dev="/dev/sde"/>
Apr 14 11:00:05 user nova-compute[71509]:   <target dev="vdb" bus="virtio"/>
Apr 14 11:00:05 user nova-compute[71509]:   <serial>7979d4e6-ecf8-4e89-897f-13d8a1a7afdd</serial>
Apr 14 11:00:05 user nova-compute[71509]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 11:00:05 user nova-compute[71509]: </disk>
Apr 14 11:00:05 user nova-compute[71509]:  {{(pid=71509) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 11:00:05 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Received event <DeviceRemovedEvent: 1681470005.484576, 0bb99276-64ba-4641-8869-3f35eea2f76e => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71509) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 11:00:05 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-fe2ae9c4-1c99-4ef5-b11d-3141bfe4899f tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0bb99276-64ba-4641-8869-3f35eea2f76e {{(pid=71509) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 11:00:05 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-fe2ae9c4-1c99-4ef5-b11d-3141bfe4899f tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Successfully detached device vdb from instance 0bb99276-64ba-4641-8869-3f35eea2f76e from the live domain config.
Apr 14 11:00:05 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe2ae9c4-1c99-4ef5-b11d-3141bfe4899f tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 0bb99276-64ba-4641-8869-3f35eea2f76e] calling os-brick to detach iSCSI Volume {{(pid=71509) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 11:00:05 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe2ae9c4-1c99-4ef5-b11d-3141bfe4899f tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0bf0749390>, {'target_iqn': 'iqn.2010-10.org.openstack:7979d4e6-ecf8-4e89-897f-13d8a1a7afdd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zeVxFUHG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 11:00:05 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-fe2ae9c4-1c99-4ef5-b11d-3141bfe4899f tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 11:00:05 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-fe2ae9c4-1c99-4ef5-b11d-3141bfe4899f tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 11:00:05 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-fe2ae9c4-1c99-4ef5-b11d-3141bfe4899f tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 11:00:05 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:00:05 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:00:05 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[5def49cb-8f79-4814-9352-9c10e1cebc31]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:46bd9d4e-4a8e-47d8-8b69-aed30d0e5f7b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7979d4e6-ecf8-4e89-897f-13d8a1a7afdd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:00:05 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe2ae9c4-1c99-4ef5-b11d-3141bfe4899f tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 11:00:05 user nova-compute[71509]: No targets found.
Apr 14 11:00:05 user nova-compute[71509]: iSNS:
Apr 14 11:00:05 user nova-compute[71509]: No targets found.
Apr 14 11:00:05 user nova-compute[71509]: STATIC:
Apr 14 11:00:05 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3
Apr 14 11:00:05 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 11:00:05 user nova-compute[71509]:                 Iface Name: default
Apr 14 11:00:05 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:46bd9d4e-4a8e-47d8-8b69-aed30d0e5f7b
Apr 14 11:00:05 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 11:00:05 user nova-compute[71509]:                 Iface Name: default
Apr 14 11:00:05 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178
Apr 14 11:00:05 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 11:00:05 user nova-compute[71509]:                 Iface Name: default
Apr 14 11:00:05 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219
Apr 14 11:00:05 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 11:00:05 user nova-compute[71509]:                 Iface Name: default
Apr 14 11:00:05 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:7979d4e6-ecf8-4e89-897f-13d8a1a7afdd
Apr 14 11:00:05 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 11:00:05 user nova-compute[71509]:                 Iface Name: default
Apr 14 11:00:05 user nova-compute[71509]: FIRMWARE:
Apr 14 11:00:05 user nova-compute[71509]: No targets found.
Apr 14 11:00:05 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 11:00:05 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe2ae9c4-1c99-4ef5-b11d-3141bfe4899f tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 11:00:05 user nova-compute[71509]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 11:00:05 user nova-compute[71509]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71509) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 11:00:05 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe2ae9c4-1c99-4ef5-b11d-3141bfe4899f tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7979d4e6-ecf8-4e89-897f-13d8a1a7afdd', 0)] {{(pid=71509) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 11:00:05 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:00:05 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:00:05 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[53dfa099-8062-4cdb-a560-d07da473db97]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46bd9d4e-4a8e-47d8-8b69-aed30d0e5f7b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7979d4e6-ecf8-4e89-897f-13d8a1a7afdd\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:00:05 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:00:05 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:00:05 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[409c2f3f-33f1-4056-8ed8-8c315e6d3ee4]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7979d4e6-ecf8-4e89-897f-13d8a1a7afdd (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46bd9d4e-4a8e-47d8-8b69-aed30d0e5f7b (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:00:05 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe2ae9c4-1c99-4ef5-b11d-3141bfe4899f tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)
Apr 14 11:00:05 user nova-compute[71509]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219 (non-flash)
Apr 14 11:00:05 user nova-compute[71509]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3 (non-flash)
Apr 14 11:00:05 user nova-compute[71509]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7979d4e6-ecf8-4e89-897f-13d8a1a7afdd (non-flash)
Apr 14 11:00:05 user nova-compute[71509]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46bd9d4e-4a8e-47d8-8b69-aed30d0e5f7b (non-flash)
Apr 14 11:00:05 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 11:00:05 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe2ae9c4-1c99-4ef5-b11d-3141bfe4899f tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)
Apr 14 11:00:05 user nova-compute[71509]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219 (non-flash)
Apr 14 11:00:05 user nova-compute[71509]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3 (non-flash)
Apr 14 11:00:05 user nova-compute[71509]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7979d4e6-ecf8-4e89-897f-13d8a1a7afdd (non-flash)
Apr 14 11:00:05 user nova-compute[71509]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46bd9d4e-4a8e-47d8-8b69-aed30d0e5f7b (non-flash)
Apr 14 11:00:05 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 11:00:05 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe2ae9c4-1c99-4ef5-b11d-3141bfe4899f tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0bf0445000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7979d4e6-ecf8-4e89-897f-13d8a1a7afdd'): ({'sde'}, set())}) {{(pid=71509) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 11:00:05 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-fe2ae9c4-1c99-4ef5-b11d-3141bfe4899f tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Removing single pathed devices sde {{(pid=71509) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 11:00:05 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:00:05 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:00:05 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdc21e18-5cec-4932-b8e2-ab8ed5420ea4]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:00:05 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:00:05 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:00:05 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[148f92e5-d1c6-4f3c-8dff-8b12d34787d3]: (4, ('ok\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:00:05 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-fe2ae9c4-1c99-4ef5-b11d-3141bfe4899f tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Flushing IO for device /dev/sde {{(pid=71509) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 11:00:05 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:00:05 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:00:05 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[b22f20a3-a21f-4a06-87fc-33ae4409efbd]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:00:05 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-fe2ae9c4-1c99-4ef5-b11d-3141bfe4899f tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71509) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 11:00:05 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:00:05 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.038s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:00:05 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8cfe4fe-621c-4d81-92ac-6c980fa30a35]: (4, ('1', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:00:05 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-fe2ae9c4-1c99-4ef5-b11d-3141bfe4899f tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71509) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 11:00:05 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-fe2ae9c4-1c99-4ef5-b11d-3141bfe4899f tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] SCSI volumes sde have been removed. {{(pid=71509) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 11:00:05 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe2ae9c4-1c99-4ef5-b11d-3141bfe4899f tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7979d4e6-ecf8-4e89-897f-13d8a1a7afdd')] {{(pid=71509) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 11:00:05 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7979d4e6-ecf8-4e89-897f-13d8a1a7afdd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:00:05 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7979d4e6-ecf8-4e89-897f-13d8a1a7afdd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:00:05 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce5d31e1-15e6-4cb6-b8dc-cbfcaf8c55dd]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:00:05 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe2ae9c4-1c99-4ef5-b11d-3141bfe4899f tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:00:05 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7979d4e6-ecf8-4e89-897f-13d8a1a7afdd -p 172.16.0.220:3260 --logout {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:00:05 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7979d4e6-ecf8-4e89-897f-13d8a1a7afdd -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:00:05 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e3fa93d-133a-4d3d-a9f1-aae1fd95db0d]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:7979d4e6-ecf8-4e89-897f-13d8a1a7afdd, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:7979d4e6-ecf8-4e89-897f-13d8a1a7afdd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:00:05 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe2ae9c4-1c99-4ef5-b11d-3141bfe4899f tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:7979d4e6-ecf8-4e89-897f-13d8a1a7afdd, portal: 172.16.0.220,3260]
Apr 14 11:00:05 user nova-compute[71509]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:7979d4e6-ecf8-4e89-897f-13d8a1a7afdd, portal: 172.16.0.220,3260] successful.
Apr 14 11:00:05 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:00:05 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7979d4e6-ecf8-4e89-897f-13d8a1a7afdd -p 172.16.0.220:3260 --op delete {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:00:05 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7979d4e6-ecf8-4e89-897f-13d8a1a7afdd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:00:05 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d638c9d-e468-484d-81b0-79853adbd0aa]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:00:05 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe2ae9c4-1c99-4ef5-b11d-3141bfe4899f tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:00:05 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-fe2ae9c4-1c99-4ef5-b11d-3141bfe4899f tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 11:00:05 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe2ae9c4-1c99-4ef5-b11d-3141bfe4899f tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] <== disconnect_volume: return (334ms) None {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 11:00:05 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe2ae9c4-1c99-4ef5-b11d-3141bfe4899f tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 0bb99276-64ba-4641-8869-3f35eea2f76e] Disconnected iSCSI Volume {{(pid=71509) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 11:00:06 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:00:06 user nova-compute[71509]: DEBUG nova.objects.instance [None req-fe2ae9c4-1c99-4ef5-b11d-3141bfe4899f tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lazy-loading 'flavor' on Instance uuid 0bb99276-64ba-4641-8869-3f35eea2f76e {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 11:00:06 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-fe2ae9c4-1c99-4ef5-b11d-3141bfe4899f tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "0bb99276-64ba-4641-8869-3f35eea2f76e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.673s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:00:07 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-803456af-a1f8-4f1f-a09a-3a41afeadac7 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Acquiring lock "0bb99276-64ba-4641-8869-3f35eea2f76e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:00:07 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-803456af-a1f8-4f1f-a09a-3a41afeadac7 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "0bb99276-64ba-4641-8869-3f35eea2f76e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:00:07 user nova-compute[71509]: INFO nova.compute.manager [None req-803456af-a1f8-4f1f-a09a-3a41afeadac7 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 0bb99276-64ba-4641-8869-3f35eea2f76e] Detaching volume 46bd9d4e-4a8e-47d8-8b69-aed30d0e5f7b
Apr 14 11:00:07 user nova-compute[71509]: INFO nova.virt.block_device [None req-803456af-a1f8-4f1f-a09a-3a41afeadac7 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 0bb99276-64ba-4641-8869-3f35eea2f76e] Attempting to driver detach volume 46bd9d4e-4a8e-47d8-8b69-aed30d0e5f7b from mountpoint /dev/vdc
Apr 14 11:00:07 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-803456af-a1f8-4f1f-a09a-3a41afeadac7 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Attempting to detach device vdc from instance 0bb99276-64ba-4641-8869-3f35eea2f76e from the persistent domain config. {{(pid=71509) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 11:00:07 user nova-compute[71509]: DEBUG nova.virt.libvirt.guest [None req-803456af-a1f8-4f1f-a09a-3a41afeadac7 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 11:00:07 user nova-compute[71509]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 11:00:07 user nova-compute[71509]:   <source dev="/dev/sdf"/>
Apr 14 11:00:07 user nova-compute[71509]:   <target dev="vdc" bus="virtio"/>
Apr 14 11:00:07 user nova-compute[71509]:   <serial>46bd9d4e-4a8e-47d8-8b69-aed30d0e5f7b</serial>
Apr 14 11:00:07 user nova-compute[71509]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Apr 14 11:00:07 user nova-compute[71509]: </disk>
Apr 14 11:00:07 user nova-compute[71509]:  {{(pid=71509) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 11:00:07 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-803456af-a1f8-4f1f-a09a-3a41afeadac7 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Successfully detached device vdc from instance 0bb99276-64ba-4641-8869-3f35eea2f76e from the persistent domain config.
Apr 14 11:00:07 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-803456af-a1f8-4f1f-a09a-3a41afeadac7 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 0bb99276-64ba-4641-8869-3f35eea2f76e from the live domain config. {{(pid=71509) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 11:00:07 user nova-compute[71509]: DEBUG nova.virt.libvirt.guest [None req-803456af-a1f8-4f1f-a09a-3a41afeadac7 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 11:00:07 user nova-compute[71509]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 11:00:07 user nova-compute[71509]:   <source dev="/dev/sdf"/>
Apr 14 11:00:07 user nova-compute[71509]:   <target dev="vdc" bus="virtio"/>
Apr 14 11:00:07 user nova-compute[71509]:   <serial>46bd9d4e-4a8e-47d8-8b69-aed30d0e5f7b</serial>
Apr 14 11:00:07 user nova-compute[71509]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Apr 14 11:00:07 user nova-compute[71509]: </disk>
Apr 14 11:00:07 user nova-compute[71509]:  {{(pid=71509) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 11:00:07 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Received event <DeviceRemovedEvent: 1681470007.9281566, 0bb99276-64ba-4641-8869-3f35eea2f76e => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=71509) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 11:00:07 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-803456af-a1f8-4f1f-a09a-3a41afeadac7 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 0bb99276-64ba-4641-8869-3f35eea2f76e {{(pid=71509) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 11:00:07 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-803456af-a1f8-4f1f-a09a-3a41afeadac7 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Successfully detached device vdc from instance 0bb99276-64ba-4641-8869-3f35eea2f76e from the live domain config.
Apr 14 11:00:07 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-803456af-a1f8-4f1f-a09a-3a41afeadac7 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 0bb99276-64ba-4641-8869-3f35eea2f76e] calling os-brick to detach iSCSI Volume {{(pid=71509) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 11:00:07 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-803456af-a1f8-4f1f-a09a-3a41afeadac7 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0bf0749390>, {'target_iqn': 'iqn.2010-10.org.openstack:46bd9d4e-4a8e-47d8-8b69-aed30d0e5f7b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gKdFXLSs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 11:00:07 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-803456af-a1f8-4f1f-a09a-3a41afeadac7 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 11:00:07 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-803456af-a1f8-4f1f-a09a-3a41afeadac7 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 11:00:07 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-803456af-a1f8-4f1f-a09a-3a41afeadac7 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 11:00:07 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:00:07 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:00:07 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[79071339-88cb-4e2f-9b7a-4d905a45665a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:46bd9d4e-4a8e-47d8-8b69-aed30d0e5f7b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:00:07 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-803456af-a1f8-4f1f-a09a-3a41afeadac7 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 11:00:07 user nova-compute[71509]: No targets found.
Apr 14 11:00:07 user nova-compute[71509]: iSNS:
Apr 14 11:00:07 user nova-compute[71509]: No targets found.
Apr 14 11:00:07 user nova-compute[71509]: STATIC:
Apr 14 11:00:07 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3
Apr 14 11:00:07 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 11:00:07 user nova-compute[71509]:                 Iface Name: default
Apr 14 11:00:07 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:46bd9d4e-4a8e-47d8-8b69-aed30d0e5f7b
Apr 14 11:00:07 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 11:00:07 user nova-compute[71509]:                 Iface Name: default
Apr 14 11:00:07 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178
Apr 14 11:00:07 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 11:00:07 user nova-compute[71509]:                 Iface Name: default
Apr 14 11:00:07 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219
Apr 14 11:00:07 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 11:00:07 user nova-compute[71509]:                 Iface Name: default
Apr 14 11:00:07 user nova-compute[71509]: FIRMWARE:
Apr 14 11:00:07 user nova-compute[71509]: No targets found.
Apr 14 11:00:07 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 11:00:07 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-803456af-a1f8-4f1f-a09a-3a41afeadac7 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 11:00:07 user nova-compute[71509]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 11:00:07 user nova-compute[71509]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71509) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 11:00:07 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-803456af-a1f8-4f1f-a09a-3a41afeadac7 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:46bd9d4e-4a8e-47d8-8b69-aed30d0e5f7b', 0)] {{(pid=71509) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 11:00:07 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:00:07 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:00:07 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[27d05a1c-dc11-4f34-bfce-eeddf2f6ecf1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:46bd9d4e-4a8e-47d8-8b69-aed30d0e5f7b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:00:07 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:00:08 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:00:08 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[6df47a2d-ac2d-43c0-a45a-9c7543a95f60]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46bd9d4e-4a8e-47d8-8b69-aed30d0e5f7b (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:00:08 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-803456af-a1f8-4f1f-a09a-3a41afeadac7 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)
Apr 14 11:00:08 user nova-compute[71509]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219 (non-flash)
Apr 14 11:00:08 user nova-compute[71509]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3 (non-flash)
Apr 14 11:00:08 user nova-compute[71509]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46bd9d4e-4a8e-47d8-8b69-aed30d0e5f7b (non-flash)
Apr 14 11:00:08 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 11:00:08 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-803456af-a1f8-4f1f-a09a-3a41afeadac7 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)
Apr 14 11:00:08 user nova-compute[71509]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219 (non-flash)
Apr 14 11:00:08 user nova-compute[71509]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3 (non-flash)
Apr 14 11:00:08 user nova-compute[71509]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:46bd9d4e-4a8e-47d8-8b69-aed30d0e5f7b (non-flash)
Apr 14 11:00:08 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 11:00:08 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-803456af-a1f8-4f1f-a09a-3a41afeadac7 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0c2c168550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:46bd9d4e-4a8e-47d8-8b69-aed30d0e5f7b'): ({'sdf'}, set())}) {{(pid=71509) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 11:00:08 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-803456af-a1f8-4f1f-a09a-3a41afeadac7 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Removing single pathed devices sdf {{(pid=71509) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 11:00:08 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:00:08 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:00:08 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[475b1971-6f8c-4d82-85c1-d4c2800046d3]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:00:08 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:00:08 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:00:08 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[428fad7b-9833-4a26-9530-d249db52a7c7]: (4, ('ok\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:00:08 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-803456af-a1f8-4f1f-a09a-3a41afeadac7 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Flushing IO for device /dev/sdf {{(pid=71509) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 11:00:08 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:00:08 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:00:08 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5006b53-a38f-4cca-b113-4514ff2619b9]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:00:08 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-803456af-a1f8-4f1f-a09a-3a41afeadac7 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71509) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 11:00:08 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:00:08 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.042s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:00:08 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[74e7d8aa-a096-404a-9e84-9cb2adf2ca71]: (4, ('1', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:00:08 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-803456af-a1f8-4f1f-a09a-3a41afeadac7 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=71509) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 11:00:08 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-803456af-a1f8-4f1f-a09a-3a41afeadac7 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] SCSI volumes sdf have been removed. {{(pid=71509) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 11:00:08 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-803456af-a1f8-4f1f-a09a-3a41afeadac7 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:46bd9d4e-4a8e-47d8-8b69-aed30d0e5f7b')] {{(pid=71509) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 11:00:08 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46bd9d4e-4a8e-47d8-8b69-aed30d0e5f7b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:00:08 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46bd9d4e-4a8e-47d8-8b69-aed30d0e5f7b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:00:08 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1c0291a-4134-41cb-8cc5-0131e878a3a3]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:00:08 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-803456af-a1f8-4f1f-a09a-3a41afeadac7 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:00:08 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46bd9d4e-4a8e-47d8-8b69-aed30d0e5f7b -p 172.16.0.220:3260 --logout {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:00:08 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46bd9d4e-4a8e-47d8-8b69-aed30d0e5f7b -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:00:08 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2cdfd90-bfa5-4545-b974-f0b547f32fb0]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:46bd9d4e-4a8e-47d8-8b69-aed30d0e5f7b, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:46bd9d4e-4a8e-47d8-8b69-aed30d0e5f7b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:00:08 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-803456af-a1f8-4f1f-a09a-3a41afeadac7 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:46bd9d4e-4a8e-47d8-8b69-aed30d0e5f7b, portal: 172.16.0.220,3260]
Apr 14 11:00:08 user nova-compute[71509]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:46bd9d4e-4a8e-47d8-8b69-aed30d0e5f7b, portal: 172.16.0.220,3260] successful.
Apr 14 11:00:08 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:00:08 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:46bd9d4e-4a8e-47d8-8b69-aed30d0e5f7b -p 172.16.0.220:3260 --op delete {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:00:08 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:46bd9d4e-4a8e-47d8-8b69-aed30d0e5f7b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:00:08 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[0709a14c-ff33-454f-a47e-21358e09db9d]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:00:08 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-803456af-a1f8-4f1f-a09a-3a41afeadac7 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:00:08 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-803456af-a1f8-4f1f-a09a-3a41afeadac7 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 11:00:08 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-803456af-a1f8-4f1f-a09a-3a41afeadac7 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] <== disconnect_volume: return (311ms) None {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 11:00:08 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-803456af-a1f8-4f1f-a09a-3a41afeadac7 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 0bb99276-64ba-4641-8869-3f35eea2f76e] Disconnected iSCSI Volume {{(pid=71509) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 11:00:08 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:00:09 user nova-compute[71509]: DEBUG nova.objects.instance [None req-803456af-a1f8-4f1f-a09a-3a41afeadac7 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lazy-loading 'flavor' on Instance uuid 0bb99276-64ba-4641-8869-3f35eea2f76e {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 11:00:09 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-803456af-a1f8-4f1f-a09a-3a41afeadac7 tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "0bb99276-64ba-4641-8869-3f35eea2f76e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.391s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:00:11 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-adc133eb-8181-4fdc-89c6-4b74d606245c tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Acquiring lock "0bb99276-64ba-4641-8869-3f35eea2f76e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:00:11 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-adc133eb-8181-4fdc-89c6-4b74d606245c tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "0bb99276-64ba-4641-8869-3f35eea2f76e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:00:11 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-adc133eb-8181-4fdc-89c6-4b74d606245c tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Acquiring lock "0bb99276-64ba-4641-8869-3f35eea2f76e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:00:11 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-adc133eb-8181-4fdc-89c6-4b74d606245c tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "0bb99276-64ba-4641-8869-3f35eea2f76e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:00:11 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-adc133eb-8181-4fdc-89c6-4b74d606245c tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "0bb99276-64ba-4641-8869-3f35eea2f76e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:00:11 user nova-compute[71509]: INFO nova.compute.manager [None req-adc133eb-8181-4fdc-89c6-4b74d606245c tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 0bb99276-64ba-4641-8869-3f35eea2f76e] Terminating instance
Apr 14 11:00:11 user nova-compute[71509]: DEBUG nova.compute.manager [None req-adc133eb-8181-4fdc-89c6-4b74d606245c tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 0bb99276-64ba-4641-8869-3f35eea2f76e] Start destroying the instance on the hypervisor. {{(pid=71509) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 11:00:11 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:00:11 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:00:11 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:00:11 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:00:11 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:00:11 user nova-compute[71509]: DEBUG nova.compute.manager [req-9cee3cda-22cc-4282-844e-4459be2e4603 req-42c6f6ed-926a-49cd-b7f0-406da9b8696a service nova] [instance: 0bb99276-64ba-4641-8869-3f35eea2f76e] Received event network-vif-unplugged-7e4a1964-f2d0-4a4f-81fc-adf97c621209 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:00:11 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-9cee3cda-22cc-4282-844e-4459be2e4603 req-42c6f6ed-926a-49cd-b7f0-406da9b8696a service nova] Acquiring lock "0bb99276-64ba-4641-8869-3f35eea2f76e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:00:11 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-9cee3cda-22cc-4282-844e-4459be2e4603 req-42c6f6ed-926a-49cd-b7f0-406da9b8696a service nova] Lock "0bb99276-64ba-4641-8869-3f35eea2f76e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:00:11 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-9cee3cda-22cc-4282-844e-4459be2e4603 req-42c6f6ed-926a-49cd-b7f0-406da9b8696a service nova] Lock "0bb99276-64ba-4641-8869-3f35eea2f76e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:00:11 user nova-compute[71509]: DEBUG nova.compute.manager [req-9cee3cda-22cc-4282-844e-4459be2e4603 req-42c6f6ed-926a-49cd-b7f0-406da9b8696a service nova] [instance: 0bb99276-64ba-4641-8869-3f35eea2f76e] No waiting events found dispatching network-vif-unplugged-7e4a1964-f2d0-4a4f-81fc-adf97c621209 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:00:11 user nova-compute[71509]: DEBUG nova.compute.manager [req-9cee3cda-22cc-4282-844e-4459be2e4603 req-42c6f6ed-926a-49cd-b7f0-406da9b8696a service nova] [instance: 0bb99276-64ba-4641-8869-3f35eea2f76e] Received event network-vif-unplugged-7e4a1964-f2d0-4a4f-81fc-adf97c621209 for instance with task_state deleting. {{(pid=71509) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 11:00:11 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: 0bb99276-64ba-4641-8869-3f35eea2f76e] Instance destroyed successfully.
Apr 14 11:00:11 user nova-compute[71509]: DEBUG nova.objects.instance [None req-adc133eb-8181-4fdc-89c6-4b74d606245c tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lazy-loading 'resources' on Instance uuid 0bb99276-64ba-4641-8869-3f35eea2f76e {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 11:00:11 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-adc133eb-8181-4fdc-89c6-4b74d606245c tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T10:57:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1620846551',display_name='tempest-AttachVolumeTestJSON-server-1620846551',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1620846551',id=31,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDFX4psVsnJ7YiVMlmDva54tVnsB3EA7ThlyG0DNat7parQ+EKTGjR4spXyHIu1F0sE5iuPdm8WruPRGM1gtmd8ovAAupZwja/Lb7SJjV4yMTxDx05zIxkiT3ZZ1VUWZmA==',key_name='tempest-keypair-1954654699',keypairs=<?>,launch_index=0,launched_at=2023-04-14T10:57:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eb9b9fc4f2e244879502006bb844761c',ramdisk_id='',reservation_id='r-09nrco14',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-821788322',owner_user_name='tempest-AttachVolumeTestJSON-821788322-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T10:57:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11cb4a1e78d447dbb18cde5453fe499c',uuid=0bb99276-64ba-4641-8869-3f35eea2f76e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7e4a1964-f2d0-4a4f-81fc-adf97c621209", "address": "fa:16:3e:3f:d7:0d", "network": {"id": "653f0c81-1afd-4ca6-9639-675ead1a6127", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-932652547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb9b9fc4f2e244879502006bb844761c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e4a1964-f2", "ovs_interfaceid": "7e4a1964-f2d0-4a4f-81fc-adf97c621209", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 11:00:11 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-adc133eb-8181-4fdc-89c6-4b74d606245c tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Converting VIF {"id": "7e4a1964-f2d0-4a4f-81fc-adf97c621209", "address": "fa:16:3e:3f:d7:0d", "network": {"id": "653f0c81-1afd-4ca6-9639-675ead1a6127", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-932652547-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb9b9fc4f2e244879502006bb844761c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e4a1964-f2", "ovs_interfaceid": "7e4a1964-f2d0-4a4f-81fc-adf97c621209", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 11:00:11 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-adc133eb-8181-4fdc-89c6-4b74d606245c tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3f:d7:0d,bridge_name='br-int',has_traffic_filtering=True,id=7e4a1964-f2d0-4a4f-81fc-adf97c621209,network=Network(653f0c81-1afd-4ca6-9639-675ead1a6127),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e4a1964-f2') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 11:00:11 user nova-compute[71509]: DEBUG os_vif [None req-adc133eb-8181-4fdc-89c6-4b74d606245c tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3f:d7:0d,bridge_name='br-int',has_traffic_filtering=True,id=7e4a1964-f2d0-4a4f-81fc-adf97c621209,network=Network(653f0c81-1afd-4ca6-9639-675ead1a6127),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e4a1964-f2') {{(pid=71509) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 11:00:11 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:00:11 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7e4a1964-f2, bridge=br-int, if_exists=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:00:11 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:00:11 user nova-compute[71509]: INFO os_vif [None req-adc133eb-8181-4fdc-89c6-4b74d606245c tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3f:d7:0d,bridge_name='br-int',has_traffic_filtering=True,id=7e4a1964-f2d0-4a4f-81fc-adf97c621209,network=Network(653f0c81-1afd-4ca6-9639-675ead1a6127),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e4a1964-f2')
Apr 14 11:00:11 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-adc133eb-8181-4fdc-89c6-4b74d606245c tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 0bb99276-64ba-4641-8869-3f35eea2f76e] Deleting instance files /opt/stack/data/nova/instances/0bb99276-64ba-4641-8869-3f35eea2f76e_del
Apr 14 11:00:11 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-adc133eb-8181-4fdc-89c6-4b74d606245c tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 0bb99276-64ba-4641-8869-3f35eea2f76e] Deletion of /opt/stack/data/nova/instances/0bb99276-64ba-4641-8869-3f35eea2f76e_del complete
Apr 14 11:00:12 user nova-compute[71509]: INFO nova.compute.manager [None req-adc133eb-8181-4fdc-89c6-4b74d606245c tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] [instance: 0bb99276-64ba-4641-8869-3f35eea2f76e] Took 0.86 seconds to destroy the instance on the hypervisor.
Apr 14 11:00:12 user nova-compute[71509]: DEBUG oslo.service.loopingcall [None req-adc133eb-8181-4fdc-89c6-4b74d606245c tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71509) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 11:00:12 user nova-compute[71509]: DEBUG nova.compute.manager [-] [instance: 0bb99276-64ba-4641-8869-3f35eea2f76e] Deallocating network for instance {{(pid=71509) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 11:00:12 user nova-compute[71509]: DEBUG nova.network.neutron [-] [instance: 0bb99276-64ba-4641-8869-3f35eea2f76e] deallocate_for_instance() {{(pid=71509) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 11:00:12 user nova-compute[71509]: DEBUG nova.network.neutron [-] [instance: 0bb99276-64ba-4641-8869-3f35eea2f76e] Updating instance_info_cache with network_info: [] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:00:12 user nova-compute[71509]: INFO nova.compute.manager [-] [instance: 0bb99276-64ba-4641-8869-3f35eea2f76e] Took 0.93 seconds to deallocate network for instance.
Apr 14 11:00:13 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-adc133eb-8181-4fdc-89c6-4b74d606245c tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:00:13 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-adc133eb-8181-4fdc-89c6-4b74d606245c tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:00:13 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:00:13 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-adc133eb-8181-4fdc-89c6-4b74d606245c tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 11:00:13 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-adc133eb-8181-4fdc-89c6-4b74d606245c tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 11:00:13 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-adc133eb-8181-4fdc-89c6-4b74d606245c tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.374s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:00:13 user nova-compute[71509]: INFO nova.scheduler.client.report [None req-adc133eb-8181-4fdc-89c6-4b74d606245c tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Deleted allocations for instance 0bb99276-64ba-4641-8869-3f35eea2f76e
Apr 14 11:00:13 user nova-compute[71509]: DEBUG nova.compute.manager [req-ac95bdef-5898-40fa-a374-0eb5850c8196 req-2fdac674-e3ed-4601-b473-b4c7d2d09a47 service nova] [instance: 0bb99276-64ba-4641-8869-3f35eea2f76e] Received event network-vif-plugged-7e4a1964-f2d0-4a4f-81fc-adf97c621209 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:00:13 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-ac95bdef-5898-40fa-a374-0eb5850c8196 req-2fdac674-e3ed-4601-b473-b4c7d2d09a47 service nova] Acquiring lock "0bb99276-64ba-4641-8869-3f35eea2f76e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:00:13 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-ac95bdef-5898-40fa-a374-0eb5850c8196 req-2fdac674-e3ed-4601-b473-b4c7d2d09a47 service nova] Lock "0bb99276-64ba-4641-8869-3f35eea2f76e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:00:13 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-ac95bdef-5898-40fa-a374-0eb5850c8196 req-2fdac674-e3ed-4601-b473-b4c7d2d09a47 service nova] Lock "0bb99276-64ba-4641-8869-3f35eea2f76e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:00:13 user nova-compute[71509]: DEBUG nova.compute.manager [req-ac95bdef-5898-40fa-a374-0eb5850c8196 req-2fdac674-e3ed-4601-b473-b4c7d2d09a47 service nova] [instance: 0bb99276-64ba-4641-8869-3f35eea2f76e] No waiting events found dispatching network-vif-plugged-7e4a1964-f2d0-4a4f-81fc-adf97c621209 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:00:13 user nova-compute[71509]: WARNING nova.compute.manager [req-ac95bdef-5898-40fa-a374-0eb5850c8196 req-2fdac674-e3ed-4601-b473-b4c7d2d09a47 service nova] [instance: 0bb99276-64ba-4641-8869-3f35eea2f76e] Received unexpected event network-vif-plugged-7e4a1964-f2d0-4a4f-81fc-adf97c621209 for instance with vm_state deleted and task_state None.
Apr 14 11:00:13 user nova-compute[71509]: DEBUG nova.compute.manager [req-ac95bdef-5898-40fa-a374-0eb5850c8196 req-2fdac674-e3ed-4601-b473-b4c7d2d09a47 service nova] [instance: 0bb99276-64ba-4641-8869-3f35eea2f76e] Received event network-vif-deleted-7e4a1964-f2d0-4a4f-81fc-adf97c621209 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:00:13 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-adc133eb-8181-4fdc-89c6-4b74d606245c tempest-AttachVolumeTestJSON-821788322 tempest-AttachVolumeTestJSON-821788322-project-member] Lock "0bb99276-64ba-4641-8869-3f35eea2f76e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.348s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:00:16 user nova-compute[71509]: DEBUG nova.compute.manager [req-8fb400b7-e072-4f75-ba0f-a10ade491606 req-a86e0463-13f1-4e9e-a6cb-26b1c1d2ffd1 service nova] [instance: 3d6a53c3-6e32-456c-a056-fbf1bef3b656] Received event network-changed-c18cf2ba-f230-4684-a95c-14af689d7981 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:00:16 user nova-compute[71509]: DEBUG nova.compute.manager [req-8fb400b7-e072-4f75-ba0f-a10ade491606 req-a86e0463-13f1-4e9e-a6cb-26b1c1d2ffd1 service nova] [instance: 3d6a53c3-6e32-456c-a056-fbf1bef3b656] Refreshing instance network info cache due to event network-changed-c18cf2ba-f230-4684-a95c-14af689d7981. {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 11:00:16 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-8fb400b7-e072-4f75-ba0f-a10ade491606 req-a86e0463-13f1-4e9e-a6cb-26b1c1d2ffd1 service nova] Acquiring lock "refresh_cache-3d6a53c3-6e32-456c-a056-fbf1bef3b656" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 11:00:16 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-8fb400b7-e072-4f75-ba0f-a10ade491606 req-a86e0463-13f1-4e9e-a6cb-26b1c1d2ffd1 service nova] Acquired lock "refresh_cache-3d6a53c3-6e32-456c-a056-fbf1bef3b656" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 11:00:16 user nova-compute[71509]: DEBUG nova.network.neutron [req-8fb400b7-e072-4f75-ba0f-a10ade491606 req-a86e0463-13f1-4e9e-a6cb-26b1c1d2ffd1 service nova] [instance: 3d6a53c3-6e32-456c-a056-fbf1bef3b656] Refreshing network info cache for port c18cf2ba-f230-4684-a95c-14af689d7981 {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 11:00:16 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-e75979df-d58b-47b4-ba3d-5298bf4536f9 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Acquiring lock "3d6a53c3-6e32-456c-a056-fbf1bef3b656" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:00:16 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-e75979df-d58b-47b4-ba3d-5298bf4536f9 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "3d6a53c3-6e32-456c-a056-fbf1bef3b656" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:00:16 user nova-compute[71509]: DEBUG nova.objects.instance [None req-e75979df-d58b-47b4-ba3d-5298bf4536f9 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lazy-loading 'flavor' on Instance uuid 3d6a53c3-6e32-456c-a056-fbf1bef3b656 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 11:00:16 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-e75979df-d58b-47b4-ba3d-5298bf4536f9 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "3d6a53c3-6e32-456c-a056-fbf1bef3b656" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:00:16 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:00:17 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-e75979df-d58b-47b4-ba3d-5298bf4536f9 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Acquiring lock "3d6a53c3-6e32-456c-a056-fbf1bef3b656" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:00:17 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-e75979df-d58b-47b4-ba3d-5298bf4536f9 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "3d6a53c3-6e32-456c-a056-fbf1bef3b656" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:00:17 user nova-compute[71509]: INFO nova.compute.manager [None req-e75979df-d58b-47b4-ba3d-5298bf4536f9 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] [instance: 3d6a53c3-6e32-456c-a056-fbf1bef3b656] Attaching volume d0f6ad3f-7e59-4955-983c-a8497d388c95 to /dev/vdb
Apr 14 11:00:17 user nova-compute[71509]: DEBUG os_brick.utils [None req-e75979df-d58b-47b4-ba3d-5298bf4536f9 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 11:00:17 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:00:17 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:00:17 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf4a6fb4-4a4b-47fa-9db8-3471cca4dd3c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50119df3c417\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:00:17 user nova-compute[71509]: DEBUG nova.network.neutron [req-8fb400b7-e072-4f75-ba0f-a10ade491606 req-a86e0463-13f1-4e9e-a6cb-26b1c1d2ffd1 service nova] [instance: 3d6a53c3-6e32-456c-a056-fbf1bef3b656] Updated VIF entry in instance network info cache for port c18cf2ba-f230-4684-a95c-14af689d7981. {{(pid=71509) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 11:00:17 user nova-compute[71509]: DEBUG nova.network.neutron [req-8fb400b7-e072-4f75-ba0f-a10ade491606 req-a86e0463-13f1-4e9e-a6cb-26b1c1d2ffd1 service nova] [instance: 3d6a53c3-6e32-456c-a056-fbf1bef3b656] Updating instance_info_cache with network_info: [{"id": "c18cf2ba-f230-4684-a95c-14af689d7981", "address": "fa:16:3e:ad:2f:9a", "network": {"id": "1fdeb048-706a-45bf-8f2a-2cee21abb9ea", "bridge": "br-int", "label": "tempest-TestStampPattern-1337046138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f629ba0ab8074ed8bb4e59d545b74eb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc18cf2ba-f2", "ovs_interfaceid": "c18cf2ba-f230-4684-a95c-14af689d7981", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:00:17 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:00:17 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:00:17 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[98bd52f7-1e02-453b-b3f3-c5e17701efe7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:00:17 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:00:17 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-8fb400b7-e072-4f75-ba0f-a10ade491606 req-a86e0463-13f1-4e9e-a6cb-26b1c1d2ffd1 service nova] Releasing lock "refresh_cache-3d6a53c3-6e32-456c-a056-fbf1bef3b656" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 11:00:17 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:00:17 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[b355e973-edab-4102-b127-2557aca6843d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:00:17 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d123bb9-ffec-458c-afc4-bc368fae6c8c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:00:17 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-e75979df-d58b-47b4-ba3d-5298bf4536f9 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Running cmd (subprocess): nvme version {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:00:17 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-e75979df-d58b-47b4-ba3d-5298bf4536f9 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] 'nvme version' failed. Not Retrying. {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 11:00:17 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e75979df-d58b-47b4-ba3d-5298bf4536f9 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] nvme not present on system {{(pid=71509) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 11:00:17 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:00:17 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 11:00:17 user nova-compute[71509]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 11:00:17 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[542dc5e6-96a8-4c54-ae23-c9ccd5188424]: (4, '') {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:00:17 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-e75979df-d58b-47b4-ba3d-5298bf4536f9 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71509) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 11:00:17 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-e75979df-d58b-47b4-ba3d-5298bf4536f9 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71509) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 11:00:17 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-e75979df-d58b-47b4-ba3d-5298bf4536f9 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] LIGHTOS: no hostnqn found. {{(pid=71509) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 11:00:17 user nova-compute[71509]: DEBUG os_brick.utils [None req-e75979df-d58b-47b4-ba3d-5298bf4536f9 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50119df3c417', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 11:00:17 user nova-compute[71509]: DEBUG nova.virt.block_device [None req-e75979df-d58b-47b4-ba3d-5298bf4536f9 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] [instance: 3d6a53c3-6e32-456c-a056-fbf1bef3b656] Updating existing volume attachment record: 671881f9-233a-4a96-a049-1e3cbbfa34f3 {{(pid=71509) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 11:00:18 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:00:21 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e75979df-d58b-47b4-ba3d-5298bf4536f9 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] [instance: 3d6a53c3-6e32-456c-a056-fbf1bef3b656] Calling os-brick to attach iSCSI Volume {{(pid=71509) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 11:00:21 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-e75979df-d58b-47b4-ba3d-5298bf4536f9 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0bf0749390>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d0f6ad3f-7e59-4955-983c-a8497d388c95', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DquWLGyA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 11:00:21 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-e75979df-d58b-47b4-ba3d-5298bf4536f9 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 11:00:21 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-e75979df-d58b-47b4-ba3d-5298bf4536f9 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 11:00:21 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-e75979df-d58b-47b4-ba3d-5298bf4536f9 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 11:00:21 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-e75979df-d58b-47b4-ba3d-5298bf4536f9 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 11:00:21 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-e75979df-d58b-47b4-ba3d-5298bf4536f9 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d0f6ad3f-7e59-4955-983c-a8497d388c95" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 11:00:21 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-e75979df-d58b-47b4-ba3d-5298bf4536f9 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d0f6ad3f-7e59-4955-983c-a8497d388c95" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 11:00:21 user nova-compute[71509]: INFO os_brick.initiator.connectors.iscsi [None req-e75979df-d58b-47b4-ba3d-5298bf4536f9 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 11:00:21 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0f6ad3f-7e59-4955-983c-a8497d388c95 -p 172.16.0.220:3260 {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:00:21 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0f6ad3f-7e59-4955-983c-a8497d388c95 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:00:21 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[e462ffcd-c648-4ad2-be91-2a66b3b87098]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:00:21 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-e75979df-d58b-47b4-ba3d-5298bf4536f9 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 11:00:21 user nova-compute[71509]:  {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:00:21 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0f6ad3f-7e59-4955-983c-a8497d388c95 -p 172.16.0.220:3260 --interface default --op new {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:00:21 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0f6ad3f-7e59-4955-983c-a8497d388c95 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:00:21 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[d439e384-c2ad-42d5-8a03-6a8e2cdef709]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d0f6ad3f-7e59-4955-983c-a8497d388c95] added\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:00:21 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-e75979df-d58b-47b4-ba3d-5298bf4536f9 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d0f6ad3f-7e59-4955-983c-a8497d388c95] added
Apr 14 11:00:21 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:00:21 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0f6ad3f-7e59-4955-983c-a8497d388c95 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:00:21 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0f6ad3f-7e59-4955-983c-a8497d388c95 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:00:21 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b39fa4f-4a82-4622-a313-850000c1a892]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:00:21 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-e75979df-d58b-47b4-ba3d-5298bf4536f9 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:00:21 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0f6ad3f-7e59-4955-983c-a8497d388c95 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:00:21 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0f6ad3f-7e59-4955-983c-a8497d388c95 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:00:21 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[6896ca37-70d4-47a3-ab6e-07aae71db342]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:00:21 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-e75979df-d58b-47b4-ba3d-5298bf4536f9 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:00:21 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0f6ad3f-7e59-4955-983c-a8497d388c95 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DquWLGyA {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:00:21 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0f6ad3f-7e59-4955-983c-a8497d388c95 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DquWLGyA" returned: 0 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:00:21 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[477d42ce-eda6-4960-b132-015f58ada94a]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:00:21 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-e75979df-d58b-47b4-ba3d-5298bf4536f9 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DquWLGyA'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:00:21 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0f6ad3f-7e59-4955-983c-a8497d388c95 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:00:21 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0f6ad3f-7e59-4955-983c-a8497d388c95 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:00:21 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[5668048f-feba-4547-b90e-45f55fb61d0d]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:00:21 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-e75979df-d58b-47b4-ba3d-5298bf4536f9 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:00:21 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:00:21 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:00:21 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b92b788-1724-4585-ab71-13c7fa7b4a5e]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3 (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:00:21 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-e75979df-d58b-47b4-ba3d-5298bf4536f9 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)
Apr 14 11:00:21 user nova-compute[71509]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219 (non-flash)
Apr 14 11:00:21 user nova-compute[71509]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3 (non-flash)
Apr 14 11:00:21 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 11:00:21 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-e75979df-d58b-47b4-ba3d-5298bf4536f9 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)
Apr 14 11:00:21 user nova-compute[71509]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219 (non-flash)
Apr 14 11:00:21 user nova-compute[71509]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3 (non-flash)
Apr 14 11:00:21 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 11:00:21 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0f6ad3f-7e59-4955-983c-a8497d388c95 -p 172.16.0.220:3260 --login {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:00:21 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0f6ad3f-7e59-4955-983c-a8497d388c95 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:00:21 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fe5d535-528d-4b12-af07-710bd8b8a5b4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d0f6ad3f-7e59-4955-983c-a8497d388c95, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d0f6ad3f-7e59-4955-983c-a8497d388c95, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:00:21 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-e75979df-d58b-47b4-ba3d-5298bf4536f9 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d0f6ad3f-7e59-4955-983c-a8497d388c95, portal: 172.16.0.220,3260]
Apr 14 11:00:21 user nova-compute[71509]: Login to [iface: default, target: iqn.2010-10.org.openstack:d0f6ad3f-7e59-4955-983c-a8497d388c95, portal: 172.16.0.220,3260] successful.
Apr 14 11:00:21 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:00:21 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0f6ad3f-7e59-4955-983c-a8497d388c95 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:00:21 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0f6ad3f-7e59-4955-983c-a8497d388c95 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.032s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:00:21 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aebc870-ffa3-4e5e-98df-f1d7a9f91307]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:00:21 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-e75979df-d58b-47b4-ba3d-5298bf4536f9 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:00:21 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:00:21 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:00:21 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[d69e4452-b96d-485a-a3c1-063cd9ca5fbe]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0f6ad3f-7e59-4955-983c-a8497d388c95 (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:00:21 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-e75979df-d58b-47b4-ba3d-5298bf4536f9 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)
Apr 14 11:00:21 user nova-compute[71509]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219 (non-flash)
Apr 14 11:00:21 user nova-compute[71509]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3 (non-flash)
Apr 14 11:00:21 user nova-compute[71509]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0f6ad3f-7e59-4955-983c-a8497d388c95 (non-flash)
Apr 14 11:00:21 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 11:00:21 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-e75979df-d58b-47b4-ba3d-5298bf4536f9 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)
Apr 14 11:00:21 user nova-compute[71509]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219 (non-flash)
Apr 14 11:00:21 user nova-compute[71509]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3 (non-flash)
Apr 14 11:00:21 user nova-compute[71509]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0f6ad3f-7e59-4955-983c-a8497d388c95 (non-flash)
Apr 14 11:00:21 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 11:00:21 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-e75979df-d58b-47b4-ba3d-5298bf4536f9 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d0f6ad3f-7e59-4955-983c-a8497d388c95" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 11:00:21 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-e75979df-d58b-47b4-ba3d-5298bf4536f9 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Connected to 172.16.0.220:3260 {{(pid=71509) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 11:00:21 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-e75979df-d58b-47b4-ba3d-5298bf4536f9 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] HCTL ('36', '-', '-', 0) found on session 42 with lun 0 {{(pid=71509) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 11:00:21 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-e75979df-d58b-47b4-ba3d-5298bf4536f9 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71509) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 11:00:21 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:00:21 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:00:21 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cb8be97-653f-405a-b228-c91eae01fd83]: (4, ('- - 0', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:00:21 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-e75979df-d58b-47b4-ba3d-5298bf4536f9 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Searching for a device in session 42 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71509) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 11:00:21 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-e75979df-d58b-47b4-ba3d-5298bf4536f9 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:d0f6ad3f-7e59-4955-983c-a8497d388c95', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DquWLGyA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71509) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 11:00:21 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:00:22 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-e75979df-d58b-47b4-ba3d-5298bf4536f9 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.327s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 11:00:22 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-e75979df-d58b-47b4-ba3d-5298bf4536f9 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] <== connect_volume: return (1329ms) {'type': 'block', 'scsi_wwn': '23133336538386566', 'path': '/dev/sde'} {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 11:00:22 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e75979df-d58b-47b4-ba3d-5298bf4536f9 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] [instance: 3d6a53c3-6e32-456c-a056-fbf1bef3b656] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23133336538386566', 'path': '/dev/sde'} {{(pid=71509) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 11:00:22 user nova-compute[71509]: DEBUG nova.objects.instance [None req-e75979df-d58b-47b4-ba3d-5298bf4536f9 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lazy-loading 'flavor' on Instance uuid 3d6a53c3-6e32-456c-a056-fbf1bef3b656 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 11:00:23 user nova-compute[71509]: DEBUG nova.virt.libvirt.guest [None req-e75979df-d58b-47b4-ba3d-5298bf4536f9 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 11:00:23 user nova-compute[71509]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 11:00:23 user nova-compute[71509]:   <source dev="/dev/sde"/>
Apr 14 11:00:23 user nova-compute[71509]:   <target dev="vdb" bus="virtio"/>
Apr 14 11:00:23 user nova-compute[71509]:   <serial>d0f6ad3f-7e59-4955-983c-a8497d388c95</serial>
Apr 14 11:00:23 user nova-compute[71509]: </disk>
Apr 14 11:00:23 user nova-compute[71509]:  {{(pid=71509) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 11:00:23 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:00:23 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-e75979df-d58b-47b4-ba3d-5298bf4536f9 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] No BDM found with device name vda, not building metadata. {{(pid=71509) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 11:00:23 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-e75979df-d58b-47b4-ba3d-5298bf4536f9 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71509) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 11:00:23 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-e75979df-d58b-47b4-ba3d-5298bf4536f9 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] No VIF found with MAC fa:16:3e:ad:2f:9a, not building metadata {{(pid=71509) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 11:00:23 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-e75979df-d58b-47b4-ba3d-5298bf4536f9 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "3d6a53c3-6e32-456c-a056-fbf1bef3b656" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.534s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:00:25 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-66d76dae-b143-4586-88c2-dfc6b7f22874 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Acquiring lock "3d6a53c3-6e32-456c-a056-fbf1bef3b656" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:00:25 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-66d76dae-b143-4586-88c2-dfc6b7f22874 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "3d6a53c3-6e32-456c-a056-fbf1bef3b656" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:00:25 user nova-compute[71509]: INFO nova.compute.manager [None req-66d76dae-b143-4586-88c2-dfc6b7f22874 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] [instance: 3d6a53c3-6e32-456c-a056-fbf1bef3b656] Detaching volume d0f6ad3f-7e59-4955-983c-a8497d388c95
Apr 14 11:00:25 user nova-compute[71509]: INFO nova.virt.block_device [None req-66d76dae-b143-4586-88c2-dfc6b7f22874 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] [instance: 3d6a53c3-6e32-456c-a056-fbf1bef3b656] Attempting to driver detach volume d0f6ad3f-7e59-4955-983c-a8497d388c95 from mountpoint /dev/vdb
Apr 14 11:00:25 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-66d76dae-b143-4586-88c2-dfc6b7f22874 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Attempting to detach device vdb from instance 3d6a53c3-6e32-456c-a056-fbf1bef3b656 from the persistent domain config. {{(pid=71509) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 11:00:25 user nova-compute[71509]: DEBUG nova.virt.libvirt.guest [None req-66d76dae-b143-4586-88c2-dfc6b7f22874 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 11:00:25 user nova-compute[71509]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 11:00:25 user nova-compute[71509]:   <source dev="/dev/sde"/>
Apr 14 11:00:25 user nova-compute[71509]:   <target dev="vdb" bus="virtio"/>
Apr 14 11:00:25 user nova-compute[71509]:   <serial>d0f6ad3f-7e59-4955-983c-a8497d388c95</serial>
Apr 14 11:00:25 user nova-compute[71509]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 11:00:25 user nova-compute[71509]: </disk>
Apr 14 11:00:25 user nova-compute[71509]:  {{(pid=71509) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 11:00:25 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-66d76dae-b143-4586-88c2-dfc6b7f22874 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Successfully detached device vdb from instance 3d6a53c3-6e32-456c-a056-fbf1bef3b656 from the persistent domain config.
Apr 14 11:00:25 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-66d76dae-b143-4586-88c2-dfc6b7f22874 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3d6a53c3-6e32-456c-a056-fbf1bef3b656 from the live domain config. {{(pid=71509) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 11:00:25 user nova-compute[71509]: DEBUG nova.virt.libvirt.guest [None req-66d76dae-b143-4586-88c2-dfc6b7f22874 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 11:00:25 user nova-compute[71509]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 11:00:25 user nova-compute[71509]:   <source dev="/dev/sde"/>
Apr 14 11:00:25 user nova-compute[71509]:   <target dev="vdb" bus="virtio"/>
Apr 14 11:00:25 user nova-compute[71509]:   <serial>d0f6ad3f-7e59-4955-983c-a8497d388c95</serial>
Apr 14 11:00:25 user nova-compute[71509]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 11:00:25 user nova-compute[71509]: </disk>
Apr 14 11:00:25 user nova-compute[71509]:  {{(pid=71509) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 11:00:25 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Received event <DeviceRemovedEvent: 1681470025.8502305, 3d6a53c3-6e32-456c-a056-fbf1bef3b656 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71509) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 11:00:25 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-66d76dae-b143-4586-88c2-dfc6b7f22874 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3d6a53c3-6e32-456c-a056-fbf1bef3b656 {{(pid=71509) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 11:00:25 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-66d76dae-b143-4586-88c2-dfc6b7f22874 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Successfully detached device vdb from instance 3d6a53c3-6e32-456c-a056-fbf1bef3b656 from the live domain config.
Apr 14 11:00:25 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66d76dae-b143-4586-88c2-dfc6b7f22874 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] [instance: 3d6a53c3-6e32-456c-a056-fbf1bef3b656] calling os-brick to detach iSCSI Volume {{(pid=71509) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 11:00:25 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-66d76dae-b143-4586-88c2-dfc6b7f22874 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0bf0749390>, {'target_iqn': 'iqn.2010-10.org.openstack:d0f6ad3f-7e59-4955-983c-a8497d388c95', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DquWLGyA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 11:00:25 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-66d76dae-b143-4586-88c2-dfc6b7f22874 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 11:00:25 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-66d76dae-b143-4586-88c2-dfc6b7f22874 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 11:00:25 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-66d76dae-b143-4586-88c2-dfc6b7f22874 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 11:00:25 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:00:25 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:00:25 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fc174c8-667b-41eb-ab58-0a3ec79a4936]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d0f6ad3f-7e59-4955-983c-a8497d388c95\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:00:25 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-66d76dae-b143-4586-88c2-dfc6b7f22874 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 11:00:25 user nova-compute[71509]: No targets found.
Apr 14 11:00:25 user nova-compute[71509]: iSNS:
Apr 14 11:00:25 user nova-compute[71509]: No targets found.
Apr 14 11:00:25 user nova-compute[71509]: STATIC:
Apr 14 11:00:25 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3
Apr 14 11:00:25 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 11:00:25 user nova-compute[71509]:                 Iface Name: default
Apr 14 11:00:25 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:d0f6ad3f-7e59-4955-983c-a8497d388c95
Apr 14 11:00:25 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 11:00:25 user nova-compute[71509]:                 Iface Name: default
Apr 14 11:00:25 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178
Apr 14 11:00:25 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 11:00:25 user nova-compute[71509]:                 Iface Name: default
Apr 14 11:00:25 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219
Apr 14 11:00:25 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 11:00:25 user nova-compute[71509]:                 Iface Name: default
Apr 14 11:00:25 user nova-compute[71509]: FIRMWARE:
Apr 14 11:00:25 user nova-compute[71509]: No targets found.
Apr 14 11:00:25 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 11:00:25 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-66d76dae-b143-4586-88c2-dfc6b7f22874 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 11:00:25 user nova-compute[71509]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 11:00:25 user nova-compute[71509]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71509) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 11:00:25 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-66d76dae-b143-4586-88c2-dfc6b7f22874 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d0f6ad3f-7e59-4955-983c-a8497d388c95', 0)] {{(pid=71509) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 11:00:25 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:00:25 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:00:25 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8b04c5a-168a-4b83-9d21-76d88ff702ad]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d0f6ad3f-7e59-4955-983c-a8497d388c95\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:00:25 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:00:25 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:00:25 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[b210e2d1-bd05-427e-a9f0-db693fe6dd88]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0f6ad3f-7e59-4955-983c-a8497d388c95 (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:00:25 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-66d76dae-b143-4586-88c2-dfc6b7f22874 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)
Apr 14 11:00:25 user nova-compute[71509]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219 (non-flash)
Apr 14 11:00:25 user nova-compute[71509]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3 (non-flash)
Apr 14 11:00:25 user nova-compute[71509]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0f6ad3f-7e59-4955-983c-a8497d388c95 (non-flash)
Apr 14 11:00:25 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 11:00:25 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-66d76dae-b143-4586-88c2-dfc6b7f22874 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)
Apr 14 11:00:25 user nova-compute[71509]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219 (non-flash)
Apr 14 11:00:25 user nova-compute[71509]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3 (non-flash)
Apr 14 11:00:25 user nova-compute[71509]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0f6ad3f-7e59-4955-983c-a8497d388c95 (non-flash)
Apr 14 11:00:25 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 11:00:25 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-66d76dae-b143-4586-88c2-dfc6b7f22874 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0c3a74f5b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d0f6ad3f-7e59-4955-983c-a8497d388c95'): ({'sde'}, set())}) {{(pid=71509) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 11:00:25 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-66d76dae-b143-4586-88c2-dfc6b7f22874 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Removing single pathed devices sde {{(pid=71509) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 11:00:25 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:00:25 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:00:25 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca2a7d07-2884-4fe2-8264-2b601d7f66c9]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:00:25 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:00:25 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:00:25 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[f28de34b-06d6-45c0-87ae-da2839261ac3]: (4, ('ok\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:00:25 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-66d76dae-b143-4586-88c2-dfc6b7f22874 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Flushing IO for device /dev/sde {{(pid=71509) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 11:00:25 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:00:26 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:00:26 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[93ef2fdd-a60b-4158-afb9-3845e0f7f2c9]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:00:26 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-66d76dae-b143-4586-88c2-dfc6b7f22874 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71509) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 11:00:26 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:00:26 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.039s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:00:26 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2f2ffc9-114c-45ab-8b9d-05a0ca218139]: (4, ('1', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:00:26 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-66d76dae-b143-4586-88c2-dfc6b7f22874 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71509) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 11:00:26 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-66d76dae-b143-4586-88c2-dfc6b7f22874 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] SCSI volumes sde have been removed. {{(pid=71509) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 11:00:26 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-66d76dae-b143-4586-88c2-dfc6b7f22874 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d0f6ad3f-7e59-4955-983c-a8497d388c95')] {{(pid=71509) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 11:00:26 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0f6ad3f-7e59-4955-983c-a8497d388c95 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:00:26 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0f6ad3f-7e59-4955-983c-a8497d388c95 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:00:26 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[84bb4f90-0c6f-47c9-9932-6ee17fb78c24]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:00:26 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-66d76dae-b143-4586-88c2-dfc6b7f22874 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:00:26 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0f6ad3f-7e59-4955-983c-a8497d388c95 -p 172.16.0.220:3260 --logout {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:00:26 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0f6ad3f-7e59-4955-983c-a8497d388c95 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:00:26 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[081e0625-69c3-40e4-b110-70928d7abfb0]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:d0f6ad3f-7e59-4955-983c-a8497d388c95, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:d0f6ad3f-7e59-4955-983c-a8497d388c95, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:00:26 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-66d76dae-b143-4586-88c2-dfc6b7f22874 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:d0f6ad3f-7e59-4955-983c-a8497d388c95, portal: 172.16.0.220,3260]
Apr 14 11:00:26 user nova-compute[71509]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:d0f6ad3f-7e59-4955-983c-a8497d388c95, portal: 172.16.0.220,3260] successful.
Apr 14 11:00:26 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:00:26 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0f6ad3f-7e59-4955-983c-a8497d388c95 -p 172.16.0.220:3260 --op delete {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:00:26 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0f6ad3f-7e59-4955-983c-a8497d388c95 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:00:26 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[6295144c-b040-4919-87ae-5131d4359c57]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:00:26 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-66d76dae-b143-4586-88c2-dfc6b7f22874 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:00:26 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-66d76dae-b143-4586-88c2-dfc6b7f22874 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 11:00:26 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-66d76dae-b143-4586-88c2-dfc6b7f22874 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] <== disconnect_volume: return (310ms) None {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 11:00:26 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66d76dae-b143-4586-88c2-dfc6b7f22874 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] [instance: 3d6a53c3-6e32-456c-a056-fbf1bef3b656] Disconnected iSCSI Volume {{(pid=71509) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 11:00:26 user nova-compute[71509]: DEBUG nova.objects.instance [None req-66d76dae-b143-4586-88c2-dfc6b7f22874 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lazy-loading 'flavor' on Instance uuid 3d6a53c3-6e32-456c-a056-fbf1bef3b656 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 11:00:26 user nova-compute[71509]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681470011.9600499, 0bb99276-64ba-4641-8869-3f35eea2f76e => Stopped> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 11:00:26 user nova-compute[71509]: INFO nova.compute.manager [-] [instance: 0bb99276-64ba-4641-8869-3f35eea2f76e] VM Stopped (Lifecycle Event)
Apr 14 11:00:26 user nova-compute[71509]: DEBUG nova.compute.manager [None req-ad3a2b78-1bf5-4a59-92f5-8e604f974924 None None] [instance: 0bb99276-64ba-4641-8869-3f35eea2f76e] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 11:00:27 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:00:27 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-66d76dae-b143-4586-88c2-dfc6b7f22874 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "3d6a53c3-6e32-456c-a056-fbf1bef3b656" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.896s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:00:28 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:00:31 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:00:33 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:00:34 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:00:35 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:00:36 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:00:38 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:00:40 user nova-compute[71509]: INFO nova.compute.manager [None req-1a1f03d8-33b5-4071-ab6e-868cd98d7dfe tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] Rescuing
Apr 14 11:00:40 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1a1f03d8-33b5-4071-ab6e-868cd98d7dfe tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Acquiring lock "refresh_cache-fbcca78c-fe73-4ef1-92f9-4c8061cad177" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 11:00:40 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1a1f03d8-33b5-4071-ab6e-868cd98d7dfe tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Acquired lock "refresh_cache-fbcca78c-fe73-4ef1-92f9-4c8061cad177" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 11:00:40 user nova-compute[71509]: DEBUG nova.network.neutron [None req-1a1f03d8-33b5-4071-ab6e-868cd98d7dfe tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] Building network info cache for instance {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 11:00:40 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:00:41 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:00:41 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71509) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 11:00:41 user nova-compute[71509]: DEBUG nova.network.neutron [None req-1a1f03d8-33b5-4071-ab6e-868cd98d7dfe tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] Updating instance_info_cache with network_info: [{"id": "845cc40f-1b03-4b85-8d19-fea731fe7f89", "address": "fa:16:3e:45:59:73", "network": {"id": "07f1f39e-292a-4e73-b4ed-99e5799d6fa8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1339551596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71289f80a05141f482cb538dac3d7b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap845cc40f-1b", "ovs_interfaceid": "845cc40f-1b03-4b85-8d19-fea731fe7f89", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:00:41 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1a1f03d8-33b5-4071-ab6e-868cd98d7dfe tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Releasing lock "refresh_cache-fbcca78c-fe73-4ef1-92f9-4c8061cad177" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 11:00:41 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:00:41 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:00:41 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:00:41 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:00:41 user nova-compute[71509]: DEBUG nova.compute.manager [req-baab3a2b-ff91-4bb5-aea4-3030144deb86 req-8d6784b7-155d-44a9-bdbb-8317ed2c9ab9 service nova] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] Received event network-vif-unplugged-845cc40f-1b03-4b85-8d19-fea731fe7f89 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:00:41 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-baab3a2b-ff91-4bb5-aea4-3030144deb86 req-8d6784b7-155d-44a9-bdbb-8317ed2c9ab9 service nova] Acquiring lock "fbcca78c-fe73-4ef1-92f9-4c8061cad177-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:00:41 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-baab3a2b-ff91-4bb5-aea4-3030144deb86 req-8d6784b7-155d-44a9-bdbb-8317ed2c9ab9 service nova] Lock "fbcca78c-fe73-4ef1-92f9-4c8061cad177-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:00:41 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-baab3a2b-ff91-4bb5-aea4-3030144deb86 req-8d6784b7-155d-44a9-bdbb-8317ed2c9ab9 service nova] Lock "fbcca78c-fe73-4ef1-92f9-4c8061cad177-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:00:41 user nova-compute[71509]: DEBUG nova.compute.manager [req-baab3a2b-ff91-4bb5-aea4-3030144deb86 req-8d6784b7-155d-44a9-bdbb-8317ed2c9ab9 service nova] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] No waiting events found dispatching network-vif-unplugged-845cc40f-1b03-4b85-8d19-fea731fe7f89 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:00:41 user nova-compute[71509]: WARNING nova.compute.manager [req-baab3a2b-ff91-4bb5-aea4-3030144deb86 req-8d6784b7-155d-44a9-bdbb-8317ed2c9ab9 service nova] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] Received unexpected event network-vif-unplugged-845cc40f-1b03-4b85-8d19-fea731fe7f89 for instance with vm_state active and task_state rescuing.
Apr 14 11:00:41 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:00:42 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] Instance destroyed successfully.
Apr 14 11:00:42 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-1a1f03d8-33b5-4071-ab6e-868cd98d7dfe tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] Attempting a stable device rescue
Apr 14 11:00:42 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-1a1f03d8-33b5-4071-ab6e-868cd98d7dfe tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=71509) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4289}}
Apr 14 11:00:42 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-1a1f03d8-33b5-4071-ab6e-868cd98d7dfe tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] Instance directory exists: not creating {{(pid=71509) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 14 11:00:42 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-1a1f03d8-33b5-4071-ab6e-868cd98d7dfe tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] Creating image(s)
Apr 14 11:00:42 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1a1f03d8-33b5-4071-ab6e-868cd98d7dfe tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Acquiring lock "/opt/stack/data/nova/instances/fbcca78c-fe73-4ef1-92f9-4c8061cad177/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:00:42 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1a1f03d8-33b5-4071-ab6e-868cd98d7dfe tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "/opt/stack/data/nova/instances/fbcca78c-fe73-4ef1-92f9-4c8061cad177/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:00:42 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1a1f03d8-33b5-4071-ab6e-868cd98d7dfe tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "/opt/stack/data/nova/instances/fbcca78c-fe73-4ef1-92f9-4c8061cad177/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.020s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:00:42 user nova-compute[71509]: DEBUG nova.objects.instance [None req-1a1f03d8-33b5-4071-ab6e-868cd98d7dfe tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lazy-loading 'trusted_certs' on Instance uuid fbcca78c-fe73-4ef1-92f9-4c8061cad177 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 11:00:42 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1a1f03d8-33b5-4071-ab6e-868cd98d7dfe tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Acquiring lock "e27d1f06e91c1a232b224ca41eca5d0e7500b081" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:00:42 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1a1f03d8-33b5-4071-ab6e-868cd98d7dfe tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "e27d1f06e91c1a232b224ca41eca5d0e7500b081" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:00:42 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:00:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1a1f03d8-33b5-4071-ab6e-868cd98d7dfe tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e27d1f06e91c1a232b224ca41eca5d0e7500b081.part --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:00:43 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:00:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1a1f03d8-33b5-4071-ab6e-868cd98d7dfe tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e27d1f06e91c1a232b224ca41eca5d0e7500b081.part --force-share --output=json" returned: 0 in 0.138s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:00:43 user nova-compute[71509]: DEBUG nova.virt.images [None req-1a1f03d8-33b5-4071-ab6e-868cd98d7dfe tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] 3a042e69-a106-4e31-8c3c-f2c334a93b93 was qcow2, converting to raw {{(pid=71509) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 14 11:00:43 user nova-compute[71509]: DEBUG nova.privsep.utils [None req-1a1f03d8-33b5-4071-ab6e-868cd98d7dfe tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71509) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 11:00:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1a1f03d8-33b5-4071-ab6e-868cd98d7dfe tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e27d1f06e91c1a232b224ca41eca5d0e7500b081.part /opt/stack/data/nova/instances/_base/e27d1f06e91c1a232b224ca41eca5d0e7500b081.converted {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:00:43 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:00:43 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:00:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1a1f03d8-33b5-4071-ab6e-868cd98d7dfe tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e27d1f06e91c1a232b224ca41eca5d0e7500b081.part /opt/stack/data/nova/instances/_base/e27d1f06e91c1a232b224ca41eca5d0e7500b081.converted" returned: 0 in 0.420s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:00:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1a1f03d8-33b5-4071-ab6e-868cd98d7dfe tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e27d1f06e91c1a232b224ca41eca5d0e7500b081.converted --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:00:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1a1f03d8-33b5-4071-ab6e-868cd98d7dfe tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e27d1f06e91c1a232b224ca41eca5d0e7500b081.converted --force-share --output=json" returned: 0 in 0.132s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:00:43 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1a1f03d8-33b5-4071-ab6e-868cd98d7dfe tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "e27d1f06e91c1a232b224ca41eca5d0e7500b081" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.534s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:00:43 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1a1f03d8-33b5-4071-ab6e-868cd98d7dfe tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Acquiring lock "e27d1f06e91c1a232b224ca41eca5d0e7500b081" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:00:43 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1a1f03d8-33b5-4071-ab6e-868cd98d7dfe tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "e27d1f06e91c1a232b224ca41eca5d0e7500b081" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:00:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1a1f03d8-33b5-4071-ab6e-868cd98d7dfe tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e27d1f06e91c1a232b224ca41eca5d0e7500b081 --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:00:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1a1f03d8-33b5-4071-ab6e-868cd98d7dfe tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e27d1f06e91c1a232b224ca41eca5d0e7500b081 --force-share --output=json" returned: 0 in 0.131s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:00:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1a1f03d8-33b5-4071-ab6e-868cd98d7dfe tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e27d1f06e91c1a232b224ca41eca5d0e7500b081,backing_fmt=raw /opt/stack/data/nova/instances/fbcca78c-fe73-4ef1-92f9-4c8061cad177/disk.rescue {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:00:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1a1f03d8-33b5-4071-ab6e-868cd98d7dfe tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e27d1f06e91c1a232b224ca41eca5d0e7500b081,backing_fmt=raw /opt/stack/data/nova/instances/fbcca78c-fe73-4ef1-92f9-4c8061cad177/disk.rescue" returned: 0 in 0.169s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:00:44 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1a1f03d8-33b5-4071-ab6e-868cd98d7dfe tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "e27d1f06e91c1a232b224ca41eca5d0e7500b081" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.307s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:00:44 user nova-compute[71509]: DEBUG nova.objects.instance [None req-1a1f03d8-33b5-4071-ab6e-868cd98d7dfe tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lazy-loading 'migration_context' on Instance uuid fbcca78c-fe73-4ef1-92f9-4c8061cad177 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 11:00:44 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-1a1f03d8-33b5-4071-ab6e-868cd98d7dfe tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] Created local disks {{(pid=71509) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 11:00:44 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-1a1f03d8-33b5-4071-ab6e-868cd98d7dfe tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] Start _get_guest_xml network_info=[{"id": "845cc40f-1b03-4b85-8d19-fea731fe7f89", "address": "fa:16:3e:45:59:73", "network": {"id": "07f1f39e-292a-4e73-b4ed-99e5799d6fa8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1339551596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1339551596-network", "vif_mac": "fa:16:3e:45:59:73"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71289f80a05141f482cb538dac3d7b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap845cc40f-1b", "ovs_interfaceid": "845cc40f-1b03-4b85-8d19-fea731fe7f89", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T10:38:55Z,direct_url=<?>,disk_format='qcow2',id=048ec0ee-0465-448d-8b4c-f072acb101dc,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='9742d6ad20cf48d9bab0fdbcc9491db9',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T10:38:57Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '3a042e69-a106-4e31-8c3c-f2c334a93b93', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'attachment_id': 'deefa7ce-3b9b-4649-873b-96abadaf35b8', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xoNByDPq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'fbcca78c-fe73-4ef1-92f9-4c8061cad177', 'attached_at': '', 'detached_at': '', 'volume_id': '5accb380-f5d8-4a81-b266-df7390893219', 'serial': '5accb380-f5d8-4a81-b266-df7390893219'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'volume_type': None} {{(pid=71509) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 11:00:44 user nova-compute[71509]: DEBUG nova.objects.instance [None req-1a1f03d8-33b5-4071-ab6e-868cd98d7dfe tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lazy-loading 'resources' on Instance uuid fbcca78c-fe73-4ef1-92f9-4c8061cad177 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 11:00:44 user nova-compute[71509]: DEBUG nova.objects.instance [None req-1a1f03d8-33b5-4071-ab6e-868cd98d7dfe tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lazy-loading 'numa_topology' on Instance uuid fbcca78c-fe73-4ef1-92f9-4c8061cad177 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 11:00:44 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-1a1f03d8-33b5-4071-ab6e-868cd98d7dfe tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 11:00:44 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-1a1f03d8-33b5-4071-ab6e-868cd98d7dfe tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 11:00:44 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-1a1f03d8-33b5-4071-ab6e-868cd98d7dfe tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71509) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 11:00:44 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-1a1f03d8-33b5-4071-ab6e-868cd98d7dfe tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T10:40:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T10:38:55Z,direct_url=<?>,disk_format='qcow2',id=048ec0ee-0465-448d-8b4c-f072acb101dc,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='9742d6ad20cf48d9bab0fdbcc9491db9',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T10:38:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 11:00:44 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-1a1f03d8-33b5-4071-ab6e-868cd98d7dfe tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Flavor limits 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 11:00:44 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-1a1f03d8-33b5-4071-ab6e-868cd98d7dfe tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Image limits 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 11:00:44 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-1a1f03d8-33b5-4071-ab6e-868cd98d7dfe tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Flavor pref 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 11:00:44 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-1a1f03d8-33b5-4071-ab6e-868cd98d7dfe tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Image pref 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 11:00:44 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-1a1f03d8-33b5-4071-ab6e-868cd98d7dfe tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 11:00:44 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-1a1f03d8-33b5-4071-ab6e-868cd98d7dfe tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 11:00:44 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-1a1f03d8-33b5-4071-ab6e-868cd98d7dfe tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71509) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 11:00:44 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-1a1f03d8-33b5-4071-ab6e-868cd98d7dfe tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Got 1 possible topologies {{(pid=71509) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 11:00:44 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-1a1f03d8-33b5-4071-ab6e-868cd98d7dfe tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 11:00:44 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-1a1f03d8-33b5-4071-ab6e-868cd98d7dfe tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 11:00:44 user nova-compute[71509]: DEBUG nova.objects.instance [None req-1a1f03d8-33b5-4071-ab6e-868cd98d7dfe tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lazy-loading 'vcpu_model' on Instance uuid fbcca78c-fe73-4ef1-92f9-4c8061cad177 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 11:00:44 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a1f03d8-33b5-4071-ab6e-868cd98d7dfe tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] Calling os-brick to attach iSCSI Volume {{(pid=71509) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 11:00:44 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a1f03d8-33b5-4071-ab6e-868cd98d7dfe tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0bf0749390>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xoNByDPq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 11:00:44 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-1a1f03d8-33b5-4071-ab6e-868cd98d7dfe tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 11:00:44 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-1a1f03d8-33b5-4071-ab6e-868cd98d7dfe tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 11:00:44 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-1a1f03d8-33b5-4071-ab6e-868cd98d7dfe tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 11:00:44 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-1a1f03d8-33b5-4071-ab6e-868cd98d7dfe tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 11:00:44 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-1a1f03d8-33b5-4071-ab6e-868cd98d7dfe tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 11:00:44 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-1a1f03d8-33b5-4071-ab6e-868cd98d7dfe tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 11:00:44 user nova-compute[71509]: INFO os_brick.initiator.connectors.iscsi [None req-1a1f03d8-33b5-4071-ab6e-868cd98d7dfe tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 11:00:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219 -p 172.16.0.220:3260 {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:00:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219 -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:00:44 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ab6f24a-f05c-4996-99cf-bfb6350cf36a]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = xoNByDPq\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:00:44 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a1f03d8-33b5-4071-ab6e-868cd98d7dfe tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Apr 14 11:00:44 user nova-compute[71509]: node.name = iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219
Apr 14 11:00:44 user nova-compute[71509]: node.tpgt = -1
Apr 14 11:00:44 user nova-compute[71509]: node.startup = automatic
Apr 14 11:00:44 user nova-compute[71509]: node.leading_login = No
Apr 14 11:00:44 user nova-compute[71509]: iface.iscsi_ifacename = default
Apr 14 11:00:44 user nova-compute[71509]: iface.net_ifacename = <empty>
Apr 14 11:00:44 user nova-compute[71509]: iface.ipaddress = <empty>
Apr 14 11:00:44 user nova-compute[71509]: iface.prefix_len = 0
Apr 14 11:00:44 user nova-compute[71509]: iface.hwaddress = <empty>
Apr 14 11:00:44 user nova-compute[71509]: iface.transport_name = tcp
Apr 14 11:00:44 user nova-compute[71509]: iface.initiatorname = <empty>
Apr 14 11:00:44 user nova-compute[71509]: iface.state = <empty>
Apr 14 11:00:44 user nova-compute[71509]: iface.vlan_id = 0
Apr 14 11:00:44 user nova-compute[71509]: iface.vlan_priority = 0
Apr 14 11:00:44 user nova-compute[71509]: iface.vlan_state = <empty>
Apr 14 11:00:44 user nova-compute[71509]: iface.iface_num = 0
Apr 14 11:00:44 user nova-compute[71509]: iface.mtu = 0
Apr 14 11:00:44 user nova-compute[71509]: iface.port = 0
Apr 14 11:00:44 user nova-compute[71509]: iface.bootproto = <empty>
Apr 14 11:00:44 user nova-compute[71509]: iface.subnet_mask = <empty>
Apr 14 11:00:44 user nova-compute[71509]: iface.gateway = <empty>
Apr 14 11:00:44 user nova-compute[71509]: iface.dhcp_alt_client_id_state = <empty>
Apr 14 11:00:44 user nova-compute[71509]: iface.dhcp_alt_client_id = <empty>
Apr 14 11:00:44 user nova-compute[71509]: iface.dhcp_dns = <empty>
Apr 14 11:00:44 user nova-compute[71509]: iface.dhcp_learn_iqn = <empty>
Apr 14 11:00:44 user nova-compute[71509]: iface.dhcp_req_vendor_id_state = <empty>
Apr 14 11:00:44 user nova-compute[71509]: iface.dhcp_vendor_id_state = <empty>
Apr 14 11:00:44 user nova-compute[71509]: iface.dhcp_vendor_id = <empty>
Apr 14 11:00:44 user nova-compute[71509]: iface.dhcp_slp_da = <empty>
Apr 14 11:00:44 user nova-compute[71509]: iface.fragmentation = <empty>
Apr 14 11:00:44 user nova-compute[71509]: iface.gratuitous_arp = <empty>
Apr 14 11:00:44 user nova-compute[71509]: iface.incoming_forwarding = <empty>
Apr 14 11:00:44 user nova-compute[71509]: iface.tos_state = <empty>
Apr 14 11:00:44 user nova-compute[71509]: iface.tos = 0
Apr 14 11:00:44 user nova-compute[71509]: iface.ttl = 0
Apr 14 11:00:44 user nova-compute[71509]: iface.delayed_ack = <empty>
Apr 14 11:00:44 user nova-compute[71509]: iface.tcp_nagle = <empty>
Apr 14 11:00:44 user nova-compute[71509]: iface.tcp_wsf_state = <empty>
Apr 14 11:00:44 user nova-compute[71509]: iface.tcp_wsf = 0
Apr 14 11:00:44 user nova-compute[71509]: iface.tcp_timer_scale = 0
Apr 14 11:00:44 user nova-compute[71509]: iface.tcp_timestamp = <empty>
Apr 14 11:00:44 user nova-compute[71509]: iface.redirect = <empty>
Apr 14 11:00:44 user nova-compute[71509]: iface.def_task_mgmt_timeout = 0
Apr 14 11:00:44 user nova-compute[71509]: iface.header_digest = <empty>
Apr 14 11:00:44 user nova-compute[71509]: iface.data_digest = <empty>
Apr 14 11:00:44 user nova-compute[71509]: iface.immediate_data = <empty>
Apr 14 11:00:44 user nova-compute[71509]: iface.initial_r2t = <empty>
Apr 14 11:00:44 user nova-compute[71509]: iface.data_seq_inorder = <empty>
Apr 14 11:00:44 user nova-compute[71509]: iface.data_pdu_inorder = <empty>
Apr 14 11:00:44 user nova-compute[71509]: iface.erl = 0
Apr 14 11:00:44 user nova-compute[71509]: iface.max_receive_data_len = 0
Apr 14 11:00:44 user nova-compute[71509]: iface.first_burst_len = 0
Apr 14 11:00:44 user nova-compute[71509]: iface.max_outstanding_r2t = 0
Apr 14 11:00:44 user nova-compute[71509]: iface.max_burst_len = 0
Apr 14 11:00:44 user nova-compute[71509]: iface.chap_auth = <empty>
Apr 14 11:00:44 user nova-compute[71509]: iface.bidi_chap = <empty>
Apr 14 11:00:44 user nova-compute[71509]: iface.strict_login_compliance = <empty>
Apr 14 11:00:44 user nova-compute[71509]: iface.discovery_auth = <empty>
Apr 14 11:00:44 user nova-compute[71509]: iface.discovery_logout = <empty>
Apr 14 11:00:44 user nova-compute[71509]: node.discovery_address = <empty>
Apr 14 11:00:44 user nova-compute[71509]: node.discovery_port = 0
Apr 14 11:00:44 user nova-compute[71509]: node.discovery_type = static
Apr 14 11:00:44 user nova-compute[71509]: node.session.initial_cmdsn = 0
Apr 14 11:00:44 user nova-compute[71509]: node.session.initial_login_retry_max = 8
Apr 14 11:00:44 user nova-compute[71509]: node.session.xmit_thread_priority = -20
Apr 14 11:00:44 user nova-compute[71509]: node.session.cmds_max = 128
Apr 14 11:00:44 user nova-compute[71509]: node.session.queue_depth = 32
Apr 14 11:00:44 user nova-compute[71509]: node.session.nr_sessions = 1
Apr 14 11:00:44 user nova-compute[71509]: node.session.auth.authmethod = CHAP
Apr 14 11:00:44 user nova-compute[71509]: node.session.auth.username = xoNByDPq
Apr 14 11:00:44 user nova-compute[71509]: node.session.auth.password = ***
Apr 14 11:00:44 user nova-compute[71509]: node.session.auth.username_in = <empty>
Apr 14 11:00:44 user nova-compute[71509]: node.session.auth.password_in = <empty>
Apr 14 11:00:44 user nova-compute[71509]: node.session.auth.chap_algs = MD5
Apr 14 11:00:44 user nova-compute[71509]: node.session.timeo.replacement_timeout = 120
Apr 14 11:00:44 user nova-compute[71509]: node.session.err_timeo.abort_timeout = 15
Apr 14 11:00:44 user nova-compute[71509]: node.session.err_timeo.lu_reset_timeout = 30
Apr 14 11:00:44 user nova-compute[71509]: node.session.err_timeo.tgt_reset_timeout = 30
Apr 14 11:00:44 user nova-compute[71509]: node.session.err_timeo.host_reset_timeout = 60
Apr 14 11:00:44 user nova-compute[71509]: node.session.iscsi.FastAbort = Yes
Apr 14 11:00:44 user nova-compute[71509]: node.session.iscsi.InitialR2T = No
Apr 14 11:00:44 user nova-compute[71509]: node.session.iscsi.ImmediateData = Yes
Apr 14 11:00:44 user nova-compute[71509]: node.session.iscsi.FirstBurstLength = 262144
Apr 14 11:00:44 user nova-compute[71509]: node.session.iscsi.MaxBurstLength = 16776192
Apr 14 11:00:44 user nova-compute[71509]: node.session.iscsi.DefaultTime2Retain = 0
Apr 14 11:00:44 user nova-compute[71509]: node.session.iscsi.DefaultTime2Wait = 2
Apr 14 11:00:44 user nova-compute[71509]: node.session.iscsi.MaxConnections = 1
Apr 14 11:00:44 user nova-compute[71509]: node.session.iscsi.MaxOutstandingR2T = 1
Apr 14 11:00:44 user nova-compute[71509]: node.session.iscsi.ERL = 0
Apr 14 11:00:44 user nova-compute[71509]: node.session.scan = manual
Apr 14 11:00:44 user nova-compute[71509]: node.session.reopen_max = 0
Apr 14 11:00:44 user nova-compute[71509]: node.conn[0].address = 172.16.0.220
Apr 14 11:00:44 user nova-compute[71509]: node.conn[0].port = 3260
Apr 14 11:00:44 user nova-compute[71509]: node.conn[0].startup = manual
Apr 14 11:00:44 user nova-compute[71509]: node.conn[0].tcp.window_size = 524288
Apr 14 11:00:44 user nova-compute[71509]: node.conn[0].tcp.type_of_service = 0
Apr 14 11:00:44 user nova-compute[71509]: node.conn[0].timeo.logout_timeout = 15
Apr 14 11:00:44 user nova-compute[71509]: node.conn[0].timeo.login_timeout = 15
Apr 14 11:00:44 user nova-compute[71509]: node.conn[0].timeo.auth_timeout = 45
Apr 14 11:00:44 user nova-compute[71509]: node.conn[0].timeo.noop_out_interval = 5
Apr 14 11:00:44 user nova-compute[71509]: node.conn[0].timeo.noop_out_timeout = 5
Apr 14 11:00:44 user nova-compute[71509]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Apr 14 11:00:44 user nova-compute[71509]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Apr 14 11:00:44 user nova-compute[71509]: node.conn[0].iscsi.HeaderDigest = None
Apr 14 11:00:44 user nova-compute[71509]: node.conn[0].iscsi.DataDigest = None
Apr 14 11:00:44 user nova-compute[71509]: node.conn[0].iscsi.IFMarker = No
Apr 14 11:00:44 user nova-compute[71509]: node.conn[0].iscsi.OFMarker = No
Apr 14 11:00:44 user nova-compute[71509]: # END RECORD
Apr 14 11:00:44 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:00:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:00:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:00:44 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[51492aec-748c-4cef-8f22-7014a0095c72]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:00:44 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a1f03d8-33b5-4071-ab6e-868cd98d7dfe tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:00:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:00:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:00:44 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f2cb5f9-b65b-4f87-a885-bb9ad52a5e4c]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:00:44 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a1f03d8-33b5-4071-ab6e-868cd98d7dfe tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:00:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xoNByDPq {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:00:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xoNByDPq" returned: 0 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:00:44 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[9132078a-ac98-4825-8e28-c28ecc5afcf1]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:00:44 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a1f03d8-33b5-4071-ab6e-868cd98d7dfe tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xoNByDPq'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:00:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:00:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:00:44 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[0280b946-7d8d-4d6f-a0c8-42c5235a903a]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:00:44 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a1f03d8-33b5-4071-ab6e-868cd98d7dfe tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:00:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:00:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:00:44 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[3807dbf0-594b-494e-9f40-d8a001a147f1]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3 (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:00:44 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a1f03d8-33b5-4071-ab6e-868cd98d7dfe tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)
Apr 14 11:00:44 user nova-compute[71509]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219 (non-flash)
Apr 14 11:00:44 user nova-compute[71509]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3 (non-flash)
Apr 14 11:00:44 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 11:00:44 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a1f03d8-33b5-4071-ab6e-868cd98d7dfe tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)
Apr 14 11:00:44 user nova-compute[71509]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219 (non-flash)
Apr 14 11:00:44 user nova-compute[71509]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3 (non-flash)
Apr 14 11:00:44 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 11:00:44 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-1a1f03d8-33b5-4071-ab6e-868cd98d7dfe tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.152s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 11:00:44 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a1f03d8-33b5-4071-ab6e-868cd98d7dfe tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Connected to 172.16.0.220:3260 {{(pid=71509) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 11:00:44 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-1a1f03d8-33b5-4071-ab6e-868cd98d7dfe tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] HCTL ('33', '0', '0', 0) found on session 37 with lun 0 {{(pid=71509) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 11:00:44 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-1a1f03d8-33b5-4071-ab6e-868cd98d7dfe tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=71509) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 11:00:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:00:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.014s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:00:44 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb5c3bbe-15e1-4134-a7f6-2b423dc59b6c]: (4, ('0 0 0', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:00:44 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-1a1f03d8-33b5-4071-ab6e-868cd98d7dfe tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Searching for a device in session 37 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=71509) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 11:00:44 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a1f03d8-33b5-4071-ab6e-868cd98d7dfe tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xoNByDPq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71509) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 11:00:44 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-1a1f03d8-33b5-4071-ab6e-868cd98d7dfe tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.178s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 11:00:44 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a1f03d8-33b5-4071-ab6e-868cd98d7dfe tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] <== connect_volume: return (179ms) {'type': 'block', 'scsi_wwn': '26338356463316566', 'path': '/dev/sdb'} {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 11:00:44 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a1f03d8-33b5-4071-ab6e-868cd98d7dfe tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26338356463316566', 'path': '/dev/sdb'} {{(pid=71509) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 11:00:44 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-1a1f03d8-33b5-4071-ab6e-868cd98d7dfe tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T10:58:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1915851503',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1915851503',id=34,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T10:59:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='71289f80a05141f482cb538dac3d7b38',ramdisk_id='',reservation_id='r-n81abyyd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2130542140',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T10:59:06Z,user_data=None,user_id='395bc9d7007c4e01ac7effd418bcea19',uuid=fbcca78c-fe73-4ef1-92f9-4c8061cad177,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "845cc40f-1b03-4b85-8d19-fea731fe7f89", "address": "fa:16:3e:45:59:73", "network": {"id": "07f1f39e-292a-4e73-b4ed-99e5799d6fa8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1339551596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1339551596-network", "vif_mac": "fa:16:3e:45:59:73"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71289f80a05141f482cb538dac3d7b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap845cc40f-1b", "ovs_interfaceid": "845cc40f-1b03-4b85-8d19-fea731fe7f89", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71509) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 11:00:44 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-1a1f03d8-33b5-4071-ab6e-868cd98d7dfe tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Converting VIF {"id": "845cc40f-1b03-4b85-8d19-fea731fe7f89", "address": "fa:16:3e:45:59:73", "network": {"id": "07f1f39e-292a-4e73-b4ed-99e5799d6fa8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1339551596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1339551596-network", "vif_mac": "fa:16:3e:45:59:73"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71289f80a05141f482cb538dac3d7b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap845cc40f-1b", "ovs_interfaceid": "845cc40f-1b03-4b85-8d19-fea731fe7f89", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 11:00:44 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-1a1f03d8-33b5-4071-ab6e-868cd98d7dfe tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:45:59:73,bridge_name='br-int',has_traffic_filtering=True,id=845cc40f-1b03-4b85-8d19-fea731fe7f89,network=Network(07f1f39e-292a-4e73-b4ed-99e5799d6fa8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap845cc40f-1b') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 11:00:44 user nova-compute[71509]: DEBUG nova.objects.instance [None req-1a1f03d8-33b5-4071-ab6e-868cd98d7dfe tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lazy-loading 'pci_devices' on Instance uuid fbcca78c-fe73-4ef1-92f9-4c8061cad177 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 11:00:44 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-1a1f03d8-33b5-4071-ab6e-868cd98d7dfe tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] End _get_guest_xml xml=<domain type="kvm">
Apr 14 11:00:44 user nova-compute[71509]:   <uuid>fbcca78c-fe73-4ef1-92f9-4c8061cad177</uuid>
Apr 14 11:00:44 user nova-compute[71509]:   <name>instance-00000022</name>
Apr 14 11:00:44 user nova-compute[71509]:   <memory>131072</memory>
Apr 14 11:00:44 user nova-compute[71509]:   <vcpu>1</vcpu>
Apr 14 11:00:44 user nova-compute[71509]:   <metadata>
Apr 14 11:00:44 user nova-compute[71509]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 11:00:44 user nova-compute[71509]:       <nova:package version="0.0.0"/>
Apr 14 11:00:44 user nova-compute[71509]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1915851503</nova:name>
Apr 14 11:00:44 user nova-compute[71509]:       <nova:creationTime>2023-04-14 11:00:44</nova:creationTime>
Apr 14 11:00:44 user nova-compute[71509]:       <nova:flavor name="m1.nano">
Apr 14 11:00:44 user nova-compute[71509]:         <nova:memory>128</nova:memory>
Apr 14 11:00:44 user nova-compute[71509]:         <nova:disk>1</nova:disk>
Apr 14 11:00:44 user nova-compute[71509]:         <nova:swap>0</nova:swap>
Apr 14 11:00:44 user nova-compute[71509]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 11:00:44 user nova-compute[71509]:         <nova:vcpus>1</nova:vcpus>
Apr 14 11:00:44 user nova-compute[71509]:       </nova:flavor>
Apr 14 11:00:44 user nova-compute[71509]:       <nova:owner>
Apr 14 11:00:44 user nova-compute[71509]:         <nova:user uuid="395bc9d7007c4e01ac7effd418bcea19">tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member</nova:user>
Apr 14 11:00:44 user nova-compute[71509]:         <nova:project uuid="71289f80a05141f482cb538dac3d7b38">tempest-ServerBootFromVolumeStableRescueTest-2130542140</nova:project>
Apr 14 11:00:44 user nova-compute[71509]:       </nova:owner>
Apr 14 11:00:44 user nova-compute[71509]:       <nova:root type="image" uuid="048ec0ee-0465-448d-8b4c-f072acb101dc"/>
Apr 14 11:00:44 user nova-compute[71509]:       <nova:ports>
Apr 14 11:00:44 user nova-compute[71509]:         <nova:port uuid="845cc40f-1b03-4b85-8d19-fea731fe7f89">
Apr 14 11:00:44 user nova-compute[71509]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Apr 14 11:00:44 user nova-compute[71509]:         </nova:port>
Apr 14 11:00:44 user nova-compute[71509]:       </nova:ports>
Apr 14 11:00:44 user nova-compute[71509]:     </nova:instance>
Apr 14 11:00:44 user nova-compute[71509]:   </metadata>
Apr 14 11:00:44 user nova-compute[71509]:   <sysinfo type="smbios">
Apr 14 11:00:44 user nova-compute[71509]:     <system>
Apr 14 11:00:44 user nova-compute[71509]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 11:00:44 user nova-compute[71509]:       <entry name="product">OpenStack Nova</entry>
Apr 14 11:00:44 user nova-compute[71509]:       <entry name="version">0.0.0</entry>
Apr 14 11:00:44 user nova-compute[71509]:       <entry name="serial">fbcca78c-fe73-4ef1-92f9-4c8061cad177</entry>
Apr 14 11:00:44 user nova-compute[71509]:       <entry name="uuid">fbcca78c-fe73-4ef1-92f9-4c8061cad177</entry>
Apr 14 11:00:44 user nova-compute[71509]:       <entry name="family">Virtual Machine</entry>
Apr 14 11:00:44 user nova-compute[71509]:     </system>
Apr 14 11:00:44 user nova-compute[71509]:   </sysinfo>
Apr 14 11:00:44 user nova-compute[71509]:   <os>
Apr 14 11:00:44 user nova-compute[71509]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 11:00:44 user nova-compute[71509]:     <smbios mode="sysinfo"/>
Apr 14 11:00:44 user nova-compute[71509]:   </os>
Apr 14 11:00:44 user nova-compute[71509]:   <features>
Apr 14 11:00:44 user nova-compute[71509]:     <acpi/>
Apr 14 11:00:44 user nova-compute[71509]:     <apic/>
Apr 14 11:00:44 user nova-compute[71509]:     <vmcoreinfo/>
Apr 14 11:00:44 user nova-compute[71509]:   </features>
Apr 14 11:00:44 user nova-compute[71509]:   <clock offset="utc">
Apr 14 11:00:44 user nova-compute[71509]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 11:00:44 user nova-compute[71509]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 11:00:44 user nova-compute[71509]:     <timer name="hpet" present="no"/>
Apr 14 11:00:44 user nova-compute[71509]:   </clock>
Apr 14 11:00:44 user nova-compute[71509]:   <cpu mode="custom" match="exact">
Apr 14 11:00:44 user nova-compute[71509]:     <model>Nehalem</model>
Apr 14 11:00:44 user nova-compute[71509]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 11:00:44 user nova-compute[71509]:   </cpu>
Apr 14 11:00:44 user nova-compute[71509]:   <devices>
Apr 14 11:00:44 user nova-compute[71509]:     <disk type="block" device="disk">
Apr 14 11:00:44 user nova-compute[71509]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 11:00:44 user nova-compute[71509]:       <source dev="/dev/sdb"/>
Apr 14 11:00:44 user nova-compute[71509]:       <target dev="vda" bus="virtio"/>
Apr 14 11:00:44 user nova-compute[71509]:       <serial>5accb380-f5d8-4a81-b266-df7390893219</serial>
Apr 14 11:00:44 user nova-compute[71509]:     </disk>
Apr 14 11:00:44 user nova-compute[71509]:     <disk type="file" device="disk">
Apr 14 11:00:44 user nova-compute[71509]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 11:00:44 user nova-compute[71509]:       <source file="/opt/stack/data/nova/instances/fbcca78c-fe73-4ef1-92f9-4c8061cad177/disk.rescue"/>
Apr 14 11:00:44 user nova-compute[71509]:       <target dev="vdb" bus="virtio"/>
Apr 14 11:00:44 user nova-compute[71509]:       <boot order="1"/>
Apr 14 11:00:44 user nova-compute[71509]:     </disk>
Apr 14 11:00:44 user nova-compute[71509]:     <interface type="ethernet">
Apr 14 11:00:44 user nova-compute[71509]:       <mac address="fa:16:3e:45:59:73"/>
Apr 14 11:00:44 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 11:00:44 user nova-compute[71509]:       <mtu size="1442"/>
Apr 14 11:00:44 user nova-compute[71509]:       <target dev="tap845cc40f-1b"/>
Apr 14 11:00:44 user nova-compute[71509]:     </interface>
Apr 14 11:00:44 user nova-compute[71509]:     <serial type="pty">
Apr 14 11:00:44 user nova-compute[71509]:       <log file="/opt/stack/data/nova/instances/fbcca78c-fe73-4ef1-92f9-4c8061cad177/console.log" append="off"/>
Apr 14 11:00:44 user nova-compute[71509]:     </serial>
Apr 14 11:00:44 user nova-compute[71509]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 11:00:44 user nova-compute[71509]:     <video>
Apr 14 11:00:44 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 11:00:44 user nova-compute[71509]:     </video>
Apr 14 11:00:44 user nova-compute[71509]:     <rng model="virtio">
Apr 14 11:00:44 user nova-compute[71509]:       <backend model="random">/dev/urandom</backend>
Apr 14 11:00:44 user nova-compute[71509]:     </rng>
Apr 14 11:00:44 user nova-compute[71509]:     <controller type="usb" index="0" model="none"/>
Apr 14 11:00:44 user nova-compute[71509]:     <memballoon model="virtio">
Apr 14 11:00:44 user nova-compute[71509]:       <stats period="10"/>
Apr 14 11:00:44 user nova-compute[71509]:     </memballoon>
Apr 14 11:00:44 user nova-compute[71509]:   </devices>
Apr 14 11:00:44 user nova-compute[71509]: </domain>
Apr 14 11:00:44 user nova-compute[71509]:  {{(pid=71509) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 11:00:44 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] Instance destroyed successfully.
Apr 14 11:00:44 user nova-compute[71509]: DEBUG nova.compute.manager [req-2d1fc168-ae88-467e-94a7-417520ab1aad req-53416add-9c18-4594-bddc-7b2b10b6b922 service nova] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] Received event network-vif-plugged-845cc40f-1b03-4b85-8d19-fea731fe7f89 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:00:44 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-2d1fc168-ae88-467e-94a7-417520ab1aad req-53416add-9c18-4594-bddc-7b2b10b6b922 service nova] Acquiring lock "fbcca78c-fe73-4ef1-92f9-4c8061cad177-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:00:44 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-2d1fc168-ae88-467e-94a7-417520ab1aad req-53416add-9c18-4594-bddc-7b2b10b6b922 service nova] Lock "fbcca78c-fe73-4ef1-92f9-4c8061cad177-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:00:44 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-2d1fc168-ae88-467e-94a7-417520ab1aad req-53416add-9c18-4594-bddc-7b2b10b6b922 service nova] Lock "fbcca78c-fe73-4ef1-92f9-4c8061cad177-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:00:44 user nova-compute[71509]: DEBUG nova.compute.manager [req-2d1fc168-ae88-467e-94a7-417520ab1aad req-53416add-9c18-4594-bddc-7b2b10b6b922 service nova] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] No waiting events found dispatching network-vif-plugged-845cc40f-1b03-4b85-8d19-fea731fe7f89 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:00:44 user nova-compute[71509]: WARNING nova.compute.manager [req-2d1fc168-ae88-467e-94a7-417520ab1aad req-53416add-9c18-4594-bddc-7b2b10b6b922 service nova] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] Received unexpected event network-vif-plugged-845cc40f-1b03-4b85-8d19-fea731fe7f89 for instance with vm_state active and task_state rescuing.
Apr 14 11:00:44 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-1a1f03d8-33b5-4071-ab6e-868cd98d7dfe tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] No BDM found with device name vda, not building metadata. {{(pid=71509) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 11:00:44 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-1a1f03d8-33b5-4071-ab6e-868cd98d7dfe tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71509) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 11:00:44 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-1a1f03d8-33b5-4071-ab6e-868cd98d7dfe tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] No VIF found with MAC fa:16:3e:45:59:73, not building metadata {{(pid=71509) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 11:00:45 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:00:46 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:00:46 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:00:46 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:00:46 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:00:46 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:00:46 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:00:46 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:00:46 user nova-compute[71509]: DEBUG nova.compute.manager [req-abc091d9-c2c8-4eb8-b13a-a59869ef13d2 req-37e9f799-743f-4258-8156-570d40bf74e2 service nova] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] Received event network-vif-plugged-845cc40f-1b03-4b85-8d19-fea731fe7f89 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:00:46 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-abc091d9-c2c8-4eb8-b13a-a59869ef13d2 req-37e9f799-743f-4258-8156-570d40bf74e2 service nova] Acquiring lock "fbcca78c-fe73-4ef1-92f9-4c8061cad177-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:00:46 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-abc091d9-c2c8-4eb8-b13a-a59869ef13d2 req-37e9f799-743f-4258-8156-570d40bf74e2 service nova] Lock "fbcca78c-fe73-4ef1-92f9-4c8061cad177-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:00:46 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-abc091d9-c2c8-4eb8-b13a-a59869ef13d2 req-37e9f799-743f-4258-8156-570d40bf74e2 service nova] Lock "fbcca78c-fe73-4ef1-92f9-4c8061cad177-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:00:46 user nova-compute[71509]: DEBUG nova.compute.manager [req-abc091d9-c2c8-4eb8-b13a-a59869ef13d2 req-37e9f799-743f-4258-8156-570d40bf74e2 service nova] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] No waiting events found dispatching network-vif-plugged-845cc40f-1b03-4b85-8d19-fea731fe7f89 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:00:46 user nova-compute[71509]: WARNING nova.compute.manager [req-abc091d9-c2c8-4eb8-b13a-a59869ef13d2 req-37e9f799-743f-4258-8156-570d40bf74e2 service nova] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] Received unexpected event network-vif-plugged-845cc40f-1b03-4b85-8d19-fea731fe7f89 for instance with vm_state active and task_state rescuing.
Apr 14 11:00:46 user nova-compute[71509]: DEBUG nova.compute.manager [req-abc091d9-c2c8-4eb8-b13a-a59869ef13d2 req-37e9f799-743f-4258-8156-570d40bf74e2 service nova] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] Received event network-vif-plugged-845cc40f-1b03-4b85-8d19-fea731fe7f89 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:00:46 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-abc091d9-c2c8-4eb8-b13a-a59869ef13d2 req-37e9f799-743f-4258-8156-570d40bf74e2 service nova] Acquiring lock "fbcca78c-fe73-4ef1-92f9-4c8061cad177-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:00:46 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-abc091d9-c2c8-4eb8-b13a-a59869ef13d2 req-37e9f799-743f-4258-8156-570d40bf74e2 service nova] Lock "fbcca78c-fe73-4ef1-92f9-4c8061cad177-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:00:46 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-abc091d9-c2c8-4eb8-b13a-a59869ef13d2 req-37e9f799-743f-4258-8156-570d40bf74e2 service nova] Lock "fbcca78c-fe73-4ef1-92f9-4c8061cad177-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:00:46 user nova-compute[71509]: DEBUG nova.compute.manager [req-abc091d9-c2c8-4eb8-b13a-a59869ef13d2 req-37e9f799-743f-4258-8156-570d40bf74e2 service nova] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] No waiting events found dispatching network-vif-plugged-845cc40f-1b03-4b85-8d19-fea731fe7f89 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:00:46 user nova-compute[71509]: WARNING nova.compute.manager [req-abc091d9-c2c8-4eb8-b13a-a59869ef13d2 req-37e9f799-743f-4258-8156-570d40bf74e2 service nova] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] Received unexpected event network-vif-plugged-845cc40f-1b03-4b85-8d19-fea731fe7f89 for instance with vm_state active and task_state rescuing.
Apr 14 11:00:46 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-3805e8dc-ea36-4f46-8038-6181ca425b14 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "ef413492-c781-459e-b99c-46a530034c94" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:00:46 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-3805e8dc-ea36-4f46-8038-6181ca425b14 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "ef413492-c781-459e-b99c-46a530034c94" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:00:46 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-3805e8dc-ea36-4f46-8038-6181ca425b14 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "ef413492-c781-459e-b99c-46a530034c94-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:00:46 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-3805e8dc-ea36-4f46-8038-6181ca425b14 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "ef413492-c781-459e-b99c-46a530034c94-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:00:46 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-3805e8dc-ea36-4f46-8038-6181ca425b14 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "ef413492-c781-459e-b99c-46a530034c94-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:00:46 user nova-compute[71509]: INFO nova.compute.manager [None req-3805e8dc-ea36-4f46-8038-6181ca425b14 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: ef413492-c781-459e-b99c-46a530034c94] Terminating instance
Apr 14 11:00:46 user nova-compute[71509]: DEBUG nova.compute.manager [None req-3805e8dc-ea36-4f46-8038-6181ca425b14 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: ef413492-c781-459e-b99c-46a530034c94] Start destroying the instance on the hypervisor. {{(pid=71509) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 11:00:47 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:00:47 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:00:47 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:00:47 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:00:47 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:00:47 user nova-compute[71509]: DEBUG nova.compute.manager [req-eeeaf05e-2e5b-432f-986f-89db29153f56 req-14405e11-f89b-4057-a833-c3c84a67b4f2 service nova] [instance: ef413492-c781-459e-b99c-46a530034c94] Received event network-vif-unplugged-9e57c0d8-8572-4355-b3c0-d2b74196fc0d {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:00:47 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-eeeaf05e-2e5b-432f-986f-89db29153f56 req-14405e11-f89b-4057-a833-c3c84a67b4f2 service nova] Acquiring lock "ef413492-c781-459e-b99c-46a530034c94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:00:47 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-eeeaf05e-2e5b-432f-986f-89db29153f56 req-14405e11-f89b-4057-a833-c3c84a67b4f2 service nova] Lock "ef413492-c781-459e-b99c-46a530034c94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:00:47 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-eeeaf05e-2e5b-432f-986f-89db29153f56 req-14405e11-f89b-4057-a833-c3c84a67b4f2 service nova] Lock "ef413492-c781-459e-b99c-46a530034c94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:00:47 user nova-compute[71509]: DEBUG nova.compute.manager [req-eeeaf05e-2e5b-432f-986f-89db29153f56 req-14405e11-f89b-4057-a833-c3c84a67b4f2 service nova] [instance: ef413492-c781-459e-b99c-46a530034c94] No waiting events found dispatching network-vif-unplugged-9e57c0d8-8572-4355-b3c0-d2b74196fc0d {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:00:47 user nova-compute[71509]: DEBUG nova.compute.manager [req-eeeaf05e-2e5b-432f-986f-89db29153f56 req-14405e11-f89b-4057-a833-c3c84a67b4f2 service nova] [instance: ef413492-c781-459e-b99c-46a530034c94] Received event network-vif-unplugged-9e57c0d8-8572-4355-b3c0-d2b74196fc0d for instance with task_state deleting. {{(pid=71509) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 11:00:47 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:00:47 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: ef413492-c781-459e-b99c-46a530034c94] Instance destroyed successfully.
Apr 14 11:00:47 user nova-compute[71509]: DEBUG nova.objects.instance [None req-3805e8dc-ea36-4f46-8038-6181ca425b14 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lazy-loading 'resources' on Instance uuid ef413492-c781-459e-b99c-46a530034c94 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 11:00:47 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-3805e8dc-ea36-4f46-8038-6181ca425b14 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T10:57:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2120803394',display_name='tempest-AttachVolumeNegativeTest-server-2120803394',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2120803394',id=32,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNw2SbFQpaxlXMigCU4SqREng1yFr8b6iVL8PJBLSwkK3b0e1hzyI9V2EhI2s6XMdqIXAYQuGjq1aeQdXx9cKlSvkg7nGGryoncSoq6eFhl2+423Xeuz3aQWMczJJSdSEQ==',key_name='tempest-keypair-880478313',keypairs=<?>,launch_index=0,launched_at=2023-04-14T10:58:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cb8f294f957f4c74ae959c1e9f238427',ramdisk_id='',reservation_id='r-yeps261o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-531644967',owner_user_name='tempest-AttachVolumeNegativeTest-531644967-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T10:58:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='78adbbdcd10e446daddde754e46309b2',uuid=ef413492-c781-459e-b99c-46a530034c94,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9e57c0d8-8572-4355-b3c0-d2b74196fc0d", "address": "fa:16:3e:6e:1f:b0", "network": {"id": "b639a68a-2b4e-435c-b98b-65b5b4981c73", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1070821894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb8f294f957f4c74ae959c1e9f238427", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e57c0d8-85", "ovs_interfaceid": "9e57c0d8-8572-4355-b3c0-d2b74196fc0d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 11:00:47 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-3805e8dc-ea36-4f46-8038-6181ca425b14 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Converting VIF {"id": "9e57c0d8-8572-4355-b3c0-d2b74196fc0d", "address": "fa:16:3e:6e:1f:b0", "network": {"id": "b639a68a-2b4e-435c-b98b-65b5b4981c73", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1070821894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb8f294f957f4c74ae959c1e9f238427", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9e57c0d8-85", "ovs_interfaceid": "9e57c0d8-8572-4355-b3c0-d2b74196fc0d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 11:00:47 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-3805e8dc-ea36-4f46-8038-6181ca425b14 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6e:1f:b0,bridge_name='br-int',has_traffic_filtering=True,id=9e57c0d8-8572-4355-b3c0-d2b74196fc0d,network=Network(b639a68a-2b4e-435c-b98b-65b5b4981c73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e57c0d8-85') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 11:00:47 user nova-compute[71509]: DEBUG os_vif [None req-3805e8dc-ea36-4f46-8038-6181ca425b14 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:1f:b0,bridge_name='br-int',has_traffic_filtering=True,id=9e57c0d8-8572-4355-b3c0-d2b74196fc0d,network=Network(b639a68a-2b4e-435c-b98b-65b5b4981c73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e57c0d8-85') {{(pid=71509) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 11:00:47 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:00:47 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9e57c0d8-85, bridge=br-int, if_exists=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:00:47 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:00:47 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:00:47 user nova-compute[71509]: INFO os_vif [None req-3805e8dc-ea36-4f46-8038-6181ca425b14 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:1f:b0,bridge_name='br-int',has_traffic_filtering=True,id=9e57c0d8-8572-4355-b3c0-d2b74196fc0d,network=Network(b639a68a-2b4e-435c-b98b-65b5b4981c73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9e57c0d8-85')
Apr 14 11:00:47 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-3805e8dc-ea36-4f46-8038-6181ca425b14 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: ef413492-c781-459e-b99c-46a530034c94] Deleting instance files /opt/stack/data/nova/instances/ef413492-c781-459e-b99c-46a530034c94_del
Apr 14 11:00:47 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-3805e8dc-ea36-4f46-8038-6181ca425b14 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: ef413492-c781-459e-b99c-46a530034c94] Deletion of /opt/stack/data/nova/instances/ef413492-c781-459e-b99c-46a530034c94_del complete
Apr 14 11:00:47 user nova-compute[71509]: INFO nova.compute.manager [None req-3805e8dc-ea36-4f46-8038-6181ca425b14 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: ef413492-c781-459e-b99c-46a530034c94] Took 0.95 seconds to destroy the instance on the hypervisor.
Apr 14 11:00:47 user nova-compute[71509]: DEBUG oslo.service.loopingcall [None req-3805e8dc-ea36-4f46-8038-6181ca425b14 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71509) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 11:00:47 user nova-compute[71509]: DEBUG nova.compute.manager [-] [instance: ef413492-c781-459e-b99c-46a530034c94] Deallocating network for instance {{(pid=71509) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 11:00:47 user nova-compute[71509]: DEBUG nova.network.neutron [-] [instance: ef413492-c781-459e-b99c-46a530034c94] deallocate_for_instance() {{(pid=71509) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 11:00:48 user nova-compute[71509]: DEBUG nova.virt.libvirt.host [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Removed pending event for fbcca78c-fe73-4ef1-92f9-4c8061cad177 due to event {{(pid=71509) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 11:00:48 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681470048.2799964, fbcca78c-fe73-4ef1-92f9-4c8061cad177 => Resumed> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 11:00:48 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] VM Resumed (Lifecycle Event)
Apr 14 11:00:48 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1a1f03d8-33b5-4071-ab6e-868cd98d7dfe tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 11:00:48 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 11:00:48 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 11:00:48 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:00:48 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] During sync_power_state the instance has a pending task (rescuing). Skip.
Apr 14 11:00:48 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681470048.2859488, fbcca78c-fe73-4ef1-92f9-4c8061cad177 => Started> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 11:00:48 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] VM Started (Lifecycle Event)
Apr 14 11:00:48 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 11:00:48 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 11:00:48 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:00:48 user nova-compute[71509]: DEBUG nova.network.neutron [-] [instance: ef413492-c781-459e-b99c-46a530034c94] Updating instance_info_cache with network_info: [] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:00:48 user nova-compute[71509]: INFO nova.compute.manager [-] [instance: ef413492-c781-459e-b99c-46a530034c94] Took 1.05 seconds to deallocate network for instance.
Apr 14 11:00:49 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-3805e8dc-ea36-4f46-8038-6181ca425b14 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:00:49 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-3805e8dc-ea36-4f46-8038-6181ca425b14 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:00:49 user nova-compute[71509]: DEBUG nova.compute.manager [req-a7bb99fb-0ad8-4e2e-9cb3-197d29b876aa req-d80fe824-2a0f-4c47-aaa5-76ed2c90512b service nova] [instance: ef413492-c781-459e-b99c-46a530034c94] Received event network-vif-plugged-9e57c0d8-8572-4355-b3c0-d2b74196fc0d {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:00:49 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-a7bb99fb-0ad8-4e2e-9cb3-197d29b876aa req-d80fe824-2a0f-4c47-aaa5-76ed2c90512b service nova] Acquiring lock "ef413492-c781-459e-b99c-46a530034c94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:00:49 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-a7bb99fb-0ad8-4e2e-9cb3-197d29b876aa req-d80fe824-2a0f-4c47-aaa5-76ed2c90512b service nova] Lock "ef413492-c781-459e-b99c-46a530034c94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:00:49 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-a7bb99fb-0ad8-4e2e-9cb3-197d29b876aa req-d80fe824-2a0f-4c47-aaa5-76ed2c90512b service nova] Lock "ef413492-c781-459e-b99c-46a530034c94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:00:49 user nova-compute[71509]: DEBUG nova.compute.manager [req-a7bb99fb-0ad8-4e2e-9cb3-197d29b876aa req-d80fe824-2a0f-4c47-aaa5-76ed2c90512b service nova] [instance: ef413492-c781-459e-b99c-46a530034c94] No waiting events found dispatching network-vif-plugged-9e57c0d8-8572-4355-b3c0-d2b74196fc0d {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:00:49 user nova-compute[71509]: WARNING nova.compute.manager [req-a7bb99fb-0ad8-4e2e-9cb3-197d29b876aa req-d80fe824-2a0f-4c47-aaa5-76ed2c90512b service nova] [instance: ef413492-c781-459e-b99c-46a530034c94] Received unexpected event network-vif-plugged-9e57c0d8-8572-4355-b3c0-d2b74196fc0d for instance with vm_state deleted and task_state None.
Apr 14 11:00:49 user nova-compute[71509]: DEBUG nova.compute.manager [req-a7bb99fb-0ad8-4e2e-9cb3-197d29b876aa req-d80fe824-2a0f-4c47-aaa5-76ed2c90512b service nova] [instance: ef413492-c781-459e-b99c-46a530034c94] Received event network-vif-deleted-9e57c0d8-8572-4355-b3c0-d2b74196fc0d {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:00:49 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-3805e8dc-ea36-4f46-8038-6181ca425b14 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 11:00:49 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-3805e8dc-ea36-4f46-8038-6181ca425b14 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 11:00:49 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-3805e8dc-ea36-4f46-8038-6181ca425b14 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.428s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:00:49 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:00:49 user nova-compute[71509]: INFO nova.scheduler.client.report [None req-3805e8dc-ea36-4f46-8038-6181ca425b14 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Deleted allocations for instance ef413492-c781-459e-b99c-46a530034c94
Apr 14 11:00:49 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-3805e8dc-ea36-4f46-8038-6181ca425b14 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "ef413492-c781-459e-b99c-46a530034c94" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.627s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:00:51 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-74d8d913-fcb1-4d21-bebb-02ebeb0ed9f7 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Acquiring lock "9c4cc2a1-0c54-4f20-b33f-9085af7b10a3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:00:51 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-74d8d913-fcb1-4d21-bebb-02ebeb0ed9f7 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "9c4cc2a1-0c54-4f20-b33f-9085af7b10a3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:00:51 user nova-compute[71509]: DEBUG nova.compute.manager [None req-74d8d913-fcb1-4d21-bebb-02ebeb0ed9f7 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Starting instance... {{(pid=71509) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 11:00:51 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-74d8d913-fcb1-4d21-bebb-02ebeb0ed9f7 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:00:51 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-74d8d913-fcb1-4d21-bebb-02ebeb0ed9f7 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:00:51 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-74d8d913-fcb1-4d21-bebb-02ebeb0ed9f7 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71509) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 11:00:51 user nova-compute[71509]: INFO nova.compute.claims [None req-74d8d913-fcb1-4d21-bebb-02ebeb0ed9f7 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Claim successful on node user
Apr 14 11:00:51 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-74d8d913-fcb1-4d21-bebb-02ebeb0ed9f7 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 11:00:51 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-74d8d913-fcb1-4d21-bebb-02ebeb0ed9f7 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 11:00:51 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-74d8d913-fcb1-4d21-bebb-02ebeb0ed9f7 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.501s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:00:51 user nova-compute[71509]: DEBUG nova.compute.manager [None req-74d8d913-fcb1-4d21-bebb-02ebeb0ed9f7 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Start building networks asynchronously for instance. {{(pid=71509) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 11:00:51 user nova-compute[71509]: DEBUG nova.compute.manager [None req-74d8d913-fcb1-4d21-bebb-02ebeb0ed9f7 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Allocating IP information in the background. {{(pid=71509) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 11:00:51 user nova-compute[71509]: DEBUG nova.network.neutron [None req-74d8d913-fcb1-4d21-bebb-02ebeb0ed9f7 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] allocate_for_instance() {{(pid=71509) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 11:00:51 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-74d8d913-fcb1-4d21-bebb-02ebeb0ed9f7 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 11:00:51 user nova-compute[71509]: DEBUG nova.compute.manager [None req-74d8d913-fcb1-4d21-bebb-02ebeb0ed9f7 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Start building block device mappings for instance. {{(pid=71509) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 11:00:51 user nova-compute[71509]: DEBUG nova.policy [None req-74d8d913-fcb1-4d21-bebb-02ebeb0ed9f7 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '831215baa8fd4fe7ba65193bbbdad1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5809862340a84c83a772c65c77513608', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71509) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 11:00:51 user nova-compute[71509]: DEBUG nova.compute.manager [None req-74d8d913-fcb1-4d21-bebb-02ebeb0ed9f7 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Start spawning the instance on the hypervisor. {{(pid=71509) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 11:00:51 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-74d8d913-fcb1-4d21-bebb-02ebeb0ed9f7 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Creating instance directory {{(pid=71509) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 11:00:51 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-74d8d913-fcb1-4d21-bebb-02ebeb0ed9f7 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Creating image(s)
Apr 14 11:00:51 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-74d8d913-fcb1-4d21-bebb-02ebeb0ed9f7 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Acquiring lock "/opt/stack/data/nova/instances/9c4cc2a1-0c54-4f20-b33f-9085af7b10a3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:00:51 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-74d8d913-fcb1-4d21-bebb-02ebeb0ed9f7 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "/opt/stack/data/nova/instances/9c4cc2a1-0c54-4f20-b33f-9085af7b10a3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:00:51 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-74d8d913-fcb1-4d21-bebb-02ebeb0ed9f7 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "/opt/stack/data/nova/instances/9c4cc2a1-0c54-4f20-b33f-9085af7b10a3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:00:51 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-74d8d913-fcb1-4d21-bebb-02ebeb0ed9f7 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Acquiring lock "50f3c4c8cd802b0332b5db3ac538fcb7484dd83c" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:00:51 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-74d8d913-fcb1-4d21-bebb-02ebeb0ed9f7 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "50f3c4c8cd802b0332b5db3ac538fcb7484dd83c" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:00:52 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-74d8d913-fcb1-4d21-bebb-02ebeb0ed9f7 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50f3c4c8cd802b0332b5db3ac538fcb7484dd83c.part --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:00:52 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:00:52 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-74d8d913-fcb1-4d21-bebb-02ebeb0ed9f7 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50f3c4c8cd802b0332b5db3ac538fcb7484dd83c.part --force-share --output=json" returned: 0 in 0.182s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:00:52 user nova-compute[71509]: DEBUG nova.virt.images [None req-74d8d913-fcb1-4d21-bebb-02ebeb0ed9f7 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] 4a4373e4-8d8a-4e8c-abe0-ace7652a4a7d was qcow2, converting to raw {{(pid=71509) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 14 11:00:52 user nova-compute[71509]: DEBUG nova.privsep.utils [None req-74d8d913-fcb1-4d21-bebb-02ebeb0ed9f7 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71509) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 11:00:52 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-74d8d913-fcb1-4d21-bebb-02ebeb0ed9f7 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/50f3c4c8cd802b0332b5db3ac538fcb7484dd83c.part /opt/stack/data/nova/instances/_base/50f3c4c8cd802b0332b5db3ac538fcb7484dd83c.converted {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:00:52 user nova-compute[71509]: DEBUG nova.network.neutron [None req-74d8d913-fcb1-4d21-bebb-02ebeb0ed9f7 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Successfully created port: f41f6957-bf6d-47bf-bb71-638137929e1e {{(pid=71509) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 11:00:52 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:00:52 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-74d8d913-fcb1-4d21-bebb-02ebeb0ed9f7 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/50f3c4c8cd802b0332b5db3ac538fcb7484dd83c.part /opt/stack/data/nova/instances/_base/50f3c4c8cd802b0332b5db3ac538fcb7484dd83c.converted" returned: 0 in 0.337s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:00:52 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-74d8d913-fcb1-4d21-bebb-02ebeb0ed9f7 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50f3c4c8cd802b0332b5db3ac538fcb7484dd83c.converted --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:00:52 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-74d8d913-fcb1-4d21-bebb-02ebeb0ed9f7 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50f3c4c8cd802b0332b5db3ac538fcb7484dd83c.converted --force-share --output=json" returned: 0 in 0.147s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:00:52 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-74d8d913-fcb1-4d21-bebb-02ebeb0ed9f7 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "50f3c4c8cd802b0332b5db3ac538fcb7484dd83c" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.038s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:00:52 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-74d8d913-fcb1-4d21-bebb-02ebeb0ed9f7 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50f3c4c8cd802b0332b5db3ac538fcb7484dd83c --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:00:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-74d8d913-fcb1-4d21-bebb-02ebeb0ed9f7 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50f3c4c8cd802b0332b5db3ac538fcb7484dd83c --force-share --output=json" returned: 0 in 0.141s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:00:53 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-74d8d913-fcb1-4d21-bebb-02ebeb0ed9f7 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Acquiring lock "50f3c4c8cd802b0332b5db3ac538fcb7484dd83c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:00:53 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-74d8d913-fcb1-4d21-bebb-02ebeb0ed9f7 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "50f3c4c8cd802b0332b5db3ac538fcb7484dd83c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:00:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-74d8d913-fcb1-4d21-bebb-02ebeb0ed9f7 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50f3c4c8cd802b0332b5db3ac538fcb7484dd83c --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:00:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-74d8d913-fcb1-4d21-bebb-02ebeb0ed9f7 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50f3c4c8cd802b0332b5db3ac538fcb7484dd83c --force-share --output=json" returned: 0 in 0.145s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:00:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-74d8d913-fcb1-4d21-bebb-02ebeb0ed9f7 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/50f3c4c8cd802b0332b5db3ac538fcb7484dd83c,backing_fmt=raw /opt/stack/data/nova/instances/9c4cc2a1-0c54-4f20-b33f-9085af7b10a3/disk 1073741824 {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:00:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-74d8d913-fcb1-4d21-bebb-02ebeb0ed9f7 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/50f3c4c8cd802b0332b5db3ac538fcb7484dd83c,backing_fmt=raw /opt/stack/data/nova/instances/9c4cc2a1-0c54-4f20-b33f-9085af7b10a3/disk 1073741824" returned: 0 in 0.051s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:00:53 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-74d8d913-fcb1-4d21-bebb-02ebeb0ed9f7 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "50f3c4c8cd802b0332b5db3ac538fcb7484dd83c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.203s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:00:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-74d8d913-fcb1-4d21-bebb-02ebeb0ed9f7 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50f3c4c8cd802b0332b5db3ac538fcb7484dd83c --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:00:53 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:00:53 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:00:53 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Starting heal instance info cache {{(pid=71509) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 11:00:53 user nova-compute[71509]: DEBUG nova.network.neutron [None req-74d8d913-fcb1-4d21-bebb-02ebeb0ed9f7 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Successfully updated port: f41f6957-bf6d-47bf-bb71-638137929e1e {{(pid=71509) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 11:00:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-74d8d913-fcb1-4d21-bebb-02ebeb0ed9f7 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50f3c4c8cd802b0332b5db3ac538fcb7484dd83c --force-share --output=json" returned: 0 in 0.143s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:00:53 user nova-compute[71509]: DEBUG nova.virt.disk.api [None req-74d8d913-fcb1-4d21-bebb-02ebeb0ed9f7 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9c4cc2a1-0c54-4f20-b33f-9085af7b10a3/disk. size=1073741824 {{(pid=71509) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 11:00:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-74d8d913-fcb1-4d21-bebb-02ebeb0ed9f7 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c4cc2a1-0c54-4f20-b33f-9085af7b10a3/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:00:53 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-74d8d913-fcb1-4d21-bebb-02ebeb0ed9f7 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Acquiring lock "refresh_cache-9c4cc2a1-0c54-4f20-b33f-9085af7b10a3" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 11:00:53 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-74d8d913-fcb1-4d21-bebb-02ebeb0ed9f7 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Acquired lock "refresh_cache-9c4cc2a1-0c54-4f20-b33f-9085af7b10a3" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 11:00:53 user nova-compute[71509]: DEBUG nova.network.neutron [None req-74d8d913-fcb1-4d21-bebb-02ebeb0ed9f7 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Building network info cache for instance {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 11:00:53 user nova-compute[71509]: DEBUG nova.compute.manager [req-f2b3be17-d7d5-49f7-84ce-9cffeaedc30f req-53419b29-8007-4a8f-b8b1-f2c7a61b4a0c service nova] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Received event network-changed-f41f6957-bf6d-47bf-bb71-638137929e1e {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:00:53 user nova-compute[71509]: DEBUG nova.compute.manager [req-f2b3be17-d7d5-49f7-84ce-9cffeaedc30f req-53419b29-8007-4a8f-b8b1-f2c7a61b4a0c service nova] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Refreshing instance network info cache due to event network-changed-f41f6957-bf6d-47bf-bb71-638137929e1e. {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 11:00:53 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-f2b3be17-d7d5-49f7-84ce-9cffeaedc30f req-53419b29-8007-4a8f-b8b1-f2c7a61b4a0c service nova] Acquiring lock "refresh_cache-9c4cc2a1-0c54-4f20-b33f-9085af7b10a3" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 11:00:53 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "refresh_cache-e6580716-8a6a-4dfa-8978-ed54b92af1fe" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 11:00:53 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquired lock "refresh_cache-e6580716-8a6a-4dfa-8978-ed54b92af1fe" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 11:00:53 user nova-compute[71509]: DEBUG nova.network.neutron [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] [instance: e6580716-8a6a-4dfa-8978-ed54b92af1fe] Forcefully refreshing network info cache for instance {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 11:00:53 user nova-compute[71509]: DEBUG nova.network.neutron [None req-74d8d913-fcb1-4d21-bebb-02ebeb0ed9f7 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Instance cache missing network info. {{(pid=71509) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 11:00:53 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-74d8d913-fcb1-4d21-bebb-02ebeb0ed9f7 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c4cc2a1-0c54-4f20-b33f-9085af7b10a3/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:00:53 user nova-compute[71509]: DEBUG nova.virt.disk.api [None req-74d8d913-fcb1-4d21-bebb-02ebeb0ed9f7 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Cannot resize image /opt/stack/data/nova/instances/9c4cc2a1-0c54-4f20-b33f-9085af7b10a3/disk to a smaller size. {{(pid=71509) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 11:00:53 user nova-compute[71509]: DEBUG nova.objects.instance [None req-74d8d913-fcb1-4d21-bebb-02ebeb0ed9f7 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lazy-loading 'migration_context' on Instance uuid 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 11:00:53 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-74d8d913-fcb1-4d21-bebb-02ebeb0ed9f7 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Created local disks {{(pid=71509) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 11:00:53 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-74d8d913-fcb1-4d21-bebb-02ebeb0ed9f7 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Ensure instance console log exists: /opt/stack/data/nova/instances/9c4cc2a1-0c54-4f20-b33f-9085af7b10a3/console.log {{(pid=71509) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 11:00:53 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-74d8d913-fcb1-4d21-bebb-02ebeb0ed9f7 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:00:53 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-74d8d913-fcb1-4d21-bebb-02ebeb0ed9f7 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:00:53 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-74d8d913-fcb1-4d21-bebb-02ebeb0ed9f7 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:00:54 user nova-compute[71509]: DEBUG nova.network.neutron [None req-74d8d913-fcb1-4d21-bebb-02ebeb0ed9f7 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Updating instance_info_cache with network_info: [{"id": "f41f6957-bf6d-47bf-bb71-638137929e1e", "address": "fa:16:3e:ca:60:62", "network": {"id": "d59680e7-ed50-4356-b665-ec64ff939708", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-598238133-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5809862340a84c83a772c65c77513608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf41f6957-bf", "ovs_interfaceid": "f41f6957-bf6d-47bf-bb71-638137929e1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:00:54 user nova-compute[71509]: DEBUG nova.network.neutron [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] [instance: e6580716-8a6a-4dfa-8978-ed54b92af1fe] Updating instance_info_cache with network_info: [{"id": "3019f976-f679-4826-8510-3de34b67807c", "address": "fa:16:3e:57:1a:d3", "network": {"id": "1fdeb048-706a-45bf-8f2a-2cee21abb9ea", "bridge": "br-int", "label": "tempest-TestStampPattern-1337046138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f629ba0ab8074ed8bb4e59d545b74eb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3019f976-f6", "ovs_interfaceid": "3019f976-f679-4826-8510-3de34b67807c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:00:54 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-74d8d913-fcb1-4d21-bebb-02ebeb0ed9f7 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Releasing lock "refresh_cache-9c4cc2a1-0c54-4f20-b33f-9085af7b10a3" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 11:00:54 user nova-compute[71509]: DEBUG nova.compute.manager [None req-74d8d913-fcb1-4d21-bebb-02ebeb0ed9f7 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Instance network_info: |[{"id": "f41f6957-bf6d-47bf-bb71-638137929e1e", "address": "fa:16:3e:ca:60:62", "network": {"id": "d59680e7-ed50-4356-b665-ec64ff939708", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-598238133-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5809862340a84c83a772c65c77513608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf41f6957-bf", "ovs_interfaceid": "f41f6957-bf6d-47bf-bb71-638137929e1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71509) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 11:00:54 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Releasing lock "refresh_cache-e6580716-8a6a-4dfa-8978-ed54b92af1fe" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 11:00:54 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] [instance: e6580716-8a6a-4dfa-8978-ed54b92af1fe] Updated the network info_cache for instance {{(pid=71509) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 11:00:54 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-f2b3be17-d7d5-49f7-84ce-9cffeaedc30f req-53419b29-8007-4a8f-b8b1-f2c7a61b4a0c service nova] Acquired lock "refresh_cache-9c4cc2a1-0c54-4f20-b33f-9085af7b10a3" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 11:00:54 user nova-compute[71509]: DEBUG nova.network.neutron [req-f2b3be17-d7d5-49f7-84ce-9cffeaedc30f req-53419b29-8007-4a8f-b8b1-f2c7a61b4a0c service nova] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Refreshing network info cache for port f41f6957-bf6d-47bf-bb71-638137929e1e {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 11:00:54 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-74d8d913-fcb1-4d21-bebb-02ebeb0ed9f7 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Start _get_guest_xml network_info=[{"id": "f41f6957-bf6d-47bf-bb71-638137929e1e", "address": "fa:16:3e:ca:60:62", "network": {"id": "d59680e7-ed50-4356-b665-ec64ff939708", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-598238133-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5809862340a84c83a772c65c77513608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf41f6957-bf", "ovs_interfaceid": "f41f6957-bf6d-47bf-bb71-638137929e1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T11:00:48Z,direct_url=<?>,disk_format='qcow2',id=4a4373e4-8d8a-4e8c-abe0-ace7652a4a7d,min_disk=0,min_ram=0,name='tempest-scenario-img--1359896468',owner='5809862340a84c83a772c65c77513608',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T11:00:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '4a4373e4-8d8a-4e8c-abe0-ace7652a4a7d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71509) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 11:00:54 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:00:54 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-74d8d913-fcb1-4d21-bebb-02ebeb0ed9f7 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 11:00:54 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-74d8d913-fcb1-4d21-bebb-02ebeb0ed9f7 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 11:00:54 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-74d8d913-fcb1-4d21-bebb-02ebeb0ed9f7 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71509) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 11:00:54 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-74d8d913-fcb1-4d21-bebb-02ebeb0ed9f7 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T10:40:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T11:00:48Z,direct_url=<?>,disk_format='qcow2',id=4a4373e4-8d8a-4e8c-abe0-ace7652a4a7d,min_disk=0,min_ram=0,name='tempest-scenario-img--1359896468',owner='5809862340a84c83a772c65c77513608',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T11:00:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 11:00:54 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-74d8d913-fcb1-4d21-bebb-02ebeb0ed9f7 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Flavor limits 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 11:00:54 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-74d8d913-fcb1-4d21-bebb-02ebeb0ed9f7 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Image limits 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 11:00:54 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-74d8d913-fcb1-4d21-bebb-02ebeb0ed9f7 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Flavor pref 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 11:00:54 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-74d8d913-fcb1-4d21-bebb-02ebeb0ed9f7 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Image pref 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 11:00:54 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-74d8d913-fcb1-4d21-bebb-02ebeb0ed9f7 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 11:00:54 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-74d8d913-fcb1-4d21-bebb-02ebeb0ed9f7 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 11:00:54 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-74d8d913-fcb1-4d21-bebb-02ebeb0ed9f7 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71509) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 11:00:54 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-74d8d913-fcb1-4d21-bebb-02ebeb0ed9f7 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Got 1 possible topologies {{(pid=71509) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 11:00:54 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-74d8d913-fcb1-4d21-bebb-02ebeb0ed9f7 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 11:00:54 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-74d8d913-fcb1-4d21-bebb-02ebeb0ed9f7 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 11:00:54 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-74d8d913-fcb1-4d21-bebb-02ebeb0ed9f7 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T11:00:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-145954405',display_name='tempest-TestMinimumBasicScenario-server-145954405',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-145954405',id=36,image_ref='4a4373e4-8d8a-4e8c-abe0-ace7652a4a7d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJI56DgU3GFkyba07rJQ5gPWmf+s+oszKE0l2AEuBdasOhPKZbxdMzg3ltBRBJuQQhxmZUmQrEIrG8aYiF6ueY2ARcTYBp9F9Zb4rPcdzBhgtNF8DrTPiOHvxBGxF5+ocQ==',key_name='tempest-TestMinimumBasicScenario-1104464810',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5809862340a84c83a772c65c77513608',ramdisk_id='',reservation_id='r-4ptbez4v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4a4373e4-8d8a-4e8c-abe0-ace7652a4a7d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-2127394977',owner_user_name='tempest-TestMinimumBasicScenario-2127394977-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T11:00:52Z,user_data=None,user_id='831215baa8fd4fe7ba65193bbbdad1b4',uuid=9c4cc2a1-0c54-4f20-b33f-9085af7b10a3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f41f6957-bf6d-47bf-bb71-638137929e1e", "address": "fa:16:3e:ca:60:62", "network": {"id": "d59680e7-ed50-4356-b665-ec64ff939708", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-598238133-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5809862340a84c83a772c65c77513608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf41f6957-bf", "ovs_interfaceid": "f41f6957-bf6d-47bf-bb71-638137929e1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71509) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 11:00:54 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-74d8d913-fcb1-4d21-bebb-02ebeb0ed9f7 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Converting VIF {"id": "f41f6957-bf6d-47bf-bb71-638137929e1e", "address": "fa:16:3e:ca:60:62", "network": {"id": "d59680e7-ed50-4356-b665-ec64ff939708", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-598238133-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5809862340a84c83a772c65c77513608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf41f6957-bf", "ovs_interfaceid": "f41f6957-bf6d-47bf-bb71-638137929e1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 11:00:54 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-74d8d913-fcb1-4d21-bebb-02ebeb0ed9f7 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:60:62,bridge_name='br-int',has_traffic_filtering=True,id=f41f6957-bf6d-47bf-bb71-638137929e1e,network=Network(d59680e7-ed50-4356-b665-ec64ff939708),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf41f6957-bf') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 11:00:54 user nova-compute[71509]: DEBUG nova.objects.instance [None req-74d8d913-fcb1-4d21-bebb-02ebeb0ed9f7 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lazy-loading 'pci_devices' on Instance uuid 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 11:00:54 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:00:54 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:00:54 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:00:54 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Auditing locally available compute resources for user (node: user) {{(pid=71509) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 11:00:54 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-74d8d913-fcb1-4d21-bebb-02ebeb0ed9f7 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] End _get_guest_xml xml=<domain type="kvm">
Apr 14 11:00:54 user nova-compute[71509]:   <uuid>9c4cc2a1-0c54-4f20-b33f-9085af7b10a3</uuid>
Apr 14 11:00:54 user nova-compute[71509]:   <name>instance-00000024</name>
Apr 14 11:00:54 user nova-compute[71509]:   <memory>131072</memory>
Apr 14 11:00:54 user nova-compute[71509]:   <vcpu>1</vcpu>
Apr 14 11:00:54 user nova-compute[71509]:   <metadata>
Apr 14 11:00:54 user nova-compute[71509]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 11:00:54 user nova-compute[71509]:       <nova:package version="0.0.0"/>
Apr 14 11:00:54 user nova-compute[71509]:       <nova:name>tempest-TestMinimumBasicScenario-server-145954405</nova:name>
Apr 14 11:00:54 user nova-compute[71509]:       <nova:creationTime>2023-04-14 11:00:54</nova:creationTime>
Apr 14 11:00:54 user nova-compute[71509]:       <nova:flavor name="m1.nano">
Apr 14 11:00:54 user nova-compute[71509]:         <nova:memory>128</nova:memory>
Apr 14 11:00:54 user nova-compute[71509]:         <nova:disk>1</nova:disk>
Apr 14 11:00:54 user nova-compute[71509]:         <nova:swap>0</nova:swap>
Apr 14 11:00:54 user nova-compute[71509]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 11:00:54 user nova-compute[71509]:         <nova:vcpus>1</nova:vcpus>
Apr 14 11:00:54 user nova-compute[71509]:       </nova:flavor>
Apr 14 11:00:54 user nova-compute[71509]:       <nova:owner>
Apr 14 11:00:54 user nova-compute[71509]:         <nova:user uuid="831215baa8fd4fe7ba65193bbbdad1b4">tempest-TestMinimumBasicScenario-2127394977-project-member</nova:user>
Apr 14 11:00:54 user nova-compute[71509]:         <nova:project uuid="5809862340a84c83a772c65c77513608">tempest-TestMinimumBasicScenario-2127394977</nova:project>
Apr 14 11:00:54 user nova-compute[71509]:       </nova:owner>
Apr 14 11:00:54 user nova-compute[71509]:       <nova:root type="image" uuid="4a4373e4-8d8a-4e8c-abe0-ace7652a4a7d"/>
Apr 14 11:00:54 user nova-compute[71509]:       <nova:ports>
Apr 14 11:00:54 user nova-compute[71509]:         <nova:port uuid="f41f6957-bf6d-47bf-bb71-638137929e1e">
Apr 14 11:00:54 user nova-compute[71509]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 14 11:00:54 user nova-compute[71509]:         </nova:port>
Apr 14 11:00:54 user nova-compute[71509]:       </nova:ports>
Apr 14 11:00:54 user nova-compute[71509]:     </nova:instance>
Apr 14 11:00:54 user nova-compute[71509]:   </metadata>
Apr 14 11:00:54 user nova-compute[71509]:   <sysinfo type="smbios">
Apr 14 11:00:54 user nova-compute[71509]:     <system>
Apr 14 11:00:54 user nova-compute[71509]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 11:00:54 user nova-compute[71509]:       <entry name="product">OpenStack Nova</entry>
Apr 14 11:00:54 user nova-compute[71509]:       <entry name="version">0.0.0</entry>
Apr 14 11:00:54 user nova-compute[71509]:       <entry name="serial">9c4cc2a1-0c54-4f20-b33f-9085af7b10a3</entry>
Apr 14 11:00:54 user nova-compute[71509]:       <entry name="uuid">9c4cc2a1-0c54-4f20-b33f-9085af7b10a3</entry>
Apr 14 11:00:54 user nova-compute[71509]:       <entry name="family">Virtual Machine</entry>
Apr 14 11:00:54 user nova-compute[71509]:     </system>
Apr 14 11:00:54 user nova-compute[71509]:   </sysinfo>
Apr 14 11:00:54 user nova-compute[71509]:   <os>
Apr 14 11:00:54 user nova-compute[71509]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 11:00:54 user nova-compute[71509]:     <boot dev="hd"/>
Apr 14 11:00:54 user nova-compute[71509]:     <smbios mode="sysinfo"/>
Apr 14 11:00:54 user nova-compute[71509]:   </os>
Apr 14 11:00:54 user nova-compute[71509]:   <features>
Apr 14 11:00:54 user nova-compute[71509]:     <acpi/>
Apr 14 11:00:54 user nova-compute[71509]:     <apic/>
Apr 14 11:00:54 user nova-compute[71509]:     <vmcoreinfo/>
Apr 14 11:00:54 user nova-compute[71509]:   </features>
Apr 14 11:00:54 user nova-compute[71509]:   <clock offset="utc">
Apr 14 11:00:54 user nova-compute[71509]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 11:00:54 user nova-compute[71509]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 11:00:54 user nova-compute[71509]:     <timer name="hpet" present="no"/>
Apr 14 11:00:54 user nova-compute[71509]:   </clock>
Apr 14 11:00:54 user nova-compute[71509]:   <cpu mode="custom" match="exact">
Apr 14 11:00:54 user nova-compute[71509]:     <model>Nehalem</model>
Apr 14 11:00:54 user nova-compute[71509]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 11:00:54 user nova-compute[71509]:   </cpu>
Apr 14 11:00:54 user nova-compute[71509]:   <devices>
Apr 14 11:00:54 user nova-compute[71509]:     <disk type="file" device="disk">
Apr 14 11:00:54 user nova-compute[71509]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 11:00:54 user nova-compute[71509]:       <source file="/opt/stack/data/nova/instances/9c4cc2a1-0c54-4f20-b33f-9085af7b10a3/disk"/>
Apr 14 11:00:54 user nova-compute[71509]:       <target dev="vda" bus="virtio"/>
Apr 14 11:00:54 user nova-compute[71509]:     </disk>
Apr 14 11:00:54 user nova-compute[71509]:     <interface type="ethernet">
Apr 14 11:00:54 user nova-compute[71509]:       <mac address="fa:16:3e:ca:60:62"/>
Apr 14 11:00:54 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 11:00:54 user nova-compute[71509]:       <mtu size="1442"/>
Apr 14 11:00:54 user nova-compute[71509]:       <target dev="tapf41f6957-bf"/>
Apr 14 11:00:54 user nova-compute[71509]:     </interface>
Apr 14 11:00:54 user nova-compute[71509]:     <serial type="pty">
Apr 14 11:00:54 user nova-compute[71509]:       <log file="/opt/stack/data/nova/instances/9c4cc2a1-0c54-4f20-b33f-9085af7b10a3/console.log" append="off"/>
Apr 14 11:00:54 user nova-compute[71509]:     </serial>
Apr 14 11:00:54 user nova-compute[71509]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 11:00:54 user nova-compute[71509]:     <video>
Apr 14 11:00:54 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 11:00:54 user nova-compute[71509]:     </video>
Apr 14 11:00:54 user nova-compute[71509]:     <rng model="virtio">
Apr 14 11:00:54 user nova-compute[71509]:       <backend model="random">/dev/urandom</backend>
Apr 14 11:00:54 user nova-compute[71509]:     </rng>
Apr 14 11:00:54 user nova-compute[71509]:     <controller type="usb" index="0" model="none"/>
Apr 14 11:00:54 user nova-compute[71509]:     <memballoon model="virtio">
Apr 14 11:00:54 user nova-compute[71509]:       <stats period="10"/>
Apr 14 11:00:54 user nova-compute[71509]:     </memballoon>
Apr 14 11:00:54 user nova-compute[71509]:   </devices>
Apr 14 11:00:54 user nova-compute[71509]: </domain>
Apr 14 11:00:54 user nova-compute[71509]:  {{(pid=71509) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 11:00:54 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-74d8d913-fcb1-4d21-bebb-02ebeb0ed9f7 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T11:00:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-145954405',display_name='tempest-TestMinimumBasicScenario-server-145954405',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-145954405',id=36,image_ref='4a4373e4-8d8a-4e8c-abe0-ace7652a4a7d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJI56DgU3GFkyba07rJQ5gPWmf+s+oszKE0l2AEuBdasOhPKZbxdMzg3ltBRBJuQQhxmZUmQrEIrG8aYiF6ueY2ARcTYBp9F9Zb4rPcdzBhgtNF8DrTPiOHvxBGxF5+ocQ==',key_name='tempest-TestMinimumBasicScenario-1104464810',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5809862340a84c83a772c65c77513608',ramdisk_id='',reservation_id='r-4ptbez4v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4a4373e4-8d8a-4e8c-abe0-ace7652a4a7d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-2127394977',owner_user_name='tempest-TestMinimumBasicScenario-2127394977-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T11:00:52Z,user_data=None,user_id='831215baa8fd4fe7ba65193bbbdad1b4',uuid=9c4cc2a1-0c54-4f20-b33f-9085af7b10a3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f41f6957-bf6d-47bf-bb71-638137929e1e", "address": "fa:16:3e:ca:60:62", "network": {"id": "d59680e7-ed50-4356-b665-ec64ff939708", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-598238133-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5809862340a84c83a772c65c77513608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf41f6957-bf", "ovs_interfaceid": "f41f6957-bf6d-47bf-bb71-638137929e1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 11:00:54 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-74d8d913-fcb1-4d21-bebb-02ebeb0ed9f7 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Converting VIF {"id": "f41f6957-bf6d-47bf-bb71-638137929e1e", "address": "fa:16:3e:ca:60:62", "network": {"id": "d59680e7-ed50-4356-b665-ec64ff939708", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-598238133-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5809862340a84c83a772c65c77513608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf41f6957-bf", "ovs_interfaceid": "f41f6957-bf6d-47bf-bb71-638137929e1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 11:00:54 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-74d8d913-fcb1-4d21-bebb-02ebeb0ed9f7 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:60:62,bridge_name='br-int',has_traffic_filtering=True,id=f41f6957-bf6d-47bf-bb71-638137929e1e,network=Network(d59680e7-ed50-4356-b665-ec64ff939708),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf41f6957-bf') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 11:00:54 user nova-compute[71509]: DEBUG os_vif [None req-74d8d913-fcb1-4d21-bebb-02ebeb0ed9f7 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:60:62,bridge_name='br-int',has_traffic_filtering=True,id=f41f6957-bf6d-47bf-bb71-638137929e1e,network=Network(d59680e7-ed50-4356-b665-ec64ff939708),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf41f6957-bf') {{(pid=71509) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 11:00:54 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:00:54 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:00:54 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 11:00:54 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:00:54 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf41f6957-bf, may_exist=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:00:54 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf41f6957-bf, col_values=(('external_ids', {'iface-id': 'f41f6957-bf6d-47bf-bb71-638137929e1e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ca:60:62', 'vm-uuid': '9c4cc2a1-0c54-4f20-b33f-9085af7b10a3'}),)) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:00:54 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:00:54 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:00:54 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:00:54 user nova-compute[71509]: INFO os_vif [None req-74d8d913-fcb1-4d21-bebb-02ebeb0ed9f7 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:60:62,bridge_name='br-int',has_traffic_filtering=True,id=f41f6957-bf6d-47bf-bb71-638137929e1e,network=Network(d59680e7-ed50-4356-b665-ec64ff939708),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf41f6957-bf')
Apr 14 11:00:54 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-74d8d913-fcb1-4d21-bebb-02ebeb0ed9f7 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] No BDM found with device name vda, not building metadata. {{(pid=71509) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 11:00:54 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-74d8d913-fcb1-4d21-bebb-02ebeb0ed9f7 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] No VIF found with MAC fa:16:3e:ca:60:62, not building metadata {{(pid=71509) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 11:00:54 user nova-compute[71509]: DEBUG nova.network.neutron [req-f2b3be17-d7d5-49f7-84ce-9cffeaedc30f req-53419b29-8007-4a8f-b8b1-f2c7a61b4a0c service nova] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Updated VIF entry in instance network info cache for port f41f6957-bf6d-47bf-bb71-638137929e1e. {{(pid=71509) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 11:00:54 user nova-compute[71509]: DEBUG nova.network.neutron [req-f2b3be17-d7d5-49f7-84ce-9cffeaedc30f req-53419b29-8007-4a8f-b8b1-f2c7a61b4a0c service nova] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Updating instance_info_cache with network_info: [{"id": "f41f6957-bf6d-47bf-bb71-638137929e1e", "address": "fa:16:3e:ca:60:62", "network": {"id": "d59680e7-ed50-4356-b665-ec64ff939708", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-598238133-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5809862340a84c83a772c65c77513608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf41f6957-bf", "ovs_interfaceid": "f41f6957-bf6d-47bf-bb71-638137929e1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:00:54 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-f2b3be17-d7d5-49f7-84ce-9cffeaedc30f req-53419b29-8007-4a8f-b8b1-f2c7a61b4a0c service nova] Releasing lock "refresh_cache-9c4cc2a1-0c54-4f20-b33f-9085af7b10a3" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 11:00:55 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:00:55 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:00:55 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:00:55 user nova-compute[71509]: DEBUG nova.compute.manager [req-8303a842-fbc7-4443-9dc3-c5a007c44011 req-1823ce65-7f1b-4751-9beb-903819215f93 service nova] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Received event network-vif-plugged-f41f6957-bf6d-47bf-bb71-638137929e1e {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:00:55 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-8303a842-fbc7-4443-9dc3-c5a007c44011 req-1823ce65-7f1b-4751-9beb-903819215f93 service nova] Acquiring lock "9c4cc2a1-0c54-4f20-b33f-9085af7b10a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:00:55 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-8303a842-fbc7-4443-9dc3-c5a007c44011 req-1823ce65-7f1b-4751-9beb-903819215f93 service nova] Lock "9c4cc2a1-0c54-4f20-b33f-9085af7b10a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:00:55 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-8303a842-fbc7-4443-9dc3-c5a007c44011 req-1823ce65-7f1b-4751-9beb-903819215f93 service nova] Lock "9c4cc2a1-0c54-4f20-b33f-9085af7b10a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:00:55 user nova-compute[71509]: DEBUG nova.compute.manager [req-8303a842-fbc7-4443-9dc3-c5a007c44011 req-1823ce65-7f1b-4751-9beb-903819215f93 service nova] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] No waiting events found dispatching network-vif-plugged-f41f6957-bf6d-47bf-bb71-638137929e1e {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:00:55 user nova-compute[71509]: WARNING nova.compute.manager [req-8303a842-fbc7-4443-9dc3-c5a007c44011 req-1823ce65-7f1b-4751-9beb-903819215f93 service nova] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Received unexpected event network-vif-plugged-f41f6957-bf6d-47bf-bb71-638137929e1e for instance with vm_state building and task_state spawning.
Apr 14 11:00:56 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c4cc2a1-0c54-4f20-b33f-9085af7b10a3/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:00:56 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:00:56 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:00:56 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c4cc2a1-0c54-4f20-b33f-9085af7b10a3/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:00:56 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c4cc2a1-0c54-4f20-b33f-9085af7b10a3/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:00:56 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c4cc2a1-0c54-4f20-b33f-9085af7b10a3/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:00:56 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6580716-8a6a-4dfa-8978-ed54b92af1fe/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:00:56 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6580716-8a6a-4dfa-8978-ed54b92af1fe/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:00:56 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6580716-8a6a-4dfa-8978-ed54b92af1fe/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:00:56 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6580716-8a6a-4dfa-8978-ed54b92af1fe/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:00:56 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e479154a-acd6-47aa-9a5b-43c6e0feda07/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:00:57 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e479154a-acd6-47aa-9a5b-43c6e0feda07/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:00:57 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e479154a-acd6-47aa-9a5b-43c6e0feda07/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:00:57 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e479154a-acd6-47aa-9a5b-43c6e0feda07/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:00:57 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f41f217-0df2-4205-9633-7dbe83f40c96/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:00:57 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f41f217-0df2-4205-9633-7dbe83f40c96/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:00:57 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f41f217-0df2-4205-9633-7dbe83f40c96/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:00:57 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f41f217-0df2-4205-9633-7dbe83f40c96/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:00:57 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71509) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 11:00:57 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71509) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 11:00:57 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbcca78c-fe73-4ef1-92f9-4c8061cad177/disk.rescue --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:00:57 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbcca78c-fe73-4ef1-92f9-4c8061cad177/disk.rescue --force-share --output=json" returned: 0 in 0.132s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:00:57 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbcca78c-fe73-4ef1-92f9-4c8061cad177/disk.rescue --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:00:57 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbcca78c-fe73-4ef1-92f9-4c8061cad177/disk.rescue --force-share --output=json" returned: 0 in 0.143s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:00:57 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a936fb20-3f17-4114-829a-8659da6bc5f3/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:00:57 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681470057.8612218, 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3 => Resumed> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 11:00:57 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] VM Resumed (Lifecycle Event)
Apr 14 11:00:57 user nova-compute[71509]: DEBUG nova.compute.manager [None req-74d8d913-fcb1-4d21-bebb-02ebeb0ed9f7 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Instance event wait completed in 0 seconds for  {{(pid=71509) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 11:00:57 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-74d8d913-fcb1-4d21-bebb-02ebeb0ed9f7 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Guest created on hypervisor {{(pid=71509) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 11:00:57 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Instance spawned successfully.
Apr 14 11:00:57 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-74d8d913-fcb1-4d21-bebb-02ebeb0ed9f7 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 11:00:57 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 11:00:57 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 11:00:57 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-74d8d913-fcb1-4d21-bebb-02ebeb0ed9f7 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Found default for hw_cdrom_bus of ide {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:00:57 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-74d8d913-fcb1-4d21-bebb-02ebeb0ed9f7 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Found default for hw_disk_bus of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:00:57 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-74d8d913-fcb1-4d21-bebb-02ebeb0ed9f7 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Found default for hw_input_bus of None {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:00:57 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-74d8d913-fcb1-4d21-bebb-02ebeb0ed9f7 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Found default for hw_pointer_model of None {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:00:57 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-74d8d913-fcb1-4d21-bebb-02ebeb0ed9f7 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Found default for hw_video_model of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:00:57 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-74d8d913-fcb1-4d21-bebb-02ebeb0ed9f7 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Found default for hw_vif_model of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:00:57 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 11:00:57 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681470057.8618734, 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3 => Started> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 11:00:57 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] VM Started (Lifecycle Event)
Apr 14 11:00:57 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 11:00:58 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a936fb20-3f17-4114-829a-8659da6bc5f3/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:00:58 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a936fb20-3f17-4114-829a-8659da6bc5f3/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:00:58 user nova-compute[71509]: DEBUG nova.compute.manager [req-9a58479d-3a01-4ede-8e33-f4b33b4b1731 req-f2d2706f-3487-445a-9d01-6b13c89036f9 service nova] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Received event network-vif-plugged-f41f6957-bf6d-47bf-bb71-638137929e1e {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:00:58 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-9a58479d-3a01-4ede-8e33-f4b33b4b1731 req-f2d2706f-3487-445a-9d01-6b13c89036f9 service nova] Acquiring lock "9c4cc2a1-0c54-4f20-b33f-9085af7b10a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:00:58 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-9a58479d-3a01-4ede-8e33-f4b33b4b1731 req-f2d2706f-3487-445a-9d01-6b13c89036f9 service nova] Lock "9c4cc2a1-0c54-4f20-b33f-9085af7b10a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:00:58 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-9a58479d-3a01-4ede-8e33-f4b33b4b1731 req-f2d2706f-3487-445a-9d01-6b13c89036f9 service nova] Lock "9c4cc2a1-0c54-4f20-b33f-9085af7b10a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:00:58 user nova-compute[71509]: DEBUG nova.compute.manager [req-9a58479d-3a01-4ede-8e33-f4b33b4b1731 req-f2d2706f-3487-445a-9d01-6b13c89036f9 service nova] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] No waiting events found dispatching network-vif-plugged-f41f6957-bf6d-47bf-bb71-638137929e1e {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:00:58 user nova-compute[71509]: WARNING nova.compute.manager [req-9a58479d-3a01-4ede-8e33-f4b33b4b1731 req-f2d2706f-3487-445a-9d01-6b13c89036f9 service nova] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Received unexpected event network-vif-plugged-f41f6957-bf6d-47bf-bb71-638137929e1e for instance with vm_state building and task_state spawning.
Apr 14 11:00:58 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 11:00:58 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a936fb20-3f17-4114-829a-8659da6bc5f3/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:00:58 user nova-compute[71509]: INFO nova.compute.manager [None req-74d8d913-fcb1-4d21-bebb-02ebeb0ed9f7 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Took 6.23 seconds to spawn the instance on the hypervisor.
Apr 14 11:00:58 user nova-compute[71509]: DEBUG nova.compute.manager [None req-74d8d913-fcb1-4d21-bebb-02ebeb0ed9f7 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 11:00:58 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 11:00:58 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dd9e11f-1fed-42af-ad5c-9cdd051b93e7/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:00:58 user nova-compute[71509]: INFO nova.compute.manager [None req-74d8d913-fcb1-4d21-bebb-02ebeb0ed9f7 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Took 7.12 seconds to build instance.
Apr 14 11:00:58 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dd9e11f-1fed-42af-ad5c-9cdd051b93e7/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:00:58 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dd9e11f-1fed-42af-ad5c-9cdd051b93e7/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:00:58 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:00:58 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-74d8d913-fcb1-4d21-bebb-02ebeb0ed9f7 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "9c4cc2a1-0c54-4f20-b33f-9085af7b10a3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.271s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:00:58 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dd9e11f-1fed-42af-ad5c-9cdd051b93e7/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:00:58 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d6a53c3-6e32-456c-a056-fbf1bef3b656/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:00:58 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d6a53c3-6e32-456c-a056-fbf1bef3b656/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:00:58 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d6a53c3-6e32-456c-a056-fbf1bef3b656/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:00:58 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d6a53c3-6e32-456c-a056-fbf1bef3b656/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:00:58 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71509) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 11:00:59 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:00:59 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 11:00:59 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 11:00:59 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Hypervisor/Node resource view: name=user free_ram=7941MB free_disk=25.767337799072266GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71509) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 11:00:59 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:00:59 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:00:59 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance e479154a-acd6-47aa-9a5b-43c6e0feda07 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 11:00:59 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 6cae9f61-763f-4671-a873-d15f01384416 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 11:00:59 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 6f41f217-0df2-4205-9633-7dbe83f40c96 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 11:00:59 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance e6580716-8a6a-4dfa-8978-ed54b92af1fe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 11:00:59 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance a936fb20-3f17-4114-829a-8659da6bc5f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 11:00:59 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 0dd9e11f-1fed-42af-ad5c-9cdd051b93e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 11:00:59 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 3d6a53c3-6e32-456c-a056-fbf1bef3b656 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 11:00:59 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance fbcca78c-fe73-4ef1-92f9-4c8061cad177 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 11:00:59 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 3db2e71c-939b-4d2f-b1be-c2122f7cd73e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 11:00:59 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 11:00:59 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=71509) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 11:00:59 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Final resource view: name=user phys_ram=16023MB used_ram=1792MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=71509) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 11:00:59 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 11:00:59 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 11:00:59 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Compute_service record updated for user:user {{(pid=71509) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 11:00:59 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.562s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:01:02 user nova-compute[71509]: DEBUG nova.compute.manager [req-d47e94f6-3223-4c72-b831-063381820f64 req-c5101947-3e50-4f1c-a984-d167bea3b60c service nova] [instance: 0dd9e11f-1fed-42af-ad5c-9cdd051b93e7] Received event network-changed-ec941aab-7c95-415b-96bc-e74ebaeb9385 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:01:02 user nova-compute[71509]: DEBUG nova.compute.manager [req-d47e94f6-3223-4c72-b831-063381820f64 req-c5101947-3e50-4f1c-a984-d167bea3b60c service nova] [instance: 0dd9e11f-1fed-42af-ad5c-9cdd051b93e7] Refreshing instance network info cache due to event network-changed-ec941aab-7c95-415b-96bc-e74ebaeb9385. {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 11:01:02 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-d47e94f6-3223-4c72-b831-063381820f64 req-c5101947-3e50-4f1c-a984-d167bea3b60c service nova] Acquiring lock "refresh_cache-0dd9e11f-1fed-42af-ad5c-9cdd051b93e7" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 11:01:02 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-d47e94f6-3223-4c72-b831-063381820f64 req-c5101947-3e50-4f1c-a984-d167bea3b60c service nova] Acquired lock "refresh_cache-0dd9e11f-1fed-42af-ad5c-9cdd051b93e7" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 11:01:02 user nova-compute[71509]: DEBUG nova.network.neutron [req-d47e94f6-3223-4c72-b831-063381820f64 req-c5101947-3e50-4f1c-a984-d167bea3b60c service nova] [instance: 0dd9e11f-1fed-42af-ad5c-9cdd051b93e7] Refreshing network info cache for port ec941aab-7c95-415b-96bc-e74ebaeb9385 {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 11:01:02 user nova-compute[71509]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681470047.7307513, ef413492-c781-459e-b99c-46a530034c94 => Stopped> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 11:01:02 user nova-compute[71509]: INFO nova.compute.manager [-] [instance: ef413492-c781-459e-b99c-46a530034c94] VM Stopped (Lifecycle Event)
Apr 14 11:01:02 user nova-compute[71509]: DEBUG nova.compute.manager [None req-f67b77c1-6fb8-416e-962e-8c6f95301a16 None None] [instance: ef413492-c781-459e-b99c-46a530034c94] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 11:01:02 user nova-compute[71509]: DEBUG nova.network.neutron [req-d47e94f6-3223-4c72-b831-063381820f64 req-c5101947-3e50-4f1c-a984-d167bea3b60c service nova] [instance: 0dd9e11f-1fed-42af-ad5c-9cdd051b93e7] Updated VIF entry in instance network info cache for port ec941aab-7c95-415b-96bc-e74ebaeb9385. {{(pid=71509) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 11:01:02 user nova-compute[71509]: DEBUG nova.network.neutron [req-d47e94f6-3223-4c72-b831-063381820f64 req-c5101947-3e50-4f1c-a984-d167bea3b60c service nova] [instance: 0dd9e11f-1fed-42af-ad5c-9cdd051b93e7] Updating instance_info_cache with network_info: [{"id": "ec941aab-7c95-415b-96bc-e74ebaeb9385", "address": "fa:16:3e:31:a2:13", "network": {"id": "18a91434-637b-4c19-a97b-736b32c1ea5a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1824162811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea2cb4dfa5b4a52b658efd8f5aefb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec941aab-7c", "ovs_interfaceid": "ec941aab-7c95-415b-96bc-e74ebaeb9385", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:01:02 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-d47e94f6-3223-4c72-b831-063381820f64 req-c5101947-3e50-4f1c-a984-d167bea3b60c service nova] Releasing lock "refresh_cache-0dd9e11f-1fed-42af-ad5c-9cdd051b93e7" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 11:01:03 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:01:03 user nova-compute[71509]: DEBUG nova.compute.manager [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] Stashing vm_state: active {{(pid=71509) _prep_resize /opt/stack/nova/nova/compute/manager.py:5499}}
Apr 14 11:01:03 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:01:03 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:01:03 user nova-compute[71509]: DEBUG nova.objects.instance [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lazy-loading 'pci_requests' on Instance uuid 3db2e71c-939b-4d2f-b1be-c2122f7cd73e {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 11:01:03 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71509) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 11:01:03 user nova-compute[71509]: INFO nova.compute.claims [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] Claim successful on node user
Apr 14 11:01:03 user nova-compute[71509]: DEBUG nova.objects.instance [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lazy-loading 'resources' on Instance uuid 3db2e71c-939b-4d2f-b1be-c2122f7cd73e {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 11:01:03 user nova-compute[71509]: DEBUG nova.objects.instance [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lazy-loading 'pci_devices' on Instance uuid 3db2e71c-939b-4d2f-b1be-c2122f7cd73e {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 11:01:04 user nova-compute[71509]: INFO nova.compute.resource_tracker [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] Updating resource usage from migration 642d65c1-f5b8-43ae-8abe-e04d77cd069e
Apr 14 11:01:04 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 11:01:04 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 11:01:04 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:01:04 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.484s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:01:04 user nova-compute[71509]: INFO nova.compute.manager [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] Migrating
Apr 14 11:01:04 user nova-compute[71509]: DEBUG nova.compute.manager [req-a47a0597-fc65-442b-a754-a86573205079 req-83e71df9-cf59-4fd8-8bf7-fff2982472de service nova] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] Received event network-changed-1e547ec7-7efd-480f-84be-806c8cf25b90 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:01:04 user nova-compute[71509]: DEBUG nova.compute.manager [req-a47a0597-fc65-442b-a754-a86573205079 req-83e71df9-cf59-4fd8-8bf7-fff2982472de service nova] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] Refreshing instance network info cache due to event network-changed-1e547ec7-7efd-480f-84be-806c8cf25b90. {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 11:01:04 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-a47a0597-fc65-442b-a754-a86573205079 req-83e71df9-cf59-4fd8-8bf7-fff2982472de service nova] Acquiring lock "refresh_cache-3db2e71c-939b-4d2f-b1be-c2122f7cd73e" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 11:01:04 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-a47a0597-fc65-442b-a754-a86573205079 req-83e71df9-cf59-4fd8-8bf7-fff2982472de service nova] Acquired lock "refresh_cache-3db2e71c-939b-4d2f-b1be-c2122f7cd73e" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 11:01:04 user nova-compute[71509]: DEBUG nova.network.neutron [req-a47a0597-fc65-442b-a754-a86573205079 req-83e71df9-cf59-4fd8-8bf7-fff2982472de service nova] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] Refreshing network info cache for port 1e547ec7-7efd-480f-84be-806c8cf25b90 {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 11:01:04 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "refresh_cache-3db2e71c-939b-4d2f-b1be-c2122f7cd73e" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 11:01:04 user nova-compute[71509]: DEBUG nova.network.neutron [req-a47a0597-fc65-442b-a754-a86573205079 req-83e71df9-cf59-4fd8-8bf7-fff2982472de service nova] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] Updated VIF entry in instance network info cache for port 1e547ec7-7efd-480f-84be-806c8cf25b90. {{(pid=71509) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 11:01:04 user nova-compute[71509]: DEBUG nova.network.neutron [req-a47a0597-fc65-442b-a754-a86573205079 req-83e71df9-cf59-4fd8-8bf7-fff2982472de service nova] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] Updating instance_info_cache with network_info: [{"id": "1e547ec7-7efd-480f-84be-806c8cf25b90", "address": "fa:16:3e:34:08:47", "network": {"id": "18a91434-637b-4c19-a97b-736b32c1ea5a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1824162811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea2cb4dfa5b4a52b658efd8f5aefb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e547ec7-7e", "ovs_interfaceid": "1e547ec7-7efd-480f-84be-806c8cf25b90", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:01:04 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-a47a0597-fc65-442b-a754-a86573205079 req-83e71df9-cf59-4fd8-8bf7-fff2982472de service nova] Releasing lock "refresh_cache-3db2e71c-939b-4d2f-b1be-c2122f7cd73e" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 11:01:04 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquired lock "refresh_cache-3db2e71c-939b-4d2f-b1be-c2122f7cd73e" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 11:01:04 user nova-compute[71509]: DEBUG nova.network.neutron [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] Building network info cache for instance {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 11:01:05 user nova-compute[71509]: DEBUG nova.network.neutron [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] Updating instance_info_cache with network_info: [{"id": "1e547ec7-7efd-480f-84be-806c8cf25b90", "address": "fa:16:3e:34:08:47", "network": {"id": "18a91434-637b-4c19-a97b-736b32c1ea5a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1824162811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea2cb4dfa5b4a52b658efd8f5aefb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e547ec7-7e", "ovs_interfaceid": "1e547ec7-7efd-480f-84be-806c8cf25b90", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:01:05 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Releasing lock "refresh_cache-3db2e71c-939b-4d2f-b1be-c2122f7cd73e" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 11:01:05 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] Starting migrate_disk_and_power_off {{(pid=71509) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11460}}
Apr 14 11:01:05 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:01:05 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:01:05 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:01:06 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] Instance destroyed successfully.
Apr 14 11:01:06 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T10:59:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1613655632',display_name='tempest-ServerActionsTestJSON-server-1613655632',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1613655632',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNt/FyD1XXsxB5kJC+SJ1dgkjoXXHkL+KX0Cr5HvI72xTIz+DAtuVRPHeIpMNLt39mbbZ9KAoCJibRQza0Qbd8j8EEoV7QHombhWz2Mdusr+gJ2OYTqrrRzVbjIHACTFWw==',key_name='tempest-keypair-1544270235',keypairs=<?>,launch_index=0,launched_at=2023-04-14T10:59:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3ea2cb4dfa5b4a52b658efd8f5aefb36',ramdisk_id='',reservation_id='r-fwmcktqp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-1923052090',owner_user_name='tempest-ServerActionsTestJSON-1923052090-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T11:01:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5873a358bf544691b12cd2979f5e36dc',uuid=3db2e71c-939b-4d2f-b1be-c2122f7cd73e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1e547ec7-7efd-480f-84be-806c8cf25b90", "address": "fa:16:3e:34:08:47", "network": {"id": "18a91434-637b-4c19-a97b-736b32c1ea5a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1824162811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1824162811-network", "vif_mac": "fa:16:3e:34:08:47"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea2cb4dfa5b4a52b658efd8f5aefb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e547ec7-7e", "ovs_interfaceid": "1e547ec7-7efd-480f-84be-806c8cf25b90", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 11:01:06 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Converting VIF {"id": "1e547ec7-7efd-480f-84be-806c8cf25b90", "address": "fa:16:3e:34:08:47", "network": {"id": "18a91434-637b-4c19-a97b-736b32c1ea5a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1824162811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1824162811-network", "vif_mac": "fa:16:3e:34:08:47"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea2cb4dfa5b4a52b658efd8f5aefb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e547ec7-7e", "ovs_interfaceid": "1e547ec7-7efd-480f-84be-806c8cf25b90", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 11:01:06 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:34:08:47,bridge_name='br-int',has_traffic_filtering=True,id=1e547ec7-7efd-480f-84be-806c8cf25b90,network=Network(18a91434-637b-4c19-a97b-736b32c1ea5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e547ec7-7e') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 11:01:06 user nova-compute[71509]: DEBUG os_vif [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:34:08:47,bridge_name='br-int',has_traffic_filtering=True,id=1e547ec7-7efd-480f-84be-806c8cf25b90,network=Network(18a91434-637b-4c19-a97b-736b32c1ea5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e547ec7-7e') {{(pid=71509) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 11:01:06 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:01:06 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1e547ec7-7e, bridge=br-int, if_exists=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:01:06 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:01:06 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:01:06 user nova-compute[71509]: INFO os_vif [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:34:08:47,bridge_name='br-int',has_traffic_filtering=True,id=1e547ec7-7efd-480f-84be-806c8cf25b90,network=Network(18a91434-637b-4c19-a97b-736b32c1ea5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e547ec7-7e')
Apr 14 11:01:06 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] calling os-brick to detach iSCSI Volume {{(pid=71509) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 11:01:06 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0bf0749390>, {'target_iqn': 'iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vfPCIMcj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 11:01:06 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 11:01:06 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 11:01:06 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 11:01:06 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:01:06 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:01:06 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9ecc878-aa33-4496-998e-7890ed4f55e9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:01:06 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 11:01:06 user nova-compute[71509]: No targets found.
Apr 14 11:01:06 user nova-compute[71509]: iSNS:
Apr 14 11:01:06 user nova-compute[71509]: No targets found.
Apr 14 11:01:06 user nova-compute[71509]: STATIC:
Apr 14 11:01:06 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3
Apr 14 11:01:06 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 11:01:06 user nova-compute[71509]:                 Iface Name: default
Apr 14 11:01:06 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178
Apr 14 11:01:06 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 11:01:06 user nova-compute[71509]:                 Iface Name: default
Apr 14 11:01:06 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219
Apr 14 11:01:06 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 11:01:06 user nova-compute[71509]:                 Iface Name: default
Apr 14 11:01:06 user nova-compute[71509]: FIRMWARE:
Apr 14 11:01:06 user nova-compute[71509]: No targets found.
Apr 14 11:01:06 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 11:01:06 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 11:01:06 user nova-compute[71509]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 11:01:06 user nova-compute[71509]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71509) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 11:01:06 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3', 0)] {{(pid=71509) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 11:01:06 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:01:06 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.034s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:01:06 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e17ee25-7fd9-4967-aac6-4c11be0a8b94]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:01:06 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:01:06 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:01:06 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d507830-1d31-4683-9205-02f0274881b2]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3 (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:01:06 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)
Apr 14 11:01:06 user nova-compute[71509]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219 (non-flash)
Apr 14 11:01:06 user nova-compute[71509]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3 (non-flash)
Apr 14 11:01:06 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 11:01:06 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)
Apr 14 11:01:06 user nova-compute[71509]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219 (non-flash)
Apr 14 11:01:06 user nova-compute[71509]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3 (non-flash)
Apr 14 11:01:06 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 11:01:06 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0bf0447250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3'): ({'sdc'}, set())}) {{(pid=71509) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 11:01:06 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Removing single pathed devices sdc {{(pid=71509) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 11:01:06 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:01:06 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.029s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:01:06 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[914e88ea-0e8a-435c-9f16-0706cfe7b488]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:01:06 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:01:06 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.031s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:01:06 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[036930da-e671-4da9-a4e0-d8effbf4e1c5]: (4, ('ok\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:01:06 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Flushing IO for device /dev/sdc {{(pid=71509) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 11:01:06 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:01:06 user nova-compute[71509]: DEBUG nova.compute.manager [req-99324e49-f9cf-41ea-84d3-a83730e9ac9e req-c8321776-f8a9-4170-a0d2-9c454dc61264 service nova] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] Received event network-vif-unplugged-1e547ec7-7efd-480f-84be-806c8cf25b90 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:01:06 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-99324e49-f9cf-41ea-84d3-a83730e9ac9e req-c8321776-f8a9-4170-a0d2-9c454dc61264 service nova] Acquiring lock "3db2e71c-939b-4d2f-b1be-c2122f7cd73e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:01:06 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-99324e49-f9cf-41ea-84d3-a83730e9ac9e req-c8321776-f8a9-4170-a0d2-9c454dc61264 service nova] Lock "3db2e71c-939b-4d2f-b1be-c2122f7cd73e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:01:06 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-99324e49-f9cf-41ea-84d3-a83730e9ac9e req-c8321776-f8a9-4170-a0d2-9c454dc61264 service nova] Lock "3db2e71c-939b-4d2f-b1be-c2122f7cd73e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:01:06 user nova-compute[71509]: DEBUG nova.compute.manager [req-99324e49-f9cf-41ea-84d3-a83730e9ac9e req-c8321776-f8a9-4170-a0d2-9c454dc61264 service nova] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] No waiting events found dispatching network-vif-unplugged-1e547ec7-7efd-480f-84be-806c8cf25b90 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:01:06 user nova-compute[71509]: WARNING nova.compute.manager [req-99324e49-f9cf-41ea-84d3-a83730e9ac9e req-c8321776-f8a9-4170-a0d2-9c454dc61264 service nova] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] Received unexpected event network-vif-unplugged-1e547ec7-7efd-480f-84be-806c8cf25b90 for instance with vm_state active and task_state resize_migrating.
Apr 14 11:01:06 user nova-compute[71509]: DEBUG nova.compute.manager [req-99324e49-f9cf-41ea-84d3-a83730e9ac9e req-c8321776-f8a9-4170-a0d2-9c454dc61264 service nova] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] Received event network-vif-plugged-1e547ec7-7efd-480f-84be-806c8cf25b90 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:01:06 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-99324e49-f9cf-41ea-84d3-a83730e9ac9e req-c8321776-f8a9-4170-a0d2-9c454dc61264 service nova] Acquiring lock "3db2e71c-939b-4d2f-b1be-c2122f7cd73e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:01:06 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-99324e49-f9cf-41ea-84d3-a83730e9ac9e req-c8321776-f8a9-4170-a0d2-9c454dc61264 service nova] Lock "3db2e71c-939b-4d2f-b1be-c2122f7cd73e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:01:06 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-99324e49-f9cf-41ea-84d3-a83730e9ac9e req-c8321776-f8a9-4170-a0d2-9c454dc61264 service nova] Lock "3db2e71c-939b-4d2f-b1be-c2122f7cd73e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:01:06 user nova-compute[71509]: DEBUG nova.compute.manager [req-99324e49-f9cf-41ea-84d3-a83730e9ac9e req-c8321776-f8a9-4170-a0d2-9c454dc61264 service nova] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] No waiting events found dispatching network-vif-plugged-1e547ec7-7efd-480f-84be-806c8cf25b90 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:01:06 user nova-compute[71509]: WARNING nova.compute.manager [req-99324e49-f9cf-41ea-84d3-a83730e9ac9e req-c8321776-f8a9-4170-a0d2-9c454dc61264 service nova] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] Received unexpected event network-vif-plugged-1e547ec7-7efd-480f-84be-806c8cf25b90 for instance with vm_state active and task_state resize_migrating.
Apr 14 11:01:06 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:01:06 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[984278f5-6b3b-4cd7-9587-58ddc528db32]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:01:06 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71509) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 11:01:06 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:01:06 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:01:06 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6aa756c-fad0-4509-8fc5-b1aba1a3dfe2]: (4, ('1', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:01:06 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71509) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 11:01:06 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] SCSI volumes sdc have been removed. {{(pid=71509) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 11:01:06 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3')] {{(pid=71509) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 11:01:06 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:01:06 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:01:06 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf668fb3-c369-4a20-99d9-465b5cc5b3b4]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:01:06 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:01:06 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3 -p 172.16.0.220:3260 --logout {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:01:06 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:01:06 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[b48209da-a684-4f03-8623-0e296cd062cd]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:01:06 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3, portal: 172.16.0.220,3260]
Apr 14 11:01:06 user nova-compute[71509]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3, portal: 172.16.0.220,3260] successful.
Apr 14 11:01:06 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:01:06 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3 -p 172.16.0.220:3260 --op delete {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:01:06 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:01:06 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[784fd4d0-012d-4b43-89a9-d41508366229]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:01:06 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:01:06 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.381s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 11:01:06 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] <== disconnect_volume: return (382ms) None {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 11:01:06 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] Disconnected iSCSI Volume {{(pid=71509) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 11:01:06 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71509) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 11:01:07 user nova-compute[71509]: DEBUG nova.network.neutron [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] Port 1e547ec7-7efd-480f-84be-806c8cf25b90 binding to destination host user is already ACTIVE {{(pid=71509) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3161}}
Apr 14 11:01:07 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "3db2e71c-939b-4d2f-b1be-c2122f7cd73e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:01:07 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "3db2e71c-939b-4d2f-b1be-c2122f7cd73e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.005s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:01:07 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "3db2e71c-939b-4d2f-b1be-c2122f7cd73e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:01:07 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "refresh_cache-3db2e71c-939b-4d2f-b1be-c2122f7cd73e" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 11:01:07 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquired lock "refresh_cache-3db2e71c-939b-4d2f-b1be-c2122f7cd73e" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 11:01:07 user nova-compute[71509]: DEBUG nova.network.neutron [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] Building network info cache for instance {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 11:01:08 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:01:08 user nova-compute[71509]: DEBUG nova.network.neutron [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] Updating instance_info_cache with network_info: [{"id": "1e547ec7-7efd-480f-84be-806c8cf25b90", "address": "fa:16:3e:34:08:47", "network": {"id": "18a91434-637b-4c19-a97b-736b32c1ea5a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1824162811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea2cb4dfa5b4a52b658efd8f5aefb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e547ec7-7e", "ovs_interfaceid": "1e547ec7-7efd-480f-84be-806c8cf25b90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:01:08 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Releasing lock "refresh_cache-3db2e71c-939b-4d2f-b1be-c2122f7cd73e" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 11:01:08 user nova-compute[71509]: DEBUG os_brick.utils [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 11:01:08 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:01:08 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:01:08 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3d6c71f-0cd8-466c-ae49-c95a97796da9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50119df3c417\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:01:08 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:01:08 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:01:08 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[f644fc11-2cfc-43b5-832d-0d6fa6b7e7ce]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:01:08 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:01:08 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:01:08 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c664428-40de-4fd2-8783-4147a3cb9f61]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:01:08 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[62919ff3-57ac-4ab9-a48e-d328fdf87758]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:01:08 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Running cmd (subprocess): nvme version {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:01:08 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] 'nvme version' failed. Not Retrying. {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 11:01:08 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] nvme not present on system {{(pid=71509) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 11:01:08 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:01:08 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 11:01:08 user nova-compute[71509]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 11:01:08 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e493329-21f0-4958-9dc7-56db79d1fd53]: (4, '') {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:01:08 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71509) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 11:01:08 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71509) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 11:01:08 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] LIGHTOS: no hostnqn found. {{(pid=71509) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 11:01:08 user nova-compute[71509]: DEBUG os_brick.utils [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50119df3c417', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 11:01:11 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:01:13 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] Starting finish_migration {{(pid=71509) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11647}}
Apr 14 11:01:13 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] Instance directory exists: not creating {{(pid=71509) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4694}}
Apr 14 11:01:13 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] Creating image(s)
Apr 14 11:01:13 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] Did not create local disks {{(pid=71509) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 11:01:13 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] Ensure instance console log exists: /opt/stack/data/nova/instances/3db2e71c-939b-4d2f-b1be-c2122f7cd73e/console.log {{(pid=71509) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 11:01:13 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:01:13 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:01:13 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:01:13 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] Start _get_guest_xml network_info=[{"id": "1e547ec7-7efd-480f-84be-806c8cf25b90", "address": "fa:16:3e:34:08:47", "network": {"id": "18a91434-637b-4c19-a97b-736b32c1ea5a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1824162811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1824162811-network", "vif_mac": "fa:16:3e:34:08:47"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea2cb4dfa5b4a52b658efd8f5aefb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e547ec7-7e", "ovs_interfaceid": "1e547ec7-7efd-480f-84be-806c8cf25b90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'attachment_id': 'af14a64d-f096-45fc-8bb0-b7a48d3cb7c5', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vfPCIMcj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '3db2e71c-939b-4d2f-b1be-c2122f7cd73e', 'attached_at': '2023-04-14T11:01:13.000000', 'detached_at': '', 'volume_id': '64198cbd-5b4a-4ca5-bb06-b6553335edb3', 'serial': '64198cbd-5b4a-4ca5-bb06-b6553335edb3'}, 'disk_bus': 'virtio', 'delete_on_termination': True, 'volume_type': None} {{(pid=71509) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 11:01:13 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 11:01:13 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 11:01:13 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71509) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 11:01:13 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T10:40:06Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=192,name='m1.micro',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 11:01:13 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Flavor limits 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 11:01:13 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Image limits 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 11:01:13 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Flavor pref 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 11:01:13 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Image pref 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 11:01:13 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 11:01:13 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 11:01:13 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71509) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 11:01:13 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Got 1 possible topologies {{(pid=71509) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 11:01:13 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 11:01:13 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 11:01:13 user nova-compute[71509]: DEBUG nova.objects.instance [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3db2e71c-939b-4d2f-b1be-c2122f7cd73e {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 11:01:13 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] Calling os-brick to attach iSCSI Volume {{(pid=71509) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 11:01:13 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0bf0749390>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vfPCIMcj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 11:01:13 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 11:01:13 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 11:01:13 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 11:01:13 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 11:01:13 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 11:01:13 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 11:01:13 user nova-compute[71509]: INFO os_brick.initiator.connectors.iscsi [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 11:01:13 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:01:13 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3 -p 172.16.0.220:3260 {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:01:13 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:01:13 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2e9e7c9-ecc9-421e-a6ae-76f65a6d955a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:01:13 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 11:01:13 user nova-compute[71509]:  {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:01:13 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3 -p 172.16.0.220:3260 --interface default --op new {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:01:13 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:01:13 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[39d72bc5-7d0a-4753-95b5-5f41d5a46a1a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3] added\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:01:13 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3] added
Apr 14 11:01:13 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:01:13 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:01:13 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.128s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:01:13 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[c64f1c14-f21c-4aa3-86e0-ce546d3d98e4]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:01:13 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:01:13 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:01:13 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:01:13 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[69153e66-df10-4758-81e8-9a0e12e8b2bc]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:01:13 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:01:13 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vfPCIMcj {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:01:13 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vfPCIMcj" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:01:13 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[50fd64a7-aa54-46a1-bfae-bfa869c501e4]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:01:13 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vfPCIMcj'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:01:13 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:01:13 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:01:13 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[7225e5e5-bf36-4de3-8525-fccc83507f9a]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:01:13 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:01:13 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:01:13 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:01:13 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[9505acfb-a7a3-4b05-b2b9-1a7f20f76107]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219 (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:01:13 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)
Apr 14 11:01:13 user nova-compute[71509]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219 (non-flash)
Apr 14 11:01:13 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 11:01:13 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)
Apr 14 11:01:13 user nova-compute[71509]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219 (non-flash)
Apr 14 11:01:13 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 11:01:13 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3 -p 172.16.0.220:3260 --login {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:01:13 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:01:13 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[7466f70f-e85d-4eea-b9d4-da0bd88e0176]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:01:13 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3, portal: 172.16.0.220,3260]
Apr 14 11:01:13 user nova-compute[71509]: Login to [iface: default, target: iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3, portal: 172.16.0.220,3260] successful.
Apr 14 11:01:13 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:01:13 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:01:13 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:01:13 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[01c66810-1594-401b-bec4-585ebacabeb7]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:01:13 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:01:13 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:01:13 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:01:13 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfaa8094-8256-46f3-9ee1-f9464debe935]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3 (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:01:13 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)
Apr 14 11:01:13 user nova-compute[71509]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219 (non-flash)
Apr 14 11:01:13 user nova-compute[71509]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3 (non-flash)
Apr 14 11:01:13 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 11:01:13 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)
Apr 14 11:01:13 user nova-compute[71509]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219 (non-flash)
Apr 14 11:01:13 user nova-compute[71509]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3 (non-flash)
Apr 14 11:01:13 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 11:01:13 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.407s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 11:01:13 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Connected to 172.16.0.220:3260 {{(pid=71509) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 11:01:13 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] HCTL ('34', '-', '-', 0) found on session 43 with lun 0 {{(pid=71509) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 11:01:13 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71509) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 11:01:13 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:01:13 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:01:13 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d6b5279-063f-42bd-8a5b-43731de6cf4b]: (4, ('- - 0', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:01:13 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Searching for a device in session 43 and hctl ['34', '*', '*', 0] yield: None {{(pid=71509) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 11:01:14 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Searching for a device in session 43 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71509) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 11:01:14 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vfPCIMcj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71509) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 11:01:14 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.437s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 11:01:14 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] <== connect_volume: return (1439ms) {'type': 'block', 'scsi_wwn': '26664386137333064', 'path': '/dev/sdc'} {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 11:01:14 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26664386137333064', 'path': '/dev/sdc'} {{(pid=71509) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 11:01:14 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T10:59:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1613655632',display_name='tempest-ServerActionsTestJSON-server-1613655632',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1613655632',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNt/FyD1XXsxB5kJC+SJ1dgkjoXXHkL+KX0Cr5HvI72xTIz+DAtuVRPHeIpMNLt39mbbZ9KAoCJibRQza0Qbd8j8EEoV7QHombhWz2Mdusr+gJ2OYTqrrRzVbjIHACTFWw==',key_name='tempest-keypair-1544270235',keypairs=<?>,launch_index=0,launched_at=2023-04-14T10:59:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3ea2cb4dfa5b4a52b658efd8f5aefb36',ramdisk_id='',reservation_id='r-fwmcktqp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-1923052090',owner_user_name='tempest-ServerActionsTestJSON-1923052090-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T11:01:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5873a358bf544691b12cd2979f5e36dc',uuid=3db2e71c-939b-4d2f-b1be-c2122f7cd73e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1e547ec7-7efd-480f-84be-806c8cf25b90", "address": "fa:16:3e:34:08:47", "network": {"id": "18a91434-637b-4c19-a97b-736b32c1ea5a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1824162811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1824162811-network", "vif_mac": "fa:16:3e:34:08:47"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea2cb4dfa5b4a52b658efd8f5aefb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e547ec7-7e", "ovs_interfaceid": "1e547ec7-7efd-480f-84be-806c8cf25b90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71509) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 11:01:14 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Converting VIF {"id": "1e547ec7-7efd-480f-84be-806c8cf25b90", "address": "fa:16:3e:34:08:47", "network": {"id": "18a91434-637b-4c19-a97b-736b32c1ea5a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1824162811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1824162811-network", "vif_mac": "fa:16:3e:34:08:47"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea2cb4dfa5b4a52b658efd8f5aefb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e547ec7-7e", "ovs_interfaceid": "1e547ec7-7efd-480f-84be-806c8cf25b90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 11:01:14 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:08:47,bridge_name='br-int',has_traffic_filtering=True,id=1e547ec7-7efd-480f-84be-806c8cf25b90,network=Network(18a91434-637b-4c19-a97b-736b32c1ea5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e547ec7-7e') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 11:01:14 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] End _get_guest_xml xml=<domain type="kvm">
Apr 14 11:01:14 user nova-compute[71509]:   <uuid>3db2e71c-939b-4d2f-b1be-c2122f7cd73e</uuid>
Apr 14 11:01:14 user nova-compute[71509]:   <name>instance-00000023</name>
Apr 14 11:01:14 user nova-compute[71509]:   <memory>196608</memory>
Apr 14 11:01:14 user nova-compute[71509]:   <vcpu>1</vcpu>
Apr 14 11:01:14 user nova-compute[71509]:   <metadata>
Apr 14 11:01:14 user nova-compute[71509]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 11:01:14 user nova-compute[71509]:       <nova:package version="0.0.0"/>
Apr 14 11:01:14 user nova-compute[71509]:       <nova:name>tempest-ServerActionsTestJSON-server-1613655632</nova:name>
Apr 14 11:01:14 user nova-compute[71509]:       <nova:creationTime>2023-04-14 11:01:13</nova:creationTime>
Apr 14 11:01:14 user nova-compute[71509]:       <nova:flavor name="m1.micro">
Apr 14 11:01:14 user nova-compute[71509]:         <nova:memory>192</nova:memory>
Apr 14 11:01:14 user nova-compute[71509]:         <nova:disk>1</nova:disk>
Apr 14 11:01:14 user nova-compute[71509]:         <nova:swap>0</nova:swap>
Apr 14 11:01:14 user nova-compute[71509]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 11:01:14 user nova-compute[71509]:         <nova:vcpus>1</nova:vcpus>
Apr 14 11:01:14 user nova-compute[71509]:       </nova:flavor>
Apr 14 11:01:14 user nova-compute[71509]:       <nova:owner>
Apr 14 11:01:14 user nova-compute[71509]:         <nova:user uuid="5873a358bf544691b12cd2979f5e36dc">tempest-ServerActionsTestJSON-1923052090-project-member</nova:user>
Apr 14 11:01:14 user nova-compute[71509]:         <nova:project uuid="3ea2cb4dfa5b4a52b658efd8f5aefb36">tempest-ServerActionsTestJSON-1923052090</nova:project>
Apr 14 11:01:14 user nova-compute[71509]:       </nova:owner>
Apr 14 11:01:14 user nova-compute[71509]:       <nova:ports>
Apr 14 11:01:14 user nova-compute[71509]:         <nova:port uuid="1e547ec7-7efd-480f-84be-806c8cf25b90">
Apr 14 11:01:14 user nova-compute[71509]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 14 11:01:14 user nova-compute[71509]:         </nova:port>
Apr 14 11:01:14 user nova-compute[71509]:       </nova:ports>
Apr 14 11:01:14 user nova-compute[71509]:     </nova:instance>
Apr 14 11:01:14 user nova-compute[71509]:   </metadata>
Apr 14 11:01:14 user nova-compute[71509]:   <sysinfo type="smbios">
Apr 14 11:01:14 user nova-compute[71509]:     <system>
Apr 14 11:01:14 user nova-compute[71509]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 11:01:14 user nova-compute[71509]:       <entry name="product">OpenStack Nova</entry>
Apr 14 11:01:14 user nova-compute[71509]:       <entry name="version">0.0.0</entry>
Apr 14 11:01:14 user nova-compute[71509]:       <entry name="serial">3db2e71c-939b-4d2f-b1be-c2122f7cd73e</entry>
Apr 14 11:01:14 user nova-compute[71509]:       <entry name="uuid">3db2e71c-939b-4d2f-b1be-c2122f7cd73e</entry>
Apr 14 11:01:14 user nova-compute[71509]:       <entry name="family">Virtual Machine</entry>
Apr 14 11:01:14 user nova-compute[71509]:     </system>
Apr 14 11:01:14 user nova-compute[71509]:   </sysinfo>
Apr 14 11:01:14 user nova-compute[71509]:   <os>
Apr 14 11:01:14 user nova-compute[71509]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 11:01:14 user nova-compute[71509]:     <boot dev="hd"/>
Apr 14 11:01:14 user nova-compute[71509]:     <smbios mode="sysinfo"/>
Apr 14 11:01:14 user nova-compute[71509]:   </os>
Apr 14 11:01:14 user nova-compute[71509]:   <features>
Apr 14 11:01:14 user nova-compute[71509]:     <acpi/>
Apr 14 11:01:14 user nova-compute[71509]:     <apic/>
Apr 14 11:01:14 user nova-compute[71509]:     <vmcoreinfo/>
Apr 14 11:01:14 user nova-compute[71509]:   </features>
Apr 14 11:01:14 user nova-compute[71509]:   <clock offset="utc">
Apr 14 11:01:14 user nova-compute[71509]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 11:01:14 user nova-compute[71509]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 11:01:14 user nova-compute[71509]:     <timer name="hpet" present="no"/>
Apr 14 11:01:14 user nova-compute[71509]:   </clock>
Apr 14 11:01:14 user nova-compute[71509]:   <cpu mode="custom" match="exact">
Apr 14 11:01:14 user nova-compute[71509]:     <model>Nehalem</model>
Apr 14 11:01:14 user nova-compute[71509]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 11:01:14 user nova-compute[71509]:   </cpu>
Apr 14 11:01:14 user nova-compute[71509]:   <devices>
Apr 14 11:01:14 user nova-compute[71509]:     <disk type="block" device="disk">
Apr 14 11:01:14 user nova-compute[71509]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 11:01:14 user nova-compute[71509]:       <source dev="/dev/sdc"/>
Apr 14 11:01:14 user nova-compute[71509]:       <target dev="vda" bus="virtio"/>
Apr 14 11:01:14 user nova-compute[71509]:       <serial>64198cbd-5b4a-4ca5-bb06-b6553335edb3</serial>
Apr 14 11:01:14 user nova-compute[71509]:     </disk>
Apr 14 11:01:14 user nova-compute[71509]:     <interface type="ethernet">
Apr 14 11:01:14 user nova-compute[71509]:       <mac address="fa:16:3e:34:08:47"/>
Apr 14 11:01:14 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 11:01:14 user nova-compute[71509]:       <mtu size="1442"/>
Apr 14 11:01:14 user nova-compute[71509]:       <target dev="tap1e547ec7-7e"/>
Apr 14 11:01:14 user nova-compute[71509]:     </interface>
Apr 14 11:01:14 user nova-compute[71509]:     <serial type="pty">
Apr 14 11:01:14 user nova-compute[71509]:       <log file="/opt/stack/data/nova/instances/3db2e71c-939b-4d2f-b1be-c2122f7cd73e/console.log" append="off"/>
Apr 14 11:01:14 user nova-compute[71509]:     </serial>
Apr 14 11:01:14 user nova-compute[71509]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 11:01:14 user nova-compute[71509]:     <video>
Apr 14 11:01:14 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 11:01:14 user nova-compute[71509]:     </video>
Apr 14 11:01:14 user nova-compute[71509]:     <rng model="virtio">
Apr 14 11:01:14 user nova-compute[71509]:       <backend model="random">/dev/urandom</backend>
Apr 14 11:01:14 user nova-compute[71509]:     </rng>
Apr 14 11:01:14 user nova-compute[71509]:     <controller type="usb" index="0" model="none"/>
Apr 14 11:01:14 user nova-compute[71509]:     <memballoon model="virtio">
Apr 14 11:01:14 user nova-compute[71509]:       <stats period="10"/>
Apr 14 11:01:14 user nova-compute[71509]:     </memballoon>
Apr 14 11:01:14 user nova-compute[71509]:   </devices>
Apr 14 11:01:14 user nova-compute[71509]: </domain>
Apr 14 11:01:14 user nova-compute[71509]:  {{(pid=71509) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 11:01:14 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T10:59:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1613655632',display_name='tempest-ServerActionsTestJSON-server-1613655632',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1613655632',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNt/FyD1XXsxB5kJC+SJ1dgkjoXXHkL+KX0Cr5HvI72xTIz+DAtuVRPHeIpMNLt39mbbZ9KAoCJibRQza0Qbd8j8EEoV7QHombhWz2Mdusr+gJ2OYTqrrRzVbjIHACTFWw==',key_name='tempest-keypair-1544270235',keypairs=<?>,launch_index=0,launched_at=2023-04-14T10:59:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='user',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3ea2cb4dfa5b4a52b658efd8f5aefb36',ramdisk_id='',reservation_id='r-fwmcktqp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestJSON-1923052090',owner_user_name='tempest-ServerActionsTestJSON-1923052090-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T11:01:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5873a358bf544691b12cd2979f5e36dc',uuid=3db2e71c-939b-4d2f-b1be-c2122f7cd73e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1e547ec7-7efd-480f-84be-806c8cf25b90", "address": "fa:16:3e:34:08:47", "network": {"id": "18a91434-637b-4c19-a97b-736b32c1ea5a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1824162811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1824162811-network", "vif_mac": "fa:16:3e:34:08:47"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea2cb4dfa5b4a52b658efd8f5aefb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e547ec7-7e", "ovs_interfaceid": "1e547ec7-7efd-480f-84be-806c8cf25b90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 11:01:14 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Converting VIF {"id": "1e547ec7-7efd-480f-84be-806c8cf25b90", "address": "fa:16:3e:34:08:47", "network": {"id": "18a91434-637b-4c19-a97b-736b32c1ea5a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1824162811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestJSON-1824162811-network", "vif_mac": "fa:16:3e:34:08:47"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea2cb4dfa5b4a52b658efd8f5aefb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e547ec7-7e", "ovs_interfaceid": "1e547ec7-7efd-480f-84be-806c8cf25b90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 11:01:14 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:08:47,bridge_name='br-int',has_traffic_filtering=True,id=1e547ec7-7efd-480f-84be-806c8cf25b90,network=Network(18a91434-637b-4c19-a97b-736b32c1ea5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e547ec7-7e') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 11:01:14 user nova-compute[71509]: DEBUG os_vif [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:08:47,bridge_name='br-int',has_traffic_filtering=True,id=1e547ec7-7efd-480f-84be-806c8cf25b90,network=Network(18a91434-637b-4c19-a97b-736b32c1ea5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e547ec7-7e') {{(pid=71509) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 11:01:14 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:01:14 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:01:14 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 11:01:14 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:01:14 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1e547ec7-7e, may_exist=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:01:14 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1e547ec7-7e, col_values=(('external_ids', {'iface-id': '1e547ec7-7efd-480f-84be-806c8cf25b90', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:34:08:47', 'vm-uuid': '3db2e71c-939b-4d2f-b1be-c2122f7cd73e'}),)) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:01:14 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:01:14 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:01:14 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:01:14 user nova-compute[71509]: INFO os_vif [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:08:47,bridge_name='br-int',has_traffic_filtering=True,id=1e547ec7-7efd-480f-84be-806c8cf25b90,network=Network(18a91434-637b-4c19-a97b-736b32c1ea5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e547ec7-7e')
Apr 14 11:01:14 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] No BDM found with device name vda, not building metadata. {{(pid=71509) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 11:01:14 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] No VIF found with MAC fa:16:3e:34:08:47, not building metadata {{(pid=71509) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 11:01:16 user nova-compute[71509]: DEBUG nova.compute.manager [req-aa2b0b20-a6a5-43b8-95b7-f23f7c19bc46 req-3e04d5c3-0ec7-45bd-8d5f-52b8225d7f49 service nova] [instance: 3d6a53c3-6e32-456c-a056-fbf1bef3b656] Received event network-changed-c18cf2ba-f230-4684-a95c-14af689d7981 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:01:16 user nova-compute[71509]: DEBUG nova.compute.manager [req-aa2b0b20-a6a5-43b8-95b7-f23f7c19bc46 req-3e04d5c3-0ec7-45bd-8d5f-52b8225d7f49 service nova] [instance: 3d6a53c3-6e32-456c-a056-fbf1bef3b656] Refreshing instance network info cache due to event network-changed-c18cf2ba-f230-4684-a95c-14af689d7981. {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 11:01:16 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-aa2b0b20-a6a5-43b8-95b7-f23f7c19bc46 req-3e04d5c3-0ec7-45bd-8d5f-52b8225d7f49 service nova] Acquiring lock "refresh_cache-3d6a53c3-6e32-456c-a056-fbf1bef3b656" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 11:01:16 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-aa2b0b20-a6a5-43b8-95b7-f23f7c19bc46 req-3e04d5c3-0ec7-45bd-8d5f-52b8225d7f49 service nova] Acquired lock "refresh_cache-3d6a53c3-6e32-456c-a056-fbf1bef3b656" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 11:01:16 user nova-compute[71509]: DEBUG nova.network.neutron [req-aa2b0b20-a6a5-43b8-95b7-f23f7c19bc46 req-3e04d5c3-0ec7-45bd-8d5f-52b8225d7f49 service nova] [instance: 3d6a53c3-6e32-456c-a056-fbf1bef3b656] Refreshing network info cache for port c18cf2ba-f230-4684-a95c-14af689d7981 {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 11:01:16 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-67e01efc-ca14-44c8-a0f6-ad857af16a7c tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Acquiring lock "3d6a53c3-6e32-456c-a056-fbf1bef3b656" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:01:16 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-67e01efc-ca14-44c8-a0f6-ad857af16a7c tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "3d6a53c3-6e32-456c-a056-fbf1bef3b656" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:01:16 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-67e01efc-ca14-44c8-a0f6-ad857af16a7c tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Acquiring lock "3d6a53c3-6e32-456c-a056-fbf1bef3b656-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:01:16 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-67e01efc-ca14-44c8-a0f6-ad857af16a7c tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "3d6a53c3-6e32-456c-a056-fbf1bef3b656-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:01:16 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-67e01efc-ca14-44c8-a0f6-ad857af16a7c tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "3d6a53c3-6e32-456c-a056-fbf1bef3b656-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:01:16 user nova-compute[71509]: INFO nova.compute.manager [None req-67e01efc-ca14-44c8-a0f6-ad857af16a7c tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] [instance: 3d6a53c3-6e32-456c-a056-fbf1bef3b656] Terminating instance
Apr 14 11:01:16 user nova-compute[71509]: DEBUG nova.compute.manager [None req-67e01efc-ca14-44c8-a0f6-ad857af16a7c tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] [instance: 3d6a53c3-6e32-456c-a056-fbf1bef3b656] Start destroying the instance on the hypervisor. {{(pid=71509) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 11:01:16 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:01:16 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:01:16 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:01:16 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:01:16 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:01:16 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:01:16 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:01:16 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:01:16 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:01:16 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:01:16 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:01:16 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: 3d6a53c3-6e32-456c-a056-fbf1bef3b656] Instance destroyed successfully.
Apr 14 11:01:16 user nova-compute[71509]: DEBUG nova.objects.instance [None req-67e01efc-ca14-44c8-a0f6-ad857af16a7c tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lazy-loading 'resources' on Instance uuid 3d6a53c3-6e32-456c-a056-fbf1bef3b656 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 11:01:16 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:01:17 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-67e01efc-ca14-44c8-a0f6-ad857af16a7c tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T10:58:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-809706283',display_name='tempest-TestStampPattern-server-809706283',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-809706283',id=33,image_ref='b87baa1b-a18b-4e25-8812-8e4876470ade',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHGJbZqWmfze/VbD7AiTXpBSSC7JeSqxVieDSB69GsDRbeWrzeiKDuD8IXa8m1YPGpwzOjCM3hxDW4Au2iAbXYcYId85Kh55qCn9eiY+V5K3AjDmmJpdlP7IQxGR6pVCIA==',key_name='tempest-TestStampPattern-627373922',keypairs=<?>,launch_index=0,launched_at=2023-04-14T10:58:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f629ba0ab8074ed8bb4e59d545b74eb6',ramdisk_id='',reservation_id='r-v0vov0ja',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='e6580716-8a6a-4dfa-8978-ed54b92af1fe',image_min_disk='1',image_min_ram='0',image_owner_id='f629ba0ab8074ed8bb4e59d545b74eb6',image_owner_project_name='tempest-TestStampPattern-1000870021',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1000870021-project-member',image_user_id='e3ad6531a67b4be58a195e1208157b0b',owner_project_name='tempest-TestStampPattern-1000870021',owner_user_name='tempest-TestStampPattern-1000870021-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T10:58:32Z,user_data=None,user_id='e3ad6531a67b4be58a195e1208157b0b',uuid=3d6a53c3-6e32-456c-a056-fbf1bef3b656,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c18cf2ba-f230-4684-a95c-14af689d7981", "address": "fa:16:3e:ad:2f:9a", "network": {"id": "1fdeb048-706a-45bf-8f2a-2cee21abb9ea", "bridge": "br-int", "label": "tempest-TestStampPattern-1337046138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f629ba0ab8074ed8bb4e59d545b74eb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc18cf2ba-f2", "ovs_interfaceid": "c18cf2ba-f230-4684-a95c-14af689d7981", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 11:01:17 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-67e01efc-ca14-44c8-a0f6-ad857af16a7c tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Converting VIF {"id": "c18cf2ba-f230-4684-a95c-14af689d7981", "address": "fa:16:3e:ad:2f:9a", "network": {"id": "1fdeb048-706a-45bf-8f2a-2cee21abb9ea", "bridge": "br-int", "label": "tempest-TestStampPattern-1337046138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f629ba0ab8074ed8bb4e59d545b74eb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc18cf2ba-f2", "ovs_interfaceid": "c18cf2ba-f230-4684-a95c-14af689d7981", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 11:01:17 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-67e01efc-ca14-44c8-a0f6-ad857af16a7c tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ad:2f:9a,bridge_name='br-int',has_traffic_filtering=True,id=c18cf2ba-f230-4684-a95c-14af689d7981,network=Network(1fdeb048-706a-45bf-8f2a-2cee21abb9ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc18cf2ba-f2') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 11:01:17 user nova-compute[71509]: DEBUG os_vif [None req-67e01efc-ca14-44c8-a0f6-ad857af16a7c tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ad:2f:9a,bridge_name='br-int',has_traffic_filtering=True,id=c18cf2ba-f230-4684-a95c-14af689d7981,network=Network(1fdeb048-706a-45bf-8f2a-2cee21abb9ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc18cf2ba-f2') {{(pid=71509) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 11:01:17 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:01:17 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc18cf2ba-f2, bridge=br-int, if_exists=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:01:17 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:01:17 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:01:17 user nova-compute[71509]: INFO os_vif [None req-67e01efc-ca14-44c8-a0f6-ad857af16a7c tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ad:2f:9a,bridge_name='br-int',has_traffic_filtering=True,id=c18cf2ba-f230-4684-a95c-14af689d7981,network=Network(1fdeb048-706a-45bf-8f2a-2cee21abb9ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc18cf2ba-f2')
Apr 14 11:01:17 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-67e01efc-ca14-44c8-a0f6-ad857af16a7c tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] [instance: 3d6a53c3-6e32-456c-a056-fbf1bef3b656] Deleting instance files /opt/stack/data/nova/instances/3d6a53c3-6e32-456c-a056-fbf1bef3b656_del
Apr 14 11:01:17 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-67e01efc-ca14-44c8-a0f6-ad857af16a7c tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] [instance: 3d6a53c3-6e32-456c-a056-fbf1bef3b656] Deletion of /opt/stack/data/nova/instances/3d6a53c3-6e32-456c-a056-fbf1bef3b656_del complete
Apr 14 11:01:17 user nova-compute[71509]: INFO nova.compute.manager [None req-67e01efc-ca14-44c8-a0f6-ad857af16a7c tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] [instance: 3d6a53c3-6e32-456c-a056-fbf1bef3b656] Took 0.95 seconds to destroy the instance on the hypervisor.
Apr 14 11:01:17 user nova-compute[71509]: DEBUG oslo.service.loopingcall [None req-67e01efc-ca14-44c8-a0f6-ad857af16a7c tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71509) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 11:01:17 user nova-compute[71509]: DEBUG nova.compute.manager [-] [instance: 3d6a53c3-6e32-456c-a056-fbf1bef3b656] Deallocating network for instance {{(pid=71509) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 11:01:17 user nova-compute[71509]: DEBUG nova.network.neutron [-] [instance: 3d6a53c3-6e32-456c-a056-fbf1bef3b656] deallocate_for_instance() {{(pid=71509) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 11:01:17 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:01:17 user nova-compute[71509]: DEBUG nova.compute.manager [req-59ada0cc-1e47-4969-9b12-370b82081312 req-f7e9557d-1afc-457c-a1fc-673cdfd6047c service nova] [instance: 3d6a53c3-6e32-456c-a056-fbf1bef3b656] Received event network-vif-unplugged-c18cf2ba-f230-4684-a95c-14af689d7981 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:01:17 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-59ada0cc-1e47-4969-9b12-370b82081312 req-f7e9557d-1afc-457c-a1fc-673cdfd6047c service nova] Acquiring lock "3d6a53c3-6e32-456c-a056-fbf1bef3b656-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:01:17 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-59ada0cc-1e47-4969-9b12-370b82081312 req-f7e9557d-1afc-457c-a1fc-673cdfd6047c service nova] Lock "3d6a53c3-6e32-456c-a056-fbf1bef3b656-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:01:17 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-59ada0cc-1e47-4969-9b12-370b82081312 req-f7e9557d-1afc-457c-a1fc-673cdfd6047c service nova] Lock "3d6a53c3-6e32-456c-a056-fbf1bef3b656-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:01:17 user nova-compute[71509]: DEBUG nova.compute.manager [req-59ada0cc-1e47-4969-9b12-370b82081312 req-f7e9557d-1afc-457c-a1fc-673cdfd6047c service nova] [instance: 3d6a53c3-6e32-456c-a056-fbf1bef3b656] No waiting events found dispatching network-vif-unplugged-c18cf2ba-f230-4684-a95c-14af689d7981 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:01:17 user nova-compute[71509]: DEBUG nova.compute.manager [req-59ada0cc-1e47-4969-9b12-370b82081312 req-f7e9557d-1afc-457c-a1fc-673cdfd6047c service nova] [instance: 3d6a53c3-6e32-456c-a056-fbf1bef3b656] Received event network-vif-unplugged-c18cf2ba-f230-4684-a95c-14af689d7981 for instance with task_state deleting. {{(pid=71509) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 11:01:17 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:01:17 user nova-compute[71509]: DEBUG nova.network.neutron [req-aa2b0b20-a6a5-43b8-95b7-f23f7c19bc46 req-3e04d5c3-0ec7-45bd-8d5f-52b8225d7f49 service nova] [instance: 3d6a53c3-6e32-456c-a056-fbf1bef3b656] Updated VIF entry in instance network info cache for port c18cf2ba-f230-4684-a95c-14af689d7981. {{(pid=71509) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 11:01:17 user nova-compute[71509]: DEBUG nova.network.neutron [req-aa2b0b20-a6a5-43b8-95b7-f23f7c19bc46 req-3e04d5c3-0ec7-45bd-8d5f-52b8225d7f49 service nova] [instance: 3d6a53c3-6e32-456c-a056-fbf1bef3b656] Updating instance_info_cache with network_info: [{"id": "c18cf2ba-f230-4684-a95c-14af689d7981", "address": "fa:16:3e:ad:2f:9a", "network": {"id": "1fdeb048-706a-45bf-8f2a-2cee21abb9ea", "bridge": "br-int", "label": "tempest-TestStampPattern-1337046138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f629ba0ab8074ed8bb4e59d545b74eb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc18cf2ba-f2", "ovs_interfaceid": "c18cf2ba-f230-4684-a95c-14af689d7981", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:01:17 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-aa2b0b20-a6a5-43b8-95b7-f23f7c19bc46 req-3e04d5c3-0ec7-45bd-8d5f-52b8225d7f49 service nova] Releasing lock "refresh_cache-3d6a53c3-6e32-456c-a056-fbf1bef3b656" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 11:01:18 user nova-compute[71509]: DEBUG nova.compute.manager [req-cdefa3ea-81ce-4de4-a68f-761ff6403985 req-ccb2b12b-409c-42a8-bc22-ba1a516bc263 service nova] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] Received event network-vif-plugged-1e547ec7-7efd-480f-84be-806c8cf25b90 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:01:18 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-cdefa3ea-81ce-4de4-a68f-761ff6403985 req-ccb2b12b-409c-42a8-bc22-ba1a516bc263 service nova] Acquiring lock "3db2e71c-939b-4d2f-b1be-c2122f7cd73e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:01:18 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-cdefa3ea-81ce-4de4-a68f-761ff6403985 req-ccb2b12b-409c-42a8-bc22-ba1a516bc263 service nova] Lock "3db2e71c-939b-4d2f-b1be-c2122f7cd73e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:01:18 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-cdefa3ea-81ce-4de4-a68f-761ff6403985 req-ccb2b12b-409c-42a8-bc22-ba1a516bc263 service nova] Lock "3db2e71c-939b-4d2f-b1be-c2122f7cd73e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:01:18 user nova-compute[71509]: DEBUG nova.compute.manager [req-cdefa3ea-81ce-4de4-a68f-761ff6403985 req-ccb2b12b-409c-42a8-bc22-ba1a516bc263 service nova] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] No waiting events found dispatching network-vif-plugged-1e547ec7-7efd-480f-84be-806c8cf25b90 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:01:18 user nova-compute[71509]: WARNING nova.compute.manager [req-cdefa3ea-81ce-4de4-a68f-761ff6403985 req-ccb2b12b-409c-42a8-bc22-ba1a516bc263 service nova] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] Received unexpected event network-vif-plugged-1e547ec7-7efd-480f-84be-806c8cf25b90 for instance with vm_state active and task_state resize_finish.
Apr 14 11:01:18 user nova-compute[71509]: DEBUG nova.compute.manager [req-cdefa3ea-81ce-4de4-a68f-761ff6403985 req-ccb2b12b-409c-42a8-bc22-ba1a516bc263 service nova] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] Received event network-vif-plugged-1e547ec7-7efd-480f-84be-806c8cf25b90 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:01:18 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-cdefa3ea-81ce-4de4-a68f-761ff6403985 req-ccb2b12b-409c-42a8-bc22-ba1a516bc263 service nova] Acquiring lock "3db2e71c-939b-4d2f-b1be-c2122f7cd73e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:01:18 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-cdefa3ea-81ce-4de4-a68f-761ff6403985 req-ccb2b12b-409c-42a8-bc22-ba1a516bc263 service nova] Lock "3db2e71c-939b-4d2f-b1be-c2122f7cd73e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:01:18 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-cdefa3ea-81ce-4de4-a68f-761ff6403985 req-ccb2b12b-409c-42a8-bc22-ba1a516bc263 service nova] Lock "3db2e71c-939b-4d2f-b1be-c2122f7cd73e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:01:18 user nova-compute[71509]: DEBUG nova.compute.manager [req-cdefa3ea-81ce-4de4-a68f-761ff6403985 req-ccb2b12b-409c-42a8-bc22-ba1a516bc263 service nova] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] No waiting events found dispatching network-vif-plugged-1e547ec7-7efd-480f-84be-806c8cf25b90 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:01:18 user nova-compute[71509]: WARNING nova.compute.manager [req-cdefa3ea-81ce-4de4-a68f-761ff6403985 req-ccb2b12b-409c-42a8-bc22-ba1a516bc263 service nova] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] Received unexpected event network-vif-plugged-1e547ec7-7efd-480f-84be-806c8cf25b90 for instance with vm_state active and task_state resize_finish.
Apr 14 11:01:18 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:01:18 user nova-compute[71509]: DEBUG nova.network.neutron [-] [instance: 3d6a53c3-6e32-456c-a056-fbf1bef3b656] Updating instance_info_cache with network_info: [] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:01:18 user nova-compute[71509]: INFO nova.compute.manager [-] [instance: 3d6a53c3-6e32-456c-a056-fbf1bef3b656] Took 1.29 seconds to deallocate network for instance.
Apr 14 11:01:18 user nova-compute[71509]: DEBUG nova.compute.manager [req-6ed74698-87b4-4255-ad43-797b1bc18e4e req-f7d89cbe-8439-447e-b810-585127d087e0 service nova] [instance: 3d6a53c3-6e32-456c-a056-fbf1bef3b656] Received event network-vif-deleted-c18cf2ba-f230-4684-a95c-14af689d7981 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:01:18 user nova-compute[71509]: INFO nova.compute.manager [req-6ed74698-87b4-4255-ad43-797b1bc18e4e req-f7d89cbe-8439-447e-b810-585127d087e0 service nova] [instance: 3d6a53c3-6e32-456c-a056-fbf1bef3b656] Neutron deleted interface c18cf2ba-f230-4684-a95c-14af689d7981; detaching it from the instance and deleting it from the info cache
Apr 14 11:01:18 user nova-compute[71509]: DEBUG nova.network.neutron [req-6ed74698-87b4-4255-ad43-797b1bc18e4e req-f7d89cbe-8439-447e-b810-585127d087e0 service nova] [instance: 3d6a53c3-6e32-456c-a056-fbf1bef3b656] Updating instance_info_cache with network_info: [] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:01:18 user nova-compute[71509]: DEBUG nova.compute.manager [req-6ed74698-87b4-4255-ad43-797b1bc18e4e req-f7d89cbe-8439-447e-b810-585127d087e0 service nova] [instance: 3d6a53c3-6e32-456c-a056-fbf1bef3b656] Detach interface failed, port_id=c18cf2ba-f230-4684-a95c-14af689d7981, reason: Instance 3d6a53c3-6e32-456c-a056-fbf1bef3b656 could not be found. {{(pid=71509) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 11:01:18 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-67e01efc-ca14-44c8-a0f6-ad857af16a7c tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:01:18 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-67e01efc-ca14-44c8-a0f6-ad857af16a7c tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:01:18 user nova-compute[71509]: DEBUG nova.virt.libvirt.host [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Removed pending event for 3db2e71c-939b-4d2f-b1be-c2122f7cd73e due to event {{(pid=71509) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 11:01:18 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681470078.8728735, 3db2e71c-939b-4d2f-b1be-c2122f7cd73e => Resumed> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 11:01:18 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] VM Resumed (Lifecycle Event)
Apr 14 11:01:18 user nova-compute[71509]: DEBUG nova.compute.manager [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] Instance event wait completed in 0 seconds for  {{(pid=71509) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 11:01:18 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] Instance running successfully.
Apr 14 11:01:18 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-67e01efc-ca14-44c8-a0f6-ad857af16a7c tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 11:01:18 user nova-compute[71509]: DEBUG nova.virt.libvirt.guest [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] Failed to set time: agent not configured {{(pid=71509) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Apr 14 11:01:18 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-f7cf06e4-20fe-42c7-a509-f8e3bc7960c6 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] finish_migration finished successfully. {{(pid=71509) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11742}}
Apr 14 11:01:18 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-67e01efc-ca14-44c8-a0f6-ad857af16a7c tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 11:01:18 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 11:01:18 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 11:01:18 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-67e01efc-ca14-44c8-a0f6-ad857af16a7c tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.495s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:01:18 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] During sync_power_state the instance has a pending task (resize_finish). Skip.
Apr 14 11:01:18 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681470078.8743222, 3db2e71c-939b-4d2f-b1be-c2122f7cd73e => Started> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 11:01:18 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] VM Started (Lifecycle Event)
Apr 14 11:01:19 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 11:01:19 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 11:01:19 user nova-compute[71509]: INFO nova.scheduler.client.report [None req-67e01efc-ca14-44c8-a0f6-ad857af16a7c tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Deleted allocations for instance 3d6a53c3-6e32-456c-a056-fbf1bef3b656
Apr 14 11:01:19 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] During sync_power_state the instance has a pending task (resize_finish). Skip.
Apr 14 11:01:19 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-67e01efc-ca14-44c8-a0f6-ad857af16a7c tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "3d6a53c3-6e32-456c-a056-fbf1bef3b656" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.969s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:01:19 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:01:19 user nova-compute[71509]: DEBUG nova.compute.manager [req-12381c6f-cfaf-4690-81ee-f9636e55bc45 req-69fead53-2c42-49e4-9a63-b8b01018ef98 service nova] [instance: 3d6a53c3-6e32-456c-a056-fbf1bef3b656] Received event network-vif-plugged-c18cf2ba-f230-4684-a95c-14af689d7981 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:01:19 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-12381c6f-cfaf-4690-81ee-f9636e55bc45 req-69fead53-2c42-49e4-9a63-b8b01018ef98 service nova] Acquiring lock "3d6a53c3-6e32-456c-a056-fbf1bef3b656-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:01:19 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-12381c6f-cfaf-4690-81ee-f9636e55bc45 req-69fead53-2c42-49e4-9a63-b8b01018ef98 service nova] Lock "3d6a53c3-6e32-456c-a056-fbf1bef3b656-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:01:19 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-12381c6f-cfaf-4690-81ee-f9636e55bc45 req-69fead53-2c42-49e4-9a63-b8b01018ef98 service nova] Lock "3d6a53c3-6e32-456c-a056-fbf1bef3b656-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:01:19 user nova-compute[71509]: DEBUG nova.compute.manager [req-12381c6f-cfaf-4690-81ee-f9636e55bc45 req-69fead53-2c42-49e4-9a63-b8b01018ef98 service nova] [instance: 3d6a53c3-6e32-456c-a056-fbf1bef3b656] No waiting events found dispatching network-vif-plugged-c18cf2ba-f230-4684-a95c-14af689d7981 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:01:19 user nova-compute[71509]: WARNING nova.compute.manager [req-12381c6f-cfaf-4690-81ee-f9636e55bc45 req-69fead53-2c42-49e4-9a63-b8b01018ef98 service nova] [instance: 3d6a53c3-6e32-456c-a056-fbf1bef3b656] Received unexpected event network-vif-plugged-c18cf2ba-f230-4684-a95c-14af689d7981 for instance with vm_state deleted and task_state None.
Apr 14 11:01:19 user nova-compute[71509]: DEBUG nova.compute.manager [req-12381c6f-cfaf-4690-81ee-f9636e55bc45 req-69fead53-2c42-49e4-9a63-b8b01018ef98 service nova] [instance: 3d6a53c3-6e32-456c-a056-fbf1bef3b656] Received event network-vif-plugged-c18cf2ba-f230-4684-a95c-14af689d7981 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:01:19 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-12381c6f-cfaf-4690-81ee-f9636e55bc45 req-69fead53-2c42-49e4-9a63-b8b01018ef98 service nova] Acquiring lock "3d6a53c3-6e32-456c-a056-fbf1bef3b656-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:01:19 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-12381c6f-cfaf-4690-81ee-f9636e55bc45 req-69fead53-2c42-49e4-9a63-b8b01018ef98 service nova] Lock "3d6a53c3-6e32-456c-a056-fbf1bef3b656-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:01:19 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-12381c6f-cfaf-4690-81ee-f9636e55bc45 req-69fead53-2c42-49e4-9a63-b8b01018ef98 service nova] Lock "3d6a53c3-6e32-456c-a056-fbf1bef3b656-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:01:19 user nova-compute[71509]: DEBUG nova.compute.manager [req-12381c6f-cfaf-4690-81ee-f9636e55bc45 req-69fead53-2c42-49e4-9a63-b8b01018ef98 service nova] [instance: 3d6a53c3-6e32-456c-a056-fbf1bef3b656] No waiting events found dispatching network-vif-plugged-c18cf2ba-f230-4684-a95c-14af689d7981 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:01:19 user nova-compute[71509]: WARNING nova.compute.manager [req-12381c6f-cfaf-4690-81ee-f9636e55bc45 req-69fead53-2c42-49e4-9a63-b8b01018ef98 service nova] [instance: 3d6a53c3-6e32-456c-a056-fbf1bef3b656] Received unexpected event network-vif-plugged-c18cf2ba-f230-4684-a95c-14af689d7981 for instance with vm_state deleted and task_state None.
Apr 14 11:01:19 user nova-compute[71509]: DEBUG nova.compute.manager [req-12381c6f-cfaf-4690-81ee-f9636e55bc45 req-69fead53-2c42-49e4-9a63-b8b01018ef98 service nova] [instance: 3d6a53c3-6e32-456c-a056-fbf1bef3b656] Received event network-vif-plugged-c18cf2ba-f230-4684-a95c-14af689d7981 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:01:19 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-12381c6f-cfaf-4690-81ee-f9636e55bc45 req-69fead53-2c42-49e4-9a63-b8b01018ef98 service nova] Acquiring lock "3d6a53c3-6e32-456c-a056-fbf1bef3b656-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:01:19 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-12381c6f-cfaf-4690-81ee-f9636e55bc45 req-69fead53-2c42-49e4-9a63-b8b01018ef98 service nova] Lock "3d6a53c3-6e32-456c-a056-fbf1bef3b656-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:01:19 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-12381c6f-cfaf-4690-81ee-f9636e55bc45 req-69fead53-2c42-49e4-9a63-b8b01018ef98 service nova] Lock "3d6a53c3-6e32-456c-a056-fbf1bef3b656-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:01:19 user nova-compute[71509]: DEBUG nova.compute.manager [req-12381c6f-cfaf-4690-81ee-f9636e55bc45 req-69fead53-2c42-49e4-9a63-b8b01018ef98 service nova] [instance: 3d6a53c3-6e32-456c-a056-fbf1bef3b656] No waiting events found dispatching network-vif-plugged-c18cf2ba-f230-4684-a95c-14af689d7981 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:01:19 user nova-compute[71509]: WARNING nova.compute.manager [req-12381c6f-cfaf-4690-81ee-f9636e55bc45 req-69fead53-2c42-49e4-9a63-b8b01018ef98 service nova] [instance: 3d6a53c3-6e32-456c-a056-fbf1bef3b656] Received unexpected event network-vif-plugged-c18cf2ba-f230-4684-a95c-14af689d7981 for instance with vm_state deleted and task_state None.
Apr 14 11:01:19 user nova-compute[71509]: DEBUG nova.compute.manager [req-12381c6f-cfaf-4690-81ee-f9636e55bc45 req-69fead53-2c42-49e4-9a63-b8b01018ef98 service nova] [instance: 3d6a53c3-6e32-456c-a056-fbf1bef3b656] Received event network-vif-plugged-c18cf2ba-f230-4684-a95c-14af689d7981 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:01:19 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-12381c6f-cfaf-4690-81ee-f9636e55bc45 req-69fead53-2c42-49e4-9a63-b8b01018ef98 service nova] Acquiring lock "3d6a53c3-6e32-456c-a056-fbf1bef3b656-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:01:19 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-12381c6f-cfaf-4690-81ee-f9636e55bc45 req-69fead53-2c42-49e4-9a63-b8b01018ef98 service nova] Lock "3d6a53c3-6e32-456c-a056-fbf1bef3b656-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:01:19 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-12381c6f-cfaf-4690-81ee-f9636e55bc45 req-69fead53-2c42-49e4-9a63-b8b01018ef98 service nova] Lock "3d6a53c3-6e32-456c-a056-fbf1bef3b656-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:01:19 user nova-compute[71509]: DEBUG nova.compute.manager [req-12381c6f-cfaf-4690-81ee-f9636e55bc45 req-69fead53-2c42-49e4-9a63-b8b01018ef98 service nova] [instance: 3d6a53c3-6e32-456c-a056-fbf1bef3b656] No waiting events found dispatching network-vif-plugged-c18cf2ba-f230-4684-a95c-14af689d7981 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:01:19 user nova-compute[71509]: WARNING nova.compute.manager [req-12381c6f-cfaf-4690-81ee-f9636e55bc45 req-69fead53-2c42-49e4-9a63-b8b01018ef98 service nova] [instance: 3d6a53c3-6e32-456c-a056-fbf1bef3b656] Received unexpected event network-vif-plugged-c18cf2ba-f230-4684-a95c-14af689d7981 for instance with vm_state deleted and task_state None.
Apr 14 11:01:22 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:01:23 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:01:27 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:01:28 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:01:30 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-2f906a9b-efab-4320-baab-d19f1cc178c5 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Acquiring lock "3d70b388-155f-4e47-8352-b69c856b2000" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:01:30 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-2f906a9b-efab-4320-baab-d19f1cc178c5 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Lock "3d70b388-155f-4e47-8352-b69c856b2000" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:01:30 user nova-compute[71509]: DEBUG nova.compute.manager [None req-2f906a9b-efab-4320-baab-d19f1cc178c5 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] [instance: 3d70b388-155f-4e47-8352-b69c856b2000] Starting instance... {{(pid=71509) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 11:01:30 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-2f906a9b-efab-4320-baab-d19f1cc178c5 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:01:30 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-2f906a9b-efab-4320-baab-d19f1cc178c5 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:01:30 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-2f906a9b-efab-4320-baab-d19f1cc178c5 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71509) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 11:01:30 user nova-compute[71509]: INFO nova.compute.claims [None req-2f906a9b-efab-4320-baab-d19f1cc178c5 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] [instance: 3d70b388-155f-4e47-8352-b69c856b2000] Claim successful on node user
Apr 14 11:01:30 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-2f906a9b-efab-4320-baab-d19f1cc178c5 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 11:01:30 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-2f906a9b-efab-4320-baab-d19f1cc178c5 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 11:01:31 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-2f906a9b-efab-4320-baab-d19f1cc178c5 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.422s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:01:31 user nova-compute[71509]: DEBUG nova.compute.manager [None req-2f906a9b-efab-4320-baab-d19f1cc178c5 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] [instance: 3d70b388-155f-4e47-8352-b69c856b2000] Start building networks asynchronously for instance. {{(pid=71509) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 11:01:31 user nova-compute[71509]: DEBUG nova.compute.manager [None req-2f906a9b-efab-4320-baab-d19f1cc178c5 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] [instance: 3d70b388-155f-4e47-8352-b69c856b2000] Allocating IP information in the background. {{(pid=71509) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 11:01:31 user nova-compute[71509]: DEBUG nova.network.neutron [None req-2f906a9b-efab-4320-baab-d19f1cc178c5 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] [instance: 3d70b388-155f-4e47-8352-b69c856b2000] allocate_for_instance() {{(pid=71509) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 11:01:31 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-2f906a9b-efab-4320-baab-d19f1cc178c5 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] [instance: 3d70b388-155f-4e47-8352-b69c856b2000] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 11:01:31 user nova-compute[71509]: DEBUG nova.compute.manager [None req-2f906a9b-efab-4320-baab-d19f1cc178c5 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] [instance: 3d70b388-155f-4e47-8352-b69c856b2000] Start building block device mappings for instance. {{(pid=71509) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 11:01:31 user nova-compute[71509]: DEBUG nova.policy [None req-2f906a9b-efab-4320-baab-d19f1cc178c5 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '282af802879e463ea87844b5fc926692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1310da753ca94b38a7c660b8613af044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71509) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 11:01:31 user nova-compute[71509]: DEBUG nova.compute.manager [None req-2f906a9b-efab-4320-baab-d19f1cc178c5 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] [instance: 3d70b388-155f-4e47-8352-b69c856b2000] Start spawning the instance on the hypervisor. {{(pid=71509) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 11:01:31 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-2f906a9b-efab-4320-baab-d19f1cc178c5 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] [instance: 3d70b388-155f-4e47-8352-b69c856b2000] Creating instance directory {{(pid=71509) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 11:01:31 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-2f906a9b-efab-4320-baab-d19f1cc178c5 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] [instance: 3d70b388-155f-4e47-8352-b69c856b2000] Creating image(s)
Apr 14 11:01:31 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-2f906a9b-efab-4320-baab-d19f1cc178c5 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Acquiring lock "/opt/stack/data/nova/instances/3d70b388-155f-4e47-8352-b69c856b2000/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:01:31 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-2f906a9b-efab-4320-baab-d19f1cc178c5 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Lock "/opt/stack/data/nova/instances/3d70b388-155f-4e47-8352-b69c856b2000/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:01:31 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-2f906a9b-efab-4320-baab-d19f1cc178c5 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Lock "/opt/stack/data/nova/instances/3d70b388-155f-4e47-8352-b69c856b2000/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:01:31 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-2f906a9b-efab-4320-baab-d19f1cc178c5 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:01:31 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-2f906a9b-efab-4320-baab-d19f1cc178c5 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json" returned: 0 in 0.159s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:01:31 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-2f906a9b-efab-4320-baab-d19f1cc178c5 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Acquiring lock "5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:01:31 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-2f906a9b-efab-4320-baab-d19f1cc178c5 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Lock "5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:01:31 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-2f906a9b-efab-4320-baab-d19f1cc178c5 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:01:31 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-2f906a9b-efab-4320-baab-d19f1cc178c5 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json" returned: 0 in 0.142s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:01:31 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-2f906a9b-efab-4320-baab-d19f1cc178c5 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18,backing_fmt=raw /opt/stack/data/nova/instances/3d70b388-155f-4e47-8352-b69c856b2000/disk 1073741824 {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:01:31 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-2f906a9b-efab-4320-baab-d19f1cc178c5 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18,backing_fmt=raw /opt/stack/data/nova/instances/3d70b388-155f-4e47-8352-b69c856b2000/disk 1073741824" returned: 0 in 0.052s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:01:31 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-2f906a9b-efab-4320-baab-d19f1cc178c5 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Lock "5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.201s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:01:31 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-2f906a9b-efab-4320-baab-d19f1cc178c5 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:01:31 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-2f906a9b-efab-4320-baab-d19f1cc178c5 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json" returned: 0 in 0.161s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:01:31 user nova-compute[71509]: DEBUG nova.virt.disk.api [None req-2f906a9b-efab-4320-baab-d19f1cc178c5 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3d70b388-155f-4e47-8352-b69c856b2000/disk. size=1073741824 {{(pid=71509) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 11:01:31 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-2f906a9b-efab-4320-baab-d19f1cc178c5 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d70b388-155f-4e47-8352-b69c856b2000/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:01:31 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-2f906a9b-efab-4320-baab-d19f1cc178c5 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d70b388-155f-4e47-8352-b69c856b2000/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:01:31 user nova-compute[71509]: DEBUG nova.virt.disk.api [None req-2f906a9b-efab-4320-baab-d19f1cc178c5 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Cannot resize image /opt/stack/data/nova/instances/3d70b388-155f-4e47-8352-b69c856b2000/disk to a smaller size. {{(pid=71509) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 11:01:31 user nova-compute[71509]: DEBUG nova.objects.instance [None req-2f906a9b-efab-4320-baab-d19f1cc178c5 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Lazy-loading 'migration_context' on Instance uuid 3d70b388-155f-4e47-8352-b69c856b2000 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 11:01:31 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-2f906a9b-efab-4320-baab-d19f1cc178c5 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] [instance: 3d70b388-155f-4e47-8352-b69c856b2000] Created local disks {{(pid=71509) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 11:01:31 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-2f906a9b-efab-4320-baab-d19f1cc178c5 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] [instance: 3d70b388-155f-4e47-8352-b69c856b2000] Ensure instance console log exists: /opt/stack/data/nova/instances/3d70b388-155f-4e47-8352-b69c856b2000/console.log {{(pid=71509) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 11:01:31 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-2f906a9b-efab-4320-baab-d19f1cc178c5 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:01:31 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-2f906a9b-efab-4320-baab-d19f1cc178c5 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:01:31 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-2f906a9b-efab-4320-baab-d19f1cc178c5 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:01:31 user nova-compute[71509]: DEBUG nova.network.neutron [None req-2f906a9b-efab-4320-baab-d19f1cc178c5 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] [instance: 3d70b388-155f-4e47-8352-b69c856b2000] Successfully created port: 77c6475d-8834-422b-ab62-0bd935284c56 {{(pid=71509) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 11:01:31 user nova-compute[71509]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681470076.9562147, 3d6a53c3-6e32-456c-a056-fbf1bef3b656 => Stopped> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 11:01:31 user nova-compute[71509]: INFO nova.compute.manager [-] [instance: 3d6a53c3-6e32-456c-a056-fbf1bef3b656] VM Stopped (Lifecycle Event)
Apr 14 11:01:31 user nova-compute[71509]: DEBUG nova.compute.manager [None req-b03ac993-24e1-4afa-899a-a59ef5fa0fec None None] [instance: 3d6a53c3-6e32-456c-a056-fbf1bef3b656] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 11:01:32 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:01:32 user nova-compute[71509]: DEBUG nova.network.neutron [None req-2f906a9b-efab-4320-baab-d19f1cc178c5 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] [instance: 3d70b388-155f-4e47-8352-b69c856b2000] Successfully updated port: 77c6475d-8834-422b-ab62-0bd935284c56 {{(pid=71509) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 11:01:32 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-2f906a9b-efab-4320-baab-d19f1cc178c5 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Acquiring lock "refresh_cache-3d70b388-155f-4e47-8352-b69c856b2000" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 11:01:32 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-2f906a9b-efab-4320-baab-d19f1cc178c5 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Acquired lock "refresh_cache-3d70b388-155f-4e47-8352-b69c856b2000" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 11:01:32 user nova-compute[71509]: DEBUG nova.network.neutron [None req-2f906a9b-efab-4320-baab-d19f1cc178c5 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] [instance: 3d70b388-155f-4e47-8352-b69c856b2000] Building network info cache for instance {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 11:01:32 user nova-compute[71509]: DEBUG nova.compute.manager [req-41c95a98-4ca3-417f-9e67-8181cf63bc05 req-7b3ca40b-9b82-40df-924d-5a5aee99482a service nova] [instance: 3d70b388-155f-4e47-8352-b69c856b2000] Received event network-changed-77c6475d-8834-422b-ab62-0bd935284c56 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:01:32 user nova-compute[71509]: DEBUG nova.compute.manager [req-41c95a98-4ca3-417f-9e67-8181cf63bc05 req-7b3ca40b-9b82-40df-924d-5a5aee99482a service nova] [instance: 3d70b388-155f-4e47-8352-b69c856b2000] Refreshing instance network info cache due to event network-changed-77c6475d-8834-422b-ab62-0bd935284c56. {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 11:01:32 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-41c95a98-4ca3-417f-9e67-8181cf63bc05 req-7b3ca40b-9b82-40df-924d-5a5aee99482a service nova] Acquiring lock "refresh_cache-3d70b388-155f-4e47-8352-b69c856b2000" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 11:01:32 user nova-compute[71509]: DEBUG nova.network.neutron [None req-2f906a9b-efab-4320-baab-d19f1cc178c5 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] [instance: 3d70b388-155f-4e47-8352-b69c856b2000] Instance cache missing network info. {{(pid=71509) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 11:01:33 user nova-compute[71509]: DEBUG nova.network.neutron [None req-2f906a9b-efab-4320-baab-d19f1cc178c5 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] [instance: 3d70b388-155f-4e47-8352-b69c856b2000] Updating instance_info_cache with network_info: [{"id": "77c6475d-8834-422b-ab62-0bd935284c56", "address": "fa:16:3e:eb:3d:94", "network": {"id": "9614cf7a-420b-4226-9189-a89f3f4e6340", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1987410065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "1310da753ca94b38a7c660b8613af044", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77c6475d-88", "ovs_interfaceid": "77c6475d-8834-422b-ab62-0bd935284c56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:01:33 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-2f906a9b-efab-4320-baab-d19f1cc178c5 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Releasing lock "refresh_cache-3d70b388-155f-4e47-8352-b69c856b2000" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 11:01:33 user nova-compute[71509]: DEBUG nova.compute.manager [None req-2f906a9b-efab-4320-baab-d19f1cc178c5 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] [instance: 3d70b388-155f-4e47-8352-b69c856b2000] Instance network_info: |[{"id": "77c6475d-8834-422b-ab62-0bd935284c56", "address": "fa:16:3e:eb:3d:94", "network": {"id": "9614cf7a-420b-4226-9189-a89f3f4e6340", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1987410065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "1310da753ca94b38a7c660b8613af044", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77c6475d-88", "ovs_interfaceid": "77c6475d-8834-422b-ab62-0bd935284c56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71509) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 11:01:33 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-41c95a98-4ca3-417f-9e67-8181cf63bc05 req-7b3ca40b-9b82-40df-924d-5a5aee99482a service nova] Acquired lock "refresh_cache-3d70b388-155f-4e47-8352-b69c856b2000" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 11:01:33 user nova-compute[71509]: DEBUG nova.network.neutron [req-41c95a98-4ca3-417f-9e67-8181cf63bc05 req-7b3ca40b-9b82-40df-924d-5a5aee99482a service nova] [instance: 3d70b388-155f-4e47-8352-b69c856b2000] Refreshing network info cache for port 77c6475d-8834-422b-ab62-0bd935284c56 {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 11:01:33 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-2f906a9b-efab-4320-baab-d19f1cc178c5 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] [instance: 3d70b388-155f-4e47-8352-b69c856b2000] Start _get_guest_xml network_info=[{"id": "77c6475d-8834-422b-ab62-0bd935284c56", "address": "fa:16:3e:eb:3d:94", "network": {"id": "9614cf7a-420b-4226-9189-a89f3f4e6340", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1987410065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "1310da753ca94b38a7c660b8613af044", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77c6475d-88", "ovs_interfaceid": "77c6475d-8834-422b-ab62-0bd935284c56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T10:38:55Z,direct_url=<?>,disk_format='qcow2',id=048ec0ee-0465-448d-8b4c-f072acb101dc,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='9742d6ad20cf48d9bab0fdbcc9491db9',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T10:38:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '048ec0ee-0465-448d-8b4c-f072acb101dc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71509) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 11:01:33 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-2f906a9b-efab-4320-baab-d19f1cc178c5 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 11:01:33 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-2f906a9b-efab-4320-baab-d19f1cc178c5 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 11:01:33 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-2f906a9b-efab-4320-baab-d19f1cc178c5 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71509) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 11:01:33 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-2f906a9b-efab-4320-baab-d19f1cc178c5 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T10:40:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T10:38:55Z,direct_url=<?>,disk_format='qcow2',id=048ec0ee-0465-448d-8b4c-f072acb101dc,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='9742d6ad20cf48d9bab0fdbcc9491db9',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T10:38:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 11:01:33 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-2f906a9b-efab-4320-baab-d19f1cc178c5 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Flavor limits 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 11:01:33 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-2f906a9b-efab-4320-baab-d19f1cc178c5 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Image limits 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 11:01:33 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-2f906a9b-efab-4320-baab-d19f1cc178c5 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Flavor pref 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 11:01:33 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-2f906a9b-efab-4320-baab-d19f1cc178c5 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Image pref 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 11:01:33 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-2f906a9b-efab-4320-baab-d19f1cc178c5 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 11:01:33 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-2f906a9b-efab-4320-baab-d19f1cc178c5 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 11:01:33 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-2f906a9b-efab-4320-baab-d19f1cc178c5 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71509) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 11:01:33 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-2f906a9b-efab-4320-baab-d19f1cc178c5 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Got 1 possible topologies {{(pid=71509) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 11:01:33 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-2f906a9b-efab-4320-baab-d19f1cc178c5 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 11:01:33 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-2f906a9b-efab-4320-baab-d19f1cc178c5 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 11:01:33 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-2f906a9b-efab-4320-baab-d19f1cc178c5 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T11:01:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-90735481',display_name='tempest-VolumesActionsTest-instance-90735481',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-90735481',id=37,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1310da753ca94b38a7c660b8613af044',ramdisk_id='',reservation_id='r-65u7wur6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1201626915',owner_user_name='tempest-VolumesActionsTest-1201626915-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T11:01:31Z,user_data=None,user_id='282af802879e463ea87844b5fc926692',uuid=3d70b388-155f-4e47-8352-b69c856b2000,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "77c6475d-8834-422b-ab62-0bd935284c56", "address": "fa:16:3e:eb:3d:94", "network": {"id": "9614cf7a-420b-4226-9189-a89f3f4e6340", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1987410065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "1310da753ca94b38a7c660b8613af044", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77c6475d-88", "ovs_interfaceid": "77c6475d-8834-422b-ab62-0bd935284c56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71509) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 11:01:33 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-2f906a9b-efab-4320-baab-d19f1cc178c5 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Converting VIF {"id": "77c6475d-8834-422b-ab62-0bd935284c56", "address": "fa:16:3e:eb:3d:94", "network": {"id": "9614cf7a-420b-4226-9189-a89f3f4e6340", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1987410065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "1310da753ca94b38a7c660b8613af044", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77c6475d-88", "ovs_interfaceid": "77c6475d-8834-422b-ab62-0bd935284c56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 11:01:33 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-2f906a9b-efab-4320-baab-d19f1cc178c5 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:3d:94,bridge_name='br-int',has_traffic_filtering=True,id=77c6475d-8834-422b-ab62-0bd935284c56,network=Network(9614cf7a-420b-4226-9189-a89f3f4e6340),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77c6475d-88') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 11:01:33 user nova-compute[71509]: DEBUG nova.objects.instance [None req-2f906a9b-efab-4320-baab-d19f1cc178c5 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Lazy-loading 'pci_devices' on Instance uuid 3d70b388-155f-4e47-8352-b69c856b2000 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 11:01:33 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-2f906a9b-efab-4320-baab-d19f1cc178c5 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] [instance: 3d70b388-155f-4e47-8352-b69c856b2000] End _get_guest_xml xml=<domain type="kvm">
Apr 14 11:01:33 user nova-compute[71509]:   <uuid>3d70b388-155f-4e47-8352-b69c856b2000</uuid>
Apr 14 11:01:33 user nova-compute[71509]:   <name>instance-00000025</name>
Apr 14 11:01:33 user nova-compute[71509]:   <memory>131072</memory>
Apr 14 11:01:33 user nova-compute[71509]:   <vcpu>1</vcpu>
Apr 14 11:01:33 user nova-compute[71509]:   <metadata>
Apr 14 11:01:33 user nova-compute[71509]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 11:01:33 user nova-compute[71509]:       <nova:package version="0.0.0"/>
Apr 14 11:01:33 user nova-compute[71509]:       <nova:name>tempest-VolumesActionsTest-instance-90735481</nova:name>
Apr 14 11:01:33 user nova-compute[71509]:       <nova:creationTime>2023-04-14 11:01:33</nova:creationTime>
Apr 14 11:01:33 user nova-compute[71509]:       <nova:flavor name="m1.nano">
Apr 14 11:01:33 user nova-compute[71509]:         <nova:memory>128</nova:memory>
Apr 14 11:01:33 user nova-compute[71509]:         <nova:disk>1</nova:disk>
Apr 14 11:01:33 user nova-compute[71509]:         <nova:swap>0</nova:swap>
Apr 14 11:01:33 user nova-compute[71509]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 11:01:33 user nova-compute[71509]:         <nova:vcpus>1</nova:vcpus>
Apr 14 11:01:33 user nova-compute[71509]:       </nova:flavor>
Apr 14 11:01:33 user nova-compute[71509]:       <nova:owner>
Apr 14 11:01:33 user nova-compute[71509]:         <nova:user uuid="282af802879e463ea87844b5fc926692">tempest-VolumesActionsTest-1201626915-project-member</nova:user>
Apr 14 11:01:33 user nova-compute[71509]:         <nova:project uuid="1310da753ca94b38a7c660b8613af044">tempest-VolumesActionsTest-1201626915</nova:project>
Apr 14 11:01:33 user nova-compute[71509]:       </nova:owner>
Apr 14 11:01:33 user nova-compute[71509]:       <nova:root type="image" uuid="048ec0ee-0465-448d-8b4c-f072acb101dc"/>
Apr 14 11:01:33 user nova-compute[71509]:       <nova:ports>
Apr 14 11:01:33 user nova-compute[71509]:         <nova:port uuid="77c6475d-8834-422b-ab62-0bd935284c56">
Apr 14 11:01:33 user nova-compute[71509]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Apr 14 11:01:33 user nova-compute[71509]:         </nova:port>
Apr 14 11:01:33 user nova-compute[71509]:       </nova:ports>
Apr 14 11:01:33 user nova-compute[71509]:     </nova:instance>
Apr 14 11:01:33 user nova-compute[71509]:   </metadata>
Apr 14 11:01:33 user nova-compute[71509]:   <sysinfo type="smbios">
Apr 14 11:01:33 user nova-compute[71509]:     <system>
Apr 14 11:01:33 user nova-compute[71509]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 11:01:33 user nova-compute[71509]:       <entry name="product">OpenStack Nova</entry>
Apr 14 11:01:33 user nova-compute[71509]:       <entry name="version">0.0.0</entry>
Apr 14 11:01:33 user nova-compute[71509]:       <entry name="serial">3d70b388-155f-4e47-8352-b69c856b2000</entry>
Apr 14 11:01:33 user nova-compute[71509]:       <entry name="uuid">3d70b388-155f-4e47-8352-b69c856b2000</entry>
Apr 14 11:01:33 user nova-compute[71509]:       <entry name="family">Virtual Machine</entry>
Apr 14 11:01:33 user nova-compute[71509]:     </system>
Apr 14 11:01:33 user nova-compute[71509]:   </sysinfo>
Apr 14 11:01:33 user nova-compute[71509]:   <os>
Apr 14 11:01:33 user nova-compute[71509]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 11:01:33 user nova-compute[71509]:     <boot dev="hd"/>
Apr 14 11:01:33 user nova-compute[71509]:     <smbios mode="sysinfo"/>
Apr 14 11:01:33 user nova-compute[71509]:   </os>
Apr 14 11:01:33 user nova-compute[71509]:   <features>
Apr 14 11:01:33 user nova-compute[71509]:     <acpi/>
Apr 14 11:01:33 user nova-compute[71509]:     <apic/>
Apr 14 11:01:33 user nova-compute[71509]:     <vmcoreinfo/>
Apr 14 11:01:33 user nova-compute[71509]:   </features>
Apr 14 11:01:33 user nova-compute[71509]:   <clock offset="utc">
Apr 14 11:01:33 user nova-compute[71509]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 11:01:33 user nova-compute[71509]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 11:01:33 user nova-compute[71509]:     <timer name="hpet" present="no"/>
Apr 14 11:01:33 user nova-compute[71509]:   </clock>
Apr 14 11:01:33 user nova-compute[71509]:   <cpu mode="custom" match="exact">
Apr 14 11:01:33 user nova-compute[71509]:     <model>Nehalem</model>
Apr 14 11:01:33 user nova-compute[71509]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 11:01:33 user nova-compute[71509]:   </cpu>
Apr 14 11:01:33 user nova-compute[71509]:   <devices>
Apr 14 11:01:33 user nova-compute[71509]:     <disk type="file" device="disk">
Apr 14 11:01:33 user nova-compute[71509]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 11:01:33 user nova-compute[71509]:       <source file="/opt/stack/data/nova/instances/3d70b388-155f-4e47-8352-b69c856b2000/disk"/>
Apr 14 11:01:33 user nova-compute[71509]:       <target dev="vda" bus="virtio"/>
Apr 14 11:01:33 user nova-compute[71509]:     </disk>
Apr 14 11:01:33 user nova-compute[71509]:     <interface type="ethernet">
Apr 14 11:01:33 user nova-compute[71509]:       <mac address="fa:16:3e:eb:3d:94"/>
Apr 14 11:01:33 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 11:01:33 user nova-compute[71509]:       <mtu size="1442"/>
Apr 14 11:01:33 user nova-compute[71509]:       <target dev="tap77c6475d-88"/>
Apr 14 11:01:33 user nova-compute[71509]:     </interface>
Apr 14 11:01:33 user nova-compute[71509]:     <serial type="pty">
Apr 14 11:01:33 user nova-compute[71509]:       <log file="/opt/stack/data/nova/instances/3d70b388-155f-4e47-8352-b69c856b2000/console.log" append="off"/>
Apr 14 11:01:33 user nova-compute[71509]:     </serial>
Apr 14 11:01:33 user nova-compute[71509]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 11:01:33 user nova-compute[71509]:     <video>
Apr 14 11:01:33 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 11:01:33 user nova-compute[71509]:     </video>
Apr 14 11:01:33 user nova-compute[71509]:     <rng model="virtio">
Apr 14 11:01:33 user nova-compute[71509]:       <backend model="random">/dev/urandom</backend>
Apr 14 11:01:33 user nova-compute[71509]:     </rng>
Apr 14 11:01:33 user nova-compute[71509]:     <controller type="usb" index="0" model="none"/>
Apr 14 11:01:33 user nova-compute[71509]:     <memballoon model="virtio">
Apr 14 11:01:33 user nova-compute[71509]:       <stats period="10"/>
Apr 14 11:01:33 user nova-compute[71509]:     </memballoon>
Apr 14 11:01:33 user nova-compute[71509]:   </devices>
Apr 14 11:01:33 user nova-compute[71509]: </domain>
Apr 14 11:01:33 user nova-compute[71509]:  {{(pid=71509) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 11:01:33 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-2f906a9b-efab-4320-baab-d19f1cc178c5 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T11:01:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-90735481',display_name='tempest-VolumesActionsTest-instance-90735481',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-90735481',id=37,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1310da753ca94b38a7c660b8613af044',ramdisk_id='',reservation_id='r-65u7wur6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1201626915',owner_user_name='tempest-VolumesActionsTest-1201626915-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T11:01:31Z,user_data=None,user_id='282af802879e463ea87844b5fc926692',uuid=3d70b388-155f-4e47-8352-b69c856b2000,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "77c6475d-8834-422b-ab62-0bd935284c56", "address": "fa:16:3e:eb:3d:94", "network": {"id": "9614cf7a-420b-4226-9189-a89f3f4e6340", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1987410065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "1310da753ca94b38a7c660b8613af044", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77c6475d-88", "ovs_interfaceid": "77c6475d-8834-422b-ab62-0bd935284c56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 11:01:33 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-2f906a9b-efab-4320-baab-d19f1cc178c5 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Converting VIF {"id": "77c6475d-8834-422b-ab62-0bd935284c56", "address": "fa:16:3e:eb:3d:94", "network": {"id": "9614cf7a-420b-4226-9189-a89f3f4e6340", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1987410065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "1310da753ca94b38a7c660b8613af044", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77c6475d-88", "ovs_interfaceid": "77c6475d-8834-422b-ab62-0bd935284c56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 11:01:33 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-2f906a9b-efab-4320-baab-d19f1cc178c5 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:3d:94,bridge_name='br-int',has_traffic_filtering=True,id=77c6475d-8834-422b-ab62-0bd935284c56,network=Network(9614cf7a-420b-4226-9189-a89f3f4e6340),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77c6475d-88') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 11:01:33 user nova-compute[71509]: DEBUG os_vif [None req-2f906a9b-efab-4320-baab-d19f1cc178c5 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:3d:94,bridge_name='br-int',has_traffic_filtering=True,id=77c6475d-8834-422b-ab62-0bd935284c56,network=Network(9614cf7a-420b-4226-9189-a89f3f4e6340),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77c6475d-88') {{(pid=71509) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 11:01:33 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:01:33 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:01:33 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 11:01:33 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:01:33 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap77c6475d-88, may_exist=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:01:33 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap77c6475d-88, col_values=(('external_ids', {'iface-id': '77c6475d-8834-422b-ab62-0bd935284c56', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:eb:3d:94', 'vm-uuid': '3d70b388-155f-4e47-8352-b69c856b2000'}),)) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:01:33 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:01:33 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:01:33 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:01:33 user nova-compute[71509]: INFO os_vif [None req-2f906a9b-efab-4320-baab-d19f1cc178c5 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:3d:94,bridge_name='br-int',has_traffic_filtering=True,id=77c6475d-8834-422b-ab62-0bd935284c56,network=Network(9614cf7a-420b-4226-9189-a89f3f4e6340),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77c6475d-88')
Apr 14 11:01:33 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-2f906a9b-efab-4320-baab-d19f1cc178c5 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] No BDM found with device name vda, not building metadata. {{(pid=71509) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 11:01:33 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-2f906a9b-efab-4320-baab-d19f1cc178c5 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] No VIF found with MAC fa:16:3e:eb:3d:94, not building metadata {{(pid=71509) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 11:01:33 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:01:33 user nova-compute[71509]: DEBUG nova.network.neutron [req-41c95a98-4ca3-417f-9e67-8181cf63bc05 req-7b3ca40b-9b82-40df-924d-5a5aee99482a service nova] [instance: 3d70b388-155f-4e47-8352-b69c856b2000] Updated VIF entry in instance network info cache for port 77c6475d-8834-422b-ab62-0bd935284c56. {{(pid=71509) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 11:01:33 user nova-compute[71509]: DEBUG nova.network.neutron [req-41c95a98-4ca3-417f-9e67-8181cf63bc05 req-7b3ca40b-9b82-40df-924d-5a5aee99482a service nova] [instance: 3d70b388-155f-4e47-8352-b69c856b2000] Updating instance_info_cache with network_info: [{"id": "77c6475d-8834-422b-ab62-0bd935284c56", "address": "fa:16:3e:eb:3d:94", "network": {"id": "9614cf7a-420b-4226-9189-a89f3f4e6340", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1987410065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "1310da753ca94b38a7c660b8613af044", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77c6475d-88", "ovs_interfaceid": "77c6475d-8834-422b-ab62-0bd935284c56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:01:33 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-41c95a98-4ca3-417f-9e67-8181cf63bc05 req-7b3ca40b-9b82-40df-924d-5a5aee99482a service nova] Releasing lock "refresh_cache-3d70b388-155f-4e47-8352-b69c856b2000" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 11:01:34 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:01:34 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:01:34 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:01:34 user nova-compute[71509]: DEBUG nova.compute.manager [req-358a8d15-accd-4d55-9b2f-fdd8fee15d66 req-3b42890e-7713-4a78-9aee-6c0cd6b89318 service nova] [instance: 3d70b388-155f-4e47-8352-b69c856b2000] Received event network-vif-plugged-77c6475d-8834-422b-ab62-0bd935284c56 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:01:34 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-358a8d15-accd-4d55-9b2f-fdd8fee15d66 req-3b42890e-7713-4a78-9aee-6c0cd6b89318 service nova] Acquiring lock "3d70b388-155f-4e47-8352-b69c856b2000-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:01:34 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-358a8d15-accd-4d55-9b2f-fdd8fee15d66 req-3b42890e-7713-4a78-9aee-6c0cd6b89318 service nova] Lock "3d70b388-155f-4e47-8352-b69c856b2000-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:01:34 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-358a8d15-accd-4d55-9b2f-fdd8fee15d66 req-3b42890e-7713-4a78-9aee-6c0cd6b89318 service nova] Lock "3d70b388-155f-4e47-8352-b69c856b2000-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:01:34 user nova-compute[71509]: DEBUG nova.compute.manager [req-358a8d15-accd-4d55-9b2f-fdd8fee15d66 req-3b42890e-7713-4a78-9aee-6c0cd6b89318 service nova] [instance: 3d70b388-155f-4e47-8352-b69c856b2000] No waiting events found dispatching network-vif-plugged-77c6475d-8834-422b-ab62-0bd935284c56 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:01:34 user nova-compute[71509]: WARNING nova.compute.manager [req-358a8d15-accd-4d55-9b2f-fdd8fee15d66 req-3b42890e-7713-4a78-9aee-6c0cd6b89318 service nova] [instance: 3d70b388-155f-4e47-8352-b69c856b2000] Received unexpected event network-vif-plugged-77c6475d-8834-422b-ab62-0bd935284c56 for instance with vm_state building and task_state spawning.
Apr 14 11:01:35 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-0de8eda9-8634-4fa5-b854-01e1cfd0fa0a tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] Acquiring lock "a1fdcfb4-8700-48fe-9dec-1e8a4b766cba" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:01:35 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-0de8eda9-8634-4fa5-b854-01e1cfd0fa0a tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] Lock "a1fdcfb4-8700-48fe-9dec-1e8a4b766cba" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:01:35 user nova-compute[71509]: DEBUG nova.compute.manager [None req-0de8eda9-8634-4fa5-b854-01e1cfd0fa0a tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] [instance: a1fdcfb4-8700-48fe-9dec-1e8a4b766cba] Starting instance... {{(pid=71509) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 11:01:35 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-0de8eda9-8634-4fa5-b854-01e1cfd0fa0a tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:01:35 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-0de8eda9-8634-4fa5-b854-01e1cfd0fa0a tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:01:35 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-0de8eda9-8634-4fa5-b854-01e1cfd0fa0a tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71509) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 11:01:35 user nova-compute[71509]: INFO nova.compute.claims [None req-0de8eda9-8634-4fa5-b854-01e1cfd0fa0a tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] [instance: a1fdcfb4-8700-48fe-9dec-1e8a4b766cba] Claim successful on node user
Apr 14 11:01:36 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-0de8eda9-8634-4fa5-b854-01e1cfd0fa0a tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 11:01:36 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-0de8eda9-8634-4fa5-b854-01e1cfd0fa0a tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 11:01:36 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-0de8eda9-8634-4fa5-b854-01e1cfd0fa0a tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.553s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:01:36 user nova-compute[71509]: DEBUG nova.compute.manager [None req-0de8eda9-8634-4fa5-b854-01e1cfd0fa0a tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] [instance: a1fdcfb4-8700-48fe-9dec-1e8a4b766cba] Start building networks asynchronously for instance. {{(pid=71509) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 11:01:36 user nova-compute[71509]: DEBUG nova.compute.manager [None req-0de8eda9-8634-4fa5-b854-01e1cfd0fa0a tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] [instance: a1fdcfb4-8700-48fe-9dec-1e8a4b766cba] Allocating IP information in the background. {{(pid=71509) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 11:01:36 user nova-compute[71509]: DEBUG nova.network.neutron [None req-0de8eda9-8634-4fa5-b854-01e1cfd0fa0a tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] [instance: a1fdcfb4-8700-48fe-9dec-1e8a4b766cba] allocate_for_instance() {{(pid=71509) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 11:01:36 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-0de8eda9-8634-4fa5-b854-01e1cfd0fa0a tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] [instance: a1fdcfb4-8700-48fe-9dec-1e8a4b766cba] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 11:01:36 user nova-compute[71509]: DEBUG nova.compute.manager [None req-0de8eda9-8634-4fa5-b854-01e1cfd0fa0a tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] [instance: a1fdcfb4-8700-48fe-9dec-1e8a4b766cba] Start building block device mappings for instance. {{(pid=71509) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 11:01:36 user nova-compute[71509]: DEBUG nova.policy [None req-0de8eda9-8634-4fa5-b854-01e1cfd0fa0a tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c9ae4725537b4162b88b3eed27666bc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '000980e0e886468b8df32c7373cde033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71509) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 11:01:36 user nova-compute[71509]: DEBUG nova.compute.manager [None req-0de8eda9-8634-4fa5-b854-01e1cfd0fa0a tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] [instance: a1fdcfb4-8700-48fe-9dec-1e8a4b766cba] Start spawning the instance on the hypervisor. {{(pid=71509) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 11:01:36 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-0de8eda9-8634-4fa5-b854-01e1cfd0fa0a tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] [instance: a1fdcfb4-8700-48fe-9dec-1e8a4b766cba] Creating instance directory {{(pid=71509) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 11:01:36 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-0de8eda9-8634-4fa5-b854-01e1cfd0fa0a tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] [instance: a1fdcfb4-8700-48fe-9dec-1e8a4b766cba] Creating image(s)
Apr 14 11:01:36 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-0de8eda9-8634-4fa5-b854-01e1cfd0fa0a tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] Acquiring lock "/opt/stack/data/nova/instances/a1fdcfb4-8700-48fe-9dec-1e8a4b766cba/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:01:36 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-0de8eda9-8634-4fa5-b854-01e1cfd0fa0a tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] Lock "/opt/stack/data/nova/instances/a1fdcfb4-8700-48fe-9dec-1e8a4b766cba/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:01:36 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-0de8eda9-8634-4fa5-b854-01e1cfd0fa0a tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] Lock "/opt/stack/data/nova/instances/a1fdcfb4-8700-48fe-9dec-1e8a4b766cba/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:01:36 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-0de8eda9-8634-4fa5-b854-01e1cfd0fa0a tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:01:36 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-0de8eda9-8634-4fa5-b854-01e1cfd0fa0a tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json" returned: 0 in 0.156s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:01:36 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-0de8eda9-8634-4fa5-b854-01e1cfd0fa0a tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] Acquiring lock "5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:01:36 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-0de8eda9-8634-4fa5-b854-01e1cfd0fa0a tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] Lock "5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:01:36 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-0de8eda9-8634-4fa5-b854-01e1cfd0fa0a tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:01:37 user nova-compute[71509]: DEBUG nova.compute.manager [req-5423d9db-7c98-4e9f-a52c-3ce50774db93 req-8e230db5-07c6-49a4-9cd1-e85c14211f05 service nova] [instance: 3d70b388-155f-4e47-8352-b69c856b2000] Received event network-vif-plugged-77c6475d-8834-422b-ab62-0bd935284c56 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:01:37 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-5423d9db-7c98-4e9f-a52c-3ce50774db93 req-8e230db5-07c6-49a4-9cd1-e85c14211f05 service nova] Acquiring lock "3d70b388-155f-4e47-8352-b69c856b2000-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:01:37 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-5423d9db-7c98-4e9f-a52c-3ce50774db93 req-8e230db5-07c6-49a4-9cd1-e85c14211f05 service nova] Lock "3d70b388-155f-4e47-8352-b69c856b2000-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.006s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:01:37 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-5423d9db-7c98-4e9f-a52c-3ce50774db93 req-8e230db5-07c6-49a4-9cd1-e85c14211f05 service nova] Lock "3d70b388-155f-4e47-8352-b69c856b2000-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:01:37 user nova-compute[71509]: DEBUG nova.compute.manager [req-5423d9db-7c98-4e9f-a52c-3ce50774db93 req-8e230db5-07c6-49a4-9cd1-e85c14211f05 service nova] [instance: 3d70b388-155f-4e47-8352-b69c856b2000] No waiting events found dispatching network-vif-plugged-77c6475d-8834-422b-ab62-0bd935284c56 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:01:37 user nova-compute[71509]: WARNING nova.compute.manager [req-5423d9db-7c98-4e9f-a52c-3ce50774db93 req-8e230db5-07c6-49a4-9cd1-e85c14211f05 service nova] [instance: 3d70b388-155f-4e47-8352-b69c856b2000] Received unexpected event network-vif-plugged-77c6475d-8834-422b-ab62-0bd935284c56 for instance with vm_state building and task_state spawning.
Apr 14 11:01:37 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-0de8eda9-8634-4fa5-b854-01e1cfd0fa0a tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json" returned: 0 in 0.134s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:01:37 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-0de8eda9-8634-4fa5-b854-01e1cfd0fa0a tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18,backing_fmt=raw /opt/stack/data/nova/instances/a1fdcfb4-8700-48fe-9dec-1e8a4b766cba/disk 1073741824 {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:01:37 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-0de8eda9-8634-4fa5-b854-01e1cfd0fa0a tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18,backing_fmt=raw /opt/stack/data/nova/instances/a1fdcfb4-8700-48fe-9dec-1e8a4b766cba/disk 1073741824" returned: 0 in 0.059s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:01:37 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-0de8eda9-8634-4fa5-b854-01e1cfd0fa0a tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] Lock "5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.199s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:01:37 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-0de8eda9-8634-4fa5-b854-01e1cfd0fa0a tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:01:37 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681470097.1820118, 3d70b388-155f-4e47-8352-b69c856b2000 => Resumed> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 11:01:37 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 3d70b388-155f-4e47-8352-b69c856b2000] VM Resumed (Lifecycle Event)
Apr 14 11:01:37 user nova-compute[71509]: DEBUG nova.compute.manager [None req-2f906a9b-efab-4320-baab-d19f1cc178c5 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] [instance: 3d70b388-155f-4e47-8352-b69c856b2000] Instance event wait completed in 0 seconds for  {{(pid=71509) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 11:01:37 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-2f906a9b-efab-4320-baab-d19f1cc178c5 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] [instance: 3d70b388-155f-4e47-8352-b69c856b2000] Guest created on hypervisor {{(pid=71509) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 11:01:37 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: 3d70b388-155f-4e47-8352-b69c856b2000] Instance spawned successfully.
Apr 14 11:01:37 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-2f906a9b-efab-4320-baab-d19f1cc178c5 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] [instance: 3d70b388-155f-4e47-8352-b69c856b2000] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 11:01:37 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 3d70b388-155f-4e47-8352-b69c856b2000] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 11:01:37 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 3d70b388-155f-4e47-8352-b69c856b2000] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 11:01:37 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-2f906a9b-efab-4320-baab-d19f1cc178c5 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] [instance: 3d70b388-155f-4e47-8352-b69c856b2000] Found default for hw_cdrom_bus of ide {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:01:37 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-2f906a9b-efab-4320-baab-d19f1cc178c5 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] [instance: 3d70b388-155f-4e47-8352-b69c856b2000] Found default for hw_disk_bus of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:01:37 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-2f906a9b-efab-4320-baab-d19f1cc178c5 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] [instance: 3d70b388-155f-4e47-8352-b69c856b2000] Found default for hw_input_bus of None {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:01:37 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-2f906a9b-efab-4320-baab-d19f1cc178c5 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] [instance: 3d70b388-155f-4e47-8352-b69c856b2000] Found default for hw_pointer_model of None {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:01:37 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-2f906a9b-efab-4320-baab-d19f1cc178c5 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] [instance: 3d70b388-155f-4e47-8352-b69c856b2000] Found default for hw_video_model of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:01:37 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-2f906a9b-efab-4320-baab-d19f1cc178c5 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] [instance: 3d70b388-155f-4e47-8352-b69c856b2000] Found default for hw_vif_model of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:01:37 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 3d70b388-155f-4e47-8352-b69c856b2000] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 11:01:37 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681470097.1831648, 3d70b388-155f-4e47-8352-b69c856b2000 => Started> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 11:01:37 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 3d70b388-155f-4e47-8352-b69c856b2000] VM Started (Lifecycle Event)
Apr 14 11:01:37 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 3d70b388-155f-4e47-8352-b69c856b2000] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 11:01:37 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 3d70b388-155f-4e47-8352-b69c856b2000] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 11:01:37 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-0de8eda9-8634-4fa5-b854-01e1cfd0fa0a tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json" returned: 0 in 0.149s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:01:37 user nova-compute[71509]: DEBUG nova.virt.disk.api [None req-0de8eda9-8634-4fa5-b854-01e1cfd0fa0a tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a1fdcfb4-8700-48fe-9dec-1e8a4b766cba/disk. size=1073741824 {{(pid=71509) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 11:01:37 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-0de8eda9-8634-4fa5-b854-01e1cfd0fa0a tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1fdcfb4-8700-48fe-9dec-1e8a4b766cba/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:01:37 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 3d70b388-155f-4e47-8352-b69c856b2000] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 11:01:37 user nova-compute[71509]: INFO nova.compute.manager [None req-2f906a9b-efab-4320-baab-d19f1cc178c5 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] [instance: 3d70b388-155f-4e47-8352-b69c856b2000] Took 6.13 seconds to spawn the instance on the hypervisor.
Apr 14 11:01:37 user nova-compute[71509]: DEBUG nova.compute.manager [None req-2f906a9b-efab-4320-baab-d19f1cc178c5 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] [instance: 3d70b388-155f-4e47-8352-b69c856b2000] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 11:01:37 user nova-compute[71509]: DEBUG nova.network.neutron [None req-0de8eda9-8634-4fa5-b854-01e1cfd0fa0a tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] [instance: a1fdcfb4-8700-48fe-9dec-1e8a4b766cba] Successfully created port: 2b800e13-6dff-47b1-aced-1f9b2600868f {{(pid=71509) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 11:01:37 user nova-compute[71509]: INFO nova.compute.manager [None req-2f906a9b-efab-4320-baab-d19f1cc178c5 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] [instance: 3d70b388-155f-4e47-8352-b69c856b2000] Took 6.89 seconds to build instance.
Apr 14 11:01:37 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-0de8eda9-8634-4fa5-b854-01e1cfd0fa0a tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1fdcfb4-8700-48fe-9dec-1e8a4b766cba/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:01:37 user nova-compute[71509]: DEBUG nova.virt.disk.api [None req-0de8eda9-8634-4fa5-b854-01e1cfd0fa0a tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] Cannot resize image /opt/stack/data/nova/instances/a1fdcfb4-8700-48fe-9dec-1e8a4b766cba/disk to a smaller size. {{(pid=71509) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 11:01:37 user nova-compute[71509]: DEBUG nova.objects.instance [None req-0de8eda9-8634-4fa5-b854-01e1cfd0fa0a tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] Lazy-loading 'migration_context' on Instance uuid a1fdcfb4-8700-48fe-9dec-1e8a4b766cba {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 11:01:37 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-2f906a9b-efab-4320-baab-d19f1cc178c5 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Lock "3d70b388-155f-4e47-8352-b69c856b2000" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.142s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:01:37 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-0de8eda9-8634-4fa5-b854-01e1cfd0fa0a tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] [instance: a1fdcfb4-8700-48fe-9dec-1e8a4b766cba] Created local disks {{(pid=71509) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 11:01:37 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-0de8eda9-8634-4fa5-b854-01e1cfd0fa0a tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] [instance: a1fdcfb4-8700-48fe-9dec-1e8a4b766cba] Ensure instance console log exists: /opt/stack/data/nova/instances/a1fdcfb4-8700-48fe-9dec-1e8a4b766cba/console.log {{(pid=71509) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 11:01:37 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-0de8eda9-8634-4fa5-b854-01e1cfd0fa0a tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:01:37 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-0de8eda9-8634-4fa5-b854-01e1cfd0fa0a tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:01:37 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-0de8eda9-8634-4fa5-b854-01e1cfd0fa0a tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:01:38 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:01:38 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:01:38 user nova-compute[71509]: DEBUG nova.network.neutron [None req-0de8eda9-8634-4fa5-b854-01e1cfd0fa0a tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] [instance: a1fdcfb4-8700-48fe-9dec-1e8a4b766cba] Successfully updated port: 2b800e13-6dff-47b1-aced-1f9b2600868f {{(pid=71509) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 11:01:38 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-0de8eda9-8634-4fa5-b854-01e1cfd0fa0a tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] Acquiring lock "refresh_cache-a1fdcfb4-8700-48fe-9dec-1e8a4b766cba" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 11:01:38 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-0de8eda9-8634-4fa5-b854-01e1cfd0fa0a tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] Acquired lock "refresh_cache-a1fdcfb4-8700-48fe-9dec-1e8a4b766cba" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 11:01:38 user nova-compute[71509]: DEBUG nova.network.neutron [None req-0de8eda9-8634-4fa5-b854-01e1cfd0fa0a tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] [instance: a1fdcfb4-8700-48fe-9dec-1e8a4b766cba] Building network info cache for instance {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 11:01:38 user nova-compute[71509]: DEBUG nova.compute.manager [req-2d77909b-703e-4454-a575-417874a25442 req-21207653-2640-426b-ad79-1d4f1cc62ac2 service nova] [instance: a1fdcfb4-8700-48fe-9dec-1e8a4b766cba] Received event network-changed-2b800e13-6dff-47b1-aced-1f9b2600868f {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:01:38 user nova-compute[71509]: DEBUG nova.compute.manager [req-2d77909b-703e-4454-a575-417874a25442 req-21207653-2640-426b-ad79-1d4f1cc62ac2 service nova] [instance: a1fdcfb4-8700-48fe-9dec-1e8a4b766cba] Refreshing instance network info cache due to event network-changed-2b800e13-6dff-47b1-aced-1f9b2600868f. {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 11:01:38 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-2d77909b-703e-4454-a575-417874a25442 req-21207653-2640-426b-ad79-1d4f1cc62ac2 service nova] Acquiring lock "refresh_cache-a1fdcfb4-8700-48fe-9dec-1e8a4b766cba" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 11:01:38 user nova-compute[71509]: DEBUG nova.network.neutron [None req-0de8eda9-8634-4fa5-b854-01e1cfd0fa0a tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] [instance: a1fdcfb4-8700-48fe-9dec-1e8a4b766cba] Instance cache missing network info. {{(pid=71509) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 11:01:39 user nova-compute[71509]: DEBUG nova.network.neutron [None req-0de8eda9-8634-4fa5-b854-01e1cfd0fa0a tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] [instance: a1fdcfb4-8700-48fe-9dec-1e8a4b766cba] Updating instance_info_cache with network_info: [{"id": "2b800e13-6dff-47b1-aced-1f9b2600868f", "address": "fa:16:3e:9d:36:94", "network": {"id": "32b79070-3f05-4fa8-90ea-ba2ba6953db2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1189530156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "000980e0e886468b8df32c7373cde033", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b800e13-6d", "ovs_interfaceid": "2b800e13-6dff-47b1-aced-1f9b2600868f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:01:39 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-0de8eda9-8634-4fa5-b854-01e1cfd0fa0a tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] Releasing lock "refresh_cache-a1fdcfb4-8700-48fe-9dec-1e8a4b766cba" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 11:01:39 user nova-compute[71509]: DEBUG nova.compute.manager [None req-0de8eda9-8634-4fa5-b854-01e1cfd0fa0a tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] [instance: a1fdcfb4-8700-48fe-9dec-1e8a4b766cba] Instance network_info: |[{"id": "2b800e13-6dff-47b1-aced-1f9b2600868f", "address": "fa:16:3e:9d:36:94", "network": {"id": "32b79070-3f05-4fa8-90ea-ba2ba6953db2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1189530156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "000980e0e886468b8df32c7373cde033", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b800e13-6d", "ovs_interfaceid": "2b800e13-6dff-47b1-aced-1f9b2600868f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71509) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 11:01:39 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-2d77909b-703e-4454-a575-417874a25442 req-21207653-2640-426b-ad79-1d4f1cc62ac2 service nova] Acquired lock "refresh_cache-a1fdcfb4-8700-48fe-9dec-1e8a4b766cba" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 11:01:39 user nova-compute[71509]: DEBUG nova.network.neutron [req-2d77909b-703e-4454-a575-417874a25442 req-21207653-2640-426b-ad79-1d4f1cc62ac2 service nova] [instance: a1fdcfb4-8700-48fe-9dec-1e8a4b766cba] Refreshing network info cache for port 2b800e13-6dff-47b1-aced-1f9b2600868f {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 11:01:39 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-0de8eda9-8634-4fa5-b854-01e1cfd0fa0a tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] [instance: a1fdcfb4-8700-48fe-9dec-1e8a4b766cba] Start _get_guest_xml network_info=[{"id": "2b800e13-6dff-47b1-aced-1f9b2600868f", "address": "fa:16:3e:9d:36:94", "network": {"id": "32b79070-3f05-4fa8-90ea-ba2ba6953db2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1189530156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "000980e0e886468b8df32c7373cde033", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b800e13-6d", "ovs_interfaceid": "2b800e13-6dff-47b1-aced-1f9b2600868f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T10:38:55Z,direct_url=<?>,disk_format='qcow2',id=048ec0ee-0465-448d-8b4c-f072acb101dc,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='9742d6ad20cf48d9bab0fdbcc9491db9',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T10:38:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '048ec0ee-0465-448d-8b4c-f072acb101dc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71509) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 11:01:39 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-0de8eda9-8634-4fa5-b854-01e1cfd0fa0a tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 11:01:39 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-0de8eda9-8634-4fa5-b854-01e1cfd0fa0a tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 11:01:39 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-0de8eda9-8634-4fa5-b854-01e1cfd0fa0a tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71509) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 11:01:39 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-0de8eda9-8634-4fa5-b854-01e1cfd0fa0a tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T10:40:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T10:38:55Z,direct_url=<?>,disk_format='qcow2',id=048ec0ee-0465-448d-8b4c-f072acb101dc,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='9742d6ad20cf48d9bab0fdbcc9491db9',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T10:38:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 11:01:39 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-0de8eda9-8634-4fa5-b854-01e1cfd0fa0a tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] Flavor limits 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 11:01:39 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-0de8eda9-8634-4fa5-b854-01e1cfd0fa0a tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] Image limits 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 11:01:39 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-0de8eda9-8634-4fa5-b854-01e1cfd0fa0a tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] Flavor pref 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 11:01:39 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-0de8eda9-8634-4fa5-b854-01e1cfd0fa0a tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] Image pref 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 11:01:39 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-0de8eda9-8634-4fa5-b854-01e1cfd0fa0a tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 11:01:39 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-0de8eda9-8634-4fa5-b854-01e1cfd0fa0a tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 11:01:39 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-0de8eda9-8634-4fa5-b854-01e1cfd0fa0a tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71509) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 11:01:39 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-0de8eda9-8634-4fa5-b854-01e1cfd0fa0a tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] Got 1 possible topologies {{(pid=71509) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 11:01:39 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-0de8eda9-8634-4fa5-b854-01e1cfd0fa0a tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 11:01:39 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-0de8eda9-8634-4fa5-b854-01e1cfd0fa0a tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 11:01:39 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-0de8eda9-8634-4fa5-b854-01e1cfd0fa0a tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T11:01:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-392369322',display_name='tempest-VolumesActionsTest-instance-392369322',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-392369322',id=38,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='000980e0e886468b8df32c7373cde033',ramdisk_id='',reservation_id='r-z55m6oai',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1402991140',owner_user_name='tempest-VolumesActionsTest-1402991140-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T11:01:37Z,user_data=None,user_id='c9ae4725537b4162b88b3eed27666bc0',uuid=a1fdcfb4-8700-48fe-9dec-1e8a4b766cba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2b800e13-6dff-47b1-aced-1f9b2600868f", "address": "fa:16:3e:9d:36:94", "network": {"id": "32b79070-3f05-4fa8-90ea-ba2ba6953db2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1189530156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "000980e0e886468b8df32c7373cde033", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b800e13-6d", "ovs_interfaceid": "2b800e13-6dff-47b1-aced-1f9b2600868f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71509) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 11:01:39 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-0de8eda9-8634-4fa5-b854-01e1cfd0fa0a tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] Converting VIF {"id": "2b800e13-6dff-47b1-aced-1f9b2600868f", "address": "fa:16:3e:9d:36:94", "network": {"id": "32b79070-3f05-4fa8-90ea-ba2ba6953db2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1189530156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "000980e0e886468b8df32c7373cde033", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b800e13-6d", "ovs_interfaceid": "2b800e13-6dff-47b1-aced-1f9b2600868f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 11:01:39 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-0de8eda9-8634-4fa5-b854-01e1cfd0fa0a tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:36:94,bridge_name='br-int',has_traffic_filtering=True,id=2b800e13-6dff-47b1-aced-1f9b2600868f,network=Network(32b79070-3f05-4fa8-90ea-ba2ba6953db2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b800e13-6d') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 11:01:39 user nova-compute[71509]: DEBUG nova.objects.instance [None req-0de8eda9-8634-4fa5-b854-01e1cfd0fa0a tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] Lazy-loading 'pci_devices' on Instance uuid a1fdcfb4-8700-48fe-9dec-1e8a4b766cba {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 11:01:39 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-0de8eda9-8634-4fa5-b854-01e1cfd0fa0a tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] [instance: a1fdcfb4-8700-48fe-9dec-1e8a4b766cba] End _get_guest_xml xml=<domain type="kvm">
Apr 14 11:01:39 user nova-compute[71509]:   <uuid>a1fdcfb4-8700-48fe-9dec-1e8a4b766cba</uuid>
Apr 14 11:01:39 user nova-compute[71509]:   <name>instance-00000026</name>
Apr 14 11:01:39 user nova-compute[71509]:   <memory>131072</memory>
Apr 14 11:01:39 user nova-compute[71509]:   <vcpu>1</vcpu>
Apr 14 11:01:39 user nova-compute[71509]:   <metadata>
Apr 14 11:01:39 user nova-compute[71509]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 11:01:39 user nova-compute[71509]:       <nova:package version="0.0.0"/>
Apr 14 11:01:39 user nova-compute[71509]:       <nova:name>tempest-VolumesActionsTest-instance-392369322</nova:name>
Apr 14 11:01:39 user nova-compute[71509]:       <nova:creationTime>2023-04-14 11:01:39</nova:creationTime>
Apr 14 11:01:39 user nova-compute[71509]:       <nova:flavor name="m1.nano">
Apr 14 11:01:39 user nova-compute[71509]:         <nova:memory>128</nova:memory>
Apr 14 11:01:39 user nova-compute[71509]:         <nova:disk>1</nova:disk>
Apr 14 11:01:39 user nova-compute[71509]:         <nova:swap>0</nova:swap>
Apr 14 11:01:39 user nova-compute[71509]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 11:01:39 user nova-compute[71509]:         <nova:vcpus>1</nova:vcpus>
Apr 14 11:01:39 user nova-compute[71509]:       </nova:flavor>
Apr 14 11:01:39 user nova-compute[71509]:       <nova:owner>
Apr 14 11:01:39 user nova-compute[71509]:         <nova:user uuid="c9ae4725537b4162b88b3eed27666bc0">tempest-VolumesActionsTest-1402991140-project-member</nova:user>
Apr 14 11:01:39 user nova-compute[71509]:         <nova:project uuid="000980e0e886468b8df32c7373cde033">tempest-VolumesActionsTest-1402991140</nova:project>
Apr 14 11:01:39 user nova-compute[71509]:       </nova:owner>
Apr 14 11:01:39 user nova-compute[71509]:       <nova:root type="image" uuid="048ec0ee-0465-448d-8b4c-f072acb101dc"/>
Apr 14 11:01:39 user nova-compute[71509]:       <nova:ports>
Apr 14 11:01:39 user nova-compute[71509]:         <nova:port uuid="2b800e13-6dff-47b1-aced-1f9b2600868f">
Apr 14 11:01:39 user nova-compute[71509]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Apr 14 11:01:39 user nova-compute[71509]:         </nova:port>
Apr 14 11:01:39 user nova-compute[71509]:       </nova:ports>
Apr 14 11:01:39 user nova-compute[71509]:     </nova:instance>
Apr 14 11:01:39 user nova-compute[71509]:   </metadata>
Apr 14 11:01:39 user nova-compute[71509]:   <sysinfo type="smbios">
Apr 14 11:01:39 user nova-compute[71509]:     <system>
Apr 14 11:01:39 user nova-compute[71509]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 11:01:39 user nova-compute[71509]:       <entry name="product">OpenStack Nova</entry>
Apr 14 11:01:39 user nova-compute[71509]:       <entry name="version">0.0.0</entry>
Apr 14 11:01:39 user nova-compute[71509]:       <entry name="serial">a1fdcfb4-8700-48fe-9dec-1e8a4b766cba</entry>
Apr 14 11:01:39 user nova-compute[71509]:       <entry name="uuid">a1fdcfb4-8700-48fe-9dec-1e8a4b766cba</entry>
Apr 14 11:01:39 user nova-compute[71509]:       <entry name="family">Virtual Machine</entry>
Apr 14 11:01:39 user nova-compute[71509]:     </system>
Apr 14 11:01:39 user nova-compute[71509]:   </sysinfo>
Apr 14 11:01:39 user nova-compute[71509]:   <os>
Apr 14 11:01:39 user nova-compute[71509]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 11:01:39 user nova-compute[71509]:     <boot dev="hd"/>
Apr 14 11:01:39 user nova-compute[71509]:     <smbios mode="sysinfo"/>
Apr 14 11:01:39 user nova-compute[71509]:   </os>
Apr 14 11:01:39 user nova-compute[71509]:   <features>
Apr 14 11:01:39 user nova-compute[71509]:     <acpi/>
Apr 14 11:01:39 user nova-compute[71509]:     <apic/>
Apr 14 11:01:39 user nova-compute[71509]:     <vmcoreinfo/>
Apr 14 11:01:39 user nova-compute[71509]:   </features>
Apr 14 11:01:39 user nova-compute[71509]:   <clock offset="utc">
Apr 14 11:01:39 user nova-compute[71509]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 11:01:39 user nova-compute[71509]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 11:01:39 user nova-compute[71509]:     <timer name="hpet" present="no"/>
Apr 14 11:01:39 user nova-compute[71509]:   </clock>
Apr 14 11:01:39 user nova-compute[71509]:   <cpu mode="custom" match="exact">
Apr 14 11:01:39 user nova-compute[71509]:     <model>Nehalem</model>
Apr 14 11:01:39 user nova-compute[71509]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 11:01:39 user nova-compute[71509]:   </cpu>
Apr 14 11:01:39 user nova-compute[71509]:   <devices>
Apr 14 11:01:39 user nova-compute[71509]:     <disk type="file" device="disk">
Apr 14 11:01:39 user nova-compute[71509]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 11:01:39 user nova-compute[71509]:       <source file="/opt/stack/data/nova/instances/a1fdcfb4-8700-48fe-9dec-1e8a4b766cba/disk"/>
Apr 14 11:01:39 user nova-compute[71509]:       <target dev="vda" bus="virtio"/>
Apr 14 11:01:39 user nova-compute[71509]:     </disk>
Apr 14 11:01:39 user nova-compute[71509]:     <interface type="ethernet">
Apr 14 11:01:39 user nova-compute[71509]:       <mac address="fa:16:3e:9d:36:94"/>
Apr 14 11:01:39 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 11:01:39 user nova-compute[71509]:       <mtu size="1442"/>
Apr 14 11:01:39 user nova-compute[71509]:       <target dev="tap2b800e13-6d"/>
Apr 14 11:01:39 user nova-compute[71509]:     </interface>
Apr 14 11:01:39 user nova-compute[71509]:     <serial type="pty">
Apr 14 11:01:39 user nova-compute[71509]:       <log file="/opt/stack/data/nova/instances/a1fdcfb4-8700-48fe-9dec-1e8a4b766cba/console.log" append="off"/>
Apr 14 11:01:39 user nova-compute[71509]:     </serial>
Apr 14 11:01:39 user nova-compute[71509]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 11:01:39 user nova-compute[71509]:     <video>
Apr 14 11:01:39 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 11:01:39 user nova-compute[71509]:     </video>
Apr 14 11:01:39 user nova-compute[71509]:     <rng model="virtio">
Apr 14 11:01:39 user nova-compute[71509]:       <backend model="random">/dev/urandom</backend>
Apr 14 11:01:39 user nova-compute[71509]:     </rng>
Apr 14 11:01:39 user nova-compute[71509]:     <controller type="usb" index="0" model="none"/>
Apr 14 11:01:39 user nova-compute[71509]:     <memballoon model="virtio">
Apr 14 11:01:39 user nova-compute[71509]:       <stats period="10"/>
Apr 14 11:01:39 user nova-compute[71509]:     </memballoon>
Apr 14 11:01:39 user nova-compute[71509]:   </devices>
Apr 14 11:01:39 user nova-compute[71509]: </domain>
Apr 14 11:01:39 user nova-compute[71509]:  {{(pid=71509) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 11:01:39 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-0de8eda9-8634-4fa5-b854-01e1cfd0fa0a tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T11:01:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-392369322',display_name='tempest-VolumesActionsTest-instance-392369322',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-392369322',id=38,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='000980e0e886468b8df32c7373cde033',ramdisk_id='',reservation_id='r-z55m6oai',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1402991140',owner_user_name='tempest-VolumesActionsTest-1402991140-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T11:01:37Z,user_data=None,user_id='c9ae4725537b4162b88b3eed27666bc0',uuid=a1fdcfb4-8700-48fe-9dec-1e8a4b766cba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2b800e13-6dff-47b1-aced-1f9b2600868f", "address": "fa:16:3e:9d:36:94", "network": {"id": "32b79070-3f05-4fa8-90ea-ba2ba6953db2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1189530156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "000980e0e886468b8df32c7373cde033", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b800e13-6d", "ovs_interfaceid": "2b800e13-6dff-47b1-aced-1f9b2600868f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 11:01:39 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-0de8eda9-8634-4fa5-b854-01e1cfd0fa0a tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] Converting VIF {"id": "2b800e13-6dff-47b1-aced-1f9b2600868f", "address": "fa:16:3e:9d:36:94", "network": {"id": "32b79070-3f05-4fa8-90ea-ba2ba6953db2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1189530156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "000980e0e886468b8df32c7373cde033", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b800e13-6d", "ovs_interfaceid": "2b800e13-6dff-47b1-aced-1f9b2600868f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 11:01:39 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-0de8eda9-8634-4fa5-b854-01e1cfd0fa0a tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:36:94,bridge_name='br-int',has_traffic_filtering=True,id=2b800e13-6dff-47b1-aced-1f9b2600868f,network=Network(32b79070-3f05-4fa8-90ea-ba2ba6953db2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b800e13-6d') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 11:01:39 user nova-compute[71509]: DEBUG os_vif [None req-0de8eda9-8634-4fa5-b854-01e1cfd0fa0a tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:36:94,bridge_name='br-int',has_traffic_filtering=True,id=2b800e13-6dff-47b1-aced-1f9b2600868f,network=Network(32b79070-3f05-4fa8-90ea-ba2ba6953db2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b800e13-6d') {{(pid=71509) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 11:01:39 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:01:39 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:01:39 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 11:01:39 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:01:39 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2b800e13-6d, may_exist=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:01:39 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2b800e13-6d, col_values=(('external_ids', {'iface-id': '2b800e13-6dff-47b1-aced-1f9b2600868f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9d:36:94', 'vm-uuid': 'a1fdcfb4-8700-48fe-9dec-1e8a4b766cba'}),)) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:01:39 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:01:39 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:01:39 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:01:39 user nova-compute[71509]: INFO os_vif [None req-0de8eda9-8634-4fa5-b854-01e1cfd0fa0a tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:36:94,bridge_name='br-int',has_traffic_filtering=True,id=2b800e13-6dff-47b1-aced-1f9b2600868f,network=Network(32b79070-3f05-4fa8-90ea-ba2ba6953db2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b800e13-6d')
Apr 14 11:01:39 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-0de8eda9-8634-4fa5-b854-01e1cfd0fa0a tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] No BDM found with device name vda, not building metadata. {{(pid=71509) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 11:01:39 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-0de8eda9-8634-4fa5-b854-01e1cfd0fa0a tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] No VIF found with MAC fa:16:3e:9d:36:94, not building metadata {{(pid=71509) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 11:01:39 user nova-compute[71509]: DEBUG nova.network.neutron [req-2d77909b-703e-4454-a575-417874a25442 req-21207653-2640-426b-ad79-1d4f1cc62ac2 service nova] [instance: a1fdcfb4-8700-48fe-9dec-1e8a4b766cba] Updated VIF entry in instance network info cache for port 2b800e13-6dff-47b1-aced-1f9b2600868f. {{(pid=71509) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 11:01:39 user nova-compute[71509]: DEBUG nova.network.neutron [req-2d77909b-703e-4454-a575-417874a25442 req-21207653-2640-426b-ad79-1d4f1cc62ac2 service nova] [instance: a1fdcfb4-8700-48fe-9dec-1e8a4b766cba] Updating instance_info_cache with network_info: [{"id": "2b800e13-6dff-47b1-aced-1f9b2600868f", "address": "fa:16:3e:9d:36:94", "network": {"id": "32b79070-3f05-4fa8-90ea-ba2ba6953db2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1189530156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "000980e0e886468b8df32c7373cde033", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b800e13-6d", "ovs_interfaceid": "2b800e13-6dff-47b1-aced-1f9b2600868f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:01:39 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-2d77909b-703e-4454-a575-417874a25442 req-21207653-2640-426b-ad79-1d4f1cc62ac2 service nova] Releasing lock "refresh_cache-a1fdcfb4-8700-48fe-9dec-1e8a4b766cba" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 11:01:40 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:01:40 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:01:41 user nova-compute[71509]: DEBUG nova.compute.manager [req-9cfeae2a-7c09-4dd4-974e-5350c00ae407 req-59d86223-33b3-4766-b7e5-c0944eb130b8 service nova] [instance: a1fdcfb4-8700-48fe-9dec-1e8a4b766cba] Received event network-vif-plugged-2b800e13-6dff-47b1-aced-1f9b2600868f {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:01:41 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-9cfeae2a-7c09-4dd4-974e-5350c00ae407 req-59d86223-33b3-4766-b7e5-c0944eb130b8 service nova] Acquiring lock "a1fdcfb4-8700-48fe-9dec-1e8a4b766cba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:01:41 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-9cfeae2a-7c09-4dd4-974e-5350c00ae407 req-59d86223-33b3-4766-b7e5-c0944eb130b8 service nova] Lock "a1fdcfb4-8700-48fe-9dec-1e8a4b766cba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:01:41 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-9cfeae2a-7c09-4dd4-974e-5350c00ae407 req-59d86223-33b3-4766-b7e5-c0944eb130b8 service nova] Lock "a1fdcfb4-8700-48fe-9dec-1e8a4b766cba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:01:41 user nova-compute[71509]: DEBUG nova.compute.manager [req-9cfeae2a-7c09-4dd4-974e-5350c00ae407 req-59d86223-33b3-4766-b7e5-c0944eb130b8 service nova] [instance: a1fdcfb4-8700-48fe-9dec-1e8a4b766cba] No waiting events found dispatching network-vif-plugged-2b800e13-6dff-47b1-aced-1f9b2600868f {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:01:41 user nova-compute[71509]: WARNING nova.compute.manager [req-9cfeae2a-7c09-4dd4-974e-5350c00ae407 req-59d86223-33b3-4766-b7e5-c0944eb130b8 service nova] [instance: a1fdcfb4-8700-48fe-9dec-1e8a4b766cba] Received unexpected event network-vif-plugged-2b800e13-6dff-47b1-aced-1f9b2600868f for instance with vm_state building and task_state spawning.
Apr 14 11:01:41 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-56b66c3c-450b-46f3-b6f3-02442274dd46 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "b96e2a1a-8c1b-4189-86b9-a3c1761a9813" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:01:41 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-56b66c3c-450b-46f3-b6f3-02442274dd46 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "b96e2a1a-8c1b-4189-86b9-a3c1761a9813" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:01:41 user nova-compute[71509]: DEBUG nova.compute.manager [None req-56b66c3c-450b-46f3-b6f3-02442274dd46 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: b96e2a1a-8c1b-4189-86b9-a3c1761a9813] Starting instance... {{(pid=71509) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 11:01:41 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-56b66c3c-450b-46f3-b6f3-02442274dd46 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:01:41 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-56b66c3c-450b-46f3-b6f3-02442274dd46 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:01:41 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-56b66c3c-450b-46f3-b6f3-02442274dd46 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71509) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 11:01:41 user nova-compute[71509]: INFO nova.compute.claims [None req-56b66c3c-450b-46f3-b6f3-02442274dd46 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: b96e2a1a-8c1b-4189-86b9-a3c1761a9813] Claim successful on node user
Apr 14 11:01:42 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-56b66c3c-450b-46f3-b6f3-02442274dd46 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 11:01:42 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-56b66c3c-450b-46f3-b6f3-02442274dd46 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 11:01:42 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-56b66c3c-450b-46f3-b6f3-02442274dd46 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.454s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:01:42 user nova-compute[71509]: DEBUG nova.compute.manager [None req-56b66c3c-450b-46f3-b6f3-02442274dd46 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: b96e2a1a-8c1b-4189-86b9-a3c1761a9813] Start building networks asynchronously for instance. {{(pid=71509) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 11:01:42 user nova-compute[71509]: DEBUG nova.compute.manager [None req-56b66c3c-450b-46f3-b6f3-02442274dd46 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: b96e2a1a-8c1b-4189-86b9-a3c1761a9813] Allocating IP information in the background. {{(pid=71509) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 11:01:42 user nova-compute[71509]: DEBUG nova.network.neutron [None req-56b66c3c-450b-46f3-b6f3-02442274dd46 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: b96e2a1a-8c1b-4189-86b9-a3c1761a9813] allocate_for_instance() {{(pid=71509) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 11:01:42 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-56b66c3c-450b-46f3-b6f3-02442274dd46 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: b96e2a1a-8c1b-4189-86b9-a3c1761a9813] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 11:01:42 user nova-compute[71509]: DEBUG nova.compute.manager [None req-56b66c3c-450b-46f3-b6f3-02442274dd46 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: b96e2a1a-8c1b-4189-86b9-a3c1761a9813] Start building block device mappings for instance. {{(pid=71509) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 11:01:42 user nova-compute[71509]: DEBUG nova.policy [None req-56b66c3c-450b-46f3-b6f3-02442274dd46 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '78adbbdcd10e446daddde754e46309b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb8f294f957f4c74ae959c1e9f238427', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71509) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 11:01:42 user nova-compute[71509]: DEBUG nova.compute.manager [None req-56b66c3c-450b-46f3-b6f3-02442274dd46 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: b96e2a1a-8c1b-4189-86b9-a3c1761a9813] Start spawning the instance on the hypervisor. {{(pid=71509) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 11:01:42 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-56b66c3c-450b-46f3-b6f3-02442274dd46 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: b96e2a1a-8c1b-4189-86b9-a3c1761a9813] Creating instance directory {{(pid=71509) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 11:01:42 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-56b66c3c-450b-46f3-b6f3-02442274dd46 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: b96e2a1a-8c1b-4189-86b9-a3c1761a9813] Creating image(s)
Apr 14 11:01:42 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-56b66c3c-450b-46f3-b6f3-02442274dd46 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "/opt/stack/data/nova/instances/b96e2a1a-8c1b-4189-86b9-a3c1761a9813/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:01:42 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-56b66c3c-450b-46f3-b6f3-02442274dd46 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "/opt/stack/data/nova/instances/b96e2a1a-8c1b-4189-86b9-a3c1761a9813/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:01:42 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-56b66c3c-450b-46f3-b6f3-02442274dd46 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "/opt/stack/data/nova/instances/b96e2a1a-8c1b-4189-86b9-a3c1761a9813/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:01:42 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-56b66c3c-450b-46f3-b6f3-02442274dd46 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:01:42 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-56b66c3c-450b-46f3-b6f3-02442274dd46 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json" returned: 0 in 0.157s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:01:42 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-56b66c3c-450b-46f3-b6f3-02442274dd46 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:01:42 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-56b66c3c-450b-46f3-b6f3-02442274dd46 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:01:42 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-56b66c3c-450b-46f3-b6f3-02442274dd46 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:01:42 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-56b66c3c-450b-46f3-b6f3-02442274dd46 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json" returned: 0 in 0.178s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:01:42 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-56b66c3c-450b-46f3-b6f3-02442274dd46 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18,backing_fmt=raw /opt/stack/data/nova/instances/b96e2a1a-8c1b-4189-86b9-a3c1761a9813/disk 1073741824 {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:01:42 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-56b66c3c-450b-46f3-b6f3-02442274dd46 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18,backing_fmt=raw /opt/stack/data/nova/instances/b96e2a1a-8c1b-4189-86b9-a3c1761a9813/disk 1073741824" returned: 0 in 0.074s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:01:42 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-56b66c3c-450b-46f3-b6f3-02442274dd46 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.259s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:01:42 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-56b66c3c-450b-46f3-b6f3-02442274dd46 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:01:42 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681470102.8959665, a1fdcfb4-8700-48fe-9dec-1e8a4b766cba => Resumed> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 11:01:42 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: a1fdcfb4-8700-48fe-9dec-1e8a4b766cba] VM Resumed (Lifecycle Event)
Apr 14 11:01:42 user nova-compute[71509]: DEBUG nova.compute.manager [None req-0de8eda9-8634-4fa5-b854-01e1cfd0fa0a tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] [instance: a1fdcfb4-8700-48fe-9dec-1e8a4b766cba] Instance event wait completed in 0 seconds for  {{(pid=71509) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 11:01:42 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-0de8eda9-8634-4fa5-b854-01e1cfd0fa0a tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] [instance: a1fdcfb4-8700-48fe-9dec-1e8a4b766cba] Guest created on hypervisor {{(pid=71509) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 11:01:42 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-56b66c3c-450b-46f3-b6f3-02442274dd46 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json" returned: 0 in 0.145s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:01:42 user nova-compute[71509]: DEBUG nova.virt.disk.api [None req-56b66c3c-450b-46f3-b6f3-02442274dd46 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b96e2a1a-8c1b-4189-86b9-a3c1761a9813/disk. size=1073741824 {{(pid=71509) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 11:01:42 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-56b66c3c-450b-46f3-b6f3-02442274dd46 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b96e2a1a-8c1b-4189-86b9-a3c1761a9813/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:01:42 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: a1fdcfb4-8700-48fe-9dec-1e8a4b766cba] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 11:01:42 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: a1fdcfb4-8700-48fe-9dec-1e8a4b766cba] Instance spawned successfully.
Apr 14 11:01:42 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-0de8eda9-8634-4fa5-b854-01e1cfd0fa0a tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] [instance: a1fdcfb4-8700-48fe-9dec-1e8a4b766cba] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 11:01:42 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: a1fdcfb4-8700-48fe-9dec-1e8a4b766cba] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 11:01:42 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-0de8eda9-8634-4fa5-b854-01e1cfd0fa0a tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] [instance: a1fdcfb4-8700-48fe-9dec-1e8a4b766cba] Found default for hw_cdrom_bus of ide {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:01:42 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-0de8eda9-8634-4fa5-b854-01e1cfd0fa0a tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] [instance: a1fdcfb4-8700-48fe-9dec-1e8a4b766cba] Found default for hw_disk_bus of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:01:42 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-0de8eda9-8634-4fa5-b854-01e1cfd0fa0a tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] [instance: a1fdcfb4-8700-48fe-9dec-1e8a4b766cba] Found default for hw_input_bus of None {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:01:42 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-0de8eda9-8634-4fa5-b854-01e1cfd0fa0a tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] [instance: a1fdcfb4-8700-48fe-9dec-1e8a4b766cba] Found default for hw_pointer_model of None {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:01:42 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-0de8eda9-8634-4fa5-b854-01e1cfd0fa0a tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] [instance: a1fdcfb4-8700-48fe-9dec-1e8a4b766cba] Found default for hw_video_model of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:01:43 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-0de8eda9-8634-4fa5-b854-01e1cfd0fa0a tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] [instance: a1fdcfb4-8700-48fe-9dec-1e8a4b766cba] Found default for hw_vif_model of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:01:43 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: a1fdcfb4-8700-48fe-9dec-1e8a4b766cba] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 11:01:43 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681470102.9009416, a1fdcfb4-8700-48fe-9dec-1e8a4b766cba => Started> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 11:01:43 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: a1fdcfb4-8700-48fe-9dec-1e8a4b766cba] VM Started (Lifecycle Event)
Apr 14 11:01:43 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: a1fdcfb4-8700-48fe-9dec-1e8a4b766cba] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 11:01:43 user nova-compute[71509]: DEBUG nova.network.neutron [None req-56b66c3c-450b-46f3-b6f3-02442274dd46 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: b96e2a1a-8c1b-4189-86b9-a3c1761a9813] Successfully created port: 7ee72a8e-db85-4e30-91e5-193e21c386cd {{(pid=71509) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 11:01:43 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: a1fdcfb4-8700-48fe-9dec-1e8a4b766cba] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 11:01:43 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: a1fdcfb4-8700-48fe-9dec-1e8a4b766cba] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 11:01:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-56b66c3c-450b-46f3-b6f3-02442274dd46 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b96e2a1a-8c1b-4189-86b9-a3c1761a9813/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:01:43 user nova-compute[71509]: DEBUG nova.virt.disk.api [None req-56b66c3c-450b-46f3-b6f3-02442274dd46 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Cannot resize image /opt/stack/data/nova/instances/b96e2a1a-8c1b-4189-86b9-a3c1761a9813/disk to a smaller size. {{(pid=71509) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 11:01:43 user nova-compute[71509]: DEBUG nova.objects.instance [None req-56b66c3c-450b-46f3-b6f3-02442274dd46 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lazy-loading 'migration_context' on Instance uuid b96e2a1a-8c1b-4189-86b9-a3c1761a9813 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 11:01:43 user nova-compute[71509]: INFO nova.compute.manager [None req-0de8eda9-8634-4fa5-b854-01e1cfd0fa0a tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] [instance: a1fdcfb4-8700-48fe-9dec-1e8a4b766cba] Took 6.32 seconds to spawn the instance on the hypervisor.
Apr 14 11:01:43 user nova-compute[71509]: DEBUG nova.compute.manager [None req-0de8eda9-8634-4fa5-b854-01e1cfd0fa0a tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] [instance: a1fdcfb4-8700-48fe-9dec-1e8a4b766cba] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 11:01:43 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-56b66c3c-450b-46f3-b6f3-02442274dd46 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: b96e2a1a-8c1b-4189-86b9-a3c1761a9813] Created local disks {{(pid=71509) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 11:01:43 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-56b66c3c-450b-46f3-b6f3-02442274dd46 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: b96e2a1a-8c1b-4189-86b9-a3c1761a9813] Ensure instance console log exists: /opt/stack/data/nova/instances/b96e2a1a-8c1b-4189-86b9-a3c1761a9813/console.log {{(pid=71509) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 11:01:43 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-56b66c3c-450b-46f3-b6f3-02442274dd46 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:01:43 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-56b66c3c-450b-46f3-b6f3-02442274dd46 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:01:43 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-56b66c3c-450b-46f3-b6f3-02442274dd46 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:01:43 user nova-compute[71509]: DEBUG nova.compute.manager [req-32ff367f-0f58-43c4-88c0-48293e5d38ac req-eb224e72-df78-4490-bec5-b08c440d456d service nova] [instance: a1fdcfb4-8700-48fe-9dec-1e8a4b766cba] Received event network-vif-plugged-2b800e13-6dff-47b1-aced-1f9b2600868f {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:01:43 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-32ff367f-0f58-43c4-88c0-48293e5d38ac req-eb224e72-df78-4490-bec5-b08c440d456d service nova] Acquiring lock "a1fdcfb4-8700-48fe-9dec-1e8a4b766cba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:01:43 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-32ff367f-0f58-43c4-88c0-48293e5d38ac req-eb224e72-df78-4490-bec5-b08c440d456d service nova] Lock "a1fdcfb4-8700-48fe-9dec-1e8a4b766cba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:01:43 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-32ff367f-0f58-43c4-88c0-48293e5d38ac req-eb224e72-df78-4490-bec5-b08c440d456d service nova] Lock "a1fdcfb4-8700-48fe-9dec-1e8a4b766cba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:01:43 user nova-compute[71509]: DEBUG nova.compute.manager [req-32ff367f-0f58-43c4-88c0-48293e5d38ac req-eb224e72-df78-4490-bec5-b08c440d456d service nova] [instance: a1fdcfb4-8700-48fe-9dec-1e8a4b766cba] No waiting events found dispatching network-vif-plugged-2b800e13-6dff-47b1-aced-1f9b2600868f {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:01:43 user nova-compute[71509]: WARNING nova.compute.manager [req-32ff367f-0f58-43c4-88c0-48293e5d38ac req-eb224e72-df78-4490-bec5-b08c440d456d service nova] [instance: a1fdcfb4-8700-48fe-9dec-1e8a4b766cba] Received unexpected event network-vif-plugged-2b800e13-6dff-47b1-aced-1f9b2600868f for instance with vm_state active and task_state None.
Apr 14 11:01:43 user nova-compute[71509]: INFO nova.compute.manager [None req-0de8eda9-8634-4fa5-b854-01e1cfd0fa0a tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] [instance: a1fdcfb4-8700-48fe-9dec-1e8a4b766cba] Took 7.25 seconds to build instance.
Apr 14 11:01:43 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-0de8eda9-8634-4fa5-b854-01e1cfd0fa0a tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] Lock "a1fdcfb4-8700-48fe-9dec-1e8a4b766cba" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.450s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:01:43 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:01:43 user nova-compute[71509]: DEBUG nova.network.neutron [None req-56b66c3c-450b-46f3-b6f3-02442274dd46 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: b96e2a1a-8c1b-4189-86b9-a3c1761a9813] Successfully updated port: 7ee72a8e-db85-4e30-91e5-193e21c386cd {{(pid=71509) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 11:01:43 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-56b66c3c-450b-46f3-b6f3-02442274dd46 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "refresh_cache-b96e2a1a-8c1b-4189-86b9-a3c1761a9813" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 11:01:43 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-56b66c3c-450b-46f3-b6f3-02442274dd46 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquired lock "refresh_cache-b96e2a1a-8c1b-4189-86b9-a3c1761a9813" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 11:01:43 user nova-compute[71509]: DEBUG nova.network.neutron [None req-56b66c3c-450b-46f3-b6f3-02442274dd46 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: b96e2a1a-8c1b-4189-86b9-a3c1761a9813] Building network info cache for instance {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 11:01:43 user nova-compute[71509]: DEBUG nova.network.neutron [None req-56b66c3c-450b-46f3-b6f3-02442274dd46 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: b96e2a1a-8c1b-4189-86b9-a3c1761a9813] Instance cache missing network info. {{(pid=71509) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 11:01:44 user nova-compute[71509]: DEBUG nova.network.neutron [None req-56b66c3c-450b-46f3-b6f3-02442274dd46 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: b96e2a1a-8c1b-4189-86b9-a3c1761a9813] Updating instance_info_cache with network_info: [{"id": "7ee72a8e-db85-4e30-91e5-193e21c386cd", "address": "fa:16:3e:b4:85:a8", "network": {"id": "b639a68a-2b4e-435c-b98b-65b5b4981c73", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1070821894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb8f294f957f4c74ae959c1e9f238427", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ee72a8e-db", "ovs_interfaceid": "7ee72a8e-db85-4e30-91e5-193e21c386cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:01:44 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-56b66c3c-450b-46f3-b6f3-02442274dd46 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Releasing lock "refresh_cache-b96e2a1a-8c1b-4189-86b9-a3c1761a9813" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 11:01:44 user nova-compute[71509]: DEBUG nova.compute.manager [None req-56b66c3c-450b-46f3-b6f3-02442274dd46 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: b96e2a1a-8c1b-4189-86b9-a3c1761a9813] Instance network_info: |[{"id": "7ee72a8e-db85-4e30-91e5-193e21c386cd", "address": "fa:16:3e:b4:85:a8", "network": {"id": "b639a68a-2b4e-435c-b98b-65b5b4981c73", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1070821894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb8f294f957f4c74ae959c1e9f238427", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ee72a8e-db", "ovs_interfaceid": "7ee72a8e-db85-4e30-91e5-193e21c386cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71509) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 11:01:44 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-56b66c3c-450b-46f3-b6f3-02442274dd46 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: b96e2a1a-8c1b-4189-86b9-a3c1761a9813] Start _get_guest_xml network_info=[{"id": "7ee72a8e-db85-4e30-91e5-193e21c386cd", "address": "fa:16:3e:b4:85:a8", "network": {"id": "b639a68a-2b4e-435c-b98b-65b5b4981c73", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1070821894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb8f294f957f4c74ae959c1e9f238427", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ee72a8e-db", "ovs_interfaceid": "7ee72a8e-db85-4e30-91e5-193e21c386cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T10:38:55Z,direct_url=<?>,disk_format='qcow2',id=048ec0ee-0465-448d-8b4c-f072acb101dc,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='9742d6ad20cf48d9bab0fdbcc9491db9',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T10:38:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '048ec0ee-0465-448d-8b4c-f072acb101dc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71509) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 11:01:44 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-56b66c3c-450b-46f3-b6f3-02442274dd46 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 11:01:44 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-56b66c3c-450b-46f3-b6f3-02442274dd46 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 11:01:44 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-56b66c3c-450b-46f3-b6f3-02442274dd46 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71509) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 11:01:44 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-56b66c3c-450b-46f3-b6f3-02442274dd46 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T10:40:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T10:38:55Z,direct_url=<?>,disk_format='qcow2',id=048ec0ee-0465-448d-8b4c-f072acb101dc,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='9742d6ad20cf48d9bab0fdbcc9491db9',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T10:38:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 11:01:44 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-56b66c3c-450b-46f3-b6f3-02442274dd46 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Flavor limits 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 11:01:44 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-56b66c3c-450b-46f3-b6f3-02442274dd46 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Image limits 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 11:01:44 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-56b66c3c-450b-46f3-b6f3-02442274dd46 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Flavor pref 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 11:01:44 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-56b66c3c-450b-46f3-b6f3-02442274dd46 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Image pref 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 11:01:44 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-56b66c3c-450b-46f3-b6f3-02442274dd46 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 11:01:44 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-56b66c3c-450b-46f3-b6f3-02442274dd46 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 11:01:44 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-56b66c3c-450b-46f3-b6f3-02442274dd46 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71509) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 11:01:44 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-56b66c3c-450b-46f3-b6f3-02442274dd46 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Got 1 possible topologies {{(pid=71509) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 11:01:44 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-56b66c3c-450b-46f3-b6f3-02442274dd46 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 11:01:44 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-56b66c3c-450b-46f3-b6f3-02442274dd46 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 11:01:44 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-56b66c3c-450b-46f3-b6f3-02442274dd46 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T11:01:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-391849424',display_name='tempest-AttachVolumeNegativeTest-server-391849424',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-391849424',id=39,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDUMt0cUlOh1dr6H24aOsI+tMVji84u3t7+LMjK6oGFZgRyd4eLIdFiX15GuGpnHHIIOHuFjVOsPnQ4vCH+2At3po6hk4ZhK8XpaMubuDoAKWSrrVyVLSqgOoqGX6zYnBA==',key_name='tempest-keypair-1834404942',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cb8f294f957f4c74ae959c1e9f238427',ramdisk_id='',reservation_id='r-db8u4052',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-531644967',owner_user_name='tempest-AttachVolumeNegativeTest-531644967-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T11:01:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='78adbbdcd10e446daddde754e46309b2',uuid=b96e2a1a-8c1b-4189-86b9-a3c1761a9813,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7ee72a8e-db85-4e30-91e5-193e21c386cd", "address": "fa:16:3e:b4:85:a8", "network": {"id": "b639a68a-2b4e-435c-b98b-65b5b4981c73", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1070821894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb8f294f957f4c74ae959c1e9f238427", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ee72a8e-db", "ovs_interfaceid": "7ee72a8e-db85-4e30-91e5-193e21c386cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71509) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 11:01:44 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-56b66c3c-450b-46f3-b6f3-02442274dd46 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Converting VIF {"id": "7ee72a8e-db85-4e30-91e5-193e21c386cd", "address": "fa:16:3e:b4:85:a8", "network": {"id": "b639a68a-2b4e-435c-b98b-65b5b4981c73", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1070821894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb8f294f957f4c74ae959c1e9f238427", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ee72a8e-db", "ovs_interfaceid": "7ee72a8e-db85-4e30-91e5-193e21c386cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 11:01:44 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-56b66c3c-450b-46f3-b6f3-02442274dd46 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:85:a8,bridge_name='br-int',has_traffic_filtering=True,id=7ee72a8e-db85-4e30-91e5-193e21c386cd,network=Network(b639a68a-2b4e-435c-b98b-65b5b4981c73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ee72a8e-db') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 11:01:44 user nova-compute[71509]: DEBUG nova.objects.instance [None req-56b66c3c-450b-46f3-b6f3-02442274dd46 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lazy-loading 'pci_devices' on Instance uuid b96e2a1a-8c1b-4189-86b9-a3c1761a9813 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 11:01:44 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-56b66c3c-450b-46f3-b6f3-02442274dd46 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: b96e2a1a-8c1b-4189-86b9-a3c1761a9813] End _get_guest_xml xml=<domain type="kvm">
Apr 14 11:01:44 user nova-compute[71509]:   <uuid>b96e2a1a-8c1b-4189-86b9-a3c1761a9813</uuid>
Apr 14 11:01:44 user nova-compute[71509]:   <name>instance-00000027</name>
Apr 14 11:01:44 user nova-compute[71509]:   <memory>131072</memory>
Apr 14 11:01:44 user nova-compute[71509]:   <vcpu>1</vcpu>
Apr 14 11:01:44 user nova-compute[71509]:   <metadata>
Apr 14 11:01:44 user nova-compute[71509]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 11:01:44 user nova-compute[71509]:       <nova:package version="0.0.0"/>
Apr 14 11:01:44 user nova-compute[71509]:       <nova:name>tempest-AttachVolumeNegativeTest-server-391849424</nova:name>
Apr 14 11:01:44 user nova-compute[71509]:       <nova:creationTime>2023-04-14 11:01:44</nova:creationTime>
Apr 14 11:01:44 user nova-compute[71509]:       <nova:flavor name="m1.nano">
Apr 14 11:01:44 user nova-compute[71509]:         <nova:memory>128</nova:memory>
Apr 14 11:01:44 user nova-compute[71509]:         <nova:disk>1</nova:disk>
Apr 14 11:01:44 user nova-compute[71509]:         <nova:swap>0</nova:swap>
Apr 14 11:01:44 user nova-compute[71509]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 11:01:44 user nova-compute[71509]:         <nova:vcpus>1</nova:vcpus>
Apr 14 11:01:44 user nova-compute[71509]:       </nova:flavor>
Apr 14 11:01:44 user nova-compute[71509]:       <nova:owner>
Apr 14 11:01:44 user nova-compute[71509]:         <nova:user uuid="78adbbdcd10e446daddde754e46309b2">tempest-AttachVolumeNegativeTest-531644967-project-member</nova:user>
Apr 14 11:01:44 user nova-compute[71509]:         <nova:project uuid="cb8f294f957f4c74ae959c1e9f238427">tempest-AttachVolumeNegativeTest-531644967</nova:project>
Apr 14 11:01:44 user nova-compute[71509]:       </nova:owner>
Apr 14 11:01:44 user nova-compute[71509]:       <nova:root type="image" uuid="048ec0ee-0465-448d-8b4c-f072acb101dc"/>
Apr 14 11:01:44 user nova-compute[71509]:       <nova:ports>
Apr 14 11:01:44 user nova-compute[71509]:         <nova:port uuid="7ee72a8e-db85-4e30-91e5-193e21c386cd">
Apr 14 11:01:44 user nova-compute[71509]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 14 11:01:44 user nova-compute[71509]:         </nova:port>
Apr 14 11:01:44 user nova-compute[71509]:       </nova:ports>
Apr 14 11:01:44 user nova-compute[71509]:     </nova:instance>
Apr 14 11:01:44 user nova-compute[71509]:   </metadata>
Apr 14 11:01:44 user nova-compute[71509]:   <sysinfo type="smbios">
Apr 14 11:01:44 user nova-compute[71509]:     <system>
Apr 14 11:01:44 user nova-compute[71509]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 11:01:44 user nova-compute[71509]:       <entry name="product">OpenStack Nova</entry>
Apr 14 11:01:44 user nova-compute[71509]:       <entry name="version">0.0.0</entry>
Apr 14 11:01:44 user nova-compute[71509]:       <entry name="serial">b96e2a1a-8c1b-4189-86b9-a3c1761a9813</entry>
Apr 14 11:01:44 user nova-compute[71509]:       <entry name="uuid">b96e2a1a-8c1b-4189-86b9-a3c1761a9813</entry>
Apr 14 11:01:44 user nova-compute[71509]:       <entry name="family">Virtual Machine</entry>
Apr 14 11:01:44 user nova-compute[71509]:     </system>
Apr 14 11:01:44 user nova-compute[71509]:   </sysinfo>
Apr 14 11:01:44 user nova-compute[71509]:   <os>
Apr 14 11:01:44 user nova-compute[71509]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 11:01:44 user nova-compute[71509]:     <boot dev="hd"/>
Apr 14 11:01:44 user nova-compute[71509]:     <smbios mode="sysinfo"/>
Apr 14 11:01:44 user nova-compute[71509]:   </os>
Apr 14 11:01:44 user nova-compute[71509]:   <features>
Apr 14 11:01:44 user nova-compute[71509]:     <acpi/>
Apr 14 11:01:44 user nova-compute[71509]:     <apic/>
Apr 14 11:01:44 user nova-compute[71509]:     <vmcoreinfo/>
Apr 14 11:01:44 user nova-compute[71509]:   </features>
Apr 14 11:01:44 user nova-compute[71509]:   <clock offset="utc">
Apr 14 11:01:44 user nova-compute[71509]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 11:01:44 user nova-compute[71509]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 11:01:44 user nova-compute[71509]:     <timer name="hpet" present="no"/>
Apr 14 11:01:44 user nova-compute[71509]:   </clock>
Apr 14 11:01:44 user nova-compute[71509]:   <cpu mode="custom" match="exact">
Apr 14 11:01:44 user nova-compute[71509]:     <model>Nehalem</model>
Apr 14 11:01:44 user nova-compute[71509]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 11:01:44 user nova-compute[71509]:   </cpu>
Apr 14 11:01:44 user nova-compute[71509]:   <devices>
Apr 14 11:01:44 user nova-compute[71509]:     <disk type="file" device="disk">
Apr 14 11:01:44 user nova-compute[71509]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 11:01:44 user nova-compute[71509]:       <source file="/opt/stack/data/nova/instances/b96e2a1a-8c1b-4189-86b9-a3c1761a9813/disk"/>
Apr 14 11:01:44 user nova-compute[71509]:       <target dev="vda" bus="virtio"/>
Apr 14 11:01:44 user nova-compute[71509]:     </disk>
Apr 14 11:01:44 user nova-compute[71509]:     <interface type="ethernet">
Apr 14 11:01:44 user nova-compute[71509]:       <mac address="fa:16:3e:b4:85:a8"/>
Apr 14 11:01:44 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 11:01:44 user nova-compute[71509]:       <mtu size="1442"/>
Apr 14 11:01:44 user nova-compute[71509]:       <target dev="tap7ee72a8e-db"/>
Apr 14 11:01:44 user nova-compute[71509]:     </interface>
Apr 14 11:01:44 user nova-compute[71509]:     <serial type="pty">
Apr 14 11:01:44 user nova-compute[71509]:       <log file="/opt/stack/data/nova/instances/b96e2a1a-8c1b-4189-86b9-a3c1761a9813/console.log" append="off"/>
Apr 14 11:01:44 user nova-compute[71509]:     </serial>
Apr 14 11:01:44 user nova-compute[71509]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 11:01:44 user nova-compute[71509]:     <video>
Apr 14 11:01:44 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 11:01:44 user nova-compute[71509]:     </video>
Apr 14 11:01:44 user nova-compute[71509]:     <rng model="virtio">
Apr 14 11:01:44 user nova-compute[71509]:       <backend model="random">/dev/urandom</backend>
Apr 14 11:01:44 user nova-compute[71509]:     </rng>
Apr 14 11:01:44 user nova-compute[71509]:     <controller type="usb" index="0" model="none"/>
Apr 14 11:01:44 user nova-compute[71509]:     <memballoon model="virtio">
Apr 14 11:01:44 user nova-compute[71509]:       <stats period="10"/>
Apr 14 11:01:44 user nova-compute[71509]:     </memballoon>
Apr 14 11:01:44 user nova-compute[71509]:   </devices>
Apr 14 11:01:44 user nova-compute[71509]: </domain>
Apr 14 11:01:44 user nova-compute[71509]:  {{(pid=71509) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 11:01:44 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-56b66c3c-450b-46f3-b6f3-02442274dd46 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T11:01:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-391849424',display_name='tempest-AttachVolumeNegativeTest-server-391849424',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-391849424',id=39,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDUMt0cUlOh1dr6H24aOsI+tMVji84u3t7+LMjK6oGFZgRyd4eLIdFiX15GuGpnHHIIOHuFjVOsPnQ4vCH+2At3po6hk4ZhK8XpaMubuDoAKWSrrVyVLSqgOoqGX6zYnBA==',key_name='tempest-keypair-1834404942',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cb8f294f957f4c74ae959c1e9f238427',ramdisk_id='',reservation_id='r-db8u4052',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-531644967',owner_user_name='tempest-AttachVolumeNegativeTest-531644967-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T11:01:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='78adbbdcd10e446daddde754e46309b2',uuid=b96e2a1a-8c1b-4189-86b9-a3c1761a9813,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7ee72a8e-db85-4e30-91e5-193e21c386cd", "address": "fa:16:3e:b4:85:a8", "network": {"id": "b639a68a-2b4e-435c-b98b-65b5b4981c73", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1070821894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb8f294f957f4c74ae959c1e9f238427", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ee72a8e-db", "ovs_interfaceid": "7ee72a8e-db85-4e30-91e5-193e21c386cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 11:01:44 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-56b66c3c-450b-46f3-b6f3-02442274dd46 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Converting VIF {"id": "7ee72a8e-db85-4e30-91e5-193e21c386cd", "address": "fa:16:3e:b4:85:a8", "network": {"id": "b639a68a-2b4e-435c-b98b-65b5b4981c73", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1070821894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb8f294f957f4c74ae959c1e9f238427", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ee72a8e-db", "ovs_interfaceid": "7ee72a8e-db85-4e30-91e5-193e21c386cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 11:01:44 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-56b66c3c-450b-46f3-b6f3-02442274dd46 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:85:a8,bridge_name='br-int',has_traffic_filtering=True,id=7ee72a8e-db85-4e30-91e5-193e21c386cd,network=Network(b639a68a-2b4e-435c-b98b-65b5b4981c73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ee72a8e-db') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 11:01:44 user nova-compute[71509]: DEBUG os_vif [None req-56b66c3c-450b-46f3-b6f3-02442274dd46 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:85:a8,bridge_name='br-int',has_traffic_filtering=True,id=7ee72a8e-db85-4e30-91e5-193e21c386cd,network=Network(b639a68a-2b4e-435c-b98b-65b5b4981c73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ee72a8e-db') {{(pid=71509) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 11:01:44 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:01:44 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:01:44 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 11:01:44 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:01:44 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7ee72a8e-db, may_exist=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:01:44 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7ee72a8e-db, col_values=(('external_ids', {'iface-id': '7ee72a8e-db85-4e30-91e5-193e21c386cd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b4:85:a8', 'vm-uuid': 'b96e2a1a-8c1b-4189-86b9-a3c1761a9813'}),)) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:01:44 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:01:44 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:01:44 user nova-compute[71509]: INFO os_vif [None req-56b66c3c-450b-46f3-b6f3-02442274dd46 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:85:a8,bridge_name='br-int',has_traffic_filtering=True,id=7ee72a8e-db85-4e30-91e5-193e21c386cd,network=Network(b639a68a-2b4e-435c-b98b-65b5b4981c73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ee72a8e-db')
Apr 14 11:01:44 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-56b66c3c-450b-46f3-b6f3-02442274dd46 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] No BDM found with device name vda, not building metadata. {{(pid=71509) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 11:01:44 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-56b66c3c-450b-46f3-b6f3-02442274dd46 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] No VIF found with MAC fa:16:3e:b4:85:a8, not building metadata {{(pid=71509) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 11:01:45 user nova-compute[71509]: DEBUG nova.compute.manager [req-1ce46fec-bbe0-4ff0-a553-687910707206 req-bb8afd83-53d2-4922-a7ff-85b77a158e3e service nova] [instance: b96e2a1a-8c1b-4189-86b9-a3c1761a9813] Received event network-changed-7ee72a8e-db85-4e30-91e5-193e21c386cd {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:01:45 user nova-compute[71509]: DEBUG nova.compute.manager [req-1ce46fec-bbe0-4ff0-a553-687910707206 req-bb8afd83-53d2-4922-a7ff-85b77a158e3e service nova] [instance: b96e2a1a-8c1b-4189-86b9-a3c1761a9813] Refreshing instance network info cache due to event network-changed-7ee72a8e-db85-4e30-91e5-193e21c386cd. {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 11:01:45 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-1ce46fec-bbe0-4ff0-a553-687910707206 req-bb8afd83-53d2-4922-a7ff-85b77a158e3e service nova] Acquiring lock "refresh_cache-b96e2a1a-8c1b-4189-86b9-a3c1761a9813" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 11:01:45 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-1ce46fec-bbe0-4ff0-a553-687910707206 req-bb8afd83-53d2-4922-a7ff-85b77a158e3e service nova] Acquired lock "refresh_cache-b96e2a1a-8c1b-4189-86b9-a3c1761a9813" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 11:01:45 user nova-compute[71509]: DEBUG nova.network.neutron [req-1ce46fec-bbe0-4ff0-a553-687910707206 req-bb8afd83-53d2-4922-a7ff-85b77a158e3e service nova] [instance: b96e2a1a-8c1b-4189-86b9-a3c1761a9813] Refreshing network info cache for port 7ee72a8e-db85-4e30-91e5-193e21c386cd {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 11:01:45 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:01:45 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:01:45 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:01:45 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:01:45 user nova-compute[71509]: DEBUG nova.network.neutron [req-1ce46fec-bbe0-4ff0-a553-687910707206 req-bb8afd83-53d2-4922-a7ff-85b77a158e3e service nova] [instance: b96e2a1a-8c1b-4189-86b9-a3c1761a9813] Updated VIF entry in instance network info cache for port 7ee72a8e-db85-4e30-91e5-193e21c386cd. {{(pid=71509) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 11:01:45 user nova-compute[71509]: DEBUG nova.network.neutron [req-1ce46fec-bbe0-4ff0-a553-687910707206 req-bb8afd83-53d2-4922-a7ff-85b77a158e3e service nova] [instance: b96e2a1a-8c1b-4189-86b9-a3c1761a9813] Updating instance_info_cache with network_info: [{"id": "7ee72a8e-db85-4e30-91e5-193e21c386cd", "address": "fa:16:3e:b4:85:a8", "network": {"id": "b639a68a-2b4e-435c-b98b-65b5b4981c73", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1070821894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb8f294f957f4c74ae959c1e9f238427", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ee72a8e-db", "ovs_interfaceid": "7ee72a8e-db85-4e30-91e5-193e21c386cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:01:45 user nova-compute[71509]: DEBUG nova.compute.manager [req-c294fb21-2c9a-4924-9fee-8d8b6057eba0 req-fd721aab-e7b2-435c-9f04-a6fb4bfa3356 service nova] [instance: b96e2a1a-8c1b-4189-86b9-a3c1761a9813] Received event network-vif-plugged-7ee72a8e-db85-4e30-91e5-193e21c386cd {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:01:45 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-c294fb21-2c9a-4924-9fee-8d8b6057eba0 req-fd721aab-e7b2-435c-9f04-a6fb4bfa3356 service nova] Acquiring lock "b96e2a1a-8c1b-4189-86b9-a3c1761a9813-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:01:45 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-c294fb21-2c9a-4924-9fee-8d8b6057eba0 req-fd721aab-e7b2-435c-9f04-a6fb4bfa3356 service nova] Lock "b96e2a1a-8c1b-4189-86b9-a3c1761a9813-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:01:45 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-c294fb21-2c9a-4924-9fee-8d8b6057eba0 req-fd721aab-e7b2-435c-9f04-a6fb4bfa3356 service nova] Lock "b96e2a1a-8c1b-4189-86b9-a3c1761a9813-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:01:45 user nova-compute[71509]: DEBUG nova.compute.manager [req-c294fb21-2c9a-4924-9fee-8d8b6057eba0 req-fd721aab-e7b2-435c-9f04-a6fb4bfa3356 service nova] [instance: b96e2a1a-8c1b-4189-86b9-a3c1761a9813] No waiting events found dispatching network-vif-plugged-7ee72a8e-db85-4e30-91e5-193e21c386cd {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:01:45 user nova-compute[71509]: WARNING nova.compute.manager [req-c294fb21-2c9a-4924-9fee-8d8b6057eba0 req-fd721aab-e7b2-435c-9f04-a6fb4bfa3356 service nova] [instance: b96e2a1a-8c1b-4189-86b9-a3c1761a9813] Received unexpected event network-vif-plugged-7ee72a8e-db85-4e30-91e5-193e21c386cd for instance with vm_state building and task_state spawning.
Apr 14 11:01:45 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-1ce46fec-bbe0-4ff0-a553-687910707206 req-bb8afd83-53d2-4922-a7ff-85b77a158e3e service nova] Releasing lock "refresh_cache-b96e2a1a-8c1b-4189-86b9-a3c1761a9813" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 11:01:46 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:01:46 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:01:46 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:01:46 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:01:46 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:01:47 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:01:47 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:01:47 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:01:47 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:01:47 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71509) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 11:01:47 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681470107.6806638, b96e2a1a-8c1b-4189-86b9-a3c1761a9813 => Resumed> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 11:01:47 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: b96e2a1a-8c1b-4189-86b9-a3c1761a9813] VM Resumed (Lifecycle Event)
Apr 14 11:01:47 user nova-compute[71509]: DEBUG nova.compute.manager [None req-56b66c3c-450b-46f3-b6f3-02442274dd46 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: b96e2a1a-8c1b-4189-86b9-a3c1761a9813] Instance event wait completed in 0 seconds for  {{(pid=71509) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 11:01:47 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-56b66c3c-450b-46f3-b6f3-02442274dd46 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: b96e2a1a-8c1b-4189-86b9-a3c1761a9813] Guest created on hypervisor {{(pid=71509) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 11:01:47 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: b96e2a1a-8c1b-4189-86b9-a3c1761a9813] Instance spawned successfully.
Apr 14 11:01:47 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-56b66c3c-450b-46f3-b6f3-02442274dd46 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: b96e2a1a-8c1b-4189-86b9-a3c1761a9813] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 11:01:47 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: b96e2a1a-8c1b-4189-86b9-a3c1761a9813] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 11:01:47 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: b96e2a1a-8c1b-4189-86b9-a3c1761a9813] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 11:01:47 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-56b66c3c-450b-46f3-b6f3-02442274dd46 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: b96e2a1a-8c1b-4189-86b9-a3c1761a9813] Found default for hw_cdrom_bus of ide {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:01:47 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-56b66c3c-450b-46f3-b6f3-02442274dd46 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: b96e2a1a-8c1b-4189-86b9-a3c1761a9813] Found default for hw_disk_bus of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:01:47 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-56b66c3c-450b-46f3-b6f3-02442274dd46 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: b96e2a1a-8c1b-4189-86b9-a3c1761a9813] Found default for hw_input_bus of None {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:01:47 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-56b66c3c-450b-46f3-b6f3-02442274dd46 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: b96e2a1a-8c1b-4189-86b9-a3c1761a9813] Found default for hw_pointer_model of None {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:01:47 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-56b66c3c-450b-46f3-b6f3-02442274dd46 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: b96e2a1a-8c1b-4189-86b9-a3c1761a9813] Found default for hw_video_model of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:01:47 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-56b66c3c-450b-46f3-b6f3-02442274dd46 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: b96e2a1a-8c1b-4189-86b9-a3c1761a9813] Found default for hw_vif_model of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:01:47 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: b96e2a1a-8c1b-4189-86b9-a3c1761a9813] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 11:01:47 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681470107.6830978, b96e2a1a-8c1b-4189-86b9-a3c1761a9813 => Started> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 11:01:47 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: b96e2a1a-8c1b-4189-86b9-a3c1761a9813] VM Started (Lifecycle Event)
Apr 14 11:01:47 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: b96e2a1a-8c1b-4189-86b9-a3c1761a9813] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 11:01:47 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: b96e2a1a-8c1b-4189-86b9-a3c1761a9813] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 11:01:47 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: b96e2a1a-8c1b-4189-86b9-a3c1761a9813] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 11:01:47 user nova-compute[71509]: INFO nova.compute.manager [None req-56b66c3c-450b-46f3-b6f3-02442274dd46 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: b96e2a1a-8c1b-4189-86b9-a3c1761a9813] Took 5.45 seconds to spawn the instance on the hypervisor.
Apr 14 11:01:47 user nova-compute[71509]: DEBUG nova.compute.manager [None req-56b66c3c-450b-46f3-b6f3-02442274dd46 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: b96e2a1a-8c1b-4189-86b9-a3c1761a9813] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 11:01:47 user nova-compute[71509]: DEBUG nova.compute.manager [req-049ab204-3bd7-472e-9c5b-e29b9fb7bfe3 req-b3937287-7cd5-4b5b-b5ea-9a0d6322e72b service nova] [instance: b96e2a1a-8c1b-4189-86b9-a3c1761a9813] Received event network-vif-plugged-7ee72a8e-db85-4e30-91e5-193e21c386cd {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:01:47 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-049ab204-3bd7-472e-9c5b-e29b9fb7bfe3 req-b3937287-7cd5-4b5b-b5ea-9a0d6322e72b service nova] Acquiring lock "b96e2a1a-8c1b-4189-86b9-a3c1761a9813-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:01:47 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-049ab204-3bd7-472e-9c5b-e29b9fb7bfe3 req-b3937287-7cd5-4b5b-b5ea-9a0d6322e72b service nova] Lock "b96e2a1a-8c1b-4189-86b9-a3c1761a9813-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:01:47 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-049ab204-3bd7-472e-9c5b-e29b9fb7bfe3 req-b3937287-7cd5-4b5b-b5ea-9a0d6322e72b service nova] Lock "b96e2a1a-8c1b-4189-86b9-a3c1761a9813-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:01:47 user nova-compute[71509]: DEBUG nova.compute.manager [req-049ab204-3bd7-472e-9c5b-e29b9fb7bfe3 req-b3937287-7cd5-4b5b-b5ea-9a0d6322e72b service nova] [instance: b96e2a1a-8c1b-4189-86b9-a3c1761a9813] No waiting events found dispatching network-vif-plugged-7ee72a8e-db85-4e30-91e5-193e21c386cd {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:01:47 user nova-compute[71509]: WARNING nova.compute.manager [req-049ab204-3bd7-472e-9c5b-e29b9fb7bfe3 req-b3937287-7cd5-4b5b-b5ea-9a0d6322e72b service nova] [instance: b96e2a1a-8c1b-4189-86b9-a3c1761a9813] Received unexpected event network-vif-plugged-7ee72a8e-db85-4e30-91e5-193e21c386cd for instance with vm_state active and task_state None.
Apr 14 11:01:47 user nova-compute[71509]: INFO nova.compute.manager [None req-56b66c3c-450b-46f3-b6f3-02442274dd46 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: b96e2a1a-8c1b-4189-86b9-a3c1761a9813] Took 6.21 seconds to build instance.
Apr 14 11:01:47 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-56b66c3c-450b-46f3-b6f3-02442274dd46 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "b96e2a1a-8c1b-4189-86b9-a3c1761a9813" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.299s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:01:48 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:01:49 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:01:49 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:01:49 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:01:50 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:01:53 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:01:54 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:01:54 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:01:54 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Starting heal instance info cache {{(pid=71509) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 11:01:54 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Didn't find any instances for network info cache update. {{(pid=71509) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 14 11:01:55 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:01:55 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:01:55 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:01:55 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:01:55 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Auditing locally available compute resources for user (node: user) {{(pid=71509) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 11:01:55 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b96e2a1a-8c1b-4189-86b9-a3c1761a9813/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:01:55 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b96e2a1a-8c1b-4189-86b9-a3c1761a9813/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:01:55 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b96e2a1a-8c1b-4189-86b9-a3c1761a9813/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:01:56 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b96e2a1a-8c1b-4189-86b9-a3c1761a9813/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:01:56 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c4cc2a1-0c54-4f20-b33f-9085af7b10a3/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:01:56 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c4cc2a1-0c54-4f20-b33f-9085af7b10a3/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:01:56 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c4cc2a1-0c54-4f20-b33f-9085af7b10a3/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:01:56 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c4cc2a1-0c54-4f20-b33f-9085af7b10a3/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:01:56 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6580716-8a6a-4dfa-8978-ed54b92af1fe/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:01:56 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6580716-8a6a-4dfa-8978-ed54b92af1fe/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:01:56 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6580716-8a6a-4dfa-8978-ed54b92af1fe/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:01:56 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6580716-8a6a-4dfa-8978-ed54b92af1fe/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:01:56 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e479154a-acd6-47aa-9a5b-43c6e0feda07/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:01:56 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e479154a-acd6-47aa-9a5b-43c6e0feda07/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:01:56 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e479154a-acd6-47aa-9a5b-43c6e0feda07/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:01:56 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e479154a-acd6-47aa-9a5b-43c6e0feda07/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:01:57 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f41f217-0df2-4205-9633-7dbe83f40c96/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:01:57 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f41f217-0df2-4205-9633-7dbe83f40c96/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:01:57 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f41f217-0df2-4205-9633-7dbe83f40c96/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:01:57 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f41f217-0df2-4205-9633-7dbe83f40c96/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:01:57 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71509) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 11:01:57 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d70b388-155f-4e47-8352-b69c856b2000/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:01:57 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d70b388-155f-4e47-8352-b69c856b2000/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:01:57 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d70b388-155f-4e47-8352-b69c856b2000/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:01:57 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d70b388-155f-4e47-8352-b69c856b2000/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:01:57 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71509) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 11:01:57 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbcca78c-fe73-4ef1-92f9-4c8061cad177/disk.rescue --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:01:57 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbcca78c-fe73-4ef1-92f9-4c8061cad177/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:01:57 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbcca78c-fe73-4ef1-92f9-4c8061cad177/disk.rescue --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:01:57 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fbcca78c-fe73-4ef1-92f9-4c8061cad177/disk.rescue --force-share --output=json" returned: 0 in 0.142s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:01:57 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a936fb20-3f17-4114-829a-8659da6bc5f3/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:01:58 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a936fb20-3f17-4114-829a-8659da6bc5f3/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:01:58 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a936fb20-3f17-4114-829a-8659da6bc5f3/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:01:58 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a936fb20-3f17-4114-829a-8659da6bc5f3/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:01:58 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dd9e11f-1fed-42af-ad5c-9cdd051b93e7/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:01:58 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dd9e11f-1fed-42af-ad5c-9cdd051b93e7/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:01:58 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dd9e11f-1fed-42af-ad5c-9cdd051b93e7/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:01:58 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:01:58 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dd9e11f-1fed-42af-ad5c-9cdd051b93e7/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:01:58 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1fdcfb4-8700-48fe-9dec-1e8a4b766cba/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:01:58 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1fdcfb4-8700-48fe-9dec-1e8a4b766cba/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:01:58 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1fdcfb4-8700-48fe-9dec-1e8a4b766cba/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:01:58 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1fdcfb4-8700-48fe-9dec-1e8a4b766cba/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:01:58 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71509) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 11:01:59 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:01:59 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 11:01:59 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 11:01:59 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Hypervisor/Node resource view: name=user free_ram=7480MB free_disk=25.69521713256836GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71509) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 11:01:59 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:01:59 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:01:59 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Applying migration context for instance 3db2e71c-939b-4d2f-b1be-c2122f7cd73e as it has an incoming, in-progress migration 642d65c1-f5b8-43ae-8abe-e04d77cd069e. Migration status is finished {{(pid=71509) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:950}}
Apr 14 11:01:59 user nova-compute[71509]: INFO nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] Updating resource usage from migration 642d65c1-f5b8-43ae-8abe-e04d77cd069e
Apr 14 11:01:59 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance e479154a-acd6-47aa-9a5b-43c6e0feda07 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 11:01:59 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 6cae9f61-763f-4671-a873-d15f01384416 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 11:01:59 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 6f41f217-0df2-4205-9633-7dbe83f40c96 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 11:01:59 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance e6580716-8a6a-4dfa-8978-ed54b92af1fe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 11:01:59 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance a936fb20-3f17-4114-829a-8659da6bc5f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 11:01:59 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 0dd9e11f-1fed-42af-ad5c-9cdd051b93e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 11:01:59 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance fbcca78c-fe73-4ef1-92f9-4c8061cad177 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 11:01:59 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 11:01:59 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Migration 642d65c1-f5b8-43ae-8abe-e04d77cd069e is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 128}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1637}}
Apr 14 11:01:59 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 3db2e71c-939b-4d2f-b1be-c2122f7cd73e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 11:01:59 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 3d70b388-155f-4e47-8352-b69c856b2000 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 11:01:59 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance a1fdcfb4-8700-48fe-9dec-1e8a4b766cba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 11:01:59 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance b96e2a1a-8c1b-4189-86b9-a3c1761a9813 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 11:01:59 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=71509) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 11:01:59 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Final resource view: name=user phys_ram=16023MB used_ram=2240MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=71509) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 11:01:59 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 11:01:59 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 11:01:59 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Compute_service record updated for user:user {{(pid=71509) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 11:01:59 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.519s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:02:03 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:02:04 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:02:08 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:02:09 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:02:13 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:02:13 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:02:13 user nova-compute[71509]: DEBUG nova.compute.manager [req-ae04dc9a-edb8-4b86-b915-04f5c9921783 req-d8934007-d323-45c3-b9cc-9f3122f6528c service nova] [instance: e6580716-8a6a-4dfa-8978-ed54b92af1fe] Received event network-changed-3019f976-f679-4826-8510-3de34b67807c {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:02:13 user nova-compute[71509]: DEBUG nova.compute.manager [req-ae04dc9a-edb8-4b86-b915-04f5c9921783 req-d8934007-d323-45c3-b9cc-9f3122f6528c service nova] [instance: e6580716-8a6a-4dfa-8978-ed54b92af1fe] Refreshing instance network info cache due to event network-changed-3019f976-f679-4826-8510-3de34b67807c. {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 11:02:13 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-ae04dc9a-edb8-4b86-b915-04f5c9921783 req-d8934007-d323-45c3-b9cc-9f3122f6528c service nova] Acquiring lock "refresh_cache-e6580716-8a6a-4dfa-8978-ed54b92af1fe" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 11:02:13 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-ae04dc9a-edb8-4b86-b915-04f5c9921783 req-d8934007-d323-45c3-b9cc-9f3122f6528c service nova] Acquired lock "refresh_cache-e6580716-8a6a-4dfa-8978-ed54b92af1fe" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 11:02:13 user nova-compute[71509]: DEBUG nova.network.neutron [req-ae04dc9a-edb8-4b86-b915-04f5c9921783 req-d8934007-d323-45c3-b9cc-9f3122f6528c service nova] [instance: e6580716-8a6a-4dfa-8978-ed54b92af1fe] Refreshing network info cache for port 3019f976-f679-4826-8510-3de34b67807c {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 11:02:14 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-98225583-c84c-4ad3-8d05-c89ddc399b11 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Acquiring lock "e6580716-8a6a-4dfa-8978-ed54b92af1fe" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:02:14 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-98225583-c84c-4ad3-8d05-c89ddc399b11 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "e6580716-8a6a-4dfa-8978-ed54b92af1fe" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:02:14 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-98225583-c84c-4ad3-8d05-c89ddc399b11 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Acquiring lock "e6580716-8a6a-4dfa-8978-ed54b92af1fe-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:02:14 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-98225583-c84c-4ad3-8d05-c89ddc399b11 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "e6580716-8a6a-4dfa-8978-ed54b92af1fe-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:02:14 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-98225583-c84c-4ad3-8d05-c89ddc399b11 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "e6580716-8a6a-4dfa-8978-ed54b92af1fe-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:02:14 user nova-compute[71509]: INFO nova.compute.manager [None req-98225583-c84c-4ad3-8d05-c89ddc399b11 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] [instance: e6580716-8a6a-4dfa-8978-ed54b92af1fe] Terminating instance
Apr 14 11:02:14 user nova-compute[71509]: DEBUG nova.compute.manager [None req-98225583-c84c-4ad3-8d05-c89ddc399b11 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] [instance: e6580716-8a6a-4dfa-8978-ed54b92af1fe] Start destroying the instance on the hypervisor. {{(pid=71509) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 11:02:14 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:02:14 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:02:14 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:02:14 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:02:14 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:02:14 user nova-compute[71509]: DEBUG nova.compute.manager [req-fe7e736d-9e3b-402e-b763-34e77c975301 req-ffc1131e-351b-49e0-994f-e883e518fa6f service nova] [instance: e6580716-8a6a-4dfa-8978-ed54b92af1fe] Received event network-vif-unplugged-3019f976-f679-4826-8510-3de34b67807c {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:02:14 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-fe7e736d-9e3b-402e-b763-34e77c975301 req-ffc1131e-351b-49e0-994f-e883e518fa6f service nova] Acquiring lock "e6580716-8a6a-4dfa-8978-ed54b92af1fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:02:14 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-fe7e736d-9e3b-402e-b763-34e77c975301 req-ffc1131e-351b-49e0-994f-e883e518fa6f service nova] Lock "e6580716-8a6a-4dfa-8978-ed54b92af1fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:02:14 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-fe7e736d-9e3b-402e-b763-34e77c975301 req-ffc1131e-351b-49e0-994f-e883e518fa6f service nova] Lock "e6580716-8a6a-4dfa-8978-ed54b92af1fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:02:14 user nova-compute[71509]: DEBUG nova.compute.manager [req-fe7e736d-9e3b-402e-b763-34e77c975301 req-ffc1131e-351b-49e0-994f-e883e518fa6f service nova] [instance: e6580716-8a6a-4dfa-8978-ed54b92af1fe] No waiting events found dispatching network-vif-unplugged-3019f976-f679-4826-8510-3de34b67807c {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:02:14 user nova-compute[71509]: DEBUG nova.compute.manager [req-fe7e736d-9e3b-402e-b763-34e77c975301 req-ffc1131e-351b-49e0-994f-e883e518fa6f service nova] [instance: e6580716-8a6a-4dfa-8978-ed54b92af1fe] Received event network-vif-unplugged-3019f976-f679-4826-8510-3de34b67807c for instance with task_state deleting. {{(pid=71509) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 11:02:14 user nova-compute[71509]: DEBUG nova.network.neutron [req-ae04dc9a-edb8-4b86-b915-04f5c9921783 req-d8934007-d323-45c3-b9cc-9f3122f6528c service nova] [instance: e6580716-8a6a-4dfa-8978-ed54b92af1fe] Updated VIF entry in instance network info cache for port 3019f976-f679-4826-8510-3de34b67807c. {{(pid=71509) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 11:02:14 user nova-compute[71509]: DEBUG nova.network.neutron [req-ae04dc9a-edb8-4b86-b915-04f5c9921783 req-d8934007-d323-45c3-b9cc-9f3122f6528c service nova] [instance: e6580716-8a6a-4dfa-8978-ed54b92af1fe] Updating instance_info_cache with network_info: [{"id": "3019f976-f679-4826-8510-3de34b67807c", "address": "fa:16:3e:57:1a:d3", "network": {"id": "1fdeb048-706a-45bf-8f2a-2cee21abb9ea", "bridge": "br-int", "label": "tempest-TestStampPattern-1337046138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f629ba0ab8074ed8bb4e59d545b74eb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3019f976-f6", "ovs_interfaceid": "3019f976-f679-4826-8510-3de34b67807c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:02:14 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-ae04dc9a-edb8-4b86-b915-04f5c9921783 req-d8934007-d323-45c3-b9cc-9f3122f6528c service nova] Releasing lock "refresh_cache-e6580716-8a6a-4dfa-8978-ed54b92af1fe" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 11:02:14 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: e6580716-8a6a-4dfa-8978-ed54b92af1fe] Instance destroyed successfully.
Apr 14 11:02:14 user nova-compute[71509]: DEBUG nova.objects.instance [None req-98225583-c84c-4ad3-8d05-c89ddc399b11 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lazy-loading 'resources' on Instance uuid e6580716-8a6a-4dfa-8978-ed54b92af1fe {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 11:02:14 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-98225583-c84c-4ad3-8d05-c89ddc399b11 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T10:55:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1925914153',display_name='tempest-TestStampPattern-server-1925914153',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-teststamppattern-server-1925914153',id=27,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHGJbZqWmfze/VbD7AiTXpBSSC7JeSqxVieDSB69GsDRbeWrzeiKDuD8IXa8m1YPGpwzOjCM3hxDW4Au2iAbXYcYId85Kh55qCn9eiY+V5K3AjDmmJpdlP7IQxGR6pVCIA==',key_name='tempest-TestStampPattern-627373922',keypairs=<?>,launch_index=0,launched_at=2023-04-14T10:55:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f629ba0ab8074ed8bb4e59d545b74eb6',ramdisk_id='',reservation_id='r-0ma87v4t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1000870021',owner_user_name='tempest-TestStampPattern-1000870021-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T10:58:20Z,user_data=None,user_id='e3ad6531a67b4be58a195e1208157b0b',uuid=e6580716-8a6a-4dfa-8978-ed54b92af1fe,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3019f976-f679-4826-8510-3de34b67807c", "address": "fa:16:3e:57:1a:d3", "network": {"id": "1fdeb048-706a-45bf-8f2a-2cee21abb9ea", "bridge": "br-int", "label": "tempest-TestStampPattern-1337046138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f629ba0ab8074ed8bb4e59d545b74eb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3019f976-f6", "ovs_interfaceid": "3019f976-f679-4826-8510-3de34b67807c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 11:02:14 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-98225583-c84c-4ad3-8d05-c89ddc399b11 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Converting VIF {"id": "3019f976-f679-4826-8510-3de34b67807c", "address": "fa:16:3e:57:1a:d3", "network": {"id": "1fdeb048-706a-45bf-8f2a-2cee21abb9ea", "bridge": "br-int", "label": "tempest-TestStampPattern-1337046138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f629ba0ab8074ed8bb4e59d545b74eb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3019f976-f6", "ovs_interfaceid": "3019f976-f679-4826-8510-3de34b67807c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 11:02:14 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-98225583-c84c-4ad3-8d05-c89ddc399b11 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:57:1a:d3,bridge_name='br-int',has_traffic_filtering=True,id=3019f976-f679-4826-8510-3de34b67807c,network=Network(1fdeb048-706a-45bf-8f2a-2cee21abb9ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3019f976-f6') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 11:02:14 user nova-compute[71509]: DEBUG os_vif [None req-98225583-c84c-4ad3-8d05-c89ddc399b11 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:57:1a:d3,bridge_name='br-int',has_traffic_filtering=True,id=3019f976-f679-4826-8510-3de34b67807c,network=Network(1fdeb048-706a-45bf-8f2a-2cee21abb9ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3019f976-f6') {{(pid=71509) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 11:02:14 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:02:14 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3019f976-f6, bridge=br-int, if_exists=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:02:14 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:02:14 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:02:14 user nova-compute[71509]: INFO os_vif [None req-98225583-c84c-4ad3-8d05-c89ddc399b11 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:57:1a:d3,bridge_name='br-int',has_traffic_filtering=True,id=3019f976-f679-4826-8510-3de34b67807c,network=Network(1fdeb048-706a-45bf-8f2a-2cee21abb9ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3019f976-f6')
Apr 14 11:02:14 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-98225583-c84c-4ad3-8d05-c89ddc399b11 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] [instance: e6580716-8a6a-4dfa-8978-ed54b92af1fe] Deleting instance files /opt/stack/data/nova/instances/e6580716-8a6a-4dfa-8978-ed54b92af1fe_del
Apr 14 11:02:14 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-98225583-c84c-4ad3-8d05-c89ddc399b11 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] [instance: e6580716-8a6a-4dfa-8978-ed54b92af1fe] Deletion of /opt/stack/data/nova/instances/e6580716-8a6a-4dfa-8978-ed54b92af1fe_del complete
Apr 14 11:02:14 user nova-compute[71509]: INFO nova.compute.manager [None req-98225583-c84c-4ad3-8d05-c89ddc399b11 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] [instance: e6580716-8a6a-4dfa-8978-ed54b92af1fe] Took 0.86 seconds to destroy the instance on the hypervisor.
Apr 14 11:02:14 user nova-compute[71509]: DEBUG oslo.service.loopingcall [None req-98225583-c84c-4ad3-8d05-c89ddc399b11 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71509) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 11:02:14 user nova-compute[71509]: DEBUG nova.compute.manager [-] [instance: e6580716-8a6a-4dfa-8978-ed54b92af1fe] Deallocating network for instance {{(pid=71509) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 11:02:14 user nova-compute[71509]: DEBUG nova.network.neutron [-] [instance: e6580716-8a6a-4dfa-8978-ed54b92af1fe] deallocate_for_instance() {{(pid=71509) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 11:02:15 user nova-compute[71509]: DEBUG nova.network.neutron [-] [instance: e6580716-8a6a-4dfa-8978-ed54b92af1fe] Updating instance_info_cache with network_info: [] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:02:15 user nova-compute[71509]: INFO nova.compute.manager [-] [instance: e6580716-8a6a-4dfa-8978-ed54b92af1fe] Took 0.45 seconds to deallocate network for instance.
Apr 14 11:02:15 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-98225583-c84c-4ad3-8d05-c89ddc399b11 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:02:15 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-98225583-c84c-4ad3-8d05-c89ddc399b11 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:02:15 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-98225583-c84c-4ad3-8d05-c89ddc399b11 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 11:02:15 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-98225583-c84c-4ad3-8d05-c89ddc399b11 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 11:02:15 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-98225583-c84c-4ad3-8d05-c89ddc399b11 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.388s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:02:15 user nova-compute[71509]: INFO nova.scheduler.client.report [None req-98225583-c84c-4ad3-8d05-c89ddc399b11 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Deleted allocations for instance e6580716-8a6a-4dfa-8978-ed54b92af1fe
Apr 14 11:02:15 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-98225583-c84c-4ad3-8d05-c89ddc399b11 tempest-TestStampPattern-1000870021 tempest-TestStampPattern-1000870021-project-member] Lock "e6580716-8a6a-4dfa-8978-ed54b92af1fe" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.888s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:02:15 user nova-compute[71509]: DEBUG nova.compute.manager [req-44f50dd4-216a-4f0c-85d5-dbc0bc05efe5 req-cca45edf-5e8f-4658-a320-a27ffe8a0973 service nova] [instance: e6580716-8a6a-4dfa-8978-ed54b92af1fe] Received event network-vif-deleted-3019f976-f679-4826-8510-3de34b67807c {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:02:16 user nova-compute[71509]: DEBUG nova.compute.manager [req-00d0455a-18c9-4c68-a408-3cb1765e26aa req-7a409dd4-8ba6-4e77-ab77-e9aec87d2581 service nova] [instance: e6580716-8a6a-4dfa-8978-ed54b92af1fe] Received event network-vif-plugged-3019f976-f679-4826-8510-3de34b67807c {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:02:16 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-00d0455a-18c9-4c68-a408-3cb1765e26aa req-7a409dd4-8ba6-4e77-ab77-e9aec87d2581 service nova] Acquiring lock "e6580716-8a6a-4dfa-8978-ed54b92af1fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:02:16 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-00d0455a-18c9-4c68-a408-3cb1765e26aa req-7a409dd4-8ba6-4e77-ab77-e9aec87d2581 service nova] Lock "e6580716-8a6a-4dfa-8978-ed54b92af1fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:02:16 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-00d0455a-18c9-4c68-a408-3cb1765e26aa req-7a409dd4-8ba6-4e77-ab77-e9aec87d2581 service nova] Lock "e6580716-8a6a-4dfa-8978-ed54b92af1fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:02:16 user nova-compute[71509]: DEBUG nova.compute.manager [req-00d0455a-18c9-4c68-a408-3cb1765e26aa req-7a409dd4-8ba6-4e77-ab77-e9aec87d2581 service nova] [instance: e6580716-8a6a-4dfa-8978-ed54b92af1fe] No waiting events found dispatching network-vif-plugged-3019f976-f679-4826-8510-3de34b67807c {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:02:16 user nova-compute[71509]: WARNING nova.compute.manager [req-00d0455a-18c9-4c68-a408-3cb1765e26aa req-7a409dd4-8ba6-4e77-ab77-e9aec87d2581 service nova] [instance: e6580716-8a6a-4dfa-8978-ed54b92af1fe] Received unexpected event network-vif-plugged-3019f976-f679-4826-8510-3de34b67807c for instance with vm_state deleted and task_state None.
Apr 14 11:02:18 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:02:19 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:02:24 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:02:28 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:02:29 user nova-compute[71509]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681470134.771871, e6580716-8a6a-4dfa-8978-ed54b92af1fe => Stopped> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 11:02:29 user nova-compute[71509]: INFO nova.compute.manager [-] [instance: e6580716-8a6a-4dfa-8978-ed54b92af1fe] VM Stopped (Lifecycle Event)
Apr 14 11:02:29 user nova-compute[71509]: DEBUG nova.compute.manager [None req-45ea2278-611e-4c01-8f85-7b9333ab6549 None None] [instance: e6580716-8a6a-4dfa-8978-ed54b92af1fe] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 11:02:29 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:02:30 user nova-compute[71509]: INFO nova.compute.manager [None req-450011c8-cc1b-4d9b-8d21-601e20cb0fd4 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] Unrescuing
Apr 14 11:02:30 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-450011c8-cc1b-4d9b-8d21-601e20cb0fd4 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Acquiring lock "refresh_cache-fbcca78c-fe73-4ef1-92f9-4c8061cad177" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 11:02:30 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-450011c8-cc1b-4d9b-8d21-601e20cb0fd4 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Acquired lock "refresh_cache-fbcca78c-fe73-4ef1-92f9-4c8061cad177" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 11:02:30 user nova-compute[71509]: DEBUG nova.network.neutron [None req-450011c8-cc1b-4d9b-8d21-601e20cb0fd4 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] Building network info cache for instance {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 11:02:31 user nova-compute[71509]: DEBUG nova.network.neutron [None req-450011c8-cc1b-4d9b-8d21-601e20cb0fd4 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] Updating instance_info_cache with network_info: [{"id": "845cc40f-1b03-4b85-8d19-fea731fe7f89", "address": "fa:16:3e:45:59:73", "network": {"id": "07f1f39e-292a-4e73-b4ed-99e5799d6fa8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1339551596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71289f80a05141f482cb538dac3d7b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap845cc40f-1b", "ovs_interfaceid": "845cc40f-1b03-4b85-8d19-fea731fe7f89", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:02:31 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-450011c8-cc1b-4d9b-8d21-601e20cb0fd4 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Releasing lock "refresh_cache-fbcca78c-fe73-4ef1-92f9-4c8061cad177" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 11:02:31 user nova-compute[71509]: DEBUG nova.objects.instance [None req-450011c8-cc1b-4d9b-8d21-601e20cb0fd4 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lazy-loading 'flavor' on Instance uuid fbcca78c-fe73-4ef1-92f9-4c8061cad177 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 11:02:31 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:02:31 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:02:31 user nova-compute[71509]: DEBUG nova.compute.manager [req-1feaa569-8a03-4914-aa59-a9a40bf814b6 req-69648042-c30f-4988-bf77-0974ce2f6093 service nova] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] Received event network-vif-unplugged-845cc40f-1b03-4b85-8d19-fea731fe7f89 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:02:31 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-1feaa569-8a03-4914-aa59-a9a40bf814b6 req-69648042-c30f-4988-bf77-0974ce2f6093 service nova] Acquiring lock "fbcca78c-fe73-4ef1-92f9-4c8061cad177-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:02:31 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-1feaa569-8a03-4914-aa59-a9a40bf814b6 req-69648042-c30f-4988-bf77-0974ce2f6093 service nova] Lock "fbcca78c-fe73-4ef1-92f9-4c8061cad177-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:02:31 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-1feaa569-8a03-4914-aa59-a9a40bf814b6 req-69648042-c30f-4988-bf77-0974ce2f6093 service nova] Lock "fbcca78c-fe73-4ef1-92f9-4c8061cad177-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:02:31 user nova-compute[71509]: DEBUG nova.compute.manager [req-1feaa569-8a03-4914-aa59-a9a40bf814b6 req-69648042-c30f-4988-bf77-0974ce2f6093 service nova] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] No waiting events found dispatching network-vif-unplugged-845cc40f-1b03-4b85-8d19-fea731fe7f89 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:02:31 user nova-compute[71509]: WARNING nova.compute.manager [req-1feaa569-8a03-4914-aa59-a9a40bf814b6 req-69648042-c30f-4988-bf77-0974ce2f6093 service nova] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] Received unexpected event network-vif-unplugged-845cc40f-1b03-4b85-8d19-fea731fe7f89 for instance with vm_state rescued and task_state unrescuing.
Apr 14 11:02:31 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:02:31 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:02:32 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] Instance destroyed successfully.
Apr 14 11:02:33 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:02:33 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:02:33 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:02:33 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:02:33 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:02:33 user nova-compute[71509]: DEBUG nova.compute.manager [req-a14a4a1c-e813-4f7d-bb09-4048e8bb0d1c req-c18d5acc-84ca-421f-8444-c82640e5aeeb service nova] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] Received event network-vif-plugged-845cc40f-1b03-4b85-8d19-fea731fe7f89 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:02:33 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-a14a4a1c-e813-4f7d-bb09-4048e8bb0d1c req-c18d5acc-84ca-421f-8444-c82640e5aeeb service nova] Acquiring lock "fbcca78c-fe73-4ef1-92f9-4c8061cad177-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:02:33 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-a14a4a1c-e813-4f7d-bb09-4048e8bb0d1c req-c18d5acc-84ca-421f-8444-c82640e5aeeb service nova] Lock "fbcca78c-fe73-4ef1-92f9-4c8061cad177-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:02:33 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-a14a4a1c-e813-4f7d-bb09-4048e8bb0d1c req-c18d5acc-84ca-421f-8444-c82640e5aeeb service nova] Lock "fbcca78c-fe73-4ef1-92f9-4c8061cad177-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:02:33 user nova-compute[71509]: DEBUG nova.compute.manager [req-a14a4a1c-e813-4f7d-bb09-4048e8bb0d1c req-c18d5acc-84ca-421f-8444-c82640e5aeeb service nova] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] No waiting events found dispatching network-vif-plugged-845cc40f-1b03-4b85-8d19-fea731fe7f89 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:02:33 user nova-compute[71509]: WARNING nova.compute.manager [req-a14a4a1c-e813-4f7d-bb09-4048e8bb0d1c req-c18d5acc-84ca-421f-8444-c82640e5aeeb service nova] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] Received unexpected event network-vif-plugged-845cc40f-1b03-4b85-8d19-fea731fe7f89 for instance with vm_state rescued and task_state unrescuing.
Apr 14 11:02:33 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:02:33 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:02:34 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:02:35 user nova-compute[71509]: DEBUG nova.compute.manager [req-80c2f145-ec58-475f-aeb1-d8463cd80b85 req-a4d609cd-21c7-4b7e-ab97-dd1a9c392cf5 service nova] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] Received event network-vif-plugged-845cc40f-1b03-4b85-8d19-fea731fe7f89 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:02:35 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-80c2f145-ec58-475f-aeb1-d8463cd80b85 req-a4d609cd-21c7-4b7e-ab97-dd1a9c392cf5 service nova] Acquiring lock "fbcca78c-fe73-4ef1-92f9-4c8061cad177-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:02:35 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-80c2f145-ec58-475f-aeb1-d8463cd80b85 req-a4d609cd-21c7-4b7e-ab97-dd1a9c392cf5 service nova] Lock "fbcca78c-fe73-4ef1-92f9-4c8061cad177-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:02:35 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-80c2f145-ec58-475f-aeb1-d8463cd80b85 req-a4d609cd-21c7-4b7e-ab97-dd1a9c392cf5 service nova] Lock "fbcca78c-fe73-4ef1-92f9-4c8061cad177-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:02:35 user nova-compute[71509]: DEBUG nova.compute.manager [req-80c2f145-ec58-475f-aeb1-d8463cd80b85 req-a4d609cd-21c7-4b7e-ab97-dd1a9c392cf5 service nova] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] No waiting events found dispatching network-vif-plugged-845cc40f-1b03-4b85-8d19-fea731fe7f89 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:02:35 user nova-compute[71509]: WARNING nova.compute.manager [req-80c2f145-ec58-475f-aeb1-d8463cd80b85 req-a4d609cd-21c7-4b7e-ab97-dd1a9c392cf5 service nova] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] Received unexpected event network-vif-plugged-845cc40f-1b03-4b85-8d19-fea731fe7f89 for instance with vm_state rescued and task_state unrescuing.
Apr 14 11:02:35 user nova-compute[71509]: DEBUG nova.compute.manager [req-80c2f145-ec58-475f-aeb1-d8463cd80b85 req-a4d609cd-21c7-4b7e-ab97-dd1a9c392cf5 service nova] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] Received event network-vif-plugged-845cc40f-1b03-4b85-8d19-fea731fe7f89 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:02:35 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-80c2f145-ec58-475f-aeb1-d8463cd80b85 req-a4d609cd-21c7-4b7e-ab97-dd1a9c392cf5 service nova] Acquiring lock "fbcca78c-fe73-4ef1-92f9-4c8061cad177-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:02:35 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-80c2f145-ec58-475f-aeb1-d8463cd80b85 req-a4d609cd-21c7-4b7e-ab97-dd1a9c392cf5 service nova] Lock "fbcca78c-fe73-4ef1-92f9-4c8061cad177-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:02:35 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-80c2f145-ec58-475f-aeb1-d8463cd80b85 req-a4d609cd-21c7-4b7e-ab97-dd1a9c392cf5 service nova] Lock "fbcca78c-fe73-4ef1-92f9-4c8061cad177-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:02:35 user nova-compute[71509]: DEBUG nova.compute.manager [req-80c2f145-ec58-475f-aeb1-d8463cd80b85 req-a4d609cd-21c7-4b7e-ab97-dd1a9c392cf5 service nova] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] No waiting events found dispatching network-vif-plugged-845cc40f-1b03-4b85-8d19-fea731fe7f89 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:02:35 user nova-compute[71509]: WARNING nova.compute.manager [req-80c2f145-ec58-475f-aeb1-d8463cd80b85 req-a4d609cd-21c7-4b7e-ab97-dd1a9c392cf5 service nova] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] Received unexpected event network-vif-plugged-845cc40f-1b03-4b85-8d19-fea731fe7f89 for instance with vm_state rescued and task_state unrescuing.
Apr 14 11:02:36 user nova-compute[71509]: DEBUG nova.virt.libvirt.host [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Removed pending event for fbcca78c-fe73-4ef1-92f9-4c8061cad177 due to event {{(pid=71509) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 11:02:36 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681470156.0021632, fbcca78c-fe73-4ef1-92f9-4c8061cad177 => Resumed> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 11:02:36 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] VM Resumed (Lifecycle Event)
Apr 14 11:02:36 user nova-compute[71509]: DEBUG nova.compute.manager [None req-450011c8-cc1b-4d9b-8d21-601e20cb0fd4 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 11:02:36 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 11:02:36 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 11:02:36 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] During sync_power_state the instance has a pending task (unrescuing). Skip.
Apr 14 11:02:36 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681470156.0039556, fbcca78c-fe73-4ef1-92f9-4c8061cad177 => Started> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 11:02:36 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] VM Started (Lifecycle Event)
Apr 14 11:02:36 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 11:02:36 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 11:02:38 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:02:39 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:02:44 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-e0e943bf-a560-466b-9087-b5b460c8ce3c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Acquiring lock "9c4cc2a1-0c54-4f20-b33f-9085af7b10a3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:02:44 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-e0e943bf-a560-466b-9087-b5b460c8ce3c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "9c4cc2a1-0c54-4f20-b33f-9085af7b10a3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:02:44 user nova-compute[71509]: DEBUG nova.objects.instance [None req-e0e943bf-a560-466b-9087-b5b460c8ce3c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lazy-loading 'flavor' on Instance uuid 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 11:02:44 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-e0e943bf-a560-466b-9087-b5b460c8ce3c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "9c4cc2a1-0c54-4f20-b33f-9085af7b10a3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:02:44 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-e0e943bf-a560-466b-9087-b5b460c8ce3c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Acquiring lock "9c4cc2a1-0c54-4f20-b33f-9085af7b10a3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:02:44 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-e0e943bf-a560-466b-9087-b5b460c8ce3c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "9c4cc2a1-0c54-4f20-b33f-9085af7b10a3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:02:44 user nova-compute[71509]: INFO nova.compute.manager [None req-e0e943bf-a560-466b-9087-b5b460c8ce3c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Attaching volume 0da1ed17-2b8c-4dd3-a61a-1133a9420d21 to /dev/vdb
Apr 14 11:02:44 user nova-compute[71509]: DEBUG os_brick.utils [None req-e0e943bf-a560-466b-9087-b5b460c8ce3c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 11:02:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:02:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:02:44 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1305474-b797-4bbe-a562-7c374c691c45]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50119df3c417\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:02:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:02:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:02:44 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[69c421e4-201c-4a2b-97da-2dbb02c70a75]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:02:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:02:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:02:44 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[63dde76a-c400-495c-a44a-e9118399990d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:02:44 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[149f0781-dbac-46fb-9b23-9cda69e10c2e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:02:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-e0e943bf-a560-466b-9087-b5b460c8ce3c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Running cmd (subprocess): nvme version {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:02:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-e0e943bf-a560-466b-9087-b5b460c8ce3c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] 'nvme version' failed. Not Retrying. {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 11:02:44 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e0e943bf-a560-466b-9087-b5b460c8ce3c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] nvme not present on system {{(pid=71509) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 11:02:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:02:44 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:02:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 11:02:44 user nova-compute[71509]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 11:02:44 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7f6e359-0968-43a8-a6a0-bd3c8ae24ff5]: (4, '') {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:02:44 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-e0e943bf-a560-466b-9087-b5b460c8ce3c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71509) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 11:02:44 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-e0e943bf-a560-466b-9087-b5b460c8ce3c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71509) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 11:02:44 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-e0e943bf-a560-466b-9087-b5b460c8ce3c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] LIGHTOS: no hostnqn found. {{(pid=71509) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 11:02:44 user nova-compute[71509]: DEBUG os_brick.utils [None req-e0e943bf-a560-466b-9087-b5b460c8ce3c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50119df3c417', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 11:02:44 user nova-compute[71509]: DEBUG nova.virt.block_device [None req-e0e943bf-a560-466b-9087-b5b460c8ce3c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Updating existing volume attachment record: 088c1840-1051-47b1-b4c2-15cc52109859 {{(pid=71509) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 11:02:46 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:02:46 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:02:46 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:02:46 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:02:46 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71509) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 11:02:48 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:02:49 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0e943bf-a560-466b-9087-b5b460c8ce3c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Calling os-brick to attach iSCSI Volume {{(pid=71509) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 11:02:49 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0e943bf-a560-466b-9087-b5b460c8ce3c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0bf0749390>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0da1ed17-2b8c-4dd3-a61a-1133a9420d21', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UNHnOXfL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 11:02:49 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-e0e943bf-a560-466b-9087-b5b460c8ce3c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 11:02:49 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-e0e943bf-a560-466b-9087-b5b460c8ce3c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 11:02:49 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-e0e943bf-a560-466b-9087-b5b460c8ce3c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 11:02:49 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-e0e943bf-a560-466b-9087-b5b460c8ce3c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 11:02:49 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-e0e943bf-a560-466b-9087-b5b460c8ce3c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0da1ed17-2b8c-4dd3-a61a-1133a9420d21" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 11:02:49 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-e0e943bf-a560-466b-9087-b5b460c8ce3c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0da1ed17-2b8c-4dd3-a61a-1133a9420d21" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 11:02:49 user nova-compute[71509]: INFO os_brick.initiator.connectors.iscsi [None req-e0e943bf-a560-466b-9087-b5b460c8ce3c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 11:02:49 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0da1ed17-2b8c-4dd3-a61a-1133a9420d21 -p 172.16.0.220:3260 {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:02:49 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0da1ed17-2b8c-4dd3-a61a-1133a9420d21 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:02:49 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac452d8f-7d63-4169-a648-032e1e08145a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:02:49 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0e943bf-a560-466b-9087-b5b460c8ce3c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 11:02:49 user nova-compute[71509]:  {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:02:49 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0da1ed17-2b8c-4dd3-a61a-1133a9420d21 -p 172.16.0.220:3260 --interface default --op new {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:02:49 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0da1ed17-2b8c-4dd3-a61a-1133a9420d21 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:02:49 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[de43a631-ec08-4d03-b7ab-feba9cf8d8de]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0da1ed17-2b8c-4dd3-a61a-1133a9420d21] added\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:02:49 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0e943bf-a560-466b-9087-b5b460c8ce3c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0da1ed17-2b8c-4dd3-a61a-1133a9420d21] added
Apr 14 11:02:49 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:02:49 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0da1ed17-2b8c-4dd3-a61a-1133a9420d21 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:02:49 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0da1ed17-2b8c-4dd3-a61a-1133a9420d21 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:02:49 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[22cd0f65-167f-4b69-9893-1d3462b82bbc]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:02:49 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0e943bf-a560-466b-9087-b5b460c8ce3c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:02:49 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0da1ed17-2b8c-4dd3-a61a-1133a9420d21 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:02:49 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0da1ed17-2b8c-4dd3-a61a-1133a9420d21 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:02:49 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[f17955e4-4dd1-4326-bb9e-0258eb283652]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:02:49 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0e943bf-a560-466b-9087-b5b460c8ce3c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:02:49 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0da1ed17-2b8c-4dd3-a61a-1133a9420d21 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UNHnOXfL {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:02:49 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0da1ed17-2b8c-4dd3-a61a-1133a9420d21 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UNHnOXfL" returned: 0 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:02:49 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d362960-9d36-49e4-a9b3-ddf8d91265ab]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:02:49 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0e943bf-a560-466b-9087-b5b460c8ce3c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UNHnOXfL'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:02:49 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0da1ed17-2b8c-4dd3-a61a-1133a9420d21 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:02:49 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:02:49 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0da1ed17-2b8c-4dd3-a61a-1133a9420d21 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:02:49 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a8f7e60-fba5-4018-b656-b637fa057ff4]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:02:49 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0e943bf-a560-466b-9087-b5b460c8ce3c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:02:49 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:02:49 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:02:49 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[34ff4ff6-c935-4cfa-88ac-7688282e3ca8]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3 (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:02:49 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0e943bf-a560-466b-9087-b5b460c8ce3c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)
Apr 14 11:02:49 user nova-compute[71509]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219 (non-flash)
Apr 14 11:02:49 user nova-compute[71509]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3 (non-flash)
Apr 14 11:02:49 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 11:02:49 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0e943bf-a560-466b-9087-b5b460c8ce3c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)
Apr 14 11:02:49 user nova-compute[71509]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219 (non-flash)
Apr 14 11:02:49 user nova-compute[71509]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3 (non-flash)
Apr 14 11:02:49 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 11:02:49 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0da1ed17-2b8c-4dd3-a61a-1133a9420d21 -p 172.16.0.220:3260 --login {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:02:49 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0da1ed17-2b8c-4dd3-a61a-1133a9420d21 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:02:49 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fecd292-d688-4846-9e7b-76d7e5c8b4c6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0da1ed17-2b8c-4dd3-a61a-1133a9420d21, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0da1ed17-2b8c-4dd3-a61a-1133a9420d21, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:02:49 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0e943bf-a560-466b-9087-b5b460c8ce3c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0da1ed17-2b8c-4dd3-a61a-1133a9420d21, portal: 172.16.0.220,3260]
Apr 14 11:02:49 user nova-compute[71509]: Login to [iface: default, target: iqn.2010-10.org.openstack:0da1ed17-2b8c-4dd3-a61a-1133a9420d21, portal: 172.16.0.220,3260] successful.
Apr 14 11:02:49 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:02:49 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0da1ed17-2b8c-4dd3-a61a-1133a9420d21 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:02:49 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0da1ed17-2b8c-4dd3-a61a-1133a9420d21 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:02:49 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[97fe5143-fc6b-4d8f-ad3f-2116426bfa65]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:02:49 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0e943bf-a560-466b-9087-b5b460c8ce3c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:02:49 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:02:49 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:02:49 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b34bb31-5c9b-4e7a-bd19-2133a62e337e]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0da1ed17-2b8c-4dd3-a61a-1133a9420d21 (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:02:49 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0e943bf-a560-466b-9087-b5b460c8ce3c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)
Apr 14 11:02:49 user nova-compute[71509]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219 (non-flash)
Apr 14 11:02:49 user nova-compute[71509]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3 (non-flash)
Apr 14 11:02:49 user nova-compute[71509]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0da1ed17-2b8c-4dd3-a61a-1133a9420d21 (non-flash)
Apr 14 11:02:49 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 11:02:49 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0e943bf-a560-466b-9087-b5b460c8ce3c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)
Apr 14 11:02:49 user nova-compute[71509]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219 (non-flash)
Apr 14 11:02:49 user nova-compute[71509]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3 (non-flash)
Apr 14 11:02:49 user nova-compute[71509]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0da1ed17-2b8c-4dd3-a61a-1133a9420d21 (non-flash)
Apr 14 11:02:49 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 11:02:49 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-e0e943bf-a560-466b-9087-b5b460c8ce3c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0da1ed17-2b8c-4dd3-a61a-1133a9420d21" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 11:02:49 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0e943bf-a560-466b-9087-b5b460c8ce3c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Connected to 172.16.0.220:3260 {{(pid=71509) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 11:02:49 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-e0e943bf-a560-466b-9087-b5b460c8ce3c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] HCTL ('36', '-', '-', 0) found on session 44 with lun 0 {{(pid=71509) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 11:02:49 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-e0e943bf-a560-466b-9087-b5b460c8ce3c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71509) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 11:02:49 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:02:49 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:02:49 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[9335688c-ab70-4334-8e3c-3a341a2f92b1]: (4, ('- - 0', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:02:49 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-e0e943bf-a560-466b-9087-b5b460c8ce3c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Searching for a device in session 44 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71509) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 11:02:49 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0e943bf-a560-466b-9087-b5b460c8ce3c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:0da1ed17-2b8c-4dd3-a61a-1133a9420d21', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UNHnOXfL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71509) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 11:02:49 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:02:50 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-e0e943bf-a560-466b-9087-b5b460c8ce3c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.325s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 11:02:50 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0e943bf-a560-466b-9087-b5b460c8ce3c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] <== connect_volume: return (1327ms) {'type': 'block', 'scsi_wwn': '26363356162626137', 'path': '/dev/sde'} {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 11:02:50 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0e943bf-a560-466b-9087-b5b460c8ce3c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26363356162626137', 'path': '/dev/sde'} {{(pid=71509) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 11:02:50 user nova-compute[71509]: DEBUG nova.objects.instance [None req-e0e943bf-a560-466b-9087-b5b460c8ce3c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lazy-loading 'flavor' on Instance uuid 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 11:02:50 user nova-compute[71509]: DEBUG nova.virt.libvirt.guest [None req-e0e943bf-a560-466b-9087-b5b460c8ce3c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 11:02:50 user nova-compute[71509]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 11:02:50 user nova-compute[71509]:   <source dev="/dev/sde"/>
Apr 14 11:02:50 user nova-compute[71509]:   <target dev="vdb" bus="virtio"/>
Apr 14 11:02:50 user nova-compute[71509]:   <serial>0da1ed17-2b8c-4dd3-a61a-1133a9420d21</serial>
Apr 14 11:02:50 user nova-compute[71509]: </disk>
Apr 14 11:02:50 user nova-compute[71509]:  {{(pid=71509) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 11:02:51 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-e0e943bf-a560-466b-9087-b5b460c8ce3c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] No BDM found with device name vda, not building metadata. {{(pid=71509) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 11:02:51 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-e0e943bf-a560-466b-9087-b5b460c8ce3c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71509) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 11:02:51 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-e0e943bf-a560-466b-9087-b5b460c8ce3c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] No VIF found with MAC fa:16:3e:ca:60:62, not building metadata {{(pid=71509) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 11:02:51 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-e0e943bf-a560-466b-9087-b5b460c8ce3c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "9c4cc2a1-0c54-4f20-b33f-9085af7b10a3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.568s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:02:51 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:02:51 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:02:53 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-33a96342-9f78-4c9c-98a0-02cc3889e1da tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "3db2e71c-939b-4d2f-b1be-c2122f7cd73e" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:02:53 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-33a96342-9f78-4c9c-98a0-02cc3889e1da tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "3db2e71c-939b-4d2f-b1be-c2122f7cd73e" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:02:53 user nova-compute[71509]: DEBUG nova.compute.manager [None req-33a96342-9f78-4c9c-98a0-02cc3889e1da tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] Going to confirm migration 2 {{(pid=71509) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4663}}
Apr 14 11:02:53 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-33a96342-9f78-4c9c-98a0-02cc3889e1da tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "refresh_cache-3db2e71c-939b-4d2f-b1be-c2122f7cd73e" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 11:02:53 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-33a96342-9f78-4c9c-98a0-02cc3889e1da tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquired lock "refresh_cache-3db2e71c-939b-4d2f-b1be-c2122f7cd73e" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 11:02:53 user nova-compute[71509]: DEBUG nova.network.neutron [None req-33a96342-9f78-4c9c-98a0-02cc3889e1da tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] Building network info cache for instance {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 11:02:53 user nova-compute[71509]: DEBUG nova.objects.instance [None req-33a96342-9f78-4c9c-98a0-02cc3889e1da tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lazy-loading 'info_cache' on Instance uuid 3db2e71c-939b-4d2f-b1be-c2122f7cd73e {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 11:02:53 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:02:53 user nova-compute[71509]: DEBUG nova.network.neutron [None req-33a96342-9f78-4c9c-98a0-02cc3889e1da tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] Updating instance_info_cache with network_info: [{"id": "1e547ec7-7efd-480f-84be-806c8cf25b90", "address": "fa:16:3e:34:08:47", "network": {"id": "18a91434-637b-4c19-a97b-736b32c1ea5a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1824162811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea2cb4dfa5b4a52b658efd8f5aefb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e547ec7-7e", "ovs_interfaceid": "1e547ec7-7efd-480f-84be-806c8cf25b90", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:02:53 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-33a96342-9f78-4c9c-98a0-02cc3889e1da tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Releasing lock "refresh_cache-3db2e71c-939b-4d2f-b1be-c2122f7cd73e" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 11:02:53 user nova-compute[71509]: DEBUG nova.objects.instance [None req-33a96342-9f78-4c9c-98a0-02cc3889e1da tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lazy-loading 'migration_context' on Instance uuid 3db2e71c-939b-4d2f-b1be-c2122f7cd73e {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 11:02:53 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-33a96342-9f78-4c9c-98a0-02cc3889e1da tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:02:53 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-33a96342-9f78-4c9c-98a0-02cc3889e1da tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:02:54 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-33a96342-9f78-4c9c-98a0-02cc3889e1da tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 11:02:54 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-33a96342-9f78-4c9c-98a0-02cc3889e1da tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 11:02:54 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-33a96342-9f78-4c9c-98a0-02cc3889e1da tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.427s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:02:54 user nova-compute[71509]: INFO nova.scheduler.client.report [None req-33a96342-9f78-4c9c-98a0-02cc3889e1da tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Deleted allocation for migration 642d65c1-f5b8-43ae-8abe-e04d77cd069e
Apr 14 11:02:54 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-33a96342-9f78-4c9c-98a0-02cc3889e1da tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "3db2e71c-939b-4d2f-b1be-c2122f7cd73e" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.339s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:02:54 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:02:55 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:02:55 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:02:55 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:02:55 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:02:55 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:02:55 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Auditing locally available compute resources for user (node: user) {{(pid=71509) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 11:02:55 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b96e2a1a-8c1b-4189-86b9-a3c1761a9813/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:02:55 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b96e2a1a-8c1b-4189-86b9-a3c1761a9813/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:02:55 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b96e2a1a-8c1b-4189-86b9-a3c1761a9813/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:02:55 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b96e2a1a-8c1b-4189-86b9-a3c1761a9813/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:02:55 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c4cc2a1-0c54-4f20-b33f-9085af7b10a3/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:02:56 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c4cc2a1-0c54-4f20-b33f-9085af7b10a3/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:02:56 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c4cc2a1-0c54-4f20-b33f-9085af7b10a3/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:02:56 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c4cc2a1-0c54-4f20-b33f-9085af7b10a3/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:02:56 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=71509) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 11:02:56 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e479154a-acd6-47aa-9a5b-43c6e0feda07/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:02:56 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e479154a-acd6-47aa-9a5b-43c6e0feda07/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:02:56 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e479154a-acd6-47aa-9a5b-43c6e0feda07/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:02:56 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e479154a-acd6-47aa-9a5b-43c6e0feda07/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:02:56 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f41f217-0df2-4205-9633-7dbe83f40c96/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:02:56 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f41f217-0df2-4205-9633-7dbe83f40c96/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:02:56 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f41f217-0df2-4205-9633-7dbe83f40c96/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:02:56 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f41f217-0df2-4205-9633-7dbe83f40c96/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:02:56 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71509) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 11:02:56 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d70b388-155f-4e47-8352-b69c856b2000/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:02:56 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d70b388-155f-4e47-8352-b69c856b2000/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:02:56 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d70b388-155f-4e47-8352-b69c856b2000/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:02:57 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d70b388-155f-4e47-8352-b69c856b2000/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:02:57 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71509) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 11:02:57 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a936fb20-3f17-4114-829a-8659da6bc5f3/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:02:57 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a936fb20-3f17-4114-829a-8659da6bc5f3/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:02:57 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a936fb20-3f17-4114-829a-8659da6bc5f3/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:02:57 user nova-compute[71509]: DEBUG nova.compute.manager [req-4acaca7f-c7cc-4768-ac22-11f607820565 req-59a84ee1-4a56-44a3-9e1c-576161771b4a service nova] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Received event network-changed-f41f6957-bf6d-47bf-bb71-638137929e1e {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:02:57 user nova-compute[71509]: DEBUG nova.compute.manager [req-4acaca7f-c7cc-4768-ac22-11f607820565 req-59a84ee1-4a56-44a3-9e1c-576161771b4a service nova] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Refreshing instance network info cache due to event network-changed-f41f6957-bf6d-47bf-bb71-638137929e1e. {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 11:02:57 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-4acaca7f-c7cc-4768-ac22-11f607820565 req-59a84ee1-4a56-44a3-9e1c-576161771b4a service nova] Acquiring lock "refresh_cache-9c4cc2a1-0c54-4f20-b33f-9085af7b10a3" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 11:02:57 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-4acaca7f-c7cc-4768-ac22-11f607820565 req-59a84ee1-4a56-44a3-9e1c-576161771b4a service nova] Acquired lock "refresh_cache-9c4cc2a1-0c54-4f20-b33f-9085af7b10a3" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 11:02:57 user nova-compute[71509]: DEBUG nova.network.neutron [req-4acaca7f-c7cc-4768-ac22-11f607820565 req-59a84ee1-4a56-44a3-9e1c-576161771b4a service nova] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Refreshing network info cache for port f41f6957-bf6d-47bf-bb71-638137929e1e {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 11:02:57 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a936fb20-3f17-4114-829a-8659da6bc5f3/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:02:57 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dd9e11f-1fed-42af-ad5c-9cdd051b93e7/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:02:57 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dd9e11f-1fed-42af-ad5c-9cdd051b93e7/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:02:57 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dd9e11f-1fed-42af-ad5c-9cdd051b93e7/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:02:57 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dd9e11f-1fed-42af-ad5c-9cdd051b93e7/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:02:57 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1fdcfb4-8700-48fe-9dec-1e8a4b766cba/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:02:57 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:02:57 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1fdcfb4-8700-48fe-9dec-1e8a4b766cba/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:02:57 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1fdcfb4-8700-48fe-9dec-1e8a4b766cba/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:02:58 user nova-compute[71509]: DEBUG nova.network.neutron [req-4acaca7f-c7cc-4768-ac22-11f607820565 req-59a84ee1-4a56-44a3-9e1c-576161771b4a service nova] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Updated VIF entry in instance network info cache for port f41f6957-bf6d-47bf-bb71-638137929e1e. {{(pid=71509) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 11:02:58 user nova-compute[71509]: DEBUG nova.network.neutron [req-4acaca7f-c7cc-4768-ac22-11f607820565 req-59a84ee1-4a56-44a3-9e1c-576161771b4a service nova] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Updating instance_info_cache with network_info: [{"id": "f41f6957-bf6d-47bf-bb71-638137929e1e", "address": "fa:16:3e:ca:60:62", "network": {"id": "d59680e7-ed50-4356-b665-ec64ff939708", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-598238133-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5809862340a84c83a772c65c77513608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf41f6957-bf", "ovs_interfaceid": "f41f6957-bf6d-47bf-bb71-638137929e1e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:02:58 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1fdcfb4-8700-48fe-9dec-1e8a4b766cba/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:02:58 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-4acaca7f-c7cc-4768-ac22-11f607820565 req-59a84ee1-4a56-44a3-9e1c-576161771b4a service nova] Releasing lock "refresh_cache-9c4cc2a1-0c54-4f20-b33f-9085af7b10a3" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 11:02:58 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71509) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 11:02:58 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:02:58 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 11:02:58 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 11:02:58 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Hypervisor/Node resource view: name=user free_ram=7532MB free_disk=25.74958038330078GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71509) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 11:02:58 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:02:58 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:02:58 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance e479154a-acd6-47aa-9a5b-43c6e0feda07 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 11:02:58 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 6cae9f61-763f-4671-a873-d15f01384416 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 11:02:58 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 6f41f217-0df2-4205-9633-7dbe83f40c96 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 11:02:58 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance a936fb20-3f17-4114-829a-8659da6bc5f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 11:02:58 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 0dd9e11f-1fed-42af-ad5c-9cdd051b93e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 11:02:58 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance fbcca78c-fe73-4ef1-92f9-4c8061cad177 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 11:02:58 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 11:02:58 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 3db2e71c-939b-4d2f-b1be-c2122f7cd73e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 11:02:58 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 3d70b388-155f-4e47-8352-b69c856b2000 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 11:02:58 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance a1fdcfb4-8700-48fe-9dec-1e8a4b766cba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 11:02:58 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance b96e2a1a-8c1b-4189-86b9-a3c1761a9813 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 11:02:58 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=71509) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 11:02:58 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Final resource view: name=user phys_ram=16023MB used_ram=1984MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=71509) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 11:02:59 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 11:02:59 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 11:02:59 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Compute_service record updated for user:user {{(pid=71509) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 11:02:59 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.467s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:02:59 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:03:00 user nova-compute[71509]: DEBUG nova.compute.manager [req-43a6c57a-68b5-4a33-9eb9-a08a29f3c01b req-97166d0a-bf14-4e69-9115-e0d2431dc18b service nova] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Received event network-changed-f41f6957-bf6d-47bf-bb71-638137929e1e {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:03:00 user nova-compute[71509]: DEBUG nova.compute.manager [req-43a6c57a-68b5-4a33-9eb9-a08a29f3c01b req-97166d0a-bf14-4e69-9115-e0d2431dc18b service nova] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Refreshing instance network info cache due to event network-changed-f41f6957-bf6d-47bf-bb71-638137929e1e. {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 11:03:00 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-43a6c57a-68b5-4a33-9eb9-a08a29f3c01b req-97166d0a-bf14-4e69-9115-e0d2431dc18b service nova] Acquiring lock "refresh_cache-9c4cc2a1-0c54-4f20-b33f-9085af7b10a3" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 11:03:00 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-43a6c57a-68b5-4a33-9eb9-a08a29f3c01b req-97166d0a-bf14-4e69-9115-e0d2431dc18b service nova] Acquired lock "refresh_cache-9c4cc2a1-0c54-4f20-b33f-9085af7b10a3" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 11:03:00 user nova-compute[71509]: DEBUG nova.network.neutron [req-43a6c57a-68b5-4a33-9eb9-a08a29f3c01b req-97166d0a-bf14-4e69-9115-e0d2431dc18b service nova] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Refreshing network info cache for port f41f6957-bf6d-47bf-bb71-638137929e1e {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 11:03:00 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:03:00 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Starting heal instance info cache {{(pid=71509) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 11:03:00 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Rebuilding the list of instances to heal {{(pid=71509) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 11:03:00 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "refresh_cache-e479154a-acd6-47aa-9a5b-43c6e0feda07" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 11:03:00 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquired lock "refresh_cache-e479154a-acd6-47aa-9a5b-43c6e0feda07" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 11:03:00 user nova-compute[71509]: DEBUG nova.network.neutron [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] [instance: e479154a-acd6-47aa-9a5b-43c6e0feda07] Forcefully refreshing network info cache for instance {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 11:03:00 user nova-compute[71509]: DEBUG nova.objects.instance [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lazy-loading 'info_cache' on Instance uuid e479154a-acd6-47aa-9a5b-43c6e0feda07 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 11:03:00 user nova-compute[71509]: DEBUG nova.network.neutron [req-43a6c57a-68b5-4a33-9eb9-a08a29f3c01b req-97166d0a-bf14-4e69-9115-e0d2431dc18b service nova] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Updated VIF entry in instance network info cache for port f41f6957-bf6d-47bf-bb71-638137929e1e. {{(pid=71509) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 11:03:00 user nova-compute[71509]: DEBUG nova.network.neutron [req-43a6c57a-68b5-4a33-9eb9-a08a29f3c01b req-97166d0a-bf14-4e69-9115-e0d2431dc18b service nova] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Updating instance_info_cache with network_info: [{"id": "f41f6957-bf6d-47bf-bb71-638137929e1e", "address": "fa:16:3e:ca:60:62", "network": {"id": "d59680e7-ed50-4356-b665-ec64ff939708", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-598238133-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5809862340a84c83a772c65c77513608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf41f6957-bf", "ovs_interfaceid": "f41f6957-bf6d-47bf-bb71-638137929e1e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:03:00 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-43a6c57a-68b5-4a33-9eb9-a08a29f3c01b req-97166d0a-bf14-4e69-9115-e0d2431dc18b service nova] Releasing lock "refresh_cache-9c4cc2a1-0c54-4f20-b33f-9085af7b10a3" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 11:03:00 user nova-compute[71509]: DEBUG nova.network.neutron [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] [instance: e479154a-acd6-47aa-9a5b-43c6e0feda07] Updating instance_info_cache with network_info: [{"id": "2fbfd894-8e16-4039-b726-638e802602c5", "address": "fa:16:3e:4d:3b:0d", "network": {"id": "07f1f39e-292a-4e73-b4ed-99e5799d6fa8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1339551596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71289f80a05141f482cb538dac3d7b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fbfd894-8e", "ovs_interfaceid": "2fbfd894-8e16-4039-b726-638e802602c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:03:00 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Releasing lock "refresh_cache-e479154a-acd6-47aa-9a5b-43c6e0feda07" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 11:03:00 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] [instance: e479154a-acd6-47aa-9a5b-43c6e0feda07] Updated the network info_cache for instance {{(pid=71509) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 11:03:03 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:03:04 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-9ee01819-87f5-4459-ad3e-1aa31c45905c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Acquiring lock "9c4cc2a1-0c54-4f20-b33f-9085af7b10a3" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:03:04 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-9ee01819-87f5-4459-ad3e-1aa31c45905c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "9c4cc2a1-0c54-4f20-b33f-9085af7b10a3" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:03:04 user nova-compute[71509]: INFO nova.compute.manager [None req-9ee01819-87f5-4459-ad3e-1aa31c45905c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Rebooting instance
Apr 14 11:03:04 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-9ee01819-87f5-4459-ad3e-1aa31c45905c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Acquiring lock "refresh_cache-9c4cc2a1-0c54-4f20-b33f-9085af7b10a3" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 11:03:04 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-9ee01819-87f5-4459-ad3e-1aa31c45905c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Acquired lock "refresh_cache-9c4cc2a1-0c54-4f20-b33f-9085af7b10a3" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 11:03:04 user nova-compute[71509]: DEBUG nova.network.neutron [None req-9ee01819-87f5-4459-ad3e-1aa31c45905c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Building network info cache for instance {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 11:03:04 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:03:04 user nova-compute[71509]: DEBUG nova.network.neutron [None req-9ee01819-87f5-4459-ad3e-1aa31c45905c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Updating instance_info_cache with network_info: [{"id": "f41f6957-bf6d-47bf-bb71-638137929e1e", "address": "fa:16:3e:ca:60:62", "network": {"id": "d59680e7-ed50-4356-b665-ec64ff939708", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-598238133-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5809862340a84c83a772c65c77513608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf41f6957-bf", "ovs_interfaceid": "f41f6957-bf6d-47bf-bb71-638137929e1e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:03:04 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-9ee01819-87f5-4459-ad3e-1aa31c45905c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Releasing lock "refresh_cache-9c4cc2a1-0c54-4f20-b33f-9085af7b10a3" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 11:03:04 user nova-compute[71509]: DEBUG nova.compute.manager [None req-9ee01819-87f5-4459-ad3e-1aa31c45905c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 11:03:05 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:03:05 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:03:05 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:03:05 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:03:05 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:03:05 user nova-compute[71509]: DEBUG nova.compute.manager [req-5748080e-452d-4491-a2b5-df06ab9626ab req-36ef39fa-4cd8-41dc-96f2-1889ca0e4ae0 service nova] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Received event network-vif-unplugged-f41f6957-bf6d-47bf-bb71-638137929e1e {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:03:05 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-5748080e-452d-4491-a2b5-df06ab9626ab req-36ef39fa-4cd8-41dc-96f2-1889ca0e4ae0 service nova] Acquiring lock "9c4cc2a1-0c54-4f20-b33f-9085af7b10a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:03:05 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-5748080e-452d-4491-a2b5-df06ab9626ab req-36ef39fa-4cd8-41dc-96f2-1889ca0e4ae0 service nova] Lock "9c4cc2a1-0c54-4f20-b33f-9085af7b10a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:03:05 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-5748080e-452d-4491-a2b5-df06ab9626ab req-36ef39fa-4cd8-41dc-96f2-1889ca0e4ae0 service nova] Lock "9c4cc2a1-0c54-4f20-b33f-9085af7b10a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:03:05 user nova-compute[71509]: DEBUG nova.compute.manager [req-5748080e-452d-4491-a2b5-df06ab9626ab req-36ef39fa-4cd8-41dc-96f2-1889ca0e4ae0 service nova] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] No waiting events found dispatching network-vif-unplugged-f41f6957-bf6d-47bf-bb71-638137929e1e {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:03:05 user nova-compute[71509]: WARNING nova.compute.manager [req-5748080e-452d-4491-a2b5-df06ab9626ab req-36ef39fa-4cd8-41dc-96f2-1889ca0e4ae0 service nova] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Received unexpected event network-vif-unplugged-f41f6957-bf6d-47bf-bb71-638137929e1e for instance with vm_state active and task_state reboot_started_hard.
Apr 14 11:03:05 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Instance destroyed successfully.
Apr 14 11:03:05 user nova-compute[71509]: DEBUG nova.objects.instance [None req-9ee01819-87f5-4459-ad3e-1aa31c45905c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lazy-loading 'resources' on Instance uuid 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 11:03:05 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-9ee01819-87f5-4459-ad3e-1aa31c45905c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T11:00:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-145954405',display_name='tempest-TestMinimumBasicScenario-server-145954405',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-145954405',id=36,image_ref='4a4373e4-8d8a-4e8c-abe0-ace7652a4a7d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJI56DgU3GFkyba07rJQ5gPWmf+s+oszKE0l2AEuBdasOhPKZbxdMzg3ltBRBJuQQhxmZUmQrEIrG8aYiF6ueY2ARcTYBp9F9Zb4rPcdzBhgtNF8DrTPiOHvxBGxF5+ocQ==',key_name='tempest-TestMinimumBasicScenario-1104464810',keypairs=<?>,launch_index=0,launched_at=2023-04-14T11:00:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5809862340a84c83a772c65c77513608',ramdisk_id='',reservation_id='r-4ptbez4v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4a4373e4-8d8a-4e8c-abe0-ace7652a4a7d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-2127394977',owner_user_name='tempest-TestMinimumBasicScenario-2127394977-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T11:03:05Z,user_data=None,user_id='831215baa8fd4fe7ba65193bbbdad1b4',uuid=9c4cc2a1-0c54-4f20-b33f-9085af7b10a3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f41f6957-bf6d-47bf-bb71-638137929e1e", "address": "fa:16:3e:ca:60:62", "network": {"id": "d59680e7-ed50-4356-b665-ec64ff939708", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-598238133-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5809862340a84c83a772c65c77513608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf41f6957-bf", "ovs_interfaceid": "f41f6957-bf6d-47bf-bb71-638137929e1e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 11:03:05 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-9ee01819-87f5-4459-ad3e-1aa31c45905c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Converting VIF {"id": "f41f6957-bf6d-47bf-bb71-638137929e1e", "address": "fa:16:3e:ca:60:62", "network": {"id": "d59680e7-ed50-4356-b665-ec64ff939708", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-598238133-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5809862340a84c83a772c65c77513608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf41f6957-bf", "ovs_interfaceid": "f41f6957-bf6d-47bf-bb71-638137929e1e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 11:03:05 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-9ee01819-87f5-4459-ad3e-1aa31c45905c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ca:60:62,bridge_name='br-int',has_traffic_filtering=True,id=f41f6957-bf6d-47bf-bb71-638137929e1e,network=Network(d59680e7-ed50-4356-b665-ec64ff939708),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf41f6957-bf') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 11:03:05 user nova-compute[71509]: DEBUG os_vif [None req-9ee01819-87f5-4459-ad3e-1aa31c45905c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ca:60:62,bridge_name='br-int',has_traffic_filtering=True,id=f41f6957-bf6d-47bf-bb71-638137929e1e,network=Network(d59680e7-ed50-4356-b665-ec64ff939708),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf41f6957-bf') {{(pid=71509) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 11:03:05 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:03:05 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf41f6957-bf, bridge=br-int, if_exists=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:03:05 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:03:05 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:03:05 user nova-compute[71509]: INFO os_vif [None req-9ee01819-87f5-4459-ad3e-1aa31c45905c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ca:60:62,bridge_name='br-int',has_traffic_filtering=True,id=f41f6957-bf6d-47bf-bb71-638137929e1e,network=Network(d59680e7-ed50-4356-b665-ec64ff939708),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf41f6957-bf')
Apr 14 11:03:05 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ee01819-87f5-4459-ad3e-1aa31c45905c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] calling os-brick to detach iSCSI Volume {{(pid=71509) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 11:03:05 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee01819-87f5-4459-ad3e-1aa31c45905c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0bf0749390>, {'target_iqn': 'iqn.2010-10.org.openstack:0da1ed17-2b8c-4dd3-a61a-1133a9420d21', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UNHnOXfL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 11:03:05 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-9ee01819-87f5-4459-ad3e-1aa31c45905c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 11:03:05 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-9ee01819-87f5-4459-ad3e-1aa31c45905c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 11:03:05 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-9ee01819-87f5-4459-ad3e-1aa31c45905c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 11:03:05 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:03:05 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:03:05 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[f295bd8d-d117-434a-a606-2f2dfdf7b7ca]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0da1ed17-2b8c-4dd3-a61a-1133a9420d21\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:03:05 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee01819-87f5-4459-ad3e-1aa31c45905c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 11:03:05 user nova-compute[71509]: No targets found.
Apr 14 11:03:05 user nova-compute[71509]: iSNS:
Apr 14 11:03:05 user nova-compute[71509]: No targets found.
Apr 14 11:03:05 user nova-compute[71509]: STATIC:
Apr 14 11:03:05 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3
Apr 14 11:03:05 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 11:03:05 user nova-compute[71509]:                 Iface Name: default
Apr 14 11:03:05 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:0da1ed17-2b8c-4dd3-a61a-1133a9420d21
Apr 14 11:03:05 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 11:03:05 user nova-compute[71509]:                 Iface Name: default
Apr 14 11:03:05 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178
Apr 14 11:03:05 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 11:03:05 user nova-compute[71509]:                 Iface Name: default
Apr 14 11:03:05 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219
Apr 14 11:03:05 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 11:03:05 user nova-compute[71509]:                 Iface Name: default
Apr 14 11:03:05 user nova-compute[71509]: FIRMWARE:
Apr 14 11:03:05 user nova-compute[71509]: No targets found.
Apr 14 11:03:05 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 11:03:05 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee01819-87f5-4459-ad3e-1aa31c45905c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 11:03:05 user nova-compute[71509]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 11:03:05 user nova-compute[71509]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71509) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 11:03:05 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee01819-87f5-4459-ad3e-1aa31c45905c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0da1ed17-2b8c-4dd3-a61a-1133a9420d21', 0)] {{(pid=71509) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 11:03:05 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:03:05 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:03:05 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[e770da4a-e1b5-43f9-97b5-940ef31dacd2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0da1ed17-2b8c-4dd3-a61a-1133a9420d21\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:03:05 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:03:05 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:03:05 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4b1e383-e5c1-4249-920f-a3b33eeafbf0]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0da1ed17-2b8c-4dd3-a61a-1133a9420d21 (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:03:05 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee01819-87f5-4459-ad3e-1aa31c45905c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)
Apr 14 11:03:05 user nova-compute[71509]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219 (non-flash)
Apr 14 11:03:05 user nova-compute[71509]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3 (non-flash)
Apr 14 11:03:05 user nova-compute[71509]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0da1ed17-2b8c-4dd3-a61a-1133a9420d21 (non-flash)
Apr 14 11:03:05 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 11:03:05 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee01819-87f5-4459-ad3e-1aa31c45905c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)
Apr 14 11:03:05 user nova-compute[71509]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219 (non-flash)
Apr 14 11:03:05 user nova-compute[71509]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3 (non-flash)
Apr 14 11:03:05 user nova-compute[71509]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0da1ed17-2b8c-4dd3-a61a-1133a9420d21 (non-flash)
Apr 14 11:03:05 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 11:03:05 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee01819-87f5-4459-ad3e-1aa31c45905c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0c142bc4c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0da1ed17-2b8c-4dd3-a61a-1133a9420d21'): ({'sde'}, set())}) {{(pid=71509) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 11:03:05 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-9ee01819-87f5-4459-ad3e-1aa31c45905c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Removing single pathed devices sde {{(pid=71509) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 11:03:05 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:03:05 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:03:05 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[21173133-00c7-470a-ae04-bcf714d1af43]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:03:05 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:03:05 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:03:05 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe7030ca-0917-42fa-83e3-c11b2d528b71]: (4, ('ok\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:03:05 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-9ee01819-87f5-4459-ad3e-1aa31c45905c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Flushing IO for device /dev/sde {{(pid=71509) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 11:03:06 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:03:06 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:03:06 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[a77e6db7-739f-4f15-8535-630694caf46c]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:03:06 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-9ee01819-87f5-4459-ad3e-1aa31c45905c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71509) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 11:03:06 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:03:06 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.032s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:03:06 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[624045dc-06d1-4f18-a940-d177bb89945c]: (4, ('1', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:03:06 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-9ee01819-87f5-4459-ad3e-1aa31c45905c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71509) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 11:03:06 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-9ee01819-87f5-4459-ad3e-1aa31c45905c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] SCSI volumes sde have been removed. {{(pid=71509) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 11:03:06 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee01819-87f5-4459-ad3e-1aa31c45905c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0da1ed17-2b8c-4dd3-a61a-1133a9420d21')] {{(pid=71509) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 11:03:06 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0da1ed17-2b8c-4dd3-a61a-1133a9420d21 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:03:06 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0da1ed17-2b8c-4dd3-a61a-1133a9420d21 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:03:06 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[a15cc19d-afca-4679-a159-f8ee24a8a5f8]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:03:06 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee01819-87f5-4459-ad3e-1aa31c45905c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:03:06 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0da1ed17-2b8c-4dd3-a61a-1133a9420d21 -p 172.16.0.220:3260 --logout {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:03:06 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0da1ed17-2b8c-4dd3-a61a-1133a9420d21 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:03:06 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[16d9b469-88c8-4e34-aaa8-df6da8451a23]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:0da1ed17-2b8c-4dd3-a61a-1133a9420d21, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:0da1ed17-2b8c-4dd3-a61a-1133a9420d21, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:03:06 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee01819-87f5-4459-ad3e-1aa31c45905c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:0da1ed17-2b8c-4dd3-a61a-1133a9420d21, portal: 172.16.0.220,3260]
Apr 14 11:03:06 user nova-compute[71509]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:0da1ed17-2b8c-4dd3-a61a-1133a9420d21, portal: 172.16.0.220,3260] successful.
Apr 14 11:03:06 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:03:06 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0da1ed17-2b8c-4dd3-a61a-1133a9420d21 -p 172.16.0.220:3260 --op delete {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:03:06 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0da1ed17-2b8c-4dd3-a61a-1133a9420d21 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:03:06 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[1802f82f-a719-4df3-98e2-65c348dc8449]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:03:06 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee01819-87f5-4459-ad3e-1aa31c45905c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:03:06 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-9ee01819-87f5-4459-ad3e-1aa31c45905c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 11:03:06 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee01819-87f5-4459-ad3e-1aa31c45905c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] <== disconnect_volume: return (320ms) None {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 11:03:06 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ee01819-87f5-4459-ad3e-1aa31c45905c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Disconnected iSCSI Volume {{(pid=71509) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 11:03:06 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-9ee01819-87f5-4459-ad3e-1aa31c45905c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Start _get_guest_xml network_info=[{"id": "f41f6957-bf6d-47bf-bb71-638137929e1e", "address": "fa:16:3e:ca:60:62", "network": {"id": "d59680e7-ed50-4356-b665-ec64ff939708", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-598238133-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5809862340a84c83a772c65c77513608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf41f6957-bf", "ovs_interfaceid": "f41f6957-bf6d-47bf-bb71-638137929e1e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=4a4373e4-8d8a-4e8c-abe0-ace7652a4a7d,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '4a4373e4-8d8a-4e8c-abe0-ace7652a4a7d'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vdb', 'boot_index': None, 'device_type': 'disk', 'attachment_id': '088c1840-1051-47b1-b4c2-15cc52109859', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0da1ed17-2b8c-4dd3-a61a-1133a9420d21', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UNHnOXfL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '9c4cc2a1-0c54-4f20-b33f-9085af7b10a3', 'attached_at': '', 'detached_at': '', 'volume_id': '0da1ed17-2b8c-4dd3-a61a-1133a9420d21', 'serial': '0da1ed17-2b8c-4dd3-a61a-1133a9420d21'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'volume_type': None} {{(pid=71509) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 11:03:06 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-9ee01819-87f5-4459-ad3e-1aa31c45905c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 11:03:06 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-9ee01819-87f5-4459-ad3e-1aa31c45905c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 11:03:06 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-9ee01819-87f5-4459-ad3e-1aa31c45905c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71509) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 11:03:06 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-9ee01819-87f5-4459-ad3e-1aa31c45905c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T10:40:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=4a4373e4-8d8a-4e8c-abe0-ace7652a4a7d,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 11:03:06 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-9ee01819-87f5-4459-ad3e-1aa31c45905c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Flavor limits 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 11:03:06 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-9ee01819-87f5-4459-ad3e-1aa31c45905c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Image limits 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 11:03:06 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-9ee01819-87f5-4459-ad3e-1aa31c45905c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Flavor pref 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 11:03:06 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-9ee01819-87f5-4459-ad3e-1aa31c45905c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Image pref 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 11:03:06 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-9ee01819-87f5-4459-ad3e-1aa31c45905c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 11:03:06 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-9ee01819-87f5-4459-ad3e-1aa31c45905c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 11:03:06 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-9ee01819-87f5-4459-ad3e-1aa31c45905c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71509) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 11:03:06 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-9ee01819-87f5-4459-ad3e-1aa31c45905c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Got 1 possible topologies {{(pid=71509) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 11:03:06 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-9ee01819-87f5-4459-ad3e-1aa31c45905c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 11:03:06 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-9ee01819-87f5-4459-ad3e-1aa31c45905c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 11:03:06 user nova-compute[71509]: DEBUG nova.objects.instance [None req-9ee01819-87f5-4459-ad3e-1aa31c45905c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 11:03:06 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ee01819-87f5-4459-ad3e-1aa31c45905c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Calling os-brick to attach iSCSI Volume {{(pid=71509) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 11:03:06 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee01819-87f5-4459-ad3e-1aa31c45905c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0bf0749390>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0da1ed17-2b8c-4dd3-a61a-1133a9420d21', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UNHnOXfL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 11:03:06 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-9ee01819-87f5-4459-ad3e-1aa31c45905c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 11:03:06 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-9ee01819-87f5-4459-ad3e-1aa31c45905c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 11:03:06 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-9ee01819-87f5-4459-ad3e-1aa31c45905c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 11:03:06 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-9ee01819-87f5-4459-ad3e-1aa31c45905c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 11:03:06 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-9ee01819-87f5-4459-ad3e-1aa31c45905c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0da1ed17-2b8c-4dd3-a61a-1133a9420d21" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 11:03:06 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-9ee01819-87f5-4459-ad3e-1aa31c45905c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0da1ed17-2b8c-4dd3-a61a-1133a9420d21" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 11:03:06 user nova-compute[71509]: INFO os_brick.initiator.connectors.iscsi [None req-9ee01819-87f5-4459-ad3e-1aa31c45905c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 11:03:06 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0da1ed17-2b8c-4dd3-a61a-1133a9420d21 -p 172.16.0.220:3260 {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:03:06 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0da1ed17-2b8c-4dd3-a61a-1133a9420d21 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:03:06 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[12b92bb5-efc0-4ec6-aeff-e5d7976e9687]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:03:06 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee01819-87f5-4459-ad3e-1aa31c45905c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 11:03:06 user nova-compute[71509]:  {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:03:06 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0da1ed17-2b8c-4dd3-a61a-1133a9420d21 -p 172.16.0.220:3260 --interface default --op new {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:03:06 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0da1ed17-2b8c-4dd3-a61a-1133a9420d21 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:03:06 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[6817e0fe-b52d-44fd-a263-f91e828e926a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0da1ed17-2b8c-4dd3-a61a-1133a9420d21] added\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:03:06 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee01819-87f5-4459-ad3e-1aa31c45905c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0da1ed17-2b8c-4dd3-a61a-1133a9420d21] added
Apr 14 11:03:06 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:03:06 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0da1ed17-2b8c-4dd3-a61a-1133a9420d21 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:03:06 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0da1ed17-2b8c-4dd3-a61a-1133a9420d21 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:03:06 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[dca4b38c-4c06-4ad0-b0b3-b055e2574bf1]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:03:06 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee01819-87f5-4459-ad3e-1aa31c45905c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:03:06 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0da1ed17-2b8c-4dd3-a61a-1133a9420d21 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:03:06 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0da1ed17-2b8c-4dd3-a61a-1133a9420d21 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:03:06 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd51fb57-4b12-459a-9ea8-a0d93830f425]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:03:06 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee01819-87f5-4459-ad3e-1aa31c45905c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:03:06 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0da1ed17-2b8c-4dd3-a61a-1133a9420d21 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UNHnOXfL {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:03:06 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0da1ed17-2b8c-4dd3-a61a-1133a9420d21 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UNHnOXfL" returned: 0 in 0.029s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:03:06 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff41b809-5be2-4164-9c9b-728bdf3083d5]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:03:06 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee01819-87f5-4459-ad3e-1aa31c45905c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UNHnOXfL'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:03:06 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0da1ed17-2b8c-4dd3-a61a-1133a9420d21 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:03:06 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0da1ed17-2b8c-4dd3-a61a-1133a9420d21 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.031s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:03:06 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[e94f9331-b956-4d2a-b504-604083e76c76]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:03:06 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee01819-87f5-4459-ad3e-1aa31c45905c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:03:06 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:03:06 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:03:06 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[14e338b5-a7d4-4aec-8f11-2f464c569523]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3 (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:03:06 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee01819-87f5-4459-ad3e-1aa31c45905c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)
Apr 14 11:03:06 user nova-compute[71509]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219 (non-flash)
Apr 14 11:03:06 user nova-compute[71509]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3 (non-flash)
Apr 14 11:03:06 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 11:03:06 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee01819-87f5-4459-ad3e-1aa31c45905c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)
Apr 14 11:03:06 user nova-compute[71509]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219 (non-flash)
Apr 14 11:03:06 user nova-compute[71509]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3 (non-flash)
Apr 14 11:03:06 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 11:03:06 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0da1ed17-2b8c-4dd3-a61a-1133a9420d21 -p 172.16.0.220:3260 --login {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:03:06 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0da1ed17-2b8c-4dd3-a61a-1133a9420d21 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:03:06 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[a53edcc1-bdef-4d9d-abaa-e7f7a035e2a9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0da1ed17-2b8c-4dd3-a61a-1133a9420d21, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0da1ed17-2b8c-4dd3-a61a-1133a9420d21, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:03:06 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee01819-87f5-4459-ad3e-1aa31c45905c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0da1ed17-2b8c-4dd3-a61a-1133a9420d21, portal: 172.16.0.220,3260]
Apr 14 11:03:06 user nova-compute[71509]: Login to [iface: default, target: iqn.2010-10.org.openstack:0da1ed17-2b8c-4dd3-a61a-1133a9420d21, portal: 172.16.0.220,3260] successful.
Apr 14 11:03:06 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:03:06 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0da1ed17-2b8c-4dd3-a61a-1133a9420d21 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:03:06 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0da1ed17-2b8c-4dd3-a61a-1133a9420d21 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:03:06 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[760a9006-7b96-4ad9-89b9-3f1547fd1743]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:03:06 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee01819-87f5-4459-ad3e-1aa31c45905c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:03:06 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:03:06 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:03:06 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[0435f1cc-62c9-4c0c-ab5f-58e2d10dae68]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0da1ed17-2b8c-4dd3-a61a-1133a9420d21 (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:03:06 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee01819-87f5-4459-ad3e-1aa31c45905c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)
Apr 14 11:03:06 user nova-compute[71509]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219 (non-flash)
Apr 14 11:03:06 user nova-compute[71509]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3 (non-flash)
Apr 14 11:03:06 user nova-compute[71509]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0da1ed17-2b8c-4dd3-a61a-1133a9420d21 (non-flash)
Apr 14 11:03:06 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 11:03:06 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee01819-87f5-4459-ad3e-1aa31c45905c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)
Apr 14 11:03:06 user nova-compute[71509]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219 (non-flash)
Apr 14 11:03:06 user nova-compute[71509]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3 (non-flash)
Apr 14 11:03:06 user nova-compute[71509]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0da1ed17-2b8c-4dd3-a61a-1133a9420d21 (non-flash)
Apr 14 11:03:06 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 11:03:06 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-9ee01819-87f5-4459-ad3e-1aa31c45905c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0da1ed17-2b8c-4dd3-a61a-1133a9420d21" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.313s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 11:03:06 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee01819-87f5-4459-ad3e-1aa31c45905c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Connected to 172.16.0.220:3260 {{(pid=71509) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 11:03:06 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-9ee01819-87f5-4459-ad3e-1aa31c45905c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] HCTL ('36', '-', '-', 0) found on session 45 with lun 0 {{(pid=71509) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 11:03:06 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-9ee01819-87f5-4459-ad3e-1aa31c45905c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=71509) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 11:03:06 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:03:06 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:03:06 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[1011d22a-8ba3-4039-9c71-9942b8cd3224]: (4, ('- - 0', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:03:06 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-9ee01819-87f5-4459-ad3e-1aa31c45905c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Searching for a device in session 45 and hctl ['36', '*', '*', 0] yield: None {{(pid=71509) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 11:03:07 user nova-compute[71509]: DEBUG nova.compute.manager [req-8a8505ea-de38-44fb-a956-a500e7eb9102 req-4311be4c-e25a-4f66-bbd9-51f948a31af7 service nova] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Received event network-vif-plugged-f41f6957-bf6d-47bf-bb71-638137929e1e {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:03:07 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-8a8505ea-de38-44fb-a956-a500e7eb9102 req-4311be4c-e25a-4f66-bbd9-51f948a31af7 service nova] Acquiring lock "9c4cc2a1-0c54-4f20-b33f-9085af7b10a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:03:07 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-8a8505ea-de38-44fb-a956-a500e7eb9102 req-4311be4c-e25a-4f66-bbd9-51f948a31af7 service nova] Lock "9c4cc2a1-0c54-4f20-b33f-9085af7b10a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:03:07 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-8a8505ea-de38-44fb-a956-a500e7eb9102 req-4311be4c-e25a-4f66-bbd9-51f948a31af7 service nova] Lock "9c4cc2a1-0c54-4f20-b33f-9085af7b10a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:03:07 user nova-compute[71509]: DEBUG nova.compute.manager [req-8a8505ea-de38-44fb-a956-a500e7eb9102 req-4311be4c-e25a-4f66-bbd9-51f948a31af7 service nova] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] No waiting events found dispatching network-vif-plugged-f41f6957-bf6d-47bf-bb71-638137929e1e {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:03:07 user nova-compute[71509]: WARNING nova.compute.manager [req-8a8505ea-de38-44fb-a956-a500e7eb9102 req-4311be4c-e25a-4f66-bbd9-51f948a31af7 service nova] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Received unexpected event network-vif-plugged-f41f6957-bf6d-47bf-bb71-638137929e1e for instance with vm_state active and task_state reboot_started_hard.
Apr 14 11:03:07 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-9ee01819-87f5-4459-ad3e-1aa31c45905c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Searching for a device in session 45 and hctl ['36', '*', '*', 0] yield: sde {{(pid=71509) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 11:03:07 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee01819-87f5-4459-ad3e-1aa31c45905c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:0da1ed17-2b8c-4dd3-a61a-1133a9420d21', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UNHnOXfL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=71509) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 11:03:07 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-9ee01819-87f5-4459-ad3e-1aa31c45905c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.344s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 11:03:07 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee01819-87f5-4459-ad3e-1aa31c45905c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] <== connect_volume: return (1345ms) {'type': 'block', 'scsi_wwn': '26363356162626137', 'path': '/dev/sde'} {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 11:03:07 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ee01819-87f5-4459-ad3e-1aa31c45905c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26363356162626137', 'path': '/dev/sde'} {{(pid=71509) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 11:03:07 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-9ee01819-87f5-4459-ad3e-1aa31c45905c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T11:00:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-145954405',display_name='tempest-TestMinimumBasicScenario-server-145954405',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-145954405',id=36,image_ref='4a4373e4-8d8a-4e8c-abe0-ace7652a4a7d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJI56DgU3GFkyba07rJQ5gPWmf+s+oszKE0l2AEuBdasOhPKZbxdMzg3ltBRBJuQQhxmZUmQrEIrG8aYiF6ueY2ARcTYBp9F9Zb4rPcdzBhgtNF8DrTPiOHvxBGxF5+ocQ==',key_name='tempest-TestMinimumBasicScenario-1104464810',keypairs=<?>,launch_index=0,launched_at=2023-04-14T11:00:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5809862340a84c83a772c65c77513608',ramdisk_id='',reservation_id='r-4ptbez4v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4a4373e4-8d8a-4e8c-abe0-ace7652a4a7d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-2127394977',owner_user_name='tempest-TestMinimumBasicScenario-2127394977-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T11:03:05Z,user_data=None,user_id='831215baa8fd4fe7ba65193bbbdad1b4',uuid=9c4cc2a1-0c54-4f20-b33f-9085af7b10a3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f41f6957-bf6d-47bf-bb71-638137929e1e", "address": "fa:16:3e:ca:60:62", "network": {"id": "d59680e7-ed50-4356-b665-ec64ff939708", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-598238133-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5809862340a84c83a772c65c77513608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf41f6957-bf", "ovs_interfaceid": "f41f6957-bf6d-47bf-bb71-638137929e1e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71509) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 11:03:07 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-9ee01819-87f5-4459-ad3e-1aa31c45905c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Converting VIF {"id": "f41f6957-bf6d-47bf-bb71-638137929e1e", "address": "fa:16:3e:ca:60:62", "network": {"id": "d59680e7-ed50-4356-b665-ec64ff939708", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-598238133-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5809862340a84c83a772c65c77513608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf41f6957-bf", "ovs_interfaceid": "f41f6957-bf6d-47bf-bb71-638137929e1e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 11:03:07 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-9ee01819-87f5-4459-ad3e-1aa31c45905c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ca:60:62,bridge_name='br-int',has_traffic_filtering=True,id=f41f6957-bf6d-47bf-bb71-638137929e1e,network=Network(d59680e7-ed50-4356-b665-ec64ff939708),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf41f6957-bf') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 11:03:07 user nova-compute[71509]: DEBUG nova.objects.instance [None req-9ee01819-87f5-4459-ad3e-1aa31c45905c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lazy-loading 'pci_devices' on Instance uuid 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 11:03:07 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-9ee01819-87f5-4459-ad3e-1aa31c45905c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] End _get_guest_xml xml=<domain type="kvm">
Apr 14 11:03:07 user nova-compute[71509]:   <uuid>9c4cc2a1-0c54-4f20-b33f-9085af7b10a3</uuid>
Apr 14 11:03:07 user nova-compute[71509]:   <name>instance-00000024</name>
Apr 14 11:03:07 user nova-compute[71509]:   <memory>131072</memory>
Apr 14 11:03:07 user nova-compute[71509]:   <vcpu>1</vcpu>
Apr 14 11:03:07 user nova-compute[71509]:   <metadata>
Apr 14 11:03:07 user nova-compute[71509]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 11:03:07 user nova-compute[71509]:       <nova:package version="0.0.0"/>
Apr 14 11:03:07 user nova-compute[71509]:       <nova:name>tempest-TestMinimumBasicScenario-server-145954405</nova:name>
Apr 14 11:03:07 user nova-compute[71509]:       <nova:creationTime>2023-04-14 11:03:06</nova:creationTime>
Apr 14 11:03:07 user nova-compute[71509]:       <nova:flavor name="m1.nano">
Apr 14 11:03:07 user nova-compute[71509]:         <nova:memory>128</nova:memory>
Apr 14 11:03:07 user nova-compute[71509]:         <nova:disk>1</nova:disk>
Apr 14 11:03:07 user nova-compute[71509]:         <nova:swap>0</nova:swap>
Apr 14 11:03:07 user nova-compute[71509]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 11:03:07 user nova-compute[71509]:         <nova:vcpus>1</nova:vcpus>
Apr 14 11:03:07 user nova-compute[71509]:       </nova:flavor>
Apr 14 11:03:07 user nova-compute[71509]:       <nova:owner>
Apr 14 11:03:07 user nova-compute[71509]:         <nova:user uuid="831215baa8fd4fe7ba65193bbbdad1b4">tempest-TestMinimumBasicScenario-2127394977-project-member</nova:user>
Apr 14 11:03:07 user nova-compute[71509]:         <nova:project uuid="5809862340a84c83a772c65c77513608">tempest-TestMinimumBasicScenario-2127394977</nova:project>
Apr 14 11:03:07 user nova-compute[71509]:       </nova:owner>
Apr 14 11:03:07 user nova-compute[71509]:       <nova:root type="image" uuid="4a4373e4-8d8a-4e8c-abe0-ace7652a4a7d"/>
Apr 14 11:03:07 user nova-compute[71509]:       <nova:ports>
Apr 14 11:03:07 user nova-compute[71509]:         <nova:port uuid="f41f6957-bf6d-47bf-bb71-638137929e1e">
Apr 14 11:03:07 user nova-compute[71509]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Apr 14 11:03:07 user nova-compute[71509]:         </nova:port>
Apr 14 11:03:07 user nova-compute[71509]:       </nova:ports>
Apr 14 11:03:07 user nova-compute[71509]:     </nova:instance>
Apr 14 11:03:07 user nova-compute[71509]:   </metadata>
Apr 14 11:03:07 user nova-compute[71509]:   <sysinfo type="smbios">
Apr 14 11:03:07 user nova-compute[71509]:     <system>
Apr 14 11:03:07 user nova-compute[71509]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 11:03:07 user nova-compute[71509]:       <entry name="product">OpenStack Nova</entry>
Apr 14 11:03:07 user nova-compute[71509]:       <entry name="version">0.0.0</entry>
Apr 14 11:03:07 user nova-compute[71509]:       <entry name="serial">9c4cc2a1-0c54-4f20-b33f-9085af7b10a3</entry>
Apr 14 11:03:07 user nova-compute[71509]:       <entry name="uuid">9c4cc2a1-0c54-4f20-b33f-9085af7b10a3</entry>
Apr 14 11:03:07 user nova-compute[71509]:       <entry name="family">Virtual Machine</entry>
Apr 14 11:03:07 user nova-compute[71509]:     </system>
Apr 14 11:03:07 user nova-compute[71509]:   </sysinfo>
Apr 14 11:03:07 user nova-compute[71509]:   <os>
Apr 14 11:03:07 user nova-compute[71509]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 11:03:07 user nova-compute[71509]:     <boot dev="hd"/>
Apr 14 11:03:07 user nova-compute[71509]:     <smbios mode="sysinfo"/>
Apr 14 11:03:07 user nova-compute[71509]:   </os>
Apr 14 11:03:07 user nova-compute[71509]:   <features>
Apr 14 11:03:07 user nova-compute[71509]:     <acpi/>
Apr 14 11:03:07 user nova-compute[71509]:     <apic/>
Apr 14 11:03:07 user nova-compute[71509]:     <vmcoreinfo/>
Apr 14 11:03:07 user nova-compute[71509]:   </features>
Apr 14 11:03:07 user nova-compute[71509]:   <clock offset="utc">
Apr 14 11:03:07 user nova-compute[71509]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 11:03:07 user nova-compute[71509]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 11:03:07 user nova-compute[71509]:     <timer name="hpet" present="no"/>
Apr 14 11:03:07 user nova-compute[71509]:   </clock>
Apr 14 11:03:07 user nova-compute[71509]:   <cpu mode="custom" match="exact">
Apr 14 11:03:07 user nova-compute[71509]:     <model>Nehalem</model>
Apr 14 11:03:07 user nova-compute[71509]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 11:03:07 user nova-compute[71509]:   </cpu>
Apr 14 11:03:07 user nova-compute[71509]:   <devices>
Apr 14 11:03:07 user nova-compute[71509]:     <disk type="file" device="disk">
Apr 14 11:03:07 user nova-compute[71509]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 11:03:07 user nova-compute[71509]:       <source file="/opt/stack/data/nova/instances/9c4cc2a1-0c54-4f20-b33f-9085af7b10a3/disk"/>
Apr 14 11:03:07 user nova-compute[71509]:       <target dev="vda" bus="virtio"/>
Apr 14 11:03:07 user nova-compute[71509]:     </disk>
Apr 14 11:03:07 user nova-compute[71509]:     <disk type="block" device="disk">
Apr 14 11:03:07 user nova-compute[71509]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 11:03:07 user nova-compute[71509]:       <source dev="/dev/sde"/>
Apr 14 11:03:07 user nova-compute[71509]:       <target dev="vdb" bus="virtio"/>
Apr 14 11:03:07 user nova-compute[71509]:       <serial>0da1ed17-2b8c-4dd3-a61a-1133a9420d21</serial>
Apr 14 11:03:07 user nova-compute[71509]:     </disk>
Apr 14 11:03:07 user nova-compute[71509]:     <interface type="ethernet">
Apr 14 11:03:07 user nova-compute[71509]:       <mac address="fa:16:3e:ca:60:62"/>
Apr 14 11:03:07 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 11:03:07 user nova-compute[71509]:       <mtu size="1442"/>
Apr 14 11:03:07 user nova-compute[71509]:       <target dev="tapf41f6957-bf"/>
Apr 14 11:03:07 user nova-compute[71509]:     </interface>
Apr 14 11:03:07 user nova-compute[71509]:     <serial type="pty">
Apr 14 11:03:07 user nova-compute[71509]:       <log file="/opt/stack/data/nova/instances/9c4cc2a1-0c54-4f20-b33f-9085af7b10a3/console.log" append="off"/>
Apr 14 11:03:07 user nova-compute[71509]:     </serial>
Apr 14 11:03:07 user nova-compute[71509]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 11:03:07 user nova-compute[71509]:     <video>
Apr 14 11:03:07 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 11:03:07 user nova-compute[71509]:     </video>
Apr 14 11:03:07 user nova-compute[71509]:     <rng model="virtio">
Apr 14 11:03:07 user nova-compute[71509]:       <backend model="random">/dev/urandom</backend>
Apr 14 11:03:07 user nova-compute[71509]:     </rng>
Apr 14 11:03:07 user nova-compute[71509]:     <controller type="usb" index="0" model="none"/>
Apr 14 11:03:07 user nova-compute[71509]:     <memballoon model="virtio">
Apr 14 11:03:07 user nova-compute[71509]:       <stats period="10"/>
Apr 14 11:03:07 user nova-compute[71509]:     </memballoon>
Apr 14 11:03:07 user nova-compute[71509]:   </devices>
Apr 14 11:03:07 user nova-compute[71509]: </domain>
Apr 14 11:03:07 user nova-compute[71509]:  {{(pid=71509) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 11:03:07 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-9ee01819-87f5-4459-ad3e-1aa31c45905c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c4cc2a1-0c54-4f20-b33f-9085af7b10a3/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:03:07 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-9ee01819-87f5-4459-ad3e-1aa31c45905c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c4cc2a1-0c54-4f20-b33f-9085af7b10a3/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:03:07 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-9ee01819-87f5-4459-ad3e-1aa31c45905c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c4cc2a1-0c54-4f20-b33f-9085af7b10a3/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:03:07 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-9ee01819-87f5-4459-ad3e-1aa31c45905c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c4cc2a1-0c54-4f20-b33f-9085af7b10a3/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:03:07 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-9ee01819-87f5-4459-ad3e-1aa31c45905c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] skipping disk /dev/sde (vdb) as it is a volume {{(pid=71509) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 11:03:07 user nova-compute[71509]: DEBUG nova.objects.instance [None req-9ee01819-87f5-4459-ad3e-1aa31c45905c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lazy-loading 'trusted_certs' on Instance uuid 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 11:03:08 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-9ee01819-87f5-4459-ad3e-1aa31c45905c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50f3c4c8cd802b0332b5db3ac538fcb7484dd83c --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:03:08 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-9ee01819-87f5-4459-ad3e-1aa31c45905c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/50f3c4c8cd802b0332b5db3ac538fcb7484dd83c --force-share --output=json" returned: 0 in 0.145s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:03:08 user nova-compute[71509]: DEBUG nova.virt.disk.api [None req-9ee01819-87f5-4459-ad3e-1aa31c45905c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9c4cc2a1-0c54-4f20-b33f-9085af7b10a3/disk. size=1073741824 {{(pid=71509) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 11:03:08 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-9ee01819-87f5-4459-ad3e-1aa31c45905c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c4cc2a1-0c54-4f20-b33f-9085af7b10a3/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:03:08 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-9ee01819-87f5-4459-ad3e-1aa31c45905c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c4cc2a1-0c54-4f20-b33f-9085af7b10a3/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:03:08 user nova-compute[71509]: DEBUG nova.virt.disk.api [None req-9ee01819-87f5-4459-ad3e-1aa31c45905c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Cannot resize image /opt/stack/data/nova/instances/9c4cc2a1-0c54-4f20-b33f-9085af7b10a3/disk to a smaller size. {{(pid=71509) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 11:03:08 user nova-compute[71509]: DEBUG nova.objects.instance [None req-9ee01819-87f5-4459-ad3e-1aa31c45905c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lazy-loading 'migration_context' on Instance uuid 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 11:03:08 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-9ee01819-87f5-4459-ad3e-1aa31c45905c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T11:00:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-145954405',display_name='tempest-TestMinimumBasicScenario-server-145954405',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-145954405',id=36,image_ref='4a4373e4-8d8a-4e8c-abe0-ace7652a4a7d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJI56DgU3GFkyba07rJQ5gPWmf+s+oszKE0l2AEuBdasOhPKZbxdMzg3ltBRBJuQQhxmZUmQrEIrG8aYiF6ueY2ARcTYBp9F9Zb4rPcdzBhgtNF8DrTPiOHvxBGxF5+ocQ==',key_name='tempest-TestMinimumBasicScenario-1104464810',keypairs=<?>,launch_index=0,launched_at=2023-04-14T11:00:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='5809862340a84c83a772c65c77513608',ramdisk_id='',reservation_id='r-4ptbez4v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4a4373e4-8d8a-4e8c-abe0-ace7652a4a7d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-2127394977',owner_user_name='tempest-TestMinimumBasicScenario-2127394977-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T11:03:05Z,user_data=None,user_id='831215baa8fd4fe7ba65193bbbdad1b4',uuid=9c4cc2a1-0c54-4f20-b33f-9085af7b10a3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f41f6957-bf6d-47bf-bb71-638137929e1e", "address": "fa:16:3e:ca:60:62", "network": {"id": "d59680e7-ed50-4356-b665-ec64ff939708", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-598238133-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5809862340a84c83a772c65c77513608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf41f6957-bf", "ovs_interfaceid": "f41f6957-bf6d-47bf-bb71-638137929e1e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 11:03:08 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-9ee01819-87f5-4459-ad3e-1aa31c45905c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Converting VIF {"id": "f41f6957-bf6d-47bf-bb71-638137929e1e", "address": "fa:16:3e:ca:60:62", "network": {"id": "d59680e7-ed50-4356-b665-ec64ff939708", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-598238133-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5809862340a84c83a772c65c77513608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf41f6957-bf", "ovs_interfaceid": "f41f6957-bf6d-47bf-bb71-638137929e1e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 11:03:08 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-9ee01819-87f5-4459-ad3e-1aa31c45905c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ca:60:62,bridge_name='br-int',has_traffic_filtering=True,id=f41f6957-bf6d-47bf-bb71-638137929e1e,network=Network(d59680e7-ed50-4356-b665-ec64ff939708),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf41f6957-bf') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 11:03:08 user nova-compute[71509]: DEBUG os_vif [None req-9ee01819-87f5-4459-ad3e-1aa31c45905c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ca:60:62,bridge_name='br-int',has_traffic_filtering=True,id=f41f6957-bf6d-47bf-bb71-638137929e1e,network=Network(d59680e7-ed50-4356-b665-ec64ff939708),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf41f6957-bf') {{(pid=71509) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 11:03:08 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:03:08 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:03:08 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 11:03:08 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:03:08 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf41f6957-bf, may_exist=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:03:08 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf41f6957-bf, col_values=(('external_ids', {'iface-id': 'f41f6957-bf6d-47bf-bb71-638137929e1e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ca:60:62', 'vm-uuid': '9c4cc2a1-0c54-4f20-b33f-9085af7b10a3'}),)) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:03:08 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:03:08 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:03:08 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:03:08 user nova-compute[71509]: INFO os_vif [None req-9ee01819-87f5-4459-ad3e-1aa31c45905c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ca:60:62,bridge_name='br-int',has_traffic_filtering=True,id=f41f6957-bf6d-47bf-bb71-638137929e1e,network=Network(d59680e7-ed50-4356-b665-ec64ff939708),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf41f6957-bf')
Apr 14 11:03:08 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:03:09 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:03:09 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:03:09 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:03:10 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:03:10 user nova-compute[71509]: DEBUG nova.compute.manager [req-bef025aa-3338-4664-85fb-f3b04f73663b req-5e5399f4-5317-42ba-a3c1-8c29ab5c525b service nova] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Received event network-vif-plugged-f41f6957-bf6d-47bf-bb71-638137929e1e {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:03:10 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-bef025aa-3338-4664-85fb-f3b04f73663b req-5e5399f4-5317-42ba-a3c1-8c29ab5c525b service nova] Acquiring lock "9c4cc2a1-0c54-4f20-b33f-9085af7b10a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:03:10 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-bef025aa-3338-4664-85fb-f3b04f73663b req-5e5399f4-5317-42ba-a3c1-8c29ab5c525b service nova] Lock "9c4cc2a1-0c54-4f20-b33f-9085af7b10a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:03:10 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-bef025aa-3338-4664-85fb-f3b04f73663b req-5e5399f4-5317-42ba-a3c1-8c29ab5c525b service nova] Lock "9c4cc2a1-0c54-4f20-b33f-9085af7b10a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:03:10 user nova-compute[71509]: DEBUG nova.compute.manager [req-bef025aa-3338-4664-85fb-f3b04f73663b req-5e5399f4-5317-42ba-a3c1-8c29ab5c525b service nova] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] No waiting events found dispatching network-vif-plugged-f41f6957-bf6d-47bf-bb71-638137929e1e {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:03:10 user nova-compute[71509]: WARNING nova.compute.manager [req-bef025aa-3338-4664-85fb-f3b04f73663b req-5e5399f4-5317-42ba-a3c1-8c29ab5c525b service nova] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Received unexpected event network-vif-plugged-f41f6957-bf6d-47bf-bb71-638137929e1e for instance with vm_state active and task_state reboot_started_hard.
Apr 14 11:03:10 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:03:10 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:03:10 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:03:10 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:03:11 user nova-compute[71509]: DEBUG nova.compute.manager [None req-9ee01819-87f5-4459-ad3e-1aa31c45905c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Instance event wait completed in 0 seconds for  {{(pid=71509) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 11:03:11 user nova-compute[71509]: DEBUG nova.virt.libvirt.host [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Removed pending event for 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3 due to event {{(pid=71509) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 11:03:11 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681470191.906814, 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3 => Resumed> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 11:03:11 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] VM Resumed (Lifecycle Event)
Apr 14 11:03:11 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Instance rebooted successfully.
Apr 14 11:03:11 user nova-compute[71509]: DEBUG nova.compute.manager [None req-9ee01819-87f5-4459-ad3e-1aa31c45905c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 11:03:11 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 11:03:11 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 11:03:11 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Apr 14 11:03:11 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681470191.9105344, 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3 => Started> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 11:03:11 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] VM Started (Lifecycle Event)
Apr 14 11:03:11 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 11:03:12 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 11:03:12 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-9ee01819-87f5-4459-ad3e-1aa31c45905c tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "9c4cc2a1-0c54-4f20-b33f-9085af7b10a3" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.002s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:03:12 user nova-compute[71509]: DEBUG nova.compute.manager [req-ef6bbefd-bead-4df8-baea-e1f22d18c4ea req-13a468c2-47c6-4230-a860-96fa6a14be04 service nova] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Received event network-vif-plugged-f41f6957-bf6d-47bf-bb71-638137929e1e {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:03:12 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-ef6bbefd-bead-4df8-baea-e1f22d18c4ea req-13a468c2-47c6-4230-a860-96fa6a14be04 service nova] Acquiring lock "9c4cc2a1-0c54-4f20-b33f-9085af7b10a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:03:12 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-ef6bbefd-bead-4df8-baea-e1f22d18c4ea req-13a468c2-47c6-4230-a860-96fa6a14be04 service nova] Lock "9c4cc2a1-0c54-4f20-b33f-9085af7b10a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:03:12 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-ef6bbefd-bead-4df8-baea-e1f22d18c4ea req-13a468c2-47c6-4230-a860-96fa6a14be04 service nova] Lock "9c4cc2a1-0c54-4f20-b33f-9085af7b10a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:03:12 user nova-compute[71509]: DEBUG nova.compute.manager [req-ef6bbefd-bead-4df8-baea-e1f22d18c4ea req-13a468c2-47c6-4230-a860-96fa6a14be04 service nova] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] No waiting events found dispatching network-vif-plugged-f41f6957-bf6d-47bf-bb71-638137929e1e {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:03:12 user nova-compute[71509]: WARNING nova.compute.manager [req-ef6bbefd-bead-4df8-baea-e1f22d18c4ea req-13a468c2-47c6-4230-a860-96fa6a14be04 service nova] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Received unexpected event network-vif-plugged-f41f6957-bf6d-47bf-bb71-638137929e1e for instance with vm_state active and task_state None.
Apr 14 11:03:13 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:03:13 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:03:13 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:03:18 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:03:20 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1608c72c-ab09-4053-9da1-588742c43b7e tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Acquiring lock "3d70b388-155f-4e47-8352-b69c856b2000" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:03:20 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1608c72c-ab09-4053-9da1-588742c43b7e tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Lock "3d70b388-155f-4e47-8352-b69c856b2000" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:03:20 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1608c72c-ab09-4053-9da1-588742c43b7e tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Acquiring lock "3d70b388-155f-4e47-8352-b69c856b2000-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:03:20 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1608c72c-ab09-4053-9da1-588742c43b7e tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Lock "3d70b388-155f-4e47-8352-b69c856b2000-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:03:20 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1608c72c-ab09-4053-9da1-588742c43b7e tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Lock "3d70b388-155f-4e47-8352-b69c856b2000-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:03:20 user nova-compute[71509]: INFO nova.compute.manager [None req-1608c72c-ab09-4053-9da1-588742c43b7e tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] [instance: 3d70b388-155f-4e47-8352-b69c856b2000] Terminating instance
Apr 14 11:03:20 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1608c72c-ab09-4053-9da1-588742c43b7e tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] [instance: 3d70b388-155f-4e47-8352-b69c856b2000] Start destroying the instance on the hypervisor. {{(pid=71509) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 11:03:20 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:03:21 user nova-compute[71509]: DEBUG nova.compute.manager [req-2ad758ff-7bb6-4283-9811-2dd215634946 req-23887c63-a4c0-4438-9b1c-ffc46df2c2d2 service nova] [instance: 3d70b388-155f-4e47-8352-b69c856b2000] Received event network-vif-unplugged-77c6475d-8834-422b-ab62-0bd935284c56 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:03:21 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-2ad758ff-7bb6-4283-9811-2dd215634946 req-23887c63-a4c0-4438-9b1c-ffc46df2c2d2 service nova] Acquiring lock "3d70b388-155f-4e47-8352-b69c856b2000-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:03:21 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-2ad758ff-7bb6-4283-9811-2dd215634946 req-23887c63-a4c0-4438-9b1c-ffc46df2c2d2 service nova] Lock "3d70b388-155f-4e47-8352-b69c856b2000-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:03:21 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-2ad758ff-7bb6-4283-9811-2dd215634946 req-23887c63-a4c0-4438-9b1c-ffc46df2c2d2 service nova] Lock "3d70b388-155f-4e47-8352-b69c856b2000-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:03:21 user nova-compute[71509]: DEBUG nova.compute.manager [req-2ad758ff-7bb6-4283-9811-2dd215634946 req-23887c63-a4c0-4438-9b1c-ffc46df2c2d2 service nova] [instance: 3d70b388-155f-4e47-8352-b69c856b2000] No waiting events found dispatching network-vif-unplugged-77c6475d-8834-422b-ab62-0bd935284c56 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:03:21 user nova-compute[71509]: DEBUG nova.compute.manager [req-2ad758ff-7bb6-4283-9811-2dd215634946 req-23887c63-a4c0-4438-9b1c-ffc46df2c2d2 service nova] [instance: 3d70b388-155f-4e47-8352-b69c856b2000] Received event network-vif-unplugged-77c6475d-8834-422b-ab62-0bd935284c56 for instance with task_state deleting. {{(pid=71509) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 11:03:21 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: 3d70b388-155f-4e47-8352-b69c856b2000] Instance destroyed successfully.
Apr 14 11:03:21 user nova-compute[71509]: DEBUG nova.objects.instance [None req-1608c72c-ab09-4053-9da1-588742c43b7e tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Lazy-loading 'resources' on Instance uuid 3d70b388-155f-4e47-8352-b69c856b2000 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 11:03:21 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-1608c72c-ab09-4053-9da1-588742c43b7e tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T11:01:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-90735481',display_name='tempest-VolumesActionsTest-instance-90735481',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-90735481',id=37,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T11:01:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1310da753ca94b38a7c660b8613af044',ramdisk_id='',reservation_id='r-65u7wur6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1201626915',owner_user_name='tempest-VolumesActionsTest-1201626915-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T11:01:37Z,user_data=None,user_id='282af802879e463ea87844b5fc926692',uuid=3d70b388-155f-4e47-8352-b69c856b2000,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "77c6475d-8834-422b-ab62-0bd935284c56", "address": "fa:16:3e:eb:3d:94", "network": {"id": "9614cf7a-420b-4226-9189-a89f3f4e6340", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1987410065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "1310da753ca94b38a7c660b8613af044", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77c6475d-88", "ovs_interfaceid": "77c6475d-8834-422b-ab62-0bd935284c56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 11:03:21 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-1608c72c-ab09-4053-9da1-588742c43b7e tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Converting VIF {"id": "77c6475d-8834-422b-ab62-0bd935284c56", "address": "fa:16:3e:eb:3d:94", "network": {"id": "9614cf7a-420b-4226-9189-a89f3f4e6340", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1987410065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "1310da753ca94b38a7c660b8613af044", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap77c6475d-88", "ovs_interfaceid": "77c6475d-8834-422b-ab62-0bd935284c56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 11:03:21 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-1608c72c-ab09-4053-9da1-588742c43b7e tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:3d:94,bridge_name='br-int',has_traffic_filtering=True,id=77c6475d-8834-422b-ab62-0bd935284c56,network=Network(9614cf7a-420b-4226-9189-a89f3f4e6340),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77c6475d-88') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 11:03:21 user nova-compute[71509]: DEBUG os_vif [None req-1608c72c-ab09-4053-9da1-588742c43b7e tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:3d:94,bridge_name='br-int',has_traffic_filtering=True,id=77c6475d-8834-422b-ab62-0bd935284c56,network=Network(9614cf7a-420b-4226-9189-a89f3f4e6340),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77c6475d-88') {{(pid=71509) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 11:03:21 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:03:21 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap77c6475d-88, bridge=br-int, if_exists=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:03:21 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:03:21 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:03:21 user nova-compute[71509]: INFO os_vif [None req-1608c72c-ab09-4053-9da1-588742c43b7e tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:3d:94,bridge_name='br-int',has_traffic_filtering=True,id=77c6475d-8834-422b-ab62-0bd935284c56,network=Network(9614cf7a-420b-4226-9189-a89f3f4e6340),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap77c6475d-88')
Apr 14 11:03:21 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-1608c72c-ab09-4053-9da1-588742c43b7e tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] [instance: 3d70b388-155f-4e47-8352-b69c856b2000] Deleting instance files /opt/stack/data/nova/instances/3d70b388-155f-4e47-8352-b69c856b2000_del
Apr 14 11:03:21 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-1608c72c-ab09-4053-9da1-588742c43b7e tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] [instance: 3d70b388-155f-4e47-8352-b69c856b2000] Deletion of /opt/stack/data/nova/instances/3d70b388-155f-4e47-8352-b69c856b2000_del complete
Apr 14 11:03:21 user nova-compute[71509]: INFO nova.compute.manager [None req-1608c72c-ab09-4053-9da1-588742c43b7e tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] [instance: 3d70b388-155f-4e47-8352-b69c856b2000] Took 0.66 seconds to destroy the instance on the hypervisor.
Apr 14 11:03:21 user nova-compute[71509]: DEBUG oslo.service.loopingcall [None req-1608c72c-ab09-4053-9da1-588742c43b7e tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71509) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 11:03:21 user nova-compute[71509]: DEBUG nova.compute.manager [-] [instance: 3d70b388-155f-4e47-8352-b69c856b2000] Deallocating network for instance {{(pid=71509) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 11:03:21 user nova-compute[71509]: DEBUG nova.network.neutron [-] [instance: 3d70b388-155f-4e47-8352-b69c856b2000] deallocate_for_instance() {{(pid=71509) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 11:03:22 user nova-compute[71509]: DEBUG nova.network.neutron [-] [instance: 3d70b388-155f-4e47-8352-b69c856b2000] Updating instance_info_cache with network_info: [] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:03:22 user nova-compute[71509]: INFO nova.compute.manager [-] [instance: 3d70b388-155f-4e47-8352-b69c856b2000] Took 0.58 seconds to deallocate network for instance.
Apr 14 11:03:22 user nova-compute[71509]: DEBUG nova.compute.manager [req-e81e3f2f-d3be-4f65-a81c-18d091f83b92 req-fa168ae5-b59e-4f7a-a662-2dca66aabb10 service nova] [instance: 3d70b388-155f-4e47-8352-b69c856b2000] Received event network-vif-deleted-77c6475d-8834-422b-ab62-0bd935284c56 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:03:22 user nova-compute[71509]: INFO nova.compute.manager [req-e81e3f2f-d3be-4f65-a81c-18d091f83b92 req-fa168ae5-b59e-4f7a-a662-2dca66aabb10 service nova] [instance: 3d70b388-155f-4e47-8352-b69c856b2000] Neutron deleted interface 77c6475d-8834-422b-ab62-0bd935284c56; detaching it from the instance and deleting it from the info cache
Apr 14 11:03:22 user nova-compute[71509]: DEBUG nova.network.neutron [req-e81e3f2f-d3be-4f65-a81c-18d091f83b92 req-fa168ae5-b59e-4f7a-a662-2dca66aabb10 service nova] [instance: 3d70b388-155f-4e47-8352-b69c856b2000] Updating instance_info_cache with network_info: [] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:03:22 user nova-compute[71509]: DEBUG nova.compute.manager [req-e81e3f2f-d3be-4f65-a81c-18d091f83b92 req-fa168ae5-b59e-4f7a-a662-2dca66aabb10 service nova] [instance: 3d70b388-155f-4e47-8352-b69c856b2000] Detach interface failed, port_id=77c6475d-8834-422b-ab62-0bd935284c56, reason: Instance 3d70b388-155f-4e47-8352-b69c856b2000 could not be found. {{(pid=71509) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 11:03:22 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1608c72c-ab09-4053-9da1-588742c43b7e tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:03:22 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1608c72c-ab09-4053-9da1-588742c43b7e tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:03:22 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-1608c72c-ab09-4053-9da1-588742c43b7e tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 11:03:22 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-1608c72c-ab09-4053-9da1-588742c43b7e tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 11:03:22 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1608c72c-ab09-4053-9da1-588742c43b7e tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.377s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:03:22 user nova-compute[71509]: INFO nova.scheduler.client.report [None req-1608c72c-ab09-4053-9da1-588742c43b7e tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Deleted allocations for instance 3d70b388-155f-4e47-8352-b69c856b2000
Apr 14 11:03:22 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1608c72c-ab09-4053-9da1-588742c43b7e tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Lock "3d70b388-155f-4e47-8352-b69c856b2000" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.811s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:03:23 user nova-compute[71509]: DEBUG nova.compute.manager [req-f20663de-ca3c-4d5f-b45c-835ca0e9addd req-4151db4b-23be-47b1-9826-bf98c98e3c5a service nova] [instance: 3d70b388-155f-4e47-8352-b69c856b2000] Received event network-vif-plugged-77c6475d-8834-422b-ab62-0bd935284c56 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:03:23 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-f20663de-ca3c-4d5f-b45c-835ca0e9addd req-4151db4b-23be-47b1-9826-bf98c98e3c5a service nova] Acquiring lock "3d70b388-155f-4e47-8352-b69c856b2000-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:03:23 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-f20663de-ca3c-4d5f-b45c-835ca0e9addd req-4151db4b-23be-47b1-9826-bf98c98e3c5a service nova] Lock "3d70b388-155f-4e47-8352-b69c856b2000-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:03:23 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-f20663de-ca3c-4d5f-b45c-835ca0e9addd req-4151db4b-23be-47b1-9826-bf98c98e3c5a service nova] Lock "3d70b388-155f-4e47-8352-b69c856b2000-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:03:23 user nova-compute[71509]: DEBUG nova.compute.manager [req-f20663de-ca3c-4d5f-b45c-835ca0e9addd req-4151db4b-23be-47b1-9826-bf98c98e3c5a service nova] [instance: 3d70b388-155f-4e47-8352-b69c856b2000] No waiting events found dispatching network-vif-plugged-77c6475d-8834-422b-ab62-0bd935284c56 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:03:23 user nova-compute[71509]: WARNING nova.compute.manager [req-f20663de-ca3c-4d5f-b45c-835ca0e9addd req-4151db4b-23be-47b1-9826-bf98c98e3c5a service nova] [instance: 3d70b388-155f-4e47-8352-b69c856b2000] Received unexpected event network-vif-plugged-77c6475d-8834-422b-ab62-0bd935284c56 for instance with vm_state deleted and task_state None.
Apr 14 11:03:23 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:03:26 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:03:28 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:03:31 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:03:32 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-5bda935c-c989-453e-b2a9-2617f3630788 tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] Acquiring lock "a1fdcfb4-8700-48fe-9dec-1e8a4b766cba" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:03:32 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-5bda935c-c989-453e-b2a9-2617f3630788 tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] Lock "a1fdcfb4-8700-48fe-9dec-1e8a4b766cba" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:03:32 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-5bda935c-c989-453e-b2a9-2617f3630788 tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] Acquiring lock "a1fdcfb4-8700-48fe-9dec-1e8a4b766cba-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:03:32 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-5bda935c-c989-453e-b2a9-2617f3630788 tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] Lock "a1fdcfb4-8700-48fe-9dec-1e8a4b766cba-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:03:32 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-5bda935c-c989-453e-b2a9-2617f3630788 tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] Lock "a1fdcfb4-8700-48fe-9dec-1e8a4b766cba-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:03:32 user nova-compute[71509]: INFO nova.compute.manager [None req-5bda935c-c989-453e-b2a9-2617f3630788 tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] [instance: a1fdcfb4-8700-48fe-9dec-1e8a4b766cba] Terminating instance
Apr 14 11:03:32 user nova-compute[71509]: DEBUG nova.compute.manager [None req-5bda935c-c989-453e-b2a9-2617f3630788 tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] [instance: a1fdcfb4-8700-48fe-9dec-1e8a4b766cba] Start destroying the instance on the hypervisor. {{(pid=71509) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 11:03:32 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:03:32 user nova-compute[71509]: DEBUG nova.compute.manager [req-efe9e20c-5247-4cb0-8b3d-e11c13f955b9 req-9dd57b3f-6afa-4460-b07b-ed0e6fa44e27 service nova] [instance: b96e2a1a-8c1b-4189-86b9-a3c1761a9813] Received event network-changed-7ee72a8e-db85-4e30-91e5-193e21c386cd {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:03:32 user nova-compute[71509]: DEBUG nova.compute.manager [req-efe9e20c-5247-4cb0-8b3d-e11c13f955b9 req-9dd57b3f-6afa-4460-b07b-ed0e6fa44e27 service nova] [instance: b96e2a1a-8c1b-4189-86b9-a3c1761a9813] Refreshing instance network info cache due to event network-changed-7ee72a8e-db85-4e30-91e5-193e21c386cd. {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 11:03:32 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-efe9e20c-5247-4cb0-8b3d-e11c13f955b9 req-9dd57b3f-6afa-4460-b07b-ed0e6fa44e27 service nova] Acquiring lock "refresh_cache-b96e2a1a-8c1b-4189-86b9-a3c1761a9813" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 11:03:32 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-efe9e20c-5247-4cb0-8b3d-e11c13f955b9 req-9dd57b3f-6afa-4460-b07b-ed0e6fa44e27 service nova] Acquired lock "refresh_cache-b96e2a1a-8c1b-4189-86b9-a3c1761a9813" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 11:03:32 user nova-compute[71509]: DEBUG nova.network.neutron [req-efe9e20c-5247-4cb0-8b3d-e11c13f955b9 req-9dd57b3f-6afa-4460-b07b-ed0e6fa44e27 service nova] [instance: b96e2a1a-8c1b-4189-86b9-a3c1761a9813] Refreshing network info cache for port 7ee72a8e-db85-4e30-91e5-193e21c386cd {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 11:03:33 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:03:33 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:03:33 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: a1fdcfb4-8700-48fe-9dec-1e8a4b766cba] Instance destroyed successfully.
Apr 14 11:03:33 user nova-compute[71509]: DEBUG nova.objects.instance [None req-5bda935c-c989-453e-b2a9-2617f3630788 tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] Lazy-loading 'resources' on Instance uuid a1fdcfb4-8700-48fe-9dec-1e8a4b766cba {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 11:03:33 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-5bda935c-c989-453e-b2a9-2617f3630788 tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T11:01:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-392369322',display_name='tempest-VolumesActionsTest-instance-392369322',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-392369322',id=38,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T11:01:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='000980e0e886468b8df32c7373cde033',ramdisk_id='',reservation_id='r-z55m6oai',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1402991140',owner_user_name='tempest-VolumesActionsTest-1402991140-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T11:01:43Z,user_data=None,user_id='c9ae4725537b4162b88b3eed27666bc0',uuid=a1fdcfb4-8700-48fe-9dec-1e8a4b766cba,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2b800e13-6dff-47b1-aced-1f9b2600868f", "address": "fa:16:3e:9d:36:94", "network": {"id": "32b79070-3f05-4fa8-90ea-ba2ba6953db2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1189530156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "000980e0e886468b8df32c7373cde033", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b800e13-6d", "ovs_interfaceid": "2b800e13-6dff-47b1-aced-1f9b2600868f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 11:03:33 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-5bda935c-c989-453e-b2a9-2617f3630788 tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] Converting VIF {"id": "2b800e13-6dff-47b1-aced-1f9b2600868f", "address": "fa:16:3e:9d:36:94", "network": {"id": "32b79070-3f05-4fa8-90ea-ba2ba6953db2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1189530156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "000980e0e886468b8df32c7373cde033", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b800e13-6d", "ovs_interfaceid": "2b800e13-6dff-47b1-aced-1f9b2600868f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 11:03:33 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-5bda935c-c989-453e-b2a9-2617f3630788 tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:36:94,bridge_name='br-int',has_traffic_filtering=True,id=2b800e13-6dff-47b1-aced-1f9b2600868f,network=Network(32b79070-3f05-4fa8-90ea-ba2ba6953db2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b800e13-6d') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 11:03:33 user nova-compute[71509]: DEBUG os_vif [None req-5bda935c-c989-453e-b2a9-2617f3630788 tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:36:94,bridge_name='br-int',has_traffic_filtering=True,id=2b800e13-6dff-47b1-aced-1f9b2600868f,network=Network(32b79070-3f05-4fa8-90ea-ba2ba6953db2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b800e13-6d') {{(pid=71509) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 11:03:33 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:03:33 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2b800e13-6d, bridge=br-int, if_exists=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:03:33 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:03:33 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:03:33 user nova-compute[71509]: INFO os_vif [None req-5bda935c-c989-453e-b2a9-2617f3630788 tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:36:94,bridge_name='br-int',has_traffic_filtering=True,id=2b800e13-6dff-47b1-aced-1f9b2600868f,network=Network(32b79070-3f05-4fa8-90ea-ba2ba6953db2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b800e13-6d')
Apr 14 11:03:33 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-5bda935c-c989-453e-b2a9-2617f3630788 tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] [instance: a1fdcfb4-8700-48fe-9dec-1e8a4b766cba] Deleting instance files /opt/stack/data/nova/instances/a1fdcfb4-8700-48fe-9dec-1e8a4b766cba_del
Apr 14 11:03:33 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-5bda935c-c989-453e-b2a9-2617f3630788 tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] [instance: a1fdcfb4-8700-48fe-9dec-1e8a4b766cba] Deletion of /opt/stack/data/nova/instances/a1fdcfb4-8700-48fe-9dec-1e8a4b766cba_del complete
Apr 14 11:03:33 user nova-compute[71509]: INFO nova.compute.manager [None req-5bda935c-c989-453e-b2a9-2617f3630788 tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] [instance: a1fdcfb4-8700-48fe-9dec-1e8a4b766cba] Took 0.70 seconds to destroy the instance on the hypervisor.
Apr 14 11:03:33 user nova-compute[71509]: DEBUG oslo.service.loopingcall [None req-5bda935c-c989-453e-b2a9-2617f3630788 tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71509) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 11:03:33 user nova-compute[71509]: DEBUG nova.compute.manager [-] [instance: a1fdcfb4-8700-48fe-9dec-1e8a4b766cba] Deallocating network for instance {{(pid=71509) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 11:03:33 user nova-compute[71509]: DEBUG nova.network.neutron [-] [instance: a1fdcfb4-8700-48fe-9dec-1e8a4b766cba] deallocate_for_instance() {{(pid=71509) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 11:03:33 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:03:33 user nova-compute[71509]: DEBUG nova.network.neutron [req-efe9e20c-5247-4cb0-8b3d-e11c13f955b9 req-9dd57b3f-6afa-4460-b07b-ed0e6fa44e27 service nova] [instance: b96e2a1a-8c1b-4189-86b9-a3c1761a9813] Updated VIF entry in instance network info cache for port 7ee72a8e-db85-4e30-91e5-193e21c386cd. {{(pid=71509) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 11:03:33 user nova-compute[71509]: DEBUG nova.network.neutron [req-efe9e20c-5247-4cb0-8b3d-e11c13f955b9 req-9dd57b3f-6afa-4460-b07b-ed0e6fa44e27 service nova] [instance: b96e2a1a-8c1b-4189-86b9-a3c1761a9813] Updating instance_info_cache with network_info: [{"id": "7ee72a8e-db85-4e30-91e5-193e21c386cd", "address": "fa:16:3e:b4:85:a8", "network": {"id": "b639a68a-2b4e-435c-b98b-65b5b4981c73", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1070821894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb8f294f957f4c74ae959c1e9f238427", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ee72a8e-db", "ovs_interfaceid": "7ee72a8e-db85-4e30-91e5-193e21c386cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:03:33 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-efe9e20c-5247-4cb0-8b3d-e11c13f955b9 req-9dd57b3f-6afa-4460-b07b-ed0e6fa44e27 service nova] Releasing lock "refresh_cache-b96e2a1a-8c1b-4189-86b9-a3c1761a9813" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 11:03:33 user nova-compute[71509]: DEBUG nova.network.neutron [-] [instance: a1fdcfb4-8700-48fe-9dec-1e8a4b766cba] Updating instance_info_cache with network_info: [] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:03:33 user nova-compute[71509]: INFO nova.compute.manager [-] [instance: a1fdcfb4-8700-48fe-9dec-1e8a4b766cba] Took 0.50 seconds to deallocate network for instance.
Apr 14 11:03:33 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-5bda935c-c989-453e-b2a9-2617f3630788 tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:03:33 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-5bda935c-c989-453e-b2a9-2617f3630788 tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:03:34 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-5bda935c-c989-453e-b2a9-2617f3630788 tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 11:03:34 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-5bda935c-c989-453e-b2a9-2617f3630788 tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 11:03:34 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-5bda935c-c989-453e-b2a9-2617f3630788 tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.384s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:03:34 user nova-compute[71509]: INFO nova.scheduler.client.report [None req-5bda935c-c989-453e-b2a9-2617f3630788 tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] Deleted allocations for instance a1fdcfb4-8700-48fe-9dec-1e8a4b766cba
Apr 14 11:03:34 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-5bda935c-c989-453e-b2a9-2617f3630788 tempest-VolumesActionsTest-1402991140 tempest-VolumesActionsTest-1402991140-project-member] Lock "a1fdcfb4-8700-48fe-9dec-1e8a4b766cba" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.862s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:03:34 user nova-compute[71509]: DEBUG nova.compute.manager [req-2b2a2099-100b-408c-890e-fc5a67a0ba39 req-2d0686da-b8e1-43ce-96da-2e132c8af7b7 service nova] [instance: a1fdcfb4-8700-48fe-9dec-1e8a4b766cba] Received event network-vif-unplugged-2b800e13-6dff-47b1-aced-1f9b2600868f {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:03:34 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-2b2a2099-100b-408c-890e-fc5a67a0ba39 req-2d0686da-b8e1-43ce-96da-2e132c8af7b7 service nova] Acquiring lock "a1fdcfb4-8700-48fe-9dec-1e8a4b766cba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:03:34 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-2b2a2099-100b-408c-890e-fc5a67a0ba39 req-2d0686da-b8e1-43ce-96da-2e132c8af7b7 service nova] Lock "a1fdcfb4-8700-48fe-9dec-1e8a4b766cba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:03:34 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-2b2a2099-100b-408c-890e-fc5a67a0ba39 req-2d0686da-b8e1-43ce-96da-2e132c8af7b7 service nova] Lock "a1fdcfb4-8700-48fe-9dec-1e8a4b766cba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:03:34 user nova-compute[71509]: DEBUG nova.compute.manager [req-2b2a2099-100b-408c-890e-fc5a67a0ba39 req-2d0686da-b8e1-43ce-96da-2e132c8af7b7 service nova] [instance: a1fdcfb4-8700-48fe-9dec-1e8a4b766cba] No waiting events found dispatching network-vif-unplugged-2b800e13-6dff-47b1-aced-1f9b2600868f {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:03:34 user nova-compute[71509]: WARNING nova.compute.manager [req-2b2a2099-100b-408c-890e-fc5a67a0ba39 req-2d0686da-b8e1-43ce-96da-2e132c8af7b7 service nova] [instance: a1fdcfb4-8700-48fe-9dec-1e8a4b766cba] Received unexpected event network-vif-unplugged-2b800e13-6dff-47b1-aced-1f9b2600868f for instance with vm_state deleted and task_state None.
Apr 14 11:03:34 user nova-compute[71509]: DEBUG nova.compute.manager [req-2b2a2099-100b-408c-890e-fc5a67a0ba39 req-2d0686da-b8e1-43ce-96da-2e132c8af7b7 service nova] [instance: a1fdcfb4-8700-48fe-9dec-1e8a4b766cba] Received event network-vif-plugged-2b800e13-6dff-47b1-aced-1f9b2600868f {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:03:34 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-2b2a2099-100b-408c-890e-fc5a67a0ba39 req-2d0686da-b8e1-43ce-96da-2e132c8af7b7 service nova] Acquiring lock "a1fdcfb4-8700-48fe-9dec-1e8a4b766cba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:03:34 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-2b2a2099-100b-408c-890e-fc5a67a0ba39 req-2d0686da-b8e1-43ce-96da-2e132c8af7b7 service nova] Lock "a1fdcfb4-8700-48fe-9dec-1e8a4b766cba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:03:34 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-2b2a2099-100b-408c-890e-fc5a67a0ba39 req-2d0686da-b8e1-43ce-96da-2e132c8af7b7 service nova] Lock "a1fdcfb4-8700-48fe-9dec-1e8a4b766cba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:03:34 user nova-compute[71509]: DEBUG nova.compute.manager [req-2b2a2099-100b-408c-890e-fc5a67a0ba39 req-2d0686da-b8e1-43ce-96da-2e132c8af7b7 service nova] [instance: a1fdcfb4-8700-48fe-9dec-1e8a4b766cba] No waiting events found dispatching network-vif-plugged-2b800e13-6dff-47b1-aced-1f9b2600868f {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:03:34 user nova-compute[71509]: WARNING nova.compute.manager [req-2b2a2099-100b-408c-890e-fc5a67a0ba39 req-2d0686da-b8e1-43ce-96da-2e132c8af7b7 service nova] [instance: a1fdcfb4-8700-48fe-9dec-1e8a4b766cba] Received unexpected event network-vif-plugged-2b800e13-6dff-47b1-aced-1f9b2600868f for instance with vm_state deleted and task_state None.
Apr 14 11:03:34 user nova-compute[71509]: DEBUG nova.compute.manager [req-2b2a2099-100b-408c-890e-fc5a67a0ba39 req-2d0686da-b8e1-43ce-96da-2e132c8af7b7 service nova] [instance: a1fdcfb4-8700-48fe-9dec-1e8a4b766cba] Received event network-vif-deleted-2b800e13-6dff-47b1-aced-1f9b2600868f {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:03:35 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-040d156c-f2b0-457c-acb5-99afbdbd2736 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "b96e2a1a-8c1b-4189-86b9-a3c1761a9813" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:03:35 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-040d156c-f2b0-457c-acb5-99afbdbd2736 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "b96e2a1a-8c1b-4189-86b9-a3c1761a9813" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:03:35 user nova-compute[71509]: DEBUG nova.objects.instance [None req-040d156c-f2b0-457c-acb5-99afbdbd2736 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lazy-loading 'flavor' on Instance uuid b96e2a1a-8c1b-4189-86b9-a3c1761a9813 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 11:03:35 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-040d156c-f2b0-457c-acb5-99afbdbd2736 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "b96e2a1a-8c1b-4189-86b9-a3c1761a9813" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:03:36 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-040d156c-f2b0-457c-acb5-99afbdbd2736 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "b96e2a1a-8c1b-4189-86b9-a3c1761a9813" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:03:36 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-040d156c-f2b0-457c-acb5-99afbdbd2736 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "b96e2a1a-8c1b-4189-86b9-a3c1761a9813" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:03:36 user nova-compute[71509]: INFO nova.compute.manager [None req-040d156c-f2b0-457c-acb5-99afbdbd2736 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: b96e2a1a-8c1b-4189-86b9-a3c1761a9813] Attaching volume 7c15d29b-d395-4a8f-ae98-ef8d51aa6133 to /dev/vdb
Apr 14 11:03:36 user nova-compute[71509]: DEBUG os_brick.utils [None req-040d156c-f2b0-457c-acb5-99afbdbd2736 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 11:03:36 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:03:36 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:03:36 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[475caf39-cf96-41a1-919d-41b5dd1af9af]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50119df3c417\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:03:36 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:03:36 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:03:36 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[f87bbf3e-546c-4cf8-8abb-e2bebe398e84]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:03:36 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:03:36 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:03:36 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[91e241e7-8502-4113-b038-d94ef5be281e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:03:36 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf7e3855-3875-4f5a-bae1-b29efa50c39c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:03:36 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-040d156c-f2b0-457c-acb5-99afbdbd2736 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Running cmd (subprocess): nvme version {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:03:36 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-040d156c-f2b0-457c-acb5-99afbdbd2736 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] 'nvme version' failed. Not Retrying. {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 11:03:36 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.nvmeof [None req-040d156c-f2b0-457c-acb5-99afbdbd2736 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] nvme not present on system {{(pid=71509) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 11:03:36 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:03:36 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 11:03:36 user nova-compute[71509]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 11:03:36 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e08ab43-992e-4036-8597-858f4073e9e0]: (4, '') {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:03:36 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-040d156c-f2b0-457c-acb5-99afbdbd2736 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71509) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 11:03:36 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-040d156c-f2b0-457c-acb5-99afbdbd2736 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71509) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 11:03:36 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-040d156c-f2b0-457c-acb5-99afbdbd2736 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] LIGHTOS: no hostnqn found. {{(pid=71509) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 11:03:36 user nova-compute[71509]: DEBUG os_brick.utils [None req-040d156c-f2b0-457c-acb5-99afbdbd2736 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50119df3c417', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 11:03:36 user nova-compute[71509]: DEBUG nova.virt.block_device [None req-040d156c-f2b0-457c-acb5-99afbdbd2736 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: b96e2a1a-8c1b-4189-86b9-a3c1761a9813] Updating existing volume attachment record: fb18cc10-a082-4c7b-b742-f71b86b86a57 {{(pid=71509) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 11:03:36 user nova-compute[71509]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681470201.3396993, 3d70b388-155f-4e47-8352-b69c856b2000 => Stopped> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 11:03:36 user nova-compute[71509]: INFO nova.compute.manager [-] [instance: 3d70b388-155f-4e47-8352-b69c856b2000] VM Stopped (Lifecycle Event)
Apr 14 11:03:36 user nova-compute[71509]: DEBUG nova.compute.manager [None req-61a2ed5a-1402-4216-8bb3-6e9e1831dc10 None None] [instance: 3d70b388-155f-4e47-8352-b69c856b2000] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 11:03:38 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:03:38 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:03:40 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-040d156c-f2b0-457c-acb5-99afbdbd2736 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: b96e2a1a-8c1b-4189-86b9-a3c1761a9813] Calling os-brick to attach iSCSI Volume {{(pid=71509) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 11:03:40 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-040d156c-f2b0-457c-acb5-99afbdbd2736 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0bf0749390>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7c15d29b-d395-4a8f-ae98-ef8d51aa6133', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'trnoCiSe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 11:03:40 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-040d156c-f2b0-457c-acb5-99afbdbd2736 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 11:03:40 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-040d156c-f2b0-457c-acb5-99afbdbd2736 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 11:03:40 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-040d156c-f2b0-457c-acb5-99afbdbd2736 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.004s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 11:03:40 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-040d156c-f2b0-457c-acb5-99afbdbd2736 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 11:03:40 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-040d156c-f2b0-457c-acb5-99afbdbd2736 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c15d29b-d395-4a8f-ae98-ef8d51aa6133" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 11:03:40 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-040d156c-f2b0-457c-acb5-99afbdbd2736 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c15d29b-d395-4a8f-ae98-ef8d51aa6133" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 11:03:40 user nova-compute[71509]: INFO os_brick.initiator.connectors.iscsi [None req-040d156c-f2b0-457c-acb5-99afbdbd2736 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 11:03:40 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c15d29b-d395-4a8f-ae98-ef8d51aa6133 -p 172.16.0.220:3260 {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:03:40 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c15d29b-d395-4a8f-ae98-ef8d51aa6133 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:03:40 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[1100b5e7-d9bf-4c7c-a074-24203dfb7aba]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:03:40 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-040d156c-f2b0-457c-acb5-99afbdbd2736 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 11:03:40 user nova-compute[71509]:  {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:03:40 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c15d29b-d395-4a8f-ae98-ef8d51aa6133 -p 172.16.0.220:3260 --interface default --op new {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:03:40 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c15d29b-d395-4a8f-ae98-ef8d51aa6133 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:03:40 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[182b172a-d7a2-4704-ab7a-cac681c3e1da]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7c15d29b-d395-4a8f-ae98-ef8d51aa6133] added\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:03:40 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-040d156c-f2b0-457c-acb5-99afbdbd2736 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7c15d29b-d395-4a8f-ae98-ef8d51aa6133] added
Apr 14 11:03:40 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:03:40 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c15d29b-d395-4a8f-ae98-ef8d51aa6133 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:03:40 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c15d29b-d395-4a8f-ae98-ef8d51aa6133 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:03:40 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[df3248dd-409d-45f7-a8ae-4b281a30a987]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:03:40 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-040d156c-f2b0-457c-acb5-99afbdbd2736 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:03:40 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c15d29b-d395-4a8f-ae98-ef8d51aa6133 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:03:40 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c15d29b-d395-4a8f-ae98-ef8d51aa6133 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:03:40 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[32d8c0af-4d5e-47ed-8d6e-cbb274374988]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:03:40 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-040d156c-f2b0-457c-acb5-99afbdbd2736 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:03:40 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c15d29b-d395-4a8f-ae98-ef8d51aa6133 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v trnoCiSe {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:03:40 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c15d29b-d395-4a8f-ae98-ef8d51aa6133 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v trnoCiSe" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:03:40 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e72da57-4a4d-44a0-84e5-b9ddd8f247bd]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:03:40 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-040d156c-f2b0-457c-acb5-99afbdbd2736 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'trnoCiSe'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:03:40 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c15d29b-d395-4a8f-ae98-ef8d51aa6133 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:03:40 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c15d29b-d395-4a8f-ae98-ef8d51aa6133 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:03:40 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[51ea1ac5-e70c-4677-b193-db81e7a586c4]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:03:40 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-040d156c-f2b0-457c-acb5-99afbdbd2736 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:03:40 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:03:40 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:03:40 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bc56208-c2cd-4add-a068-5b5ef4e5d9ff]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0da1ed17-2b8c-4dd3-a61a-1133a9420d21 (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:03:40 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-040d156c-f2b0-457c-acb5-99afbdbd2736 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)
Apr 14 11:03:40 user nova-compute[71509]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219 (non-flash)
Apr 14 11:03:40 user nova-compute[71509]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3 (non-flash)
Apr 14 11:03:40 user nova-compute[71509]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0da1ed17-2b8c-4dd3-a61a-1133a9420d21 (non-flash)
Apr 14 11:03:40 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 11:03:40 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-040d156c-f2b0-457c-acb5-99afbdbd2736 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)
Apr 14 11:03:40 user nova-compute[71509]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219 (non-flash)
Apr 14 11:03:40 user nova-compute[71509]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3 (non-flash)
Apr 14 11:03:40 user nova-compute[71509]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0da1ed17-2b8c-4dd3-a61a-1133a9420d21 (non-flash)
Apr 14 11:03:40 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 11:03:40 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c15d29b-d395-4a8f-ae98-ef8d51aa6133 -p 172.16.0.220:3260 --login {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:03:40 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c15d29b-d395-4a8f-ae98-ef8d51aa6133 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:03:40 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[cebf7467-29e3-4ef2-80b8-7bac42b0cda7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7c15d29b-d395-4a8f-ae98-ef8d51aa6133, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7c15d29b-d395-4a8f-ae98-ef8d51aa6133, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:03:40 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-040d156c-f2b0-457c-acb5-99afbdbd2736 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7c15d29b-d395-4a8f-ae98-ef8d51aa6133, portal: 172.16.0.220,3260]
Apr 14 11:03:40 user nova-compute[71509]: Login to [iface: default, target: iqn.2010-10.org.openstack:7c15d29b-d395-4a8f-ae98-ef8d51aa6133, portal: 172.16.0.220,3260] successful.
Apr 14 11:03:40 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:03:40 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c15d29b-d395-4a8f-ae98-ef8d51aa6133 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:03:40 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c15d29b-d395-4a8f-ae98-ef8d51aa6133 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:03:40 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c881f49-b356-41e3-b186-ca6fb108252b]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:03:40 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-040d156c-f2b0-457c-acb5-99afbdbd2736 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:03:40 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:03:40 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:03:40 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[550851bd-3445-47c3-864e-36e92229bfcd]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0da1ed17-2b8c-4dd3-a61a-1133a9420d21 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c15d29b-d395-4a8f-ae98-ef8d51aa6133 (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:03:40 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-040d156c-f2b0-457c-acb5-99afbdbd2736 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)
Apr 14 11:03:40 user nova-compute[71509]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219 (non-flash)
Apr 14 11:03:40 user nova-compute[71509]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3 (non-flash)
Apr 14 11:03:40 user nova-compute[71509]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0da1ed17-2b8c-4dd3-a61a-1133a9420d21 (non-flash)
Apr 14 11:03:40 user nova-compute[71509]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c15d29b-d395-4a8f-ae98-ef8d51aa6133 (non-flash)
Apr 14 11:03:40 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 11:03:40 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-040d156c-f2b0-457c-acb5-99afbdbd2736 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)
Apr 14 11:03:40 user nova-compute[71509]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219 (non-flash)
Apr 14 11:03:40 user nova-compute[71509]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3 (non-flash)
Apr 14 11:03:40 user nova-compute[71509]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0da1ed17-2b8c-4dd3-a61a-1133a9420d21 (non-flash)
Apr 14 11:03:40 user nova-compute[71509]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c15d29b-d395-4a8f-ae98-ef8d51aa6133 (non-flash)
Apr 14 11:03:40 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 11:03:40 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-040d156c-f2b0-457c-acb5-99afbdbd2736 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c15d29b-d395-4a8f-ae98-ef8d51aa6133" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 11:03:40 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-040d156c-f2b0-457c-acb5-99afbdbd2736 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Connected to 172.16.0.220:3260 {{(pid=71509) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 11:03:40 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-040d156c-f2b0-457c-acb5-99afbdbd2736 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] HCTL ('37', '-', '-', 0) found on session 46 with lun 0 {{(pid=71509) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 11:03:40 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-040d156c-f2b0-457c-acb5-99afbdbd2736 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=71509) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 11:03:40 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:03:41 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:03:41 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cd9d49b-dfab-4bed-8c46-41b8ee80b7a8]: (4, ('- - 0', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:03:41 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-040d156c-f2b0-457c-acb5-99afbdbd2736 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Searching for a device in session 46 and hctl ['37', '*', '*', 0] yield: None {{(pid=71509) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 11:03:42 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-040d156c-f2b0-457c-acb5-99afbdbd2736 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Searching for a device in session 46 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=71509) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 11:03:42 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-040d156c-f2b0-457c-acb5-99afbdbd2736 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:7c15d29b-d395-4a8f-ae98-ef8d51aa6133', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'trnoCiSe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71509) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 11:03:42 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-040d156c-f2b0-457c-acb5-99afbdbd2736 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.325s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 11:03:42 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-040d156c-f2b0-457c-acb5-99afbdbd2736 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] <== connect_volume: return (1330ms) {'type': 'block', 'scsi_wwn': '26566303166363431', 'path': '/dev/sdf'} {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 11:03:42 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-040d156c-f2b0-457c-acb5-99afbdbd2736 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: b96e2a1a-8c1b-4189-86b9-a3c1761a9813] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26566303166363431', 'path': '/dev/sdf'} {{(pid=71509) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 11:03:42 user nova-compute[71509]: DEBUG nova.objects.instance [None req-040d156c-f2b0-457c-acb5-99afbdbd2736 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lazy-loading 'flavor' on Instance uuid b96e2a1a-8c1b-4189-86b9-a3c1761a9813 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 11:03:42 user nova-compute[71509]: DEBUG nova.virt.libvirt.guest [None req-040d156c-f2b0-457c-acb5-99afbdbd2736 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 11:03:42 user nova-compute[71509]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 11:03:42 user nova-compute[71509]:   <source dev="/dev/sdf"/>
Apr 14 11:03:42 user nova-compute[71509]:   <target dev="vdb" bus="virtio"/>
Apr 14 11:03:42 user nova-compute[71509]:   <serial>7c15d29b-d395-4a8f-ae98-ef8d51aa6133</serial>
Apr 14 11:03:42 user nova-compute[71509]: </disk>
Apr 14 11:03:42 user nova-compute[71509]:  {{(pid=71509) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 11:03:42 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:03:42 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Cleaning up deleted instances {{(pid=71509) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 14 11:03:42 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] There are 0 instances to clean {{(pid=71509) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 14 11:03:42 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-040d156c-f2b0-457c-acb5-99afbdbd2736 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] No BDM found with device name vda, not building metadata. {{(pid=71509) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 11:03:42 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-040d156c-f2b0-457c-acb5-99afbdbd2736 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71509) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 11:03:42 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-040d156c-f2b0-457c-acb5-99afbdbd2736 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] No VIF found with MAC fa:16:3e:b4:85:a8, not building metadata {{(pid=71509) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 11:03:42 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-040d156c-f2b0-457c-acb5-99afbdbd2736 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "b96e2a1a-8c1b-4189-86b9-a3c1761a9813" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.584s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:03:43 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:03:43 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:03:43 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:03:43 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71509) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 11:03:43 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-65b49b3f-cb92-4791-a767-ea964c8ad446 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "b96e2a1a-8c1b-4189-86b9-a3c1761a9813" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:03:43 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-65b49b3f-cb92-4791-a767-ea964c8ad446 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "b96e2a1a-8c1b-4189-86b9-a3c1761a9813" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:03:43 user nova-compute[71509]: INFO nova.compute.manager [None req-65b49b3f-cb92-4791-a767-ea964c8ad446 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: b96e2a1a-8c1b-4189-86b9-a3c1761a9813] Detaching volume 7c15d29b-d395-4a8f-ae98-ef8d51aa6133
Apr 14 11:03:44 user nova-compute[71509]: INFO nova.virt.block_device [None req-65b49b3f-cb92-4791-a767-ea964c8ad446 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: b96e2a1a-8c1b-4189-86b9-a3c1761a9813] Attempting to driver detach volume 7c15d29b-d395-4a8f-ae98-ef8d51aa6133 from mountpoint /dev/vdb
Apr 14 11:03:44 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-65b49b3f-cb92-4791-a767-ea964c8ad446 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Attempting to detach device vdb from instance b96e2a1a-8c1b-4189-86b9-a3c1761a9813 from the persistent domain config. {{(pid=71509) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 11:03:44 user nova-compute[71509]: DEBUG nova.virt.libvirt.guest [None req-65b49b3f-cb92-4791-a767-ea964c8ad446 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 11:03:44 user nova-compute[71509]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 11:03:44 user nova-compute[71509]:   <source dev="/dev/sdf"/>
Apr 14 11:03:44 user nova-compute[71509]:   <target dev="vdb" bus="virtio"/>
Apr 14 11:03:44 user nova-compute[71509]:   <serial>7c15d29b-d395-4a8f-ae98-ef8d51aa6133</serial>
Apr 14 11:03:44 user nova-compute[71509]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 11:03:44 user nova-compute[71509]: </disk>
Apr 14 11:03:44 user nova-compute[71509]:  {{(pid=71509) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 11:03:44 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-65b49b3f-cb92-4791-a767-ea964c8ad446 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Successfully detached device vdb from instance b96e2a1a-8c1b-4189-86b9-a3c1761a9813 from the persistent domain config.
Apr 14 11:03:44 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-65b49b3f-cb92-4791-a767-ea964c8ad446 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b96e2a1a-8c1b-4189-86b9-a3c1761a9813 from the live domain config. {{(pid=71509) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 11:03:44 user nova-compute[71509]: DEBUG nova.virt.libvirt.guest [None req-65b49b3f-cb92-4791-a767-ea964c8ad446 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 11:03:44 user nova-compute[71509]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 11:03:44 user nova-compute[71509]:   <source dev="/dev/sdf"/>
Apr 14 11:03:44 user nova-compute[71509]:   <target dev="vdb" bus="virtio"/>
Apr 14 11:03:44 user nova-compute[71509]:   <serial>7c15d29b-d395-4a8f-ae98-ef8d51aa6133</serial>
Apr 14 11:03:44 user nova-compute[71509]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 11:03:44 user nova-compute[71509]: </disk>
Apr 14 11:03:44 user nova-compute[71509]:  {{(pid=71509) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 11:03:44 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Received event <DeviceRemovedEvent: 1681470224.4639351, b96e2a1a-8c1b-4189-86b9-a3c1761a9813 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71509) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 11:03:44 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-65b49b3f-cb92-4791-a767-ea964c8ad446 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b96e2a1a-8c1b-4189-86b9-a3c1761a9813 {{(pid=71509) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 11:03:44 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-65b49b3f-cb92-4791-a767-ea964c8ad446 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Successfully detached device vdb from instance b96e2a1a-8c1b-4189-86b9-a3c1761a9813 from the live domain config.
Apr 14 11:03:44 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65b49b3f-cb92-4791-a767-ea964c8ad446 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: b96e2a1a-8c1b-4189-86b9-a3c1761a9813] calling os-brick to detach iSCSI Volume {{(pid=71509) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 11:03:44 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-65b49b3f-cb92-4791-a767-ea964c8ad446 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0bf0749390>, {'target_iqn': 'iqn.2010-10.org.openstack:7c15d29b-d395-4a8f-ae98-ef8d51aa6133', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'trnoCiSe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf': {}}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 11:03:44 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-65b49b3f-cb92-4791-a767-ea964c8ad446 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 11:03:44 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-65b49b3f-cb92-4791-a767-ea964c8ad446 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 11:03:44 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-65b49b3f-cb92-4791-a767-ea964c8ad446 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 11:03:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:03:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:03:44 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[c522b22d-7fbc-45df-9f0d-ab862ff0e855]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7c15d29b-d395-4a8f-ae98-ef8d51aa6133\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0da1ed17-2b8c-4dd3-a61a-1133a9420d21\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:03:44 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-65b49b3f-cb92-4791-a767-ea964c8ad446 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 11:03:44 user nova-compute[71509]: No targets found.
Apr 14 11:03:44 user nova-compute[71509]: iSNS:
Apr 14 11:03:44 user nova-compute[71509]: No targets found.
Apr 14 11:03:44 user nova-compute[71509]: STATIC:
Apr 14 11:03:44 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3
Apr 14 11:03:44 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 11:03:44 user nova-compute[71509]:                 Iface Name: default
Apr 14 11:03:44 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:7c15d29b-d395-4a8f-ae98-ef8d51aa6133
Apr 14 11:03:44 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 11:03:44 user nova-compute[71509]:                 Iface Name: default
Apr 14 11:03:44 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:0da1ed17-2b8c-4dd3-a61a-1133a9420d21
Apr 14 11:03:44 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 11:03:44 user nova-compute[71509]:                 Iface Name: default
Apr 14 11:03:44 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178
Apr 14 11:03:44 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 11:03:44 user nova-compute[71509]:                 Iface Name: default
Apr 14 11:03:44 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219
Apr 14 11:03:44 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 11:03:44 user nova-compute[71509]:                 Iface Name: default
Apr 14 11:03:44 user nova-compute[71509]: FIRMWARE:
Apr 14 11:03:44 user nova-compute[71509]: No targets found.
Apr 14 11:03:44 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 11:03:44 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-65b49b3f-cb92-4791-a767-ea964c8ad446 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 11:03:44 user nova-compute[71509]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 11:03:44 user nova-compute[71509]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71509) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 11:03:44 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-65b49b3f-cb92-4791-a767-ea964c8ad446 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c15d29b-d395-4a8f-ae98-ef8d51aa6133', 0)] {{(pid=71509) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 11:03:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:03:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:03:44 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[d56ed88d-0d43-4d87-8cfd-9a3a770a7388]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0da1ed17-2b8c-4dd3-a61a-1133a9420d21\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c15d29b-d395-4a8f-ae98-ef8d51aa6133\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:03:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:03:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:03:44 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[b99507b6-9013-4f1e-8669-a3233dcbea81]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0da1ed17-2b8c-4dd3-a61a-1133a9420d21 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c15d29b-d395-4a8f-ae98-ef8d51aa6133 (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:03:44 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-65b49b3f-cb92-4791-a767-ea964c8ad446 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)
Apr 14 11:03:44 user nova-compute[71509]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219 (non-flash)
Apr 14 11:03:44 user nova-compute[71509]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3 (non-flash)
Apr 14 11:03:44 user nova-compute[71509]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0da1ed17-2b8c-4dd3-a61a-1133a9420d21 (non-flash)
Apr 14 11:03:44 user nova-compute[71509]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c15d29b-d395-4a8f-ae98-ef8d51aa6133 (non-flash)
Apr 14 11:03:44 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 11:03:44 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-65b49b3f-cb92-4791-a767-ea964c8ad446 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)
Apr 14 11:03:44 user nova-compute[71509]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219 (non-flash)
Apr 14 11:03:44 user nova-compute[71509]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3 (non-flash)
Apr 14 11:03:44 user nova-compute[71509]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0da1ed17-2b8c-4dd3-a61a-1133a9420d21 (non-flash)
Apr 14 11:03:44 user nova-compute[71509]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c15d29b-d395-4a8f-ae98-ef8d51aa6133 (non-flash)
Apr 14 11:03:44 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 11:03:44 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-65b49b3f-cb92-4791-a767-ea964c8ad446 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0bf0476290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c15d29b-d395-4a8f-ae98-ef8d51aa6133'): ({'sdf'}, set())}) {{(pid=71509) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 11:03:44 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-65b49b3f-cb92-4791-a767-ea964c8ad446 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Removing single pathed devices sdf {{(pid=71509) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 11:03:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:03:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:03:44 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2c1991c-5dfa-42f4-b051-755b765eb774]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:03:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:03:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.023s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:03:44 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[111f940d-0744-42d9-8a5c-d276b94af990]: (4, ('ok\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:03:44 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-65b49b3f-cb92-4791-a767-ea964c8ad446 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Flushing IO for device /dev/sdf {{(pid=71509) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 11:03:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:03:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.017s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:03:44 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[a393e379-14e9-4545-ac48-69f9ac70cfa6]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:03:44 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-65b49b3f-cb92-4791-a767-ea964c8ad446 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=71509) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 11:03:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:03:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.050s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:03:44 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[1105fbc8-4e22-4873-82ca-f326489b0afa]: (4, ('1', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:03:44 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-65b49b3f-cb92-4791-a767-ea964c8ad446 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=71509) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 11:03:44 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-65b49b3f-cb92-4791-a767-ea964c8ad446 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] SCSI volumes sdf have been removed. {{(pid=71509) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 11:03:44 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-65b49b3f-cb92-4791-a767-ea964c8ad446 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c15d29b-d395-4a8f-ae98-ef8d51aa6133')] {{(pid=71509) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 11:03:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c15d29b-d395-4a8f-ae98-ef8d51aa6133 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:03:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c15d29b-d395-4a8f-ae98-ef8d51aa6133 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:03:44 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[304ca158-0e07-4970-8688-7b6ec3ff9225]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:03:44 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-65b49b3f-cb92-4791-a767-ea964c8ad446 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:03:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c15d29b-d395-4a8f-ae98-ef8d51aa6133 -p 172.16.0.220:3260 --logout {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:03:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c15d29b-d395-4a8f-ae98-ef8d51aa6133 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:03:44 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[d27951c0-af72-4bd3-9fdb-d4156c241ef4]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:7c15d29b-d395-4a8f-ae98-ef8d51aa6133, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:7c15d29b-d395-4a8f-ae98-ef8d51aa6133, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:03:44 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-65b49b3f-cb92-4791-a767-ea964c8ad446 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:7c15d29b-d395-4a8f-ae98-ef8d51aa6133, portal: 172.16.0.220,3260]
Apr 14 11:03:44 user nova-compute[71509]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:7c15d29b-d395-4a8f-ae98-ef8d51aa6133, portal: 172.16.0.220,3260] successful.
Apr 14 11:03:44 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:03:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c15d29b-d395-4a8f-ae98-ef8d51aa6133 -p 172.16.0.220:3260 --op delete {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:03:44 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c15d29b-d395-4a8f-ae98-ef8d51aa6133 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:03:44 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dc6a174-2d17-4801-a82c-f711161bd655]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:03:44 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-65b49b3f-cb92-4791-a767-ea964c8ad446 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:03:44 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-65b49b3f-cb92-4791-a767-ea964c8ad446 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.346s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 11:03:44 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-65b49b3f-cb92-4791-a767-ea964c8ad446 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] <== disconnect_volume: return (347ms) None {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 11:03:44 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65b49b3f-cb92-4791-a767-ea964c8ad446 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: b96e2a1a-8c1b-4189-86b9-a3c1761a9813] Disconnected iSCSI Volume {{(pid=71509) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 11:03:45 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:03:46 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:03:46 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:03:46 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:03:47 user nova-compute[71509]: DEBUG nova.objects.instance [None req-65b49b3f-cb92-4791-a767-ea964c8ad446 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lazy-loading 'flavor' on Instance uuid b96e2a1a-8c1b-4189-86b9-a3c1761a9813 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 11:03:47 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-65b49b3f-cb92-4791-a767-ea964c8ad446 tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "b96e2a1a-8c1b-4189-86b9-a3c1761a9813" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.851s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:03:48 user nova-compute[71509]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681470213.2049463, a1fdcfb4-8700-48fe-9dec-1e8a4b766cba => Stopped> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 11:03:48 user nova-compute[71509]: INFO nova.compute.manager [-] [instance: a1fdcfb4-8700-48fe-9dec-1e8a4b766cba] VM Stopped (Lifecycle Event)
Apr 14 11:03:48 user nova-compute[71509]: DEBUG nova.compute.manager [None req-baed8573-1683-4721-9c07-4e782d51609e None None] [instance: a1fdcfb4-8700-48fe-9dec-1e8a4b766cba] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 11:03:48 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:03:48 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:03:49 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:03:49 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71509) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 14 11:03:50 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-255c20d5-1609-4a2e-98f6-2315896463dd tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Acquiring lock "6f41f217-0df2-4205-9633-7dbe83f40c96" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:03:50 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-255c20d5-1609-4a2e-98f6-2315896463dd tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Lock "6f41f217-0df2-4205-9633-7dbe83f40c96" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:03:50 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-255c20d5-1609-4a2e-98f6-2315896463dd tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Acquiring lock "6f41f217-0df2-4205-9633-7dbe83f40c96-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:03:50 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-255c20d5-1609-4a2e-98f6-2315896463dd tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Lock "6f41f217-0df2-4205-9633-7dbe83f40c96-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:03:50 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-255c20d5-1609-4a2e-98f6-2315896463dd tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Lock "6f41f217-0df2-4205-9633-7dbe83f40c96-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:03:50 user nova-compute[71509]: INFO nova.compute.manager [None req-255c20d5-1609-4a2e-98f6-2315896463dd tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] [instance: 6f41f217-0df2-4205-9633-7dbe83f40c96] Terminating instance
Apr 14 11:03:50 user nova-compute[71509]: DEBUG nova.compute.manager [None req-255c20d5-1609-4a2e-98f6-2315896463dd tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] [instance: 6f41f217-0df2-4205-9633-7dbe83f40c96] Start destroying the instance on the hypervisor. {{(pid=71509) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 11:03:50 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:03:50 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:03:50 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:03:50 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:03:50 user nova-compute[71509]: DEBUG nova.compute.manager [req-68cf728c-ec16-4790-9ca3-39ae2b0a9db8 req-2276c402-8a3c-4dfd-a20e-5994a1ca6faf service nova] [instance: 6f41f217-0df2-4205-9633-7dbe83f40c96] Received event network-vif-unplugged-e3d5b9ac-d641-478c-89cc-acbbf189ee2a {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:03:50 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-68cf728c-ec16-4790-9ca3-39ae2b0a9db8 req-2276c402-8a3c-4dfd-a20e-5994a1ca6faf service nova] Acquiring lock "6f41f217-0df2-4205-9633-7dbe83f40c96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:03:50 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-68cf728c-ec16-4790-9ca3-39ae2b0a9db8 req-2276c402-8a3c-4dfd-a20e-5994a1ca6faf service nova] Lock "6f41f217-0df2-4205-9633-7dbe83f40c96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:03:50 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-68cf728c-ec16-4790-9ca3-39ae2b0a9db8 req-2276c402-8a3c-4dfd-a20e-5994a1ca6faf service nova] Lock "6f41f217-0df2-4205-9633-7dbe83f40c96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:03:50 user nova-compute[71509]: DEBUG nova.compute.manager [req-68cf728c-ec16-4790-9ca3-39ae2b0a9db8 req-2276c402-8a3c-4dfd-a20e-5994a1ca6faf service nova] [instance: 6f41f217-0df2-4205-9633-7dbe83f40c96] No waiting events found dispatching network-vif-unplugged-e3d5b9ac-d641-478c-89cc-acbbf189ee2a {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:03:50 user nova-compute[71509]: DEBUG nova.compute.manager [req-68cf728c-ec16-4790-9ca3-39ae2b0a9db8 req-2276c402-8a3c-4dfd-a20e-5994a1ca6faf service nova] [instance: 6f41f217-0df2-4205-9633-7dbe83f40c96] Received event network-vif-unplugged-e3d5b9ac-d641-478c-89cc-acbbf189ee2a for instance with task_state deleting. {{(pid=71509) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 11:03:51 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: 6f41f217-0df2-4205-9633-7dbe83f40c96] Instance destroyed successfully.
Apr 14 11:03:51 user nova-compute[71509]: DEBUG nova.objects.instance [None req-255c20d5-1609-4a2e-98f6-2315896463dd tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Lazy-loading 'resources' on Instance uuid 6f41f217-0df2-4205-9633-7dbe83f40c96 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 11:03:51 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-255c20d5-1609-4a2e-98f6-2315896463dd tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T10:55:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1683745900',display_name='tempest-ServersNegativeTestJSON-server-1683745900',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1683745900',id=26,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T10:55:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='be1c0764b8a843808158644eb90704e6',ramdisk_id='',reservation_id='r-cr5mkbrz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1472676568',owner_user_name='tempest-ServersNegativeTestJSON-1472676568-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T10:55:15Z,user_data=None,user_id='b3f2157c5d4d441db80ea4a3ca60e4dc',uuid=6f41f217-0df2-4205-9633-7dbe83f40c96,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e3d5b9ac-d641-478c-89cc-acbbf189ee2a", "address": "fa:16:3e:2d:5c:30", "network": {"id": "0d829782-2ea4-4af3-8460-468b818423dc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2082561441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be1c0764b8a843808158644eb90704e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3d5b9ac-d6", "ovs_interfaceid": "e3d5b9ac-d641-478c-89cc-acbbf189ee2a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 11:03:51 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-255c20d5-1609-4a2e-98f6-2315896463dd tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Converting VIF {"id": "e3d5b9ac-d641-478c-89cc-acbbf189ee2a", "address": "fa:16:3e:2d:5c:30", "network": {"id": "0d829782-2ea4-4af3-8460-468b818423dc", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2082561441-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be1c0764b8a843808158644eb90704e6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape3d5b9ac-d6", "ovs_interfaceid": "e3d5b9ac-d641-478c-89cc-acbbf189ee2a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 11:03:51 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-255c20d5-1609-4a2e-98f6-2315896463dd tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2d:5c:30,bridge_name='br-int',has_traffic_filtering=True,id=e3d5b9ac-d641-478c-89cc-acbbf189ee2a,network=Network(0d829782-2ea4-4af3-8460-468b818423dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3d5b9ac-d6') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 11:03:51 user nova-compute[71509]: DEBUG os_vif [None req-255c20d5-1609-4a2e-98f6-2315896463dd tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2d:5c:30,bridge_name='br-int',has_traffic_filtering=True,id=e3d5b9ac-d641-478c-89cc-acbbf189ee2a,network=Network(0d829782-2ea4-4af3-8460-468b818423dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3d5b9ac-d6') {{(pid=71509) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 11:03:51 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:03:51 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape3d5b9ac-d6, bridge=br-int, if_exists=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:03:51 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:03:51 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:03:51 user nova-compute[71509]: INFO os_vif [None req-255c20d5-1609-4a2e-98f6-2315896463dd tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2d:5c:30,bridge_name='br-int',has_traffic_filtering=True,id=e3d5b9ac-d641-478c-89cc-acbbf189ee2a,network=Network(0d829782-2ea4-4af3-8460-468b818423dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape3d5b9ac-d6')
Apr 14 11:03:51 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-255c20d5-1609-4a2e-98f6-2315896463dd tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] [instance: 6f41f217-0df2-4205-9633-7dbe83f40c96] Deleting instance files /opt/stack/data/nova/instances/6f41f217-0df2-4205-9633-7dbe83f40c96_del
Apr 14 11:03:51 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-255c20d5-1609-4a2e-98f6-2315896463dd tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] [instance: 6f41f217-0df2-4205-9633-7dbe83f40c96] Deletion of /opt/stack/data/nova/instances/6f41f217-0df2-4205-9633-7dbe83f40c96_del complete
Apr 14 11:03:51 user nova-compute[71509]: INFO nova.compute.manager [None req-255c20d5-1609-4a2e-98f6-2315896463dd tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] [instance: 6f41f217-0df2-4205-9633-7dbe83f40c96] Took 0.88 seconds to destroy the instance on the hypervisor.
Apr 14 11:03:51 user nova-compute[71509]: DEBUG oslo.service.loopingcall [None req-255c20d5-1609-4a2e-98f6-2315896463dd tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71509) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 11:03:51 user nova-compute[71509]: DEBUG nova.compute.manager [-] [instance: 6f41f217-0df2-4205-9633-7dbe83f40c96] Deallocating network for instance {{(pid=71509) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 11:03:51 user nova-compute[71509]: DEBUG nova.network.neutron [-] [instance: 6f41f217-0df2-4205-9633-7dbe83f40c96] deallocate_for_instance() {{(pid=71509) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 11:03:51 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:03:51 user nova-compute[71509]: DEBUG nova.network.neutron [-] [instance: 6f41f217-0df2-4205-9633-7dbe83f40c96] Updating instance_info_cache with network_info: [] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:03:51 user nova-compute[71509]: INFO nova.compute.manager [-] [instance: 6f41f217-0df2-4205-9633-7dbe83f40c96] Took 0.47 seconds to deallocate network for instance.
Apr 14 11:03:51 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-255c20d5-1609-4a2e-98f6-2315896463dd tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:03:51 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-255c20d5-1609-4a2e-98f6-2315896463dd tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:03:51 user nova-compute[71509]: DEBUG nova.compute.manager [req-07189cd5-8a71-4d93-8396-c6b67b54f469 req-21cfb1e6-958a-4c9b-a298-538fbaad83ef service nova] [instance: 6f41f217-0df2-4205-9633-7dbe83f40c96] Received event network-vif-deleted-e3d5b9ac-d641-478c-89cc-acbbf189ee2a {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:03:52 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-255c20d5-1609-4a2e-98f6-2315896463dd tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 11:03:52 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-255c20d5-1609-4a2e-98f6-2315896463dd tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 11:03:52 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-255c20d5-1609-4a2e-98f6-2315896463dd tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.291s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:03:52 user nova-compute[71509]: INFO nova.scheduler.client.report [None req-255c20d5-1609-4a2e-98f6-2315896463dd tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Deleted allocations for instance 6f41f217-0df2-4205-9633-7dbe83f40c96
Apr 14 11:03:52 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-255c20d5-1609-4a2e-98f6-2315896463dd tempest-ServersNegativeTestJSON-1472676568 tempest-ServersNegativeTestJSON-1472676568-project-member] Lock "6f41f217-0df2-4205-9633-7dbe83f40c96" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.941s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:03:52 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:03:52 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:03:52 user nova-compute[71509]: DEBUG nova.compute.manager [req-0dc69858-0947-4d28-9262-1e46fe7799b0 req-fde02532-1221-4d95-980e-485e90b2fe88 service nova] [instance: 6f41f217-0df2-4205-9633-7dbe83f40c96] Received event network-vif-plugged-e3d5b9ac-d641-478c-89cc-acbbf189ee2a {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:03:52 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-0dc69858-0947-4d28-9262-1e46fe7799b0 req-fde02532-1221-4d95-980e-485e90b2fe88 service nova] Acquiring lock "6f41f217-0df2-4205-9633-7dbe83f40c96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:03:52 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-0dc69858-0947-4d28-9262-1e46fe7799b0 req-fde02532-1221-4d95-980e-485e90b2fe88 service nova] Lock "6f41f217-0df2-4205-9633-7dbe83f40c96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:03:52 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-0dc69858-0947-4d28-9262-1e46fe7799b0 req-fde02532-1221-4d95-980e-485e90b2fe88 service nova] Lock "6f41f217-0df2-4205-9633-7dbe83f40c96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:03:52 user nova-compute[71509]: DEBUG nova.compute.manager [req-0dc69858-0947-4d28-9262-1e46fe7799b0 req-fde02532-1221-4d95-980e-485e90b2fe88 service nova] [instance: 6f41f217-0df2-4205-9633-7dbe83f40c96] No waiting events found dispatching network-vif-plugged-e3d5b9ac-d641-478c-89cc-acbbf189ee2a {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:03:52 user nova-compute[71509]: WARNING nova.compute.manager [req-0dc69858-0947-4d28-9262-1e46fe7799b0 req-fde02532-1221-4d95-980e-485e90b2fe88 service nova] [instance: 6f41f217-0df2-4205-9633-7dbe83f40c96] Received unexpected event network-vif-plugged-e3d5b9ac-d641-478c-89cc-acbbf189ee2a for instance with vm_state deleted and task_state None.
Apr 14 11:03:56 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:03:56 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:03:56 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Starting heal instance info cache {{(pid=71509) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 11:03:56 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "refresh_cache-6cae9f61-763f-4671-a873-d15f01384416" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 11:03:56 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquired lock "refresh_cache-6cae9f61-763f-4671-a873-d15f01384416" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 11:03:56 user nova-compute[71509]: DEBUG nova.network.neutron [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] [instance: 6cae9f61-763f-4671-a873-d15f01384416] Forcefully refreshing network info cache for instance {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 11:03:56 user nova-compute[71509]: DEBUG nova.network.neutron [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] [instance: 6cae9f61-763f-4671-a873-d15f01384416] Updating instance_info_cache with network_info: [{"id": "30d57100-3321-41fe-9335-d53c8c5e291c", "address": "fa:16:3e:57:7d:4b", "network": {"id": "07f1f39e-292a-4e73-b4ed-99e5799d6fa8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1339551596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71289f80a05141f482cb538dac3d7b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30d57100-33", "ovs_interfaceid": "30d57100-3321-41fe-9335-d53c8c5e291c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:03:56 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Releasing lock "refresh_cache-6cae9f61-763f-4671-a873-d15f01384416" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 11:03:56 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] [instance: 6cae9f61-763f-4671-a873-d15f01384416] Updated the network info_cache for instance {{(pid=71509) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 11:03:56 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:03:56 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:03:56 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:03:56 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:03:56 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Auditing locally available compute resources for user (node: user) {{(pid=71509) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 11:03:57 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b96e2a1a-8c1b-4189-86b9-a3c1761a9813/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:03:57 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b96e2a1a-8c1b-4189-86b9-a3c1761a9813/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:03:57 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b96e2a1a-8c1b-4189-86b9-a3c1761a9813/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:03:57 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b96e2a1a-8c1b-4189-86b9-a3c1761a9813/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:03:57 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c4cc2a1-0c54-4f20-b33f-9085af7b10a3/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:03:57 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c4cc2a1-0c54-4f20-b33f-9085af7b10a3/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:03:57 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c4cc2a1-0c54-4f20-b33f-9085af7b10a3/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:03:57 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c4cc2a1-0c54-4f20-b33f-9085af7b10a3/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:03:57 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=71509) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 11:03:57 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e479154a-acd6-47aa-9a5b-43c6e0feda07/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:03:57 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e479154a-acd6-47aa-9a5b-43c6e0feda07/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:03:57 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e479154a-acd6-47aa-9a5b-43c6e0feda07/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:03:58 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e479154a-acd6-47aa-9a5b-43c6e0feda07/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:03:58 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71509) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 11:03:58 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71509) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 11:03:58 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a936fb20-3f17-4114-829a-8659da6bc5f3/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:03:58 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a936fb20-3f17-4114-829a-8659da6bc5f3/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:03:58 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a936fb20-3f17-4114-829a-8659da6bc5f3/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:03:58 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a936fb20-3f17-4114-829a-8659da6bc5f3/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:03:58 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dd9e11f-1fed-42af-ad5c-9cdd051b93e7/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:03:58 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:03:58 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dd9e11f-1fed-42af-ad5c-9cdd051b93e7/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:03:58 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dd9e11f-1fed-42af-ad5c-9cdd051b93e7/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:03:58 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dd9e11f-1fed-42af-ad5c-9cdd051b93e7/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:03:58 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71509) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 11:03:59 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 11:03:59 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 11:03:59 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Hypervisor/Node resource view: name=user free_ram=7911MB free_disk=25.79439926147461GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71509) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 11:03:59 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:03:59 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:03:59 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance e479154a-acd6-47aa-9a5b-43c6e0feda07 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 11:03:59 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 6cae9f61-763f-4671-a873-d15f01384416 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 11:03:59 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance a936fb20-3f17-4114-829a-8659da6bc5f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 11:03:59 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 0dd9e11f-1fed-42af-ad5c-9cdd051b93e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 11:03:59 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance fbcca78c-fe73-4ef1-92f9-4c8061cad177 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 11:03:59 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 11:03:59 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 3db2e71c-939b-4d2f-b1be-c2122f7cd73e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 11:03:59 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance b96e2a1a-8c1b-4189-86b9-a3c1761a9813 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 11:03:59 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=71509) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 11:03:59 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Final resource view: name=user phys_ram=16023MB used_ram=1600MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=71509) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 11:03:59 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Refreshing inventories for resource provider 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 14 11:03:59 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Updating ProviderTree inventory for provider 52209f7e-594e-4cf4-9018-18636056cd6b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 14 11:03:59 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Updating inventory in ProviderTree for provider 52209f7e-594e-4cf4-9018-18636056cd6b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 14 11:03:59 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Refreshing aggregate associations for resource provider 52209f7e-594e-4cf4-9018-18636056cd6b, aggregates: None {{(pid=71509) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 14 11:03:59 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Refreshing trait associations for resource provider 52209f7e-594e-4cf4-9018-18636056cd6b, traits: COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE42,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_SATA {{(pid=71509) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 14 11:03:59 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 11:03:59 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 11:03:59 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Compute_service record updated for user:user {{(pid=71509) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 11:03:59 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.578s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:04:01 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:04:03 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:04:06 user nova-compute[71509]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681470231.1567469, 6f41f217-0df2-4205-9633-7dbe83f40c96 => Stopped> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 11:04:06 user nova-compute[71509]: INFO nova.compute.manager [-] [instance: 6f41f217-0df2-4205-9633-7dbe83f40c96] VM Stopped (Lifecycle Event)
Apr 14 11:04:06 user nova-compute[71509]: DEBUG nova.compute.manager [None req-f19f2ebc-bef9-4f9d-9faa-f8cf884fa917 None None] [instance: 6f41f217-0df2-4205-9633-7dbe83f40c96] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 11:04:06 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:04:08 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:04:11 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:04:12 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-d31f4828-24df-45d2-8994-6beff7f8ff11 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Acquiring lock "269aa265-9398-4692-8ab4-f3bf5be82714" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:04:12 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-d31f4828-24df-45d2-8994-6beff7f8ff11 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Lock "269aa265-9398-4692-8ab4-f3bf5be82714" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:04:12 user nova-compute[71509]: DEBUG nova.compute.manager [None req-d31f4828-24df-45d2-8994-6beff7f8ff11 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] [instance: 269aa265-9398-4692-8ab4-f3bf5be82714] Starting instance... {{(pid=71509) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 11:04:12 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-d31f4828-24df-45d2-8994-6beff7f8ff11 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:04:12 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-d31f4828-24df-45d2-8994-6beff7f8ff11 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:04:12 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-d31f4828-24df-45d2-8994-6beff7f8ff11 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71509) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 11:04:12 user nova-compute[71509]: INFO nova.compute.claims [None req-d31f4828-24df-45d2-8994-6beff7f8ff11 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] [instance: 269aa265-9398-4692-8ab4-f3bf5be82714] Claim successful on node user
Apr 14 11:04:12 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-d31f4828-24df-45d2-8994-6beff7f8ff11 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 11:04:12 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-d31f4828-24df-45d2-8994-6beff7f8ff11 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 11:04:12 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-d31f4828-24df-45d2-8994-6beff7f8ff11 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.352s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:04:12 user nova-compute[71509]: DEBUG nova.compute.manager [None req-d31f4828-24df-45d2-8994-6beff7f8ff11 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] [instance: 269aa265-9398-4692-8ab4-f3bf5be82714] Start building networks asynchronously for instance. {{(pid=71509) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 11:04:12 user nova-compute[71509]: DEBUG nova.compute.manager [None req-d31f4828-24df-45d2-8994-6beff7f8ff11 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] [instance: 269aa265-9398-4692-8ab4-f3bf5be82714] Allocating IP information in the background. {{(pid=71509) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 11:04:12 user nova-compute[71509]: DEBUG nova.network.neutron [None req-d31f4828-24df-45d2-8994-6beff7f8ff11 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] [instance: 269aa265-9398-4692-8ab4-f3bf5be82714] allocate_for_instance() {{(pid=71509) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 11:04:12 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-d31f4828-24df-45d2-8994-6beff7f8ff11 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] [instance: 269aa265-9398-4692-8ab4-f3bf5be82714] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 11:04:12 user nova-compute[71509]: DEBUG nova.compute.manager [None req-d31f4828-24df-45d2-8994-6beff7f8ff11 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] [instance: 269aa265-9398-4692-8ab4-f3bf5be82714] Start building block device mappings for instance. {{(pid=71509) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 11:04:13 user nova-compute[71509]: DEBUG nova.policy [None req-d31f4828-24df-45d2-8994-6beff7f8ff11 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '282af802879e463ea87844b5fc926692', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1310da753ca94b38a7c660b8613af044', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71509) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 11:04:13 user nova-compute[71509]: DEBUG nova.compute.manager [None req-d31f4828-24df-45d2-8994-6beff7f8ff11 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] [instance: 269aa265-9398-4692-8ab4-f3bf5be82714] Start spawning the instance on the hypervisor. {{(pid=71509) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 11:04:13 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-d31f4828-24df-45d2-8994-6beff7f8ff11 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] [instance: 269aa265-9398-4692-8ab4-f3bf5be82714] Creating instance directory {{(pid=71509) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 11:04:13 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-d31f4828-24df-45d2-8994-6beff7f8ff11 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] [instance: 269aa265-9398-4692-8ab4-f3bf5be82714] Creating image(s)
Apr 14 11:04:13 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-d31f4828-24df-45d2-8994-6beff7f8ff11 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Acquiring lock "/opt/stack/data/nova/instances/269aa265-9398-4692-8ab4-f3bf5be82714/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:04:13 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-d31f4828-24df-45d2-8994-6beff7f8ff11 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Lock "/opt/stack/data/nova/instances/269aa265-9398-4692-8ab4-f3bf5be82714/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:04:13 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-d31f4828-24df-45d2-8994-6beff7f8ff11 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Lock "/opt/stack/data/nova/instances/269aa265-9398-4692-8ab4-f3bf5be82714/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:04:13 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-d31f4828-24df-45d2-8994-6beff7f8ff11 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:04:13 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-d31f4828-24df-45d2-8994-6beff7f8ff11 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json" returned: 0 in 0.139s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:04:13 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-d31f4828-24df-45d2-8994-6beff7f8ff11 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Acquiring lock "5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:04:13 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-d31f4828-24df-45d2-8994-6beff7f8ff11 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Lock "5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:04:13 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-d31f4828-24df-45d2-8994-6beff7f8ff11 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:04:13 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-d31f4828-24df-45d2-8994-6beff7f8ff11 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json" returned: 0 in 0.130s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:04:13 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-d31f4828-24df-45d2-8994-6beff7f8ff11 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18,backing_fmt=raw /opt/stack/data/nova/instances/269aa265-9398-4692-8ab4-f3bf5be82714/disk 1073741824 {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:04:13 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-d31f4828-24df-45d2-8994-6beff7f8ff11 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18,backing_fmt=raw /opt/stack/data/nova/instances/269aa265-9398-4692-8ab4-f3bf5be82714/disk 1073741824" returned: 0 in 0.110s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:04:13 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-d31f4828-24df-45d2-8994-6beff7f8ff11 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Lock "5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:04:13 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-d31f4828-24df-45d2-8994-6beff7f8ff11 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:04:13 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:04:13 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-d31f4828-24df-45d2-8994-6beff7f8ff11 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 --force-share --output=json" returned: 0 in 0.136s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:04:13 user nova-compute[71509]: DEBUG nova.virt.disk.api [None req-d31f4828-24df-45d2-8994-6beff7f8ff11 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Checking if we can resize image /opt/stack/data/nova/instances/269aa265-9398-4692-8ab4-f3bf5be82714/disk. size=1073741824 {{(pid=71509) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 11:04:13 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-d31f4828-24df-45d2-8994-6beff7f8ff11 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/269aa265-9398-4692-8ab4-f3bf5be82714/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:04:13 user nova-compute[71509]: DEBUG nova.network.neutron [None req-d31f4828-24df-45d2-8994-6beff7f8ff11 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] [instance: 269aa265-9398-4692-8ab4-f3bf5be82714] Successfully created port: 71f5b8c7-15e0-485a-8632-01ed76e9ad91 {{(pid=71509) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 11:04:13 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-d31f4828-24df-45d2-8994-6beff7f8ff11 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/269aa265-9398-4692-8ab4-f3bf5be82714/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:04:13 user nova-compute[71509]: DEBUG nova.virt.disk.api [None req-d31f4828-24df-45d2-8994-6beff7f8ff11 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Cannot resize image /opt/stack/data/nova/instances/269aa265-9398-4692-8ab4-f3bf5be82714/disk to a smaller size. {{(pid=71509) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 11:04:13 user nova-compute[71509]: DEBUG nova.objects.instance [None req-d31f4828-24df-45d2-8994-6beff7f8ff11 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Lazy-loading 'migration_context' on Instance uuid 269aa265-9398-4692-8ab4-f3bf5be82714 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 11:04:13 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-d31f4828-24df-45d2-8994-6beff7f8ff11 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] [instance: 269aa265-9398-4692-8ab4-f3bf5be82714] Created local disks {{(pid=71509) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 11:04:13 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-d31f4828-24df-45d2-8994-6beff7f8ff11 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] [instance: 269aa265-9398-4692-8ab4-f3bf5be82714] Ensure instance console log exists: /opt/stack/data/nova/instances/269aa265-9398-4692-8ab4-f3bf5be82714/console.log {{(pid=71509) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 11:04:13 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-d31f4828-24df-45d2-8994-6beff7f8ff11 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:04:13 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-d31f4828-24df-45d2-8994-6beff7f8ff11 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:04:13 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-d31f4828-24df-45d2-8994-6beff7f8ff11 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:04:14 user nova-compute[71509]: DEBUG nova.network.neutron [None req-d31f4828-24df-45d2-8994-6beff7f8ff11 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] [instance: 269aa265-9398-4692-8ab4-f3bf5be82714] Successfully updated port: 71f5b8c7-15e0-485a-8632-01ed76e9ad91 {{(pid=71509) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 11:04:14 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-d31f4828-24df-45d2-8994-6beff7f8ff11 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Acquiring lock "refresh_cache-269aa265-9398-4692-8ab4-f3bf5be82714" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 11:04:14 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-d31f4828-24df-45d2-8994-6beff7f8ff11 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Acquired lock "refresh_cache-269aa265-9398-4692-8ab4-f3bf5be82714" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 11:04:14 user nova-compute[71509]: DEBUG nova.network.neutron [None req-d31f4828-24df-45d2-8994-6beff7f8ff11 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] [instance: 269aa265-9398-4692-8ab4-f3bf5be82714] Building network info cache for instance {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 11:04:14 user nova-compute[71509]: DEBUG nova.compute.manager [req-cf9bebce-3a0c-4a47-a61e-2a62c6f48af1 req-41b25278-3b17-4461-a0a8-ec0f7f47a7fa service nova] [instance: 269aa265-9398-4692-8ab4-f3bf5be82714] Received event network-changed-71f5b8c7-15e0-485a-8632-01ed76e9ad91 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:04:14 user nova-compute[71509]: DEBUG nova.compute.manager [req-cf9bebce-3a0c-4a47-a61e-2a62c6f48af1 req-41b25278-3b17-4461-a0a8-ec0f7f47a7fa service nova] [instance: 269aa265-9398-4692-8ab4-f3bf5be82714] Refreshing instance network info cache due to event network-changed-71f5b8c7-15e0-485a-8632-01ed76e9ad91. {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 11:04:14 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-cf9bebce-3a0c-4a47-a61e-2a62c6f48af1 req-41b25278-3b17-4461-a0a8-ec0f7f47a7fa service nova] Acquiring lock "refresh_cache-269aa265-9398-4692-8ab4-f3bf5be82714" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 11:04:14 user nova-compute[71509]: DEBUG nova.network.neutron [None req-d31f4828-24df-45d2-8994-6beff7f8ff11 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] [instance: 269aa265-9398-4692-8ab4-f3bf5be82714] Instance cache missing network info. {{(pid=71509) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 11:04:14 user nova-compute[71509]: DEBUG nova.network.neutron [None req-d31f4828-24df-45d2-8994-6beff7f8ff11 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] [instance: 269aa265-9398-4692-8ab4-f3bf5be82714] Updating instance_info_cache with network_info: [{"id": "71f5b8c7-15e0-485a-8632-01ed76e9ad91", "address": "fa:16:3e:36:08:6c", "network": {"id": "9614cf7a-420b-4226-9189-a89f3f4e6340", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1987410065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "1310da753ca94b38a7c660b8613af044", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71f5b8c7-15", "ovs_interfaceid": "71f5b8c7-15e0-485a-8632-01ed76e9ad91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:04:14 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-d31f4828-24df-45d2-8994-6beff7f8ff11 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Releasing lock "refresh_cache-269aa265-9398-4692-8ab4-f3bf5be82714" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 11:04:14 user nova-compute[71509]: DEBUG nova.compute.manager [None req-d31f4828-24df-45d2-8994-6beff7f8ff11 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] [instance: 269aa265-9398-4692-8ab4-f3bf5be82714] Instance network_info: |[{"id": "71f5b8c7-15e0-485a-8632-01ed76e9ad91", "address": "fa:16:3e:36:08:6c", "network": {"id": "9614cf7a-420b-4226-9189-a89f3f4e6340", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1987410065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "1310da753ca94b38a7c660b8613af044", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71f5b8c7-15", "ovs_interfaceid": "71f5b8c7-15e0-485a-8632-01ed76e9ad91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71509) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 11:04:14 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-cf9bebce-3a0c-4a47-a61e-2a62c6f48af1 req-41b25278-3b17-4461-a0a8-ec0f7f47a7fa service nova] Acquired lock "refresh_cache-269aa265-9398-4692-8ab4-f3bf5be82714" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 11:04:14 user nova-compute[71509]: DEBUG nova.network.neutron [req-cf9bebce-3a0c-4a47-a61e-2a62c6f48af1 req-41b25278-3b17-4461-a0a8-ec0f7f47a7fa service nova] [instance: 269aa265-9398-4692-8ab4-f3bf5be82714] Refreshing network info cache for port 71f5b8c7-15e0-485a-8632-01ed76e9ad91 {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 11:04:14 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-d31f4828-24df-45d2-8994-6beff7f8ff11 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] [instance: 269aa265-9398-4692-8ab4-f3bf5be82714] Start _get_guest_xml network_info=[{"id": "71f5b8c7-15e0-485a-8632-01ed76e9ad91", "address": "fa:16:3e:36:08:6c", "network": {"id": "9614cf7a-420b-4226-9189-a89f3f4e6340", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1987410065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "1310da753ca94b38a7c660b8613af044", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71f5b8c7-15", "ovs_interfaceid": "71f5b8c7-15e0-485a-8632-01ed76e9ad91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T10:38:55Z,direct_url=<?>,disk_format='qcow2',id=048ec0ee-0465-448d-8b4c-f072acb101dc,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='9742d6ad20cf48d9bab0fdbcc9491db9',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T10:38:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': '048ec0ee-0465-448d-8b4c-f072acb101dc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71509) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 11:04:14 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-d31f4828-24df-45d2-8994-6beff7f8ff11 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 11:04:14 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-d31f4828-24df-45d2-8994-6beff7f8ff11 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 11:04:14 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-d31f4828-24df-45d2-8994-6beff7f8ff11 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71509) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 11:04:14 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-d31f4828-24df-45d2-8994-6beff7f8ff11 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T10:40:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T10:38:55Z,direct_url=<?>,disk_format='qcow2',id=048ec0ee-0465-448d-8b4c-f072acb101dc,min_disk=0,min_ram=0,name='cirros-0.5.2-x86_64-disk',owner='9742d6ad20cf48d9bab0fdbcc9491db9',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T10:38:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 11:04:14 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-d31f4828-24df-45d2-8994-6beff7f8ff11 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Flavor limits 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 11:04:14 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-d31f4828-24df-45d2-8994-6beff7f8ff11 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Image limits 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 11:04:14 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-d31f4828-24df-45d2-8994-6beff7f8ff11 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Flavor pref 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 11:04:14 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-d31f4828-24df-45d2-8994-6beff7f8ff11 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Image pref 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 11:04:14 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-d31f4828-24df-45d2-8994-6beff7f8ff11 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 11:04:14 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-d31f4828-24df-45d2-8994-6beff7f8ff11 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 11:04:14 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-d31f4828-24df-45d2-8994-6beff7f8ff11 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71509) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 11:04:14 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-d31f4828-24df-45d2-8994-6beff7f8ff11 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Got 1 possible topologies {{(pid=71509) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 11:04:14 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-d31f4828-24df-45d2-8994-6beff7f8ff11 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 11:04:14 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-d31f4828-24df-45d2-8994-6beff7f8ff11 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 11:04:14 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-d31f4828-24df-45d2-8994-6beff7f8ff11 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T11:04:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-611211991',display_name='tempest-VolumesActionsTest-instance-611211991',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-611211991',id=40,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1310da753ca94b38a7c660b8613af044',ramdisk_id='',reservation_id='r-twnxtkhf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1201626915',owner_user_name='tempest-VolumesActionsTest-1201626915-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T11:04:13Z,user_data=None,user_id='282af802879e463ea87844b5fc926692',uuid=269aa265-9398-4692-8ab4-f3bf5be82714,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "71f5b8c7-15e0-485a-8632-01ed76e9ad91", "address": "fa:16:3e:36:08:6c", "network": {"id": "9614cf7a-420b-4226-9189-a89f3f4e6340", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1987410065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "1310da753ca94b38a7c660b8613af044", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71f5b8c7-15", "ovs_interfaceid": "71f5b8c7-15e0-485a-8632-01ed76e9ad91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71509) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 11:04:14 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-d31f4828-24df-45d2-8994-6beff7f8ff11 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Converting VIF {"id": "71f5b8c7-15e0-485a-8632-01ed76e9ad91", "address": "fa:16:3e:36:08:6c", "network": {"id": "9614cf7a-420b-4226-9189-a89f3f4e6340", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1987410065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "1310da753ca94b38a7c660b8613af044", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71f5b8c7-15", "ovs_interfaceid": "71f5b8c7-15e0-485a-8632-01ed76e9ad91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 11:04:14 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-d31f4828-24df-45d2-8994-6beff7f8ff11 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:08:6c,bridge_name='br-int',has_traffic_filtering=True,id=71f5b8c7-15e0-485a-8632-01ed76e9ad91,network=Network(9614cf7a-420b-4226-9189-a89f3f4e6340),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71f5b8c7-15') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 11:04:14 user nova-compute[71509]: DEBUG nova.objects.instance [None req-d31f4828-24df-45d2-8994-6beff7f8ff11 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Lazy-loading 'pci_devices' on Instance uuid 269aa265-9398-4692-8ab4-f3bf5be82714 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 11:04:14 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-d31f4828-24df-45d2-8994-6beff7f8ff11 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] [instance: 269aa265-9398-4692-8ab4-f3bf5be82714] End _get_guest_xml xml=<domain type="kvm">
Apr 14 11:04:14 user nova-compute[71509]:   <uuid>269aa265-9398-4692-8ab4-f3bf5be82714</uuid>
Apr 14 11:04:14 user nova-compute[71509]:   <name>instance-00000028</name>
Apr 14 11:04:14 user nova-compute[71509]:   <memory>131072</memory>
Apr 14 11:04:14 user nova-compute[71509]:   <vcpu>1</vcpu>
Apr 14 11:04:14 user nova-compute[71509]:   <metadata>
Apr 14 11:04:14 user nova-compute[71509]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 11:04:14 user nova-compute[71509]:       <nova:package version="0.0.0"/>
Apr 14 11:04:14 user nova-compute[71509]:       <nova:name>tempest-VolumesActionsTest-instance-611211991</nova:name>
Apr 14 11:04:14 user nova-compute[71509]:       <nova:creationTime>2023-04-14 11:04:14</nova:creationTime>
Apr 14 11:04:14 user nova-compute[71509]:       <nova:flavor name="m1.nano">
Apr 14 11:04:14 user nova-compute[71509]:         <nova:memory>128</nova:memory>
Apr 14 11:04:14 user nova-compute[71509]:         <nova:disk>1</nova:disk>
Apr 14 11:04:14 user nova-compute[71509]:         <nova:swap>0</nova:swap>
Apr 14 11:04:14 user nova-compute[71509]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 11:04:14 user nova-compute[71509]:         <nova:vcpus>1</nova:vcpus>
Apr 14 11:04:14 user nova-compute[71509]:       </nova:flavor>
Apr 14 11:04:14 user nova-compute[71509]:       <nova:owner>
Apr 14 11:04:14 user nova-compute[71509]:         <nova:user uuid="282af802879e463ea87844b5fc926692">tempest-VolumesActionsTest-1201626915-project-member</nova:user>
Apr 14 11:04:14 user nova-compute[71509]:         <nova:project uuid="1310da753ca94b38a7c660b8613af044">tempest-VolumesActionsTest-1201626915</nova:project>
Apr 14 11:04:14 user nova-compute[71509]:       </nova:owner>
Apr 14 11:04:14 user nova-compute[71509]:       <nova:root type="image" uuid="048ec0ee-0465-448d-8b4c-f072acb101dc"/>
Apr 14 11:04:14 user nova-compute[71509]:       <nova:ports>
Apr 14 11:04:14 user nova-compute[71509]:         <nova:port uuid="71f5b8c7-15e0-485a-8632-01ed76e9ad91">
Apr 14 11:04:14 user nova-compute[71509]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Apr 14 11:04:14 user nova-compute[71509]:         </nova:port>
Apr 14 11:04:14 user nova-compute[71509]:       </nova:ports>
Apr 14 11:04:14 user nova-compute[71509]:     </nova:instance>
Apr 14 11:04:14 user nova-compute[71509]:   </metadata>
Apr 14 11:04:14 user nova-compute[71509]:   <sysinfo type="smbios">
Apr 14 11:04:14 user nova-compute[71509]:     <system>
Apr 14 11:04:14 user nova-compute[71509]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 11:04:14 user nova-compute[71509]:       <entry name="product">OpenStack Nova</entry>
Apr 14 11:04:14 user nova-compute[71509]:       <entry name="version">0.0.0</entry>
Apr 14 11:04:14 user nova-compute[71509]:       <entry name="serial">269aa265-9398-4692-8ab4-f3bf5be82714</entry>
Apr 14 11:04:14 user nova-compute[71509]:       <entry name="uuid">269aa265-9398-4692-8ab4-f3bf5be82714</entry>
Apr 14 11:04:14 user nova-compute[71509]:       <entry name="family">Virtual Machine</entry>
Apr 14 11:04:14 user nova-compute[71509]:     </system>
Apr 14 11:04:14 user nova-compute[71509]:   </sysinfo>
Apr 14 11:04:14 user nova-compute[71509]:   <os>
Apr 14 11:04:14 user nova-compute[71509]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 11:04:14 user nova-compute[71509]:     <boot dev="hd"/>
Apr 14 11:04:14 user nova-compute[71509]:     <smbios mode="sysinfo"/>
Apr 14 11:04:14 user nova-compute[71509]:   </os>
Apr 14 11:04:14 user nova-compute[71509]:   <features>
Apr 14 11:04:14 user nova-compute[71509]:     <acpi/>
Apr 14 11:04:14 user nova-compute[71509]:     <apic/>
Apr 14 11:04:14 user nova-compute[71509]:     <vmcoreinfo/>
Apr 14 11:04:14 user nova-compute[71509]:   </features>
Apr 14 11:04:14 user nova-compute[71509]:   <clock offset="utc">
Apr 14 11:04:14 user nova-compute[71509]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 11:04:14 user nova-compute[71509]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 11:04:14 user nova-compute[71509]:     <timer name="hpet" present="no"/>
Apr 14 11:04:14 user nova-compute[71509]:   </clock>
Apr 14 11:04:14 user nova-compute[71509]:   <cpu mode="custom" match="exact">
Apr 14 11:04:14 user nova-compute[71509]:     <model>Nehalem</model>
Apr 14 11:04:14 user nova-compute[71509]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 11:04:14 user nova-compute[71509]:   </cpu>
Apr 14 11:04:14 user nova-compute[71509]:   <devices>
Apr 14 11:04:14 user nova-compute[71509]:     <disk type="file" device="disk">
Apr 14 11:04:14 user nova-compute[71509]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 11:04:14 user nova-compute[71509]:       <source file="/opt/stack/data/nova/instances/269aa265-9398-4692-8ab4-f3bf5be82714/disk"/>
Apr 14 11:04:14 user nova-compute[71509]:       <target dev="vda" bus="virtio"/>
Apr 14 11:04:14 user nova-compute[71509]:     </disk>
Apr 14 11:04:14 user nova-compute[71509]:     <interface type="ethernet">
Apr 14 11:04:14 user nova-compute[71509]:       <mac address="fa:16:3e:36:08:6c"/>
Apr 14 11:04:14 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 11:04:14 user nova-compute[71509]:       <mtu size="1442"/>
Apr 14 11:04:14 user nova-compute[71509]:       <target dev="tap71f5b8c7-15"/>
Apr 14 11:04:14 user nova-compute[71509]:     </interface>
Apr 14 11:04:14 user nova-compute[71509]:     <serial type="pty">
Apr 14 11:04:14 user nova-compute[71509]:       <log file="/opt/stack/data/nova/instances/269aa265-9398-4692-8ab4-f3bf5be82714/console.log" append="off"/>
Apr 14 11:04:14 user nova-compute[71509]:     </serial>
Apr 14 11:04:14 user nova-compute[71509]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 11:04:14 user nova-compute[71509]:     <video>
Apr 14 11:04:14 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 11:04:14 user nova-compute[71509]:     </video>
Apr 14 11:04:14 user nova-compute[71509]:     <rng model="virtio">
Apr 14 11:04:14 user nova-compute[71509]:       <backend model="random">/dev/urandom</backend>
Apr 14 11:04:14 user nova-compute[71509]:     </rng>
Apr 14 11:04:14 user nova-compute[71509]:     <controller type="usb" index="0" model="none"/>
Apr 14 11:04:14 user nova-compute[71509]:     <memballoon model="virtio">
Apr 14 11:04:14 user nova-compute[71509]:       <stats period="10"/>
Apr 14 11:04:14 user nova-compute[71509]:     </memballoon>
Apr 14 11:04:14 user nova-compute[71509]:   </devices>
Apr 14 11:04:14 user nova-compute[71509]: </domain>
Apr 14 11:04:14 user nova-compute[71509]:  {{(pid=71509) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 11:04:14 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-d31f4828-24df-45d2-8994-6beff7f8ff11 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T11:04:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-611211991',display_name='tempest-VolumesActionsTest-instance-611211991',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-611211991',id=40,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1310da753ca94b38a7c660b8613af044',ramdisk_id='',reservation_id='r-twnxtkhf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1201626915',owner_user_name='tempest-VolumesActionsTest-1201626915-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T11:04:13Z,user_data=None,user_id='282af802879e463ea87844b5fc926692',uuid=269aa265-9398-4692-8ab4-f3bf5be82714,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "71f5b8c7-15e0-485a-8632-01ed76e9ad91", "address": "fa:16:3e:36:08:6c", "network": {"id": "9614cf7a-420b-4226-9189-a89f3f4e6340", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1987410065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "1310da753ca94b38a7c660b8613af044", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71f5b8c7-15", "ovs_interfaceid": "71f5b8c7-15e0-485a-8632-01ed76e9ad91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 11:04:14 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-d31f4828-24df-45d2-8994-6beff7f8ff11 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Converting VIF {"id": "71f5b8c7-15e0-485a-8632-01ed76e9ad91", "address": "fa:16:3e:36:08:6c", "network": {"id": "9614cf7a-420b-4226-9189-a89f3f4e6340", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1987410065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "1310da753ca94b38a7c660b8613af044", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71f5b8c7-15", "ovs_interfaceid": "71f5b8c7-15e0-485a-8632-01ed76e9ad91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 11:04:14 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-d31f4828-24df-45d2-8994-6beff7f8ff11 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:08:6c,bridge_name='br-int',has_traffic_filtering=True,id=71f5b8c7-15e0-485a-8632-01ed76e9ad91,network=Network(9614cf7a-420b-4226-9189-a89f3f4e6340),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71f5b8c7-15') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 11:04:14 user nova-compute[71509]: DEBUG os_vif [None req-d31f4828-24df-45d2-8994-6beff7f8ff11 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:08:6c,bridge_name='br-int',has_traffic_filtering=True,id=71f5b8c7-15e0-485a-8632-01ed76e9ad91,network=Network(9614cf7a-420b-4226-9189-a89f3f4e6340),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71f5b8c7-15') {{(pid=71509) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 11:04:14 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:04:14 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:04:14 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 11:04:14 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:04:14 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap71f5b8c7-15, may_exist=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:04:14 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap71f5b8c7-15, col_values=(('external_ids', {'iface-id': '71f5b8c7-15e0-485a-8632-01ed76e9ad91', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:36:08:6c', 'vm-uuid': '269aa265-9398-4692-8ab4-f3bf5be82714'}),)) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:04:14 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:04:14 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:04:14 user nova-compute[71509]: INFO os_vif [None req-d31f4828-24df-45d2-8994-6beff7f8ff11 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:08:6c,bridge_name='br-int',has_traffic_filtering=True,id=71f5b8c7-15e0-485a-8632-01ed76e9ad91,network=Network(9614cf7a-420b-4226-9189-a89f3f4e6340),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71f5b8c7-15')
Apr 14 11:04:14 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-d31f4828-24df-45d2-8994-6beff7f8ff11 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] No BDM found with device name vda, not building metadata. {{(pid=71509) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 11:04:14 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-d31f4828-24df-45d2-8994-6beff7f8ff11 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] No VIF found with MAC fa:16:3e:36:08:6c, not building metadata {{(pid=71509) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 11:04:15 user nova-compute[71509]: DEBUG nova.network.neutron [req-cf9bebce-3a0c-4a47-a61e-2a62c6f48af1 req-41b25278-3b17-4461-a0a8-ec0f7f47a7fa service nova] [instance: 269aa265-9398-4692-8ab4-f3bf5be82714] Updated VIF entry in instance network info cache for port 71f5b8c7-15e0-485a-8632-01ed76e9ad91. {{(pid=71509) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 11:04:15 user nova-compute[71509]: DEBUG nova.network.neutron [req-cf9bebce-3a0c-4a47-a61e-2a62c6f48af1 req-41b25278-3b17-4461-a0a8-ec0f7f47a7fa service nova] [instance: 269aa265-9398-4692-8ab4-f3bf5be82714] Updating instance_info_cache with network_info: [{"id": "71f5b8c7-15e0-485a-8632-01ed76e9ad91", "address": "fa:16:3e:36:08:6c", "network": {"id": "9614cf7a-420b-4226-9189-a89f3f4e6340", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1987410065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "1310da753ca94b38a7c660b8613af044", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71f5b8c7-15", "ovs_interfaceid": "71f5b8c7-15e0-485a-8632-01ed76e9ad91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:04:15 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-cf9bebce-3a0c-4a47-a61e-2a62c6f48af1 req-41b25278-3b17-4461-a0a8-ec0f7f47a7fa service nova] Releasing lock "refresh_cache-269aa265-9398-4692-8ab4-f3bf5be82714" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 11:04:16 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:04:16 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:04:16 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:04:16 user nova-compute[71509]: DEBUG nova.compute.manager [req-6cf08f46-439a-4fd8-b0af-8f02b2d03690 req-2d55cf38-bd6e-47c0-b2b1-8cde8ca7b25d service nova] [instance: 269aa265-9398-4692-8ab4-f3bf5be82714] Received event network-vif-plugged-71f5b8c7-15e0-485a-8632-01ed76e9ad91 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:04:16 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-6cf08f46-439a-4fd8-b0af-8f02b2d03690 req-2d55cf38-bd6e-47c0-b2b1-8cde8ca7b25d service nova] Acquiring lock "269aa265-9398-4692-8ab4-f3bf5be82714-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:04:16 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-6cf08f46-439a-4fd8-b0af-8f02b2d03690 req-2d55cf38-bd6e-47c0-b2b1-8cde8ca7b25d service nova] Lock "269aa265-9398-4692-8ab4-f3bf5be82714-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:04:16 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-6cf08f46-439a-4fd8-b0af-8f02b2d03690 req-2d55cf38-bd6e-47c0-b2b1-8cde8ca7b25d service nova] Lock "269aa265-9398-4692-8ab4-f3bf5be82714-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:04:16 user nova-compute[71509]: DEBUG nova.compute.manager [req-6cf08f46-439a-4fd8-b0af-8f02b2d03690 req-2d55cf38-bd6e-47c0-b2b1-8cde8ca7b25d service nova] [instance: 269aa265-9398-4692-8ab4-f3bf5be82714] No waiting events found dispatching network-vif-plugged-71f5b8c7-15e0-485a-8632-01ed76e9ad91 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:04:16 user nova-compute[71509]: WARNING nova.compute.manager [req-6cf08f46-439a-4fd8-b0af-8f02b2d03690 req-2d55cf38-bd6e-47c0-b2b1-8cde8ca7b25d service nova] [instance: 269aa265-9398-4692-8ab4-f3bf5be82714] Received unexpected event network-vif-plugged-71f5b8c7-15e0-485a-8632-01ed76e9ad91 for instance with vm_state building and task_state spawning.
Apr 14 11:04:16 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:04:18 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681470258.117159, 269aa265-9398-4692-8ab4-f3bf5be82714 => Resumed> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 11:04:18 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 269aa265-9398-4692-8ab4-f3bf5be82714] VM Resumed (Lifecycle Event)
Apr 14 11:04:18 user nova-compute[71509]: DEBUG nova.compute.manager [None req-d31f4828-24df-45d2-8994-6beff7f8ff11 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] [instance: 269aa265-9398-4692-8ab4-f3bf5be82714] Instance event wait completed in 0 seconds for  {{(pid=71509) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 11:04:18 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-d31f4828-24df-45d2-8994-6beff7f8ff11 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] [instance: 269aa265-9398-4692-8ab4-f3bf5be82714] Guest created on hypervisor {{(pid=71509) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 11:04:18 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: 269aa265-9398-4692-8ab4-f3bf5be82714] Instance spawned successfully.
Apr 14 11:04:18 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-d31f4828-24df-45d2-8994-6beff7f8ff11 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] [instance: 269aa265-9398-4692-8ab4-f3bf5be82714] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 11:04:18 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 269aa265-9398-4692-8ab4-f3bf5be82714] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 11:04:18 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 269aa265-9398-4692-8ab4-f3bf5be82714] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 11:04:18 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-d31f4828-24df-45d2-8994-6beff7f8ff11 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] [instance: 269aa265-9398-4692-8ab4-f3bf5be82714] Found default for hw_cdrom_bus of ide {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:04:18 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-d31f4828-24df-45d2-8994-6beff7f8ff11 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] [instance: 269aa265-9398-4692-8ab4-f3bf5be82714] Found default for hw_disk_bus of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:04:18 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-d31f4828-24df-45d2-8994-6beff7f8ff11 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] [instance: 269aa265-9398-4692-8ab4-f3bf5be82714] Found default for hw_input_bus of None {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:04:18 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-d31f4828-24df-45d2-8994-6beff7f8ff11 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] [instance: 269aa265-9398-4692-8ab4-f3bf5be82714] Found default for hw_pointer_model of None {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:04:18 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-d31f4828-24df-45d2-8994-6beff7f8ff11 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] [instance: 269aa265-9398-4692-8ab4-f3bf5be82714] Found default for hw_video_model of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:04:18 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-d31f4828-24df-45d2-8994-6beff7f8ff11 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] [instance: 269aa265-9398-4692-8ab4-f3bf5be82714] Found default for hw_vif_model of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:04:18 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 269aa265-9398-4692-8ab4-f3bf5be82714] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 11:04:18 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681470258.1184435, 269aa265-9398-4692-8ab4-f3bf5be82714 => Started> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 11:04:18 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 269aa265-9398-4692-8ab4-f3bf5be82714] VM Started (Lifecycle Event)
Apr 14 11:04:18 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 269aa265-9398-4692-8ab4-f3bf5be82714] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 11:04:18 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 269aa265-9398-4692-8ab4-f3bf5be82714] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 11:04:18 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 269aa265-9398-4692-8ab4-f3bf5be82714] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 11:04:18 user nova-compute[71509]: INFO nova.compute.manager [None req-d31f4828-24df-45d2-8994-6beff7f8ff11 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] [instance: 269aa265-9398-4692-8ab4-f3bf5be82714] Took 5.18 seconds to spawn the instance on the hypervisor.
Apr 14 11:04:18 user nova-compute[71509]: DEBUG nova.compute.manager [None req-d31f4828-24df-45d2-8994-6beff7f8ff11 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] [instance: 269aa265-9398-4692-8ab4-f3bf5be82714] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 11:04:18 user nova-compute[71509]: INFO nova.compute.manager [None req-d31f4828-24df-45d2-8994-6beff7f8ff11 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] [instance: 269aa265-9398-4692-8ab4-f3bf5be82714] Took 5.84 seconds to build instance.
Apr 14 11:04:18 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-d31f4828-24df-45d2-8994-6beff7f8ff11 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Lock "269aa265-9398-4692-8ab4-f3bf5be82714" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.967s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:04:18 user nova-compute[71509]: DEBUG nova.compute.manager [req-99e30b72-e348-4376-a84a-47435a3965c4 req-c3cc75c8-4e2e-431b-add6-fca9784fbc6b service nova] [instance: 269aa265-9398-4692-8ab4-f3bf5be82714] Received event network-vif-plugged-71f5b8c7-15e0-485a-8632-01ed76e9ad91 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:04:18 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-99e30b72-e348-4376-a84a-47435a3965c4 req-c3cc75c8-4e2e-431b-add6-fca9784fbc6b service nova] Acquiring lock "269aa265-9398-4692-8ab4-f3bf5be82714-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:04:18 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-99e30b72-e348-4376-a84a-47435a3965c4 req-c3cc75c8-4e2e-431b-add6-fca9784fbc6b service nova] Lock "269aa265-9398-4692-8ab4-f3bf5be82714-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:04:18 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-99e30b72-e348-4376-a84a-47435a3965c4 req-c3cc75c8-4e2e-431b-add6-fca9784fbc6b service nova] Lock "269aa265-9398-4692-8ab4-f3bf5be82714-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:04:18 user nova-compute[71509]: DEBUG nova.compute.manager [req-99e30b72-e348-4376-a84a-47435a3965c4 req-c3cc75c8-4e2e-431b-add6-fca9784fbc6b service nova] [instance: 269aa265-9398-4692-8ab4-f3bf5be82714] No waiting events found dispatching network-vif-plugged-71f5b8c7-15e0-485a-8632-01ed76e9ad91 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:04:18 user nova-compute[71509]: WARNING nova.compute.manager [req-99e30b72-e348-4376-a84a-47435a3965c4 req-c3cc75c8-4e2e-431b-add6-fca9784fbc6b service nova] [instance: 269aa265-9398-4692-8ab4-f3bf5be82714] Received unexpected event network-vif-plugged-71f5b8c7-15e0-485a-8632-01ed76e9ad91 for instance with vm_state active and task_state None.
Apr 14 11:04:18 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:04:19 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:04:21 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-4e6973c7-4f24-482a-9ca3-1c12ee71d54a tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Acquiring lock "fbcca78c-fe73-4ef1-92f9-4c8061cad177" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:04:21 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-4e6973c7-4f24-482a-9ca3-1c12ee71d54a tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "fbcca78c-fe73-4ef1-92f9-4c8061cad177" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:04:21 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-4e6973c7-4f24-482a-9ca3-1c12ee71d54a tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Acquiring lock "fbcca78c-fe73-4ef1-92f9-4c8061cad177-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:04:21 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-4e6973c7-4f24-482a-9ca3-1c12ee71d54a tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "fbcca78c-fe73-4ef1-92f9-4c8061cad177-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:04:21 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-4e6973c7-4f24-482a-9ca3-1c12ee71d54a tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "fbcca78c-fe73-4ef1-92f9-4c8061cad177-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:04:21 user nova-compute[71509]: INFO nova.compute.manager [None req-4e6973c7-4f24-482a-9ca3-1c12ee71d54a tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] Terminating instance
Apr 14 11:04:21 user nova-compute[71509]: DEBUG nova.compute.manager [None req-4e6973c7-4f24-482a-9ca3-1c12ee71d54a tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] Start destroying the instance on the hypervisor. {{(pid=71509) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 11:04:21 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:04:21 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:04:22 user nova-compute[71509]: DEBUG nova.compute.manager [req-4c1bb9d4-7477-49db-889d-cf50c6d50fae req-15465bab-931f-417c-9c6b-91d3eab79bde service nova] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] Received event network-vif-unplugged-845cc40f-1b03-4b85-8d19-fea731fe7f89 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:04:22 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-4c1bb9d4-7477-49db-889d-cf50c6d50fae req-15465bab-931f-417c-9c6b-91d3eab79bde service nova] Acquiring lock "fbcca78c-fe73-4ef1-92f9-4c8061cad177-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:04:22 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-4c1bb9d4-7477-49db-889d-cf50c6d50fae req-15465bab-931f-417c-9c6b-91d3eab79bde service nova] Lock "fbcca78c-fe73-4ef1-92f9-4c8061cad177-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:04:22 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-4c1bb9d4-7477-49db-889d-cf50c6d50fae req-15465bab-931f-417c-9c6b-91d3eab79bde service nova] Lock "fbcca78c-fe73-4ef1-92f9-4c8061cad177-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:04:22 user nova-compute[71509]: DEBUG nova.compute.manager [req-4c1bb9d4-7477-49db-889d-cf50c6d50fae req-15465bab-931f-417c-9c6b-91d3eab79bde service nova] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] No waiting events found dispatching network-vif-unplugged-845cc40f-1b03-4b85-8d19-fea731fe7f89 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:04:22 user nova-compute[71509]: DEBUG nova.compute.manager [req-4c1bb9d4-7477-49db-889d-cf50c6d50fae req-15465bab-931f-417c-9c6b-91d3eab79bde service nova] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] Received event network-vif-unplugged-845cc40f-1b03-4b85-8d19-fea731fe7f89 for instance with task_state deleting. {{(pid=71509) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 11:04:22 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:04:22 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:04:22 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] Instance destroyed successfully.
Apr 14 11:04:22 user nova-compute[71509]: DEBUG nova.objects.instance [None req-4e6973c7-4f24-482a-9ca3-1c12ee71d54a tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lazy-loading 'resources' on Instance uuid fbcca78c-fe73-4ef1-92f9-4c8061cad177 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 11:04:22 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-4e6973c7-4f24-482a-9ca3-1c12ee71d54a tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T10:58:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1915851503',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1915851503',id=34,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T11:00:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='71289f80a05141f482cb538dac3d7b38',ramdisk_id='',reservation_id='r-n81abyyd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2130542140',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T11:02:36Z,user_data=None,user_id='395bc9d7007c4e01ac7effd418bcea19',uuid=fbcca78c-fe73-4ef1-92f9-4c8061cad177,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "845cc40f-1b03-4b85-8d19-fea731fe7f89", "address": "fa:16:3e:45:59:73", "network": {"id": "07f1f39e-292a-4e73-b4ed-99e5799d6fa8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1339551596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71289f80a05141f482cb538dac3d7b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap845cc40f-1b", "ovs_interfaceid": "845cc40f-1b03-4b85-8d19-fea731fe7f89", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 11:04:22 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-4e6973c7-4f24-482a-9ca3-1c12ee71d54a tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Converting VIF {"id": "845cc40f-1b03-4b85-8d19-fea731fe7f89", "address": "fa:16:3e:45:59:73", "network": {"id": "07f1f39e-292a-4e73-b4ed-99e5799d6fa8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1339551596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71289f80a05141f482cb538dac3d7b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap845cc40f-1b", "ovs_interfaceid": "845cc40f-1b03-4b85-8d19-fea731fe7f89", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 11:04:22 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-4e6973c7-4f24-482a-9ca3-1c12ee71d54a tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:45:59:73,bridge_name='br-int',has_traffic_filtering=True,id=845cc40f-1b03-4b85-8d19-fea731fe7f89,network=Network(07f1f39e-292a-4e73-b4ed-99e5799d6fa8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap845cc40f-1b') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 11:04:22 user nova-compute[71509]: DEBUG os_vif [None req-4e6973c7-4f24-482a-9ca3-1c12ee71d54a tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:45:59:73,bridge_name='br-int',has_traffic_filtering=True,id=845cc40f-1b03-4b85-8d19-fea731fe7f89,network=Network(07f1f39e-292a-4e73-b4ed-99e5799d6fa8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap845cc40f-1b') {{(pid=71509) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 11:04:22 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:04:22 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap845cc40f-1b, bridge=br-int, if_exists=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:04:22 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:04:22 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:04:22 user nova-compute[71509]: INFO os_vif [None req-4e6973c7-4f24-482a-9ca3-1c12ee71d54a tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:45:59:73,bridge_name='br-int',has_traffic_filtering=True,id=845cc40f-1b03-4b85-8d19-fea731fe7f89,network=Network(07f1f39e-292a-4e73-b4ed-99e5799d6fa8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap845cc40f-1b')
Apr 14 11:04:22 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e6973c7-4f24-482a-9ca3-1c12ee71d54a tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] calling os-brick to detach iSCSI Volume {{(pid=71509) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 11:04:22 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e6973c7-4f24-482a-9ca3-1c12ee71d54a tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0bf0749390>, {'target_iqn': 'iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xoNByDPq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 11:04:22 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-4e6973c7-4f24-482a-9ca3-1c12ee71d54a tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 11:04:22 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-4e6973c7-4f24-482a-9ca3-1c12ee71d54a tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 11:04:22 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-4e6973c7-4f24-482a-9ca3-1c12ee71d54a tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 11:04:22 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:04:22 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:04:22 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd8d17e9-e574-4893-8a2e-9a173ccdfbc7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0da1ed17-2b8c-4dd3-a61a-1133a9420d21\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:04:22 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e6973c7-4f24-482a-9ca3-1c12ee71d54a tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 11:04:22 user nova-compute[71509]: No targets found.
Apr 14 11:04:22 user nova-compute[71509]: iSNS:
Apr 14 11:04:22 user nova-compute[71509]: No targets found.
Apr 14 11:04:22 user nova-compute[71509]: STATIC:
Apr 14 11:04:22 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3
Apr 14 11:04:22 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 11:04:22 user nova-compute[71509]:                 Iface Name: default
Apr 14 11:04:22 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:0da1ed17-2b8c-4dd3-a61a-1133a9420d21
Apr 14 11:04:22 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 11:04:22 user nova-compute[71509]:                 Iface Name: default
Apr 14 11:04:22 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178
Apr 14 11:04:22 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 11:04:22 user nova-compute[71509]:                 Iface Name: default
Apr 14 11:04:22 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219
Apr 14 11:04:22 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 11:04:22 user nova-compute[71509]:                 Iface Name: default
Apr 14 11:04:22 user nova-compute[71509]: FIRMWARE:
Apr 14 11:04:22 user nova-compute[71509]: No targets found.
Apr 14 11:04:22 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 11:04:22 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e6973c7-4f24-482a-9ca3-1c12ee71d54a tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 11:04:22 user nova-compute[71509]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 11:04:22 user nova-compute[71509]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71509) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 11:04:22 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e6973c7-4f24-482a-9ca3-1c12ee71d54a tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219', 0)] {{(pid=71509) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 11:04:22 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:04:22 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:04:22 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[02ca42e9-e632-423b-a25a-c3ae01e3d88b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0da1ed17-2b8c-4dd3-a61a-1133a9420d21\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:04:22 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:04:22 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:04:22 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[1552cba4-f5f6-477f-918b-9345900df4a9]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0da1ed17-2b8c-4dd3-a61a-1133a9420d21 (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:04:22 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e6973c7-4f24-482a-9ca3-1c12ee71d54a tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)
Apr 14 11:04:22 user nova-compute[71509]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219 (non-flash)
Apr 14 11:04:22 user nova-compute[71509]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3 (non-flash)
Apr 14 11:04:22 user nova-compute[71509]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0da1ed17-2b8c-4dd3-a61a-1133a9420d21 (non-flash)
Apr 14 11:04:22 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 11:04:22 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e6973c7-4f24-482a-9ca3-1c12ee71d54a tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)
Apr 14 11:04:22 user nova-compute[71509]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219 (non-flash)
Apr 14 11:04:22 user nova-compute[71509]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3 (non-flash)
Apr 14 11:04:22 user nova-compute[71509]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0da1ed17-2b8c-4dd3-a61a-1133a9420d21 (non-flash)
Apr 14 11:04:22 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 11:04:22 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e6973c7-4f24-482a-9ca3-1c12ee71d54a tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0c14208820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219'): ({'sdb'}, set())}) {{(pid=71509) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 11:04:22 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-4e6973c7-4f24-482a-9ca3-1c12ee71d54a tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Removing single pathed devices sdb {{(pid=71509) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 11:04:22 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:04:22 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:04:22 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[32e10b30-bb73-4770-83f5-f032c39b0623]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:04:22 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:04:22 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:04:22 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c939f90-fc50-4447-8e48-79fc77747427]: (4, ('ok\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:04:22 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-4e6973c7-4f24-482a-9ca3-1c12ee71d54a tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Flushing IO for device /dev/sdb {{(pid=71509) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 11:04:22 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:04:22 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:04:22 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ba1a13e-c2c1-4e68-ac80-6ee603404720]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:04:22 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-4e6973c7-4f24-482a-9ca3-1c12ee71d54a tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71509) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 11:04:22 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:04:22 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:04:22 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4acce62-70dd-42a1-ae96-bacad3020ff0]: (4, ('1', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:04:22 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-4e6973c7-4f24-482a-9ca3-1c12ee71d54a tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71509) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 11:04:22 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-4e6973c7-4f24-482a-9ca3-1c12ee71d54a tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] SCSI volumes sdb have been removed. {{(pid=71509) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 11:04:22 user nova-compute[71509]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26338356463316566', '/dev/disk/by-id/scsi-1SCST_BIO62d5be7c-c85dc1efe48429e6', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_62d5be7c') {{(pid=82281) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 14 11:04:22 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[c89d6618-f554-4a8d-93c3-ef23dc6fefbe]: (4, None) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:04:22 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e6973c7-4f24-482a-9ca3-1c12ee71d54a tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219')] {{(pid=71509) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 11:04:22 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:04:22 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:04:22 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[835984bb-a489-4946-b7b8-3648129aab71]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:04:22 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e6973c7-4f24-482a-9ca3-1c12ee71d54a tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:04:22 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219 -p 172.16.0.220:3260 --logout {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:04:22 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:04:22 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d0a1f38-a186-4eb2-afe6-6d41e7d6f12b]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:04:22 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e6973c7-4f24-482a-9ca3-1c12ee71d54a tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219, portal: 172.16.0.220,3260]
Apr 14 11:04:22 user nova-compute[71509]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219, portal: 172.16.0.220,3260] successful.
Apr 14 11:04:22 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:04:22 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219 -p 172.16.0.220:3260 --op delete {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:04:22 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5accb380-f5d8-4a81-b266-df7390893219 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:04:22 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[cce07f41-c87c-404f-b693-1acf3266f418]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:04:22 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e6973c7-4f24-482a-9ca3-1c12ee71d54a tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:04:23 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-4e6973c7-4f24-482a-9ca3-1c12ee71d54a tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 11:04:23 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e6973c7-4f24-482a-9ca3-1c12ee71d54a tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] <== disconnect_volume: return (313ms) None {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 11:04:23 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e6973c7-4f24-482a-9ca3-1c12ee71d54a tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] Disconnected iSCSI Volume {{(pid=71509) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 11:04:23 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-4e6973c7-4f24-482a-9ca3-1c12ee71d54a tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] Deleting instance files /opt/stack/data/nova/instances/fbcca78c-fe73-4ef1-92f9-4c8061cad177_del
Apr 14 11:04:23 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-4e6973c7-4f24-482a-9ca3-1c12ee71d54a tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] Deletion of /opt/stack/data/nova/instances/fbcca78c-fe73-4ef1-92f9-4c8061cad177_del complete
Apr 14 11:04:23 user nova-compute[71509]: INFO nova.compute.manager [None req-4e6973c7-4f24-482a-9ca3-1c12ee71d54a tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] Took 1.19 seconds to destroy the instance on the hypervisor.
Apr 14 11:04:23 user nova-compute[71509]: DEBUG oslo.service.loopingcall [None req-4e6973c7-4f24-482a-9ca3-1c12ee71d54a tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71509) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 11:04:23 user nova-compute[71509]: DEBUG nova.compute.manager [-] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] Deallocating network for instance {{(pid=71509) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 11:04:23 user nova-compute[71509]: DEBUG nova.network.neutron [-] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] deallocate_for_instance() {{(pid=71509) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 11:04:23 user nova-compute[71509]: DEBUG nova.network.neutron [-] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] Updating instance_info_cache with network_info: [] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:04:23 user nova-compute[71509]: INFO nova.compute.manager [-] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] Took 0.59 seconds to deallocate network for instance.
Apr 14 11:04:24 user nova-compute[71509]: DEBUG nova.compute.manager [req-c9b7f1ca-d807-4bbe-854c-9ec0b317054c req-5943c720-f2dc-415c-aefa-1fc70ecee96c service nova] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] Received event network-vif-plugged-845cc40f-1b03-4b85-8d19-fea731fe7f89 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:04:24 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-c9b7f1ca-d807-4bbe-854c-9ec0b317054c req-5943c720-f2dc-415c-aefa-1fc70ecee96c service nova] Acquiring lock "fbcca78c-fe73-4ef1-92f9-4c8061cad177-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:04:24 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-c9b7f1ca-d807-4bbe-854c-9ec0b317054c req-5943c720-f2dc-415c-aefa-1fc70ecee96c service nova] Lock "fbcca78c-fe73-4ef1-92f9-4c8061cad177-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:04:24 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-c9b7f1ca-d807-4bbe-854c-9ec0b317054c req-5943c720-f2dc-415c-aefa-1fc70ecee96c service nova] Lock "fbcca78c-fe73-4ef1-92f9-4c8061cad177-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:04:24 user nova-compute[71509]: DEBUG nova.compute.manager [req-c9b7f1ca-d807-4bbe-854c-9ec0b317054c req-5943c720-f2dc-415c-aefa-1fc70ecee96c service nova] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] No waiting events found dispatching network-vif-plugged-845cc40f-1b03-4b85-8d19-fea731fe7f89 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:04:24 user nova-compute[71509]: WARNING nova.compute.manager [req-c9b7f1ca-d807-4bbe-854c-9ec0b317054c req-5943c720-f2dc-415c-aefa-1fc70ecee96c service nova] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] Received unexpected event network-vif-plugged-845cc40f-1b03-4b85-8d19-fea731fe7f89 for instance with vm_state active and task_state deleting.
Apr 14 11:04:24 user nova-compute[71509]: DEBUG nova.compute.manager [req-c9b7f1ca-d807-4bbe-854c-9ec0b317054c req-5943c720-f2dc-415c-aefa-1fc70ecee96c service nova] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] Received event network-vif-deleted-845cc40f-1b03-4b85-8d19-fea731fe7f89 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:04:24 user nova-compute[71509]: INFO nova.compute.manager [None req-4e6973c7-4f24-482a-9ca3-1c12ee71d54a tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] Took 1.07 seconds to detach 1 volumes for instance.
Apr 14 11:04:24 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-4e6973c7-4f24-482a-9ca3-1c12ee71d54a tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:04:24 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-4e6973c7-4f24-482a-9ca3-1c12ee71d54a tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:04:25 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-4e6973c7-4f24-482a-9ca3-1c12ee71d54a tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 11:04:25 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-4e6973c7-4f24-482a-9ca3-1c12ee71d54a tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 11:04:25 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-4e6973c7-4f24-482a-9ca3-1c12ee71d54a tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.264s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:04:25 user nova-compute[71509]: INFO nova.scheduler.client.report [None req-4e6973c7-4f24-482a-9ca3-1c12ee71d54a tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Deleted allocations for instance fbcca78c-fe73-4ef1-92f9-4c8061cad177
Apr 14 11:04:25 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-4e6973c7-4f24-482a-9ca3-1c12ee71d54a tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "fbcca78c-fe73-4ef1-92f9-4c8061cad177" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.287s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:04:27 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:04:28 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:04:32 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:04:33 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:04:34 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-987a5258-e017-4a5d-823b-4fd693101a8e tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "b96e2a1a-8c1b-4189-86b9-a3c1761a9813" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:04:34 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-987a5258-e017-4a5d-823b-4fd693101a8e tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "b96e2a1a-8c1b-4189-86b9-a3c1761a9813" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:04:34 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-987a5258-e017-4a5d-823b-4fd693101a8e tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "b96e2a1a-8c1b-4189-86b9-a3c1761a9813-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:04:34 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-987a5258-e017-4a5d-823b-4fd693101a8e tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "b96e2a1a-8c1b-4189-86b9-a3c1761a9813-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:04:34 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-987a5258-e017-4a5d-823b-4fd693101a8e tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "b96e2a1a-8c1b-4189-86b9-a3c1761a9813-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:04:34 user nova-compute[71509]: INFO nova.compute.manager [None req-987a5258-e017-4a5d-823b-4fd693101a8e tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: b96e2a1a-8c1b-4189-86b9-a3c1761a9813] Terminating instance
Apr 14 11:04:34 user nova-compute[71509]: DEBUG nova.compute.manager [None req-987a5258-e017-4a5d-823b-4fd693101a8e tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: b96e2a1a-8c1b-4189-86b9-a3c1761a9813] Start destroying the instance on the hypervisor. {{(pid=71509) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 11:04:34 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:04:34 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:04:34 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:04:34 user nova-compute[71509]: DEBUG nova.compute.manager [req-f3cc1828-296f-4a95-aa4d-80938969cd2c req-8b394876-4de7-41a4-bb3f-74fdcbd13ccc service nova] [instance: b96e2a1a-8c1b-4189-86b9-a3c1761a9813] Received event network-vif-unplugged-7ee72a8e-db85-4e30-91e5-193e21c386cd {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:04:34 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-f3cc1828-296f-4a95-aa4d-80938969cd2c req-8b394876-4de7-41a4-bb3f-74fdcbd13ccc service nova] Acquiring lock "b96e2a1a-8c1b-4189-86b9-a3c1761a9813-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:04:34 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-f3cc1828-296f-4a95-aa4d-80938969cd2c req-8b394876-4de7-41a4-bb3f-74fdcbd13ccc service nova] Lock "b96e2a1a-8c1b-4189-86b9-a3c1761a9813-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:04:34 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-f3cc1828-296f-4a95-aa4d-80938969cd2c req-8b394876-4de7-41a4-bb3f-74fdcbd13ccc service nova] Lock "b96e2a1a-8c1b-4189-86b9-a3c1761a9813-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:04:34 user nova-compute[71509]: DEBUG nova.compute.manager [req-f3cc1828-296f-4a95-aa4d-80938969cd2c req-8b394876-4de7-41a4-bb3f-74fdcbd13ccc service nova] [instance: b96e2a1a-8c1b-4189-86b9-a3c1761a9813] No waiting events found dispatching network-vif-unplugged-7ee72a8e-db85-4e30-91e5-193e21c386cd {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:04:34 user nova-compute[71509]: DEBUG nova.compute.manager [req-f3cc1828-296f-4a95-aa4d-80938969cd2c req-8b394876-4de7-41a4-bb3f-74fdcbd13ccc service nova] [instance: b96e2a1a-8c1b-4189-86b9-a3c1761a9813] Received event network-vif-unplugged-7ee72a8e-db85-4e30-91e5-193e21c386cd for instance with task_state deleting. {{(pid=71509) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 11:04:35 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: b96e2a1a-8c1b-4189-86b9-a3c1761a9813] Instance destroyed successfully.
Apr 14 11:04:35 user nova-compute[71509]: DEBUG nova.objects.instance [None req-987a5258-e017-4a5d-823b-4fd693101a8e tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lazy-loading 'resources' on Instance uuid b96e2a1a-8c1b-4189-86b9-a3c1761a9813 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 11:04:35 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-987a5258-e017-4a5d-823b-4fd693101a8e tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T11:01:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-391849424',display_name='tempest-AttachVolumeNegativeTest-server-391849424',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-391849424',id=39,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDUMt0cUlOh1dr6H24aOsI+tMVji84u3t7+LMjK6oGFZgRyd4eLIdFiX15GuGpnHHIIOHuFjVOsPnQ4vCH+2At3po6hk4ZhK8XpaMubuDoAKWSrrVyVLSqgOoqGX6zYnBA==',key_name='tempest-keypair-1834404942',keypairs=<?>,launch_index=0,launched_at=2023-04-14T11:01:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cb8f294f957f4c74ae959c1e9f238427',ramdisk_id='',reservation_id='r-db8u4052',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-531644967',owner_user_name='tempest-AttachVolumeNegativeTest-531644967-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T11:01:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='78adbbdcd10e446daddde754e46309b2',uuid=b96e2a1a-8c1b-4189-86b9-a3c1761a9813,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7ee72a8e-db85-4e30-91e5-193e21c386cd", "address": "fa:16:3e:b4:85:a8", "network": {"id": "b639a68a-2b4e-435c-b98b-65b5b4981c73", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1070821894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb8f294f957f4c74ae959c1e9f238427", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ee72a8e-db", "ovs_interfaceid": "7ee72a8e-db85-4e30-91e5-193e21c386cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 11:04:35 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-987a5258-e017-4a5d-823b-4fd693101a8e tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Converting VIF {"id": "7ee72a8e-db85-4e30-91e5-193e21c386cd", "address": "fa:16:3e:b4:85:a8", "network": {"id": "b639a68a-2b4e-435c-b98b-65b5b4981c73", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1070821894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb8f294f957f4c74ae959c1e9f238427", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ee72a8e-db", "ovs_interfaceid": "7ee72a8e-db85-4e30-91e5-193e21c386cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 11:04:35 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-987a5258-e017-4a5d-823b-4fd693101a8e tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b4:85:a8,bridge_name='br-int',has_traffic_filtering=True,id=7ee72a8e-db85-4e30-91e5-193e21c386cd,network=Network(b639a68a-2b4e-435c-b98b-65b5b4981c73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ee72a8e-db') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 11:04:35 user nova-compute[71509]: DEBUG os_vif [None req-987a5258-e017-4a5d-823b-4fd693101a8e tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b4:85:a8,bridge_name='br-int',has_traffic_filtering=True,id=7ee72a8e-db85-4e30-91e5-193e21c386cd,network=Network(b639a68a-2b4e-435c-b98b-65b5b4981c73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ee72a8e-db') {{(pid=71509) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 11:04:35 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:04:35 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7ee72a8e-db, bridge=br-int, if_exists=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:04:35 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:04:35 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:04:35 user nova-compute[71509]: INFO os_vif [None req-987a5258-e017-4a5d-823b-4fd693101a8e tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b4:85:a8,bridge_name='br-int',has_traffic_filtering=True,id=7ee72a8e-db85-4e30-91e5-193e21c386cd,network=Network(b639a68a-2b4e-435c-b98b-65b5b4981c73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ee72a8e-db')
Apr 14 11:04:35 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-987a5258-e017-4a5d-823b-4fd693101a8e tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: b96e2a1a-8c1b-4189-86b9-a3c1761a9813] Deleting instance files /opt/stack/data/nova/instances/b96e2a1a-8c1b-4189-86b9-a3c1761a9813_del
Apr 14 11:04:35 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-987a5258-e017-4a5d-823b-4fd693101a8e tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: b96e2a1a-8c1b-4189-86b9-a3c1761a9813] Deletion of /opt/stack/data/nova/instances/b96e2a1a-8c1b-4189-86b9-a3c1761a9813_del complete
Apr 14 11:04:35 user nova-compute[71509]: INFO nova.compute.manager [None req-987a5258-e017-4a5d-823b-4fd693101a8e tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] [instance: b96e2a1a-8c1b-4189-86b9-a3c1761a9813] Took 1.19 seconds to destroy the instance on the hypervisor.
Apr 14 11:04:35 user nova-compute[71509]: DEBUG oslo.service.loopingcall [None req-987a5258-e017-4a5d-823b-4fd693101a8e tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71509) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 11:04:35 user nova-compute[71509]: DEBUG nova.compute.manager [-] [instance: b96e2a1a-8c1b-4189-86b9-a3c1761a9813] Deallocating network for instance {{(pid=71509) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 11:04:35 user nova-compute[71509]: DEBUG nova.network.neutron [-] [instance: b96e2a1a-8c1b-4189-86b9-a3c1761a9813] deallocate_for_instance() {{(pid=71509) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 11:04:36 user nova-compute[71509]: DEBUG nova.network.neutron [-] [instance: b96e2a1a-8c1b-4189-86b9-a3c1761a9813] Updating instance_info_cache with network_info: [] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:04:36 user nova-compute[71509]: INFO nova.compute.manager [-] [instance: b96e2a1a-8c1b-4189-86b9-a3c1761a9813] Took 1.00 seconds to deallocate network for instance.
Apr 14 11:04:36 user nova-compute[71509]: DEBUG nova.compute.manager [req-016b092b-4d05-43c9-9ea3-f27e9c9a0870 req-ea67f58e-3eca-41cf-b73a-be81053def47 service nova] [instance: b96e2a1a-8c1b-4189-86b9-a3c1761a9813] Received event network-vif-deleted-7ee72a8e-db85-4e30-91e5-193e21c386cd {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:04:36 user nova-compute[71509]: INFO nova.compute.manager [req-016b092b-4d05-43c9-9ea3-f27e9c9a0870 req-ea67f58e-3eca-41cf-b73a-be81053def47 service nova] [instance: b96e2a1a-8c1b-4189-86b9-a3c1761a9813] Neutron deleted interface 7ee72a8e-db85-4e30-91e5-193e21c386cd; detaching it from the instance and deleting it from the info cache
Apr 14 11:04:36 user nova-compute[71509]: DEBUG nova.network.neutron [req-016b092b-4d05-43c9-9ea3-f27e9c9a0870 req-ea67f58e-3eca-41cf-b73a-be81053def47 service nova] [instance: b96e2a1a-8c1b-4189-86b9-a3c1761a9813] Updating instance_info_cache with network_info: [] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:04:36 user nova-compute[71509]: DEBUG nova.compute.manager [req-016b092b-4d05-43c9-9ea3-f27e9c9a0870 req-ea67f58e-3eca-41cf-b73a-be81053def47 service nova] [instance: b96e2a1a-8c1b-4189-86b9-a3c1761a9813] Detach interface failed, port_id=7ee72a8e-db85-4e30-91e5-193e21c386cd, reason: Instance b96e2a1a-8c1b-4189-86b9-a3c1761a9813 could not be found. {{(pid=71509) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 11:04:36 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-987a5258-e017-4a5d-823b-4fd693101a8e tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:04:36 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-987a5258-e017-4a5d-823b-4fd693101a8e tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:04:36 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-987a5258-e017-4a5d-823b-4fd693101a8e tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 11:04:36 user nova-compute[71509]: DEBUG nova.compute.manager [req-a66a4642-d8d0-4688-8628-abbf9f09b42f req-eac95707-4f5d-4544-8622-9be22cc5f441 service nova] [instance: b96e2a1a-8c1b-4189-86b9-a3c1761a9813] Received event network-vif-plugged-7ee72a8e-db85-4e30-91e5-193e21c386cd {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:04:36 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-a66a4642-d8d0-4688-8628-abbf9f09b42f req-eac95707-4f5d-4544-8622-9be22cc5f441 service nova] Acquiring lock "b96e2a1a-8c1b-4189-86b9-a3c1761a9813-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:04:36 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-a66a4642-d8d0-4688-8628-abbf9f09b42f req-eac95707-4f5d-4544-8622-9be22cc5f441 service nova] Lock "b96e2a1a-8c1b-4189-86b9-a3c1761a9813-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:04:36 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-a66a4642-d8d0-4688-8628-abbf9f09b42f req-eac95707-4f5d-4544-8622-9be22cc5f441 service nova] Lock "b96e2a1a-8c1b-4189-86b9-a3c1761a9813-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:04:36 user nova-compute[71509]: DEBUG nova.compute.manager [req-a66a4642-d8d0-4688-8628-abbf9f09b42f req-eac95707-4f5d-4544-8622-9be22cc5f441 service nova] [instance: b96e2a1a-8c1b-4189-86b9-a3c1761a9813] No waiting events found dispatching network-vif-plugged-7ee72a8e-db85-4e30-91e5-193e21c386cd {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:04:36 user nova-compute[71509]: WARNING nova.compute.manager [req-a66a4642-d8d0-4688-8628-abbf9f09b42f req-eac95707-4f5d-4544-8622-9be22cc5f441 service nova] [instance: b96e2a1a-8c1b-4189-86b9-a3c1761a9813] Received unexpected event network-vif-plugged-7ee72a8e-db85-4e30-91e5-193e21c386cd for instance with vm_state deleted and task_state None.
Apr 14 11:04:36 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-987a5258-e017-4a5d-823b-4fd693101a8e tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 11:04:36 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-987a5258-e017-4a5d-823b-4fd693101a8e tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.291s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:04:37 user nova-compute[71509]: INFO nova.scheduler.client.report [None req-987a5258-e017-4a5d-823b-4fd693101a8e tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Deleted allocations for instance b96e2a1a-8c1b-4189-86b9-a3c1761a9813
Apr 14 11:04:37 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-987a5258-e017-4a5d-823b-4fd693101a8e tempest-AttachVolumeNegativeTest-531644967 tempest-AttachVolumeNegativeTest-531644967-project-member] Lock "b96e2a1a-8c1b-4189-86b9-a3c1761a9813" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.711s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:04:37 user nova-compute[71509]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681470262.6445003, fbcca78c-fe73-4ef1-92f9-4c8061cad177 => Stopped> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 11:04:37 user nova-compute[71509]: INFO nova.compute.manager [-] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] VM Stopped (Lifecycle Event)
Apr 14 11:04:37 user nova-compute[71509]: DEBUG nova.compute.manager [None req-4da41cd2-2436-4c70-b6c2-9e67b686d000 None None] [instance: fbcca78c-fe73-4ef1-92f9-4c8061cad177] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 11:04:38 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:04:40 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:04:43 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:04:44 user nova-compute[71509]: INFO nova.compute.manager [None req-31dc092e-0bc7-43d1-9f75-70380041148d tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] Get console output
Apr 14 11:04:44 user nova-compute[71509]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Apr 14 11:04:45 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:04:47 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:04:47 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:04:47 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:04:47 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71509) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 11:04:47 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:04:48 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:04:50 user nova-compute[71509]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681470275.244147, b96e2a1a-8c1b-4189-86b9-a3c1761a9813 => Stopped> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 11:04:50 user nova-compute[71509]: INFO nova.compute.manager [-] [instance: b96e2a1a-8c1b-4189-86b9-a3c1761a9813] VM Stopped (Lifecycle Event)
Apr 14 11:04:50 user nova-compute[71509]: DEBUG nova.compute.manager [None req-b24f4ba3-49d2-439a-a221-198f5fd8e872 None None] [instance: b96e2a1a-8c1b-4189-86b9-a3c1761a9813] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 11:04:50 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:04:52 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:04:53 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:04:54 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:04:55 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:04:55 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:04:55 user nova-compute[71509]: DEBUG nova.compute.manager [req-277d0a7b-a95a-4a9d-804e-c3f1a60536a1 req-577857d9-b879-46bd-a269-95ad2f2d1057 service nova] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Received event network-changed-f41f6957-bf6d-47bf-bb71-638137929e1e {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:04:55 user nova-compute[71509]: DEBUG nova.compute.manager [req-277d0a7b-a95a-4a9d-804e-c3f1a60536a1 req-577857d9-b879-46bd-a269-95ad2f2d1057 service nova] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Refreshing instance network info cache due to event network-changed-f41f6957-bf6d-47bf-bb71-638137929e1e. {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 11:04:55 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-277d0a7b-a95a-4a9d-804e-c3f1a60536a1 req-577857d9-b879-46bd-a269-95ad2f2d1057 service nova] Acquiring lock "refresh_cache-9c4cc2a1-0c54-4f20-b33f-9085af7b10a3" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 11:04:55 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-277d0a7b-a95a-4a9d-804e-c3f1a60536a1 req-577857d9-b879-46bd-a269-95ad2f2d1057 service nova] Acquired lock "refresh_cache-9c4cc2a1-0c54-4f20-b33f-9085af7b10a3" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 11:04:55 user nova-compute[71509]: DEBUG nova.network.neutron [req-277d0a7b-a95a-4a9d-804e-c3f1a60536a1 req-577857d9-b879-46bd-a269-95ad2f2d1057 service nova] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Refreshing network info cache for port f41f6957-bf6d-47bf-bb71-638137929e1e {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 11:04:56 user nova-compute[71509]: DEBUG nova.network.neutron [req-277d0a7b-a95a-4a9d-804e-c3f1a60536a1 req-577857d9-b879-46bd-a269-95ad2f2d1057 service nova] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Updated VIF entry in instance network info cache for port f41f6957-bf6d-47bf-bb71-638137929e1e. {{(pid=71509) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 11:04:56 user nova-compute[71509]: DEBUG nova.network.neutron [req-277d0a7b-a95a-4a9d-804e-c3f1a60536a1 req-577857d9-b879-46bd-a269-95ad2f2d1057 service nova] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Updating instance_info_cache with network_info: [{"id": "f41f6957-bf6d-47bf-bb71-638137929e1e", "address": "fa:16:3e:ca:60:62", "network": {"id": "d59680e7-ed50-4356-b665-ec64ff939708", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-598238133-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5809862340a84c83a772c65c77513608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf41f6957-bf", "ovs_interfaceid": "f41f6957-bf6d-47bf-bb71-638137929e1e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:04:56 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-277d0a7b-a95a-4a9d-804e-c3f1a60536a1 req-577857d9-b879-46bd-a269-95ad2f2d1057 service nova] Releasing lock "refresh_cache-9c4cc2a1-0c54-4f20-b33f-9085af7b10a3" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 11:04:56 user nova-compute[71509]: DEBUG nova.compute.manager [req-7fa38689-45bd-4df7-bceb-8d4905f6d352 req-c7d7c28c-a089-4123-9343-c7560dfb3c39 service nova] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Received event network-changed-f41f6957-bf6d-47bf-bb71-638137929e1e {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:04:56 user nova-compute[71509]: DEBUG nova.compute.manager [req-7fa38689-45bd-4df7-bceb-8d4905f6d352 req-c7d7c28c-a089-4123-9343-c7560dfb3c39 service nova] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Refreshing instance network info cache due to event network-changed-f41f6957-bf6d-47bf-bb71-638137929e1e. {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 11:04:56 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-7fa38689-45bd-4df7-bceb-8d4905f6d352 req-c7d7c28c-a089-4123-9343-c7560dfb3c39 service nova] Acquiring lock "refresh_cache-9c4cc2a1-0c54-4f20-b33f-9085af7b10a3" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 11:04:56 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-7fa38689-45bd-4df7-bceb-8d4905f6d352 req-c7d7c28c-a089-4123-9343-c7560dfb3c39 service nova] Acquired lock "refresh_cache-9c4cc2a1-0c54-4f20-b33f-9085af7b10a3" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 11:04:56 user nova-compute[71509]: DEBUG nova.network.neutron [req-7fa38689-45bd-4df7-bceb-8d4905f6d352 req-c7d7c28c-a089-4123-9343-c7560dfb3c39 service nova] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Refreshing network info cache for port f41f6957-bf6d-47bf-bb71-638137929e1e {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 11:04:56 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:04:56 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:04:56 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:04:56 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:04:56 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Auditing locally available compute resources for user (node: user) {{(pid=71509) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 11:04:56 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c4cc2a1-0c54-4f20-b33f-9085af7b10a3/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:04:56 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-d1efc1be-8d56-4923-99cd-3e0f34d93e52 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Acquiring lock "9c4cc2a1-0c54-4f20-b33f-9085af7b10a3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:04:56 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-d1efc1be-8d56-4923-99cd-3e0f34d93e52 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "9c4cc2a1-0c54-4f20-b33f-9085af7b10a3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:04:56 user nova-compute[71509]: INFO nova.compute.manager [None req-d1efc1be-8d56-4923-99cd-3e0f34d93e52 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Detaching volume 0da1ed17-2b8c-4dd3-a61a-1133a9420d21
Apr 14 11:04:56 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c4cc2a1-0c54-4f20-b33f-9085af7b10a3/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:04:56 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c4cc2a1-0c54-4f20-b33f-9085af7b10a3/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:04:56 user nova-compute[71509]: INFO nova.virt.block_device [None req-d1efc1be-8d56-4923-99cd-3e0f34d93e52 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Attempting to driver detach volume 0da1ed17-2b8c-4dd3-a61a-1133a9420d21 from mountpoint /dev/vdb
Apr 14 11:04:56 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-d1efc1be-8d56-4923-99cd-3e0f34d93e52 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Attempting to detach device vdb from instance 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3 from the persistent domain config. {{(pid=71509) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 11:04:56 user nova-compute[71509]: DEBUG nova.virt.libvirt.guest [None req-d1efc1be-8d56-4923-99cd-3e0f34d93e52 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 11:04:56 user nova-compute[71509]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 11:04:56 user nova-compute[71509]:   <source dev="/dev/sde"/>
Apr 14 11:04:56 user nova-compute[71509]:   <target dev="vdb" bus="virtio"/>
Apr 14 11:04:56 user nova-compute[71509]:   <serial>0da1ed17-2b8c-4dd3-a61a-1133a9420d21</serial>
Apr 14 11:04:56 user nova-compute[71509]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 14 11:04:56 user nova-compute[71509]: </disk>
Apr 14 11:04:56 user nova-compute[71509]:  {{(pid=71509) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 11:04:56 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-d1efc1be-8d56-4923-99cd-3e0f34d93e52 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Successfully detached device vdb from instance 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3 from the persistent domain config.
Apr 14 11:04:56 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-d1efc1be-8d56-4923-99cd-3e0f34d93e52 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3 from the live domain config. {{(pid=71509) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 11:04:56 user nova-compute[71509]: DEBUG nova.virt.libvirt.guest [None req-d1efc1be-8d56-4923-99cd-3e0f34d93e52 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 11:04:56 user nova-compute[71509]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 11:04:56 user nova-compute[71509]:   <source dev="/dev/sde"/>
Apr 14 11:04:56 user nova-compute[71509]:   <target dev="vdb" bus="virtio"/>
Apr 14 11:04:56 user nova-compute[71509]:   <serial>0da1ed17-2b8c-4dd3-a61a-1133a9420d21</serial>
Apr 14 11:04:56 user nova-compute[71509]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Apr 14 11:04:56 user nova-compute[71509]: </disk>
Apr 14 11:04:56 user nova-compute[71509]:  {{(pid=71509) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 11:04:56 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c4cc2a1-0c54-4f20-b33f-9085af7b10a3/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:04:56 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=71509) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 11:04:56 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e479154a-acd6-47aa-9a5b-43c6e0feda07/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:04:56 user nova-compute[71509]: DEBUG nova.network.neutron [req-7fa38689-45bd-4df7-bceb-8d4905f6d352 req-c7d7c28c-a089-4123-9343-c7560dfb3c39 service nova] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Updated VIF entry in instance network info cache for port f41f6957-bf6d-47bf-bb71-638137929e1e. {{(pid=71509) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 11:04:57 user nova-compute[71509]: DEBUG nova.network.neutron [req-7fa38689-45bd-4df7-bceb-8d4905f6d352 req-c7d7c28c-a089-4123-9343-c7560dfb3c39 service nova] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Updating instance_info_cache with network_info: [{"id": "f41f6957-bf6d-47bf-bb71-638137929e1e", "address": "fa:16:3e:ca:60:62", "network": {"id": "d59680e7-ed50-4356-b665-ec64ff939708", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-598238133-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5809862340a84c83a772c65c77513608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf41f6957-bf", "ovs_interfaceid": "f41f6957-bf6d-47bf-bb71-638137929e1e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:04:57 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-7fa38689-45bd-4df7-bceb-8d4905f6d352 req-c7d7c28c-a089-4123-9343-c7560dfb3c39 service nova] Releasing lock "refresh_cache-9c4cc2a1-0c54-4f20-b33f-9085af7b10a3" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 11:04:57 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e479154a-acd6-47aa-9a5b-43c6e0feda07/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:04:57 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e479154a-acd6-47aa-9a5b-43c6e0feda07/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:04:57 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e479154a-acd6-47aa-9a5b-43c6e0feda07/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:04:57 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/269aa265-9398-4692-8ab4-f3bf5be82714/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:04:57 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Received event <DeviceRemovedEvent: 1681470297.378897, 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71509) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 11:04:57 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-d1efc1be-8d56-4923-99cd-3e0f34d93e52 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3 {{(pid=71509) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 11:04:57 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-d1efc1be-8d56-4923-99cd-3e0f34d93e52 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Successfully detached device vdb from instance 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3 from the live domain config.
Apr 14 11:04:57 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1efc1be-8d56-4923-99cd-3e0f34d93e52 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] calling os-brick to detach iSCSI Volume {{(pid=71509) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 11:04:57 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1efc1be-8d56-4923-99cd-3e0f34d93e52 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0bf0749390>, {'target_iqn': 'iqn.2010-10.org.openstack:0da1ed17-2b8c-4dd3-a61a-1133a9420d21', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UNHnOXfL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde': {}}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 11:04:57 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-d1efc1be-8d56-4923-99cd-3e0f34d93e52 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 11:04:57 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-d1efc1be-8d56-4923-99cd-3e0f34d93e52 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 11:04:57 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-d1efc1be-8d56-4923-99cd-3e0f34d93e52 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 11:04:57 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:04:57 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/269aa265-9398-4692-8ab4-f3bf5be82714/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:04:57 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/269aa265-9398-4692-8ab4-f3bf5be82714/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:04:57 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:04:57 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[30af44e3-9dfe-4af2-82ae-e3b1dab99cfa]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0da1ed17-2b8c-4dd3-a61a-1133a9420d21\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:04:57 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1efc1be-8d56-4923-99cd-3e0f34d93e52 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 11:04:57 user nova-compute[71509]: No targets found.
Apr 14 11:04:57 user nova-compute[71509]: iSNS:
Apr 14 11:04:57 user nova-compute[71509]: No targets found.
Apr 14 11:04:57 user nova-compute[71509]: STATIC:
Apr 14 11:04:57 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3
Apr 14 11:04:57 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 11:04:57 user nova-compute[71509]:                 Iface Name: default
Apr 14 11:04:57 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:0da1ed17-2b8c-4dd3-a61a-1133a9420d21
Apr 14 11:04:57 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 11:04:57 user nova-compute[71509]:                 Iface Name: default
Apr 14 11:04:57 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178
Apr 14 11:04:57 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 11:04:57 user nova-compute[71509]:                 Iface Name: default
Apr 14 11:04:57 user nova-compute[71509]: FIRMWARE:
Apr 14 11:04:57 user nova-compute[71509]: No targets found.
Apr 14 11:04:57 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 11:04:57 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1efc1be-8d56-4923-99cd-3e0f34d93e52 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 11:04:57 user nova-compute[71509]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 11:04:57 user nova-compute[71509]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71509) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 11:04:57 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1efc1be-8d56-4923-99cd-3e0f34d93e52 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0da1ed17-2b8c-4dd3-a61a-1133a9420d21', 0)] {{(pid=71509) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 11:04:57 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:04:57 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:04:57 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c810f1b-3059-445b-aabc-d7ad818f46fe]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0da1ed17-2b8c-4dd3-a61a-1133a9420d21\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:04:57 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:04:57 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:04:57 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[22c096f1-1c50-426a-a568-53d003fa2ae0]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0da1ed17-2b8c-4dd3-a61a-1133a9420d21 (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:04:57 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1efc1be-8d56-4923-99cd-3e0f34d93e52 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)
Apr 14 11:04:57 user nova-compute[71509]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3 (non-flash)
Apr 14 11:04:57 user nova-compute[71509]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0da1ed17-2b8c-4dd3-a61a-1133a9420d21 (non-flash)
Apr 14 11:04:57 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 11:04:57 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1efc1be-8d56-4923-99cd-3e0f34d93e52 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)
Apr 14 11:04:57 user nova-compute[71509]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3 (non-flash)
Apr 14 11:04:57 user nova-compute[71509]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0da1ed17-2b8c-4dd3-a61a-1133a9420d21 (non-flash)
Apr 14 11:04:57 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 11:04:57 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1efc1be-8d56-4923-99cd-3e0f34d93e52 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0c141c35b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0da1ed17-2b8c-4dd3-a61a-1133a9420d21'): ({'sde'}, set())}) {{(pid=71509) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 11:04:57 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-d1efc1be-8d56-4923-99cd-3e0f34d93e52 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Removing single pathed devices sde {{(pid=71509) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 11:04:57 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:04:57 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:04:57 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc81d648-4b60-440b-8b11-3d294cf1d0cd]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:04:57 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:04:57 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:04:57 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[faecb5da-4dd7-4588-8ddd-96deb3c9acd8]: (4, ('ok\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:04:57 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-d1efc1be-8d56-4923-99cd-3e0f34d93e52 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Flushing IO for device /dev/sde {{(pid=71509) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 11:04:57 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:04:57 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:04:57 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[a441c56e-1612-40f3-b74c-21f9b8038669]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:04:57 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/269aa265-9398-4692-8ab4-f3bf5be82714/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:04:57 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-d1efc1be-8d56-4923-99cd-3e0f34d93e52 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=71509) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 11:04:57 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:04:57 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71509) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 11:04:57 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a936fb20-3f17-4114-829a-8659da6bc5f3/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:04:57 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.053s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:04:57 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b5aafbd-9c0c-4e3e-87cb-ec2e3810f844]: (4, ('1', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:04:57 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-d1efc1be-8d56-4923-99cd-3e0f34d93e52 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=71509) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 11:04:57 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-d1efc1be-8d56-4923-99cd-3e0f34d93e52 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] SCSI volumes sde have been removed. {{(pid=71509) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 11:04:57 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1efc1be-8d56-4923-99cd-3e0f34d93e52 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0da1ed17-2b8c-4dd3-a61a-1133a9420d21')] {{(pid=71509) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 11:04:57 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0da1ed17-2b8c-4dd3-a61a-1133a9420d21 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:04:57 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0da1ed17-2b8c-4dd3-a61a-1133a9420d21 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:04:57 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a8f2b84-69e9-45c5-b070-568d323ff61f]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:04:57 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1efc1be-8d56-4923-99cd-3e0f34d93e52 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:04:57 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0da1ed17-2b8c-4dd3-a61a-1133a9420d21 -p 172.16.0.220:3260 --logout {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:04:57 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a936fb20-3f17-4114-829a-8659da6bc5f3/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:04:57 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a936fb20-3f17-4114-829a-8659da6bc5f3/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:04:57 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0da1ed17-2b8c-4dd3-a61a-1133a9420d21 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:04:57 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[853fb855-3282-4b78-890f-ab9fee242630]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:0da1ed17-2b8c-4dd3-a61a-1133a9420d21, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:0da1ed17-2b8c-4dd3-a61a-1133a9420d21, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:04:57 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1efc1be-8d56-4923-99cd-3e0f34d93e52 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:0da1ed17-2b8c-4dd3-a61a-1133a9420d21, portal: 172.16.0.220,3260]
Apr 14 11:04:57 user nova-compute[71509]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:0da1ed17-2b8c-4dd3-a61a-1133a9420d21, portal: 172.16.0.220,3260] successful.
Apr 14 11:04:57 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:04:57 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0da1ed17-2b8c-4dd3-a61a-1133a9420d21 -p 172.16.0.220:3260 --op delete {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:04:57 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0da1ed17-2b8c-4dd3-a61a-1133a9420d21 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:04:57 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f3a3a1d-08b8-47ca-9d9a-d36ea3a5080d]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:04:57 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1efc1be-8d56-4923-99cd-3e0f34d93e52 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:04:57 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-d1efc1be-8d56-4923-99cd-3e0f34d93e52 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.399s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 11:04:57 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1efc1be-8d56-4923-99cd-3e0f34d93e52 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] <== disconnect_volume: return (401ms) None {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 11:04:57 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1efc1be-8d56-4923-99cd-3e0f34d93e52 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Disconnected iSCSI Volume {{(pid=71509) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 11:04:57 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a936fb20-3f17-4114-829a-8659da6bc5f3/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:04:57 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dd9e11f-1fed-42af-ad5c-9cdd051b93e7/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:04:58 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dd9e11f-1fed-42af-ad5c-9cdd051b93e7/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:04:58 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dd9e11f-1fed-42af-ad5c-9cdd051b93e7/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:04:58 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dd9e11f-1fed-42af-ad5c-9cdd051b93e7/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:04:58 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71509) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 11:04:58 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:04:58 user nova-compute[71509]: DEBUG nova.objects.instance [None req-d1efc1be-8d56-4923-99cd-3e0f34d93e52 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lazy-loading 'flavor' on Instance uuid 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 11:04:58 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 11:04:58 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 11:04:58 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Hypervisor/Node resource view: name=user free_ram=8052MB free_disk=25.791362762451172GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71509) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 11:04:58 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:04:58 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:04:58 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-d1efc1be-8d56-4923-99cd-3e0f34d93e52 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "9c4cc2a1-0c54-4f20-b33f-9085af7b10a3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.063s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:04:58 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance e479154a-acd6-47aa-9a5b-43c6e0feda07 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 11:04:58 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 6cae9f61-763f-4671-a873-d15f01384416 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 11:04:58 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance a936fb20-3f17-4114-829a-8659da6bc5f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 11:04:58 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 0dd9e11f-1fed-42af-ad5c-9cdd051b93e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 11:04:58 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 11:04:58 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 3db2e71c-939b-4d2f-b1be-c2122f7cd73e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 11:04:58 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 269aa265-9398-4692-8ab4-f3bf5be82714 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 11:04:58 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=71509) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 11:04:58 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Final resource view: name=user phys_ram=16023MB used_ram=1472MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=71509) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 11:04:59 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 11:04:59 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 11:04:59 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Compute_service record updated for user:user {{(pid=71509) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 11:04:59 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.364s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:05:00 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:05:01 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:05:01 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Starting heal instance info cache {{(pid=71509) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 11:05:01 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "refresh_cache-a936fb20-3f17-4114-829a-8659da6bc5f3" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 11:05:01 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquired lock "refresh_cache-a936fb20-3f17-4114-829a-8659da6bc5f3" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 11:05:01 user nova-compute[71509]: DEBUG nova.network.neutron [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] [instance: a936fb20-3f17-4114-829a-8659da6bc5f3] Forcefully refreshing network info cache for instance {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 11:05:02 user nova-compute[71509]: DEBUG nova.network.neutron [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] [instance: a936fb20-3f17-4114-829a-8659da6bc5f3] Updating instance_info_cache with network_info: [{"id": "472fc537-2bff-4ebb-bfb7-f7973f9f8b81", "address": "fa:16:3e:3d:95:64", "network": {"id": "07f1f39e-292a-4e73-b4ed-99e5799d6fa8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1339551596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71289f80a05141f482cb538dac3d7b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap472fc537-2b", "ovs_interfaceid": "472fc537-2bff-4ebb-bfb7-f7973f9f8b81", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:05:02 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Releasing lock "refresh_cache-a936fb20-3f17-4114-829a-8659da6bc5f3" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 11:05:02 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] [instance: a936fb20-3f17-4114-829a-8659da6bc5f3] Updated the network info_cache for instance {{(pid=71509) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 11:05:03 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:05:05 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:05:10 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:05:12 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-ceb356ae-06a7-4773-b435-8eef5d44e6e8 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Acquiring lock "a936fb20-3f17-4114-829a-8659da6bc5f3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:05:12 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-ceb356ae-06a7-4773-b435-8eef5d44e6e8 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "a936fb20-3f17-4114-829a-8659da6bc5f3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:05:12 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-ceb356ae-06a7-4773-b435-8eef5d44e6e8 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Acquiring lock "a936fb20-3f17-4114-829a-8659da6bc5f3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:05:12 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-ceb356ae-06a7-4773-b435-8eef5d44e6e8 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "a936fb20-3f17-4114-829a-8659da6bc5f3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:05:12 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-ceb356ae-06a7-4773-b435-8eef5d44e6e8 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "a936fb20-3f17-4114-829a-8659da6bc5f3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:05:12 user nova-compute[71509]: INFO nova.compute.manager [None req-ceb356ae-06a7-4773-b435-8eef5d44e6e8 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: a936fb20-3f17-4114-829a-8659da6bc5f3] Terminating instance
Apr 14 11:05:12 user nova-compute[71509]: DEBUG nova.compute.manager [None req-ceb356ae-06a7-4773-b435-8eef5d44e6e8 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: a936fb20-3f17-4114-829a-8659da6bc5f3] Start destroying the instance on the hypervisor. {{(pid=71509) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 11:05:12 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:05:12 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:05:12 user nova-compute[71509]: DEBUG nova.compute.manager [req-68ea8e85-d528-4554-b639-4b2cd13368f5 req-6b107b6f-61df-4f48-84c6-a31077f36e0b service nova] [instance: a936fb20-3f17-4114-829a-8659da6bc5f3] Received event network-vif-unplugged-472fc537-2bff-4ebb-bfb7-f7973f9f8b81 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:05:12 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-68ea8e85-d528-4554-b639-4b2cd13368f5 req-6b107b6f-61df-4f48-84c6-a31077f36e0b service nova] Acquiring lock "a936fb20-3f17-4114-829a-8659da6bc5f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:05:12 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-68ea8e85-d528-4554-b639-4b2cd13368f5 req-6b107b6f-61df-4f48-84c6-a31077f36e0b service nova] Lock "a936fb20-3f17-4114-829a-8659da6bc5f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:05:12 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-68ea8e85-d528-4554-b639-4b2cd13368f5 req-6b107b6f-61df-4f48-84c6-a31077f36e0b service nova] Lock "a936fb20-3f17-4114-829a-8659da6bc5f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:05:12 user nova-compute[71509]: DEBUG nova.compute.manager [req-68ea8e85-d528-4554-b639-4b2cd13368f5 req-6b107b6f-61df-4f48-84c6-a31077f36e0b service nova] [instance: a936fb20-3f17-4114-829a-8659da6bc5f3] No waiting events found dispatching network-vif-unplugged-472fc537-2bff-4ebb-bfb7-f7973f9f8b81 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:05:12 user nova-compute[71509]: DEBUG nova.compute.manager [req-68ea8e85-d528-4554-b639-4b2cd13368f5 req-6b107b6f-61df-4f48-84c6-a31077f36e0b service nova] [instance: a936fb20-3f17-4114-829a-8659da6bc5f3] Received event network-vif-unplugged-472fc537-2bff-4ebb-bfb7-f7973f9f8b81 for instance with task_state deleting. {{(pid=71509) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 11:05:12 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:05:12 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:05:13 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: a936fb20-3f17-4114-829a-8659da6bc5f3] Instance destroyed successfully.
Apr 14 11:05:13 user nova-compute[71509]: DEBUG nova.objects.instance [None req-ceb356ae-06a7-4773-b435-8eef5d44e6e8 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lazy-loading 'resources' on Instance uuid a936fb20-3f17-4114-829a-8659da6bc5f3 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 11:05:13 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-ceb356ae-06a7-4773-b435-8eef5d44e6e8 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T10:55:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-116763620',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-116763620',id=28,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T10:55:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='71289f80a05141f482cb538dac3d7b38',ramdisk_id='',reservation_id='r-051u8j4l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2130542140',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T10:57:48Z,user_data=None,user_id='395bc9d7007c4e01ac7effd418bcea19',uuid=a936fb20-3f17-4114-829a-8659da6bc5f3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "472fc537-2bff-4ebb-bfb7-f7973f9f8b81", "address": "fa:16:3e:3d:95:64", "network": {"id": "07f1f39e-292a-4e73-b4ed-99e5799d6fa8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1339551596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71289f80a05141f482cb538dac3d7b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap472fc537-2b", "ovs_interfaceid": "472fc537-2bff-4ebb-bfb7-f7973f9f8b81", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 11:05:13 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-ceb356ae-06a7-4773-b435-8eef5d44e6e8 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Converting VIF {"id": "472fc537-2bff-4ebb-bfb7-f7973f9f8b81", "address": "fa:16:3e:3d:95:64", "network": {"id": "07f1f39e-292a-4e73-b4ed-99e5799d6fa8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1339551596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71289f80a05141f482cb538dac3d7b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap472fc537-2b", "ovs_interfaceid": "472fc537-2bff-4ebb-bfb7-f7973f9f8b81", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 11:05:13 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-ceb356ae-06a7-4773-b435-8eef5d44e6e8 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3d:95:64,bridge_name='br-int',has_traffic_filtering=True,id=472fc537-2bff-4ebb-bfb7-f7973f9f8b81,network=Network(07f1f39e-292a-4e73-b4ed-99e5799d6fa8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap472fc537-2b') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 11:05:13 user nova-compute[71509]: DEBUG os_vif [None req-ceb356ae-06a7-4773-b435-8eef5d44e6e8 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3d:95:64,bridge_name='br-int',has_traffic_filtering=True,id=472fc537-2bff-4ebb-bfb7-f7973f9f8b81,network=Network(07f1f39e-292a-4e73-b4ed-99e5799d6fa8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap472fc537-2b') {{(pid=71509) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 11:05:13 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:05:13 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap472fc537-2b, bridge=br-int, if_exists=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:05:13 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:05:13 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:05:13 user nova-compute[71509]: INFO os_vif [None req-ceb356ae-06a7-4773-b435-8eef5d44e6e8 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3d:95:64,bridge_name='br-int',has_traffic_filtering=True,id=472fc537-2bff-4ebb-bfb7-f7973f9f8b81,network=Network(07f1f39e-292a-4e73-b4ed-99e5799d6fa8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap472fc537-2b')
Apr 14 11:05:13 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-ceb356ae-06a7-4773-b435-8eef5d44e6e8 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: a936fb20-3f17-4114-829a-8659da6bc5f3] Deleting instance files /opt/stack/data/nova/instances/a936fb20-3f17-4114-829a-8659da6bc5f3_del
Apr 14 11:05:13 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-ceb356ae-06a7-4773-b435-8eef5d44e6e8 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: a936fb20-3f17-4114-829a-8659da6bc5f3] Deletion of /opt/stack/data/nova/instances/a936fb20-3f17-4114-829a-8659da6bc5f3_del complete
Apr 14 11:05:13 user nova-compute[71509]: INFO nova.compute.manager [None req-ceb356ae-06a7-4773-b435-8eef5d44e6e8 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: a936fb20-3f17-4114-829a-8659da6bc5f3] Took 0.88 seconds to destroy the instance on the hypervisor.
Apr 14 11:05:13 user nova-compute[71509]: DEBUG oslo.service.loopingcall [None req-ceb356ae-06a7-4773-b435-8eef5d44e6e8 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71509) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 11:05:13 user nova-compute[71509]: DEBUG nova.compute.manager [-] [instance: a936fb20-3f17-4114-829a-8659da6bc5f3] Deallocating network for instance {{(pid=71509) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 11:05:13 user nova-compute[71509]: DEBUG nova.network.neutron [-] [instance: a936fb20-3f17-4114-829a-8659da6bc5f3] deallocate_for_instance() {{(pid=71509) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 11:05:13 user nova-compute[71509]: DEBUG nova.network.neutron [-] [instance: a936fb20-3f17-4114-829a-8659da6bc5f3] Updating instance_info_cache with network_info: [] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:05:13 user nova-compute[71509]: INFO nova.compute.manager [-] [instance: a936fb20-3f17-4114-829a-8659da6bc5f3] Took 0.48 seconds to deallocate network for instance.
Apr 14 11:05:13 user nova-compute[71509]: DEBUG nova.compute.manager [req-05c5cbb4-f171-4af7-8da3-184adbfd851b req-fc0fd1b2-6800-480a-9314-7f47c58492b3 service nova] [instance: a936fb20-3f17-4114-829a-8659da6bc5f3] Received event network-vif-deleted-472fc537-2bff-4ebb-bfb7-f7973f9f8b81 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:05:13 user nova-compute[71509]: INFO nova.compute.manager [req-05c5cbb4-f171-4af7-8da3-184adbfd851b req-fc0fd1b2-6800-480a-9314-7f47c58492b3 service nova] [instance: a936fb20-3f17-4114-829a-8659da6bc5f3] Neutron deleted interface 472fc537-2bff-4ebb-bfb7-f7973f9f8b81; detaching it from the instance and deleting it from the info cache
Apr 14 11:05:13 user nova-compute[71509]: DEBUG nova.network.neutron [req-05c5cbb4-f171-4af7-8da3-184adbfd851b req-fc0fd1b2-6800-480a-9314-7f47c58492b3 service nova] [instance: a936fb20-3f17-4114-829a-8659da6bc5f3] Updating instance_info_cache with network_info: [] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:05:13 user nova-compute[71509]: DEBUG nova.compute.manager [req-05c5cbb4-f171-4af7-8da3-184adbfd851b req-fc0fd1b2-6800-480a-9314-7f47c58492b3 service nova] [instance: a936fb20-3f17-4114-829a-8659da6bc5f3] Detach interface failed, port_id=472fc537-2bff-4ebb-bfb7-f7973f9f8b81, reason: Instance a936fb20-3f17-4114-829a-8659da6bc5f3 could not be found. {{(pid=71509) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 11:05:13 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-ceb356ae-06a7-4773-b435-8eef5d44e6e8 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:05:13 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-ceb356ae-06a7-4773-b435-8eef5d44e6e8 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:05:14 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-ceb356ae-06a7-4773-b435-8eef5d44e6e8 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 11:05:14 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-ceb356ae-06a7-4773-b435-8eef5d44e6e8 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 11:05:14 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-ceb356ae-06a7-4773-b435-8eef5d44e6e8 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.252s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:05:14 user nova-compute[71509]: INFO nova.scheduler.client.report [None req-ceb356ae-06a7-4773-b435-8eef5d44e6e8 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Deleted allocations for instance a936fb20-3f17-4114-829a-8659da6bc5f3
Apr 14 11:05:14 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-ceb356ae-06a7-4773-b435-8eef5d44e6e8 tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "a936fb20-3f17-4114-829a-8659da6bc5f3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.840s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:05:14 user nova-compute[71509]: DEBUG nova.compute.manager [req-c7941c48-15e3-4bb0-a268-c44613ada93a req-45953cdd-0f57-4785-afb3-edc8a8f9e2e2 service nova] [instance: a936fb20-3f17-4114-829a-8659da6bc5f3] Received event network-vif-plugged-472fc537-2bff-4ebb-bfb7-f7973f9f8b81 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:05:14 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-c7941c48-15e3-4bb0-a268-c44613ada93a req-45953cdd-0f57-4785-afb3-edc8a8f9e2e2 service nova] Acquiring lock "a936fb20-3f17-4114-829a-8659da6bc5f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:05:14 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-c7941c48-15e3-4bb0-a268-c44613ada93a req-45953cdd-0f57-4785-afb3-edc8a8f9e2e2 service nova] Lock "a936fb20-3f17-4114-829a-8659da6bc5f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:05:14 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-c7941c48-15e3-4bb0-a268-c44613ada93a req-45953cdd-0f57-4785-afb3-edc8a8f9e2e2 service nova] Lock "a936fb20-3f17-4114-829a-8659da6bc5f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:05:14 user nova-compute[71509]: DEBUG nova.compute.manager [req-c7941c48-15e3-4bb0-a268-c44613ada93a req-45953cdd-0f57-4785-afb3-edc8a8f9e2e2 service nova] [instance: a936fb20-3f17-4114-829a-8659da6bc5f3] No waiting events found dispatching network-vif-plugged-472fc537-2bff-4ebb-bfb7-f7973f9f8b81 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:05:14 user nova-compute[71509]: WARNING nova.compute.manager [req-c7941c48-15e3-4bb0-a268-c44613ada93a req-45953cdd-0f57-4785-afb3-edc8a8f9e2e2 service nova] [instance: a936fb20-3f17-4114-829a-8659da6bc5f3] Received unexpected event network-vif-plugged-472fc537-2bff-4ebb-bfb7-f7973f9f8b81 for instance with vm_state deleted and task_state None.
Apr 14 11:05:18 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:05:20 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:05:23 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:05:28 user nova-compute[71509]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681470313.340262, a936fb20-3f17-4114-829a-8659da6bc5f3 => Stopped> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 11:05:28 user nova-compute[71509]: INFO nova.compute.manager [-] [instance: a936fb20-3f17-4114-829a-8659da6bc5f3] VM Stopped (Lifecycle Event)
Apr 14 11:05:28 user nova-compute[71509]: DEBUG nova.compute.manager [None req-eff1678e-17f9-4ceb-8b91-47ef441558a0 None None] [instance: a936fb20-3f17-4114-829a-8659da6bc5f3] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 11:05:28 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:05:28 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:05:33 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:05:33 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:05:38 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:05:38 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:05:38 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:05:43 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:05:44 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-aee38e59-cff8-4908-95a4-3faa886a6491 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "3db2e71c-939b-4d2f-b1be-c2122f7cd73e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:05:44 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-aee38e59-cff8-4908-95a4-3faa886a6491 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "3db2e71c-939b-4d2f-b1be-c2122f7cd73e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:05:44 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-aee38e59-cff8-4908-95a4-3faa886a6491 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "3db2e71c-939b-4d2f-b1be-c2122f7cd73e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:05:44 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-aee38e59-cff8-4908-95a4-3faa886a6491 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "3db2e71c-939b-4d2f-b1be-c2122f7cd73e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:05:44 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-aee38e59-cff8-4908-95a4-3faa886a6491 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "3db2e71c-939b-4d2f-b1be-c2122f7cd73e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:05:44 user nova-compute[71509]: INFO nova.compute.manager [None req-aee38e59-cff8-4908-95a4-3faa886a6491 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] Terminating instance
Apr 14 11:05:44 user nova-compute[71509]: DEBUG nova.compute.manager [None req-aee38e59-cff8-4908-95a4-3faa886a6491 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] Start destroying the instance on the hypervisor. {{(pid=71509) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 11:05:44 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:05:45 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:05:45 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:05:45 user nova-compute[71509]: DEBUG nova.compute.manager [req-d0bca87e-a370-4eae-93d3-2d5ee3603da3 req-5305170e-fdbe-4c29-801f-58350c904a3e service nova] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] Received event network-vif-unplugged-1e547ec7-7efd-480f-84be-806c8cf25b90 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:05:45 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-d0bca87e-a370-4eae-93d3-2d5ee3603da3 req-5305170e-fdbe-4c29-801f-58350c904a3e service nova] Acquiring lock "3db2e71c-939b-4d2f-b1be-c2122f7cd73e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:05:45 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-d0bca87e-a370-4eae-93d3-2d5ee3603da3 req-5305170e-fdbe-4c29-801f-58350c904a3e service nova] Lock "3db2e71c-939b-4d2f-b1be-c2122f7cd73e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:05:45 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-d0bca87e-a370-4eae-93d3-2d5ee3603da3 req-5305170e-fdbe-4c29-801f-58350c904a3e service nova] Lock "3db2e71c-939b-4d2f-b1be-c2122f7cd73e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:05:45 user nova-compute[71509]: DEBUG nova.compute.manager [req-d0bca87e-a370-4eae-93d3-2d5ee3603da3 req-5305170e-fdbe-4c29-801f-58350c904a3e service nova] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] No waiting events found dispatching network-vif-unplugged-1e547ec7-7efd-480f-84be-806c8cf25b90 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:05:45 user nova-compute[71509]: DEBUG nova.compute.manager [req-d0bca87e-a370-4eae-93d3-2d5ee3603da3 req-5305170e-fdbe-4c29-801f-58350c904a3e service nova] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] Received event network-vif-unplugged-1e547ec7-7efd-480f-84be-806c8cf25b90 for instance with task_state deleting. {{(pid=71509) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 11:05:45 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:05:45 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71509) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 11:05:45 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] Instance destroyed successfully.
Apr 14 11:05:45 user nova-compute[71509]: DEBUG nova.objects.instance [None req-aee38e59-cff8-4908-95a4-3faa886a6491 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lazy-loading 'resources' on Instance uuid 3db2e71c-939b-4d2f-b1be-c2122f7cd73e {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 11:05:45 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-aee38e59-cff8-4908-95a4-3faa886a6491 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T10:59:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1613655632',display_name='tempest-ServerActionsTestJSON-server-1613655632',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1613655632',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNt/FyD1XXsxB5kJC+SJ1dgkjoXXHkL+KX0Cr5HvI72xTIz+DAtuVRPHeIpMNLt39mbbZ9KAoCJibRQza0Qbd8j8EEoV7QHombhWz2Mdusr+gJ2OYTqrrRzVbjIHACTFWw==',key_name='tempest-keypair-1544270235',keypairs=<?>,launch_index=0,launched_at=2023-04-14T11:01:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3ea2cb4dfa5b4a52b658efd8f5aefb36',ramdisk_id='',reservation_id='r-fwmcktqp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-1923052090',owner_user_name='tempest-ServerActionsTestJSON-1923052090-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T11:02:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5873a358bf544691b12cd2979f5e36dc',uuid=3db2e71c-939b-4d2f-b1be-c2122f7cd73e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1e547ec7-7efd-480f-84be-806c8cf25b90", "address": "fa:16:3e:34:08:47", "network": {"id": "18a91434-637b-4c19-a97b-736b32c1ea5a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1824162811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea2cb4dfa5b4a52b658efd8f5aefb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e547ec7-7e", "ovs_interfaceid": "1e547ec7-7efd-480f-84be-806c8cf25b90", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 11:05:45 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-aee38e59-cff8-4908-95a4-3faa886a6491 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Converting VIF {"id": "1e547ec7-7efd-480f-84be-806c8cf25b90", "address": "fa:16:3e:34:08:47", "network": {"id": "18a91434-637b-4c19-a97b-736b32c1ea5a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1824162811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea2cb4dfa5b4a52b658efd8f5aefb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e547ec7-7e", "ovs_interfaceid": "1e547ec7-7efd-480f-84be-806c8cf25b90", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 11:05:45 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-aee38e59-cff8-4908-95a4-3faa886a6491 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:34:08:47,bridge_name='br-int',has_traffic_filtering=True,id=1e547ec7-7efd-480f-84be-806c8cf25b90,network=Network(18a91434-637b-4c19-a97b-736b32c1ea5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e547ec7-7e') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 11:05:45 user nova-compute[71509]: DEBUG os_vif [None req-aee38e59-cff8-4908-95a4-3faa886a6491 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:34:08:47,bridge_name='br-int',has_traffic_filtering=True,id=1e547ec7-7efd-480f-84be-806c8cf25b90,network=Network(18a91434-637b-4c19-a97b-736b32c1ea5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e547ec7-7e') {{(pid=71509) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 11:05:45 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:05:45 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1e547ec7-7e, bridge=br-int, if_exists=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:05:45 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:05:45 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:05:45 user nova-compute[71509]: INFO os_vif [None req-aee38e59-cff8-4908-95a4-3faa886a6491 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:34:08:47,bridge_name='br-int',has_traffic_filtering=True,id=1e547ec7-7efd-480f-84be-806c8cf25b90,network=Network(18a91434-637b-4c19-a97b-736b32c1ea5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e547ec7-7e')
Apr 14 11:05:45 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aee38e59-cff8-4908-95a4-3faa886a6491 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] calling os-brick to detach iSCSI Volume {{(pid=71509) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 11:05:45 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee38e59-cff8-4908-95a4-3faa886a6491 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0bf0749390>, {'target_iqn': 'iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vfPCIMcj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 11:05:45 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-aee38e59-cff8-4908-95a4-3faa886a6491 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 11:05:45 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-aee38e59-cff8-4908-95a4-3faa886a6491 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 11:05:45 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-aee38e59-cff8-4908-95a4-3faa886a6491 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 11:05:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:05:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:05:45 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[6efa1762-a733-46be-b804-cdc75cd9eda4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:05:45 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee38e59-cff8-4908-95a4-3faa886a6491 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 11:05:45 user nova-compute[71509]: No targets found.
Apr 14 11:05:45 user nova-compute[71509]: iSNS:
Apr 14 11:05:45 user nova-compute[71509]: No targets found.
Apr 14 11:05:45 user nova-compute[71509]: STATIC:
Apr 14 11:05:45 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3
Apr 14 11:05:45 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 11:05:45 user nova-compute[71509]:                 Iface Name: default
Apr 14 11:05:45 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178
Apr 14 11:05:45 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 11:05:45 user nova-compute[71509]:                 Iface Name: default
Apr 14 11:05:45 user nova-compute[71509]: FIRMWARE:
Apr 14 11:05:45 user nova-compute[71509]: No targets found.
Apr 14 11:05:45 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 11:05:45 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee38e59-cff8-4908-95a4-3faa886a6491 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 11:05:45 user nova-compute[71509]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 11:05:45 user nova-compute[71509]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71509) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 11:05:45 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee38e59-cff8-4908-95a4-3faa886a6491 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3', 0)] {{(pid=71509) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 11:05:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:05:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:05:45 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[b35eef94-c71e-4b23-a37f-98568b18f5ae]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:05:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:05:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:05:45 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a9af075-de8e-4212-91ae-e999d96e1134]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3 (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:05:45 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee38e59-cff8-4908-95a4-3faa886a6491 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)
Apr 14 11:05:45 user nova-compute[71509]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3 (non-flash)
Apr 14 11:05:45 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 11:05:45 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee38e59-cff8-4908-95a4-3faa886a6491 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)
Apr 14 11:05:45 user nova-compute[71509]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3 (non-flash)
Apr 14 11:05:45 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 11:05:45 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee38e59-cff8-4908-95a4-3faa886a6491 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0c14114280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3'): ({'sdc'}, set())}) {{(pid=71509) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 11:05:45 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-aee38e59-cff8-4908-95a4-3faa886a6491 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Removing single pathed devices sdc {{(pid=71509) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 11:05:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:05:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:05:45 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[d829a4be-454e-4fac-a2f7-2e85474f5408]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:05:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:05:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:05:45 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[994954dd-ea56-4f33-874b-3c4c9b333465]: (4, ('ok\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:05:45 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-aee38e59-cff8-4908-95a4-3faa886a6491 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Flushing IO for device /dev/sdc {{(pid=71509) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 11:05:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:05:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:05:45 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2d45006-c89f-4ee4-a534-e3d1228be2c8]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:05:45 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-aee38e59-cff8-4908-95a4-3faa886a6491 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71509) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 11:05:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:05:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.053s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:05:45 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd91a8a6-e2af-49b5-9a93-2c3a3afae8a9]: (4, ('1', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:05:45 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-aee38e59-cff8-4908-95a4-3faa886a6491 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71509) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 11:05:45 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-aee38e59-cff8-4908-95a4-3faa886a6491 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] SCSI volumes sdc have been removed. {{(pid=71509) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 11:05:45 user nova-compute[71509]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26664386137333064', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_f932bf43', '/dev/disk/by-id/scsi-1SCST_BIOf932bf43-fd8a730d4cc51681') {{(pid=82281) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 14 11:05:45 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc7e1da7-11f0-4667-b148-ce74d469c612]: (4, None) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:05:45 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee38e59-cff8-4908-95a4-3faa886a6491 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3')] {{(pid=71509) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 11:05:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:05:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:05:45 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e721fd9-7c7d-4370-89ac-919cdea7e37d]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:05:45 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee38e59-cff8-4908-95a4-3faa886a6491 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:05:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3 -p 172.16.0.220:3260 --logout {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:05:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:05:45 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[e344d03e-4515-4efd-91c3-5cca5f551ed2]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:05:45 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee38e59-cff8-4908-95a4-3faa886a6491 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3, portal: 172.16.0.220,3260]
Apr 14 11:05:45 user nova-compute[71509]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3, portal: 172.16.0.220,3260] successful.
Apr 14 11:05:45 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:05:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3 -p 172.16.0.220:3260 --op delete {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:05:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64198cbd-5b4a-4ca5-bb06-b6553335edb3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:05:45 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ed30b4b-c9dd-41b6-8533-b7b560a3022c]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:05:45 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee38e59-cff8-4908-95a4-3faa886a6491 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:05:45 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-aee38e59-cff8-4908-95a4-3faa886a6491 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 11:05:45 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee38e59-cff8-4908-95a4-3faa886a6491 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] <== disconnect_volume: return (330ms) None {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 11:05:45 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aee38e59-cff8-4908-95a4-3faa886a6491 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] Disconnected iSCSI Volume {{(pid=71509) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 11:05:45 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-aee38e59-cff8-4908-95a4-3faa886a6491 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] Deleting instance files /opt/stack/data/nova/instances/3db2e71c-939b-4d2f-b1be-c2122f7cd73e_del
Apr 14 11:05:45 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-aee38e59-cff8-4908-95a4-3faa886a6491 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] Deletion of /opt/stack/data/nova/instances/3db2e71c-939b-4d2f-b1be-c2122f7cd73e_del complete
Apr 14 11:05:45 user nova-compute[71509]: INFO nova.compute.manager [None req-aee38e59-cff8-4908-95a4-3faa886a6491 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] Took 1.19 seconds to destroy the instance on the hypervisor.
Apr 14 11:05:45 user nova-compute[71509]: DEBUG oslo.service.loopingcall [None req-aee38e59-cff8-4908-95a4-3faa886a6491 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71509) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 11:05:45 user nova-compute[71509]: DEBUG nova.compute.manager [-] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] Deallocating network for instance {{(pid=71509) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 11:05:45 user nova-compute[71509]: DEBUG nova.network.neutron [-] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] deallocate_for_instance() {{(pid=71509) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 11:05:46 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:05:46 user nova-compute[71509]: DEBUG nova.network.neutron [-] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] Updating instance_info_cache with network_info: [] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:05:46 user nova-compute[71509]: INFO nova.compute.manager [-] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] Took 0.85 seconds to deallocate network for instance.
Apr 14 11:05:46 user nova-compute[71509]: DEBUG nova.compute.manager [req-b4495c4c-0391-4623-b350-ff8e4b842581 req-14219276-bfd9-44e4-bd16-50a168f928b9 service nova] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] Received event network-vif-deleted-1e547ec7-7efd-480f-84be-806c8cf25b90 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:05:47 user nova-compute[71509]: DEBUG nova.compute.manager [req-49817dd9-5ef2-41d4-ba58-02baa9a57d76 req-882b44b9-add8-4a16-836d-ceb9dc21a241 service nova] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] Received event network-vif-plugged-1e547ec7-7efd-480f-84be-806c8cf25b90 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:05:47 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-49817dd9-5ef2-41d4-ba58-02baa9a57d76 req-882b44b9-add8-4a16-836d-ceb9dc21a241 service nova] Acquiring lock "3db2e71c-939b-4d2f-b1be-c2122f7cd73e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:05:47 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-49817dd9-5ef2-41d4-ba58-02baa9a57d76 req-882b44b9-add8-4a16-836d-ceb9dc21a241 service nova] Lock "3db2e71c-939b-4d2f-b1be-c2122f7cd73e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:05:47 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-49817dd9-5ef2-41d4-ba58-02baa9a57d76 req-882b44b9-add8-4a16-836d-ceb9dc21a241 service nova] Lock "3db2e71c-939b-4d2f-b1be-c2122f7cd73e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:05:47 user nova-compute[71509]: DEBUG nova.compute.manager [req-49817dd9-5ef2-41d4-ba58-02baa9a57d76 req-882b44b9-add8-4a16-836d-ceb9dc21a241 service nova] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] No waiting events found dispatching network-vif-plugged-1e547ec7-7efd-480f-84be-806c8cf25b90 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:05:47 user nova-compute[71509]: WARNING nova.compute.manager [req-49817dd9-5ef2-41d4-ba58-02baa9a57d76 req-882b44b9-add8-4a16-836d-ceb9dc21a241 service nova] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] Received unexpected event network-vif-plugged-1e547ec7-7efd-480f-84be-806c8cf25b90 for instance with vm_state active and task_state deleting.
Apr 14 11:05:47 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:05:47 user nova-compute[71509]: INFO nova.compute.manager [None req-aee38e59-cff8-4908-95a4-3faa886a6491 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] Took 0.83 seconds to detach 1 volumes for instance.
Apr 14 11:05:47 user nova-compute[71509]: DEBUG nova.compute.manager [None req-aee38e59-cff8-4908-95a4-3faa886a6491 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] Deleting volume: 64198cbd-5b4a-4ca5-bb06-b6553335edb3 {{(pid=71509) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 14 11:05:47 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-aee38e59-cff8-4908-95a4-3faa886a6491 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:05:47 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-aee38e59-cff8-4908-95a4-3faa886a6491 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:05:47 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-aee38e59-cff8-4908-95a4-3faa886a6491 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 11:05:47 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-aee38e59-cff8-4908-95a4-3faa886a6491 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 11:05:48 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-aee38e59-cff8-4908-95a4-3faa886a6491 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.254s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:05:48 user nova-compute[71509]: INFO nova.scheduler.client.report [None req-aee38e59-cff8-4908-95a4-3faa886a6491 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Deleted allocations for instance 3db2e71c-939b-4d2f-b1be-c2122f7cd73e
Apr 14 11:05:48 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-aee38e59-cff8-4908-95a4-3faa886a6491 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "3db2e71c-939b-4d2f-b1be-c2122f7cd73e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.398s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:05:48 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:05:50 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:05:50 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-a9b082dc-56a4-4860-89c0-774d58cfc293 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Acquiring lock "9c4cc2a1-0c54-4f20-b33f-9085af7b10a3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:05:50 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-a9b082dc-56a4-4860-89c0-774d58cfc293 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "9c4cc2a1-0c54-4f20-b33f-9085af7b10a3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:05:50 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-a9b082dc-56a4-4860-89c0-774d58cfc293 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Acquiring lock "9c4cc2a1-0c54-4f20-b33f-9085af7b10a3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:05:50 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-a9b082dc-56a4-4860-89c0-774d58cfc293 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "9c4cc2a1-0c54-4f20-b33f-9085af7b10a3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:05:50 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-a9b082dc-56a4-4860-89c0-774d58cfc293 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "9c4cc2a1-0c54-4f20-b33f-9085af7b10a3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:05:50 user nova-compute[71509]: INFO nova.compute.manager [None req-a9b082dc-56a4-4860-89c0-774d58cfc293 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Terminating instance
Apr 14 11:05:50 user nova-compute[71509]: DEBUG nova.compute.manager [None req-a9b082dc-56a4-4860-89c0-774d58cfc293 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Start destroying the instance on the hypervisor. {{(pid=71509) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 11:05:50 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:05:50 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:05:50 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:05:50 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:05:51 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:05:51 user nova-compute[71509]: DEBUG nova.compute.manager [req-9814b48d-f6d8-47c0-897a-9fbeb1c34e36 req-54f082c3-6de3-45b4-a55f-6c52185a4630 service nova] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Received event network-vif-unplugged-f41f6957-bf6d-47bf-bb71-638137929e1e {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:05:51 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-9814b48d-f6d8-47c0-897a-9fbeb1c34e36 req-54f082c3-6de3-45b4-a55f-6c52185a4630 service nova] Acquiring lock "9c4cc2a1-0c54-4f20-b33f-9085af7b10a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:05:51 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-9814b48d-f6d8-47c0-897a-9fbeb1c34e36 req-54f082c3-6de3-45b4-a55f-6c52185a4630 service nova] Lock "9c4cc2a1-0c54-4f20-b33f-9085af7b10a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:05:51 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-9814b48d-f6d8-47c0-897a-9fbeb1c34e36 req-54f082c3-6de3-45b4-a55f-6c52185a4630 service nova] Lock "9c4cc2a1-0c54-4f20-b33f-9085af7b10a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:05:51 user nova-compute[71509]: DEBUG nova.compute.manager [req-9814b48d-f6d8-47c0-897a-9fbeb1c34e36 req-54f082c3-6de3-45b4-a55f-6c52185a4630 service nova] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] No waiting events found dispatching network-vif-unplugged-f41f6957-bf6d-47bf-bb71-638137929e1e {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:05:51 user nova-compute[71509]: DEBUG nova.compute.manager [req-9814b48d-f6d8-47c0-897a-9fbeb1c34e36 req-54f082c3-6de3-45b4-a55f-6c52185a4630 service nova] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Received event network-vif-unplugged-f41f6957-bf6d-47bf-bb71-638137929e1e for instance with task_state deleting. {{(pid=71509) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 11:05:51 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:05:51 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:05:51 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:05:51 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:05:51 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Instance destroyed successfully.
Apr 14 11:05:51 user nova-compute[71509]: DEBUG nova.objects.instance [None req-a9b082dc-56a4-4860-89c0-774d58cfc293 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lazy-loading 'resources' on Instance uuid 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 11:05:51 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-a9b082dc-56a4-4860-89c0-774d58cfc293 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T11:00:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-145954405',display_name='tempest-TestMinimumBasicScenario-server-145954405',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-145954405',id=36,image_ref='4a4373e4-8d8a-4e8c-abe0-ace7652a4a7d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJI56DgU3GFkyba07rJQ5gPWmf+s+oszKE0l2AEuBdasOhPKZbxdMzg3ltBRBJuQQhxmZUmQrEIrG8aYiF6ueY2ARcTYBp9F9Zb4rPcdzBhgtNF8DrTPiOHvxBGxF5+ocQ==',key_name='tempest-TestMinimumBasicScenario-1104464810',keypairs=<?>,launch_index=0,launched_at=2023-04-14T11:00:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5809862340a84c83a772c65c77513608',ramdisk_id='',reservation_id='r-4ptbez4v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='4a4373e4-8d8a-4e8c-abe0-ace7652a4a7d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-2127394977',owner_user_name='tempest-TestMinimumBasicScenario-2127394977-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T11:03:12Z,user_data=None,user_id='831215baa8fd4fe7ba65193bbbdad1b4',uuid=9c4cc2a1-0c54-4f20-b33f-9085af7b10a3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f41f6957-bf6d-47bf-bb71-638137929e1e", "address": "fa:16:3e:ca:60:62", "network": {"id": "d59680e7-ed50-4356-b665-ec64ff939708", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-598238133-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5809862340a84c83a772c65c77513608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf41f6957-bf", "ovs_interfaceid": "f41f6957-bf6d-47bf-bb71-638137929e1e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 11:05:51 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-a9b082dc-56a4-4860-89c0-774d58cfc293 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Converting VIF {"id": "f41f6957-bf6d-47bf-bb71-638137929e1e", "address": "fa:16:3e:ca:60:62", "network": {"id": "d59680e7-ed50-4356-b665-ec64ff939708", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-598238133-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5809862340a84c83a772c65c77513608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf41f6957-bf", "ovs_interfaceid": "f41f6957-bf6d-47bf-bb71-638137929e1e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 11:05:51 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-a9b082dc-56a4-4860-89c0-774d58cfc293 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ca:60:62,bridge_name='br-int',has_traffic_filtering=True,id=f41f6957-bf6d-47bf-bb71-638137929e1e,network=Network(d59680e7-ed50-4356-b665-ec64ff939708),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf41f6957-bf') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 11:05:51 user nova-compute[71509]: DEBUG os_vif [None req-a9b082dc-56a4-4860-89c0-774d58cfc293 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ca:60:62,bridge_name='br-int',has_traffic_filtering=True,id=f41f6957-bf6d-47bf-bb71-638137929e1e,network=Network(d59680e7-ed50-4356-b665-ec64ff939708),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf41f6957-bf') {{(pid=71509) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 11:05:51 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:05:51 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf41f6957-bf, bridge=br-int, if_exists=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:05:51 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:05:51 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:05:51 user nova-compute[71509]: INFO os_vif [None req-a9b082dc-56a4-4860-89c0-774d58cfc293 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ca:60:62,bridge_name='br-int',has_traffic_filtering=True,id=f41f6957-bf6d-47bf-bb71-638137929e1e,network=Network(d59680e7-ed50-4356-b665-ec64ff939708),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf41f6957-bf')
Apr 14 11:05:51 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-a9b082dc-56a4-4860-89c0-774d58cfc293 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Deleting instance files /opt/stack/data/nova/instances/9c4cc2a1-0c54-4f20-b33f-9085af7b10a3_del
Apr 14 11:05:51 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-a9b082dc-56a4-4860-89c0-774d58cfc293 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Deletion of /opt/stack/data/nova/instances/9c4cc2a1-0c54-4f20-b33f-9085af7b10a3_del complete
Apr 14 11:05:51 user nova-compute[71509]: INFO nova.compute.manager [None req-a9b082dc-56a4-4860-89c0-774d58cfc293 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Took 1.10 seconds to destroy the instance on the hypervisor.
Apr 14 11:05:51 user nova-compute[71509]: DEBUG oslo.service.loopingcall [None req-a9b082dc-56a4-4860-89c0-774d58cfc293 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71509) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 11:05:51 user nova-compute[71509]: DEBUG nova.compute.manager [-] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Deallocating network for instance {{(pid=71509) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 11:05:51 user nova-compute[71509]: DEBUG nova.network.neutron [-] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] deallocate_for_instance() {{(pid=71509) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 11:05:52 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:05:52 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:05:52 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:05:52 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:05:52 user nova-compute[71509]: DEBUG nova.network.neutron [-] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Updating instance_info_cache with network_info: [] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:05:52 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:05:52 user nova-compute[71509]: INFO nova.compute.manager [-] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Took 0.54 seconds to deallocate network for instance.
Apr 14 11:05:52 user nova-compute[71509]: DEBUG nova.compute.manager [req-5bbff7b5-b1c8-488d-884c-c63b8929458d req-aec2ad28-f0d1-4d24-b26e-fee74b420e8a service nova] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Received event network-vif-deleted-f41f6957-bf6d-47bf-bb71-638137929e1e {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:05:52 user nova-compute[71509]: INFO nova.compute.manager [req-5bbff7b5-b1c8-488d-884c-c63b8929458d req-aec2ad28-f0d1-4d24-b26e-fee74b420e8a service nova] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Neutron deleted interface f41f6957-bf6d-47bf-bb71-638137929e1e; detaching it from the instance and deleting it from the info cache
Apr 14 11:05:52 user nova-compute[71509]: DEBUG nova.network.neutron [req-5bbff7b5-b1c8-488d-884c-c63b8929458d req-aec2ad28-f0d1-4d24-b26e-fee74b420e8a service nova] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Updating instance_info_cache with network_info: [] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:05:52 user nova-compute[71509]: DEBUG nova.compute.manager [req-5bbff7b5-b1c8-488d-884c-c63b8929458d req-aec2ad28-f0d1-4d24-b26e-fee74b420e8a service nova] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Detach interface failed, port_id=f41f6957-bf6d-47bf-bb71-638137929e1e, reason: Instance 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3 could not be found. {{(pid=71509) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 11:05:52 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-a9b082dc-56a4-4860-89c0-774d58cfc293 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:05:52 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-a9b082dc-56a4-4860-89c0-774d58cfc293 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:05:52 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:05:52 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-a9b082dc-56a4-4860-89c0-774d58cfc293 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 11:05:52 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-a9b082dc-56a4-4860-89c0-774d58cfc293 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 11:05:52 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-a9b082dc-56a4-4860-89c0-774d58cfc293 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.200s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:05:52 user nova-compute[71509]: INFO nova.scheduler.client.report [None req-a9b082dc-56a4-4860-89c0-774d58cfc293 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Deleted allocations for instance 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3
Apr 14 11:05:52 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-a9b082dc-56a4-4860-89c0-774d58cfc293 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "9c4cc2a1-0c54-4f20-b33f-9085af7b10a3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.055s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:05:53 user nova-compute[71509]: DEBUG nova.compute.manager [req-31b083d2-c332-4f98-a818-1d6a53a61f24 req-7d10968b-d4a4-4550-ae09-496bb7371e2c service nova] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Received event network-vif-plugged-f41f6957-bf6d-47bf-bb71-638137929e1e {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:05:53 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-31b083d2-c332-4f98-a818-1d6a53a61f24 req-7d10968b-d4a4-4550-ae09-496bb7371e2c service nova] Acquiring lock "9c4cc2a1-0c54-4f20-b33f-9085af7b10a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:05:53 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-31b083d2-c332-4f98-a818-1d6a53a61f24 req-7d10968b-d4a4-4550-ae09-496bb7371e2c service nova] Lock "9c4cc2a1-0c54-4f20-b33f-9085af7b10a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:05:53 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-31b083d2-c332-4f98-a818-1d6a53a61f24 req-7d10968b-d4a4-4550-ae09-496bb7371e2c service nova] Lock "9c4cc2a1-0c54-4f20-b33f-9085af7b10a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:05:53 user nova-compute[71509]: DEBUG nova.compute.manager [req-31b083d2-c332-4f98-a818-1d6a53a61f24 req-7d10968b-d4a4-4550-ae09-496bb7371e2c service nova] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] No waiting events found dispatching network-vif-plugged-f41f6957-bf6d-47bf-bb71-638137929e1e {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:05:53 user nova-compute[71509]: WARNING nova.compute.manager [req-31b083d2-c332-4f98-a818-1d6a53a61f24 req-7d10968b-d4a4-4550-ae09-496bb7371e2c service nova] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Received unexpected event network-vif-plugged-f41f6957-bf6d-47bf-bb71-638137929e1e for instance with vm_state deleted and task_state None.
Apr 14 11:05:53 user nova-compute[71509]: DEBUG nova.compute.manager [req-31b083d2-c332-4f98-a818-1d6a53a61f24 req-7d10968b-d4a4-4550-ae09-496bb7371e2c service nova] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Received event network-vif-plugged-f41f6957-bf6d-47bf-bb71-638137929e1e {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:05:53 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-31b083d2-c332-4f98-a818-1d6a53a61f24 req-7d10968b-d4a4-4550-ae09-496bb7371e2c service nova] Acquiring lock "9c4cc2a1-0c54-4f20-b33f-9085af7b10a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:05:53 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-31b083d2-c332-4f98-a818-1d6a53a61f24 req-7d10968b-d4a4-4550-ae09-496bb7371e2c service nova] Lock "9c4cc2a1-0c54-4f20-b33f-9085af7b10a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:05:53 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-31b083d2-c332-4f98-a818-1d6a53a61f24 req-7d10968b-d4a4-4550-ae09-496bb7371e2c service nova] Lock "9c4cc2a1-0c54-4f20-b33f-9085af7b10a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:05:53 user nova-compute[71509]: DEBUG nova.compute.manager [req-31b083d2-c332-4f98-a818-1d6a53a61f24 req-7d10968b-d4a4-4550-ae09-496bb7371e2c service nova] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] No waiting events found dispatching network-vif-plugged-f41f6957-bf6d-47bf-bb71-638137929e1e {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:05:53 user nova-compute[71509]: WARNING nova.compute.manager [req-31b083d2-c332-4f98-a818-1d6a53a61f24 req-7d10968b-d4a4-4550-ae09-496bb7371e2c service nova] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Received unexpected event network-vif-plugged-f41f6957-bf6d-47bf-bb71-638137929e1e for instance with vm_state deleted and task_state None.
Apr 14 11:05:53 user nova-compute[71509]: DEBUG nova.compute.manager [req-31b083d2-c332-4f98-a818-1d6a53a61f24 req-7d10968b-d4a4-4550-ae09-496bb7371e2c service nova] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Received event network-vif-plugged-f41f6957-bf6d-47bf-bb71-638137929e1e {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:05:53 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-31b083d2-c332-4f98-a818-1d6a53a61f24 req-7d10968b-d4a4-4550-ae09-496bb7371e2c service nova] Acquiring lock "9c4cc2a1-0c54-4f20-b33f-9085af7b10a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:05:53 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-31b083d2-c332-4f98-a818-1d6a53a61f24 req-7d10968b-d4a4-4550-ae09-496bb7371e2c service nova] Lock "9c4cc2a1-0c54-4f20-b33f-9085af7b10a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:05:53 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-31b083d2-c332-4f98-a818-1d6a53a61f24 req-7d10968b-d4a4-4550-ae09-496bb7371e2c service nova] Lock "9c4cc2a1-0c54-4f20-b33f-9085af7b10a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:05:53 user nova-compute[71509]: DEBUG nova.compute.manager [req-31b083d2-c332-4f98-a818-1d6a53a61f24 req-7d10968b-d4a4-4550-ae09-496bb7371e2c service nova] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] No waiting events found dispatching network-vif-plugged-f41f6957-bf6d-47bf-bb71-638137929e1e {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:05:53 user nova-compute[71509]: WARNING nova.compute.manager [req-31b083d2-c332-4f98-a818-1d6a53a61f24 req-7d10968b-d4a4-4550-ae09-496bb7371e2c service nova] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Received unexpected event network-vif-plugged-f41f6957-bf6d-47bf-bb71-638137929e1e for instance with vm_state deleted and task_state None.
Apr 14 11:05:53 user nova-compute[71509]: DEBUG nova.compute.manager [req-31b083d2-c332-4f98-a818-1d6a53a61f24 req-7d10968b-d4a4-4550-ae09-496bb7371e2c service nova] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Received event network-vif-plugged-f41f6957-bf6d-47bf-bb71-638137929e1e {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:05:53 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-31b083d2-c332-4f98-a818-1d6a53a61f24 req-7d10968b-d4a4-4550-ae09-496bb7371e2c service nova] Acquiring lock "9c4cc2a1-0c54-4f20-b33f-9085af7b10a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:05:53 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-31b083d2-c332-4f98-a818-1d6a53a61f24 req-7d10968b-d4a4-4550-ae09-496bb7371e2c service nova] Lock "9c4cc2a1-0c54-4f20-b33f-9085af7b10a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:05:53 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-31b083d2-c332-4f98-a818-1d6a53a61f24 req-7d10968b-d4a4-4550-ae09-496bb7371e2c service nova] Lock "9c4cc2a1-0c54-4f20-b33f-9085af7b10a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:05:53 user nova-compute[71509]: DEBUG nova.compute.manager [req-31b083d2-c332-4f98-a818-1d6a53a61f24 req-7d10968b-d4a4-4550-ae09-496bb7371e2c service nova] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] No waiting events found dispatching network-vif-plugged-f41f6957-bf6d-47bf-bb71-638137929e1e {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:05:53 user nova-compute[71509]: WARNING nova.compute.manager [req-31b083d2-c332-4f98-a818-1d6a53a61f24 req-7d10968b-d4a4-4550-ae09-496bb7371e2c service nova] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Received unexpected event network-vif-plugged-f41f6957-bf6d-47bf-bb71-638137929e1e for instance with vm_state deleted and task_state None.
Apr 14 11:05:54 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:05:54 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:05:56 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:05:57 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:05:57 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:05:57 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:05:57 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:05:57 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Auditing locally available compute resources for user (node: user) {{(pid=71509) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 11:05:57 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e479154a-acd6-47aa-9a5b-43c6e0feda07/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:05:57 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e479154a-acd6-47aa-9a5b-43c6e0feda07/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:05:57 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e479154a-acd6-47aa-9a5b-43c6e0feda07/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:05:57 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e479154a-acd6-47aa-9a5b-43c6e0feda07/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:05:57 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/269aa265-9398-4692-8ab4-f3bf5be82714/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:05:58 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/269aa265-9398-4692-8ab4-f3bf5be82714/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:05:58 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/269aa265-9398-4692-8ab4-f3bf5be82714/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:05:58 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/269aa265-9398-4692-8ab4-f3bf5be82714/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:05:58 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=71509) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 11:05:58 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dd9e11f-1fed-42af-ad5c-9cdd051b93e7/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:05:58 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dd9e11f-1fed-42af-ad5c-9cdd051b93e7/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:05:58 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dd9e11f-1fed-42af-ad5c-9cdd051b93e7/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:05:58 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dd9e11f-1fed-42af-ad5c-9cdd051b93e7/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:05:58 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 11:05:58 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 11:05:58 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Hypervisor/Node resource view: name=user free_ram=8395MB free_disk=25.881732940673828GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71509) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 11:05:58 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:05:58 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:05:59 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance e479154a-acd6-47aa-9a5b-43c6e0feda07 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 11:05:59 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 6cae9f61-763f-4671-a873-d15f01384416 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 11:05:59 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 0dd9e11f-1fed-42af-ad5c-9cdd051b93e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 11:05:59 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 269aa265-9398-4692-8ab4-f3bf5be82714 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 11:05:59 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=71509) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 11:05:59 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Final resource view: name=user phys_ram=16023MB used_ram=1024MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=71509) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 11:05:59 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 11:05:59 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 11:05:59 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Compute_service record updated for user:user {{(pid=71509) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 11:05:59 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.268s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:06:00 user nova-compute[71509]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681470345.4745896, 3db2e71c-939b-4d2f-b1be-c2122f7cd73e => Stopped> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 11:06:00 user nova-compute[71509]: INFO nova.compute.manager [-] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] VM Stopped (Lifecycle Event)
Apr 14 11:06:00 user nova-compute[71509]: DEBUG nova.compute.manager [None req-9021a68e-86ec-4071-add9-45d60f7a593e None None] [instance: 3db2e71c-939b-4d2f-b1be-c2122f7cd73e] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 11:06:01 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:06:01 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:06:01 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71509) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 11:06:01 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71509) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 11:06:01 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71509) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 11:06:01 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:06:02 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:06:02 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Starting heal instance info cache {{(pid=71509) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 11:06:02 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "refresh_cache-0dd9e11f-1fed-42af-ad5c-9cdd051b93e7" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 11:06:02 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquired lock "refresh_cache-0dd9e11f-1fed-42af-ad5c-9cdd051b93e7" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 11:06:02 user nova-compute[71509]: DEBUG nova.network.neutron [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] [instance: 0dd9e11f-1fed-42af-ad5c-9cdd051b93e7] Forcefully refreshing network info cache for instance {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 11:06:02 user nova-compute[71509]: DEBUG nova.network.neutron [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] [instance: 0dd9e11f-1fed-42af-ad5c-9cdd051b93e7] Updating instance_info_cache with network_info: [{"id": "ec941aab-7c95-415b-96bc-e74ebaeb9385", "address": "fa:16:3e:31:a2:13", "network": {"id": "18a91434-637b-4c19-a97b-736b32c1ea5a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1824162811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea2cb4dfa5b4a52b658efd8f5aefb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec941aab-7c", "ovs_interfaceid": "ec941aab-7c95-415b-96bc-e74ebaeb9385", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:06:02 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Releasing lock "refresh_cache-0dd9e11f-1fed-42af-ad5c-9cdd051b93e7" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 11:06:02 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] [instance: 0dd9e11f-1fed-42af-ad5c-9cdd051b93e7] Updated the network info_cache for instance {{(pid=71509) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 11:06:03 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-b0ab2718-6c22-4af1-8c37-f077e4b5c69d tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Acquiring lock "6cae9f61-763f-4671-a873-d15f01384416" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:06:03 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-b0ab2718-6c22-4af1-8c37-f077e4b5c69d tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "6cae9f61-763f-4671-a873-d15f01384416" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:06:03 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-b0ab2718-6c22-4af1-8c37-f077e4b5c69d tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Acquiring lock "6cae9f61-763f-4671-a873-d15f01384416-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:06:03 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-b0ab2718-6c22-4af1-8c37-f077e4b5c69d tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "6cae9f61-763f-4671-a873-d15f01384416-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:06:03 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-b0ab2718-6c22-4af1-8c37-f077e4b5c69d tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "6cae9f61-763f-4671-a873-d15f01384416-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:06:03 user nova-compute[71509]: INFO nova.compute.manager [None req-b0ab2718-6c22-4af1-8c37-f077e4b5c69d tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: 6cae9f61-763f-4671-a873-d15f01384416] Terminating instance
Apr 14 11:06:03 user nova-compute[71509]: DEBUG nova.compute.manager [None req-b0ab2718-6c22-4af1-8c37-f077e4b5c69d tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: 6cae9f61-763f-4671-a873-d15f01384416] Start destroying the instance on the hypervisor. {{(pid=71509) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 11:06:03 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:06:03 user nova-compute[71509]: DEBUG nova.compute.manager [req-6ec1d6cd-98f7-4c11-bc8d-7a1ecae8fd1c req-505160d1-3fe8-4b17-a350-2f7384080799 service nova] [instance: 6cae9f61-763f-4671-a873-d15f01384416] Received event network-vif-unplugged-30d57100-3321-41fe-9335-d53c8c5e291c {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:06:03 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-6ec1d6cd-98f7-4c11-bc8d-7a1ecae8fd1c req-505160d1-3fe8-4b17-a350-2f7384080799 service nova] Acquiring lock "6cae9f61-763f-4671-a873-d15f01384416-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:06:03 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-6ec1d6cd-98f7-4c11-bc8d-7a1ecae8fd1c req-505160d1-3fe8-4b17-a350-2f7384080799 service nova] Lock "6cae9f61-763f-4671-a873-d15f01384416-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:06:03 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-6ec1d6cd-98f7-4c11-bc8d-7a1ecae8fd1c req-505160d1-3fe8-4b17-a350-2f7384080799 service nova] Lock "6cae9f61-763f-4671-a873-d15f01384416-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:06:03 user nova-compute[71509]: DEBUG nova.compute.manager [req-6ec1d6cd-98f7-4c11-bc8d-7a1ecae8fd1c req-505160d1-3fe8-4b17-a350-2f7384080799 service nova] [instance: 6cae9f61-763f-4671-a873-d15f01384416] No waiting events found dispatching network-vif-unplugged-30d57100-3321-41fe-9335-d53c8c5e291c {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:06:03 user nova-compute[71509]: DEBUG nova.compute.manager [req-6ec1d6cd-98f7-4c11-bc8d-7a1ecae8fd1c req-505160d1-3fe8-4b17-a350-2f7384080799 service nova] [instance: 6cae9f61-763f-4671-a873-d15f01384416] Received event network-vif-unplugged-30d57100-3321-41fe-9335-d53c8c5e291c for instance with task_state deleting. {{(pid=71509) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 11:06:03 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:06:03 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:06:03 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-6ced92f6-fcfd-4507-9f1d-ffdc05b29b05 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Acquiring lock "269aa265-9398-4692-8ab4-f3bf5be82714" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:06:03 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-6ced92f6-fcfd-4507-9f1d-ffdc05b29b05 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Lock "269aa265-9398-4692-8ab4-f3bf5be82714" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:06:03 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-6ced92f6-fcfd-4507-9f1d-ffdc05b29b05 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Acquiring lock "269aa265-9398-4692-8ab4-f3bf5be82714-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:06:03 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-6ced92f6-fcfd-4507-9f1d-ffdc05b29b05 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Lock "269aa265-9398-4692-8ab4-f3bf5be82714-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:06:03 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-6ced92f6-fcfd-4507-9f1d-ffdc05b29b05 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Lock "269aa265-9398-4692-8ab4-f3bf5be82714-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:06:03 user nova-compute[71509]: INFO nova.compute.manager [None req-6ced92f6-fcfd-4507-9f1d-ffdc05b29b05 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] [instance: 269aa265-9398-4692-8ab4-f3bf5be82714] Terminating instance
Apr 14 11:06:03 user nova-compute[71509]: DEBUG nova.compute.manager [None req-6ced92f6-fcfd-4507-9f1d-ffdc05b29b05 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] [instance: 269aa265-9398-4692-8ab4-f3bf5be82714] Start destroying the instance on the hypervisor. {{(pid=71509) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 11:06:03 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:06:04 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:06:04 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:06:04 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:06:04 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: 6cae9f61-763f-4671-a873-d15f01384416] Instance destroyed successfully.
Apr 14 11:06:04 user nova-compute[71509]: DEBUG nova.objects.instance [None req-b0ab2718-6c22-4af1-8c37-f077e4b5c69d tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lazy-loading 'resources' on Instance uuid 6cae9f61-763f-4671-a873-d15f01384416 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 11:06:04 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: 269aa265-9398-4692-8ab4-f3bf5be82714] Instance destroyed successfully.
Apr 14 11:06:04 user nova-compute[71509]: DEBUG nova.objects.instance [None req-6ced92f6-fcfd-4507-9f1d-ffdc05b29b05 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Lazy-loading 'resources' on Instance uuid 269aa265-9398-4692-8ab4-f3bf5be82714 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 11:06:04 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-b0ab2718-6c22-4af1-8c37-f077e4b5c69d tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T10:50:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-632123778',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-632123778',id=19,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T10:52:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='71289f80a05141f482cb538dac3d7b38',ramdisk_id='',reservation_id='r-07afy9z0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2130542140',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T10:54:05Z,user_data=None,user_id='395bc9d7007c4e01ac7effd418bcea19',uuid=6cae9f61-763f-4671-a873-d15f01384416,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "30d57100-3321-41fe-9335-d53c8c5e291c", "address": "fa:16:3e:57:7d:4b", "network": {"id": "07f1f39e-292a-4e73-b4ed-99e5799d6fa8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1339551596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71289f80a05141f482cb538dac3d7b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30d57100-33", "ovs_interfaceid": "30d57100-3321-41fe-9335-d53c8c5e291c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 11:06:04 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-b0ab2718-6c22-4af1-8c37-f077e4b5c69d tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Converting VIF {"id": "30d57100-3321-41fe-9335-d53c8c5e291c", "address": "fa:16:3e:57:7d:4b", "network": {"id": "07f1f39e-292a-4e73-b4ed-99e5799d6fa8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1339551596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71289f80a05141f482cb538dac3d7b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30d57100-33", "ovs_interfaceid": "30d57100-3321-41fe-9335-d53c8c5e291c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 11:06:04 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-b0ab2718-6c22-4af1-8c37-f077e4b5c69d tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:57:7d:4b,bridge_name='br-int',has_traffic_filtering=True,id=30d57100-3321-41fe-9335-d53c8c5e291c,network=Network(07f1f39e-292a-4e73-b4ed-99e5799d6fa8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30d57100-33') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 11:06:04 user nova-compute[71509]: DEBUG os_vif [None req-b0ab2718-6c22-4af1-8c37-f077e4b5c69d tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:57:7d:4b,bridge_name='br-int',has_traffic_filtering=True,id=30d57100-3321-41fe-9335-d53c8c5e291c,network=Network(07f1f39e-292a-4e73-b4ed-99e5799d6fa8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30d57100-33') {{(pid=71509) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 11:06:04 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-6ced92f6-fcfd-4507-9f1d-ffdc05b29b05 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T11:04:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-611211991',display_name='tempest-VolumesActionsTest-instance-611211991',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-611211991',id=40,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T11:04:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1310da753ca94b38a7c660b8613af044',ramdisk_id='',reservation_id='r-twnxtkhf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1201626915',owner_user_name='tempest-VolumesActionsTest-1201626915-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T11:04:18Z,user_data=None,user_id='282af802879e463ea87844b5fc926692',uuid=269aa265-9398-4692-8ab4-f3bf5be82714,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "71f5b8c7-15e0-485a-8632-01ed76e9ad91", "address": "fa:16:3e:36:08:6c", "network": {"id": "9614cf7a-420b-4226-9189-a89f3f4e6340", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1987410065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "1310da753ca94b38a7c660b8613af044", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71f5b8c7-15", "ovs_interfaceid": "71f5b8c7-15e0-485a-8632-01ed76e9ad91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 11:06:04 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-6ced92f6-fcfd-4507-9f1d-ffdc05b29b05 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Converting VIF {"id": "71f5b8c7-15e0-485a-8632-01ed76e9ad91", "address": "fa:16:3e:36:08:6c", "network": {"id": "9614cf7a-420b-4226-9189-a89f3f4e6340", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1987410065-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "1310da753ca94b38a7c660b8613af044", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71f5b8c7-15", "ovs_interfaceid": "71f5b8c7-15e0-485a-8632-01ed76e9ad91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 11:06:04 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-6ced92f6-fcfd-4507-9f1d-ffdc05b29b05 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:08:6c,bridge_name='br-int',has_traffic_filtering=True,id=71f5b8c7-15e0-485a-8632-01ed76e9ad91,network=Network(9614cf7a-420b-4226-9189-a89f3f4e6340),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71f5b8c7-15') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 11:06:04 user nova-compute[71509]: DEBUG os_vif [None req-6ced92f6-fcfd-4507-9f1d-ffdc05b29b05 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:08:6c,bridge_name='br-int',has_traffic_filtering=True,id=71f5b8c7-15e0-485a-8632-01ed76e9ad91,network=Network(9614cf7a-420b-4226-9189-a89f3f4e6340),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71f5b8c7-15') {{(pid=71509) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 11:06:04 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:06:04 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap30d57100-33, bridge=br-int, if_exists=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:06:04 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:06:04 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:06:04 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:06:04 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:06:04 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap71f5b8c7-15, bridge=br-int, if_exists=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:06:04 user nova-compute[71509]: INFO os_vif [None req-b0ab2718-6c22-4af1-8c37-f077e4b5c69d tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:57:7d:4b,bridge_name='br-int',has_traffic_filtering=True,id=30d57100-3321-41fe-9335-d53c8c5e291c,network=Network(07f1f39e-292a-4e73-b4ed-99e5799d6fa8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30d57100-33')
Apr 14 11:06:04 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:06:04 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:06:04 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0ab2718-6c22-4af1-8c37-f077e4b5c69d tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: 6cae9f61-763f-4671-a873-d15f01384416] calling os-brick to detach iSCSI Volume {{(pid=71509) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 11:06:04 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0ab2718-6c22-4af1-8c37-f077e4b5c69d tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0bf0749390>, {'target_iqn': 'iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BvhFzdPu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd': {}}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 11:06:04 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-b0ab2718-6c22-4af1-8c37-f077e4b5c69d tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 11:06:04 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-b0ab2718-6c22-4af1-8c37-f077e4b5c69d tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 11:06:04 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-b0ab2718-6c22-4af1-8c37-f077e4b5c69d tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 11:06:04 user nova-compute[71509]: INFO os_vif [None req-6ced92f6-fcfd-4507-9f1d-ffdc05b29b05 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:08:6c,bridge_name='br-int',has_traffic_filtering=True,id=71f5b8c7-15e0-485a-8632-01ed76e9ad91,network=Network(9614cf7a-420b-4226-9189-a89f3f4e6340),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71f5b8c7-15')
Apr 14 11:06:04 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-6ced92f6-fcfd-4507-9f1d-ffdc05b29b05 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] [instance: 269aa265-9398-4692-8ab4-f3bf5be82714] Deleting instance files /opt/stack/data/nova/instances/269aa265-9398-4692-8ab4-f3bf5be82714_del
Apr 14 11:06:04 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-6ced92f6-fcfd-4507-9f1d-ffdc05b29b05 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] [instance: 269aa265-9398-4692-8ab4-f3bf5be82714] Deletion of /opt/stack/data/nova/instances/269aa265-9398-4692-8ab4-f3bf5be82714_del complete
Apr 14 11:06:04 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:06:04 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:06:04 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b76abec-cf36-4ad8-94b3-61b8924509a3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:06:04 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0ab2718-6c22-4af1-8c37-f077e4b5c69d tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 11:06:04 user nova-compute[71509]: No targets found.
Apr 14 11:06:04 user nova-compute[71509]: iSNS:
Apr 14 11:06:04 user nova-compute[71509]: No targets found.
Apr 14 11:06:04 user nova-compute[71509]: STATIC:
Apr 14 11:06:04 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178
Apr 14 11:06:04 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 11:06:04 user nova-compute[71509]:                 Iface Name: default
Apr 14 11:06:04 user nova-compute[71509]: FIRMWARE:
Apr 14 11:06:04 user nova-compute[71509]: No targets found.
Apr 14 11:06:04 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 11:06:04 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0ab2718-6c22-4af1-8c37-f077e4b5c69d tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 11:06:04 user nova-compute[71509]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 11:06:04 user nova-compute[71509]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71509) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 11:06:04 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0ab2718-6c22-4af1-8c37-f077e4b5c69d tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178', 0)] {{(pid=71509) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 11:06:04 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:06:04 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:06:04 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[74a0891f-2b4c-4bac-a00f-796cdeba3b75]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:06:04 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:06:04 user nova-compute[71509]: INFO nova.compute.manager [None req-6ced92f6-fcfd-4507-9f1d-ffdc05b29b05 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] [instance: 269aa265-9398-4692-8ab4-f3bf5be82714] Took 0.70 seconds to destroy the instance on the hypervisor.
Apr 14 11:06:04 user nova-compute[71509]: DEBUG oslo.service.loopingcall [None req-6ced92f6-fcfd-4507-9f1d-ffdc05b29b05 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71509) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 11:06:04 user nova-compute[71509]: DEBUG nova.compute.manager [-] [instance: 269aa265-9398-4692-8ab4-f3bf5be82714] Deallocating network for instance {{(pid=71509) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 11:06:04 user nova-compute[71509]: DEBUG nova.network.neutron [-] [instance: 269aa265-9398-4692-8ab4-f3bf5be82714] deallocate_for_instance() {{(pid=71509) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 11:06:04 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:06:04 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[78fbc1bd-381b-4a33-8b99-920839f523c5]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:06:04 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0ab2718-6c22-4af1-8c37-f077e4b5c69d tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)
Apr 14 11:06:04 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 11:06:04 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0ab2718-6c22-4af1-8c37-f077e4b5c69d tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 (non-flash)
Apr 14 11:06:04 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 11:06:04 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0ab2718-6c22-4af1-8c37-f077e4b5c69d tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0c3a897010>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178'): ({'sdd'}, set())}) {{(pid=71509) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 11:06:04 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-b0ab2718-6c22-4af1-8c37-f077e4b5c69d tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Removing single pathed devices sdd {{(pid=71509) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 11:06:04 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:06:04 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:06:04 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7d1c66a-b4f7-4f29-a6d1-490e5ba0015f]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:06:04 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:06:04 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:06:04 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[2280ef55-d9a9-49f3-b3eb-f7b04c6f2ac8]: (4, ('ok\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:06:04 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-b0ab2718-6c22-4af1-8c37-f077e4b5c69d tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Flushing IO for device /dev/sdd {{(pid=71509) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 11:06:04 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:06:04 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:06:04 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c9bc6ab-94cb-41cf-9678-e9460e760fc5]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:06:04 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-b0ab2718-6c22-4af1-8c37-f077e4b5c69d tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=71509) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 11:06:04 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:06:04 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.226s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:06:04 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[0369d571-41d1-4bc5-a441-499fb6b9c0da]: (4, ('1', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:06:04 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-b0ab2718-6c22-4af1-8c37-f077e4b5c69d tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=71509) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 11:06:04 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-b0ab2718-6c22-4af1-8c37-f077e4b5c69d tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] SCSI volumes sdd have been removed. {{(pid=71509) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 11:06:04 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0ab2718-6c22-4af1-8c37-f077e4b5c69d tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178')] {{(pid=71509) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 11:06:04 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:06:04 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:06:04 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e27ac05-1b7b-47a3-80d6-ec3c948dfcff]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:06:04 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0ab2718-6c22-4af1-8c37-f077e4b5c69d tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:06:04 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 -p 172.16.0.220:3260 --logout {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:06:04 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:06:04 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[707ee152-5405-4447-b124-d4d0eedb0569]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:06:04 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0ab2718-6c22-4af1-8c37-f077e4b5c69d tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178, portal: 172.16.0.220,3260]
Apr 14 11:06:04 user nova-compute[71509]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178, portal: 172.16.0.220,3260] successful.
Apr 14 11:06:04 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:06:04 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 -p 172.16.0.220:3260 --op delete {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:06:04 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00c6dcaa-8222-45d7-a3a2-c110834bd178 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:06:04 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[bee45306-97ed-4bce-bd2c-4f482458a6a6]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:06:04 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0ab2718-6c22-4af1-8c37-f077e4b5c69d tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:06:04 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-b0ab2718-6c22-4af1-8c37-f077e4b5c69d tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.497s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 11:06:04 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0ab2718-6c22-4af1-8c37-f077e4b5c69d tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] <== disconnect_volume: return (498ms) None {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 11:06:04 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0ab2718-6c22-4af1-8c37-f077e4b5c69d tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: 6cae9f61-763f-4671-a873-d15f01384416] Disconnected iSCSI Volume {{(pid=71509) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 11:06:04 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-b0ab2718-6c22-4af1-8c37-f077e4b5c69d tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: 6cae9f61-763f-4671-a873-d15f01384416] Deleting instance files /opt/stack/data/nova/instances/6cae9f61-763f-4671-a873-d15f01384416_del
Apr 14 11:06:04 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-b0ab2718-6c22-4af1-8c37-f077e4b5c69d tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: 6cae9f61-763f-4671-a873-d15f01384416] Deletion of /opt/stack/data/nova/instances/6cae9f61-763f-4671-a873-d15f01384416_del complete
Apr 14 11:06:04 user nova-compute[71509]: INFO nova.compute.manager [None req-b0ab2718-6c22-4af1-8c37-f077e4b5c69d tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: 6cae9f61-763f-4671-a873-d15f01384416] Took 1.89 seconds to destroy the instance on the hypervisor.
Apr 14 11:06:04 user nova-compute[71509]: DEBUG oslo.service.loopingcall [None req-b0ab2718-6c22-4af1-8c37-f077e4b5c69d tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71509) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 11:06:04 user nova-compute[71509]: DEBUG nova.compute.manager [-] [instance: 6cae9f61-763f-4671-a873-d15f01384416] Deallocating network for instance {{(pid=71509) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 11:06:04 user nova-compute[71509]: DEBUG nova.network.neutron [-] [instance: 6cae9f61-763f-4671-a873-d15f01384416] deallocate_for_instance() {{(pid=71509) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 11:06:05 user nova-compute[71509]: DEBUG nova.network.neutron [-] [instance: 269aa265-9398-4692-8ab4-f3bf5be82714] Updating instance_info_cache with network_info: [] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:06:05 user nova-compute[71509]: INFO nova.compute.manager [-] [instance: 269aa265-9398-4692-8ab4-f3bf5be82714] Took 0.64 seconds to deallocate network for instance.
Apr 14 11:06:05 user nova-compute[71509]: DEBUG nova.compute.manager [req-f1291355-face-4f5a-9c56-f7426035b0af req-7499c558-1d6b-40d9-8c31-99be2663045d service nova] [instance: 269aa265-9398-4692-8ab4-f3bf5be82714] Received event network-vif-deleted-71f5b8c7-15e0-485a-8632-01ed76e9ad91 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:06:05 user nova-compute[71509]: INFO nova.compute.manager [req-f1291355-face-4f5a-9c56-f7426035b0af req-7499c558-1d6b-40d9-8c31-99be2663045d service nova] [instance: 269aa265-9398-4692-8ab4-f3bf5be82714] Neutron deleted interface 71f5b8c7-15e0-485a-8632-01ed76e9ad91; detaching it from the instance and deleting it from the info cache
Apr 14 11:06:05 user nova-compute[71509]: DEBUG nova.network.neutron [req-f1291355-face-4f5a-9c56-f7426035b0af req-7499c558-1d6b-40d9-8c31-99be2663045d service nova] [instance: 269aa265-9398-4692-8ab4-f3bf5be82714] Updating instance_info_cache with network_info: [] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:06:05 user nova-compute[71509]: DEBUG nova.compute.manager [req-f1291355-face-4f5a-9c56-f7426035b0af req-7499c558-1d6b-40d9-8c31-99be2663045d service nova] [instance: 269aa265-9398-4692-8ab4-f3bf5be82714] Detach interface failed, port_id=71f5b8c7-15e0-485a-8632-01ed76e9ad91, reason: Instance 269aa265-9398-4692-8ab4-f3bf5be82714 could not be found. {{(pid=71509) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 11:06:05 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-6ced92f6-fcfd-4507-9f1d-ffdc05b29b05 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:06:05 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-6ced92f6-fcfd-4507-9f1d-ffdc05b29b05 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:06:05 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-6ced92f6-fcfd-4507-9f1d-ffdc05b29b05 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 11:06:05 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-6ced92f6-fcfd-4507-9f1d-ffdc05b29b05 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 11:06:05 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-6ced92f6-fcfd-4507-9f1d-ffdc05b29b05 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.186s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:06:05 user nova-compute[71509]: DEBUG nova.compute.manager [req-429748b5-e4e6-42fa-b15a-cc604e2ea479 req-01306de4-126f-40ec-b4f3-45d759855f6c service nova] [instance: 6cae9f61-763f-4671-a873-d15f01384416] Received event network-vif-plugged-30d57100-3321-41fe-9335-d53c8c5e291c {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:06:05 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-429748b5-e4e6-42fa-b15a-cc604e2ea479 req-01306de4-126f-40ec-b4f3-45d759855f6c service nova] Acquiring lock "6cae9f61-763f-4671-a873-d15f01384416-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:06:05 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-429748b5-e4e6-42fa-b15a-cc604e2ea479 req-01306de4-126f-40ec-b4f3-45d759855f6c service nova] Lock "6cae9f61-763f-4671-a873-d15f01384416-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:06:05 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-429748b5-e4e6-42fa-b15a-cc604e2ea479 req-01306de4-126f-40ec-b4f3-45d759855f6c service nova] Lock "6cae9f61-763f-4671-a873-d15f01384416-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:06:05 user nova-compute[71509]: DEBUG nova.compute.manager [req-429748b5-e4e6-42fa-b15a-cc604e2ea479 req-01306de4-126f-40ec-b4f3-45d759855f6c service nova] [instance: 6cae9f61-763f-4671-a873-d15f01384416] No waiting events found dispatching network-vif-plugged-30d57100-3321-41fe-9335-d53c8c5e291c {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:06:05 user nova-compute[71509]: WARNING nova.compute.manager [req-429748b5-e4e6-42fa-b15a-cc604e2ea479 req-01306de4-126f-40ec-b4f3-45d759855f6c service nova] [instance: 6cae9f61-763f-4671-a873-d15f01384416] Received unexpected event network-vif-plugged-30d57100-3321-41fe-9335-d53c8c5e291c for instance with vm_state active and task_state deleting.
Apr 14 11:06:05 user nova-compute[71509]: DEBUG nova.compute.manager [req-429748b5-e4e6-42fa-b15a-cc604e2ea479 req-01306de4-126f-40ec-b4f3-45d759855f6c service nova] [instance: 269aa265-9398-4692-8ab4-f3bf5be82714] Received event network-vif-unplugged-71f5b8c7-15e0-485a-8632-01ed76e9ad91 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:06:05 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-429748b5-e4e6-42fa-b15a-cc604e2ea479 req-01306de4-126f-40ec-b4f3-45d759855f6c service nova] Acquiring lock "269aa265-9398-4692-8ab4-f3bf5be82714-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:06:05 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-429748b5-e4e6-42fa-b15a-cc604e2ea479 req-01306de4-126f-40ec-b4f3-45d759855f6c service nova] Lock "269aa265-9398-4692-8ab4-f3bf5be82714-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:06:05 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-429748b5-e4e6-42fa-b15a-cc604e2ea479 req-01306de4-126f-40ec-b4f3-45d759855f6c service nova] Lock "269aa265-9398-4692-8ab4-f3bf5be82714-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:06:05 user nova-compute[71509]: DEBUG nova.compute.manager [req-429748b5-e4e6-42fa-b15a-cc604e2ea479 req-01306de4-126f-40ec-b4f3-45d759855f6c service nova] [instance: 269aa265-9398-4692-8ab4-f3bf5be82714] No waiting events found dispatching network-vif-unplugged-71f5b8c7-15e0-485a-8632-01ed76e9ad91 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:06:05 user nova-compute[71509]: WARNING nova.compute.manager [req-429748b5-e4e6-42fa-b15a-cc604e2ea479 req-01306de4-126f-40ec-b4f3-45d759855f6c service nova] [instance: 269aa265-9398-4692-8ab4-f3bf5be82714] Received unexpected event network-vif-unplugged-71f5b8c7-15e0-485a-8632-01ed76e9ad91 for instance with vm_state deleted and task_state None.
Apr 14 11:06:05 user nova-compute[71509]: DEBUG nova.compute.manager [req-429748b5-e4e6-42fa-b15a-cc604e2ea479 req-01306de4-126f-40ec-b4f3-45d759855f6c service nova] [instance: 269aa265-9398-4692-8ab4-f3bf5be82714] Received event network-vif-plugged-71f5b8c7-15e0-485a-8632-01ed76e9ad91 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:06:05 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-429748b5-e4e6-42fa-b15a-cc604e2ea479 req-01306de4-126f-40ec-b4f3-45d759855f6c service nova] Acquiring lock "269aa265-9398-4692-8ab4-f3bf5be82714-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:06:05 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-429748b5-e4e6-42fa-b15a-cc604e2ea479 req-01306de4-126f-40ec-b4f3-45d759855f6c service nova] Lock "269aa265-9398-4692-8ab4-f3bf5be82714-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:06:05 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-429748b5-e4e6-42fa-b15a-cc604e2ea479 req-01306de4-126f-40ec-b4f3-45d759855f6c service nova] Lock "269aa265-9398-4692-8ab4-f3bf5be82714-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:06:05 user nova-compute[71509]: DEBUG nova.compute.manager [req-429748b5-e4e6-42fa-b15a-cc604e2ea479 req-01306de4-126f-40ec-b4f3-45d759855f6c service nova] [instance: 269aa265-9398-4692-8ab4-f3bf5be82714] No waiting events found dispatching network-vif-plugged-71f5b8c7-15e0-485a-8632-01ed76e9ad91 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:06:05 user nova-compute[71509]: WARNING nova.compute.manager [req-429748b5-e4e6-42fa-b15a-cc604e2ea479 req-01306de4-126f-40ec-b4f3-45d759855f6c service nova] [instance: 269aa265-9398-4692-8ab4-f3bf5be82714] Received unexpected event network-vif-plugged-71f5b8c7-15e0-485a-8632-01ed76e9ad91 for instance with vm_state deleted and task_state None.
Apr 14 11:06:05 user nova-compute[71509]: DEBUG nova.compute.manager [req-429748b5-e4e6-42fa-b15a-cc604e2ea479 req-01306de4-126f-40ec-b4f3-45d759855f6c service nova] [instance: 269aa265-9398-4692-8ab4-f3bf5be82714] Received event network-vif-plugged-71f5b8c7-15e0-485a-8632-01ed76e9ad91 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:06:05 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-429748b5-e4e6-42fa-b15a-cc604e2ea479 req-01306de4-126f-40ec-b4f3-45d759855f6c service nova] Acquiring lock "269aa265-9398-4692-8ab4-f3bf5be82714-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:06:05 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-429748b5-e4e6-42fa-b15a-cc604e2ea479 req-01306de4-126f-40ec-b4f3-45d759855f6c service nova] Lock "269aa265-9398-4692-8ab4-f3bf5be82714-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:06:05 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-429748b5-e4e6-42fa-b15a-cc604e2ea479 req-01306de4-126f-40ec-b4f3-45d759855f6c service nova] Lock "269aa265-9398-4692-8ab4-f3bf5be82714-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:06:05 user nova-compute[71509]: DEBUG nova.compute.manager [req-429748b5-e4e6-42fa-b15a-cc604e2ea479 req-01306de4-126f-40ec-b4f3-45d759855f6c service nova] [instance: 269aa265-9398-4692-8ab4-f3bf5be82714] No waiting events found dispatching network-vif-plugged-71f5b8c7-15e0-485a-8632-01ed76e9ad91 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:06:05 user nova-compute[71509]: WARNING nova.compute.manager [req-429748b5-e4e6-42fa-b15a-cc604e2ea479 req-01306de4-126f-40ec-b4f3-45d759855f6c service nova] [instance: 269aa265-9398-4692-8ab4-f3bf5be82714] Received unexpected event network-vif-plugged-71f5b8c7-15e0-485a-8632-01ed76e9ad91 for instance with vm_state deleted and task_state None.
Apr 14 11:06:05 user nova-compute[71509]: DEBUG nova.compute.manager [req-429748b5-e4e6-42fa-b15a-cc604e2ea479 req-01306de4-126f-40ec-b4f3-45d759855f6c service nova] [instance: 269aa265-9398-4692-8ab4-f3bf5be82714] Received event network-vif-plugged-71f5b8c7-15e0-485a-8632-01ed76e9ad91 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:06:05 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-429748b5-e4e6-42fa-b15a-cc604e2ea479 req-01306de4-126f-40ec-b4f3-45d759855f6c service nova] Acquiring lock "269aa265-9398-4692-8ab4-f3bf5be82714-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:06:05 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-429748b5-e4e6-42fa-b15a-cc604e2ea479 req-01306de4-126f-40ec-b4f3-45d759855f6c service nova] Lock "269aa265-9398-4692-8ab4-f3bf5be82714-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:06:05 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-429748b5-e4e6-42fa-b15a-cc604e2ea479 req-01306de4-126f-40ec-b4f3-45d759855f6c service nova] Lock "269aa265-9398-4692-8ab4-f3bf5be82714-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:06:05 user nova-compute[71509]: DEBUG nova.compute.manager [req-429748b5-e4e6-42fa-b15a-cc604e2ea479 req-01306de4-126f-40ec-b4f3-45d759855f6c service nova] [instance: 269aa265-9398-4692-8ab4-f3bf5be82714] No waiting events found dispatching network-vif-plugged-71f5b8c7-15e0-485a-8632-01ed76e9ad91 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:06:05 user nova-compute[71509]: WARNING nova.compute.manager [req-429748b5-e4e6-42fa-b15a-cc604e2ea479 req-01306de4-126f-40ec-b4f3-45d759855f6c service nova] [instance: 269aa265-9398-4692-8ab4-f3bf5be82714] Received unexpected event network-vif-plugged-71f5b8c7-15e0-485a-8632-01ed76e9ad91 for instance with vm_state deleted and task_state None.
Apr 14 11:06:05 user nova-compute[71509]: INFO nova.scheduler.client.report [None req-6ced92f6-fcfd-4507-9f1d-ffdc05b29b05 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Deleted allocations for instance 269aa265-9398-4692-8ab4-f3bf5be82714
Apr 14 11:06:05 user nova-compute[71509]: DEBUG nova.network.neutron [-] [instance: 6cae9f61-763f-4671-a873-d15f01384416] Updating instance_info_cache with network_info: [] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:06:05 user nova-compute[71509]: INFO nova.compute.manager [-] [instance: 6cae9f61-763f-4671-a873-d15f01384416] Took 0.50 seconds to deallocate network for instance.
Apr 14 11:06:05 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-6ced92f6-fcfd-4507-9f1d-ffdc05b29b05 tempest-VolumesActionsTest-1201626915 tempest-VolumesActionsTest-1201626915-project-member] Lock "269aa265-9398-4692-8ab4-f3bf5be82714" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.722s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:06:05 user nova-compute[71509]: DEBUG nova.compute.manager [req-c1f9247a-56e1-4c3d-836c-7b6261d55900 req-50cae9de-16d5-4f11-96e3-cf12b6736e60 service nova] [instance: 6cae9f61-763f-4671-a873-d15f01384416] Received event network-vif-deleted-30d57100-3321-41fe-9335-d53c8c5e291c {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:06:06 user nova-compute[71509]: INFO nova.compute.manager [None req-b0ab2718-6c22-4af1-8c37-f077e4b5c69d tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: 6cae9f61-763f-4671-a873-d15f01384416] Took 0.82 seconds to detach 1 volumes for instance.
Apr 14 11:06:06 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-b0ab2718-6c22-4af1-8c37-f077e4b5c69d tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:06:06 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-b0ab2718-6c22-4af1-8c37-f077e4b5c69d tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:06:06 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-b0ab2718-6c22-4af1-8c37-f077e4b5c69d tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 11:06:06 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-b0ab2718-6c22-4af1-8c37-f077e4b5c69d tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 11:06:06 user nova-compute[71509]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681470351.6430464, 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3 => Stopped> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 11:06:06 user nova-compute[71509]: INFO nova.compute.manager [-] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] VM Stopped (Lifecycle Event)
Apr 14 11:06:06 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-b0ab2718-6c22-4af1-8c37-f077e4b5c69d tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.441s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:06:06 user nova-compute[71509]: DEBUG nova.compute.manager [None req-78f1348f-4878-4384-b9b5-eb07ed4e9893 None None] [instance: 9c4cc2a1-0c54-4f20-b33f-9085af7b10a3] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 11:06:06 user nova-compute[71509]: INFO nova.scheduler.client.report [None req-b0ab2718-6c22-4af1-8c37-f077e4b5c69d tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Deleted allocations for instance 6cae9f61-763f-4671-a873-d15f01384416
Apr 14 11:06:06 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-b0ab2718-6c22-4af1-8c37-f077e4b5c69d tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "6cae9f61-763f-4671-a873-d15f01384416" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.860s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:06:09 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:06:14 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:06:18 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:06:19 user nova-compute[71509]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681470364.275703, 6cae9f61-763f-4671-a873-d15f01384416 => Stopped> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 11:06:19 user nova-compute[71509]: INFO nova.compute.manager [-] [instance: 6cae9f61-763f-4671-a873-d15f01384416] VM Stopped (Lifecycle Event)
Apr 14 11:06:19 user nova-compute[71509]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681470364.2888792, 269aa265-9398-4692-8ab4-f3bf5be82714 => Stopped> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 11:06:19 user nova-compute[71509]: INFO nova.compute.manager [-] [instance: 269aa265-9398-4692-8ab4-f3bf5be82714] VM Stopped (Lifecycle Event)
Apr 14 11:06:19 user nova-compute[71509]: DEBUG nova.compute.manager [None req-73700f5a-292d-4440-ba2e-6742bca85923 None None] [instance: 6cae9f61-763f-4671-a873-d15f01384416] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 11:06:19 user nova-compute[71509]: DEBUG nova.compute.manager [None req-cf52516f-03f6-481a-8eea-60783663424e None None] [instance: 269aa265-9398-4692-8ab4-f3bf5be82714] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 11:06:19 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:06:20 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:06:23 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:06:24 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:06:24 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:06:25 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:06:26 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:06:28 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:06:29 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:06:33 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:06:34 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:06:35 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-dc00e960-930f-440e-a1b0-86755b9c8ac1 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "0dd9e11f-1fed-42af-ad5c-9cdd051b93e7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:06:35 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-dc00e960-930f-440e-a1b0-86755b9c8ac1 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "0dd9e11f-1fed-42af-ad5c-9cdd051b93e7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:06:35 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-dc00e960-930f-440e-a1b0-86755b9c8ac1 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "0dd9e11f-1fed-42af-ad5c-9cdd051b93e7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:06:35 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-dc00e960-930f-440e-a1b0-86755b9c8ac1 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "0dd9e11f-1fed-42af-ad5c-9cdd051b93e7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:06:35 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-dc00e960-930f-440e-a1b0-86755b9c8ac1 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "0dd9e11f-1fed-42af-ad5c-9cdd051b93e7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:06:35 user nova-compute[71509]: INFO nova.compute.manager [None req-dc00e960-930f-440e-a1b0-86755b9c8ac1 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 0dd9e11f-1fed-42af-ad5c-9cdd051b93e7] Terminating instance
Apr 14 11:06:35 user nova-compute[71509]: DEBUG nova.compute.manager [None req-dc00e960-930f-440e-a1b0-86755b9c8ac1 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 0dd9e11f-1fed-42af-ad5c-9cdd051b93e7] Start destroying the instance on the hypervisor. {{(pid=71509) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 11:06:35 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:06:35 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:06:35 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:06:35 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: 0dd9e11f-1fed-42af-ad5c-9cdd051b93e7] Instance destroyed successfully.
Apr 14 11:06:35 user nova-compute[71509]: DEBUG nova.objects.instance [None req-dc00e960-930f-440e-a1b0-86755b9c8ac1 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lazy-loading 'resources' on Instance uuid 0dd9e11f-1fed-42af-ad5c-9cdd051b93e7 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 11:06:36 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-dc00e960-930f-440e-a1b0-86755b9c8ac1 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T10:57:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestJSON-server-1174054965',display_name='tempest-ServerActionsTestJSON-server-1174054965',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serveractionstestjson-server-1174054965',id=30,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNt/FyD1XXsxB5kJC+SJ1dgkjoXXHkL+KX0Cr5HvI72xTIz+DAtuVRPHeIpMNLt39mbbZ9KAoCJibRQza0Qbd8j8EEoV7QHombhWz2Mdusr+gJ2OYTqrrRzVbjIHACTFWw==',key_name='tempest-keypair-1544270235',keypairs=<?>,launch_index=0,launched_at=2023-04-14T10:57:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3ea2cb4dfa5b4a52b658efd8f5aefb36',ramdisk_id='',reservation_id='r-bb9gxkx7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestJSON-1923052090',owner_user_name='tempest-ServerActionsTestJSON-1923052090-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T10:57:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5873a358bf544691b12cd2979f5e36dc',uuid=0dd9e11f-1fed-42af-ad5c-9cdd051b93e7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ec941aab-7c95-415b-96bc-e74ebaeb9385", "address": "fa:16:3e:31:a2:13", "network": {"id": "18a91434-637b-4c19-a97b-736b32c1ea5a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1824162811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea2cb4dfa5b4a52b658efd8f5aefb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec941aab-7c", "ovs_interfaceid": "ec941aab-7c95-415b-96bc-e74ebaeb9385", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 11:06:36 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-dc00e960-930f-440e-a1b0-86755b9c8ac1 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Converting VIF {"id": "ec941aab-7c95-415b-96bc-e74ebaeb9385", "address": "fa:16:3e:31:a2:13", "network": {"id": "18a91434-637b-4c19-a97b-736b32c1ea5a", "bridge": "br-int", "label": "tempest-ServerActionsTestJSON-1824162811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ea2cb4dfa5b4a52b658efd8f5aefb36", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec941aab-7c", "ovs_interfaceid": "ec941aab-7c95-415b-96bc-e74ebaeb9385", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 11:06:36 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-dc00e960-930f-440e-a1b0-86755b9c8ac1 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:31:a2:13,bridge_name='br-int',has_traffic_filtering=True,id=ec941aab-7c95-415b-96bc-e74ebaeb9385,network=Network(18a91434-637b-4c19-a97b-736b32c1ea5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec941aab-7c') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 11:06:36 user nova-compute[71509]: DEBUG os_vif [None req-dc00e960-930f-440e-a1b0-86755b9c8ac1 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:31:a2:13,bridge_name='br-int',has_traffic_filtering=True,id=ec941aab-7c95-415b-96bc-e74ebaeb9385,network=Network(18a91434-637b-4c19-a97b-736b32c1ea5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec941aab-7c') {{(pid=71509) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 11:06:36 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:06:36 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapec941aab-7c, bridge=br-int, if_exists=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:06:36 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:06:36 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:06:36 user nova-compute[71509]: INFO os_vif [None req-dc00e960-930f-440e-a1b0-86755b9c8ac1 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:31:a2:13,bridge_name='br-int',has_traffic_filtering=True,id=ec941aab-7c95-415b-96bc-e74ebaeb9385,network=Network(18a91434-637b-4c19-a97b-736b32c1ea5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec941aab-7c')
Apr 14 11:06:36 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-dc00e960-930f-440e-a1b0-86755b9c8ac1 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 0dd9e11f-1fed-42af-ad5c-9cdd051b93e7] Deleting instance files /opt/stack/data/nova/instances/0dd9e11f-1fed-42af-ad5c-9cdd051b93e7_del
Apr 14 11:06:36 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-dc00e960-930f-440e-a1b0-86755b9c8ac1 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 0dd9e11f-1fed-42af-ad5c-9cdd051b93e7] Deletion of /opt/stack/data/nova/instances/0dd9e11f-1fed-42af-ad5c-9cdd051b93e7_del complete
Apr 14 11:06:36 user nova-compute[71509]: DEBUG nova.compute.manager [req-7f23593d-af08-4bef-a0c4-f135ee28ea61 req-b82a8722-6869-472b-b408-4dc51458a4ec service nova] [instance: 0dd9e11f-1fed-42af-ad5c-9cdd051b93e7] Received event network-vif-unplugged-ec941aab-7c95-415b-96bc-e74ebaeb9385 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:06:36 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-7f23593d-af08-4bef-a0c4-f135ee28ea61 req-b82a8722-6869-472b-b408-4dc51458a4ec service nova] Acquiring lock "0dd9e11f-1fed-42af-ad5c-9cdd051b93e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:06:36 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-7f23593d-af08-4bef-a0c4-f135ee28ea61 req-b82a8722-6869-472b-b408-4dc51458a4ec service nova] Lock "0dd9e11f-1fed-42af-ad5c-9cdd051b93e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:06:36 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-7f23593d-af08-4bef-a0c4-f135ee28ea61 req-b82a8722-6869-472b-b408-4dc51458a4ec service nova] Lock "0dd9e11f-1fed-42af-ad5c-9cdd051b93e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:06:36 user nova-compute[71509]: DEBUG nova.compute.manager [req-7f23593d-af08-4bef-a0c4-f135ee28ea61 req-b82a8722-6869-472b-b408-4dc51458a4ec service nova] [instance: 0dd9e11f-1fed-42af-ad5c-9cdd051b93e7] No waiting events found dispatching network-vif-unplugged-ec941aab-7c95-415b-96bc-e74ebaeb9385 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:06:36 user nova-compute[71509]: DEBUG nova.compute.manager [req-7f23593d-af08-4bef-a0c4-f135ee28ea61 req-b82a8722-6869-472b-b408-4dc51458a4ec service nova] [instance: 0dd9e11f-1fed-42af-ad5c-9cdd051b93e7] Received event network-vif-unplugged-ec941aab-7c95-415b-96bc-e74ebaeb9385 for instance with task_state deleting. {{(pid=71509) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 11:06:36 user nova-compute[71509]: INFO nova.compute.manager [None req-dc00e960-930f-440e-a1b0-86755b9c8ac1 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] [instance: 0dd9e11f-1fed-42af-ad5c-9cdd051b93e7] Took 0.72 seconds to destroy the instance on the hypervisor.
Apr 14 11:06:36 user nova-compute[71509]: DEBUG oslo.service.loopingcall [None req-dc00e960-930f-440e-a1b0-86755b9c8ac1 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71509) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 11:06:36 user nova-compute[71509]: DEBUG nova.compute.manager [-] [instance: 0dd9e11f-1fed-42af-ad5c-9cdd051b93e7] Deallocating network for instance {{(pid=71509) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 11:06:36 user nova-compute[71509]: DEBUG nova.network.neutron [-] [instance: 0dd9e11f-1fed-42af-ad5c-9cdd051b93e7] deallocate_for_instance() {{(pid=71509) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 11:06:36 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-fb5de40f-21ae-47cb-936d-ec56d06a0a6c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:06:36 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-fb5de40f-21ae-47cb-936d-ec56d06a0a6c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:06:36 user nova-compute[71509]: DEBUG nova.compute.manager [None req-fb5de40f-21ae-47cb-936d-ec56d06a0a6c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5] Starting instance... {{(pid=71509) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 11:06:36 user nova-compute[71509]: DEBUG nova.network.neutron [-] [instance: 0dd9e11f-1fed-42af-ad5c-9cdd051b93e7] Updating instance_info_cache with network_info: [] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:06:36 user nova-compute[71509]: INFO nova.compute.manager [-] [instance: 0dd9e11f-1fed-42af-ad5c-9cdd051b93e7] Took 0.62 seconds to deallocate network for instance.
Apr 14 11:06:36 user nova-compute[71509]: DEBUG nova.compute.manager [req-527c9839-675d-4380-bffd-7179d275fd62 req-ec0242c0-7b3e-402a-aaa0-edc002c778c6 service nova] [instance: 0dd9e11f-1fed-42af-ad5c-9cdd051b93e7] Received event network-vif-deleted-ec941aab-7c95-415b-96bc-e74ebaeb9385 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:06:36 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-fb5de40f-21ae-47cb-936d-ec56d06a0a6c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:06:36 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-fb5de40f-21ae-47cb-936d-ec56d06a0a6c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:06:36 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-fb5de40f-21ae-47cb-936d-ec56d06a0a6c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71509) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 11:06:36 user nova-compute[71509]: INFO nova.compute.claims [None req-fb5de40f-21ae-47cb-936d-ec56d06a0a6c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5] Claim successful on node user
Apr 14 11:06:36 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-dc00e960-930f-440e-a1b0-86755b9c8ac1 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:06:36 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-fb5de40f-21ae-47cb-936d-ec56d06a0a6c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 11:06:37 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-fb5de40f-21ae-47cb-936d-ec56d06a0a6c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 11:06:37 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-fb5de40f-21ae-47cb-936d-ec56d06a0a6c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.263s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:06:37 user nova-compute[71509]: DEBUG nova.compute.manager [None req-fb5de40f-21ae-47cb-936d-ec56d06a0a6c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5] Start building networks asynchronously for instance. {{(pid=71509) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 11:06:37 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-dc00e960-930f-440e-a1b0-86755b9c8ac1 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.224s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:06:37 user nova-compute[71509]: DEBUG nova.compute.manager [None req-fb5de40f-21ae-47cb-936d-ec56d06a0a6c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5] Allocating IP information in the background. {{(pid=71509) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 11:06:37 user nova-compute[71509]: DEBUG nova.network.neutron [None req-fb5de40f-21ae-47cb-936d-ec56d06a0a6c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5] allocate_for_instance() {{(pid=71509) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 11:06:37 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-fb5de40f-21ae-47cb-936d-ec56d06a0a6c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 11:06:37 user nova-compute[71509]: DEBUG nova.compute.manager [None req-fb5de40f-21ae-47cb-936d-ec56d06a0a6c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5] Start building block device mappings for instance. {{(pid=71509) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 11:06:37 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-dc00e960-930f-440e-a1b0-86755b9c8ac1 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 11:06:37 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-dc00e960-930f-440e-a1b0-86755b9c8ac1 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 11:06:37 user nova-compute[71509]: INFO nova.virt.block_device [None req-fb5de40f-21ae-47cb-936d-ec56d06a0a6c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5] Booting with volume snapshot 24d3b48b-6ea1-489d-add9-81a2f85cc64a at /dev/vda
Apr 14 11:06:37 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-dc00e960-930f-440e-a1b0-86755b9c8ac1 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.155s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:06:37 user nova-compute[71509]: DEBUG nova.policy [None req-fb5de40f-21ae-47cb-936d-ec56d06a0a6c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c7644d02bc784e4fb74ebaaceb3affe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e7089cb52574f1daf7f578222bb7a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71509) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 11:06:37 user nova-compute[71509]: INFO nova.scheduler.client.report [None req-dc00e960-930f-440e-a1b0-86755b9c8ac1 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Deleted allocations for instance 0dd9e11f-1fed-42af-ad5c-9cdd051b93e7
Apr 14 11:06:37 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-dc00e960-930f-440e-a1b0-86755b9c8ac1 tempest-ServerActionsTestJSON-1923052090 tempest-ServerActionsTestJSON-1923052090-project-member] Lock "0dd9e11f-1fed-42af-ad5c-9cdd051b93e7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.927s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:06:37 user nova-compute[71509]: DEBUG nova.network.neutron [None req-fb5de40f-21ae-47cb-936d-ec56d06a0a6c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5] Successfully created port: 76a7a337-1fec-4cd0-b065-5788cf59e2da {{(pid=71509) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 11:06:38 user nova-compute[71509]: DEBUG nova.compute.manager [req-4abfaa77-5e31-4e85-a2e2-a65a203c70b3 req-726b2e0f-e48b-431e-a34d-8839d0abf217 service nova] [instance: 0dd9e11f-1fed-42af-ad5c-9cdd051b93e7] Received event network-vif-plugged-ec941aab-7c95-415b-96bc-e74ebaeb9385 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:06:38 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-4abfaa77-5e31-4e85-a2e2-a65a203c70b3 req-726b2e0f-e48b-431e-a34d-8839d0abf217 service nova] Acquiring lock "0dd9e11f-1fed-42af-ad5c-9cdd051b93e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:06:38 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-4abfaa77-5e31-4e85-a2e2-a65a203c70b3 req-726b2e0f-e48b-431e-a34d-8839d0abf217 service nova] Lock "0dd9e11f-1fed-42af-ad5c-9cdd051b93e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:06:38 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-4abfaa77-5e31-4e85-a2e2-a65a203c70b3 req-726b2e0f-e48b-431e-a34d-8839d0abf217 service nova] Lock "0dd9e11f-1fed-42af-ad5c-9cdd051b93e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:06:38 user nova-compute[71509]: DEBUG nova.compute.manager [req-4abfaa77-5e31-4e85-a2e2-a65a203c70b3 req-726b2e0f-e48b-431e-a34d-8839d0abf217 service nova] [instance: 0dd9e11f-1fed-42af-ad5c-9cdd051b93e7] No waiting events found dispatching network-vif-plugged-ec941aab-7c95-415b-96bc-e74ebaeb9385 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:06:38 user nova-compute[71509]: WARNING nova.compute.manager [req-4abfaa77-5e31-4e85-a2e2-a65a203c70b3 req-726b2e0f-e48b-431e-a34d-8839d0abf217 service nova] [instance: 0dd9e11f-1fed-42af-ad5c-9cdd051b93e7] Received unexpected event network-vif-plugged-ec941aab-7c95-415b-96bc-e74ebaeb9385 for instance with vm_state deleted and task_state None.
Apr 14 11:06:38 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:06:38 user nova-compute[71509]: DEBUG nova.network.neutron [None req-fb5de40f-21ae-47cb-936d-ec56d06a0a6c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5] Successfully updated port: 76a7a337-1fec-4cd0-b065-5788cf59e2da {{(pid=71509) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 11:06:38 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-fb5de40f-21ae-47cb-936d-ec56d06a0a6c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "refresh_cache-1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 11:06:38 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-fb5de40f-21ae-47cb-936d-ec56d06a0a6c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquired lock "refresh_cache-1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 11:06:38 user nova-compute[71509]: DEBUG nova.network.neutron [None req-fb5de40f-21ae-47cb-936d-ec56d06a0a6c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5] Building network info cache for instance {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 11:06:38 user nova-compute[71509]: DEBUG nova.network.neutron [None req-fb5de40f-21ae-47cb-936d-ec56d06a0a6c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5] Instance cache missing network info. {{(pid=71509) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 11:06:38 user nova-compute[71509]: DEBUG nova.compute.manager [req-00c8fd6e-7aa4-4df8-b495-88ea848dbd3e req-4d0c8537-0dc2-4039-a947-9a34e46d9107 service nova] [instance: 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5] Received event network-changed-76a7a337-1fec-4cd0-b065-5788cf59e2da {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:06:38 user nova-compute[71509]: DEBUG nova.compute.manager [req-00c8fd6e-7aa4-4df8-b495-88ea848dbd3e req-4d0c8537-0dc2-4039-a947-9a34e46d9107 service nova] [instance: 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5] Refreshing instance network info cache due to event network-changed-76a7a337-1fec-4cd0-b065-5788cf59e2da. {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 11:06:38 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-00c8fd6e-7aa4-4df8-b495-88ea848dbd3e req-4d0c8537-0dc2-4039-a947-9a34e46d9107 service nova] Acquiring lock "refresh_cache-1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 11:06:39 user nova-compute[71509]: DEBUG nova.network.neutron [None req-fb5de40f-21ae-47cb-936d-ec56d06a0a6c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5] Updating instance_info_cache with network_info: [{"id": "76a7a337-1fec-4cd0-b065-5788cf59e2da", "address": "fa:16:3e:df:77:18", "network": {"id": "6d6b6b35-b5ef-4d7c-abce-cad21cc99e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-878222456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e7089cb52574f1daf7f578222bb7a67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76a7a337-1f", "ovs_interfaceid": "76a7a337-1fec-4cd0-b065-5788cf59e2da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:06:39 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-fb5de40f-21ae-47cb-936d-ec56d06a0a6c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Releasing lock "refresh_cache-1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 11:06:39 user nova-compute[71509]: DEBUG nova.compute.manager [None req-fb5de40f-21ae-47cb-936d-ec56d06a0a6c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5] Instance network_info: |[{"id": "76a7a337-1fec-4cd0-b065-5788cf59e2da", "address": "fa:16:3e:df:77:18", "network": {"id": "6d6b6b35-b5ef-4d7c-abce-cad21cc99e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-878222456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e7089cb52574f1daf7f578222bb7a67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76a7a337-1f", "ovs_interfaceid": "76a7a337-1fec-4cd0-b065-5788cf59e2da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71509) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 11:06:39 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-00c8fd6e-7aa4-4df8-b495-88ea848dbd3e req-4d0c8537-0dc2-4039-a947-9a34e46d9107 service nova] Acquired lock "refresh_cache-1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 11:06:39 user nova-compute[71509]: DEBUG nova.network.neutron [req-00c8fd6e-7aa4-4df8-b495-88ea848dbd3e req-4d0c8537-0dc2-4039-a947-9a34e46d9107 service nova] [instance: 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5] Refreshing network info cache for port 76a7a337-1fec-4cd0-b065-5788cf59e2da {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 11:06:40 user nova-compute[71509]: DEBUG nova.network.neutron [req-00c8fd6e-7aa4-4df8-b495-88ea848dbd3e req-4d0c8537-0dc2-4039-a947-9a34e46d9107 service nova] [instance: 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5] Updated VIF entry in instance network info cache for port 76a7a337-1fec-4cd0-b065-5788cf59e2da. {{(pid=71509) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 11:06:40 user nova-compute[71509]: DEBUG nova.network.neutron [req-00c8fd6e-7aa4-4df8-b495-88ea848dbd3e req-4d0c8537-0dc2-4039-a947-9a34e46d9107 service nova] [instance: 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5] Updating instance_info_cache with network_info: [{"id": "76a7a337-1fec-4cd0-b065-5788cf59e2da", "address": "fa:16:3e:df:77:18", "network": {"id": "6d6b6b35-b5ef-4d7c-abce-cad21cc99e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-878222456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e7089cb52574f1daf7f578222bb7a67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76a7a337-1f", "ovs_interfaceid": "76a7a337-1fec-4cd0-b065-5788cf59e2da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:06:40 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-00c8fd6e-7aa4-4df8-b495-88ea848dbd3e req-4d0c8537-0dc2-4039-a947-9a34e46d9107 service nova] Releasing lock "refresh_cache-1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 11:06:41 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:06:43 user nova-compute[71509]: DEBUG os_brick.utils [None req-fb5de40f-21ae-47cb-936d-ec56d06a0a6c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 11:06:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:06:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:06:43 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[89db27e4-0369-448a-a1cc-3ba7857d6697]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50119df3c417\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:06:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:06:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:06:43 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dbc97ab-8ab6-4edf-9fdb-9d639705c4e2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:06:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:06:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:06:43 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dd4c340-aafd-4ff6-90a9-1f276ef85e7c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:06:43 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0e10df6-dbbd-45f3-bb01-cd7ebe2503e8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:06:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-fb5de40f-21ae-47cb-936d-ec56d06a0a6c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Running cmd (subprocess): nvme version {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:06:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-fb5de40f-21ae-47cb-936d-ec56d06a0a6c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] 'nvme version' failed. Not Retrying. {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 11:06:43 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fb5de40f-21ae-47cb-936d-ec56d06a0a6c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] nvme not present on system {{(pid=71509) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 11:06:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:06:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 11:06:43 user nova-compute[71509]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 11:06:43 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b71b915-fef2-4cf2-b20a-b9faf76cd6d7]: (4, '') {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:06:43 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-fb5de40f-21ae-47cb-936d-ec56d06a0a6c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71509) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 11:06:43 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-fb5de40f-21ae-47cb-936d-ec56d06a0a6c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71509) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 11:06:43 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-fb5de40f-21ae-47cb-936d-ec56d06a0a6c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] LIGHTOS: no hostnqn found. {{(pid=71509) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 11:06:43 user nova-compute[71509]: DEBUG os_brick.utils [None req-fb5de40f-21ae-47cb-936d-ec56d06a0a6c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50119df3c417', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 11:06:43 user nova-compute[71509]: DEBUG nova.virt.block_device [None req-fb5de40f-21ae-47cb-936d-ec56d06a0a6c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5] Updating existing volume attachment record: a14fc0d7-25be-4d1d-ac3c-5f0c0dc233d8 {{(pid=71509) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 11:06:43 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:06:44 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-536a2ec7-f406-4e62-87de-46eca645a7fe tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Acquiring lock "6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:06:44 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-536a2ec7-f406-4e62-87de-46eca645a7fe tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:06:44 user nova-compute[71509]: DEBUG nova.compute.manager [None req-536a2ec7-f406-4e62-87de-46eca645a7fe tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] Starting instance... {{(pid=71509) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 11:06:44 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-536a2ec7-f406-4e62-87de-46eca645a7fe tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:06:44 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-536a2ec7-f406-4e62-87de-46eca645a7fe tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:06:44 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-536a2ec7-f406-4e62-87de-46eca645a7fe tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71509) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 11:06:44 user nova-compute[71509]: INFO nova.compute.claims [None req-536a2ec7-f406-4e62-87de-46eca645a7fe tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] Claim successful on node user
Apr 14 11:06:44 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-536a2ec7-f406-4e62-87de-46eca645a7fe tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 11:06:44 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-536a2ec7-f406-4e62-87de-46eca645a7fe tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 11:06:44 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-536a2ec7-f406-4e62-87de-46eca645a7fe tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.231s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:06:44 user nova-compute[71509]: DEBUG nova.compute.manager [None req-536a2ec7-f406-4e62-87de-46eca645a7fe tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] Start building networks asynchronously for instance. {{(pid=71509) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 11:06:45 user nova-compute[71509]: DEBUG nova.compute.manager [None req-536a2ec7-f406-4e62-87de-46eca645a7fe tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] Allocating IP information in the background. {{(pid=71509) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 11:06:45 user nova-compute[71509]: DEBUG nova.network.neutron [None req-536a2ec7-f406-4e62-87de-46eca645a7fe tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] allocate_for_instance() {{(pid=71509) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 11:06:45 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-536a2ec7-f406-4e62-87de-46eca645a7fe tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 11:06:45 user nova-compute[71509]: DEBUG nova.compute.manager [None req-536a2ec7-f406-4e62-87de-46eca645a7fe tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] Start building block device mappings for instance. {{(pid=71509) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 11:06:45 user nova-compute[71509]: DEBUG nova.policy [None req-536a2ec7-f406-4e62-87de-46eca645a7fe tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '831215baa8fd4fe7ba65193bbbdad1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5809862340a84c83a772c65c77513608', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71509) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 11:06:45 user nova-compute[71509]: DEBUG nova.compute.manager [None req-536a2ec7-f406-4e62-87de-46eca645a7fe tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] Start spawning the instance on the hypervisor. {{(pid=71509) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 11:06:45 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-536a2ec7-f406-4e62-87de-46eca645a7fe tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] Creating instance directory {{(pid=71509) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 11:06:45 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-536a2ec7-f406-4e62-87de-46eca645a7fe tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] Creating image(s)
Apr 14 11:06:45 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-536a2ec7-f406-4e62-87de-46eca645a7fe tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Acquiring lock "/opt/stack/data/nova/instances/6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:06:45 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-536a2ec7-f406-4e62-87de-46eca645a7fe tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "/opt/stack/data/nova/instances/6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:06:45 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-536a2ec7-f406-4e62-87de-46eca645a7fe tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "/opt/stack/data/nova/instances/6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:06:45 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-536a2ec7-f406-4e62-87de-46eca645a7fe tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Acquiring lock "9ce66efdb94e466916ac9172290bb13aa3df5cc5" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:06:45 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-536a2ec7-f406-4e62-87de-46eca645a7fe tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "9ce66efdb94e466916ac9172290bb13aa3df5cc5" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:06:45 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:06:45 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71509) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 11:06:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-536a2ec7-f406-4e62-87de-46eca645a7fe tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ce66efdb94e466916ac9172290bb13aa3df5cc5.part --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:06:45 user nova-compute[71509]: DEBUG nova.network.neutron [None req-536a2ec7-f406-4e62-87de-46eca645a7fe tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] Successfully created port: cc02fdc1-b3b9-4ca0-937a-fdcc2a3ba608 {{(pid=71509) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 11:06:46 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-536a2ec7-f406-4e62-87de-46eca645a7fe tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ce66efdb94e466916ac9172290bb13aa3df5cc5.part --force-share --output=json" returned: 0 in 0.135s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:06:46 user nova-compute[71509]: DEBUG nova.virt.images [None req-536a2ec7-f406-4e62-87de-46eca645a7fe tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] a08e5ed8-d3a1-4c04-b424-dd862d7803ae was qcow2, converting to raw {{(pid=71509) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Apr 14 11:06:46 user nova-compute[71509]: DEBUG nova.privsep.utils [None req-536a2ec7-f406-4e62-87de-46eca645a7fe tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=71509) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Apr 14 11:06:46 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-536a2ec7-f406-4e62-87de-46eca645a7fe tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9ce66efdb94e466916ac9172290bb13aa3df5cc5.part /opt/stack/data/nova/instances/_base/9ce66efdb94e466916ac9172290bb13aa3df5cc5.converted {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:06:46 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:06:46 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:06:46 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-536a2ec7-f406-4e62-87de-46eca645a7fe tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9ce66efdb94e466916ac9172290bb13aa3df5cc5.part /opt/stack/data/nova/instances/_base/9ce66efdb94e466916ac9172290bb13aa3df5cc5.converted" returned: 0 in 0.597s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:06:46 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-536a2ec7-f406-4e62-87de-46eca645a7fe tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ce66efdb94e466916ac9172290bb13aa3df5cc5.converted --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:06:46 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-536a2ec7-f406-4e62-87de-46eca645a7fe tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ce66efdb94e466916ac9172290bb13aa3df5cc5.converted --force-share --output=json" returned: 0 in 0.159s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:06:46 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-536a2ec7-f406-4e62-87de-46eca645a7fe tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "9ce66efdb94e466916ac9172290bb13aa3df5cc5" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.565s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:06:46 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-536a2ec7-f406-4e62-87de-46eca645a7fe tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ce66efdb94e466916ac9172290bb13aa3df5cc5 --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:06:46 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-536a2ec7-f406-4e62-87de-46eca645a7fe tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ce66efdb94e466916ac9172290bb13aa3df5cc5 --force-share --output=json" returned: 0 in 0.135s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:06:46 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-536a2ec7-f406-4e62-87de-46eca645a7fe tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Acquiring lock "9ce66efdb94e466916ac9172290bb13aa3df5cc5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:06:46 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-536a2ec7-f406-4e62-87de-46eca645a7fe tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "9ce66efdb94e466916ac9172290bb13aa3df5cc5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:06:46 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-536a2ec7-f406-4e62-87de-46eca645a7fe tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ce66efdb94e466916ac9172290bb13aa3df5cc5 --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:06:46 user nova-compute[71509]: DEBUG nova.network.neutron [None req-536a2ec7-f406-4e62-87de-46eca645a7fe tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] Successfully updated port: cc02fdc1-b3b9-4ca0-937a-fdcc2a3ba608 {{(pid=71509) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 11:06:47 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-536a2ec7-f406-4e62-87de-46eca645a7fe tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Acquiring lock "refresh_cache-6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 11:06:47 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-536a2ec7-f406-4e62-87de-46eca645a7fe tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Acquired lock "refresh_cache-6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 11:06:47 user nova-compute[71509]: DEBUG nova.network.neutron [None req-536a2ec7-f406-4e62-87de-46eca645a7fe tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] Building network info cache for instance {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 11:06:47 user nova-compute[71509]: DEBUG nova.compute.manager [req-daf89855-3591-493c-a59a-76cff5bc927e req-8740317f-004b-464c-822c-393763dd55e6 service nova] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] Received event network-changed-cc02fdc1-b3b9-4ca0-937a-fdcc2a3ba608 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:06:47 user nova-compute[71509]: DEBUG nova.compute.manager [req-daf89855-3591-493c-a59a-76cff5bc927e req-8740317f-004b-464c-822c-393763dd55e6 service nova] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] Refreshing instance network info cache due to event network-changed-cc02fdc1-b3b9-4ca0-937a-fdcc2a3ba608. {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 11:06:47 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-daf89855-3591-493c-a59a-76cff5bc927e req-8740317f-004b-464c-822c-393763dd55e6 service nova] Acquiring lock "refresh_cache-6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 11:06:47 user nova-compute[71509]: DEBUG nova.network.neutron [None req-536a2ec7-f406-4e62-87de-46eca645a7fe tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] Instance cache missing network info. {{(pid=71509) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 11:06:47 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-536a2ec7-f406-4e62-87de-46eca645a7fe tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ce66efdb94e466916ac9172290bb13aa3df5cc5 --force-share --output=json" returned: 0 in 0.140s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:06:47 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-536a2ec7-f406-4e62-87de-46eca645a7fe tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9ce66efdb94e466916ac9172290bb13aa3df5cc5,backing_fmt=raw /opt/stack/data/nova/instances/6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99/disk 1073741824 {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:06:47 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-536a2ec7-f406-4e62-87de-46eca645a7fe tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9ce66efdb94e466916ac9172290bb13aa3df5cc5,backing_fmt=raw /opt/stack/data/nova/instances/6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99/disk 1073741824" returned: 0 in 0.046s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:06:47 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-536a2ec7-f406-4e62-87de-46eca645a7fe tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "9ce66efdb94e466916ac9172290bb13aa3df5cc5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.190s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:06:47 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-536a2ec7-f406-4e62-87de-46eca645a7fe tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ce66efdb94e466916ac9172290bb13aa3df5cc5 --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:06:47 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-536a2ec7-f406-4e62-87de-46eca645a7fe tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ce66efdb94e466916ac9172290bb13aa3df5cc5 --force-share --output=json" returned: 0 in 0.149s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:06:47 user nova-compute[71509]: DEBUG nova.virt.disk.api [None req-536a2ec7-f406-4e62-87de-46eca645a7fe tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99/disk. size=1073741824 {{(pid=71509) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Apr 14 11:06:47 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-536a2ec7-f406-4e62-87de-46eca645a7fe tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:06:47 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-536a2ec7-f406-4e62-87de-46eca645a7fe tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:06:47 user nova-compute[71509]: DEBUG nova.virt.disk.api [None req-536a2ec7-f406-4e62-87de-46eca645a7fe tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Cannot resize image /opt/stack/data/nova/instances/6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99/disk to a smaller size. {{(pid=71509) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Apr 14 11:06:47 user nova-compute[71509]: DEBUG nova.objects.instance [None req-536a2ec7-f406-4e62-87de-46eca645a7fe tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lazy-loading 'migration_context' on Instance uuid 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 11:06:47 user nova-compute[71509]: DEBUG nova.network.neutron [None req-536a2ec7-f406-4e62-87de-46eca645a7fe tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] Updating instance_info_cache with network_info: [{"id": "cc02fdc1-b3b9-4ca0-937a-fdcc2a3ba608", "address": "fa:16:3e:d0:2f:a0", "network": {"id": "d59680e7-ed50-4356-b665-ec64ff939708", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-598238133-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5809862340a84c83a772c65c77513608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc02fdc1-b3", "ovs_interfaceid": "cc02fdc1-b3b9-4ca0-937a-fdcc2a3ba608", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:06:47 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:06:47 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-536a2ec7-f406-4e62-87de-46eca645a7fe tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] Created local disks {{(pid=71509) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4832}}
Apr 14 11:06:47 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-536a2ec7-f406-4e62-87de-46eca645a7fe tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] Ensure instance console log exists: /opt/stack/data/nova/instances/6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99/console.log {{(pid=71509) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 11:06:47 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-536a2ec7-f406-4e62-87de-46eca645a7fe tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:06:47 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-536a2ec7-f406-4e62-87de-46eca645a7fe tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:06:47 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-536a2ec7-f406-4e62-87de-46eca645a7fe tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:06:47 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-536a2ec7-f406-4e62-87de-46eca645a7fe tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Releasing lock "refresh_cache-6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 11:06:47 user nova-compute[71509]: DEBUG nova.compute.manager [None req-536a2ec7-f406-4e62-87de-46eca645a7fe tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] Instance network_info: |[{"id": "cc02fdc1-b3b9-4ca0-937a-fdcc2a3ba608", "address": "fa:16:3e:d0:2f:a0", "network": {"id": "d59680e7-ed50-4356-b665-ec64ff939708", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-598238133-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5809862340a84c83a772c65c77513608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc02fdc1-b3", "ovs_interfaceid": "cc02fdc1-b3b9-4ca0-937a-fdcc2a3ba608", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71509) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 11:06:47 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-daf89855-3591-493c-a59a-76cff5bc927e req-8740317f-004b-464c-822c-393763dd55e6 service nova] Acquired lock "refresh_cache-6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 11:06:47 user nova-compute[71509]: DEBUG nova.network.neutron [req-daf89855-3591-493c-a59a-76cff5bc927e req-8740317f-004b-464c-822c-393763dd55e6 service nova] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] Refreshing network info cache for port cc02fdc1-b3b9-4ca0-937a-fdcc2a3ba608 {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 11:06:47 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-536a2ec7-f406-4e62-87de-46eca645a7fe tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] Start _get_guest_xml network_info=[{"id": "cc02fdc1-b3b9-4ca0-937a-fdcc2a3ba608", "address": "fa:16:3e:d0:2f:a0", "network": {"id": "d59680e7-ed50-4356-b665-ec64ff939708", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-598238133-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5809862340a84c83a772c65c77513608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc02fdc1-b3", "ovs_interfaceid": "cc02fdc1-b3b9-4ca0-937a-fdcc2a3ba608", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T11:06:42Z,direct_url=<?>,disk_format='qcow2',id=a08e5ed8-d3a1-4c04-b424-dd862d7803ae,min_disk=0,min_ram=0,name='tempest-scenario-img--1117516138',owner='5809862340a84c83a772c65c77513608',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T11:06:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'size': 0, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'encryption_options': None, 'encryption_secret_uuid': None, 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'image_id': 'a08e5ed8-d3a1-4c04-b424-dd862d7803ae'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=71509) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 11:06:47 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-536a2ec7-f406-4e62-87de-46eca645a7fe tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 11:06:47 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-536a2ec7-f406-4e62-87de-46eca645a7fe tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 11:06:47 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-536a2ec7-f406-4e62-87de-46eca645a7fe tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71509) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 11:06:47 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-536a2ec7-f406-4e62-87de-46eca645a7fe tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T10:40:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='b874c39491a2377b8490f5f1e89761a4',container_format='bare',created_at=2023-04-14T11:06:42Z,direct_url=<?>,disk_format='qcow2',id=a08e5ed8-d3a1-4c04-b424-dd862d7803ae,min_disk=0,min_ram=0,name='tempest-scenario-img--1117516138',owner='5809862340a84c83a772c65c77513608',properties=ImageMetaProps,protected=<?>,size=16300544,status='active',tags=<?>,updated_at=2023-04-14T11:06:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 11:06:47 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-536a2ec7-f406-4e62-87de-46eca645a7fe tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Flavor limits 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 11:06:47 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-536a2ec7-f406-4e62-87de-46eca645a7fe tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Image limits 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 11:06:47 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-536a2ec7-f406-4e62-87de-46eca645a7fe tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Flavor pref 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 11:06:47 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-536a2ec7-f406-4e62-87de-46eca645a7fe tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Image pref 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 11:06:47 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-536a2ec7-f406-4e62-87de-46eca645a7fe tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 11:06:47 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-536a2ec7-f406-4e62-87de-46eca645a7fe tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 11:06:47 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-536a2ec7-f406-4e62-87de-46eca645a7fe tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71509) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 11:06:47 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-536a2ec7-f406-4e62-87de-46eca645a7fe tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Got 1 possible topologies {{(pid=71509) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 11:06:47 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-536a2ec7-f406-4e62-87de-46eca645a7fe tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 11:06:47 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-536a2ec7-f406-4e62-87de-46eca645a7fe tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 11:06:47 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-536a2ec7-f406-4e62-87de-46eca645a7fe tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T11:06:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1969920784',display_name='tempest-TestMinimumBasicScenario-server-1969920784',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1969920784',id=42,image_ref='a08e5ed8-d3a1-4c04-b424-dd862d7803ae',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC6ZxpnOnwCD8++AKCw08DAo5uRuXS1qhshnTNxj6xmDqjI3Q4e5zyIEi9HPx2ijCKifpCb4oBzu+Rg40bzqM2EcC2gqsAhMQLM5Csl2BMJQ3L+MgH2g/mWsmYIR45G7+A==',key_name='tempest-TestMinimumBasicScenario-1135167667',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5809862340a84c83a772c65c77513608',ramdisk_id='',reservation_id='r-t5gwaz98',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a08e5ed8-d3a1-4c04-b424-dd862d7803ae',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-2127394977',owner_user_name='tempest-TestMinimumBasicScenario-2127394977-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T11:06:45Z,user_data=None,user_id='831215baa8fd4fe7ba65193bbbdad1b4',uuid=6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cc02fdc1-b3b9-4ca0-937a-fdcc2a3ba608", "address": "fa:16:3e:d0:2f:a0", "network": {"id": "d59680e7-ed50-4356-b665-ec64ff939708", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-598238133-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5809862340a84c83a772c65c77513608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc02fdc1-b3", "ovs_interfaceid": "cc02fdc1-b3b9-4ca0-937a-fdcc2a3ba608", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71509) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 11:06:47 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-536a2ec7-f406-4e62-87de-46eca645a7fe tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Converting VIF {"id": "cc02fdc1-b3b9-4ca0-937a-fdcc2a3ba608", "address": "fa:16:3e:d0:2f:a0", "network": {"id": "d59680e7-ed50-4356-b665-ec64ff939708", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-598238133-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5809862340a84c83a772c65c77513608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc02fdc1-b3", "ovs_interfaceid": "cc02fdc1-b3b9-4ca0-937a-fdcc2a3ba608", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 11:06:47 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-536a2ec7-f406-4e62-87de-46eca645a7fe tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:2f:a0,bridge_name='br-int',has_traffic_filtering=True,id=cc02fdc1-b3b9-4ca0-937a-fdcc2a3ba608,network=Network(d59680e7-ed50-4356-b665-ec64ff939708),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc02fdc1-b3') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 11:06:47 user nova-compute[71509]: DEBUG nova.objects.instance [None req-536a2ec7-f406-4e62-87de-46eca645a7fe tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lazy-loading 'pci_devices' on Instance uuid 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 11:06:47 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-536a2ec7-f406-4e62-87de-46eca645a7fe tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] End _get_guest_xml xml=<domain type="kvm">
Apr 14 11:06:47 user nova-compute[71509]:   <uuid>6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99</uuid>
Apr 14 11:06:47 user nova-compute[71509]:   <name>instance-0000002a</name>
Apr 14 11:06:47 user nova-compute[71509]:   <memory>131072</memory>
Apr 14 11:06:47 user nova-compute[71509]:   <vcpu>1</vcpu>
Apr 14 11:06:47 user nova-compute[71509]:   <metadata>
Apr 14 11:06:47 user nova-compute[71509]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 11:06:47 user nova-compute[71509]:       <nova:package version="0.0.0"/>
Apr 14 11:06:47 user nova-compute[71509]:       <nova:name>tempest-TestMinimumBasicScenario-server-1969920784</nova:name>
Apr 14 11:06:47 user nova-compute[71509]:       <nova:creationTime>2023-04-14 11:06:47</nova:creationTime>
Apr 14 11:06:47 user nova-compute[71509]:       <nova:flavor name="m1.nano">
Apr 14 11:06:47 user nova-compute[71509]:         <nova:memory>128</nova:memory>
Apr 14 11:06:47 user nova-compute[71509]:         <nova:disk>1</nova:disk>
Apr 14 11:06:47 user nova-compute[71509]:         <nova:swap>0</nova:swap>
Apr 14 11:06:47 user nova-compute[71509]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 11:06:47 user nova-compute[71509]:         <nova:vcpus>1</nova:vcpus>
Apr 14 11:06:47 user nova-compute[71509]:       </nova:flavor>
Apr 14 11:06:47 user nova-compute[71509]:       <nova:owner>
Apr 14 11:06:47 user nova-compute[71509]:         <nova:user uuid="831215baa8fd4fe7ba65193bbbdad1b4">tempest-TestMinimumBasicScenario-2127394977-project-member</nova:user>
Apr 14 11:06:47 user nova-compute[71509]:         <nova:project uuid="5809862340a84c83a772c65c77513608">tempest-TestMinimumBasicScenario-2127394977</nova:project>
Apr 14 11:06:47 user nova-compute[71509]:       </nova:owner>
Apr 14 11:06:47 user nova-compute[71509]:       <nova:root type="image" uuid="a08e5ed8-d3a1-4c04-b424-dd862d7803ae"/>
Apr 14 11:06:47 user nova-compute[71509]:       <nova:ports>
Apr 14 11:06:47 user nova-compute[71509]:         <nova:port uuid="cc02fdc1-b3b9-4ca0-937a-fdcc2a3ba608">
Apr 14 11:06:47 user nova-compute[71509]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Apr 14 11:06:47 user nova-compute[71509]:         </nova:port>
Apr 14 11:06:47 user nova-compute[71509]:       </nova:ports>
Apr 14 11:06:47 user nova-compute[71509]:     </nova:instance>
Apr 14 11:06:47 user nova-compute[71509]:   </metadata>
Apr 14 11:06:47 user nova-compute[71509]:   <sysinfo type="smbios">
Apr 14 11:06:47 user nova-compute[71509]:     <system>
Apr 14 11:06:47 user nova-compute[71509]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 11:06:47 user nova-compute[71509]:       <entry name="product">OpenStack Nova</entry>
Apr 14 11:06:47 user nova-compute[71509]:       <entry name="version">0.0.0</entry>
Apr 14 11:06:47 user nova-compute[71509]:       <entry name="serial">6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99</entry>
Apr 14 11:06:47 user nova-compute[71509]:       <entry name="uuid">6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99</entry>
Apr 14 11:06:47 user nova-compute[71509]:       <entry name="family">Virtual Machine</entry>
Apr 14 11:06:47 user nova-compute[71509]:     </system>
Apr 14 11:06:47 user nova-compute[71509]:   </sysinfo>
Apr 14 11:06:47 user nova-compute[71509]:   <os>
Apr 14 11:06:47 user nova-compute[71509]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 11:06:47 user nova-compute[71509]:     <boot dev="hd"/>
Apr 14 11:06:47 user nova-compute[71509]:     <smbios mode="sysinfo"/>
Apr 14 11:06:47 user nova-compute[71509]:   </os>
Apr 14 11:06:47 user nova-compute[71509]:   <features>
Apr 14 11:06:47 user nova-compute[71509]:     <acpi/>
Apr 14 11:06:47 user nova-compute[71509]:     <apic/>
Apr 14 11:06:47 user nova-compute[71509]:     <vmcoreinfo/>
Apr 14 11:06:47 user nova-compute[71509]:   </features>
Apr 14 11:06:47 user nova-compute[71509]:   <clock offset="utc">
Apr 14 11:06:47 user nova-compute[71509]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 11:06:47 user nova-compute[71509]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 11:06:47 user nova-compute[71509]:     <timer name="hpet" present="no"/>
Apr 14 11:06:47 user nova-compute[71509]:   </clock>
Apr 14 11:06:47 user nova-compute[71509]:   <cpu mode="custom" match="exact">
Apr 14 11:06:47 user nova-compute[71509]:     <model>Nehalem</model>
Apr 14 11:06:47 user nova-compute[71509]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 11:06:47 user nova-compute[71509]:   </cpu>
Apr 14 11:06:47 user nova-compute[71509]:   <devices>
Apr 14 11:06:47 user nova-compute[71509]:     <disk type="file" device="disk">
Apr 14 11:06:47 user nova-compute[71509]:       <driver name="qemu" type="qcow2" cache="none"/>
Apr 14 11:06:47 user nova-compute[71509]:       <source file="/opt/stack/data/nova/instances/6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99/disk"/>
Apr 14 11:06:47 user nova-compute[71509]:       <target dev="vda" bus="virtio"/>
Apr 14 11:06:47 user nova-compute[71509]:     </disk>
Apr 14 11:06:47 user nova-compute[71509]:     <interface type="ethernet">
Apr 14 11:06:47 user nova-compute[71509]:       <mac address="fa:16:3e:d0:2f:a0"/>
Apr 14 11:06:47 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 11:06:47 user nova-compute[71509]:       <mtu size="1442"/>
Apr 14 11:06:47 user nova-compute[71509]:       <target dev="tapcc02fdc1-b3"/>
Apr 14 11:06:47 user nova-compute[71509]:     </interface>
Apr 14 11:06:47 user nova-compute[71509]:     <serial type="pty">
Apr 14 11:06:47 user nova-compute[71509]:       <log file="/opt/stack/data/nova/instances/6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99/console.log" append="off"/>
Apr 14 11:06:47 user nova-compute[71509]:     </serial>
Apr 14 11:06:47 user nova-compute[71509]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 11:06:47 user nova-compute[71509]:     <video>
Apr 14 11:06:47 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 11:06:47 user nova-compute[71509]:     </video>
Apr 14 11:06:47 user nova-compute[71509]:     <rng model="virtio">
Apr 14 11:06:47 user nova-compute[71509]:       <backend model="random">/dev/urandom</backend>
Apr 14 11:06:47 user nova-compute[71509]:     </rng>
Apr 14 11:06:47 user nova-compute[71509]:     <controller type="usb" index="0" model="none"/>
Apr 14 11:06:47 user nova-compute[71509]:     <memballoon model="virtio">
Apr 14 11:06:47 user nova-compute[71509]:       <stats period="10"/>
Apr 14 11:06:47 user nova-compute[71509]:     </memballoon>
Apr 14 11:06:47 user nova-compute[71509]:   </devices>
Apr 14 11:06:47 user nova-compute[71509]: </domain>
Apr 14 11:06:47 user nova-compute[71509]:  {{(pid=71509) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 11:06:47 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-536a2ec7-f406-4e62-87de-46eca645a7fe tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T11:06:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1969920784',display_name='tempest-TestMinimumBasicScenario-server-1969920784',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1969920784',id=42,image_ref='a08e5ed8-d3a1-4c04-b424-dd862d7803ae',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC6ZxpnOnwCD8++AKCw08DAo5uRuXS1qhshnTNxj6xmDqjI3Q4e5zyIEi9HPx2ijCKifpCb4oBzu+Rg40bzqM2EcC2gqsAhMQLM5Csl2BMJQ3L+MgH2g/mWsmYIR45G7+A==',key_name='tempest-TestMinimumBasicScenario-1135167667',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5809862340a84c83a772c65c77513608',ramdisk_id='',reservation_id='r-t5gwaz98',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a08e5ed8-d3a1-4c04-b424-dd862d7803ae',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-2127394977',owner_user_name='tempest-TestMinimumBasicScenario-2127394977-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T11:06:45Z,user_data=None,user_id='831215baa8fd4fe7ba65193bbbdad1b4',uuid=6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cc02fdc1-b3b9-4ca0-937a-fdcc2a3ba608", "address": "fa:16:3e:d0:2f:a0", "network": {"id": "d59680e7-ed50-4356-b665-ec64ff939708", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-598238133-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5809862340a84c83a772c65c77513608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc02fdc1-b3", "ovs_interfaceid": "cc02fdc1-b3b9-4ca0-937a-fdcc2a3ba608", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 11:06:47 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-536a2ec7-f406-4e62-87de-46eca645a7fe tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Converting VIF {"id": "cc02fdc1-b3b9-4ca0-937a-fdcc2a3ba608", "address": "fa:16:3e:d0:2f:a0", "network": {"id": "d59680e7-ed50-4356-b665-ec64ff939708", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-598238133-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5809862340a84c83a772c65c77513608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc02fdc1-b3", "ovs_interfaceid": "cc02fdc1-b3b9-4ca0-937a-fdcc2a3ba608", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 11:06:47 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-536a2ec7-f406-4e62-87de-46eca645a7fe tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:2f:a0,bridge_name='br-int',has_traffic_filtering=True,id=cc02fdc1-b3b9-4ca0-937a-fdcc2a3ba608,network=Network(d59680e7-ed50-4356-b665-ec64ff939708),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc02fdc1-b3') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 11:06:47 user nova-compute[71509]: DEBUG os_vif [None req-536a2ec7-f406-4e62-87de-46eca645a7fe tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:2f:a0,bridge_name='br-int',has_traffic_filtering=True,id=cc02fdc1-b3b9-4ca0-937a-fdcc2a3ba608,network=Network(d59680e7-ed50-4356-b665-ec64ff939708),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc02fdc1-b3') {{(pid=71509) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 11:06:47 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:06:47 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:06:47 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 11:06:47 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:06:47 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcc02fdc1-b3, may_exist=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:06:47 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcc02fdc1-b3, col_values=(('external_ids', {'iface-id': 'cc02fdc1-b3b9-4ca0-937a-fdcc2a3ba608', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d0:2f:a0', 'vm-uuid': '6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99'}),)) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:06:47 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:06:47 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:06:47 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:06:47 user nova-compute[71509]: INFO os_vif [None req-536a2ec7-f406-4e62-87de-46eca645a7fe tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:2f:a0,bridge_name='br-int',has_traffic_filtering=True,id=cc02fdc1-b3b9-4ca0-937a-fdcc2a3ba608,network=Network(d59680e7-ed50-4356-b665-ec64ff939708),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc02fdc1-b3')
Apr 14 11:06:47 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-536a2ec7-f406-4e62-87de-46eca645a7fe tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] No BDM found with device name vda, not building metadata. {{(pid=71509) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 11:06:47 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-536a2ec7-f406-4e62-87de-46eca645a7fe tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] No VIF found with MAC fa:16:3e:d0:2f:a0, not building metadata {{(pid=71509) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 11:06:47 user nova-compute[71509]: DEBUG nova.compute.manager [None req-fb5de40f-21ae-47cb-936d-ec56d06a0a6c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5] Start spawning the instance on the hypervisor. {{(pid=71509) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 11:06:47 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-fb5de40f-21ae-47cb-936d-ec56d06a0a6c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5] Creating instance directory {{(pid=71509) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 11:06:47 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-fb5de40f-21ae-47cb-936d-ec56d06a0a6c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5] Creating image(s)
Apr 14 11:06:47 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-fb5de40f-21ae-47cb-936d-ec56d06a0a6c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5] Did not create local disks {{(pid=71509) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 11:06:47 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-fb5de40f-21ae-47cb-936d-ec56d06a0a6c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5] Ensure instance console log exists: /opt/stack/data/nova/instances/1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5/console.log {{(pid=71509) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 11:06:47 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-fb5de40f-21ae-47cb-936d-ec56d06a0a6c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:06:47 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-fb5de40f-21ae-47cb-936d-ec56d06a0a6c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:06:47 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-fb5de40f-21ae-47cb-936d-ec56d06a0a6c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:06:47 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-fb5de40f-21ae-47cb-936d-ec56d06a0a6c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5] Start _get_guest_xml network_info=[{"id": "76a7a337-1fec-4cd0-b065-5788cf59e2da", "address": "fa:16:3e:df:77:18", "network": {"id": "6d6b6b35-b5ef-4d7c-abce-cad21cc99e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-878222456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e7089cb52574f1daf7f578222bb7a67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76a7a337-1f", "ovs_interfaceid": "76a7a337-1fec-4cd0-b065-5788cf59e2da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'attachment_id': 'a14fc0d7-25be-4d1d-ac3c-5f0c0dc233d8', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7c842927-5996-4d6c-aa72-083cf7db0103', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'czumwfnN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5', 'attached_at': '', 'detached_at': '', 'volume_id': '7c842927-5996-4d6c-aa72-083cf7db0103', 'serial': '7c842927-5996-4d6c-aa72-083cf7db0103'}, 'disk_bus': 'virtio', 'delete_on_termination': True, 'volume_type': None} {{(pid=71509) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 11:06:47 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-fb5de40f-21ae-47cb-936d-ec56d06a0a6c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 11:06:47 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-fb5de40f-21ae-47cb-936d-ec56d06a0a6c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 11:06:47 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-fb5de40f-21ae-47cb-936d-ec56d06a0a6c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71509) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 11:06:47 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-fb5de40f-21ae-47cb-936d-ec56d06a0a6c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T10:40:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 11:06:47 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-fb5de40f-21ae-47cb-936d-ec56d06a0a6c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Flavor limits 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 11:06:47 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-fb5de40f-21ae-47cb-936d-ec56d06a0a6c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Image limits 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 11:06:47 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-fb5de40f-21ae-47cb-936d-ec56d06a0a6c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Flavor pref 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 11:06:47 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-fb5de40f-21ae-47cb-936d-ec56d06a0a6c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Image pref 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 11:06:47 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-fb5de40f-21ae-47cb-936d-ec56d06a0a6c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 11:06:47 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-fb5de40f-21ae-47cb-936d-ec56d06a0a6c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 11:06:47 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-fb5de40f-21ae-47cb-936d-ec56d06a0a6c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71509) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 11:06:47 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-fb5de40f-21ae-47cb-936d-ec56d06a0a6c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Got 1 possible topologies {{(pid=71509) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 11:06:47 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-fb5de40f-21ae-47cb-936d-ec56d06a0a6c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 11:06:47 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-fb5de40f-21ae-47cb-936d-ec56d06a0a6c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 11:06:47 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb5de40f-21ae-47cb-936d-ec56d06a0a6c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5] Calling os-brick to attach iSCSI Volume {{(pid=71509) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 11:06:47 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb5de40f-21ae-47cb-936d-ec56d06a0a6c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0bf0749390>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7c842927-5996-4d6c-aa72-083cf7db0103', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'czumwfnN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 11:06:47 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-fb5de40f-21ae-47cb-936d-ec56d06a0a6c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 11:06:47 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-fb5de40f-21ae-47cb-936d-ec56d06a0a6c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 11:06:47 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-fb5de40f-21ae-47cb-936d-ec56d06a0a6c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 11:06:47 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-fb5de40f-21ae-47cb-936d-ec56d06a0a6c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 11:06:47 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-fb5de40f-21ae-47cb-936d-ec56d06a0a6c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c842927-5996-4d6c-aa72-083cf7db0103" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 11:06:47 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-fb5de40f-21ae-47cb-936d-ec56d06a0a6c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c842927-5996-4d6c-aa72-083cf7db0103" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 11:06:47 user nova-compute[71509]: INFO os_brick.initiator.connectors.iscsi [None req-fb5de40f-21ae-47cb-936d-ec56d06a0a6c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 11:06:47 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c842927-5996-4d6c-aa72-083cf7db0103 -p 172.16.0.220:3260 {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:06:47 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c842927-5996-4d6c-aa72-083cf7db0103 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:06:47 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fcc95a6-ca82-4d80-bb13-0d90ec3e2cbf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:06:47 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb5de40f-21ae-47cb-936d-ec56d06a0a6c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 11:06:47 user nova-compute[71509]:  {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:06:47 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c842927-5996-4d6c-aa72-083cf7db0103 -p 172.16.0.220:3260 --interface default --op new {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:06:47 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c842927-5996-4d6c-aa72-083cf7db0103 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:06:47 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[601bce7d-8276-4b43-8cdb-c0ac32629f3e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7c842927-5996-4d6c-aa72-083cf7db0103] added\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:06:47 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb5de40f-21ae-47cb-936d-ec56d06a0a6c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7c842927-5996-4d6c-aa72-083cf7db0103] added
Apr 14 11:06:47 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:06:47 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c842927-5996-4d6c-aa72-083cf7db0103 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:06:47 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c842927-5996-4d6c-aa72-083cf7db0103 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:06:47 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c47a177-f2e6-42c4-95a6-01566b6027eb]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:06:47 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb5de40f-21ae-47cb-936d-ec56d06a0a6c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:06:47 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c842927-5996-4d6c-aa72-083cf7db0103 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:06:47 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c842927-5996-4d6c-aa72-083cf7db0103 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:06:47 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[84de1c4e-3196-44f4-9a9c-b81d33732e95]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:06:47 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb5de40f-21ae-47cb-936d-ec56d06a0a6c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:06:47 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c842927-5996-4d6c-aa72-083cf7db0103 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v czumwfnN {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:06:47 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c842927-5996-4d6c-aa72-083cf7db0103 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v czumwfnN" returned: 0 in 0.017s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:06:47 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[eed6d50d-8103-40af-885e-1512ea6d423f]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:06:47 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb5de40f-21ae-47cb-936d-ec56d06a0a6c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'czumwfnN'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:06:47 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c842927-5996-4d6c-aa72-083cf7db0103 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:06:47 user nova-compute[71509]: DEBUG nova.network.neutron [req-daf89855-3591-493c-a59a-76cff5bc927e req-8740317f-004b-464c-822c-393763dd55e6 service nova] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] Updated VIF entry in instance network info cache for port cc02fdc1-b3b9-4ca0-937a-fdcc2a3ba608. {{(pid=71509) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 11:06:47 user nova-compute[71509]: DEBUG nova.network.neutron [req-daf89855-3591-493c-a59a-76cff5bc927e req-8740317f-004b-464c-822c-393763dd55e6 service nova] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] Updating instance_info_cache with network_info: [{"id": "cc02fdc1-b3b9-4ca0-937a-fdcc2a3ba608", "address": "fa:16:3e:d0:2f:a0", "network": {"id": "d59680e7-ed50-4356-b665-ec64ff939708", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-598238133-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5809862340a84c83a772c65c77513608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc02fdc1-b3", "ovs_interfaceid": "cc02fdc1-b3b9-4ca0-937a-fdcc2a3ba608", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:06:47 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c842927-5996-4d6c-aa72-083cf7db0103 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:06:47 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e09a4fe-7b2b-4d51-adec-090e02c0f87d]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:06:47 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb5de40f-21ae-47cb-936d-ec56d06a0a6c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:06:47 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:06:47 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-daf89855-3591-493c-a59a-76cff5bc927e req-8740317f-004b-464c-822c-393763dd55e6 service nova] Releasing lock "refresh_cache-6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 11:06:47 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:06:47 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fa96066-88d5-4f46-967c-8a81cec95693]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:06:47 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb5de40f-21ae-47cb-936d-ec56d06a0a6c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 14 11:06:47 user nova-compute[71509]:  {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 11:06:47 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb5de40f-21ae-47cb-936d-ec56d06a0a6c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 14 11:06:47 user nova-compute[71509]:  {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 11:06:47 user nova-compute[71509]: WARNING os_brick.initiator.connectors.iscsi [None req-fb5de40f-21ae-47cb-936d-ec56d06a0a6c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 14 11:06:47 user nova-compute[71509]: 
Apr 14 11:06:47 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c842927-5996-4d6c-aa72-083cf7db0103 -p 172.16.0.220:3260 --login {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:06:47 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c842927-5996-4d6c-aa72-083cf7db0103 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:06:47 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[625978ff-7d18-4e6f-a742-f044a31a8544]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7c842927-5996-4d6c-aa72-083cf7db0103, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7c842927-5996-4d6c-aa72-083cf7db0103, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:06:47 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb5de40f-21ae-47cb-936d-ec56d06a0a6c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7c842927-5996-4d6c-aa72-083cf7db0103, portal: 172.16.0.220,3260]
Apr 14 11:06:47 user nova-compute[71509]: Login to [iface: default, target: iqn.2010-10.org.openstack:7c842927-5996-4d6c-aa72-083cf7db0103, portal: 172.16.0.220,3260] successful.
Apr 14 11:06:47 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:06:47 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c842927-5996-4d6c-aa72-083cf7db0103 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:06:47 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c842927-5996-4d6c-aa72-083cf7db0103 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:06:47 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b863075-968e-46a4-be35-9e79ea3d3ac2]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:06:47 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb5de40f-21ae-47cb-936d-ec56d06a0a6c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:06:47 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:06:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:06:48 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6406f46-9ed2-4018-ada0-9aa7597150d7]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c842927-5996-4d6c-aa72-083cf7db0103 (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:06:48 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb5de40f-21ae-47cb-936d-ec56d06a0a6c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c842927-5996-4d6c-aa72-083cf7db0103 (non-flash)
Apr 14 11:06:48 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 11:06:48 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb5de40f-21ae-47cb-936d-ec56d06a0a6c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c842927-5996-4d6c-aa72-083cf7db0103 (non-flash)
Apr 14 11:06:48 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 11:06:48 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-fb5de40f-21ae-47cb-936d-ec56d06a0a6c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c842927-5996-4d6c-aa72-083cf7db0103" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.248s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 11:06:48 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb5de40f-21ae-47cb-936d-ec56d06a0a6c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Connected to 172.16.0.220:3260 {{(pid=71509) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 11:06:48 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-fb5de40f-21ae-47cb-936d-ec56d06a0a6c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] HCTL ('33', '-', '-', 0) found on session 47 with lun 0 {{(pid=71509) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 11:06:48 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-fb5de40f-21ae-47cb-936d-ec56d06a0a6c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71509) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 11:06:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:06:48 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.036s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:06:48 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[405963cc-bd96-4965-b573-a562b886a56d]: (4, ('- - 0', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:06:48 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-fb5de40f-21ae-47cb-936d-ec56d06a0a6c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Searching for a device in session 47 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71509) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 11:06:48 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb5de40f-21ae-47cb-936d-ec56d06a0a6c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:7c842927-5996-4d6c-aa72-083cf7db0103', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'czumwfnN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71509) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 11:06:48 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:06:48 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:06:48 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:06:48 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:06:49 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-fb5de40f-21ae-47cb-936d-ec56d06a0a6c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.310s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 11:06:49 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb5de40f-21ae-47cb-936d-ec56d06a0a6c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] <== connect_volume: return (1311ms) {'type': 'block', 'scsi_wwn': '23431383465323836', 'path': '/dev/sdb'} {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 11:06:49 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb5de40f-21ae-47cb-936d-ec56d06a0a6c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23431383465323836', 'path': '/dev/sdb'} {{(pid=71509) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 11:06:49 user nova-compute[71509]: DEBUG nova.compute.manager [req-b9ffb09b-cb58-4608-8a59-ac975f37fc1a req-a50ad85d-bd06-4b06-b2cb-8e9e54e4b6b0 service nova] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] Received event network-vif-plugged-cc02fdc1-b3b9-4ca0-937a-fdcc2a3ba608 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:06:49 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-b9ffb09b-cb58-4608-8a59-ac975f37fc1a req-a50ad85d-bd06-4b06-b2cb-8e9e54e4b6b0 service nova] Acquiring lock "6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:06:49 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-b9ffb09b-cb58-4608-8a59-ac975f37fc1a req-a50ad85d-bd06-4b06-b2cb-8e9e54e4b6b0 service nova] Lock "6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:06:49 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-b9ffb09b-cb58-4608-8a59-ac975f37fc1a req-a50ad85d-bd06-4b06-b2cb-8e9e54e4b6b0 service nova] Lock "6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:06:49 user nova-compute[71509]: DEBUG nova.compute.manager [req-b9ffb09b-cb58-4608-8a59-ac975f37fc1a req-a50ad85d-bd06-4b06-b2cb-8e9e54e4b6b0 service nova] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] No waiting events found dispatching network-vif-plugged-cc02fdc1-b3b9-4ca0-937a-fdcc2a3ba608 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:06:49 user nova-compute[71509]: WARNING nova.compute.manager [req-b9ffb09b-cb58-4608-8a59-ac975f37fc1a req-a50ad85d-bd06-4b06-b2cb-8e9e54e4b6b0 service nova] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] Received unexpected event network-vif-plugged-cc02fdc1-b3b9-4ca0-937a-fdcc2a3ba608 for instance with vm_state building and task_state spawning.
Apr 14 11:06:49 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-fb5de40f-21ae-47cb-936d-ec56d06a0a6c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T11:06:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-985741733',display_name='tempest-TestVolumeBootPattern-server-985741733',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-985741733',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e7089cb52574f1daf7f578222bb7a67',ramdisk_id='',reservation_id='r-8ep8tqys',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-193101874',owner_user_name='tempest-TestVolumeBootPattern-193101874-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T11:06:37Z,user_data=None,user_id='c7644d02bc784e4fb74ebaaceb3affe1',uuid=1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "76a7a337-1fec-4cd0-b065-5788cf59e2da", "address": "fa:16:3e:df:77:18", "network": {"id": "6d6b6b35-b5ef-4d7c-abce-cad21cc99e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-878222456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e7089cb52574f1daf7f578222bb7a67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76a7a337-1f", "ovs_interfaceid": "76a7a337-1fec-4cd0-b065-5788cf59e2da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71509) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 11:06:49 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-fb5de40f-21ae-47cb-936d-ec56d06a0a6c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Converting VIF {"id": "76a7a337-1fec-4cd0-b065-5788cf59e2da", "address": "fa:16:3e:df:77:18", "network": {"id": "6d6b6b35-b5ef-4d7c-abce-cad21cc99e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-878222456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e7089cb52574f1daf7f578222bb7a67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76a7a337-1f", "ovs_interfaceid": "76a7a337-1fec-4cd0-b065-5788cf59e2da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 11:06:49 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-fb5de40f-21ae-47cb-936d-ec56d06a0a6c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:77:18,bridge_name='br-int',has_traffic_filtering=True,id=76a7a337-1fec-4cd0-b065-5788cf59e2da,network=Network(6d6b6b35-b5ef-4d7c-abce-cad21cc99e32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76a7a337-1f') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 11:06:49 user nova-compute[71509]: DEBUG nova.objects.instance [None req-fb5de40f-21ae-47cb-936d-ec56d06a0a6c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lazy-loading 'pci_devices' on Instance uuid 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 11:06:49 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-fb5de40f-21ae-47cb-936d-ec56d06a0a6c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5] End _get_guest_xml xml=<domain type="kvm">
Apr 14 11:06:49 user nova-compute[71509]:   <uuid>1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5</uuid>
Apr 14 11:06:49 user nova-compute[71509]:   <name>instance-00000029</name>
Apr 14 11:06:49 user nova-compute[71509]:   <memory>131072</memory>
Apr 14 11:06:49 user nova-compute[71509]:   <vcpu>1</vcpu>
Apr 14 11:06:49 user nova-compute[71509]:   <metadata>
Apr 14 11:06:49 user nova-compute[71509]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 11:06:49 user nova-compute[71509]:       <nova:package version="0.0.0"/>
Apr 14 11:06:49 user nova-compute[71509]:       <nova:name>tempest-TestVolumeBootPattern-server-985741733</nova:name>
Apr 14 11:06:49 user nova-compute[71509]:       <nova:creationTime>2023-04-14 11:06:47</nova:creationTime>
Apr 14 11:06:49 user nova-compute[71509]:       <nova:flavor name="m1.nano">
Apr 14 11:06:49 user nova-compute[71509]:         <nova:memory>128</nova:memory>
Apr 14 11:06:49 user nova-compute[71509]:         <nova:disk>1</nova:disk>
Apr 14 11:06:49 user nova-compute[71509]:         <nova:swap>0</nova:swap>
Apr 14 11:06:49 user nova-compute[71509]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 11:06:49 user nova-compute[71509]:         <nova:vcpus>1</nova:vcpus>
Apr 14 11:06:49 user nova-compute[71509]:       </nova:flavor>
Apr 14 11:06:49 user nova-compute[71509]:       <nova:owner>
Apr 14 11:06:49 user nova-compute[71509]:         <nova:user uuid="c7644d02bc784e4fb74ebaaceb3affe1">tempest-TestVolumeBootPattern-193101874-project-member</nova:user>
Apr 14 11:06:49 user nova-compute[71509]:         <nova:project uuid="2e7089cb52574f1daf7f578222bb7a67">tempest-TestVolumeBootPattern-193101874</nova:project>
Apr 14 11:06:49 user nova-compute[71509]:       </nova:owner>
Apr 14 11:06:49 user nova-compute[71509]:       <nova:ports>
Apr 14 11:06:49 user nova-compute[71509]:         <nova:port uuid="76a7a337-1fec-4cd0-b065-5788cf59e2da">
Apr 14 11:06:49 user nova-compute[71509]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Apr 14 11:06:49 user nova-compute[71509]:         </nova:port>
Apr 14 11:06:49 user nova-compute[71509]:       </nova:ports>
Apr 14 11:06:49 user nova-compute[71509]:     </nova:instance>
Apr 14 11:06:49 user nova-compute[71509]:   </metadata>
Apr 14 11:06:49 user nova-compute[71509]:   <sysinfo type="smbios">
Apr 14 11:06:49 user nova-compute[71509]:     <system>
Apr 14 11:06:49 user nova-compute[71509]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 11:06:49 user nova-compute[71509]:       <entry name="product">OpenStack Nova</entry>
Apr 14 11:06:49 user nova-compute[71509]:       <entry name="version">0.0.0</entry>
Apr 14 11:06:49 user nova-compute[71509]:       <entry name="serial">1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5</entry>
Apr 14 11:06:49 user nova-compute[71509]:       <entry name="uuid">1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5</entry>
Apr 14 11:06:49 user nova-compute[71509]:       <entry name="family">Virtual Machine</entry>
Apr 14 11:06:49 user nova-compute[71509]:     </system>
Apr 14 11:06:49 user nova-compute[71509]:   </sysinfo>
Apr 14 11:06:49 user nova-compute[71509]:   <os>
Apr 14 11:06:49 user nova-compute[71509]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 11:06:49 user nova-compute[71509]:     <boot dev="hd"/>
Apr 14 11:06:49 user nova-compute[71509]:     <smbios mode="sysinfo"/>
Apr 14 11:06:49 user nova-compute[71509]:   </os>
Apr 14 11:06:49 user nova-compute[71509]:   <features>
Apr 14 11:06:49 user nova-compute[71509]:     <acpi/>
Apr 14 11:06:49 user nova-compute[71509]:     <apic/>
Apr 14 11:06:49 user nova-compute[71509]:     <vmcoreinfo/>
Apr 14 11:06:49 user nova-compute[71509]:   </features>
Apr 14 11:06:49 user nova-compute[71509]:   <clock offset="utc">
Apr 14 11:06:49 user nova-compute[71509]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 11:06:49 user nova-compute[71509]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 11:06:49 user nova-compute[71509]:     <timer name="hpet" present="no"/>
Apr 14 11:06:49 user nova-compute[71509]:   </clock>
Apr 14 11:06:49 user nova-compute[71509]:   <cpu mode="custom" match="exact">
Apr 14 11:06:49 user nova-compute[71509]:     <model>Nehalem</model>
Apr 14 11:06:49 user nova-compute[71509]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 11:06:49 user nova-compute[71509]:   </cpu>
Apr 14 11:06:49 user nova-compute[71509]:   <devices>
Apr 14 11:06:49 user nova-compute[71509]:     <disk type="block" device="disk">
Apr 14 11:06:49 user nova-compute[71509]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 11:06:49 user nova-compute[71509]:       <source dev="/dev/sdb"/>
Apr 14 11:06:49 user nova-compute[71509]:       <target dev="vda" bus="virtio"/>
Apr 14 11:06:49 user nova-compute[71509]:       <serial>7c842927-5996-4d6c-aa72-083cf7db0103</serial>
Apr 14 11:06:49 user nova-compute[71509]:     </disk>
Apr 14 11:06:49 user nova-compute[71509]:     <interface type="ethernet">
Apr 14 11:06:49 user nova-compute[71509]:       <mac address="fa:16:3e:df:77:18"/>
Apr 14 11:06:49 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 11:06:49 user nova-compute[71509]:       <mtu size="1442"/>
Apr 14 11:06:49 user nova-compute[71509]:       <target dev="tap76a7a337-1f"/>
Apr 14 11:06:49 user nova-compute[71509]:     </interface>
Apr 14 11:06:49 user nova-compute[71509]:     <serial type="pty">
Apr 14 11:06:49 user nova-compute[71509]:       <log file="/opt/stack/data/nova/instances/1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5/console.log" append="off"/>
Apr 14 11:06:49 user nova-compute[71509]:     </serial>
Apr 14 11:06:49 user nova-compute[71509]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 11:06:49 user nova-compute[71509]:     <video>
Apr 14 11:06:49 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 11:06:49 user nova-compute[71509]:     </video>
Apr 14 11:06:49 user nova-compute[71509]:     <rng model="virtio">
Apr 14 11:06:49 user nova-compute[71509]:       <backend model="random">/dev/urandom</backend>
Apr 14 11:06:49 user nova-compute[71509]:     </rng>
Apr 14 11:06:49 user nova-compute[71509]:     <controller type="usb" index="0" model="none"/>
Apr 14 11:06:49 user nova-compute[71509]:     <memballoon model="virtio">
Apr 14 11:06:49 user nova-compute[71509]:       <stats period="10"/>
Apr 14 11:06:49 user nova-compute[71509]:     </memballoon>
Apr 14 11:06:49 user nova-compute[71509]:   </devices>
Apr 14 11:06:49 user nova-compute[71509]: </domain>
Apr 14 11:06:49 user nova-compute[71509]:  {{(pid=71509) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 11:06:49 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-fb5de40f-21ae-47cb-936d-ec56d06a0a6c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T11:06:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-985741733',display_name='tempest-TestVolumeBootPattern-server-985741733',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-985741733',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e7089cb52574f1daf7f578222bb7a67',ramdisk_id='',reservation_id='r-8ep8tqys',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-193101874',owner_user_name='tempest-TestVolumeBootPattern-193101874-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T11:06:37Z,user_data=None,user_id='c7644d02bc784e4fb74ebaaceb3affe1',uuid=1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "76a7a337-1fec-4cd0-b065-5788cf59e2da", "address": "fa:16:3e:df:77:18", "network": {"id": "6d6b6b35-b5ef-4d7c-abce-cad21cc99e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-878222456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e7089cb52574f1daf7f578222bb7a67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76a7a337-1f", "ovs_interfaceid": "76a7a337-1fec-4cd0-b065-5788cf59e2da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 11:06:49 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-fb5de40f-21ae-47cb-936d-ec56d06a0a6c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Converting VIF {"id": "76a7a337-1fec-4cd0-b065-5788cf59e2da", "address": "fa:16:3e:df:77:18", "network": {"id": "6d6b6b35-b5ef-4d7c-abce-cad21cc99e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-878222456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e7089cb52574f1daf7f578222bb7a67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76a7a337-1f", "ovs_interfaceid": "76a7a337-1fec-4cd0-b065-5788cf59e2da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 11:06:49 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-fb5de40f-21ae-47cb-936d-ec56d06a0a6c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:77:18,bridge_name='br-int',has_traffic_filtering=True,id=76a7a337-1fec-4cd0-b065-5788cf59e2da,network=Network(6d6b6b35-b5ef-4d7c-abce-cad21cc99e32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76a7a337-1f') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 11:06:49 user nova-compute[71509]: DEBUG os_vif [None req-fb5de40f-21ae-47cb-936d-ec56d06a0a6c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:77:18,bridge_name='br-int',has_traffic_filtering=True,id=76a7a337-1fec-4cd0-b065-5788cf59e2da,network=Network(6d6b6b35-b5ef-4d7c-abce-cad21cc99e32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76a7a337-1f') {{(pid=71509) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 11:06:49 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:06:49 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:06:49 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 11:06:49 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:06:49 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap76a7a337-1f, may_exist=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:06:49 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap76a7a337-1f, col_values=(('external_ids', {'iface-id': '76a7a337-1fec-4cd0-b065-5788cf59e2da', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:df:77:18', 'vm-uuid': '1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5'}),)) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:06:49 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:06:49 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:06:49 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:06:49 user nova-compute[71509]: INFO os_vif [None req-fb5de40f-21ae-47cb-936d-ec56d06a0a6c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:77:18,bridge_name='br-int',has_traffic_filtering=True,id=76a7a337-1fec-4cd0-b065-5788cf59e2da,network=Network(6d6b6b35-b5ef-4d7c-abce-cad21cc99e32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76a7a337-1f')
Apr 14 11:06:49 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-fb5de40f-21ae-47cb-936d-ec56d06a0a6c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] No BDM found with device name vda, not building metadata. {{(pid=71509) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 11:06:49 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-fb5de40f-21ae-47cb-936d-ec56d06a0a6c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] No VIF found with MAC fa:16:3e:df:77:18, not building metadata {{(pid=71509) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 11:06:49 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:06:49 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:06:49 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:06:49 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:06:49 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:06:50 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:06:50 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:06:50 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:06:50 user nova-compute[71509]: DEBUG nova.compute.manager [req-cce56e45-a151-43eb-a646-e09d734cce09 req-3e427141-99bc-4360-89d5-d6ca67083aed service nova] [instance: 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5] Received event network-vif-plugged-76a7a337-1fec-4cd0-b065-5788cf59e2da {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:06:50 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-cce56e45-a151-43eb-a646-e09d734cce09 req-3e427141-99bc-4360-89d5-d6ca67083aed service nova] Acquiring lock "1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:06:50 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-cce56e45-a151-43eb-a646-e09d734cce09 req-3e427141-99bc-4360-89d5-d6ca67083aed service nova] Lock "1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:06:50 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-cce56e45-a151-43eb-a646-e09d734cce09 req-3e427141-99bc-4360-89d5-d6ca67083aed service nova] Lock "1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:06:50 user nova-compute[71509]: DEBUG nova.compute.manager [req-cce56e45-a151-43eb-a646-e09d734cce09 req-3e427141-99bc-4360-89d5-d6ca67083aed service nova] [instance: 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5] No waiting events found dispatching network-vif-plugged-76a7a337-1fec-4cd0-b065-5788cf59e2da {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:06:50 user nova-compute[71509]: WARNING nova.compute.manager [req-cce56e45-a151-43eb-a646-e09d734cce09 req-3e427141-99bc-4360-89d5-d6ca67083aed service nova] [instance: 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5] Received unexpected event network-vif-plugged-76a7a337-1fec-4cd0-b065-5788cf59e2da for instance with vm_state building and task_state spawning.
Apr 14 11:06:50 user nova-compute[71509]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681470395.9901483, 0dd9e11f-1fed-42af-ad5c-9cdd051b93e7 => Stopped> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 11:06:50 user nova-compute[71509]: INFO nova.compute.manager [-] [instance: 0dd9e11f-1fed-42af-ad5c-9cdd051b93e7] VM Stopped (Lifecycle Event)
Apr 14 11:06:51 user nova-compute[71509]: DEBUG nova.compute.manager [None req-aba27d22-fc0c-43a6-8151-35e111484258 None None] [instance: 0dd9e11f-1fed-42af-ad5c-9cdd051b93e7] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 11:06:51 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:06:51 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:06:51 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:06:51 user nova-compute[71509]: DEBUG nova.compute.manager [req-0088dcee-9288-4680-ad21-1094e5e0db7b req-ff9797dc-01d2-41d6-a58c-41e28792fc11 service nova] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] Received event network-vif-plugged-cc02fdc1-b3b9-4ca0-937a-fdcc2a3ba608 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:06:51 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-0088dcee-9288-4680-ad21-1094e5e0db7b req-ff9797dc-01d2-41d6-a58c-41e28792fc11 service nova] Acquiring lock "6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:06:51 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-0088dcee-9288-4680-ad21-1094e5e0db7b req-ff9797dc-01d2-41d6-a58c-41e28792fc11 service nova] Lock "6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:06:51 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-0088dcee-9288-4680-ad21-1094e5e0db7b req-ff9797dc-01d2-41d6-a58c-41e28792fc11 service nova] Lock "6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:06:51 user nova-compute[71509]: DEBUG nova.compute.manager [req-0088dcee-9288-4680-ad21-1094e5e0db7b req-ff9797dc-01d2-41d6-a58c-41e28792fc11 service nova] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] No waiting events found dispatching network-vif-plugged-cc02fdc1-b3b9-4ca0-937a-fdcc2a3ba608 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:06:51 user nova-compute[71509]: WARNING nova.compute.manager [req-0088dcee-9288-4680-ad21-1094e5e0db7b req-ff9797dc-01d2-41d6-a58c-41e28792fc11 service nova] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] Received unexpected event network-vif-plugged-cc02fdc1-b3b9-4ca0-937a-fdcc2a3ba608 for instance with vm_state building and task_state spawning.
Apr 14 11:06:51 user nova-compute[71509]: DEBUG nova.compute.manager [None req-536a2ec7-f406-4e62-87de-46eca645a7fe tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] Instance event wait completed in 0 seconds for  {{(pid=71509) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 11:06:51 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-536a2ec7-f406-4e62-87de-46eca645a7fe tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] Guest created on hypervisor {{(pid=71509) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 11:06:51 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681470411.8749218, 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99 => Resumed> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 11:06:51 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] VM Resumed (Lifecycle Event)
Apr 14 11:06:51 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] Instance spawned successfully.
Apr 14 11:06:51 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-536a2ec7-f406-4e62-87de-46eca645a7fe tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 11:06:51 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 11:06:51 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 11:06:51 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-536a2ec7-f406-4e62-87de-46eca645a7fe tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] Found default for hw_cdrom_bus of ide {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:06:51 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-536a2ec7-f406-4e62-87de-46eca645a7fe tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] Found default for hw_disk_bus of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:06:51 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-536a2ec7-f406-4e62-87de-46eca645a7fe tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] Found default for hw_input_bus of None {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:06:51 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-536a2ec7-f406-4e62-87de-46eca645a7fe tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] Found default for hw_pointer_model of None {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:06:51 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-536a2ec7-f406-4e62-87de-46eca645a7fe tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] Found default for hw_video_model of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:06:51 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-536a2ec7-f406-4e62-87de-46eca645a7fe tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] Found default for hw_vif_model of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:06:51 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 11:06:51 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681470411.876212, 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99 => Started> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 11:06:51 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] VM Started (Lifecycle Event)
Apr 14 11:06:51 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 11:06:51 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 11:06:51 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 11:06:51 user nova-compute[71509]: INFO nova.compute.manager [None req-536a2ec7-f406-4e62-87de-46eca645a7fe tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] Took 6.75 seconds to spawn the instance on the hypervisor.
Apr 14 11:06:51 user nova-compute[71509]: DEBUG nova.compute.manager [None req-536a2ec7-f406-4e62-87de-46eca645a7fe tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 11:06:52 user nova-compute[71509]: INFO nova.compute.manager [None req-536a2ec7-f406-4e62-87de-46eca645a7fe tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] Took 7.38 seconds to build instance.
Apr 14 11:06:52 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-536a2ec7-f406-4e62-87de-46eca645a7fe tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.480s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:06:52 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:06:52 user nova-compute[71509]: DEBUG nova.compute.manager [None req-fb5de40f-21ae-47cb-936d-ec56d06a0a6c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5] Instance event wait completed in 0 seconds for  {{(pid=71509) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 11:06:52 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-fb5de40f-21ae-47cb-936d-ec56d06a0a6c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5] Guest created on hypervisor {{(pid=71509) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 11:06:52 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681470412.6564999, 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5 => Resumed> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 11:06:52 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5] VM Resumed (Lifecycle Event)
Apr 14 11:06:52 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5] Instance spawned successfully.
Apr 14 11:06:52 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-fb5de40f-21ae-47cb-936d-ec56d06a0a6c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 11:06:52 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 11:06:52 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-fb5de40f-21ae-47cb-936d-ec56d06a0a6c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5] Found default for hw_cdrom_bus of ide {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:06:52 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-fb5de40f-21ae-47cb-936d-ec56d06a0a6c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5] Found default for hw_disk_bus of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:06:52 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-fb5de40f-21ae-47cb-936d-ec56d06a0a6c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5] Found default for hw_input_bus of None {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:06:52 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-fb5de40f-21ae-47cb-936d-ec56d06a0a6c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5] Found default for hw_pointer_model of None {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:06:52 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-fb5de40f-21ae-47cb-936d-ec56d06a0a6c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5] Found default for hw_video_model of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:06:52 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-fb5de40f-21ae-47cb-936d-ec56d06a0a6c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5] Found default for hw_vif_model of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:06:52 user nova-compute[71509]: DEBUG nova.compute.manager [req-e605e675-fb54-40cf-b920-41c918cd7b09 req-81d5f6ce-bebb-4dd6-8868-4dbe3dca0a6f service nova] [instance: 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5] Received event network-vif-plugged-76a7a337-1fec-4cd0-b065-5788cf59e2da {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:06:52 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-e605e675-fb54-40cf-b920-41c918cd7b09 req-81d5f6ce-bebb-4dd6-8868-4dbe3dca0a6f service nova] Acquiring lock "1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:06:52 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-e605e675-fb54-40cf-b920-41c918cd7b09 req-81d5f6ce-bebb-4dd6-8868-4dbe3dca0a6f service nova] Lock "1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:06:52 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-e605e675-fb54-40cf-b920-41c918cd7b09 req-81d5f6ce-bebb-4dd6-8868-4dbe3dca0a6f service nova] Lock "1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:06:52 user nova-compute[71509]: DEBUG nova.compute.manager [req-e605e675-fb54-40cf-b920-41c918cd7b09 req-81d5f6ce-bebb-4dd6-8868-4dbe3dca0a6f service nova] [instance: 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5] No waiting events found dispatching network-vif-plugged-76a7a337-1fec-4cd0-b065-5788cf59e2da {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:06:52 user nova-compute[71509]: WARNING nova.compute.manager [req-e605e675-fb54-40cf-b920-41c918cd7b09 req-81d5f6ce-bebb-4dd6-8868-4dbe3dca0a6f service nova] [instance: 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5] Received unexpected event network-vif-plugged-76a7a337-1fec-4cd0-b065-5788cf59e2da for instance with vm_state building and task_state spawning.
Apr 14 11:06:52 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 11:06:52 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 11:06:52 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681470412.6577694, 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5 => Started> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 11:06:52 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5] VM Started (Lifecycle Event)
Apr 14 11:06:52 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 11:06:52 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 11:06:52 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 11:06:52 user nova-compute[71509]: INFO nova.compute.manager [None req-fb5de40f-21ae-47cb-936d-ec56d06a0a6c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5] Took 5.07 seconds to spawn the instance on the hypervisor.
Apr 14 11:06:52 user nova-compute[71509]: DEBUG nova.compute.manager [None req-fb5de40f-21ae-47cb-936d-ec56d06a0a6c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 11:06:52 user nova-compute[71509]: INFO nova.compute.manager [None req-fb5de40f-21ae-47cb-936d-ec56d06a0a6c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5] Took 16.11 seconds to build instance.
Apr 14 11:06:52 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-fb5de40f-21ae-47cb-936d-ec56d06a0a6c tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.225s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:06:53 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:06:53 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-120d98c0-7afc-48b0-87a7-d75f8bb0998f tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Acquiring lock "e479154a-acd6-47aa-9a5b-43c6e0feda07" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:06:53 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-120d98c0-7afc-48b0-87a7-d75f8bb0998f tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "e479154a-acd6-47aa-9a5b-43c6e0feda07" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:06:53 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-120d98c0-7afc-48b0-87a7-d75f8bb0998f tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Acquiring lock "e479154a-acd6-47aa-9a5b-43c6e0feda07-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:06:53 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-120d98c0-7afc-48b0-87a7-d75f8bb0998f tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "e479154a-acd6-47aa-9a5b-43c6e0feda07-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:06:53 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-120d98c0-7afc-48b0-87a7-d75f8bb0998f tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "e479154a-acd6-47aa-9a5b-43c6e0feda07-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:06:53 user nova-compute[71509]: INFO nova.compute.manager [None req-120d98c0-7afc-48b0-87a7-d75f8bb0998f tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: e479154a-acd6-47aa-9a5b-43c6e0feda07] Terminating instance
Apr 14 11:06:53 user nova-compute[71509]: DEBUG nova.compute.manager [None req-120d98c0-7afc-48b0-87a7-d75f8bb0998f tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: e479154a-acd6-47aa-9a5b-43c6e0feda07] Start destroying the instance on the hypervisor. {{(pid=71509) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 11:06:53 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:06:53 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:06:53 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:06:54 user nova-compute[71509]: DEBUG nova.compute.manager [req-bf7a516c-ea7d-4570-a8a8-d15863febe63 req-c3e8cc37-3805-4ba9-8bf7-7c760753a627 service nova] [instance: e479154a-acd6-47aa-9a5b-43c6e0feda07] Received event network-vif-unplugged-2fbfd894-8e16-4039-b726-638e802602c5 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:06:54 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-bf7a516c-ea7d-4570-a8a8-d15863febe63 req-c3e8cc37-3805-4ba9-8bf7-7c760753a627 service nova] Acquiring lock "e479154a-acd6-47aa-9a5b-43c6e0feda07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:06:54 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-bf7a516c-ea7d-4570-a8a8-d15863febe63 req-c3e8cc37-3805-4ba9-8bf7-7c760753a627 service nova] Lock "e479154a-acd6-47aa-9a5b-43c6e0feda07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:06:54 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-bf7a516c-ea7d-4570-a8a8-d15863febe63 req-c3e8cc37-3805-4ba9-8bf7-7c760753a627 service nova] Lock "e479154a-acd6-47aa-9a5b-43c6e0feda07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:06:54 user nova-compute[71509]: DEBUG nova.compute.manager [req-bf7a516c-ea7d-4570-a8a8-d15863febe63 req-c3e8cc37-3805-4ba9-8bf7-7c760753a627 service nova] [instance: e479154a-acd6-47aa-9a5b-43c6e0feda07] No waiting events found dispatching network-vif-unplugged-2fbfd894-8e16-4039-b726-638e802602c5 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:06:54 user nova-compute[71509]: DEBUG nova.compute.manager [req-bf7a516c-ea7d-4570-a8a8-d15863febe63 req-c3e8cc37-3805-4ba9-8bf7-7c760753a627 service nova] [instance: e479154a-acd6-47aa-9a5b-43c6e0feda07] Received event network-vif-unplugged-2fbfd894-8e16-4039-b726-638e802602c5 for instance with task_state deleting. {{(pid=71509) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 11:06:54 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:06:54 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:06:54 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:06:54 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: e479154a-acd6-47aa-9a5b-43c6e0feda07] Instance destroyed successfully.
Apr 14 11:06:54 user nova-compute[71509]: DEBUG nova.objects.instance [None req-120d98c0-7afc-48b0-87a7-d75f8bb0998f tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lazy-loading 'resources' on Instance uuid e479154a-acd6-47aa-9a5b-43c6e0feda07 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 11:06:54 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-120d98c0-7afc-48b0-87a7-d75f8bb0998f tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T10:46:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-917884205',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-917884205',id=15,image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T10:46:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='71289f80a05141f482cb538dac3d7b38',ramdisk_id='',reservation_id='r-lrwitdb5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='048ec0ee-0465-448d-8b4c-f072acb101dc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-2130542140',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T10:48:26Z,user_data=None,user_id='395bc9d7007c4e01ac7effd418bcea19',uuid=e479154a-acd6-47aa-9a5b-43c6e0feda07,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2fbfd894-8e16-4039-b726-638e802602c5", "address": "fa:16:3e:4d:3b:0d", "network": {"id": "07f1f39e-292a-4e73-b4ed-99e5799d6fa8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1339551596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71289f80a05141f482cb538dac3d7b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fbfd894-8e", "ovs_interfaceid": "2fbfd894-8e16-4039-b726-638e802602c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 11:06:54 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-120d98c0-7afc-48b0-87a7-d75f8bb0998f tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Converting VIF {"id": "2fbfd894-8e16-4039-b726-638e802602c5", "address": "fa:16:3e:4d:3b:0d", "network": {"id": "07f1f39e-292a-4e73-b4ed-99e5799d6fa8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1339551596-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71289f80a05141f482cb538dac3d7b38", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2fbfd894-8e", "ovs_interfaceid": "2fbfd894-8e16-4039-b726-638e802602c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 11:06:54 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-120d98c0-7afc-48b0-87a7-d75f8bb0998f tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4d:3b:0d,bridge_name='br-int',has_traffic_filtering=True,id=2fbfd894-8e16-4039-b726-638e802602c5,network=Network(07f1f39e-292a-4e73-b4ed-99e5799d6fa8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2fbfd894-8e') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 11:06:54 user nova-compute[71509]: DEBUG os_vif [None req-120d98c0-7afc-48b0-87a7-d75f8bb0998f tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4d:3b:0d,bridge_name='br-int',has_traffic_filtering=True,id=2fbfd894-8e16-4039-b726-638e802602c5,network=Network(07f1f39e-292a-4e73-b4ed-99e5799d6fa8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2fbfd894-8e') {{(pid=71509) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 11:06:54 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:06:54 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2fbfd894-8e, bridge=br-int, if_exists=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:06:54 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:06:54 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:06:54 user nova-compute[71509]: INFO os_vif [None req-120d98c0-7afc-48b0-87a7-d75f8bb0998f tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4d:3b:0d,bridge_name='br-int',has_traffic_filtering=True,id=2fbfd894-8e16-4039-b726-638e802602c5,network=Network(07f1f39e-292a-4e73-b4ed-99e5799d6fa8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2fbfd894-8e')
Apr 14 11:06:54 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-120d98c0-7afc-48b0-87a7-d75f8bb0998f tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: e479154a-acd6-47aa-9a5b-43c6e0feda07] Deleting instance files /opt/stack/data/nova/instances/e479154a-acd6-47aa-9a5b-43c6e0feda07_del
Apr 14 11:06:54 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-120d98c0-7afc-48b0-87a7-d75f8bb0998f tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: e479154a-acd6-47aa-9a5b-43c6e0feda07] Deletion of /opt/stack/data/nova/instances/e479154a-acd6-47aa-9a5b-43c6e0feda07_del complete
Apr 14 11:06:54 user nova-compute[71509]: INFO nova.compute.manager [None req-120d98c0-7afc-48b0-87a7-d75f8bb0998f tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] [instance: e479154a-acd6-47aa-9a5b-43c6e0feda07] Took 0.91 seconds to destroy the instance on the hypervisor.
Apr 14 11:06:54 user nova-compute[71509]: DEBUG oslo.service.loopingcall [None req-120d98c0-7afc-48b0-87a7-d75f8bb0998f tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71509) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 11:06:54 user nova-compute[71509]: DEBUG nova.compute.manager [-] [instance: e479154a-acd6-47aa-9a5b-43c6e0feda07] Deallocating network for instance {{(pid=71509) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 11:06:54 user nova-compute[71509]: DEBUG nova.network.neutron [-] [instance: e479154a-acd6-47aa-9a5b-43c6e0feda07] deallocate_for_instance() {{(pid=71509) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 11:06:55 user nova-compute[71509]: DEBUG nova.network.neutron [-] [instance: e479154a-acd6-47aa-9a5b-43c6e0feda07] Updating instance_info_cache with network_info: [] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:06:55 user nova-compute[71509]: INFO nova.compute.manager [-] [instance: e479154a-acd6-47aa-9a5b-43c6e0feda07] Took 0.50 seconds to deallocate network for instance.
Apr 14 11:06:55 user nova-compute[71509]: DEBUG nova.compute.manager [req-efc0e311-727e-45f7-9072-485217ac6d6f req-2a57a04f-a0c7-4be1-97bb-cac2b0dc2243 service nova] [instance: e479154a-acd6-47aa-9a5b-43c6e0feda07] Received event network-vif-deleted-2fbfd894-8e16-4039-b726-638e802602c5 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:06:55 user nova-compute[71509]: INFO nova.compute.manager [req-efc0e311-727e-45f7-9072-485217ac6d6f req-2a57a04f-a0c7-4be1-97bb-cac2b0dc2243 service nova] [instance: e479154a-acd6-47aa-9a5b-43c6e0feda07] Neutron deleted interface 2fbfd894-8e16-4039-b726-638e802602c5; detaching it from the instance and deleting it from the info cache
Apr 14 11:06:55 user nova-compute[71509]: DEBUG nova.network.neutron [req-efc0e311-727e-45f7-9072-485217ac6d6f req-2a57a04f-a0c7-4be1-97bb-cac2b0dc2243 service nova] [instance: e479154a-acd6-47aa-9a5b-43c6e0feda07] Updating instance_info_cache with network_info: [] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:06:55 user nova-compute[71509]: DEBUG nova.compute.manager [req-efc0e311-727e-45f7-9072-485217ac6d6f req-2a57a04f-a0c7-4be1-97bb-cac2b0dc2243 service nova] [instance: e479154a-acd6-47aa-9a5b-43c6e0feda07] Detach interface failed, port_id=2fbfd894-8e16-4039-b726-638e802602c5, reason: Instance e479154a-acd6-47aa-9a5b-43c6e0feda07 could not be found. {{(pid=71509) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10816}}
Apr 14 11:06:55 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-120d98c0-7afc-48b0-87a7-d75f8bb0998f tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:06:55 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-120d98c0-7afc-48b0-87a7-d75f8bb0998f tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:06:55 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-120d98c0-7afc-48b0-87a7-d75f8bb0998f tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 11:06:55 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-120d98c0-7afc-48b0-87a7-d75f8bb0998f tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 11:06:55 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-120d98c0-7afc-48b0-87a7-d75f8bb0998f tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.162s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:06:55 user nova-compute[71509]: INFO nova.scheduler.client.report [None req-120d98c0-7afc-48b0-87a7-d75f8bb0998f tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Deleted allocations for instance e479154a-acd6-47aa-9a5b-43c6e0feda07
Apr 14 11:06:55 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:06:55 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-120d98c0-7afc-48b0-87a7-d75f8bb0998f tempest-ServerBootFromVolumeStableRescueTest-2130542140 tempest-ServerBootFromVolumeStableRescueTest-2130542140-project-member] Lock "e479154a-acd6-47aa-9a5b-43c6e0feda07" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.772s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:06:56 user nova-compute[71509]: DEBUG nova.compute.manager [req-78345315-efff-46f3-bcfd-1c047a44b6c9 req-024ffd56-f1a4-454f-9246-ff7ad4afc614 service nova] [instance: e479154a-acd6-47aa-9a5b-43c6e0feda07] Received event network-vif-plugged-2fbfd894-8e16-4039-b726-638e802602c5 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:06:56 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-78345315-efff-46f3-bcfd-1c047a44b6c9 req-024ffd56-f1a4-454f-9246-ff7ad4afc614 service nova] Acquiring lock "e479154a-acd6-47aa-9a5b-43c6e0feda07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:06:56 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-78345315-efff-46f3-bcfd-1c047a44b6c9 req-024ffd56-f1a4-454f-9246-ff7ad4afc614 service nova] Lock "e479154a-acd6-47aa-9a5b-43c6e0feda07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:06:56 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-78345315-efff-46f3-bcfd-1c047a44b6c9 req-024ffd56-f1a4-454f-9246-ff7ad4afc614 service nova] Lock "e479154a-acd6-47aa-9a5b-43c6e0feda07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:06:56 user nova-compute[71509]: DEBUG nova.compute.manager [req-78345315-efff-46f3-bcfd-1c047a44b6c9 req-024ffd56-f1a4-454f-9246-ff7ad4afc614 service nova] [instance: e479154a-acd6-47aa-9a5b-43c6e0feda07] No waiting events found dispatching network-vif-plugged-2fbfd894-8e16-4039-b726-638e802602c5 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:06:56 user nova-compute[71509]: WARNING nova.compute.manager [req-78345315-efff-46f3-bcfd-1c047a44b6c9 req-024ffd56-f1a4-454f-9246-ff7ad4afc614 service nova] [instance: e479154a-acd6-47aa-9a5b-43c6e0feda07] Received unexpected event network-vif-plugged-2fbfd894-8e16-4039-b726-638e802602c5 for instance with vm_state deleted and task_state None.
Apr 14 11:06:56 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:06:58 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:06:59 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:06:59 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:06:59 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:06:59 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:06:59 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Auditing locally available compute resources for user (node: user) {{(pid=71509) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 11:06:59 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:06:59 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:06:59 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:06:59 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:06:59 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:06:59 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71509) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 11:07:00 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 11:07:00 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 11:07:00 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Hypervisor/Node resource view: name=user free_ram=8433MB free_disk=25.989749908447266GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71509) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 11:07:00 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:07:00 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:07:00 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 11:07:00 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 11:07:00 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71509) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 11:07:00 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71509) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 11:07:00 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 11:07:00 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 11:07:00 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Compute_service record updated for user:user {{(pid=71509) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 11:07:00 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.240s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:07:03 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:07:03 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Starting heal instance info cache {{(pid=71509) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 11:07:03 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Didn't find any instances for network info cache update. {{(pid=71509) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 14 11:07:04 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:07:08 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:07:09 user nova-compute[71509]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681470414.4753642, e479154a-acd6-47aa-9a5b-43c6e0feda07 => Stopped> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 11:07:09 user nova-compute[71509]: INFO nova.compute.manager [-] [instance: e479154a-acd6-47aa-9a5b-43c6e0feda07] VM Stopped (Lifecycle Event)
Apr 14 11:07:09 user nova-compute[71509]: DEBUG nova.compute.manager [None req-2cbb6219-b7a7-4c3d-8fba-7b8cf36bdc87 None None] [instance: e479154a-acd6-47aa-9a5b-43c6e0feda07] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 11:07:09 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:07:13 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:07:14 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:07:18 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:07:19 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:07:23 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:07:24 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:07:25 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:07:29 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:07:34 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:07:36 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:07:38 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:07:39 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:07:43 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:07:44 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:07:46 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:07:46 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71509) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 11:07:47 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:07:47 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:07:48 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:07:49 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:07:49 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:07:53 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:07:54 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:07:54 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:07:58 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:07:59 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:07:59 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:07:59 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:07:59 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:07:59 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Auditing locally available compute resources for user (node: user) {{(pid=71509) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 11:07:59 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:07:59 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:07:59 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:07:59 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:07:59 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:07:59 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71509) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 11:08:00 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 11:08:00 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 11:08:00 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Hypervisor/Node resource view: name=user free_ram=8487MB free_disk=25.95864486694336GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71509) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 11:08:00 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:08:00 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:08:00 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 11:08:00 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 11:08:00 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71509) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 11:08:00 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71509) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 11:08:00 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 11:08:00 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 11:08:00 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Compute_service record updated for user:user {{(pid=71509) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 11:08:00 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.214s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:08:04 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:08:05 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:08:05 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Starting heal instance info cache {{(pid=71509) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 11:08:05 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Rebuilding the list of instances to heal {{(pid=71509) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 11:08:05 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "refresh_cache-1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 11:08:05 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquired lock "refresh_cache-1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 11:08:05 user nova-compute[71509]: DEBUG nova.network.neutron [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] [instance: 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5] Forcefully refreshing network info cache for instance {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 11:08:05 user nova-compute[71509]: DEBUG nova.objects.instance [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lazy-loading 'info_cache' on Instance uuid 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 11:08:06 user nova-compute[71509]: DEBUG nova.network.neutron [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] [instance: 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5] Updating instance_info_cache with network_info: [{"id": "76a7a337-1fec-4cd0-b065-5788cf59e2da", "address": "fa:16:3e:df:77:18", "network": {"id": "6d6b6b35-b5ef-4d7c-abce-cad21cc99e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-878222456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e7089cb52574f1daf7f578222bb7a67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76a7a337-1f", "ovs_interfaceid": "76a7a337-1fec-4cd0-b065-5788cf59e2da", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:08:06 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Releasing lock "refresh_cache-1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 11:08:06 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] [instance: 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5] Updated the network info_cache for instance {{(pid=71509) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 11:08:08 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:08:09 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:08:14 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:08:18 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:08:19 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:08:24 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:08:27 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-06406709-1e97-4933-8a00-9faa49bc88db tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:08:27 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-06406709-1e97-4933-8a00-9faa49bc88db tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:08:27 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-06406709-1e97-4933-8a00-9faa49bc88db tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:08:27 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-06406709-1e97-4933-8a00-9faa49bc88db tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:08:27 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-06406709-1e97-4933-8a00-9faa49bc88db tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:08:27 user nova-compute[71509]: INFO nova.compute.manager [None req-06406709-1e97-4933-8a00-9faa49bc88db tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5] Terminating instance
Apr 14 11:08:27 user nova-compute[71509]: DEBUG nova.compute.manager [None req-06406709-1e97-4933-8a00-9faa49bc88db tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5] Start destroying the instance on the hypervisor. {{(pid=71509) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 11:08:27 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:08:27 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:08:27 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:08:27 user nova-compute[71509]: DEBUG nova.compute.manager [req-6d7d9477-8e30-4c67-875d-3c90d3877585 req-9d0c776b-a78e-48ca-9ce3-18f6546293b2 service nova] [instance: 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5] Received event network-vif-unplugged-76a7a337-1fec-4cd0-b065-5788cf59e2da {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:08:27 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-6d7d9477-8e30-4c67-875d-3c90d3877585 req-9d0c776b-a78e-48ca-9ce3-18f6546293b2 service nova] Acquiring lock "1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:08:27 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-6d7d9477-8e30-4c67-875d-3c90d3877585 req-9d0c776b-a78e-48ca-9ce3-18f6546293b2 service nova] Lock "1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:08:27 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-6d7d9477-8e30-4c67-875d-3c90d3877585 req-9d0c776b-a78e-48ca-9ce3-18f6546293b2 service nova] Lock "1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:08:27 user nova-compute[71509]: DEBUG nova.compute.manager [req-6d7d9477-8e30-4c67-875d-3c90d3877585 req-9d0c776b-a78e-48ca-9ce3-18f6546293b2 service nova] [instance: 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5] No waiting events found dispatching network-vif-unplugged-76a7a337-1fec-4cd0-b065-5788cf59e2da {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:08:27 user nova-compute[71509]: DEBUG nova.compute.manager [req-6d7d9477-8e30-4c67-875d-3c90d3877585 req-9d0c776b-a78e-48ca-9ce3-18f6546293b2 service nova] [instance: 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5] Received event network-vif-unplugged-76a7a337-1fec-4cd0-b065-5788cf59e2da for instance with task_state deleting. {{(pid=71509) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 11:08:27 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:08:27 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:08:28 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:08:28 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:08:28 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5] Instance destroyed successfully.
Apr 14 11:08:28 user nova-compute[71509]: DEBUG nova.objects.instance [None req-06406709-1e97-4933-8a00-9faa49bc88db tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lazy-loading 'resources' on Instance uuid 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 11:08:28 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-06406709-1e97-4933-8a00-9faa49bc88db tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T11:06:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-985741733',display_name='tempest-TestVolumeBootPattern-server-985741733',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-985741733',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T11:06:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2e7089cb52574f1daf7f578222bb7a67',ramdisk_id='',reservation_id='r-8ep8tqys',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-193101874',owner_user_name='tempest-TestVolumeBootPattern-193101874-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T11:06:53Z,user_data=None,user_id='c7644d02bc784e4fb74ebaaceb3affe1',uuid=1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "76a7a337-1fec-4cd0-b065-5788cf59e2da", "address": "fa:16:3e:df:77:18", "network": {"id": "6d6b6b35-b5ef-4d7c-abce-cad21cc99e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-878222456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e7089cb52574f1daf7f578222bb7a67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76a7a337-1f", "ovs_interfaceid": "76a7a337-1fec-4cd0-b065-5788cf59e2da", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 11:08:28 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-06406709-1e97-4933-8a00-9faa49bc88db tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Converting VIF {"id": "76a7a337-1fec-4cd0-b065-5788cf59e2da", "address": "fa:16:3e:df:77:18", "network": {"id": "6d6b6b35-b5ef-4d7c-abce-cad21cc99e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-878222456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e7089cb52574f1daf7f578222bb7a67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76a7a337-1f", "ovs_interfaceid": "76a7a337-1fec-4cd0-b065-5788cf59e2da", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 11:08:28 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-06406709-1e97-4933-8a00-9faa49bc88db tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:df:77:18,bridge_name='br-int',has_traffic_filtering=True,id=76a7a337-1fec-4cd0-b065-5788cf59e2da,network=Network(6d6b6b35-b5ef-4d7c-abce-cad21cc99e32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76a7a337-1f') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 11:08:28 user nova-compute[71509]: DEBUG os_vif [None req-06406709-1e97-4933-8a00-9faa49bc88db tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:77:18,bridge_name='br-int',has_traffic_filtering=True,id=76a7a337-1fec-4cd0-b065-5788cf59e2da,network=Network(6d6b6b35-b5ef-4d7c-abce-cad21cc99e32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76a7a337-1f') {{(pid=71509) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 11:08:28 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:08:28 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap76a7a337-1f, bridge=br-int, if_exists=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:08:28 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:08:28 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:08:28 user nova-compute[71509]: INFO os_vif [None req-06406709-1e97-4933-8a00-9faa49bc88db tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:77:18,bridge_name='br-int',has_traffic_filtering=True,id=76a7a337-1fec-4cd0-b065-5788cf59e2da,network=Network(6d6b6b35-b5ef-4d7c-abce-cad21cc99e32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76a7a337-1f')
Apr 14 11:08:28 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-06406709-1e97-4933-8a00-9faa49bc88db tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5] calling os-brick to detach iSCSI Volume {{(pid=71509) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 11:08:28 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-06406709-1e97-4933-8a00-9faa49bc88db tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0bf0749390>, {'target_iqn': 'iqn.2010-10.org.openstack:7c842927-5996-4d6c-aa72-083cf7db0103', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'czumwfnN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 11:08:28 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-06406709-1e97-4933-8a00-9faa49bc88db tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 11:08:28 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-06406709-1e97-4933-8a00-9faa49bc88db tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 11:08:28 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-06406709-1e97-4933-8a00-9faa49bc88db tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 11:08:28 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:08:28 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:08:28 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa835380-5ecb-48a4-b017-71198f983e07]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7c842927-5996-4d6c-aa72-083cf7db0103\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:08:28 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-06406709-1e97-4933-8a00-9faa49bc88db tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 11:08:28 user nova-compute[71509]: No targets found.
Apr 14 11:08:28 user nova-compute[71509]: iSNS:
Apr 14 11:08:28 user nova-compute[71509]: No targets found.
Apr 14 11:08:28 user nova-compute[71509]: STATIC:
Apr 14 11:08:28 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:7c842927-5996-4d6c-aa72-083cf7db0103
Apr 14 11:08:28 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 11:08:28 user nova-compute[71509]:                 Iface Name: default
Apr 14 11:08:28 user nova-compute[71509]: FIRMWARE:
Apr 14 11:08:28 user nova-compute[71509]: No targets found.
Apr 14 11:08:28 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 11:08:28 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-06406709-1e97-4933-8a00-9faa49bc88db tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 11:08:28 user nova-compute[71509]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 11:08:28 user nova-compute[71509]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71509) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 11:08:28 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-06406709-1e97-4933-8a00-9faa49bc88db tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c842927-5996-4d6c-aa72-083cf7db0103', 0)] {{(pid=71509) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 11:08:28 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:08:28 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:08:28 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bd4010c-ca89-4729-8ebe-0956f0031a29]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c842927-5996-4d6c-aa72-083cf7db0103\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:08:28 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:08:28 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:08:28 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[439d00d4-a8c0-4e40-b5b7-0e89d72daab7]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c842927-5996-4d6c-aa72-083cf7db0103 (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:08:28 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-06406709-1e97-4933-8a00-9faa49bc88db tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c842927-5996-4d6c-aa72-083cf7db0103 (non-flash)
Apr 14 11:08:28 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 11:08:28 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-06406709-1e97-4933-8a00-9faa49bc88db tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c842927-5996-4d6c-aa72-083cf7db0103 (non-flash)
Apr 14 11:08:28 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 11:08:28 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-06406709-1e97-4933-8a00-9faa49bc88db tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0c3a74d900>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c842927-5996-4d6c-aa72-083cf7db0103'): ({'sdb'}, set())}) {{(pid=71509) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 11:08:28 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-06406709-1e97-4933-8a00-9faa49bc88db tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Removing single pathed devices sdb {{(pid=71509) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 11:08:28 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:08:28 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:08:28 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[08c29afd-b7d2-4d75-9fdf-8eda763b9a5a]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:08:28 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:08:28 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:08:28 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[4edc1d12-9e27-4579-a31d-19e0ad4e8321]: (4, ('ok\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:08:28 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-06406709-1e97-4933-8a00-9faa49bc88db tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Flushing IO for device /dev/sdb {{(pid=71509) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 11:08:28 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:08:28 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:08:28 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f17c4fc-1649-4b81-b0bb-e4d90166de95]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:08:28 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-06406709-1e97-4933-8a00-9faa49bc88db tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71509) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 11:08:28 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:08:28 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:08:28 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5c8d522-da5e-49d4-a50a-376d220c6028]: (4, ('1', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:08:28 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-06406709-1e97-4933-8a00-9faa49bc88db tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71509) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 11:08:28 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-06406709-1e97-4933-8a00-9faa49bc88db tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] SCSI volumes sdb have been removed. {{(pid=71509) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 11:08:28 user nova-compute[71509]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_796f2d53',) {{(pid=82281) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 14 11:08:28 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[f75fb194-3e28-4b6a-8cf5-48fc7fc5ade9]: (4, None) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:08:28 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-06406709-1e97-4933-8a00-9faa49bc88db tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c842927-5996-4d6c-aa72-083cf7db0103')] {{(pid=71509) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 11:08:28 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c842927-5996-4d6c-aa72-083cf7db0103 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:08:28 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c842927-5996-4d6c-aa72-083cf7db0103 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:08:28 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[edb1fbf8-bee7-4635-9dee-87936b7670f3]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:08:28 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-06406709-1e97-4933-8a00-9faa49bc88db tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:08:28 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c842927-5996-4d6c-aa72-083cf7db0103 -p 172.16.0.220:3260 --logout {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:08:28 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c842927-5996-4d6c-aa72-083cf7db0103 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:08:28 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[fed78964-c498-455e-90d9-0c0b7db57388]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:7c842927-5996-4d6c-aa72-083cf7db0103, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:7c842927-5996-4d6c-aa72-083cf7db0103, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:08:28 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-06406709-1e97-4933-8a00-9faa49bc88db tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:7c842927-5996-4d6c-aa72-083cf7db0103, portal: 172.16.0.220,3260]
Apr 14 11:08:28 user nova-compute[71509]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:7c842927-5996-4d6c-aa72-083cf7db0103, portal: 172.16.0.220,3260] successful.
Apr 14 11:08:28 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:08:28 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c842927-5996-4d6c-aa72-083cf7db0103 -p 172.16.0.220:3260 --op delete {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:08:28 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c842927-5996-4d6c-aa72-083cf7db0103 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:08:28 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[0863c7ac-2e64-4b22-9877-221c9a2b07d6]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:08:28 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-06406709-1e97-4933-8a00-9faa49bc88db tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:08:28 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-06406709-1e97-4933-8a00-9faa49bc88db tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 11:08:28 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-06406709-1e97-4933-8a00-9faa49bc88db tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] <== disconnect_volume: return (324ms) None {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 11:08:28 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-06406709-1e97-4933-8a00-9faa49bc88db tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5] Disconnected iSCSI Volume {{(pid=71509) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 11:08:28 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-06406709-1e97-4933-8a00-9faa49bc88db tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5] Deleting instance files /opt/stack/data/nova/instances/1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5_del
Apr 14 11:08:28 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-06406709-1e97-4933-8a00-9faa49bc88db tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5] Deletion of /opt/stack/data/nova/instances/1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5_del complete
Apr 14 11:08:28 user nova-compute[71509]: INFO nova.compute.manager [None req-06406709-1e97-4933-8a00-9faa49bc88db tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5] Took 1.19 seconds to destroy the instance on the hypervisor.
Apr 14 11:08:28 user nova-compute[71509]: DEBUG oslo.service.loopingcall [None req-06406709-1e97-4933-8a00-9faa49bc88db tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71509) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 11:08:28 user nova-compute[71509]: DEBUG nova.compute.manager [-] [instance: 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5] Deallocating network for instance {{(pid=71509) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 11:08:28 user nova-compute[71509]: DEBUG nova.network.neutron [-] [instance: 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5] deallocate_for_instance() {{(pid=71509) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 11:08:28 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:08:28 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:08:28 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:08:28 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:08:28 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:08:28 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:08:29 user nova-compute[71509]: DEBUG nova.network.neutron [-] [instance: 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5] Updating instance_info_cache with network_info: [] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:08:29 user nova-compute[71509]: INFO nova.compute.manager [-] [instance: 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5] Took 1.06 seconds to deallocate network for instance.
Apr 14 11:08:29 user nova-compute[71509]: DEBUG nova.compute.manager [req-1322881a-d654-4c35-8ee0-289c33525f00 req-d33481cd-110a-4eda-9539-89b5fdd1fb6c service nova] [instance: 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5] Received event network-vif-plugged-76a7a337-1fec-4cd0-b065-5788cf59e2da {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:08:29 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-1322881a-d654-4c35-8ee0-289c33525f00 req-d33481cd-110a-4eda-9539-89b5fdd1fb6c service nova] Acquiring lock "1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:08:29 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-1322881a-d654-4c35-8ee0-289c33525f00 req-d33481cd-110a-4eda-9539-89b5fdd1fb6c service nova] Lock "1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:08:29 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-1322881a-d654-4c35-8ee0-289c33525f00 req-d33481cd-110a-4eda-9539-89b5fdd1fb6c service nova] Lock "1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:08:29 user nova-compute[71509]: DEBUG nova.compute.manager [req-1322881a-d654-4c35-8ee0-289c33525f00 req-d33481cd-110a-4eda-9539-89b5fdd1fb6c service nova] [instance: 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5] No waiting events found dispatching network-vif-plugged-76a7a337-1fec-4cd0-b065-5788cf59e2da {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:08:29 user nova-compute[71509]: WARNING nova.compute.manager [req-1322881a-d654-4c35-8ee0-289c33525f00 req-d33481cd-110a-4eda-9539-89b5fdd1fb6c service nova] [instance: 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5] Received unexpected event network-vif-plugged-76a7a337-1fec-4cd0-b065-5788cf59e2da for instance with vm_state active and task_state deleting.
Apr 14 11:08:29 user nova-compute[71509]: DEBUG nova.compute.manager [req-1322881a-d654-4c35-8ee0-289c33525f00 req-d33481cd-110a-4eda-9539-89b5fdd1fb6c service nova] [instance: 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5] Received event network-vif-plugged-76a7a337-1fec-4cd0-b065-5788cf59e2da {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:08:29 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-1322881a-d654-4c35-8ee0-289c33525f00 req-d33481cd-110a-4eda-9539-89b5fdd1fb6c service nova] Acquiring lock "1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:08:29 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-1322881a-d654-4c35-8ee0-289c33525f00 req-d33481cd-110a-4eda-9539-89b5fdd1fb6c service nova] Lock "1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:08:29 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-1322881a-d654-4c35-8ee0-289c33525f00 req-d33481cd-110a-4eda-9539-89b5fdd1fb6c service nova] Lock "1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:08:29 user nova-compute[71509]: DEBUG nova.compute.manager [req-1322881a-d654-4c35-8ee0-289c33525f00 req-d33481cd-110a-4eda-9539-89b5fdd1fb6c service nova] [instance: 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5] No waiting events found dispatching network-vif-plugged-76a7a337-1fec-4cd0-b065-5788cf59e2da {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:08:29 user nova-compute[71509]: WARNING nova.compute.manager [req-1322881a-d654-4c35-8ee0-289c33525f00 req-d33481cd-110a-4eda-9539-89b5fdd1fb6c service nova] [instance: 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5] Received unexpected event network-vif-plugged-76a7a337-1fec-4cd0-b065-5788cf59e2da for instance with vm_state active and task_state deleting.
Apr 14 11:08:29 user nova-compute[71509]: DEBUG nova.compute.manager [req-1322881a-d654-4c35-8ee0-289c33525f00 req-d33481cd-110a-4eda-9539-89b5fdd1fb6c service nova] [instance: 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5] Received event network-vif-plugged-76a7a337-1fec-4cd0-b065-5788cf59e2da {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:08:29 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-1322881a-d654-4c35-8ee0-289c33525f00 req-d33481cd-110a-4eda-9539-89b5fdd1fb6c service nova] Acquiring lock "1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:08:29 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-1322881a-d654-4c35-8ee0-289c33525f00 req-d33481cd-110a-4eda-9539-89b5fdd1fb6c service nova] Lock "1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:08:29 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-1322881a-d654-4c35-8ee0-289c33525f00 req-d33481cd-110a-4eda-9539-89b5fdd1fb6c service nova] Lock "1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:08:29 user nova-compute[71509]: DEBUG nova.compute.manager [req-1322881a-d654-4c35-8ee0-289c33525f00 req-d33481cd-110a-4eda-9539-89b5fdd1fb6c service nova] [instance: 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5] No waiting events found dispatching network-vif-plugged-76a7a337-1fec-4cd0-b065-5788cf59e2da {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:08:29 user nova-compute[71509]: WARNING nova.compute.manager [req-1322881a-d654-4c35-8ee0-289c33525f00 req-d33481cd-110a-4eda-9539-89b5fdd1fb6c service nova] [instance: 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5] Received unexpected event network-vif-plugged-76a7a337-1fec-4cd0-b065-5788cf59e2da for instance with vm_state active and task_state deleting.
Apr 14 11:08:29 user nova-compute[71509]: DEBUG nova.compute.manager [req-1322881a-d654-4c35-8ee0-289c33525f00 req-d33481cd-110a-4eda-9539-89b5fdd1fb6c service nova] [instance: 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5] Received event network-vif-unplugged-76a7a337-1fec-4cd0-b065-5788cf59e2da {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:08:29 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-1322881a-d654-4c35-8ee0-289c33525f00 req-d33481cd-110a-4eda-9539-89b5fdd1fb6c service nova] Acquiring lock "1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:08:29 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-1322881a-d654-4c35-8ee0-289c33525f00 req-d33481cd-110a-4eda-9539-89b5fdd1fb6c service nova] Lock "1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:08:29 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-1322881a-d654-4c35-8ee0-289c33525f00 req-d33481cd-110a-4eda-9539-89b5fdd1fb6c service nova] Lock "1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:08:29 user nova-compute[71509]: DEBUG nova.compute.manager [req-1322881a-d654-4c35-8ee0-289c33525f00 req-d33481cd-110a-4eda-9539-89b5fdd1fb6c service nova] [instance: 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5] No waiting events found dispatching network-vif-unplugged-76a7a337-1fec-4cd0-b065-5788cf59e2da {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:08:29 user nova-compute[71509]: DEBUG nova.compute.manager [req-1322881a-d654-4c35-8ee0-289c33525f00 req-d33481cd-110a-4eda-9539-89b5fdd1fb6c service nova] [instance: 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5] Received event network-vif-unplugged-76a7a337-1fec-4cd0-b065-5788cf59e2da for instance with task_state deleting. {{(pid=71509) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 11:08:29 user nova-compute[71509]: DEBUG nova.compute.manager [req-1322881a-d654-4c35-8ee0-289c33525f00 req-d33481cd-110a-4eda-9539-89b5fdd1fb6c service nova] [instance: 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5] Received event network-vif-plugged-76a7a337-1fec-4cd0-b065-5788cf59e2da {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:08:29 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-1322881a-d654-4c35-8ee0-289c33525f00 req-d33481cd-110a-4eda-9539-89b5fdd1fb6c service nova] Acquiring lock "1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:08:29 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-1322881a-d654-4c35-8ee0-289c33525f00 req-d33481cd-110a-4eda-9539-89b5fdd1fb6c service nova] Lock "1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:08:29 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-1322881a-d654-4c35-8ee0-289c33525f00 req-d33481cd-110a-4eda-9539-89b5fdd1fb6c service nova] Lock "1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:08:29 user nova-compute[71509]: DEBUG nova.compute.manager [req-1322881a-d654-4c35-8ee0-289c33525f00 req-d33481cd-110a-4eda-9539-89b5fdd1fb6c service nova] [instance: 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5] No waiting events found dispatching network-vif-plugged-76a7a337-1fec-4cd0-b065-5788cf59e2da {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:08:29 user nova-compute[71509]: WARNING nova.compute.manager [req-1322881a-d654-4c35-8ee0-289c33525f00 req-d33481cd-110a-4eda-9539-89b5fdd1fb6c service nova] [instance: 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5] Received unexpected event network-vif-plugged-76a7a337-1fec-4cd0-b065-5788cf59e2da for instance with vm_state active and task_state deleting.
Apr 14 11:08:29 user nova-compute[71509]: DEBUG nova.compute.manager [req-1322881a-d654-4c35-8ee0-289c33525f00 req-d33481cd-110a-4eda-9539-89b5fdd1fb6c service nova] [instance: 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5] Received event network-vif-deleted-76a7a337-1fec-4cd0-b065-5788cf59e2da {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:08:30 user nova-compute[71509]: INFO nova.compute.manager [None req-06406709-1e97-4933-8a00-9faa49bc88db tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5] Took 0.83 seconds to detach 1 volumes for instance.
Apr 14 11:08:30 user nova-compute[71509]: DEBUG nova.compute.manager [None req-06406709-1e97-4933-8a00-9faa49bc88db tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5] Deleting volume: 7c842927-5996-4d6c-aa72-083cf7db0103 {{(pid=71509) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 14 11:08:30 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-06406709-1e97-4933-8a00-9faa49bc88db tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:08:30 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-06406709-1e97-4933-8a00-9faa49bc88db tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:08:30 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-06406709-1e97-4933-8a00-9faa49bc88db tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 11:08:30 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-06406709-1e97-4933-8a00-9faa49bc88db tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 11:08:30 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-06406709-1e97-4933-8a00-9faa49bc88db tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.140s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:08:30 user nova-compute[71509]: INFO nova.scheduler.client.report [None req-06406709-1e97-4933-8a00-9faa49bc88db tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Deleted allocations for instance 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5
Apr 14 11:08:30 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-06406709-1e97-4933-8a00-9faa49bc88db tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.501s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:08:33 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:08:38 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:08:38 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:08:38 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71509) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 11:08:38 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71509) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 11:08:38 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71509) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 11:08:38 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:08:38 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-720ecf63-0eea-4d64-8bc7-5cc5cda327a1 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Acquiring lock "6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:08:38 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-720ecf63-0eea-4d64-8bc7-5cc5cda327a1 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:08:38 user nova-compute[71509]: DEBUG nova.objects.instance [None req-720ecf63-0eea-4d64-8bc7-5cc5cda327a1 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lazy-loading 'flavor' on Instance uuid 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 11:08:38 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-720ecf63-0eea-4d64-8bc7-5cc5cda327a1 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:08:38 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-720ecf63-0eea-4d64-8bc7-5cc5cda327a1 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Acquiring lock "6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:08:38 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-720ecf63-0eea-4d64-8bc7-5cc5cda327a1 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:08:38 user nova-compute[71509]: INFO nova.compute.manager [None req-720ecf63-0eea-4d64-8bc7-5cc5cda327a1 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] Attaching volume ad9a8e38-a4a0-464f-8ac1-32552aaa2af3 to /dev/vdb
Apr 14 11:08:38 user nova-compute[71509]: DEBUG os_brick.utils [None req-720ecf63-0eea-4d64-8bc7-5cc5cda327a1 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 11:08:38 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:08:38 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:08:38 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[51fb3406-65c6-47b9-9ef1-9aaf85385862]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50119df3c417\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:08:38 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:08:38 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:08:38 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[562b678c-7c9f-446e-a203-f7a779b9e115]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:08:38 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:08:38 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.037s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:08:38 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e75b50a-0bc7-472c-83e0-36368d6ce201]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:08:38 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[08647047-8cf3-4f6c-9d85-3a8f7a5fdb79]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:08:38 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-720ecf63-0eea-4d64-8bc7-5cc5cda327a1 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Running cmd (subprocess): nvme version {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:08:38 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-720ecf63-0eea-4d64-8bc7-5cc5cda327a1 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] 'nvme version' failed. Not Retrying. {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 11:08:38 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.nvmeof [None req-720ecf63-0eea-4d64-8bc7-5cc5cda327a1 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] nvme not present on system {{(pid=71509) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 11:08:38 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:08:38 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 11:08:38 user nova-compute[71509]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 11:08:38 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[84ce1409-679d-43c7-a528-ae60e9c9fc2f]: (4, '') {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:08:38 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-720ecf63-0eea-4d64-8bc7-5cc5cda327a1 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71509) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 11:08:38 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-720ecf63-0eea-4d64-8bc7-5cc5cda327a1 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71509) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 11:08:38 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-720ecf63-0eea-4d64-8bc7-5cc5cda327a1 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] LIGHTOS: no hostnqn found. {{(pid=71509) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 11:08:38 user nova-compute[71509]: DEBUG os_brick.utils [None req-720ecf63-0eea-4d64-8bc7-5cc5cda327a1 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50119df3c417', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 11:08:38 user nova-compute[71509]: DEBUG nova.virt.block_device [None req-720ecf63-0eea-4d64-8bc7-5cc5cda327a1 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] Updating existing volume attachment record: 56ff8724-521c-459f-a2e2-df08edfc22be {{(pid=71509) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 11:08:43 user nova-compute[71509]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681470508.0280516, 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5 => Stopped> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 11:08:43 user nova-compute[71509]: INFO nova.compute.manager [-] [instance: 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5] VM Stopped (Lifecycle Event)
Apr 14 11:08:43 user nova-compute[71509]: DEBUG nova.compute.manager [None req-42c2ac2d-8803-4e04-9e1d-37d34fc4c393 None None] [instance: 1a4c8d84-a688-4f33-93cd-2dc6b8c1d5b5] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 11:08:43 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-720ecf63-0eea-4d64-8bc7-5cc5cda327a1 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] Calling os-brick to attach iSCSI Volume {{(pid=71509) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 11:08:43 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-720ecf63-0eea-4d64-8bc7-5cc5cda327a1 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0bf0749390>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ad9a8e38-a4a0-464f-8ac1-32552aaa2af3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lTWgFtSM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 11:08:43 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-720ecf63-0eea-4d64-8bc7-5cc5cda327a1 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 11:08:43 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-720ecf63-0eea-4d64-8bc7-5cc5cda327a1 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 11:08:43 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-720ecf63-0eea-4d64-8bc7-5cc5cda327a1 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 11:08:43 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-720ecf63-0eea-4d64-8bc7-5cc5cda327a1 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 11:08:43 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-720ecf63-0eea-4d64-8bc7-5cc5cda327a1 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ad9a8e38-a4a0-464f-8ac1-32552aaa2af3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 11:08:43 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-720ecf63-0eea-4d64-8bc7-5cc5cda327a1 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ad9a8e38-a4a0-464f-8ac1-32552aaa2af3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 11:08:43 user nova-compute[71509]: INFO os_brick.initiator.connectors.iscsi [None req-720ecf63-0eea-4d64-8bc7-5cc5cda327a1 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 11:08:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad9a8e38-a4a0-464f-8ac1-32552aaa2af3 -p 172.16.0.220:3260 {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:08:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad9a8e38-a4a0-464f-8ac1-32552aaa2af3 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:08:43 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce728f0e-ab9a-43f6-9198-b5d751893459]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:08:43 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-720ecf63-0eea-4d64-8bc7-5cc5cda327a1 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 11:08:43 user nova-compute[71509]:  {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:08:43 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:08:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad9a8e38-a4a0-464f-8ac1-32552aaa2af3 -p 172.16.0.220:3260 --interface default --op new {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:08:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad9a8e38-a4a0-464f-8ac1-32552aaa2af3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:08:43 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[e845df68-12ea-4efb-a3a5-7c503bf3685c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ad9a8e38-a4a0-464f-8ac1-32552aaa2af3] added\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:08:43 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-720ecf63-0eea-4d64-8bc7-5cc5cda327a1 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ad9a8e38-a4a0-464f-8ac1-32552aaa2af3] added
Apr 14 11:08:43 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:08:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad9a8e38-a4a0-464f-8ac1-32552aaa2af3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:08:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad9a8e38-a4a0-464f-8ac1-32552aaa2af3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:08:43 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[7324a4c4-d554-43a1-bbb8-ddeff941629d]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:08:43 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-720ecf63-0eea-4d64-8bc7-5cc5cda327a1 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:08:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad9a8e38-a4a0-464f-8ac1-32552aaa2af3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:08:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad9a8e38-a4a0-464f-8ac1-32552aaa2af3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:08:43 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac176c56-c614-4fbc-8cf5-871b28a9ce1e]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:08:43 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-720ecf63-0eea-4d64-8bc7-5cc5cda327a1 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:08:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad9a8e38-a4a0-464f-8ac1-32552aaa2af3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lTWgFtSM {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:08:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad9a8e38-a4a0-464f-8ac1-32552aaa2af3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lTWgFtSM" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:08:43 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5b68937-bd73-4d27-a217-5eaba9c5954c]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:08:43 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-720ecf63-0eea-4d64-8bc7-5cc5cda327a1 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lTWgFtSM'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:08:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad9a8e38-a4a0-464f-8ac1-32552aaa2af3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:08:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad9a8e38-a4a0-464f-8ac1-32552aaa2af3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:08:43 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3bad52c-0218-4798-9411-aea347883137]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:08:43 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-720ecf63-0eea-4d64-8bc7-5cc5cda327a1 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:08:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:08:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:08:43 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[06dfbb05-4482-460b-b3b5-587da1ebd2b2]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:08:43 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-720ecf63-0eea-4d64-8bc7-5cc5cda327a1 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 14 11:08:43 user nova-compute[71509]:  {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 11:08:43 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-720ecf63-0eea-4d64-8bc7-5cc5cda327a1 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 14 11:08:43 user nova-compute[71509]:  {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 11:08:43 user nova-compute[71509]: WARNING os_brick.initiator.connectors.iscsi [None req-720ecf63-0eea-4d64-8bc7-5cc5cda327a1 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 14 11:08:43 user nova-compute[71509]: 
Apr 14 11:08:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad9a8e38-a4a0-464f-8ac1-32552aaa2af3 -p 172.16.0.220:3260 --login {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:08:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad9a8e38-a4a0-464f-8ac1-32552aaa2af3 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:08:43 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[c253fad1-3650-416c-83ee-619c02008455]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ad9a8e38-a4a0-464f-8ac1-32552aaa2af3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ad9a8e38-a4a0-464f-8ac1-32552aaa2af3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:08:43 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-720ecf63-0eea-4d64-8bc7-5cc5cda327a1 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ad9a8e38-a4a0-464f-8ac1-32552aaa2af3, portal: 172.16.0.220,3260]
Apr 14 11:08:43 user nova-compute[71509]: Login to [iface: default, target: iqn.2010-10.org.openstack:ad9a8e38-a4a0-464f-8ac1-32552aaa2af3, portal: 172.16.0.220,3260] successful.
Apr 14 11:08:43 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:08:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad9a8e38-a4a0-464f-8ac1-32552aaa2af3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:08:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad9a8e38-a4a0-464f-8ac1-32552aaa2af3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:08:43 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[32023fe4-7e94-4c79-850f-c1d51a4ba2a0]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:08:43 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-720ecf63-0eea-4d64-8bc7-5cc5cda327a1 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:08:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:08:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:08:43 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ee11320-8a96-4ad4-b072-8b5d593b7169]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad9a8e38-a4a0-464f-8ac1-32552aaa2af3 (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:08:43 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-720ecf63-0eea-4d64-8bc7-5cc5cda327a1 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad9a8e38-a4a0-464f-8ac1-32552aaa2af3 (non-flash)
Apr 14 11:08:43 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 11:08:43 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-720ecf63-0eea-4d64-8bc7-5cc5cda327a1 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad9a8e38-a4a0-464f-8ac1-32552aaa2af3 (non-flash)
Apr 14 11:08:43 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 11:08:43 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-720ecf63-0eea-4d64-8bc7-5cc5cda327a1 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ad9a8e38-a4a0-464f-8ac1-32552aaa2af3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.272s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 11:08:43 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-720ecf63-0eea-4d64-8bc7-5cc5cda327a1 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Connected to 172.16.0.220:3260 {{(pid=71509) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 11:08:43 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-720ecf63-0eea-4d64-8bc7-5cc5cda327a1 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] HCTL ('33', '-', '-', 0) found on session 49 with lun 0 {{(pid=71509) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 11:08:43 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-720ecf63-0eea-4d64-8bc7-5cc5cda327a1 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71509) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 11:08:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:08:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:08:43 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a609502-95b9-4fea-b9b4-de1354e73945]: (4, ('- - 0', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:08:43 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-720ecf63-0eea-4d64-8bc7-5cc5cda327a1 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: None {{(pid=71509) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 11:08:44 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-720ecf63-0eea-4d64-8bc7-5cc5cda327a1 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71509) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 11:08:44 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-720ecf63-0eea-4d64-8bc7-5cc5cda327a1 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:ad9a8e38-a4a0-464f-8ac1-32552aaa2af3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lTWgFtSM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71509) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 11:08:44 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-720ecf63-0eea-4d64-8bc7-5cc5cda327a1 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.299s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 11:08:44 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-720ecf63-0eea-4d64-8bc7-5cc5cda327a1 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] <== connect_volume: return (1301ms) {'type': 'block', 'scsi_wwn': '23531313636646466', 'path': '/dev/sdb'} {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 11:08:44 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-720ecf63-0eea-4d64-8bc7-5cc5cda327a1 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23531313636646466', 'path': '/dev/sdb'} {{(pid=71509) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 11:08:44 user nova-compute[71509]: DEBUG nova.objects.instance [None req-720ecf63-0eea-4d64-8bc7-5cc5cda327a1 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lazy-loading 'flavor' on Instance uuid 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 11:08:44 user nova-compute[71509]: DEBUG nova.virt.libvirt.guest [None req-720ecf63-0eea-4d64-8bc7-5cc5cda327a1 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] attach device xml: <disk type="block" device="disk">
Apr 14 11:08:44 user nova-compute[71509]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 11:08:44 user nova-compute[71509]:   <source dev="/dev/sdb"/>
Apr 14 11:08:44 user nova-compute[71509]:   <target dev="vdb" bus="virtio"/>
Apr 14 11:08:44 user nova-compute[71509]:   <serial>ad9a8e38-a4a0-464f-8ac1-32552aaa2af3</serial>
Apr 14 11:08:44 user nova-compute[71509]: </disk>
Apr 14 11:08:44 user nova-compute[71509]:  {{(pid=71509) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Apr 14 11:08:44 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-720ecf63-0eea-4d64-8bc7-5cc5cda327a1 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] No BDM found with device name vda, not building metadata. {{(pid=71509) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 11:08:44 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-720ecf63-0eea-4d64-8bc7-5cc5cda327a1 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] No BDM found with device name vdb, not building metadata. {{(pid=71509) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 11:08:44 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-720ecf63-0eea-4d64-8bc7-5cc5cda327a1 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] No VIF found with MAC fa:16:3e:d0:2f:a0, not building metadata {{(pid=71509) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 11:08:44 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-720ecf63-0eea-4d64-8bc7-5cc5cda327a1 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.556s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:08:46 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:08:46 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71509) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 11:08:46 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:08:47 user nova-compute[71509]: DEBUG nova.compute.manager [req-d6c7497e-615a-4b28-8f7c-dbf87b9372d5 req-3862e439-2df9-4966-879f-4dc4769ab6d6 service nova] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] Received event network-changed-cc02fdc1-b3b9-4ca0-937a-fdcc2a3ba608 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:08:47 user nova-compute[71509]: DEBUG nova.compute.manager [req-d6c7497e-615a-4b28-8f7c-dbf87b9372d5 req-3862e439-2df9-4966-879f-4dc4769ab6d6 service nova] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] Refreshing instance network info cache due to event network-changed-cc02fdc1-b3b9-4ca0-937a-fdcc2a3ba608. {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 11:08:47 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-d6c7497e-615a-4b28-8f7c-dbf87b9372d5 req-3862e439-2df9-4966-879f-4dc4769ab6d6 service nova] Acquiring lock "refresh_cache-6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 11:08:47 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-d6c7497e-615a-4b28-8f7c-dbf87b9372d5 req-3862e439-2df9-4966-879f-4dc4769ab6d6 service nova] Acquired lock "refresh_cache-6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 11:08:47 user nova-compute[71509]: DEBUG nova.network.neutron [req-d6c7497e-615a-4b28-8f7c-dbf87b9372d5 req-3862e439-2df9-4966-879f-4dc4769ab6d6 service nova] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] Refreshing network info cache for port cc02fdc1-b3b9-4ca0-937a-fdcc2a3ba608 {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 11:08:48 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:08:48 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:08:48 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:08:48 user nova-compute[71509]: DEBUG nova.network.neutron [req-d6c7497e-615a-4b28-8f7c-dbf87b9372d5 req-3862e439-2df9-4966-879f-4dc4769ab6d6 service nova] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] Updated VIF entry in instance network info cache for port cc02fdc1-b3b9-4ca0-937a-fdcc2a3ba608. {{(pid=71509) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 11:08:48 user nova-compute[71509]: DEBUG nova.network.neutron [req-d6c7497e-615a-4b28-8f7c-dbf87b9372d5 req-3862e439-2df9-4966-879f-4dc4769ab6d6 service nova] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] Updating instance_info_cache with network_info: [{"id": "cc02fdc1-b3b9-4ca0-937a-fdcc2a3ba608", "address": "fa:16:3e:d0:2f:a0", "network": {"id": "d59680e7-ed50-4356-b665-ec64ff939708", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-598238133-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5809862340a84c83a772c65c77513608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc02fdc1-b3", "ovs_interfaceid": "cc02fdc1-b3b9-4ca0-937a-fdcc2a3ba608", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:08:48 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-d6c7497e-615a-4b28-8f7c-dbf87b9372d5 req-3862e439-2df9-4966-879f-4dc4769ab6d6 service nova] Releasing lock "refresh_cache-6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 11:08:48 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:08:49 user nova-compute[71509]: DEBUG nova.compute.manager [req-26c5cbfd-41ae-4841-bd77-5e35dfe3c2b2 req-374eec00-33b7-4c30-a2e2-3c42b951227f service nova] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] Received event network-changed-cc02fdc1-b3b9-4ca0-937a-fdcc2a3ba608 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:08:49 user nova-compute[71509]: DEBUG nova.compute.manager [req-26c5cbfd-41ae-4841-bd77-5e35dfe3c2b2 req-374eec00-33b7-4c30-a2e2-3c42b951227f service nova] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] Refreshing instance network info cache due to event network-changed-cc02fdc1-b3b9-4ca0-937a-fdcc2a3ba608. {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 11:08:49 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-26c5cbfd-41ae-4841-bd77-5e35dfe3c2b2 req-374eec00-33b7-4c30-a2e2-3c42b951227f service nova] Acquiring lock "refresh_cache-6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 11:08:49 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-26c5cbfd-41ae-4841-bd77-5e35dfe3c2b2 req-374eec00-33b7-4c30-a2e2-3c42b951227f service nova] Acquired lock "refresh_cache-6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 11:08:49 user nova-compute[71509]: DEBUG nova.network.neutron [req-26c5cbfd-41ae-4841-bd77-5e35dfe3c2b2 req-374eec00-33b7-4c30-a2e2-3c42b951227f service nova] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] Refreshing network info cache for port cc02fdc1-b3b9-4ca0-937a-fdcc2a3ba608 {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 11:08:50 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-a051dba8-e8d6-4651-8c8d-2913c25331b9 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Acquiring lock "6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:08:50 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-a051dba8-e8d6-4651-8c8d-2913c25331b9 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:08:50 user nova-compute[71509]: INFO nova.compute.manager [None req-a051dba8-e8d6-4651-8c8d-2913c25331b9 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] Rebooting instance
Apr 14 11:08:50 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-a051dba8-e8d6-4651-8c8d-2913c25331b9 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Acquiring lock "refresh_cache-6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 11:08:50 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:08:50 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Cleaning up deleted instances {{(pid=71509) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 14 11:08:50 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] There are 0 instances to clean {{(pid=71509) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 14 11:08:50 user nova-compute[71509]: DEBUG nova.network.neutron [req-26c5cbfd-41ae-4841-bd77-5e35dfe3c2b2 req-374eec00-33b7-4c30-a2e2-3c42b951227f service nova] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] Updated VIF entry in instance network info cache for port cc02fdc1-b3b9-4ca0-937a-fdcc2a3ba608. {{(pid=71509) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 11:08:50 user nova-compute[71509]: DEBUG nova.network.neutron [req-26c5cbfd-41ae-4841-bd77-5e35dfe3c2b2 req-374eec00-33b7-4c30-a2e2-3c42b951227f service nova] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] Updating instance_info_cache with network_info: [{"id": "cc02fdc1-b3b9-4ca0-937a-fdcc2a3ba608", "address": "fa:16:3e:d0:2f:a0", "network": {"id": "d59680e7-ed50-4356-b665-ec64ff939708", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-598238133-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5809862340a84c83a772c65c77513608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc02fdc1-b3", "ovs_interfaceid": "cc02fdc1-b3b9-4ca0-937a-fdcc2a3ba608", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:08:50 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-26c5cbfd-41ae-4841-bd77-5e35dfe3c2b2 req-374eec00-33b7-4c30-a2e2-3c42b951227f service nova] Releasing lock "refresh_cache-6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 11:08:50 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-a051dba8-e8d6-4651-8c8d-2913c25331b9 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Acquired lock "refresh_cache-6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 11:08:50 user nova-compute[71509]: DEBUG nova.network.neutron [None req-a051dba8-e8d6-4651-8c8d-2913c25331b9 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] Building network info cache for instance {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 11:08:51 user nova-compute[71509]: DEBUG nova.network.neutron [None req-a051dba8-e8d6-4651-8c8d-2913c25331b9 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] Updating instance_info_cache with network_info: [{"id": "cc02fdc1-b3b9-4ca0-937a-fdcc2a3ba608", "address": "fa:16:3e:d0:2f:a0", "network": {"id": "d59680e7-ed50-4356-b665-ec64ff939708", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-598238133-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5809862340a84c83a772c65c77513608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc02fdc1-b3", "ovs_interfaceid": "cc02fdc1-b3b9-4ca0-937a-fdcc2a3ba608", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:08:51 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-a051dba8-e8d6-4651-8c8d-2913c25331b9 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Releasing lock "refresh_cache-6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 11:08:51 user nova-compute[71509]: DEBUG nova.compute.manager [None req-a051dba8-e8d6-4651-8c8d-2913c25331b9 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 11:08:51 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:08:52 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:08:52 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71509) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 14 11:08:52 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:08:53 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:08:53 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:08:53 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:08:53 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:08:53 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:08:53 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:08:53 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:08:53 user nova-compute[71509]: DEBUG nova.compute.manager [req-82b3581a-1a66-45f4-b1a6-9b59ad9f6dfb req-ab5f3ead-246e-4f50-b0d4-f7f9b88d533f service nova] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] Received event network-vif-unplugged-cc02fdc1-b3b9-4ca0-937a-fdcc2a3ba608 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:08:53 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-82b3581a-1a66-45f4-b1a6-9b59ad9f6dfb req-ab5f3ead-246e-4f50-b0d4-f7f9b88d533f service nova] Acquiring lock "6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:08:53 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-82b3581a-1a66-45f4-b1a6-9b59ad9f6dfb req-ab5f3ead-246e-4f50-b0d4-f7f9b88d533f service nova] Lock "6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:08:53 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-82b3581a-1a66-45f4-b1a6-9b59ad9f6dfb req-ab5f3ead-246e-4f50-b0d4-f7f9b88d533f service nova] Lock "6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:08:53 user nova-compute[71509]: DEBUG nova.compute.manager [req-82b3581a-1a66-45f4-b1a6-9b59ad9f6dfb req-ab5f3ead-246e-4f50-b0d4-f7f9b88d533f service nova] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] No waiting events found dispatching network-vif-unplugged-cc02fdc1-b3b9-4ca0-937a-fdcc2a3ba608 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:08:53 user nova-compute[71509]: WARNING nova.compute.manager [req-82b3581a-1a66-45f4-b1a6-9b59ad9f6dfb req-ab5f3ead-246e-4f50-b0d4-f7f9b88d533f service nova] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] Received unexpected event network-vif-unplugged-cc02fdc1-b3b9-4ca0-937a-fdcc2a3ba608 for instance with vm_state active and task_state reboot_started.
Apr 14 11:08:54 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:08:54 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:08:54 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-a051dba8-e8d6-4651-8c8d-2913c25331b9 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] Instance shutdown successfully.
Apr 14 11:08:55 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:08:55 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:08:55 user nova-compute[71509]: DEBUG nova.compute.manager [req-0a38b9c0-5809-496e-b94d-9cc6db1c0aad req-2103f138-4935-43ef-a5d0-b3eede6055b8 service nova] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] Received event network-vif-plugged-cc02fdc1-b3b9-4ca0-937a-fdcc2a3ba608 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:08:55 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-0a38b9c0-5809-496e-b94d-9cc6db1c0aad req-2103f138-4935-43ef-a5d0-b3eede6055b8 service nova] Acquiring lock "6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:08:55 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-0a38b9c0-5809-496e-b94d-9cc6db1c0aad req-2103f138-4935-43ef-a5d0-b3eede6055b8 service nova] Lock "6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:08:55 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-0a38b9c0-5809-496e-b94d-9cc6db1c0aad req-2103f138-4935-43ef-a5d0-b3eede6055b8 service nova] Lock "6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:08:55 user nova-compute[71509]: DEBUG nova.compute.manager [req-0a38b9c0-5809-496e-b94d-9cc6db1c0aad req-2103f138-4935-43ef-a5d0-b3eede6055b8 service nova] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] No waiting events found dispatching network-vif-plugged-cc02fdc1-b3b9-4ca0-937a-fdcc2a3ba608 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:08:55 user nova-compute[71509]: WARNING nova.compute.manager [req-0a38b9c0-5809-496e-b94d-9cc6db1c0aad req-2103f138-4935-43ef-a5d0-b3eede6055b8 service nova] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] Received unexpected event network-vif-plugged-cc02fdc1-b3b9-4ca0-937a-fdcc2a3ba608 for instance with vm_state active and task_state reboot_started.
Apr 14 11:08:55 user nova-compute[71509]: DEBUG nova.compute.manager [req-0a38b9c0-5809-496e-b94d-9cc6db1c0aad req-2103f138-4935-43ef-a5d0-b3eede6055b8 service nova] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] Received event network-vif-plugged-cc02fdc1-b3b9-4ca0-937a-fdcc2a3ba608 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:08:55 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-0a38b9c0-5809-496e-b94d-9cc6db1c0aad req-2103f138-4935-43ef-a5d0-b3eede6055b8 service nova] Acquiring lock "6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:08:55 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-0a38b9c0-5809-496e-b94d-9cc6db1c0aad req-2103f138-4935-43ef-a5d0-b3eede6055b8 service nova] Lock "6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:08:55 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-0a38b9c0-5809-496e-b94d-9cc6db1c0aad req-2103f138-4935-43ef-a5d0-b3eede6055b8 service nova] Lock "6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:08:55 user nova-compute[71509]: DEBUG nova.compute.manager [req-0a38b9c0-5809-496e-b94d-9cc6db1c0aad req-2103f138-4935-43ef-a5d0-b3eede6055b8 service nova] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] No waiting events found dispatching network-vif-plugged-cc02fdc1-b3b9-4ca0-937a-fdcc2a3ba608 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:08:55 user nova-compute[71509]: WARNING nova.compute.manager [req-0a38b9c0-5809-496e-b94d-9cc6db1c0aad req-2103f138-4935-43ef-a5d0-b3eede6055b8 service nova] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] Received unexpected event network-vif-plugged-cc02fdc1-b3b9-4ca0-937a-fdcc2a3ba608 for instance with vm_state active and task_state reboot_started.
Apr 14 11:08:56 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:08:56 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:08:56 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:08:56 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:08:56 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:08:56 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:08:57 user nova-compute[71509]: DEBUG nova.virt.libvirt.host [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Removed pending event for 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99 due to event {{(pid=71509) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Apr 14 11:08:57 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681470537.919042, 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99 => Resumed> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 11:08:57 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] VM Resumed (Lifecycle Event)
Apr 14 11:08:57 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] Instance running successfully.
Apr 14 11:08:57 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-a051dba8-e8d6-4651-8c8d-2913c25331b9 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] Instance soft rebooted successfully.
Apr 14 11:08:57 user nova-compute[71509]: DEBUG nova.compute.manager [None req-a051dba8-e8d6-4651-8c8d-2913c25331b9 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 11:08:57 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 11:08:57 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 11:08:57 user nova-compute[71509]: DEBUG nova.compute.manager [req-fb1d8642-66e7-4d81-b869-173de51874a3 req-f9e1cc64-c14c-4cac-a9de-95854e311728 service nova] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] Received event network-vif-plugged-cc02fdc1-b3b9-4ca0-937a-fdcc2a3ba608 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:08:57 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-fb1d8642-66e7-4d81-b869-173de51874a3 req-f9e1cc64-c14c-4cac-a9de-95854e311728 service nova] Acquiring lock "6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:08:57 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-fb1d8642-66e7-4d81-b869-173de51874a3 req-f9e1cc64-c14c-4cac-a9de-95854e311728 service nova] Lock "6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:08:57 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-fb1d8642-66e7-4d81-b869-173de51874a3 req-f9e1cc64-c14c-4cac-a9de-95854e311728 service nova] Lock "6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:08:57 user nova-compute[71509]: DEBUG nova.compute.manager [req-fb1d8642-66e7-4d81-b869-173de51874a3 req-f9e1cc64-c14c-4cac-a9de-95854e311728 service nova] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] No waiting events found dispatching network-vif-plugged-cc02fdc1-b3b9-4ca0-937a-fdcc2a3ba608 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:08:57 user nova-compute[71509]: WARNING nova.compute.manager [req-fb1d8642-66e7-4d81-b869-173de51874a3 req-f9e1cc64-c14c-4cac-a9de-95854e311728 service nova] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] Received unexpected event network-vif-plugged-cc02fdc1-b3b9-4ca0-937a-fdcc2a3ba608 for instance with vm_state active and task_state reboot_started.
Apr 14 11:08:57 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] During sync_power_state the instance has a pending task (reboot_started). Skip.
Apr 14 11:08:57 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681470537.9223263, 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99 => Started> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 11:08:57 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] VM Started (Lifecycle Event)
Apr 14 11:08:57 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-a051dba8-e8d6-4651-8c8d-2913c25331b9 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.759s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:08:58 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 11:08:58 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 11:08:58 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:08:58 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:08:59 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:09:00 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:09:00 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:09:00 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:09:00 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:09:00 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Auditing locally available compute resources for user (node: user) {{(pid=71509) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 11:09:00 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:09:00 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:09:00 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:09:00 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:09:00 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71509) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 11:09:01 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 11:09:01 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 11:09:01 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Hypervisor/Node resource view: name=user free_ram=8662MB free_disk=25.936981201171875GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71509) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 11:09:01 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:09:01 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:09:01 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 11:09:01 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71509) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 11:09:01 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71509) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 11:09:01 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Refreshing inventories for resource provider 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 14 11:09:01 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Updating ProviderTree inventory for provider 52209f7e-594e-4cf4-9018-18636056cd6b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 14 11:09:01 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Updating inventory in ProviderTree for provider 52209f7e-594e-4cf4-9018-18636056cd6b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 14 11:09:01 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Refreshing aggregate associations for resource provider 52209f7e-594e-4cf4-9018-18636056cd6b, aggregates: None {{(pid=71509) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 14 11:09:01 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Refreshing trait associations for resource provider 52209f7e-594e-4cf4-9018-18636056cd6b, traits: COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE42,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_SATA {{(pid=71509) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 14 11:09:01 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 11:09:01 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 11:09:01 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Compute_service record updated for user:user {{(pid=71509) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 11:09:01 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.606s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:09:03 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:09:03 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:09:06 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:09:06 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Starting heal instance info cache {{(pid=71509) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 11:09:07 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "refresh_cache-6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 11:09:07 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquired lock "refresh_cache-6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 11:09:07 user nova-compute[71509]: DEBUG nova.network.neutron [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] Forcefully refreshing network info cache for instance {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 11:09:07 user nova-compute[71509]: DEBUG nova.network.neutron [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] Updating instance_info_cache with network_info: [{"id": "cc02fdc1-b3b9-4ca0-937a-fdcc2a3ba608", "address": "fa:16:3e:d0:2f:a0", "network": {"id": "d59680e7-ed50-4356-b665-ec64ff939708", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-598238133-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5809862340a84c83a772c65c77513608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc02fdc1-b3", "ovs_interfaceid": "cc02fdc1-b3b9-4ca0-937a-fdcc2a3ba608", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:09:07 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Releasing lock "refresh_cache-6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 11:09:07 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] Updated the network info_cache for instance {{(pid=71509) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 11:09:08 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:09:08 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:09:13 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:09:13 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:09:13 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71509) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 11:09:13 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71509) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 11:09:13 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71509) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 11:09:13 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:09:13 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:09:18 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:09:18 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:09:19 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._sync_power_states {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:09:19 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Triggering sync for uuid 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99 {{(pid=71509) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 11:09:19 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:09:19 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:09:20 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.047s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:09:23 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:09:23 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:09:28 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:09:30 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-6a9c922b-ac9c-48c2-bd58-4a2c773fdeb9 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "434ec83b-ca3c-446e-a63b-f130ceaf8e91" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:09:30 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-6a9c922b-ac9c-48c2-bd58-4a2c773fdeb9 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "434ec83b-ca3c-446e-a63b-f130ceaf8e91" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:09:30 user nova-compute[71509]: DEBUG nova.compute.manager [None req-6a9c922b-ac9c-48c2-bd58-4a2c773fdeb9 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 434ec83b-ca3c-446e-a63b-f130ceaf8e91] Starting instance... {{(pid=71509) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 11:09:30 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-6a9c922b-ac9c-48c2-bd58-4a2c773fdeb9 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:09:30 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-6a9c922b-ac9c-48c2-bd58-4a2c773fdeb9 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:09:30 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-6a9c922b-ac9c-48c2-bd58-4a2c773fdeb9 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71509) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 11:09:30 user nova-compute[71509]: INFO nova.compute.claims [None req-6a9c922b-ac9c-48c2-bd58-4a2c773fdeb9 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 434ec83b-ca3c-446e-a63b-f130ceaf8e91] Claim successful on node user
Apr 14 11:09:30 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-6a9c922b-ac9c-48c2-bd58-4a2c773fdeb9 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 11:09:30 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-6a9c922b-ac9c-48c2-bd58-4a2c773fdeb9 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 11:09:30 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-6a9c922b-ac9c-48c2-bd58-4a2c773fdeb9 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.347s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:09:30 user nova-compute[71509]: DEBUG nova.compute.manager [None req-6a9c922b-ac9c-48c2-bd58-4a2c773fdeb9 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 434ec83b-ca3c-446e-a63b-f130ceaf8e91] Start building networks asynchronously for instance. {{(pid=71509) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 11:09:30 user nova-compute[71509]: DEBUG nova.compute.manager [None req-6a9c922b-ac9c-48c2-bd58-4a2c773fdeb9 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 434ec83b-ca3c-446e-a63b-f130ceaf8e91] Allocating IP information in the background. {{(pid=71509) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 11:09:30 user nova-compute[71509]: DEBUG nova.network.neutron [None req-6a9c922b-ac9c-48c2-bd58-4a2c773fdeb9 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 434ec83b-ca3c-446e-a63b-f130ceaf8e91] allocate_for_instance() {{(pid=71509) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 11:09:30 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-6a9c922b-ac9c-48c2-bd58-4a2c773fdeb9 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 434ec83b-ca3c-446e-a63b-f130ceaf8e91] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 11:09:30 user nova-compute[71509]: DEBUG nova.compute.manager [None req-6a9c922b-ac9c-48c2-bd58-4a2c773fdeb9 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 434ec83b-ca3c-446e-a63b-f130ceaf8e91] Start building block device mappings for instance. {{(pid=71509) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 11:09:31 user nova-compute[71509]: INFO nova.virt.block_device [None req-6a9c922b-ac9c-48c2-bd58-4a2c773fdeb9 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 434ec83b-ca3c-446e-a63b-f130ceaf8e91] Booting with volume b6eae10c-5695-41f5-8511-7a5bbc598367 at /dev/vda
Apr 14 11:09:31 user nova-compute[71509]: DEBUG nova.policy [None req-6a9c922b-ac9c-48c2-bd58-4a2c773fdeb9 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c7644d02bc784e4fb74ebaaceb3affe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e7089cb52574f1daf7f578222bb7a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71509) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 11:09:31 user nova-compute[71509]: DEBUG os_brick.utils [None req-6a9c922b-ac9c-48c2-bd58-4a2c773fdeb9 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 11:09:31 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:09:31 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:09:31 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[d150bc0d-eaf2-4329-86bc-5ef56e888f42]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50119df3c417\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:09:31 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:09:31 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:09:31 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[99d584f4-ae5c-47c6-bebb-088b55f1c4fc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:09:31 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:09:31 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:09:31 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dfdb29d-ec0f-4d11-904e-7c3979b9c672]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:09:31 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1f0d729-0a17-4f43-97e6-26c9ae9dbbe4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:09:31 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-6a9c922b-ac9c-48c2-bd58-4a2c773fdeb9 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Running cmd (subprocess): nvme version {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:09:31 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-6a9c922b-ac9c-48c2-bd58-4a2c773fdeb9 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] 'nvme version' failed. Not Retrying. {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 11:09:31 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6a9c922b-ac9c-48c2-bd58-4a2c773fdeb9 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] nvme not present on system {{(pid=71509) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 11:09:31 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:09:31 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 11:09:31 user nova-compute[71509]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 11:09:31 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7e1b575-9f96-4033-bf8f-4d44c5a66826]: (4, '') {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:09:31 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-6a9c922b-ac9c-48c2-bd58-4a2c773fdeb9 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71509) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 11:09:31 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-6a9c922b-ac9c-48c2-bd58-4a2c773fdeb9 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71509) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 11:09:31 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-6a9c922b-ac9c-48c2-bd58-4a2c773fdeb9 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] LIGHTOS: no hostnqn found. {{(pid=71509) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 11:09:31 user nova-compute[71509]: DEBUG os_brick.utils [None req-6a9c922b-ac9c-48c2-bd58-4a2c773fdeb9 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50119df3c417', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 11:09:31 user nova-compute[71509]: DEBUG nova.virt.block_device [None req-6a9c922b-ac9c-48c2-bd58-4a2c773fdeb9 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 434ec83b-ca3c-446e-a63b-f130ceaf8e91] Updating existing volume attachment record: ef9e8861-31e7-4a4b-be40-d17c4ff25efd {{(pid=71509) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 11:09:31 user nova-compute[71509]: DEBUG nova.network.neutron [None req-6a9c922b-ac9c-48c2-bd58-4a2c773fdeb9 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 434ec83b-ca3c-446e-a63b-f130ceaf8e91] Successfully created port: dd3954c8-cff9-4d50-a4bb-63365524ac72 {{(pid=71509) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 11:09:32 user nova-compute[71509]: DEBUG nova.network.neutron [None req-6a9c922b-ac9c-48c2-bd58-4a2c773fdeb9 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 434ec83b-ca3c-446e-a63b-f130ceaf8e91] Successfully updated port: dd3954c8-cff9-4d50-a4bb-63365524ac72 {{(pid=71509) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 11:09:32 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-6a9c922b-ac9c-48c2-bd58-4a2c773fdeb9 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "refresh_cache-434ec83b-ca3c-446e-a63b-f130ceaf8e91" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 11:09:32 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-6a9c922b-ac9c-48c2-bd58-4a2c773fdeb9 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquired lock "refresh_cache-434ec83b-ca3c-446e-a63b-f130ceaf8e91" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 11:09:32 user nova-compute[71509]: DEBUG nova.network.neutron [None req-6a9c922b-ac9c-48c2-bd58-4a2c773fdeb9 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 434ec83b-ca3c-446e-a63b-f130ceaf8e91] Building network info cache for instance {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 11:09:32 user nova-compute[71509]: DEBUG nova.compute.manager [req-619c7b7b-159f-4ca9-b15d-eccde659efe4 req-612a81e1-7d17-4703-b978-9e55714a5853 service nova] [instance: 434ec83b-ca3c-446e-a63b-f130ceaf8e91] Received event network-changed-dd3954c8-cff9-4d50-a4bb-63365524ac72 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:09:32 user nova-compute[71509]: DEBUG nova.compute.manager [req-619c7b7b-159f-4ca9-b15d-eccde659efe4 req-612a81e1-7d17-4703-b978-9e55714a5853 service nova] [instance: 434ec83b-ca3c-446e-a63b-f130ceaf8e91] Refreshing instance network info cache due to event network-changed-dd3954c8-cff9-4d50-a4bb-63365524ac72. {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 11:09:32 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-619c7b7b-159f-4ca9-b15d-eccde659efe4 req-612a81e1-7d17-4703-b978-9e55714a5853 service nova] Acquiring lock "refresh_cache-434ec83b-ca3c-446e-a63b-f130ceaf8e91" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 11:09:32 user nova-compute[71509]: DEBUG nova.network.neutron [None req-6a9c922b-ac9c-48c2-bd58-4a2c773fdeb9 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 434ec83b-ca3c-446e-a63b-f130ceaf8e91] Instance cache missing network info. {{(pid=71509) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 11:09:32 user nova-compute[71509]: DEBUG nova.network.neutron [None req-6a9c922b-ac9c-48c2-bd58-4a2c773fdeb9 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 434ec83b-ca3c-446e-a63b-f130ceaf8e91] Updating instance_info_cache with network_info: [{"id": "dd3954c8-cff9-4d50-a4bb-63365524ac72", "address": "fa:16:3e:63:f2:83", "network": {"id": "6d6b6b35-b5ef-4d7c-abce-cad21cc99e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-878222456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e7089cb52574f1daf7f578222bb7a67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd3954c8-cf", "ovs_interfaceid": "dd3954c8-cff9-4d50-a4bb-63365524ac72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:09:32 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-6a9c922b-ac9c-48c2-bd58-4a2c773fdeb9 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Releasing lock "refresh_cache-434ec83b-ca3c-446e-a63b-f130ceaf8e91" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 11:09:32 user nova-compute[71509]: DEBUG nova.compute.manager [None req-6a9c922b-ac9c-48c2-bd58-4a2c773fdeb9 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 434ec83b-ca3c-446e-a63b-f130ceaf8e91] Instance network_info: |[{"id": "dd3954c8-cff9-4d50-a4bb-63365524ac72", "address": "fa:16:3e:63:f2:83", "network": {"id": "6d6b6b35-b5ef-4d7c-abce-cad21cc99e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-878222456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e7089cb52574f1daf7f578222bb7a67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd3954c8-cf", "ovs_interfaceid": "dd3954c8-cff9-4d50-a4bb-63365524ac72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71509) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 11:09:32 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-619c7b7b-159f-4ca9-b15d-eccde659efe4 req-612a81e1-7d17-4703-b978-9e55714a5853 service nova] Acquired lock "refresh_cache-434ec83b-ca3c-446e-a63b-f130ceaf8e91" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 11:09:32 user nova-compute[71509]: DEBUG nova.network.neutron [req-619c7b7b-159f-4ca9-b15d-eccde659efe4 req-612a81e1-7d17-4703-b978-9e55714a5853 service nova] [instance: 434ec83b-ca3c-446e-a63b-f130ceaf8e91] Refreshing network info cache for port dd3954c8-cff9-4d50-a4bb-63365524ac72 {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 11:09:33 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:09:33 user nova-compute[71509]: DEBUG nova.network.neutron [req-619c7b7b-159f-4ca9-b15d-eccde659efe4 req-612a81e1-7d17-4703-b978-9e55714a5853 service nova] [instance: 434ec83b-ca3c-446e-a63b-f130ceaf8e91] Updated VIF entry in instance network info cache for port dd3954c8-cff9-4d50-a4bb-63365524ac72. {{(pid=71509) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 11:09:33 user nova-compute[71509]: DEBUG nova.network.neutron [req-619c7b7b-159f-4ca9-b15d-eccde659efe4 req-612a81e1-7d17-4703-b978-9e55714a5853 service nova] [instance: 434ec83b-ca3c-446e-a63b-f130ceaf8e91] Updating instance_info_cache with network_info: [{"id": "dd3954c8-cff9-4d50-a4bb-63365524ac72", "address": "fa:16:3e:63:f2:83", "network": {"id": "6d6b6b35-b5ef-4d7c-abce-cad21cc99e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-878222456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e7089cb52574f1daf7f578222bb7a67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd3954c8-cf", "ovs_interfaceid": "dd3954c8-cff9-4d50-a4bb-63365524ac72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:09:33 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-619c7b7b-159f-4ca9-b15d-eccde659efe4 req-612a81e1-7d17-4703-b978-9e55714a5853 service nova] Releasing lock "refresh_cache-434ec83b-ca3c-446e-a63b-f130ceaf8e91" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 11:09:36 user nova-compute[71509]: DEBUG nova.compute.manager [None req-6a9c922b-ac9c-48c2-bd58-4a2c773fdeb9 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 434ec83b-ca3c-446e-a63b-f130ceaf8e91] Start spawning the instance on the hypervisor. {{(pid=71509) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 11:09:36 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-6a9c922b-ac9c-48c2-bd58-4a2c773fdeb9 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 434ec83b-ca3c-446e-a63b-f130ceaf8e91] Creating instance directory {{(pid=71509) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 11:09:36 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-6a9c922b-ac9c-48c2-bd58-4a2c773fdeb9 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 434ec83b-ca3c-446e-a63b-f130ceaf8e91] Creating image(s)
Apr 14 11:09:36 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-6a9c922b-ac9c-48c2-bd58-4a2c773fdeb9 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 434ec83b-ca3c-446e-a63b-f130ceaf8e91] Did not create local disks {{(pid=71509) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 11:09:36 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-6a9c922b-ac9c-48c2-bd58-4a2c773fdeb9 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 434ec83b-ca3c-446e-a63b-f130ceaf8e91] Ensure instance console log exists: /opt/stack/data/nova/instances/434ec83b-ca3c-446e-a63b-f130ceaf8e91/console.log {{(pid=71509) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 11:09:36 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-6a9c922b-ac9c-48c2-bd58-4a2c773fdeb9 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:09:36 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-6a9c922b-ac9c-48c2-bd58-4a2c773fdeb9 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:09:36 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-6a9c922b-ac9c-48c2-bd58-4a2c773fdeb9 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:09:36 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-6a9c922b-ac9c-48c2-bd58-4a2c773fdeb9 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 434ec83b-ca3c-446e-a63b-f130ceaf8e91] Start _get_guest_xml network_info=[{"id": "dd3954c8-cff9-4d50-a4bb-63365524ac72", "address": "fa:16:3e:63:f2:83", "network": {"id": "6d6b6b35-b5ef-4d7c-abce-cad21cc99e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-878222456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e7089cb52574f1daf7f578222bb7a67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd3954c8-cf", "ovs_interfaceid": "dd3954c8-cff9-4d50-a4bb-63365524ac72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'attachment_id': 'ef9e8861-31e7-4a4b-be40-d17c4ff25efd', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b6eae10c-5695-41f5-8511-7a5bbc598367', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TxpZNWGB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '434ec83b-ca3c-446e-a63b-f130ceaf8e91', 'attached_at': '', 'detached_at': '', 'volume_id': 'b6eae10c-5695-41f5-8511-7a5bbc598367', 'serial': 'b6eae10c-5695-41f5-8511-7a5bbc598367'}, 'disk_bus': 'virtio', 'delete_on_termination': True, 'volume_type': None} {{(pid=71509) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 11:09:36 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-6a9c922b-ac9c-48c2-bd58-4a2c773fdeb9 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 11:09:36 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-6a9c922b-ac9c-48c2-bd58-4a2c773fdeb9 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 11:09:36 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-6a9c922b-ac9c-48c2-bd58-4a2c773fdeb9 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71509) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 11:09:36 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-6a9c922b-ac9c-48c2-bd58-4a2c773fdeb9 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T10:40:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 11:09:36 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-6a9c922b-ac9c-48c2-bd58-4a2c773fdeb9 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Flavor limits 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 11:09:36 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-6a9c922b-ac9c-48c2-bd58-4a2c773fdeb9 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Image limits 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 11:09:36 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-6a9c922b-ac9c-48c2-bd58-4a2c773fdeb9 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Flavor pref 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 11:09:36 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-6a9c922b-ac9c-48c2-bd58-4a2c773fdeb9 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Image pref 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 11:09:36 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-6a9c922b-ac9c-48c2-bd58-4a2c773fdeb9 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 11:09:36 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-6a9c922b-ac9c-48c2-bd58-4a2c773fdeb9 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 11:09:36 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-6a9c922b-ac9c-48c2-bd58-4a2c773fdeb9 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71509) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 11:09:36 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-6a9c922b-ac9c-48c2-bd58-4a2c773fdeb9 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Got 1 possible topologies {{(pid=71509) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 11:09:36 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-6a9c922b-ac9c-48c2-bd58-4a2c773fdeb9 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 11:09:36 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-6a9c922b-ac9c-48c2-bd58-4a2c773fdeb9 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 11:09:36 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a9c922b-ac9c-48c2-bd58-4a2c773fdeb9 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 434ec83b-ca3c-446e-a63b-f130ceaf8e91] Calling os-brick to attach iSCSI Volume {{(pid=71509) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 11:09:36 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a9c922b-ac9c-48c2-bd58-4a2c773fdeb9 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0bf0749390>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b6eae10c-5695-41f5-8511-7a5bbc598367', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TxpZNWGB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 11:09:36 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-6a9c922b-ac9c-48c2-bd58-4a2c773fdeb9 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 11:09:36 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-6a9c922b-ac9c-48c2-bd58-4a2c773fdeb9 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 11:09:36 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-6a9c922b-ac9c-48c2-bd58-4a2c773fdeb9 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 11:09:36 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-6a9c922b-ac9c-48c2-bd58-4a2c773fdeb9 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 11:09:36 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-6a9c922b-ac9c-48c2-bd58-4a2c773fdeb9 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b6eae10c-5695-41f5-8511-7a5bbc598367" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 11:09:36 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-6a9c922b-ac9c-48c2-bd58-4a2c773fdeb9 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b6eae10c-5695-41f5-8511-7a5bbc598367" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 11:09:36 user nova-compute[71509]: INFO os_brick.initiator.connectors.iscsi [None req-6a9c922b-ac9c-48c2-bd58-4a2c773fdeb9 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 11:09:36 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6eae10c-5695-41f5-8511-7a5bbc598367 -p 172.16.0.220:3260 {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:09:36 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6eae10c-5695-41f5-8511-7a5bbc598367 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:09:36 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6d5c3cc-f7b2-4dcb-9671-a48f6aa81dbd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:09:36 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a9c922b-ac9c-48c2-bd58-4a2c773fdeb9 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 11:09:36 user nova-compute[71509]:  {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:09:36 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6eae10c-5695-41f5-8511-7a5bbc598367 -p 172.16.0.220:3260 --interface default --op new {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:09:36 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6eae10c-5695-41f5-8511-7a5bbc598367 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:09:36 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5f55983-05e7-492d-b15c-6f091ee18055]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b6eae10c-5695-41f5-8511-7a5bbc598367] added\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:09:36 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a9c922b-ac9c-48c2-bd58-4a2c773fdeb9 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b6eae10c-5695-41f5-8511-7a5bbc598367] added
Apr 14 11:09:36 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:09:36 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6eae10c-5695-41f5-8511-7a5bbc598367 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:09:36 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6eae10c-5695-41f5-8511-7a5bbc598367 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.035s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:09:36 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[b067ccf2-720c-49d2-94be-86d0230cd240]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:09:36 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a9c922b-ac9c-48c2-bd58-4a2c773fdeb9 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:09:36 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6eae10c-5695-41f5-8511-7a5bbc598367 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:09:36 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6eae10c-5695-41f5-8511-7a5bbc598367 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:09:36 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[52734895-e2be-41e0-b00d-ac5bdd702b9b]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:09:36 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a9c922b-ac9c-48c2-bd58-4a2c773fdeb9 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:09:36 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6eae10c-5695-41f5-8511-7a5bbc598367 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TxpZNWGB {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:09:36 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6eae10c-5695-41f5-8511-7a5bbc598367 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TxpZNWGB" returned: 0 in 0.030s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:09:36 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe02671f-200f-4ece-bb36-d54c9e2f1d47]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:09:36 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a9c922b-ac9c-48c2-bd58-4a2c773fdeb9 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TxpZNWGB'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:09:36 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6eae10c-5695-41f5-8511-7a5bbc598367 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:09:36 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6eae10c-5695-41f5-8511-7a5bbc598367 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.034s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:09:36 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[f71bafda-2e62-44cf-9f58-4f492a259c7d]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:09:36 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a9c922b-ac9c-48c2-bd58-4a2c773fdeb9 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:09:36 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:09:36 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:09:36 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[a280f821-4c90-440f-8363-6ef91423b4d1]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad9a8e38-a4a0-464f-8ac1-32552aaa2af3 (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:09:36 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a9c922b-ac9c-48c2-bd58-4a2c773fdeb9 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad9a8e38-a4a0-464f-8ac1-32552aaa2af3 (non-flash)
Apr 14 11:09:36 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 11:09:36 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a9c922b-ac9c-48c2-bd58-4a2c773fdeb9 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad9a8e38-a4a0-464f-8ac1-32552aaa2af3 (non-flash)
Apr 14 11:09:36 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 11:09:36 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6eae10c-5695-41f5-8511-7a5bbc598367 -p 172.16.0.220:3260 --login {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:09:36 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6eae10c-5695-41f5-8511-7a5bbc598367 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:09:36 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[2db2fb3f-d86c-4b0d-9007-448945f1474d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b6eae10c-5695-41f5-8511-7a5bbc598367, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b6eae10c-5695-41f5-8511-7a5bbc598367, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:09:36 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a9c922b-ac9c-48c2-bd58-4a2c773fdeb9 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b6eae10c-5695-41f5-8511-7a5bbc598367, portal: 172.16.0.220,3260]
Apr 14 11:09:36 user nova-compute[71509]: Login to [iface: default, target: iqn.2010-10.org.openstack:b6eae10c-5695-41f5-8511-7a5bbc598367, portal: 172.16.0.220,3260] successful.
Apr 14 11:09:36 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:09:36 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6eae10c-5695-41f5-8511-7a5bbc598367 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:09:36 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6eae10c-5695-41f5-8511-7a5bbc598367 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:09:36 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bfa6a4d-10e7-4ed4-8ce7-e33df03ae7e8]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:09:36 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a9c922b-ac9c-48c2-bd58-4a2c773fdeb9 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:09:36 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:09:36 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:09:36 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[91689608-ca59-4712-bd06-0b6917a3a558]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad9a8e38-a4a0-464f-8ac1-32552aaa2af3 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6eae10c-5695-41f5-8511-7a5bbc598367 (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:09:36 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a9c922b-ac9c-48c2-bd58-4a2c773fdeb9 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad9a8e38-a4a0-464f-8ac1-32552aaa2af3 (non-flash)
Apr 14 11:09:36 user nova-compute[71509]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6eae10c-5695-41f5-8511-7a5bbc598367 (non-flash)
Apr 14 11:09:36 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 11:09:36 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a9c922b-ac9c-48c2-bd58-4a2c773fdeb9 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad9a8e38-a4a0-464f-8ac1-32552aaa2af3 (non-flash)
Apr 14 11:09:36 user nova-compute[71509]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6eae10c-5695-41f5-8511-7a5bbc598367 (non-flash)
Apr 14 11:09:36 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 11:09:36 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-6a9c922b-ac9c-48c2-bd58-4a2c773fdeb9 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b6eae10c-5695-41f5-8511-7a5bbc598367" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.351s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 11:09:36 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a9c922b-ac9c-48c2-bd58-4a2c773fdeb9 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Connected to 172.16.0.220:3260 {{(pid=71509) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 11:09:36 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-6a9c922b-ac9c-48c2-bd58-4a2c773fdeb9 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] HCTL ('34', '-', '-', 0) found on session 50 with lun 0 {{(pid=71509) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 11:09:36 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-6a9c922b-ac9c-48c2-bd58-4a2c773fdeb9 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71509) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 11:09:36 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:09:36 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:09:36 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[746db111-b151-404e-875a-4521e002b98a]: (4, ('- - 0', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:09:36 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-6a9c922b-ac9c-48c2-bd58-4a2c773fdeb9 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Searching for a device in session 50 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71509) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 11:09:36 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a9c922b-ac9c-48c2-bd58-4a2c773fdeb9 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:b6eae10c-5695-41f5-8511-7a5bbc598367', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TxpZNWGB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71509) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 11:09:37 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-6a9c922b-ac9c-48c2-bd58-4a2c773fdeb9 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.389s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 11:09:37 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a9c922b-ac9c-48c2-bd58-4a2c773fdeb9 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] <== connect_volume: return (1390ms) {'type': 'block', 'scsi_wwn': '26434363831626438', 'path': '/dev/sdc'} {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 11:09:37 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a9c922b-ac9c-48c2-bd58-4a2c773fdeb9 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 434ec83b-ca3c-446e-a63b-f130ceaf8e91] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26434363831626438', 'path': '/dev/sdc'} {{(pid=71509) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 11:09:38 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-6a9c922b-ac9c-48c2-bd58-4a2c773fdeb9 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T11:09:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1989339962',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1989339962',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1989339962',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e7089cb52574f1daf7f578222bb7a67',ramdisk_id='',reservation_id='r-nvd0exzj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-193101874',owner_user_name='tempest-TestVolumeBootPattern-193101874-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T11:09:31Z,user_data=None,user_id='c7644d02bc784e4fb74ebaaceb3affe1',uuid=434ec83b-ca3c-446e-a63b-f130ceaf8e91,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dd3954c8-cff9-4d50-a4bb-63365524ac72", "address": "fa:16:3e:63:f2:83", "network": {"id": "6d6b6b35-b5ef-4d7c-abce-cad21cc99e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-878222456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e7089cb52574f1daf7f578222bb7a67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd3954c8-cf", "ovs_interfaceid": "dd3954c8-cff9-4d50-a4bb-63365524ac72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71509) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 11:09:38 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-6a9c922b-ac9c-48c2-bd58-4a2c773fdeb9 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Converting VIF {"id": "dd3954c8-cff9-4d50-a4bb-63365524ac72", "address": "fa:16:3e:63:f2:83", "network": {"id": "6d6b6b35-b5ef-4d7c-abce-cad21cc99e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-878222456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e7089cb52574f1daf7f578222bb7a67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd3954c8-cf", "ovs_interfaceid": "dd3954c8-cff9-4d50-a4bb-63365524ac72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 11:09:38 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-6a9c922b-ac9c-48c2-bd58-4a2c773fdeb9 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:f2:83,bridge_name='br-int',has_traffic_filtering=True,id=dd3954c8-cff9-4d50-a4bb-63365524ac72,network=Network(6d6b6b35-b5ef-4d7c-abce-cad21cc99e32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd3954c8-cf') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 11:09:38 user nova-compute[71509]: DEBUG nova.objects.instance [None req-6a9c922b-ac9c-48c2-bd58-4a2c773fdeb9 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lazy-loading 'pci_devices' on Instance uuid 434ec83b-ca3c-446e-a63b-f130ceaf8e91 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 11:09:38 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-6a9c922b-ac9c-48c2-bd58-4a2c773fdeb9 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 434ec83b-ca3c-446e-a63b-f130ceaf8e91] End _get_guest_xml xml=<domain type="kvm">
Apr 14 11:09:38 user nova-compute[71509]:   <uuid>434ec83b-ca3c-446e-a63b-f130ceaf8e91</uuid>
Apr 14 11:09:38 user nova-compute[71509]:   <name>instance-0000002b</name>
Apr 14 11:09:38 user nova-compute[71509]:   <memory>131072</memory>
Apr 14 11:09:38 user nova-compute[71509]:   <vcpu>1</vcpu>
Apr 14 11:09:38 user nova-compute[71509]:   <metadata>
Apr 14 11:09:38 user nova-compute[71509]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 11:09:38 user nova-compute[71509]:       <nova:package version="0.0.0"/>
Apr 14 11:09:38 user nova-compute[71509]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1989339962</nova:name>
Apr 14 11:09:38 user nova-compute[71509]:       <nova:creationTime>2023-04-14 11:09:36</nova:creationTime>
Apr 14 11:09:38 user nova-compute[71509]:       <nova:flavor name="m1.nano">
Apr 14 11:09:38 user nova-compute[71509]:         <nova:memory>128</nova:memory>
Apr 14 11:09:38 user nova-compute[71509]:         <nova:disk>1</nova:disk>
Apr 14 11:09:38 user nova-compute[71509]:         <nova:swap>0</nova:swap>
Apr 14 11:09:38 user nova-compute[71509]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 11:09:38 user nova-compute[71509]:         <nova:vcpus>1</nova:vcpus>
Apr 14 11:09:38 user nova-compute[71509]:       </nova:flavor>
Apr 14 11:09:38 user nova-compute[71509]:       <nova:owner>
Apr 14 11:09:38 user nova-compute[71509]:         <nova:user uuid="c7644d02bc784e4fb74ebaaceb3affe1">tempest-TestVolumeBootPattern-193101874-project-member</nova:user>
Apr 14 11:09:38 user nova-compute[71509]:         <nova:project uuid="2e7089cb52574f1daf7f578222bb7a67">tempest-TestVolumeBootPattern-193101874</nova:project>
Apr 14 11:09:38 user nova-compute[71509]:       </nova:owner>
Apr 14 11:09:38 user nova-compute[71509]:       <nova:ports>
Apr 14 11:09:38 user nova-compute[71509]:         <nova:port uuid="dd3954c8-cff9-4d50-a4bb-63365524ac72">
Apr 14 11:09:38 user nova-compute[71509]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 14 11:09:38 user nova-compute[71509]:         </nova:port>
Apr 14 11:09:38 user nova-compute[71509]:       </nova:ports>
Apr 14 11:09:38 user nova-compute[71509]:     </nova:instance>
Apr 14 11:09:38 user nova-compute[71509]:   </metadata>
Apr 14 11:09:38 user nova-compute[71509]:   <sysinfo type="smbios">
Apr 14 11:09:38 user nova-compute[71509]:     <system>
Apr 14 11:09:38 user nova-compute[71509]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 11:09:38 user nova-compute[71509]:       <entry name="product">OpenStack Nova</entry>
Apr 14 11:09:38 user nova-compute[71509]:       <entry name="version">0.0.0</entry>
Apr 14 11:09:38 user nova-compute[71509]:       <entry name="serial">434ec83b-ca3c-446e-a63b-f130ceaf8e91</entry>
Apr 14 11:09:38 user nova-compute[71509]:       <entry name="uuid">434ec83b-ca3c-446e-a63b-f130ceaf8e91</entry>
Apr 14 11:09:38 user nova-compute[71509]:       <entry name="family">Virtual Machine</entry>
Apr 14 11:09:38 user nova-compute[71509]:     </system>
Apr 14 11:09:38 user nova-compute[71509]:   </sysinfo>
Apr 14 11:09:38 user nova-compute[71509]:   <os>
Apr 14 11:09:38 user nova-compute[71509]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 11:09:38 user nova-compute[71509]:     <boot dev="hd"/>
Apr 14 11:09:38 user nova-compute[71509]:     <smbios mode="sysinfo"/>
Apr 14 11:09:38 user nova-compute[71509]:   </os>
Apr 14 11:09:38 user nova-compute[71509]:   <features>
Apr 14 11:09:38 user nova-compute[71509]:     <acpi/>
Apr 14 11:09:38 user nova-compute[71509]:     <apic/>
Apr 14 11:09:38 user nova-compute[71509]:     <vmcoreinfo/>
Apr 14 11:09:38 user nova-compute[71509]:   </features>
Apr 14 11:09:38 user nova-compute[71509]:   <clock offset="utc">
Apr 14 11:09:38 user nova-compute[71509]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 11:09:38 user nova-compute[71509]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 11:09:38 user nova-compute[71509]:     <timer name="hpet" present="no"/>
Apr 14 11:09:38 user nova-compute[71509]:   </clock>
Apr 14 11:09:38 user nova-compute[71509]:   <cpu mode="custom" match="exact">
Apr 14 11:09:38 user nova-compute[71509]:     <model>Nehalem</model>
Apr 14 11:09:38 user nova-compute[71509]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 11:09:38 user nova-compute[71509]:   </cpu>
Apr 14 11:09:38 user nova-compute[71509]:   <devices>
Apr 14 11:09:38 user nova-compute[71509]:     <disk type="block" device="disk">
Apr 14 11:09:38 user nova-compute[71509]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 11:09:38 user nova-compute[71509]:       <source dev="/dev/sdc"/>
Apr 14 11:09:38 user nova-compute[71509]:       <target dev="vda" bus="virtio"/>
Apr 14 11:09:38 user nova-compute[71509]:       <serial>b6eae10c-5695-41f5-8511-7a5bbc598367</serial>
Apr 14 11:09:38 user nova-compute[71509]:     </disk>
Apr 14 11:09:38 user nova-compute[71509]:     <interface type="ethernet">
Apr 14 11:09:38 user nova-compute[71509]:       <mac address="fa:16:3e:63:f2:83"/>
Apr 14 11:09:38 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 11:09:38 user nova-compute[71509]:       <mtu size="1442"/>
Apr 14 11:09:38 user nova-compute[71509]:       <target dev="tapdd3954c8-cf"/>
Apr 14 11:09:38 user nova-compute[71509]:     </interface>
Apr 14 11:09:38 user nova-compute[71509]:     <serial type="pty">
Apr 14 11:09:38 user nova-compute[71509]:       <log file="/opt/stack/data/nova/instances/434ec83b-ca3c-446e-a63b-f130ceaf8e91/console.log" append="off"/>
Apr 14 11:09:38 user nova-compute[71509]:     </serial>
Apr 14 11:09:38 user nova-compute[71509]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 11:09:38 user nova-compute[71509]:     <video>
Apr 14 11:09:38 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 11:09:38 user nova-compute[71509]:     </video>
Apr 14 11:09:38 user nova-compute[71509]:     <rng model="virtio">
Apr 14 11:09:38 user nova-compute[71509]:       <backend model="random">/dev/urandom</backend>
Apr 14 11:09:38 user nova-compute[71509]:     </rng>
Apr 14 11:09:38 user nova-compute[71509]:     <controller type="usb" index="0" model="none"/>
Apr 14 11:09:38 user nova-compute[71509]:     <memballoon model="virtio">
Apr 14 11:09:38 user nova-compute[71509]:       <stats period="10"/>
Apr 14 11:09:38 user nova-compute[71509]:     </memballoon>
Apr 14 11:09:38 user nova-compute[71509]:   </devices>
Apr 14 11:09:38 user nova-compute[71509]: </domain>
Apr 14 11:09:38 user nova-compute[71509]:  {{(pid=71509) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 11:09:38 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-6a9c922b-ac9c-48c2-bd58-4a2c773fdeb9 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T11:09:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1989339962',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1989339962',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1989339962',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e7089cb52574f1daf7f578222bb7a67',ramdisk_id='',reservation_id='r-nvd0exzj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-193101874',owner_user_name='tempest-TestVolumeBootPattern-193101874-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T11:09:31Z,user_data=None,user_id='c7644d02bc784e4fb74ebaaceb3affe1',uuid=434ec83b-ca3c-446e-a63b-f130ceaf8e91,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dd3954c8-cff9-4d50-a4bb-63365524ac72", "address": "fa:16:3e:63:f2:83", "network": {"id": "6d6b6b35-b5ef-4d7c-abce-cad21cc99e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-878222456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e7089cb52574f1daf7f578222bb7a67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd3954c8-cf", "ovs_interfaceid": "dd3954c8-cff9-4d50-a4bb-63365524ac72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 11:09:38 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-6a9c922b-ac9c-48c2-bd58-4a2c773fdeb9 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Converting VIF {"id": "dd3954c8-cff9-4d50-a4bb-63365524ac72", "address": "fa:16:3e:63:f2:83", "network": {"id": "6d6b6b35-b5ef-4d7c-abce-cad21cc99e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-878222456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e7089cb52574f1daf7f578222bb7a67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd3954c8-cf", "ovs_interfaceid": "dd3954c8-cff9-4d50-a4bb-63365524ac72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 11:09:38 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-6a9c922b-ac9c-48c2-bd58-4a2c773fdeb9 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:f2:83,bridge_name='br-int',has_traffic_filtering=True,id=dd3954c8-cff9-4d50-a4bb-63365524ac72,network=Network(6d6b6b35-b5ef-4d7c-abce-cad21cc99e32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd3954c8-cf') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 11:09:38 user nova-compute[71509]: DEBUG os_vif [None req-6a9c922b-ac9c-48c2-bd58-4a2c773fdeb9 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:f2:83,bridge_name='br-int',has_traffic_filtering=True,id=dd3954c8-cff9-4d50-a4bb-63365524ac72,network=Network(6d6b6b35-b5ef-4d7c-abce-cad21cc99e32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd3954c8-cf') {{(pid=71509) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 11:09:38 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:09:38 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:09:38 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 11:09:38 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:09:38 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdd3954c8-cf, may_exist=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:09:38 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdd3954c8-cf, col_values=(('external_ids', {'iface-id': 'dd3954c8-cff9-4d50-a4bb-63365524ac72', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:63:f2:83', 'vm-uuid': '434ec83b-ca3c-446e-a63b-f130ceaf8e91'}),)) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:09:38 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:09:38 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:09:38 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:09:38 user nova-compute[71509]: INFO os_vif [None req-6a9c922b-ac9c-48c2-bd58-4a2c773fdeb9 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:f2:83,bridge_name='br-int',has_traffic_filtering=True,id=dd3954c8-cff9-4d50-a4bb-63365524ac72,network=Network(6d6b6b35-b5ef-4d7c-abce-cad21cc99e32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd3954c8-cf')
Apr 14 11:09:38 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-6a9c922b-ac9c-48c2-bd58-4a2c773fdeb9 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] No BDM found with device name vda, not building metadata. {{(pid=71509) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 11:09:38 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-6a9c922b-ac9c-48c2-bd58-4a2c773fdeb9 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] No VIF found with MAC fa:16:3e:63:f2:83, not building metadata {{(pid=71509) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 11:09:38 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:09:39 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:09:39 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:09:39 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:09:39 user nova-compute[71509]: DEBUG nova.compute.manager [req-569613c2-97b7-43c8-a8fa-57735bed57d0 req-41f882b7-1d03-4b93-8271-94dc17f76b12 service nova] [instance: 434ec83b-ca3c-446e-a63b-f130ceaf8e91] Received event network-vif-plugged-dd3954c8-cff9-4d50-a4bb-63365524ac72 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:09:39 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-569613c2-97b7-43c8-a8fa-57735bed57d0 req-41f882b7-1d03-4b93-8271-94dc17f76b12 service nova] Acquiring lock "434ec83b-ca3c-446e-a63b-f130ceaf8e91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:09:39 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-569613c2-97b7-43c8-a8fa-57735bed57d0 req-41f882b7-1d03-4b93-8271-94dc17f76b12 service nova] Lock "434ec83b-ca3c-446e-a63b-f130ceaf8e91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:09:39 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-569613c2-97b7-43c8-a8fa-57735bed57d0 req-41f882b7-1d03-4b93-8271-94dc17f76b12 service nova] Lock "434ec83b-ca3c-446e-a63b-f130ceaf8e91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:09:39 user nova-compute[71509]: DEBUG nova.compute.manager [req-569613c2-97b7-43c8-a8fa-57735bed57d0 req-41f882b7-1d03-4b93-8271-94dc17f76b12 service nova] [instance: 434ec83b-ca3c-446e-a63b-f130ceaf8e91] No waiting events found dispatching network-vif-plugged-dd3954c8-cff9-4d50-a4bb-63365524ac72 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:09:39 user nova-compute[71509]: WARNING nova.compute.manager [req-569613c2-97b7-43c8-a8fa-57735bed57d0 req-41f882b7-1d03-4b93-8271-94dc17f76b12 service nova] [instance: 434ec83b-ca3c-446e-a63b-f130ceaf8e91] Received unexpected event network-vif-plugged-dd3954c8-cff9-4d50-a4bb-63365524ac72 for instance with vm_state building and task_state spawning.
Apr 14 11:09:39 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:09:39 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:09:40 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:09:41 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681470581.5327635, 434ec83b-ca3c-446e-a63b-f130ceaf8e91 => Resumed> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 11:09:41 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 434ec83b-ca3c-446e-a63b-f130ceaf8e91] VM Resumed (Lifecycle Event)
Apr 14 11:09:41 user nova-compute[71509]: DEBUG nova.compute.manager [None req-6a9c922b-ac9c-48c2-bd58-4a2c773fdeb9 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 434ec83b-ca3c-446e-a63b-f130ceaf8e91] Instance event wait completed in 0 seconds for  {{(pid=71509) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 11:09:41 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-6a9c922b-ac9c-48c2-bd58-4a2c773fdeb9 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 434ec83b-ca3c-446e-a63b-f130ceaf8e91] Guest created on hypervisor {{(pid=71509) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 11:09:41 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: 434ec83b-ca3c-446e-a63b-f130ceaf8e91] Instance spawned successfully.
Apr 14 11:09:41 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-6a9c922b-ac9c-48c2-bd58-4a2c773fdeb9 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 434ec83b-ca3c-446e-a63b-f130ceaf8e91] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 11:09:41 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 434ec83b-ca3c-446e-a63b-f130ceaf8e91] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 11:09:41 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 434ec83b-ca3c-446e-a63b-f130ceaf8e91] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 11:09:41 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-6a9c922b-ac9c-48c2-bd58-4a2c773fdeb9 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 434ec83b-ca3c-446e-a63b-f130ceaf8e91] Found default for hw_cdrom_bus of ide {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:09:41 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-6a9c922b-ac9c-48c2-bd58-4a2c773fdeb9 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 434ec83b-ca3c-446e-a63b-f130ceaf8e91] Found default for hw_disk_bus of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:09:41 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-6a9c922b-ac9c-48c2-bd58-4a2c773fdeb9 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 434ec83b-ca3c-446e-a63b-f130ceaf8e91] Found default for hw_input_bus of None {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:09:41 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-6a9c922b-ac9c-48c2-bd58-4a2c773fdeb9 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 434ec83b-ca3c-446e-a63b-f130ceaf8e91] Found default for hw_pointer_model of None {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:09:41 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-6a9c922b-ac9c-48c2-bd58-4a2c773fdeb9 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 434ec83b-ca3c-446e-a63b-f130ceaf8e91] Found default for hw_video_model of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:09:41 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-6a9c922b-ac9c-48c2-bd58-4a2c773fdeb9 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 434ec83b-ca3c-446e-a63b-f130ceaf8e91] Found default for hw_vif_model of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:09:41 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 434ec83b-ca3c-446e-a63b-f130ceaf8e91] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 11:09:41 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681470581.533175, 434ec83b-ca3c-446e-a63b-f130ceaf8e91 => Started> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 11:09:41 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 434ec83b-ca3c-446e-a63b-f130ceaf8e91] VM Started (Lifecycle Event)
Apr 14 11:09:41 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 434ec83b-ca3c-446e-a63b-f130ceaf8e91] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 11:09:41 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 434ec83b-ca3c-446e-a63b-f130ceaf8e91] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 11:09:41 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 434ec83b-ca3c-446e-a63b-f130ceaf8e91] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 11:09:41 user nova-compute[71509]: DEBUG nova.compute.manager [req-cee2edbb-1e6c-46a7-9030-a8bb0b4b63eb req-efdb2a92-2295-4e5e-9d05-db110f5ff0f5 service nova] [instance: 434ec83b-ca3c-446e-a63b-f130ceaf8e91] Received event network-vif-plugged-dd3954c8-cff9-4d50-a4bb-63365524ac72 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:09:41 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-cee2edbb-1e6c-46a7-9030-a8bb0b4b63eb req-efdb2a92-2295-4e5e-9d05-db110f5ff0f5 service nova] Acquiring lock "434ec83b-ca3c-446e-a63b-f130ceaf8e91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:09:41 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-cee2edbb-1e6c-46a7-9030-a8bb0b4b63eb req-efdb2a92-2295-4e5e-9d05-db110f5ff0f5 service nova] Lock "434ec83b-ca3c-446e-a63b-f130ceaf8e91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:09:41 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-cee2edbb-1e6c-46a7-9030-a8bb0b4b63eb req-efdb2a92-2295-4e5e-9d05-db110f5ff0f5 service nova] Lock "434ec83b-ca3c-446e-a63b-f130ceaf8e91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:09:41 user nova-compute[71509]: DEBUG nova.compute.manager [req-cee2edbb-1e6c-46a7-9030-a8bb0b4b63eb req-efdb2a92-2295-4e5e-9d05-db110f5ff0f5 service nova] [instance: 434ec83b-ca3c-446e-a63b-f130ceaf8e91] No waiting events found dispatching network-vif-plugged-dd3954c8-cff9-4d50-a4bb-63365524ac72 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:09:41 user nova-compute[71509]: WARNING nova.compute.manager [req-cee2edbb-1e6c-46a7-9030-a8bb0b4b63eb req-efdb2a92-2295-4e5e-9d05-db110f5ff0f5 service nova] [instance: 434ec83b-ca3c-446e-a63b-f130ceaf8e91] Received unexpected event network-vif-plugged-dd3954c8-cff9-4d50-a4bb-63365524ac72 for instance with vm_state building and task_state spawning.
Apr 14 11:09:41 user nova-compute[71509]: INFO nova.compute.manager [None req-6a9c922b-ac9c-48c2-bd58-4a2c773fdeb9 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 434ec83b-ca3c-446e-a63b-f130ceaf8e91] Took 5.19 seconds to spawn the instance on the hypervisor.
Apr 14 11:09:41 user nova-compute[71509]: DEBUG nova.compute.manager [None req-6a9c922b-ac9c-48c2-bd58-4a2c773fdeb9 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 434ec83b-ca3c-446e-a63b-f130ceaf8e91] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 11:09:41 user nova-compute[71509]: INFO nova.compute.manager [None req-6a9c922b-ac9c-48c2-bd58-4a2c773fdeb9 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 434ec83b-ca3c-446e-a63b-f130ceaf8e91] Took 11.25 seconds to build instance.
Apr 14 11:09:41 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-6a9c922b-ac9c-48c2-bd58-4a2c773fdeb9 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "434ec83b-ca3c-446e-a63b-f130ceaf8e91" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.348s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:09:43 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:09:43 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:09:47 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:09:47 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71509) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 11:09:48 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:09:49 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:09:49 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:09:52 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:09:53 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:09:53 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:09:53 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71509) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 11:09:53 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71509) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 11:09:53 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71509) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 11:09:53 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:09:53 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:09:54 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:09:54 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:09:57 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:09:58 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:09:58 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:09:59 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:10:01 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:10:01 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:10:01 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:10:01 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:10:01 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Auditing locally available compute resources for user (node: user) {{(pid=71509) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 11:10:01 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:10:01 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:10:01 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:10:01 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:10:01 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=71509) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 11:10:01 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71509) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 11:10:02 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 11:10:02 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 11:10:02 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Hypervisor/Node resource view: name=user free_ram=8517MB free_disk=25.923664093017578GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71509) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 11:10:02 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:10:02 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:10:02 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 11:10:02 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 434ec83b-ca3c-446e-a63b-f130ceaf8e91 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 11:10:02 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71509) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 11:10:02 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71509) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 11:10:02 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 11:10:02 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 11:10:02 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Compute_service record updated for user:user {{(pid=71509) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 11:10:02 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.252s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:10:03 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:10:03 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:10:06 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:10:06 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Starting heal instance info cache {{(pid=71509) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 11:10:06 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Rebuilding the list of instances to heal {{(pid=71509) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 11:10:06 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "refresh_cache-6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 11:10:06 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquired lock "refresh_cache-6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 11:10:06 user nova-compute[71509]: DEBUG nova.network.neutron [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] Forcefully refreshing network info cache for instance {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 11:10:06 user nova-compute[71509]: DEBUG nova.objects.instance [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lazy-loading 'info_cache' on Instance uuid 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 11:10:07 user nova-compute[71509]: DEBUG nova.network.neutron [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] Updating instance_info_cache with network_info: [{"id": "cc02fdc1-b3b9-4ca0-937a-fdcc2a3ba608", "address": "fa:16:3e:d0:2f:a0", "network": {"id": "d59680e7-ed50-4356-b665-ec64ff939708", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-598238133-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5809862340a84c83a772c65c77513608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc02fdc1-b3", "ovs_interfaceid": "cc02fdc1-b3b9-4ca0-937a-fdcc2a3ba608", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:10:07 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Releasing lock "refresh_cache-6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 11:10:07 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] Updated the network info_cache for instance {{(pid=71509) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 11:10:08 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:10:08 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:10:13 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:10:18 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:10:23 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:10:23 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:10:28 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:10:33 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:10:33 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:10:33 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71509) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 11:10:33 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71509) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 11:10:33 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71509) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 11:10:33 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:10:38 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:10:41 user nova-compute[71509]: DEBUG nova.compute.manager [req-fe6f9aec-660c-4c2b-a8d6-366b82c005a0 req-5d4486dd-b773-4f71-81a1-cdd92dfdf24a service nova] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] Received event network-changed-cc02fdc1-b3b9-4ca0-937a-fdcc2a3ba608 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:10:41 user nova-compute[71509]: DEBUG nova.compute.manager [req-fe6f9aec-660c-4c2b-a8d6-366b82c005a0 req-5d4486dd-b773-4f71-81a1-cdd92dfdf24a service nova] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] Refreshing instance network info cache due to event network-changed-cc02fdc1-b3b9-4ca0-937a-fdcc2a3ba608. {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 11:10:41 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-fe6f9aec-660c-4c2b-a8d6-366b82c005a0 req-5d4486dd-b773-4f71-81a1-cdd92dfdf24a service nova] Acquiring lock "refresh_cache-6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 11:10:41 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-fe6f9aec-660c-4c2b-a8d6-366b82c005a0 req-5d4486dd-b773-4f71-81a1-cdd92dfdf24a service nova] Acquired lock "refresh_cache-6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 11:10:41 user nova-compute[71509]: DEBUG nova.network.neutron [req-fe6f9aec-660c-4c2b-a8d6-366b82c005a0 req-5d4486dd-b773-4f71-81a1-cdd92dfdf24a service nova] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] Refreshing network info cache for port cc02fdc1-b3b9-4ca0-937a-fdcc2a3ba608 {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 11:10:41 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:10:42 user nova-compute[71509]: DEBUG nova.compute.manager [req-02d43780-3469-4b27-9b6e-43f81ac403da req-c50ec026-8394-4549-84e8-0541f0bdf267 service nova] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] Received event network-changed-cc02fdc1-b3b9-4ca0-937a-fdcc2a3ba608 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:10:42 user nova-compute[71509]: DEBUG nova.compute.manager [req-02d43780-3469-4b27-9b6e-43f81ac403da req-c50ec026-8394-4549-84e8-0541f0bdf267 service nova] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] Refreshing instance network info cache due to event network-changed-cc02fdc1-b3b9-4ca0-937a-fdcc2a3ba608. {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 11:10:42 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-02d43780-3469-4b27-9b6e-43f81ac403da req-c50ec026-8394-4549-84e8-0541f0bdf267 service nova] Acquiring lock "refresh_cache-6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 11:10:42 user nova-compute[71509]: DEBUG nova.network.neutron [req-fe6f9aec-660c-4c2b-a8d6-366b82c005a0 req-5d4486dd-b773-4f71-81a1-cdd92dfdf24a service nova] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] Updated VIF entry in instance network info cache for port cc02fdc1-b3b9-4ca0-937a-fdcc2a3ba608. {{(pid=71509) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 11:10:42 user nova-compute[71509]: DEBUG nova.network.neutron [req-fe6f9aec-660c-4c2b-a8d6-366b82c005a0 req-5d4486dd-b773-4f71-81a1-cdd92dfdf24a service nova] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] Updating instance_info_cache with network_info: [{"id": "cc02fdc1-b3b9-4ca0-937a-fdcc2a3ba608", "address": "fa:16:3e:d0:2f:a0", "network": {"id": "d59680e7-ed50-4356-b665-ec64ff939708", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-598238133-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5809862340a84c83a772c65c77513608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc02fdc1-b3", "ovs_interfaceid": "cc02fdc1-b3b9-4ca0-937a-fdcc2a3ba608", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:10:42 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-fe6f9aec-660c-4c2b-a8d6-366b82c005a0 req-5d4486dd-b773-4f71-81a1-cdd92dfdf24a service nova] Releasing lock "refresh_cache-6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 11:10:42 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-02d43780-3469-4b27-9b6e-43f81ac403da req-c50ec026-8394-4549-84e8-0541f0bdf267 service nova] Acquired lock "refresh_cache-6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 11:10:42 user nova-compute[71509]: DEBUG nova.network.neutron [req-02d43780-3469-4b27-9b6e-43f81ac403da req-c50ec026-8394-4549-84e8-0541f0bdf267 service nova] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] Refreshing network info cache for port cc02fdc1-b3b9-4ca0-937a-fdcc2a3ba608 {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 11:10:42 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-0ce5df7a-b5b2-465d-97ac-5ab0f215b379 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Acquiring lock "6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:10:42 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-0ce5df7a-b5b2-465d-97ac-5ab0f215b379 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:10:42 user nova-compute[71509]: INFO nova.compute.manager [None req-0ce5df7a-b5b2-465d-97ac-5ab0f215b379 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] Detaching volume ad9a8e38-a4a0-464f-8ac1-32552aaa2af3
Apr 14 11:10:42 user nova-compute[71509]: INFO nova.virt.block_device [None req-0ce5df7a-b5b2-465d-97ac-5ab0f215b379 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] Attempting to driver detach volume ad9a8e38-a4a0-464f-8ac1-32552aaa2af3 from mountpoint /dev/vdb
Apr 14 11:10:42 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-0ce5df7a-b5b2-465d-97ac-5ab0f215b379 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Attempting to detach device vdb from instance 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99 from the persistent domain config. {{(pid=71509) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2458}}
Apr 14 11:10:42 user nova-compute[71509]: DEBUG nova.virt.libvirt.guest [None req-0ce5df7a-b5b2-465d-97ac-5ab0f215b379 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 11:10:42 user nova-compute[71509]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 11:10:42 user nova-compute[71509]:   <source dev="/dev/sdb"/>
Apr 14 11:10:42 user nova-compute[71509]:   <target dev="vdb" bus="virtio"/>
Apr 14 11:10:42 user nova-compute[71509]:   <serial>ad9a8e38-a4a0-464f-8ac1-32552aaa2af3</serial>
Apr 14 11:10:42 user nova-compute[71509]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 11:10:42 user nova-compute[71509]: </disk>
Apr 14 11:10:42 user nova-compute[71509]:  {{(pid=71509) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 11:10:42 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-0ce5df7a-b5b2-465d-97ac-5ab0f215b379 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Successfully detached device vdb from instance 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99 from the persistent domain config.
Apr 14 11:10:42 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-0ce5df7a-b5b2-465d-97ac-5ab0f215b379 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99 from the live domain config. {{(pid=71509) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2494}}
Apr 14 11:10:42 user nova-compute[71509]: DEBUG nova.virt.libvirt.guest [None req-0ce5df7a-b5b2-465d-97ac-5ab0f215b379 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] detach device xml: <disk type="block" device="disk">
Apr 14 11:10:42 user nova-compute[71509]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 11:10:42 user nova-compute[71509]:   <source dev="/dev/sdb"/>
Apr 14 11:10:42 user nova-compute[71509]:   <target dev="vdb" bus="virtio"/>
Apr 14 11:10:42 user nova-compute[71509]:   <serial>ad9a8e38-a4a0-464f-8ac1-32552aaa2af3</serial>
Apr 14 11:10:42 user nova-compute[71509]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Apr 14 11:10:42 user nova-compute[71509]: </disk>
Apr 14 11:10:42 user nova-compute[71509]:  {{(pid=71509) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Apr 14 11:10:42 user nova-compute[71509]: DEBUG nova.network.neutron [req-02d43780-3469-4b27-9b6e-43f81ac403da req-c50ec026-8394-4549-84e8-0541f0bdf267 service nova] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] Updated VIF entry in instance network info cache for port cc02fdc1-b3b9-4ca0-937a-fdcc2a3ba608. {{(pid=71509) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 11:10:42 user nova-compute[71509]: DEBUG nova.network.neutron [req-02d43780-3469-4b27-9b6e-43f81ac403da req-c50ec026-8394-4549-84e8-0541f0bdf267 service nova] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] Updating instance_info_cache with network_info: [{"id": "cc02fdc1-b3b9-4ca0-937a-fdcc2a3ba608", "address": "fa:16:3e:d0:2f:a0", "network": {"id": "d59680e7-ed50-4356-b665-ec64ff939708", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-598238133-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5809862340a84c83a772c65c77513608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc02fdc1-b3", "ovs_interfaceid": "cc02fdc1-b3b9-4ca0-937a-fdcc2a3ba608", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:10:42 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-02d43780-3469-4b27-9b6e-43f81ac403da req-c50ec026-8394-4549-84e8-0541f0bdf267 service nova] Releasing lock "refresh_cache-6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 11:10:43 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Received event <DeviceRemovedEvent: 1681470643.0736518, 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=71509) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2341}}
Apr 14 11:10:43 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-0ce5df7a-b5b2-465d-97ac-5ab0f215b379 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99 {{(pid=71509) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2570}}
Apr 14 11:10:43 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-0ce5df7a-b5b2-465d-97ac-5ab0f215b379 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Successfully detached device vdb from instance 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99 from the live domain config.
Apr 14 11:10:43 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ce5df7a-b5b2-465d-97ac-5ab0f215b379 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] calling os-brick to detach iSCSI Volume {{(pid=71509) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 11:10:43 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ce5df7a-b5b2-465d-97ac-5ab0f215b379 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0bf0749390>, {'target_iqn': 'iqn.2010-10.org.openstack:ad9a8e38-a4a0-464f-8ac1-32552aaa2af3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lTWgFtSM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 11:10:43 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-0ce5df7a-b5b2-465d-97ac-5ab0f215b379 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 11:10:43 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-0ce5df7a-b5b2-465d-97ac-5ab0f215b379 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 11:10:43 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-0ce5df7a-b5b2-465d-97ac-5ab0f215b379 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 11:10:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:10:43 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:10:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:10:43 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1861edb-65e2-46bf-836d-7c59c6a8c96c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ad9a8e38-a4a0-464f-8ac1-32552aaa2af3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b6eae10c-5695-41f5-8511-7a5bbc598367\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:10:43 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ce5df7a-b5b2-465d-97ac-5ab0f215b379 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 11:10:43 user nova-compute[71509]: No targets found.
Apr 14 11:10:43 user nova-compute[71509]: iSNS:
Apr 14 11:10:43 user nova-compute[71509]: No targets found.
Apr 14 11:10:43 user nova-compute[71509]: STATIC:
Apr 14 11:10:43 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:ad9a8e38-a4a0-464f-8ac1-32552aaa2af3
Apr 14 11:10:43 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 11:10:43 user nova-compute[71509]:                 Iface Name: default
Apr 14 11:10:43 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:b6eae10c-5695-41f5-8511-7a5bbc598367
Apr 14 11:10:43 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 11:10:43 user nova-compute[71509]:                 Iface Name: default
Apr 14 11:10:43 user nova-compute[71509]: FIRMWARE:
Apr 14 11:10:43 user nova-compute[71509]: No targets found.
Apr 14 11:10:43 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 11:10:43 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ce5df7a-b5b2-465d-97ac-5ab0f215b379 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 11:10:43 user nova-compute[71509]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 11:10:43 user nova-compute[71509]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71509) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 11:10:43 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ce5df7a-b5b2-465d-97ac-5ab0f215b379 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ad9a8e38-a4a0-464f-8ac1-32552aaa2af3', 0)] {{(pid=71509) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 11:10:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:10:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:10:43 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cf78b47-b152-446b-ba5d-e06e154211f2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ad9a8e38-a4a0-464f-8ac1-32552aaa2af3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b6eae10c-5695-41f5-8511-7a5bbc598367\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:10:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:10:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:10:43 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ee798e2-5b26-4ddc-b97e-60e40346d35c]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad9a8e38-a4a0-464f-8ac1-32552aaa2af3 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6eae10c-5695-41f5-8511-7a5bbc598367 (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:10:43 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ce5df7a-b5b2-465d-97ac-5ab0f215b379 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad9a8e38-a4a0-464f-8ac1-32552aaa2af3 (non-flash)
Apr 14 11:10:43 user nova-compute[71509]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6eae10c-5695-41f5-8511-7a5bbc598367 (non-flash)
Apr 14 11:10:43 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 11:10:43 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ce5df7a-b5b2-465d-97ac-5ab0f215b379 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad9a8e38-a4a0-464f-8ac1-32552aaa2af3 (non-flash)
Apr 14 11:10:43 user nova-compute[71509]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6eae10c-5695-41f5-8511-7a5bbc598367 (non-flash)
Apr 14 11:10:43 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 11:10:43 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ce5df7a-b5b2-465d-97ac-5ab0f215b379 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0bf0782f80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ad9a8e38-a4a0-464f-8ac1-32552aaa2af3'): ({'sdb'}, set())}) {{(pid=71509) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 11:10:43 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-0ce5df7a-b5b2-465d-97ac-5ab0f215b379 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Removing single pathed devices sdb {{(pid=71509) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 11:10:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:10:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:10:43 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c11ed89-66ef-40e9-a725-0293ea32f1ff]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:10:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:10:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:10:43 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ef6d340-c6e9-4a8a-9fbe-655786811727]: (4, ('ok\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:10:43 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-0ce5df7a-b5b2-465d-97ac-5ab0f215b379 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Flushing IO for device /dev/sdb {{(pid=71509) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 11:10:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:10:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:10:43 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6dd4441-306c-4828-9be3-7fe951e12349]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:10:43 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-0ce5df7a-b5b2-465d-97ac-5ab0f215b379 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71509) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 11:10:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:10:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:10:43 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[e869978a-6247-4bd3-ab09-084aaac21baf]: (4, ('1', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:10:43 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-0ce5df7a-b5b2-465d-97ac-5ab0f215b379 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71509) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 11:10:43 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-0ce5df7a-b5b2-465d-97ac-5ab0f215b379 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] SCSI volumes sdb have been removed. {{(pid=71509) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 11:10:43 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ce5df7a-b5b2-465d-97ac-5ab0f215b379 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ad9a8e38-a4a0-464f-8ac1-32552aaa2af3')] {{(pid=71509) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 11:10:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad9a8e38-a4a0-464f-8ac1-32552aaa2af3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:10:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad9a8e38-a4a0-464f-8ac1-32552aaa2af3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:10:43 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[35548f12-9cb1-4f0c-a0d9-d0280652910b]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:10:43 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ce5df7a-b5b2-465d-97ac-5ab0f215b379 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:10:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad9a8e38-a4a0-464f-8ac1-32552aaa2af3 -p 172.16.0.220:3260 --logout {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:10:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad9a8e38-a4a0-464f-8ac1-32552aaa2af3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:10:43 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e366d81-46c1-4df9-b762-81c61a01b8b1]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:ad9a8e38-a4a0-464f-8ac1-32552aaa2af3, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:ad9a8e38-a4a0-464f-8ac1-32552aaa2af3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:10:43 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ce5df7a-b5b2-465d-97ac-5ab0f215b379 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:ad9a8e38-a4a0-464f-8ac1-32552aaa2af3, portal: 172.16.0.220,3260]
Apr 14 11:10:43 user nova-compute[71509]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:ad9a8e38-a4a0-464f-8ac1-32552aaa2af3, portal: 172.16.0.220,3260] successful.
Apr 14 11:10:43 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:10:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad9a8e38-a4a0-464f-8ac1-32552aaa2af3 -p 172.16.0.220:3260 --op delete {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:10:43 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad9a8e38-a4a0-464f-8ac1-32552aaa2af3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:10:43 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaec2179-401f-4279-8485-fea47884a9c8]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:10:43 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ce5df7a-b5b2-465d-97ac-5ab0f215b379 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:10:43 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-0ce5df7a-b5b2-465d-97ac-5ab0f215b379 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.281s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 11:10:43 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ce5df7a-b5b2-465d-97ac-5ab0f215b379 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] <== disconnect_volume: return (282ms) None {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 11:10:43 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ce5df7a-b5b2-465d-97ac-5ab0f215b379 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] Disconnected iSCSI Volume {{(pid=71509) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 11:10:43 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:10:44 user nova-compute[71509]: DEBUG nova.objects.instance [None req-0ce5df7a-b5b2-465d-97ac-5ab0f215b379 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lazy-loading 'flavor' on Instance uuid 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 11:10:44 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-0ce5df7a-b5b2-465d-97ac-5ab0f215b379 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.638s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:10:48 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:10:48 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:10:49 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:10:49 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71509) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 11:10:50 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:10:50 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:10:52 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:10:53 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:10:53 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:10:54 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:10:56 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:10:57 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:10:58 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:11:01 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:11:02 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:11:02 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:11:02 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:11:02 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:11:02 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Auditing locally available compute resources for user (node: user) {{(pid=71509) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 11:11:02 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:11:02 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:11:02 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99/disk --force-share --output=json {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:11:02 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:11:02 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71509) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 11:11:03 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:11:03 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 11:11:03 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 11:11:03 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Hypervisor/Node resource view: name=user free_ram=8648MB free_disk=25.922607421875GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71509) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 11:11:03 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:11:03 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:11:03 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 11:11:03 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 434ec83b-ca3c-446e-a63b-f130ceaf8e91 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 11:11:03 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71509) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 11:11:03 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71509) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 11:11:03 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 11:11:03 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 11:11:03 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Compute_service record updated for user:user {{(pid=71509) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 11:11:03 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.205s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:11:07 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:11:07 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Starting heal instance info cache {{(pid=71509) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 11:11:07 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "refresh_cache-434ec83b-ca3c-446e-a63b-f130ceaf8e91" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 11:11:07 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquired lock "refresh_cache-434ec83b-ca3c-446e-a63b-f130ceaf8e91" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 11:11:07 user nova-compute[71509]: DEBUG nova.network.neutron [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] [instance: 434ec83b-ca3c-446e-a63b-f130ceaf8e91] Forcefully refreshing network info cache for instance {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 11:11:08 user nova-compute[71509]: DEBUG nova.network.neutron [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] [instance: 434ec83b-ca3c-446e-a63b-f130ceaf8e91] Updating instance_info_cache with network_info: [{"id": "dd3954c8-cff9-4d50-a4bb-63365524ac72", "address": "fa:16:3e:63:f2:83", "network": {"id": "6d6b6b35-b5ef-4d7c-abce-cad21cc99e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-878222456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e7089cb52574f1daf7f578222bb7a67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd3954c8-cf", "ovs_interfaceid": "dd3954c8-cff9-4d50-a4bb-63365524ac72", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:11:08 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Releasing lock "refresh_cache-434ec83b-ca3c-446e-a63b-f130ceaf8e91" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 11:11:08 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] [instance: 434ec83b-ca3c-446e-a63b-f130ceaf8e91] Updated the network info_cache for instance {{(pid=71509) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 11:11:08 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:11:08 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:11:08 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71509) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 11:11:08 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71509) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 11:11:08 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71509) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 11:11:08 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:11:08 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:11:13 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:11:18 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:11:23 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:11:23 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:11:23 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71509) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 11:11:23 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71509) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 11:11:23 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71509) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 11:11:23 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:11:24 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-48552b54-b78d-4631-855e-bf0525dece6b tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "3f86738b-0091-4be9-bd1f-729e54374584" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:11:24 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-48552b54-b78d-4631-855e-bf0525dece6b tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "3f86738b-0091-4be9-bd1f-729e54374584" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:11:24 user nova-compute[71509]: DEBUG nova.compute.manager [None req-48552b54-b78d-4631-855e-bf0525dece6b tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 3f86738b-0091-4be9-bd1f-729e54374584] Starting instance... {{(pid=71509) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 11:11:24 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-48552b54-b78d-4631-855e-bf0525dece6b tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:11:24 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-48552b54-b78d-4631-855e-bf0525dece6b tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:11:24 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-48552b54-b78d-4631-855e-bf0525dece6b tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71509) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 11:11:24 user nova-compute[71509]: INFO nova.compute.claims [None req-48552b54-b78d-4631-855e-bf0525dece6b tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 3f86738b-0091-4be9-bd1f-729e54374584] Claim successful on node user
Apr 14 11:11:24 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-48552b54-b78d-4631-855e-bf0525dece6b tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 11:11:24 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-48552b54-b78d-4631-855e-bf0525dece6b tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 11:11:24 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-48552b54-b78d-4631-855e-bf0525dece6b tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.238s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:11:24 user nova-compute[71509]: DEBUG nova.compute.manager [None req-48552b54-b78d-4631-855e-bf0525dece6b tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 3f86738b-0091-4be9-bd1f-729e54374584] Start building networks asynchronously for instance. {{(pid=71509) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 11:11:24 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-48552b54-b78d-4631-855e-bf0525dece6b tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 3f86738b-0091-4be9-bd1f-729e54374584] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 11:11:24 user nova-compute[71509]: DEBUG nova.compute.manager [None req-48552b54-b78d-4631-855e-bf0525dece6b tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 3f86738b-0091-4be9-bd1f-729e54374584] Allocating IP information in the background. {{(pid=71509) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 11:11:24 user nova-compute[71509]: DEBUG nova.network.neutron [None req-48552b54-b78d-4631-855e-bf0525dece6b tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 3f86738b-0091-4be9-bd1f-729e54374584] allocate_for_instance() {{(pid=71509) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 11:11:24 user nova-compute[71509]: DEBUG nova.compute.manager [None req-48552b54-b78d-4631-855e-bf0525dece6b tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 3f86738b-0091-4be9-bd1f-729e54374584] Start building block device mappings for instance. {{(pid=71509) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 11:11:24 user nova-compute[71509]: INFO nova.virt.block_device [None req-48552b54-b78d-4631-855e-bf0525dece6b tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 3f86738b-0091-4be9-bd1f-729e54374584] Booting with volume snapshot a25d2fe8-6c54-458b-9ff0-e8dc47483640 at /dev/vda
Apr 14 11:11:24 user nova-compute[71509]: DEBUG nova.policy [None req-48552b54-b78d-4631-855e-bf0525dece6b tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c7644d02bc784e4fb74ebaaceb3affe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e7089cb52574f1daf7f578222bb7a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71509) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 11:11:26 user nova-compute[71509]: DEBUG nova.network.neutron [None req-48552b54-b78d-4631-855e-bf0525dece6b tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 3f86738b-0091-4be9-bd1f-729e54374584] Successfully created port: 6d4702fa-9e35-4be4-b3b9-015af3cddba8 {{(pid=71509) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 11:11:26 user nova-compute[71509]: DEBUG nova.network.neutron [None req-48552b54-b78d-4631-855e-bf0525dece6b tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 3f86738b-0091-4be9-bd1f-729e54374584] Successfully updated port: 6d4702fa-9e35-4be4-b3b9-015af3cddba8 {{(pid=71509) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 11:11:26 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-48552b54-b78d-4631-855e-bf0525dece6b tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "refresh_cache-3f86738b-0091-4be9-bd1f-729e54374584" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 11:11:26 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-48552b54-b78d-4631-855e-bf0525dece6b tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquired lock "refresh_cache-3f86738b-0091-4be9-bd1f-729e54374584" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 11:11:26 user nova-compute[71509]: DEBUG nova.network.neutron [None req-48552b54-b78d-4631-855e-bf0525dece6b tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 3f86738b-0091-4be9-bd1f-729e54374584] Building network info cache for instance {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 11:11:26 user nova-compute[71509]: DEBUG nova.compute.manager [req-5fd0d068-d504-46c7-820a-493643e9177b req-ddf3fbe7-ca1a-4e7a-83cc-5a2d2529d032 service nova] [instance: 3f86738b-0091-4be9-bd1f-729e54374584] Received event network-changed-6d4702fa-9e35-4be4-b3b9-015af3cddba8 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:11:26 user nova-compute[71509]: DEBUG nova.compute.manager [req-5fd0d068-d504-46c7-820a-493643e9177b req-ddf3fbe7-ca1a-4e7a-83cc-5a2d2529d032 service nova] [instance: 3f86738b-0091-4be9-bd1f-729e54374584] Refreshing instance network info cache due to event network-changed-6d4702fa-9e35-4be4-b3b9-015af3cddba8. {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 11:11:26 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-5fd0d068-d504-46c7-820a-493643e9177b req-ddf3fbe7-ca1a-4e7a-83cc-5a2d2529d032 service nova] Acquiring lock "refresh_cache-3f86738b-0091-4be9-bd1f-729e54374584" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 11:11:26 user nova-compute[71509]: DEBUG nova.network.neutron [None req-48552b54-b78d-4631-855e-bf0525dece6b tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 3f86738b-0091-4be9-bd1f-729e54374584] Instance cache missing network info. {{(pid=71509) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 11:11:27 user nova-compute[71509]: DEBUG nova.network.neutron [None req-48552b54-b78d-4631-855e-bf0525dece6b tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 3f86738b-0091-4be9-bd1f-729e54374584] Updating instance_info_cache with network_info: [{"id": "6d4702fa-9e35-4be4-b3b9-015af3cddba8", "address": "fa:16:3e:48:96:73", "network": {"id": "6d6b6b35-b5ef-4d7c-abce-cad21cc99e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-878222456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e7089cb52574f1daf7f578222bb7a67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d4702fa-9e", "ovs_interfaceid": "6d4702fa-9e35-4be4-b3b9-015af3cddba8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:11:27 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-48552b54-b78d-4631-855e-bf0525dece6b tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Releasing lock "refresh_cache-3f86738b-0091-4be9-bd1f-729e54374584" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 11:11:27 user nova-compute[71509]: DEBUG nova.compute.manager [None req-48552b54-b78d-4631-855e-bf0525dece6b tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 3f86738b-0091-4be9-bd1f-729e54374584] Instance network_info: |[{"id": "6d4702fa-9e35-4be4-b3b9-015af3cddba8", "address": "fa:16:3e:48:96:73", "network": {"id": "6d6b6b35-b5ef-4d7c-abce-cad21cc99e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-878222456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e7089cb52574f1daf7f578222bb7a67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d4702fa-9e", "ovs_interfaceid": "6d4702fa-9e35-4be4-b3b9-015af3cddba8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71509) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 11:11:27 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-5fd0d068-d504-46c7-820a-493643e9177b req-ddf3fbe7-ca1a-4e7a-83cc-5a2d2529d032 service nova] Acquired lock "refresh_cache-3f86738b-0091-4be9-bd1f-729e54374584" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 11:11:27 user nova-compute[71509]: DEBUG nova.network.neutron [req-5fd0d068-d504-46c7-820a-493643e9177b req-ddf3fbe7-ca1a-4e7a-83cc-5a2d2529d032 service nova] [instance: 3f86738b-0091-4be9-bd1f-729e54374584] Refreshing network info cache for port 6d4702fa-9e35-4be4-b3b9-015af3cddba8 {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 11:11:27 user nova-compute[71509]: DEBUG nova.network.neutron [req-5fd0d068-d504-46c7-820a-493643e9177b req-ddf3fbe7-ca1a-4e7a-83cc-5a2d2529d032 service nova] [instance: 3f86738b-0091-4be9-bd1f-729e54374584] Updated VIF entry in instance network info cache for port 6d4702fa-9e35-4be4-b3b9-015af3cddba8. {{(pid=71509) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 11:11:27 user nova-compute[71509]: DEBUG nova.network.neutron [req-5fd0d068-d504-46c7-820a-493643e9177b req-ddf3fbe7-ca1a-4e7a-83cc-5a2d2529d032 service nova] [instance: 3f86738b-0091-4be9-bd1f-729e54374584] Updating instance_info_cache with network_info: [{"id": "6d4702fa-9e35-4be4-b3b9-015af3cddba8", "address": "fa:16:3e:48:96:73", "network": {"id": "6d6b6b35-b5ef-4d7c-abce-cad21cc99e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-878222456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e7089cb52574f1daf7f578222bb7a67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d4702fa-9e", "ovs_interfaceid": "6d4702fa-9e35-4be4-b3b9-015af3cddba8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:11:27 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-5fd0d068-d504-46c7-820a-493643e9177b req-ddf3fbe7-ca1a-4e7a-83cc-5a2d2529d032 service nova] Releasing lock "refresh_cache-3f86738b-0091-4be9-bd1f-729e54374584" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 11:11:28 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:11:30 user nova-compute[71509]: DEBUG os_brick.utils [None req-48552b54-b78d-4631-855e-bf0525dece6b tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 11:11:30 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:11:30 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:11:30 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8047533-78c2-4dec-a199-fcbef01626b4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50119df3c417\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:11:30 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:11:30 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:11:30 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[e718f894-9056-42d9-9736-cfda78f94eb6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:11:30 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:11:30 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:11:30 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb7c99ce-c2d2-4520-bde4-6feeb50b205c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:11:30 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebffb355-c798-4ae9-93cb-aac38d3ffefe]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:11:30 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-48552b54-b78d-4631-855e-bf0525dece6b tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Running cmd (subprocess): nvme version {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:11:30 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-48552b54-b78d-4631-855e-bf0525dece6b tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] 'nvme version' failed. Not Retrying. {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 11:11:30 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.nvmeof [None req-48552b54-b78d-4631-855e-bf0525dece6b tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] nvme not present on system {{(pid=71509) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 11:11:30 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:11:30 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 11:11:30 user nova-compute[71509]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 11:11:30 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[03c9d6d7-b7a7-4a5f-878a-63ee80660bb1]: (4, '') {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:11:30 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-48552b54-b78d-4631-855e-bf0525dece6b tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71509) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 11:11:30 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-48552b54-b78d-4631-855e-bf0525dece6b tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71509) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 11:11:30 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-48552b54-b78d-4631-855e-bf0525dece6b tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] LIGHTOS: no hostnqn found. {{(pid=71509) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 11:11:30 user nova-compute[71509]: DEBUG os_brick.utils [None req-48552b54-b78d-4631-855e-bf0525dece6b tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50119df3c417', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 11:11:30 user nova-compute[71509]: DEBUG nova.virt.block_device [None req-48552b54-b78d-4631-855e-bf0525dece6b tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 3f86738b-0091-4be9-bd1f-729e54374584] Updating existing volume attachment record: 7c4a1c1f-61ce-4753-81e3-bf037b9d2598 {{(pid=71509) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 11:11:33 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:11:35 user nova-compute[71509]: DEBUG nova.compute.manager [None req-48552b54-b78d-4631-855e-bf0525dece6b tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 3f86738b-0091-4be9-bd1f-729e54374584] Start spawning the instance on the hypervisor. {{(pid=71509) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 11:11:35 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-48552b54-b78d-4631-855e-bf0525dece6b tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 3f86738b-0091-4be9-bd1f-729e54374584] Creating instance directory {{(pid=71509) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 11:11:35 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-48552b54-b78d-4631-855e-bf0525dece6b tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 3f86738b-0091-4be9-bd1f-729e54374584] Creating image(s)
Apr 14 11:11:35 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-48552b54-b78d-4631-855e-bf0525dece6b tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 3f86738b-0091-4be9-bd1f-729e54374584] Did not create local disks {{(pid=71509) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 11:11:35 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-48552b54-b78d-4631-855e-bf0525dece6b tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 3f86738b-0091-4be9-bd1f-729e54374584] Ensure instance console log exists: /opt/stack/data/nova/instances/3f86738b-0091-4be9-bd1f-729e54374584/console.log {{(pid=71509) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 11:11:35 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-48552b54-b78d-4631-855e-bf0525dece6b tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:11:35 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-48552b54-b78d-4631-855e-bf0525dece6b tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:11:35 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-48552b54-b78d-4631-855e-bf0525dece6b tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:11:35 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-48552b54-b78d-4631-855e-bf0525dece6b tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 3f86738b-0091-4be9-bd1f-729e54374584] Start _get_guest_xml network_info=[{"id": "6d4702fa-9e35-4be4-b3b9-015af3cddba8", "address": "fa:16:3e:48:96:73", "network": {"id": "6d6b6b35-b5ef-4d7c-abce-cad21cc99e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-878222456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e7089cb52574f1daf7f578222bb7a67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d4702fa-9e", "ovs_interfaceid": "6d4702fa-9e35-4be4-b3b9-015af3cddba8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-04-14T11:11:22Z,direct_url=<?>,disk_format='qcow2',id=93ab939e-5ede-4edd-aa21-6e6ce2e27bdb,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-935320189',owner='2e7089cb52574f1daf7f578222bb7a67',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-04-14T11:11:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'attachment_id': '7c4a1c1f-61ce-4753-81e3-bf037b9d2598', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0eca2bb4-fe51-4445-8d85-c092b3ac8712', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DaFIWrHg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3f86738b-0091-4be9-bd1f-729e54374584', 'attached_at': '', 'detached_at': '', 'volume_id': '0eca2bb4-fe51-4445-8d85-c092b3ac8712', 'serial': '0eca2bb4-fe51-4445-8d85-c092b3ac8712'}, 'disk_bus': 'virtio', 'delete_on_termination': True, 'volume_type': None} {{(pid=71509) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 11:11:35 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-48552b54-b78d-4631-855e-bf0525dece6b tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 11:11:35 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-48552b54-b78d-4631-855e-bf0525dece6b tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 11:11:35 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-48552b54-b78d-4631-855e-bf0525dece6b tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71509) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 11:11:35 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-48552b54-b78d-4631-855e-bf0525dece6b tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T10:40:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-04-14T11:11:22Z,direct_url=<?>,disk_format='qcow2',id=93ab939e-5ede-4edd-aa21-6e6ce2e27bdb,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-935320189',owner='2e7089cb52574f1daf7f578222bb7a67',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-04-14T11:11:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 11:11:35 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-48552b54-b78d-4631-855e-bf0525dece6b tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Flavor limits 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 11:11:35 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-48552b54-b78d-4631-855e-bf0525dece6b tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Image limits 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 11:11:35 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-48552b54-b78d-4631-855e-bf0525dece6b tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Flavor pref 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 11:11:35 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-48552b54-b78d-4631-855e-bf0525dece6b tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Image pref 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 11:11:35 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-48552b54-b78d-4631-855e-bf0525dece6b tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 11:11:35 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-48552b54-b78d-4631-855e-bf0525dece6b tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 11:11:35 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-48552b54-b78d-4631-855e-bf0525dece6b tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71509) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 11:11:35 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-48552b54-b78d-4631-855e-bf0525dece6b tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Got 1 possible topologies {{(pid=71509) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 11:11:35 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-48552b54-b78d-4631-855e-bf0525dece6b tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 11:11:35 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-48552b54-b78d-4631-855e-bf0525dece6b tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 11:11:35 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48552b54-b78d-4631-855e-bf0525dece6b tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 3f86738b-0091-4be9-bd1f-729e54374584] Calling os-brick to attach iSCSI Volume {{(pid=71509) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 11:11:35 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-48552b54-b78d-4631-855e-bf0525dece6b tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0bf0749390>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0eca2bb4-fe51-4445-8d85-c092b3ac8712', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DaFIWrHg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 11:11:35 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-48552b54-b78d-4631-855e-bf0525dece6b tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 11:11:35 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-48552b54-b78d-4631-855e-bf0525dece6b tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 11:11:35 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-48552b54-b78d-4631-855e-bf0525dece6b tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 11:11:35 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-48552b54-b78d-4631-855e-bf0525dece6b tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 11:11:35 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-48552b54-b78d-4631-855e-bf0525dece6b tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0eca2bb4-fe51-4445-8d85-c092b3ac8712" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 11:11:35 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-48552b54-b78d-4631-855e-bf0525dece6b tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0eca2bb4-fe51-4445-8d85-c092b3ac8712" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 11:11:35 user nova-compute[71509]: INFO os_brick.initiator.connectors.iscsi [None req-48552b54-b78d-4631-855e-bf0525dece6b tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 11:11:35 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0eca2bb4-fe51-4445-8d85-c092b3ac8712 -p 172.16.0.220:3260 {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:11:35 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0eca2bb4-fe51-4445-8d85-c092b3ac8712 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:11:35 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9cb0cb3-92b4-46ad-90fd-9e1f35a23bc4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:11:35 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-48552b54-b78d-4631-855e-bf0525dece6b tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 11:11:35 user nova-compute[71509]:  {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:11:35 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0eca2bb4-fe51-4445-8d85-c092b3ac8712 -p 172.16.0.220:3260 --interface default --op new {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:11:35 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0eca2bb4-fe51-4445-8d85-c092b3ac8712 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:11:35 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4b02a47-d3f6-46ca-9e69-53a3e30ee30f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0eca2bb4-fe51-4445-8d85-c092b3ac8712] added\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:11:35 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-48552b54-b78d-4631-855e-bf0525dece6b tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0eca2bb4-fe51-4445-8d85-c092b3ac8712] added
Apr 14 11:11:35 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:11:35 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0eca2bb4-fe51-4445-8d85-c092b3ac8712 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:11:35 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0eca2bb4-fe51-4445-8d85-c092b3ac8712 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:11:35 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[30f9f63d-6ec4-4925-bfc9-393d335e8081]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:11:35 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-48552b54-b78d-4631-855e-bf0525dece6b tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:11:35 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0eca2bb4-fe51-4445-8d85-c092b3ac8712 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:11:35 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0eca2bb4-fe51-4445-8d85-c092b3ac8712 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:11:35 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c919763-c37b-488c-bbe9-2a88d50f41be]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:11:35 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-48552b54-b78d-4631-855e-bf0525dece6b tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:11:35 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0eca2bb4-fe51-4445-8d85-c092b3ac8712 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DaFIWrHg {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:11:35 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0eca2bb4-fe51-4445-8d85-c092b3ac8712 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DaFIWrHg" returned: 0 in 0.025s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:11:35 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[49c4833e-26ea-4b67-be88-00c633d32563]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:11:35 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-48552b54-b78d-4631-855e-bf0525dece6b tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DaFIWrHg'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:11:35 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0eca2bb4-fe51-4445-8d85-c092b3ac8712 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:11:35 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0eca2bb4-fe51-4445-8d85-c092b3ac8712 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:11:35 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[b13e4c38-8ca8-4b17-877e-80e43ce645aa]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:11:35 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-48552b54-b78d-4631-855e-bf0525dece6b tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:11:35 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:11:35 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:11:35 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[111ce14b-cf2b-43d2-9726-9de5d34ac914]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6eae10c-5695-41f5-8511-7a5bbc598367 (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:11:35 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-48552b54-b78d-4631-855e-bf0525dece6b tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6eae10c-5695-41f5-8511-7a5bbc598367 (non-flash)
Apr 14 11:11:35 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 11:11:35 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-48552b54-b78d-4631-855e-bf0525dece6b tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6eae10c-5695-41f5-8511-7a5bbc598367 (non-flash)
Apr 14 11:11:35 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 11:11:35 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0eca2bb4-fe51-4445-8d85-c092b3ac8712 -p 172.16.0.220:3260 --login {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:11:35 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0eca2bb4-fe51-4445-8d85-c092b3ac8712 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:11:35 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4e2f9b0-b6cf-49e1-9fa2-43dd9130d453]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0eca2bb4-fe51-4445-8d85-c092b3ac8712, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0eca2bb4-fe51-4445-8d85-c092b3ac8712, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:11:35 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-48552b54-b78d-4631-855e-bf0525dece6b tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0eca2bb4-fe51-4445-8d85-c092b3ac8712, portal: 172.16.0.220,3260]
Apr 14 11:11:35 user nova-compute[71509]: Login to [iface: default, target: iqn.2010-10.org.openstack:0eca2bb4-fe51-4445-8d85-c092b3ac8712, portal: 172.16.0.220,3260] successful.
Apr 14 11:11:35 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:11:35 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0eca2bb4-fe51-4445-8d85-c092b3ac8712 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:11:35 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0eca2bb4-fe51-4445-8d85-c092b3ac8712 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:11:35 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e0b2b4b-fd8e-4162-b564-83800e09a533]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:11:35 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-48552b54-b78d-4631-855e-bf0525dece6b tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:11:35 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:11:35 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:11:35 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd84a85b-0667-43c8-84d5-225cfd44a3a4]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6eae10c-5695-41f5-8511-7a5bbc598367 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eca2bb4-fe51-4445-8d85-c092b3ac8712 (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:11:35 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-48552b54-b78d-4631-855e-bf0525dece6b tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6eae10c-5695-41f5-8511-7a5bbc598367 (non-flash)
Apr 14 11:11:35 user nova-compute[71509]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eca2bb4-fe51-4445-8d85-c092b3ac8712 (non-flash)
Apr 14 11:11:35 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 11:11:35 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-48552b54-b78d-4631-855e-bf0525dece6b tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6eae10c-5695-41f5-8511-7a5bbc598367 (non-flash)
Apr 14 11:11:35 user nova-compute[71509]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eca2bb4-fe51-4445-8d85-c092b3ac8712 (non-flash)
Apr 14 11:11:35 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 11:11:35 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-48552b54-b78d-4631-855e-bf0525dece6b tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0eca2bb4-fe51-4445-8d85-c092b3ac8712" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.311s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 11:11:35 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-48552b54-b78d-4631-855e-bf0525dece6b tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Connected to 172.16.0.220:3260 {{(pid=71509) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 11:11:35 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-48552b54-b78d-4631-855e-bf0525dece6b tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] HCTL ('33', '-', '-', 0) found on session 51 with lun 0 {{(pid=71509) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 11:11:35 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-48552b54-b78d-4631-855e-bf0525dece6b tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71509) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 11:11:35 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:11:35 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:11:35 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[f64607e1-6569-402c-bb8c-bdccf0ba63f9]: (4, ('- - 0', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:11:35 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-48552b54-b78d-4631-855e-bf0525dece6b tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71509) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 11:11:35 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-48552b54-b78d-4631-855e-bf0525dece6b tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:0eca2bb4-fe51-4445-8d85-c092b3ac8712', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DaFIWrHg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71509) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 11:11:36 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-f842dd3b-2aaa-4e56-9d4d-6ea425c3ddb4 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Acquiring lock "6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:11:36 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-f842dd3b-2aaa-4e56-9d4d-6ea425c3ddb4 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:11:36 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-f842dd3b-2aaa-4e56-9d4d-6ea425c3ddb4 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Acquiring lock "6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:11:36 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-f842dd3b-2aaa-4e56-9d4d-6ea425c3ddb4 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:11:36 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-f842dd3b-2aaa-4e56-9d4d-6ea425c3ddb4 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:11:36 user nova-compute[71509]: INFO nova.compute.manager [None req-f842dd3b-2aaa-4e56-9d4d-6ea425c3ddb4 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] Terminating instance
Apr 14 11:11:36 user nova-compute[71509]: DEBUG nova.compute.manager [None req-f842dd3b-2aaa-4e56-9d4d-6ea425c3ddb4 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] Start destroying the instance on the hypervisor. {{(pid=71509) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 11:11:36 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:11:36 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:11:36 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:11:36 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:11:36 user nova-compute[71509]: DEBUG nova.compute.manager [req-e3f200ef-6f63-491f-80a7-dd1926882a0c req-e1c52ee7-e8d5-4718-8b3b-1a6043fedac9 service nova] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] Received event network-vif-unplugged-cc02fdc1-b3b9-4ca0-937a-fdcc2a3ba608 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:11:36 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-e3f200ef-6f63-491f-80a7-dd1926882a0c req-e1c52ee7-e8d5-4718-8b3b-1a6043fedac9 service nova] Acquiring lock "6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:11:36 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-e3f200ef-6f63-491f-80a7-dd1926882a0c req-e1c52ee7-e8d5-4718-8b3b-1a6043fedac9 service nova] Lock "6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:11:36 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-e3f200ef-6f63-491f-80a7-dd1926882a0c req-e1c52ee7-e8d5-4718-8b3b-1a6043fedac9 service nova] Lock "6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:11:36 user nova-compute[71509]: DEBUG nova.compute.manager [req-e3f200ef-6f63-491f-80a7-dd1926882a0c req-e1c52ee7-e8d5-4718-8b3b-1a6043fedac9 service nova] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] No waiting events found dispatching network-vif-unplugged-cc02fdc1-b3b9-4ca0-937a-fdcc2a3ba608 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:11:36 user nova-compute[71509]: DEBUG nova.compute.manager [req-e3f200ef-6f63-491f-80a7-dd1926882a0c req-e1c52ee7-e8d5-4718-8b3b-1a6043fedac9 service nova] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] Received event network-vif-unplugged-cc02fdc1-b3b9-4ca0-937a-fdcc2a3ba608 for instance with task_state deleting. {{(pid=71509) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 11:11:36 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-48552b54-b78d-4631-855e-bf0525dece6b tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.347s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 11:11:36 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-48552b54-b78d-4631-855e-bf0525dece6b tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] <== connect_volume: return (1349ms) {'type': 'block', 'scsi_wwn': '23336636365383539', 'path': '/dev/sdb'} {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 11:11:36 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48552b54-b78d-4631-855e-bf0525dece6b tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 3f86738b-0091-4be9-bd1f-729e54374584] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23336636365383539', 'path': '/dev/sdb'} {{(pid=71509) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 11:11:36 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-48552b54-b78d-4631-855e-bf0525dece6b tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T11:11:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1443395603',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1443395603',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1443395603',id=44,image_ref='93ab939e-5ede-4edd-aa21-6e6ce2e27bdb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e7089cb52574f1daf7f578222bb7a67',ramdisk_id='',reservation_id='r-fci9uvjk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-193101874',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-193101874-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-193101874',owner_user_name='tempest-TestVolumeBootPattern-193101874-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T11:11:25Z,user_data=None,user_id='c7644d02bc784e4fb74ebaaceb3affe1',uuid=3f86738b-0091-4be9-bd1f-729e54374584,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6d4702fa-9e35-4be4-b3b9-015af3cddba8", "address": "fa:16:3e:48:96:73", "network": {"id": "6d6b6b35-b5ef-4d7c-abce-cad21cc99e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-878222456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e7089cb52574f1daf7f578222bb7a67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d4702fa-9e", "ovs_interfaceid": "6d4702fa-9e35-4be4-b3b9-015af3cddba8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71509) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 11:11:36 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-48552b54-b78d-4631-855e-bf0525dece6b tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Converting VIF {"id": "6d4702fa-9e35-4be4-b3b9-015af3cddba8", "address": "fa:16:3e:48:96:73", "network": {"id": "6d6b6b35-b5ef-4d7c-abce-cad21cc99e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-878222456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e7089cb52574f1daf7f578222bb7a67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d4702fa-9e", "ovs_interfaceid": "6d4702fa-9e35-4be4-b3b9-015af3cddba8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 11:11:36 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-48552b54-b78d-4631-855e-bf0525dece6b tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:96:73,bridge_name='br-int',has_traffic_filtering=True,id=6d4702fa-9e35-4be4-b3b9-015af3cddba8,network=Network(6d6b6b35-b5ef-4d7c-abce-cad21cc99e32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d4702fa-9e') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 11:11:36 user nova-compute[71509]: DEBUG nova.objects.instance [None req-48552b54-b78d-4631-855e-bf0525dece6b tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lazy-loading 'pci_devices' on Instance uuid 3f86738b-0091-4be9-bd1f-729e54374584 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 11:11:37 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-48552b54-b78d-4631-855e-bf0525dece6b tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 3f86738b-0091-4be9-bd1f-729e54374584] End _get_guest_xml xml=<domain type="kvm">
Apr 14 11:11:37 user nova-compute[71509]:   <uuid>3f86738b-0091-4be9-bd1f-729e54374584</uuid>
Apr 14 11:11:37 user nova-compute[71509]:   <name>instance-0000002c</name>
Apr 14 11:11:37 user nova-compute[71509]:   <memory>131072</memory>
Apr 14 11:11:37 user nova-compute[71509]:   <vcpu>1</vcpu>
Apr 14 11:11:37 user nova-compute[71509]:   <metadata>
Apr 14 11:11:37 user nova-compute[71509]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 11:11:37 user nova-compute[71509]:       <nova:package version="0.0.0"/>
Apr 14 11:11:37 user nova-compute[71509]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1443395603</nova:name>
Apr 14 11:11:37 user nova-compute[71509]:       <nova:creationTime>2023-04-14 11:11:35</nova:creationTime>
Apr 14 11:11:37 user nova-compute[71509]:       <nova:flavor name="m1.nano">
Apr 14 11:11:37 user nova-compute[71509]:         <nova:memory>128</nova:memory>
Apr 14 11:11:37 user nova-compute[71509]:         <nova:disk>1</nova:disk>
Apr 14 11:11:37 user nova-compute[71509]:         <nova:swap>0</nova:swap>
Apr 14 11:11:37 user nova-compute[71509]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 11:11:37 user nova-compute[71509]:         <nova:vcpus>1</nova:vcpus>
Apr 14 11:11:37 user nova-compute[71509]:       </nova:flavor>
Apr 14 11:11:37 user nova-compute[71509]:       <nova:owner>
Apr 14 11:11:37 user nova-compute[71509]:         <nova:user uuid="c7644d02bc784e4fb74ebaaceb3affe1">tempest-TestVolumeBootPattern-193101874-project-member</nova:user>
Apr 14 11:11:37 user nova-compute[71509]:         <nova:project uuid="2e7089cb52574f1daf7f578222bb7a67">tempest-TestVolumeBootPattern-193101874</nova:project>
Apr 14 11:11:37 user nova-compute[71509]:       </nova:owner>
Apr 14 11:11:37 user nova-compute[71509]:       <nova:root type="image" uuid="93ab939e-5ede-4edd-aa21-6e6ce2e27bdb"/>
Apr 14 11:11:37 user nova-compute[71509]:       <nova:ports>
Apr 14 11:11:37 user nova-compute[71509]:         <nova:port uuid="6d4702fa-9e35-4be4-b3b9-015af3cddba8">
Apr 14 11:11:37 user nova-compute[71509]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Apr 14 11:11:37 user nova-compute[71509]:         </nova:port>
Apr 14 11:11:37 user nova-compute[71509]:       </nova:ports>
Apr 14 11:11:37 user nova-compute[71509]:     </nova:instance>
Apr 14 11:11:37 user nova-compute[71509]:   </metadata>
Apr 14 11:11:37 user nova-compute[71509]:   <sysinfo type="smbios">
Apr 14 11:11:37 user nova-compute[71509]:     <system>
Apr 14 11:11:37 user nova-compute[71509]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 11:11:37 user nova-compute[71509]:       <entry name="product">OpenStack Nova</entry>
Apr 14 11:11:37 user nova-compute[71509]:       <entry name="version">0.0.0</entry>
Apr 14 11:11:37 user nova-compute[71509]:       <entry name="serial">3f86738b-0091-4be9-bd1f-729e54374584</entry>
Apr 14 11:11:37 user nova-compute[71509]:       <entry name="uuid">3f86738b-0091-4be9-bd1f-729e54374584</entry>
Apr 14 11:11:37 user nova-compute[71509]:       <entry name="family">Virtual Machine</entry>
Apr 14 11:11:37 user nova-compute[71509]:     </system>
Apr 14 11:11:37 user nova-compute[71509]:   </sysinfo>
Apr 14 11:11:37 user nova-compute[71509]:   <os>
Apr 14 11:11:37 user nova-compute[71509]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 11:11:37 user nova-compute[71509]:     <boot dev="hd"/>
Apr 14 11:11:37 user nova-compute[71509]:     <smbios mode="sysinfo"/>
Apr 14 11:11:37 user nova-compute[71509]:   </os>
Apr 14 11:11:37 user nova-compute[71509]:   <features>
Apr 14 11:11:37 user nova-compute[71509]:     <acpi/>
Apr 14 11:11:37 user nova-compute[71509]:     <apic/>
Apr 14 11:11:37 user nova-compute[71509]:     <vmcoreinfo/>
Apr 14 11:11:37 user nova-compute[71509]:   </features>
Apr 14 11:11:37 user nova-compute[71509]:   <clock offset="utc">
Apr 14 11:11:37 user nova-compute[71509]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 11:11:37 user nova-compute[71509]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 11:11:37 user nova-compute[71509]:     <timer name="hpet" present="no"/>
Apr 14 11:11:37 user nova-compute[71509]:   </clock>
Apr 14 11:11:37 user nova-compute[71509]:   <cpu mode="custom" match="exact">
Apr 14 11:11:37 user nova-compute[71509]:     <model>Nehalem</model>
Apr 14 11:11:37 user nova-compute[71509]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 11:11:37 user nova-compute[71509]:   </cpu>
Apr 14 11:11:37 user nova-compute[71509]:   <devices>
Apr 14 11:11:37 user nova-compute[71509]:     <disk type="block" device="disk">
Apr 14 11:11:37 user nova-compute[71509]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 11:11:37 user nova-compute[71509]:       <source dev="/dev/sdb"/>
Apr 14 11:11:37 user nova-compute[71509]:       <target dev="vda" bus="virtio"/>
Apr 14 11:11:37 user nova-compute[71509]:       <serial>0eca2bb4-fe51-4445-8d85-c092b3ac8712</serial>
Apr 14 11:11:37 user nova-compute[71509]:     </disk>
Apr 14 11:11:37 user nova-compute[71509]:     <interface type="ethernet">
Apr 14 11:11:37 user nova-compute[71509]:       <mac address="fa:16:3e:48:96:73"/>
Apr 14 11:11:37 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 11:11:37 user nova-compute[71509]:       <mtu size="1442"/>
Apr 14 11:11:37 user nova-compute[71509]:       <target dev="tap6d4702fa-9e"/>
Apr 14 11:11:37 user nova-compute[71509]:     </interface>
Apr 14 11:11:37 user nova-compute[71509]:     <serial type="pty">
Apr 14 11:11:37 user nova-compute[71509]:       <log file="/opt/stack/data/nova/instances/3f86738b-0091-4be9-bd1f-729e54374584/console.log" append="off"/>
Apr 14 11:11:37 user nova-compute[71509]:     </serial>
Apr 14 11:11:37 user nova-compute[71509]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 11:11:37 user nova-compute[71509]:     <video>
Apr 14 11:11:37 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 11:11:37 user nova-compute[71509]:     </video>
Apr 14 11:11:37 user nova-compute[71509]:     <rng model="virtio">
Apr 14 11:11:37 user nova-compute[71509]:       <backend model="random">/dev/urandom</backend>
Apr 14 11:11:37 user nova-compute[71509]:     </rng>
Apr 14 11:11:37 user nova-compute[71509]:     <controller type="usb" index="0" model="none"/>
Apr 14 11:11:37 user nova-compute[71509]:     <memballoon model="virtio">
Apr 14 11:11:37 user nova-compute[71509]:       <stats period="10"/>
Apr 14 11:11:37 user nova-compute[71509]:     </memballoon>
Apr 14 11:11:37 user nova-compute[71509]:   </devices>
Apr 14 11:11:37 user nova-compute[71509]: </domain>
Apr 14 11:11:37 user nova-compute[71509]:  {{(pid=71509) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 11:11:37 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-48552b54-b78d-4631-855e-bf0525dece6b tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T11:11:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1443395603',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1443395603',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1443395603',id=44,image_ref='93ab939e-5ede-4edd-aa21-6e6ce2e27bdb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e7089cb52574f1daf7f578222bb7a67',ramdisk_id='',reservation_id='r-fci9uvjk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-193101874',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-193101874-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-193101874',owner_user_name='tempest-TestVolumeBootPattern-193101874-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T11:11:25Z,user_data=None,user_id='c7644d02bc784e4fb74ebaaceb3affe1',uuid=3f86738b-0091-4be9-bd1f-729e54374584,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6d4702fa-9e35-4be4-b3b9-015af3cddba8", "address": "fa:16:3e:48:96:73", "network": {"id": "6d6b6b35-b5ef-4d7c-abce-cad21cc99e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-878222456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e7089cb52574f1daf7f578222bb7a67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d4702fa-9e", "ovs_interfaceid": "6d4702fa-9e35-4be4-b3b9-015af3cddba8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 11:11:37 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-48552b54-b78d-4631-855e-bf0525dece6b tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Converting VIF {"id": "6d4702fa-9e35-4be4-b3b9-015af3cddba8", "address": "fa:16:3e:48:96:73", "network": {"id": "6d6b6b35-b5ef-4d7c-abce-cad21cc99e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-878222456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e7089cb52574f1daf7f578222bb7a67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d4702fa-9e", "ovs_interfaceid": "6d4702fa-9e35-4be4-b3b9-015af3cddba8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 11:11:37 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-48552b54-b78d-4631-855e-bf0525dece6b tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:96:73,bridge_name='br-int',has_traffic_filtering=True,id=6d4702fa-9e35-4be4-b3b9-015af3cddba8,network=Network(6d6b6b35-b5ef-4d7c-abce-cad21cc99e32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d4702fa-9e') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 11:11:37 user nova-compute[71509]: DEBUG os_vif [None req-48552b54-b78d-4631-855e-bf0525dece6b tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:96:73,bridge_name='br-int',has_traffic_filtering=True,id=6d4702fa-9e35-4be4-b3b9-015af3cddba8,network=Network(6d6b6b35-b5ef-4d7c-abce-cad21cc99e32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d4702fa-9e') {{(pid=71509) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 11:11:37 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:11:37 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:11:37 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 11:11:37 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:11:37 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6d4702fa-9e, may_exist=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:11:37 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6d4702fa-9e, col_values=(('external_ids', {'iface-id': '6d4702fa-9e35-4be4-b3b9-015af3cddba8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:48:96:73', 'vm-uuid': '3f86738b-0091-4be9-bd1f-729e54374584'}),)) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:11:37 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:11:37 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:11:37 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:11:37 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:11:37 user nova-compute[71509]: INFO os_vif [None req-48552b54-b78d-4631-855e-bf0525dece6b tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:96:73,bridge_name='br-int',has_traffic_filtering=True,id=6d4702fa-9e35-4be4-b3b9-015af3cddba8,network=Network(6d6b6b35-b5ef-4d7c-abce-cad21cc99e32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d4702fa-9e')
Apr 14 11:11:37 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-48552b54-b78d-4631-855e-bf0525dece6b tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] No BDM found with device name vda, not building metadata. {{(pid=71509) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 11:11:37 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-48552b54-b78d-4631-855e-bf0525dece6b tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] No VIF found with MAC fa:16:3e:48:96:73, not building metadata {{(pid=71509) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 11:11:37 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] Instance destroyed successfully.
Apr 14 11:11:37 user nova-compute[71509]: DEBUG nova.objects.instance [None req-f842dd3b-2aaa-4e56-9d4d-6ea425c3ddb4 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lazy-loading 'resources' on Instance uuid 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 11:11:37 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-f842dd3b-2aaa-4e56-9d4d-6ea425c3ddb4 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T11:06:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1969920784',display_name='tempest-TestMinimumBasicScenario-server-1969920784',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1969920784',id=42,image_ref='a08e5ed8-d3a1-4c04-b424-dd862d7803ae',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC6ZxpnOnwCD8++AKCw08DAo5uRuXS1qhshnTNxj6xmDqjI3Q4e5zyIEi9HPx2ijCKifpCb4oBzu+Rg40bzqM2EcC2gqsAhMQLM5Csl2BMJQ3L+MgH2g/mWsmYIR45G7+A==',key_name='tempest-TestMinimumBasicScenario-1135167667',keypairs=<?>,launch_index=0,launched_at=2023-04-14T11:06:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5809862340a84c83a772c65c77513608',ramdisk_id='',reservation_id='r-t5gwaz98',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a08e5ed8-d3a1-4c04-b424-dd862d7803ae',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-2127394977',owner_user_name='tempest-TestMinimumBasicScenario-2127394977-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T11:08:58Z,user_data=None,user_id='831215baa8fd4fe7ba65193bbbdad1b4',uuid=6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cc02fdc1-b3b9-4ca0-937a-fdcc2a3ba608", "address": "fa:16:3e:d0:2f:a0", "network": {"id": "d59680e7-ed50-4356-b665-ec64ff939708", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-598238133-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5809862340a84c83a772c65c77513608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc02fdc1-b3", "ovs_interfaceid": "cc02fdc1-b3b9-4ca0-937a-fdcc2a3ba608", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 11:11:37 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-f842dd3b-2aaa-4e56-9d4d-6ea425c3ddb4 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Converting VIF {"id": "cc02fdc1-b3b9-4ca0-937a-fdcc2a3ba608", "address": "fa:16:3e:d0:2f:a0", "network": {"id": "d59680e7-ed50-4356-b665-ec64ff939708", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-598238133-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5809862340a84c83a772c65c77513608", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc02fdc1-b3", "ovs_interfaceid": "cc02fdc1-b3b9-4ca0-937a-fdcc2a3ba608", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 11:11:37 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-f842dd3b-2aaa-4e56-9d4d-6ea425c3ddb4 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d0:2f:a0,bridge_name='br-int',has_traffic_filtering=True,id=cc02fdc1-b3b9-4ca0-937a-fdcc2a3ba608,network=Network(d59680e7-ed50-4356-b665-ec64ff939708),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc02fdc1-b3') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 11:11:37 user nova-compute[71509]: DEBUG os_vif [None req-f842dd3b-2aaa-4e56-9d4d-6ea425c3ddb4 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d0:2f:a0,bridge_name='br-int',has_traffic_filtering=True,id=cc02fdc1-b3b9-4ca0-937a-fdcc2a3ba608,network=Network(d59680e7-ed50-4356-b665-ec64ff939708),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc02fdc1-b3') {{(pid=71509) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 11:11:37 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:11:37 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcc02fdc1-b3, bridge=br-int, if_exists=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:11:37 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:11:37 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:11:37 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:11:37 user nova-compute[71509]: INFO os_vif [None req-f842dd3b-2aaa-4e56-9d4d-6ea425c3ddb4 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d0:2f:a0,bridge_name='br-int',has_traffic_filtering=True,id=cc02fdc1-b3b9-4ca0-937a-fdcc2a3ba608,network=Network(d59680e7-ed50-4356-b665-ec64ff939708),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc02fdc1-b3')
Apr 14 11:11:37 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-f842dd3b-2aaa-4e56-9d4d-6ea425c3ddb4 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] Deleting instance files /opt/stack/data/nova/instances/6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99_del
Apr 14 11:11:37 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-f842dd3b-2aaa-4e56-9d4d-6ea425c3ddb4 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] Deletion of /opt/stack/data/nova/instances/6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99_del complete
Apr 14 11:11:37 user nova-compute[71509]: INFO nova.compute.manager [None req-f842dd3b-2aaa-4e56-9d4d-6ea425c3ddb4 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] Took 1.12 seconds to destroy the instance on the hypervisor.
Apr 14 11:11:37 user nova-compute[71509]: DEBUG oslo.service.loopingcall [None req-f842dd3b-2aaa-4e56-9d4d-6ea425c3ddb4 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71509) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 11:11:37 user nova-compute[71509]: DEBUG nova.compute.manager [-] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] Deallocating network for instance {{(pid=71509) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 11:11:37 user nova-compute[71509]: DEBUG nova.network.neutron [-] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] deallocate_for_instance() {{(pid=71509) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 11:11:38 user nova-compute[71509]: DEBUG nova.network.neutron [-] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] Updating instance_info_cache with network_info: [] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:11:38 user nova-compute[71509]: INFO nova.compute.manager [-] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] Took 0.52 seconds to deallocate network for instance.
Apr 14 11:11:38 user nova-compute[71509]: DEBUG nova.compute.manager [req-26f1b2b7-e76c-4bd0-ad22-20d3a571ac63 req-116fa02a-ac90-43fd-ba22-aacf974af9cc service nova] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] Received event network-vif-deleted-cc02fdc1-b3b9-4ca0-937a-fdcc2a3ba608 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:11:38 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-f842dd3b-2aaa-4e56-9d4d-6ea425c3ddb4 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:11:38 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-f842dd3b-2aaa-4e56-9d4d-6ea425c3ddb4 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:11:38 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-f842dd3b-2aaa-4e56-9d4d-6ea425c3ddb4 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 11:11:38 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-f842dd3b-2aaa-4e56-9d4d-6ea425c3ddb4 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 11:11:38 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-f842dd3b-2aaa-4e56-9d4d-6ea425c3ddb4 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.163s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:11:38 user nova-compute[71509]: INFO nova.scheduler.client.report [None req-f842dd3b-2aaa-4e56-9d4d-6ea425c3ddb4 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Deleted allocations for instance 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99
Apr 14 11:11:38 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:11:38 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:11:38 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:11:38 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-f842dd3b-2aaa-4e56-9d4d-6ea425c3ddb4 tempest-TestMinimumBasicScenario-2127394977 tempest-TestMinimumBasicScenario-2127394977-project-member] Lock "6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.997s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:11:38 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:11:38 user nova-compute[71509]: DEBUG nova.compute.manager [req-013a9508-8011-40b4-a8c4-bc4c7c912c4c req-a72b2b81-d033-4ac4-9919-118521d5a193 service nova] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] Received event network-vif-plugged-cc02fdc1-b3b9-4ca0-937a-fdcc2a3ba608 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:11:38 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-013a9508-8011-40b4-a8c4-bc4c7c912c4c req-a72b2b81-d033-4ac4-9919-118521d5a193 service nova] Acquiring lock "6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:11:38 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-013a9508-8011-40b4-a8c4-bc4c7c912c4c req-a72b2b81-d033-4ac4-9919-118521d5a193 service nova] Lock "6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:11:38 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-013a9508-8011-40b4-a8c4-bc4c7c912c4c req-a72b2b81-d033-4ac4-9919-118521d5a193 service nova] Lock "6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:11:38 user nova-compute[71509]: DEBUG nova.compute.manager [req-013a9508-8011-40b4-a8c4-bc4c7c912c4c req-a72b2b81-d033-4ac4-9919-118521d5a193 service nova] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] No waiting events found dispatching network-vif-plugged-cc02fdc1-b3b9-4ca0-937a-fdcc2a3ba608 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:11:38 user nova-compute[71509]: WARNING nova.compute.manager [req-013a9508-8011-40b4-a8c4-bc4c7c912c4c req-a72b2b81-d033-4ac4-9919-118521d5a193 service nova] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] Received unexpected event network-vif-plugged-cc02fdc1-b3b9-4ca0-937a-fdcc2a3ba608 for instance with vm_state deleted and task_state None.
Apr 14 11:11:40 user nova-compute[71509]: DEBUG nova.compute.manager [req-1bac8751-3c51-4081-b0a2-6b4b3763c92d req-85913935-934c-40ed-8936-d46ff97369cf service nova] [instance: 3f86738b-0091-4be9-bd1f-729e54374584] Received event network-vif-plugged-6d4702fa-9e35-4be4-b3b9-015af3cddba8 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:11:40 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-1bac8751-3c51-4081-b0a2-6b4b3763c92d req-85913935-934c-40ed-8936-d46ff97369cf service nova] Acquiring lock "3f86738b-0091-4be9-bd1f-729e54374584-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:11:40 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-1bac8751-3c51-4081-b0a2-6b4b3763c92d req-85913935-934c-40ed-8936-d46ff97369cf service nova] Lock "3f86738b-0091-4be9-bd1f-729e54374584-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:11:40 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-1bac8751-3c51-4081-b0a2-6b4b3763c92d req-85913935-934c-40ed-8936-d46ff97369cf service nova] Lock "3f86738b-0091-4be9-bd1f-729e54374584-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:11:40 user nova-compute[71509]: DEBUG nova.compute.manager [req-1bac8751-3c51-4081-b0a2-6b4b3763c92d req-85913935-934c-40ed-8936-d46ff97369cf service nova] [instance: 3f86738b-0091-4be9-bd1f-729e54374584] No waiting events found dispatching network-vif-plugged-6d4702fa-9e35-4be4-b3b9-015af3cddba8 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:11:40 user nova-compute[71509]: WARNING nova.compute.manager [req-1bac8751-3c51-4081-b0a2-6b4b3763c92d req-85913935-934c-40ed-8936-d46ff97369cf service nova] [instance: 3f86738b-0091-4be9-bd1f-729e54374584] Received unexpected event network-vif-plugged-6d4702fa-9e35-4be4-b3b9-015af3cddba8 for instance with vm_state building and task_state spawning.
Apr 14 11:11:40 user nova-compute[71509]: DEBUG nova.compute.manager [req-1bac8751-3c51-4081-b0a2-6b4b3763c92d req-85913935-934c-40ed-8936-d46ff97369cf service nova] [instance: 3f86738b-0091-4be9-bd1f-729e54374584] Received event network-vif-plugged-6d4702fa-9e35-4be4-b3b9-015af3cddba8 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:11:40 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-1bac8751-3c51-4081-b0a2-6b4b3763c92d req-85913935-934c-40ed-8936-d46ff97369cf service nova] Acquiring lock "3f86738b-0091-4be9-bd1f-729e54374584-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:11:40 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-1bac8751-3c51-4081-b0a2-6b4b3763c92d req-85913935-934c-40ed-8936-d46ff97369cf service nova] Lock "3f86738b-0091-4be9-bd1f-729e54374584-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:11:40 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-1bac8751-3c51-4081-b0a2-6b4b3763c92d req-85913935-934c-40ed-8936-d46ff97369cf service nova] Lock "3f86738b-0091-4be9-bd1f-729e54374584-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:11:40 user nova-compute[71509]: DEBUG nova.compute.manager [req-1bac8751-3c51-4081-b0a2-6b4b3763c92d req-85913935-934c-40ed-8936-d46ff97369cf service nova] [instance: 3f86738b-0091-4be9-bd1f-729e54374584] No waiting events found dispatching network-vif-plugged-6d4702fa-9e35-4be4-b3b9-015af3cddba8 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:11:40 user nova-compute[71509]: WARNING nova.compute.manager [req-1bac8751-3c51-4081-b0a2-6b4b3763c92d req-85913935-934c-40ed-8936-d46ff97369cf service nova] [instance: 3f86738b-0091-4be9-bd1f-729e54374584] Received unexpected event network-vif-plugged-6d4702fa-9e35-4be4-b3b9-015af3cddba8 for instance with vm_state building and task_state spawning.
Apr 14 11:11:40 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681470700.4621363, 3f86738b-0091-4be9-bd1f-729e54374584 => Resumed> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 11:11:40 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 3f86738b-0091-4be9-bd1f-729e54374584] VM Resumed (Lifecycle Event)
Apr 14 11:11:40 user nova-compute[71509]: DEBUG nova.compute.manager [None req-48552b54-b78d-4631-855e-bf0525dece6b tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 3f86738b-0091-4be9-bd1f-729e54374584] Instance event wait completed in 0 seconds for  {{(pid=71509) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 11:11:40 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-48552b54-b78d-4631-855e-bf0525dece6b tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 3f86738b-0091-4be9-bd1f-729e54374584] Guest created on hypervisor {{(pid=71509) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 11:11:40 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: 3f86738b-0091-4be9-bd1f-729e54374584] Instance spawned successfully.
Apr 14 11:11:40 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-48552b54-b78d-4631-855e-bf0525dece6b tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 3f86738b-0091-4be9-bd1f-729e54374584] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 11:11:40 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-48552b54-b78d-4631-855e-bf0525dece6b tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 3f86738b-0091-4be9-bd1f-729e54374584] Found default for hw_input_bus of None {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:11:40 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-48552b54-b78d-4631-855e-bf0525dece6b tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 3f86738b-0091-4be9-bd1f-729e54374584] Found default for hw_pointer_model of None {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:11:40 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 3f86738b-0091-4be9-bd1f-729e54374584] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 11:11:40 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 3f86738b-0091-4be9-bd1f-729e54374584] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 11:11:40 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 3f86738b-0091-4be9-bd1f-729e54374584] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 11:11:40 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681470700.4657605, 3f86738b-0091-4be9-bd1f-729e54374584 => Started> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 11:11:40 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 3f86738b-0091-4be9-bd1f-729e54374584] VM Started (Lifecycle Event)
Apr 14 11:11:40 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 3f86738b-0091-4be9-bd1f-729e54374584] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 11:11:40 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 3f86738b-0091-4be9-bd1f-729e54374584] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 11:11:40 user nova-compute[71509]: INFO nova.compute.manager [None req-48552b54-b78d-4631-855e-bf0525dece6b tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 3f86738b-0091-4be9-bd1f-729e54374584] Took 5.02 seconds to spawn the instance on the hypervisor.
Apr 14 11:11:40 user nova-compute[71509]: DEBUG nova.compute.manager [None req-48552b54-b78d-4631-855e-bf0525dece6b tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 3f86738b-0091-4be9-bd1f-729e54374584] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 11:11:40 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 3f86738b-0091-4be9-bd1f-729e54374584] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 11:11:40 user nova-compute[71509]: INFO nova.compute.manager [None req-48552b54-b78d-4631-855e-bf0525dece6b tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 3f86738b-0091-4be9-bd1f-729e54374584] Took 16.30 seconds to build instance.
Apr 14 11:11:40 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-48552b54-b78d-4631-855e-bf0525dece6b tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "3f86738b-0091-4be9-bd1f-729e54374584" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.389s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:11:42 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:11:43 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:11:47 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:11:50 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:11:50 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71509) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 11:11:51 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:11:51 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:11:52 user nova-compute[71509]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681470697.4760945, 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99 => Stopped> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 11:11:52 user nova-compute[71509]: INFO nova.compute.manager [-] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] VM Stopped (Lifecycle Event)
Apr 14 11:11:52 user nova-compute[71509]: DEBUG nova.compute.manager [None req-f1a80229-a340-4843-a1b9-cc61ccd72dd7 None None] [instance: 6f0e2b69-b1e1-4dbe-aea6-c10fc933ef99] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 11:11:52 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:11:53 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:11:53 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:11:56 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:11:57 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:11:58 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:11:59 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:12:02 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:12:02 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:12:03 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:12:04 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:12:04 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:12:04 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:12:04 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:12:04 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Auditing locally available compute resources for user (node: user) {{(pid=71509) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 11:12:04 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71509) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 11:12:04 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71509) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 11:12:05 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 11:12:05 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 11:12:05 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Hypervisor/Node resource view: name=user free_ram=8614MB free_disk=25.940475463867188GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71509) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 11:12:05 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:12:05 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:12:05 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 434ec83b-ca3c-446e-a63b-f130ceaf8e91 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 11:12:05 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 3f86738b-0091-4be9-bd1f-729e54374584 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 11:12:05 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71509) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 11:12:05 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71509) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 11:12:05 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 11:12:05 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 11:12:05 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Compute_service record updated for user:user {{(pid=71509) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 11:12:05 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.204s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:12:07 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:12:08 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:12:08 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Starting heal instance info cache {{(pid=71509) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 11:12:08 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Rebuilding the list of instances to heal {{(pid=71509) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 11:12:08 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "refresh_cache-434ec83b-ca3c-446e-a63b-f130ceaf8e91" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 11:12:08 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquired lock "refresh_cache-434ec83b-ca3c-446e-a63b-f130ceaf8e91" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 11:12:08 user nova-compute[71509]: DEBUG nova.network.neutron [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] [instance: 434ec83b-ca3c-446e-a63b-f130ceaf8e91] Forcefully refreshing network info cache for instance {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 11:12:08 user nova-compute[71509]: DEBUG nova.objects.instance [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lazy-loading 'info_cache' on Instance uuid 434ec83b-ca3c-446e-a63b-f130ceaf8e91 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 11:12:08 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:12:08 user nova-compute[71509]: DEBUG nova.network.neutron [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] [instance: 434ec83b-ca3c-446e-a63b-f130ceaf8e91] Updating instance_info_cache with network_info: [{"id": "dd3954c8-cff9-4d50-a4bb-63365524ac72", "address": "fa:16:3e:63:f2:83", "network": {"id": "6d6b6b35-b5ef-4d7c-abce-cad21cc99e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-878222456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e7089cb52574f1daf7f578222bb7a67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd3954c8-cf", "ovs_interfaceid": "dd3954c8-cff9-4d50-a4bb-63365524ac72", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:12:08 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Releasing lock "refresh_cache-434ec83b-ca3c-446e-a63b-f130ceaf8e91" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 11:12:08 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] [instance: 434ec83b-ca3c-446e-a63b-f130ceaf8e91] Updated the network info_cache for instance {{(pid=71509) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 11:12:12 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:12:17 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:12:22 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:12:23 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:12:27 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:12:29 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:12:29 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:12:32 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:12:32 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:12:37 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:12:42 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:12:42 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:12:42 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71509) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 11:12:42 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71509) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 11:12:42 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71509) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 11:12:42 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:12:47 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:12:51 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:12:51 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:12:51 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71509) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 11:12:52 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:12:52 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:12:52 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71509) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 11:12:52 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71509) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 11:12:52 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71509) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 11:12:52 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:12:53 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:12:54 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:12:56 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:12:57 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:12:58 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:13:00 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:13:01 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:13:02 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:13:02 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:13:06 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:13:06 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:13:06 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:13:06 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:13:06 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Auditing locally available compute resources for user (node: user) {{(pid=71509) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 11:13:06 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71509) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 11:13:06 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71509) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 11:13:07 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 11:13:07 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 11:13:07 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Hypervisor/Node resource view: name=user free_ram=8711MB free_disk=25.96969985961914GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71509) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 11:13:07 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:13:07 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:13:07 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 434ec83b-ca3c-446e-a63b-f130ceaf8e91 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 11:13:07 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 3f86738b-0091-4be9-bd1f-729e54374584 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 11:13:07 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71509) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 11:13:07 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71509) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 11:13:07 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 11:13:07 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 11:13:07 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Compute_service record updated for user:user {{(pid=71509) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 11:13:07 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.192s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:13:07 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:13:07 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:13:07 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71509) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 11:13:07 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71509) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 11:13:07 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71509) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 11:13:07 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:13:10 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:13:10 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Starting heal instance info cache {{(pid=71509) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 11:13:10 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "refresh_cache-3f86738b-0091-4be9-bd1f-729e54374584" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 11:13:10 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquired lock "refresh_cache-3f86738b-0091-4be9-bd1f-729e54374584" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 11:13:10 user nova-compute[71509]: DEBUG nova.network.neutron [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] [instance: 3f86738b-0091-4be9-bd1f-729e54374584] Forcefully refreshing network info cache for instance {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 11:13:10 user nova-compute[71509]: DEBUG nova.network.neutron [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] [instance: 3f86738b-0091-4be9-bd1f-729e54374584] Updating instance_info_cache with network_info: [{"id": "6d4702fa-9e35-4be4-b3b9-015af3cddba8", "address": "fa:16:3e:48:96:73", "network": {"id": "6d6b6b35-b5ef-4d7c-abce-cad21cc99e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-878222456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e7089cb52574f1daf7f578222bb7a67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d4702fa-9e", "ovs_interfaceid": "6d4702fa-9e35-4be4-b3b9-015af3cddba8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:13:10 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Releasing lock "refresh_cache-3f86738b-0091-4be9-bd1f-729e54374584" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 11:13:10 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] [instance: 3f86738b-0091-4be9-bd1f-729e54374584] Updated the network info_cache for instance {{(pid=71509) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 11:13:12 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:13:12 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:13:12 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71509) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 11:13:12 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71509) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 11:13:12 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71509) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 11:13:12 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:13:14 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-78d6cd22-b924-4956-a239-626dd8c56fdd tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "3f86738b-0091-4be9-bd1f-729e54374584" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:13:14 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-78d6cd22-b924-4956-a239-626dd8c56fdd tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "3f86738b-0091-4be9-bd1f-729e54374584" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:13:14 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-78d6cd22-b924-4956-a239-626dd8c56fdd tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "3f86738b-0091-4be9-bd1f-729e54374584-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:13:14 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-78d6cd22-b924-4956-a239-626dd8c56fdd tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "3f86738b-0091-4be9-bd1f-729e54374584-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:13:14 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-78d6cd22-b924-4956-a239-626dd8c56fdd tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "3f86738b-0091-4be9-bd1f-729e54374584-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:13:14 user nova-compute[71509]: INFO nova.compute.manager [None req-78d6cd22-b924-4956-a239-626dd8c56fdd tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 3f86738b-0091-4be9-bd1f-729e54374584] Terminating instance
Apr 14 11:13:14 user nova-compute[71509]: DEBUG nova.compute.manager [None req-78d6cd22-b924-4956-a239-626dd8c56fdd tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 3f86738b-0091-4be9-bd1f-729e54374584] Start destroying the instance on the hypervisor. {{(pid=71509) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 11:13:14 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:13:14 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:13:14 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:13:15 user nova-compute[71509]: DEBUG nova.compute.manager [req-b951f1a0-79f3-45b2-953a-18c27abba57d req-ab84cb85-48f3-47a7-8fd5-db8ea49a77fa service nova] [instance: 3f86738b-0091-4be9-bd1f-729e54374584] Received event network-vif-unplugged-6d4702fa-9e35-4be4-b3b9-015af3cddba8 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:13:15 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-b951f1a0-79f3-45b2-953a-18c27abba57d req-ab84cb85-48f3-47a7-8fd5-db8ea49a77fa service nova] Acquiring lock "3f86738b-0091-4be9-bd1f-729e54374584-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:13:15 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-b951f1a0-79f3-45b2-953a-18c27abba57d req-ab84cb85-48f3-47a7-8fd5-db8ea49a77fa service nova] Lock "3f86738b-0091-4be9-bd1f-729e54374584-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:13:15 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-b951f1a0-79f3-45b2-953a-18c27abba57d req-ab84cb85-48f3-47a7-8fd5-db8ea49a77fa service nova] Lock "3f86738b-0091-4be9-bd1f-729e54374584-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:13:15 user nova-compute[71509]: DEBUG nova.compute.manager [req-b951f1a0-79f3-45b2-953a-18c27abba57d req-ab84cb85-48f3-47a7-8fd5-db8ea49a77fa service nova] [instance: 3f86738b-0091-4be9-bd1f-729e54374584] No waiting events found dispatching network-vif-unplugged-6d4702fa-9e35-4be4-b3b9-015af3cddba8 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:13:15 user nova-compute[71509]: DEBUG nova.compute.manager [req-b951f1a0-79f3-45b2-953a-18c27abba57d req-ab84cb85-48f3-47a7-8fd5-db8ea49a77fa service nova] [instance: 3f86738b-0091-4be9-bd1f-729e54374584] Received event network-vif-unplugged-6d4702fa-9e35-4be4-b3b9-015af3cddba8 for instance with task_state deleting. {{(pid=71509) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 11:13:15 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:13:15 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:13:15 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:13:15 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:13:15 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: 3f86738b-0091-4be9-bd1f-729e54374584] Instance destroyed successfully.
Apr 14 11:13:15 user nova-compute[71509]: DEBUG nova.objects.instance [None req-78d6cd22-b924-4956-a239-626dd8c56fdd tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lazy-loading 'resources' on Instance uuid 3f86738b-0091-4be9-bd1f-729e54374584 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 11:13:15 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-78d6cd22-b924-4956-a239-626dd8c56fdd tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T11:11:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1443395603',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1443395603',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1443395603',id=44,image_ref='93ab939e-5ede-4edd-aa21-6e6ce2e27bdb',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T11:11:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2e7089cb52574f1daf7f578222bb7a67',ramdisk_id='',reservation_id='r-fci9uvjk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-193101874',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-193101874-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-193101874',owner_user_name='tempest-TestVolumeBootPattern-193101874-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T11:11:41Z,user_data=None,user_id='c7644d02bc784e4fb74ebaaceb3affe1',uuid=3f86738b-0091-4be9-bd1f-729e54374584,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6d4702fa-9e35-4be4-b3b9-015af3cddba8", "address": "fa:16:3e:48:96:73", "network": {"id": "6d6b6b35-b5ef-4d7c-abce-cad21cc99e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-878222456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e7089cb52574f1daf7f578222bb7a67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d4702fa-9e", "ovs_interfaceid": "6d4702fa-9e35-4be4-b3b9-015af3cddba8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 11:13:15 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-78d6cd22-b924-4956-a239-626dd8c56fdd tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Converting VIF {"id": "6d4702fa-9e35-4be4-b3b9-015af3cddba8", "address": "fa:16:3e:48:96:73", "network": {"id": "6d6b6b35-b5ef-4d7c-abce-cad21cc99e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-878222456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e7089cb52574f1daf7f578222bb7a67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d4702fa-9e", "ovs_interfaceid": "6d4702fa-9e35-4be4-b3b9-015af3cddba8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 11:13:15 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-78d6cd22-b924-4956-a239-626dd8c56fdd tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:48:96:73,bridge_name='br-int',has_traffic_filtering=True,id=6d4702fa-9e35-4be4-b3b9-015af3cddba8,network=Network(6d6b6b35-b5ef-4d7c-abce-cad21cc99e32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d4702fa-9e') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 11:13:15 user nova-compute[71509]: DEBUG os_vif [None req-78d6cd22-b924-4956-a239-626dd8c56fdd tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:48:96:73,bridge_name='br-int',has_traffic_filtering=True,id=6d4702fa-9e35-4be4-b3b9-015af3cddba8,network=Network(6d6b6b35-b5ef-4d7c-abce-cad21cc99e32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d4702fa-9e') {{(pid=71509) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 11:13:15 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:13:15 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6d4702fa-9e, bridge=br-int, if_exists=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:13:15 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:13:15 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:13:15 user nova-compute[71509]: INFO os_vif [None req-78d6cd22-b924-4956-a239-626dd8c56fdd tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:48:96:73,bridge_name='br-int',has_traffic_filtering=True,id=6d4702fa-9e35-4be4-b3b9-015af3cddba8,network=Network(6d6b6b35-b5ef-4d7c-abce-cad21cc99e32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d4702fa-9e')
Apr 14 11:13:15 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78d6cd22-b924-4956-a239-626dd8c56fdd tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 3f86738b-0091-4be9-bd1f-729e54374584] calling os-brick to detach iSCSI Volume {{(pid=71509) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 11:13:15 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d6cd22-b924-4956-a239-626dd8c56fdd tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0bf0749390>, {'target_iqn': 'iqn.2010-10.org.openstack:0eca2bb4-fe51-4445-8d85-c092b3ac8712', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DaFIWrHg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 11:13:15 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-78d6cd22-b924-4956-a239-626dd8c56fdd tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 11:13:15 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-78d6cd22-b924-4956-a239-626dd8c56fdd tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 11:13:15 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-78d6cd22-b924-4956-a239-626dd8c56fdd tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 11:13:15 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:13:15 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:13:15 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fcb4fe8-5059-4b03-91a7-242df07693fc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0eca2bb4-fe51-4445-8d85-c092b3ac8712\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b6eae10c-5695-41f5-8511-7a5bbc598367\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:13:15 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d6cd22-b924-4956-a239-626dd8c56fdd tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 11:13:15 user nova-compute[71509]: No targets found.
Apr 14 11:13:15 user nova-compute[71509]: iSNS:
Apr 14 11:13:15 user nova-compute[71509]: No targets found.
Apr 14 11:13:15 user nova-compute[71509]: STATIC:
Apr 14 11:13:15 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:0eca2bb4-fe51-4445-8d85-c092b3ac8712
Apr 14 11:13:15 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 11:13:15 user nova-compute[71509]:                 Iface Name: default
Apr 14 11:13:15 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:b6eae10c-5695-41f5-8511-7a5bbc598367
Apr 14 11:13:15 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 11:13:15 user nova-compute[71509]:                 Iface Name: default
Apr 14 11:13:15 user nova-compute[71509]: FIRMWARE:
Apr 14 11:13:15 user nova-compute[71509]: No targets found.
Apr 14 11:13:15 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 11:13:15 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d6cd22-b924-4956-a239-626dd8c56fdd tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 11:13:15 user nova-compute[71509]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 11:13:15 user nova-compute[71509]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71509) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 11:13:15 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d6cd22-b924-4956-a239-626dd8c56fdd tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0eca2bb4-fe51-4445-8d85-c092b3ac8712', 0)] {{(pid=71509) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 11:13:15 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:13:15 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:13:15 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[9297dc54-9790-48e8-8a34-6c20edef9733]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0eca2bb4-fe51-4445-8d85-c092b3ac8712\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b6eae10c-5695-41f5-8511-7a5bbc598367\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:13:15 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:13:15 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:13:15 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[2731f623-eb3a-4034-8aa6-05964d5d2e4a]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6eae10c-5695-41f5-8511-7a5bbc598367 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eca2bb4-fe51-4445-8d85-c092b3ac8712 (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:13:15 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d6cd22-b924-4956-a239-626dd8c56fdd tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6eae10c-5695-41f5-8511-7a5bbc598367 (non-flash)
Apr 14 11:13:15 user nova-compute[71509]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eca2bb4-fe51-4445-8d85-c092b3ac8712 (non-flash)
Apr 14 11:13:15 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 11:13:15 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d6cd22-b924-4956-a239-626dd8c56fdd tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6eae10c-5695-41f5-8511-7a5bbc598367 (non-flash)
Apr 14 11:13:15 user nova-compute[71509]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eca2bb4-fe51-4445-8d85-c092b3ac8712 (non-flash)
Apr 14 11:13:15 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 11:13:15 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d6cd22-b924-4956-a239-626dd8c56fdd tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0c1420ba30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0eca2bb4-fe51-4445-8d85-c092b3ac8712'): ({'sdb'}, set())}) {{(pid=71509) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 11:13:15 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-78d6cd22-b924-4956-a239-626dd8c56fdd tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Removing single pathed devices sdb {{(pid=71509) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 11:13:15 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:13:15 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:13:15 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[139d8b8b-310f-43cb-a0e5-f7f888f7e946]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:13:15 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:13:15 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.028s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:13:15 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3d34bcf-469c-45ef-bb91-cab5f4eaef38]: (4, ('ok\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:13:15 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-78d6cd22-b924-4956-a239-626dd8c56fdd tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Flushing IO for device /dev/sdb {{(pid=71509) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 11:13:15 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:13:15 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:13:15 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:13:15 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[785d5d9c-27de-46f6-acf1-7b363fad1ca2]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:13:15 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-78d6cd22-b924-4956-a239-626dd8c56fdd tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71509) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 11:13:15 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:13:15 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.140s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:13:15 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[7974f2d3-6ea7-43a0-8cc1-0dd3c47cd350]: (4, ('1', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:13:15 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-78d6cd22-b924-4956-a239-626dd8c56fdd tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71509) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 11:13:15 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-78d6cd22-b924-4956-a239-626dd8c56fdd tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] SCSI volumes sdb have been removed. {{(pid=71509) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 11:13:15 user nova-compute[71509]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_b44fe5c4', '/dev/disk/by-id/scsi-23336636365383539', '/dev/disk/by-id/scsi-1SCST_BIOb44fe5c4-36cce859dcd0215e') {{(pid=82281) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 14 11:13:15 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[12769191-859a-4360-aad9-5a9ead28293b]: (4, None) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:13:15 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d6cd22-b924-4956-a239-626dd8c56fdd tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0eca2bb4-fe51-4445-8d85-c092b3ac8712')] {{(pid=71509) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 11:13:15 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0eca2bb4-fe51-4445-8d85-c092b3ac8712 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:13:15 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0eca2bb4-fe51-4445-8d85-c092b3ac8712 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:13:15 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ad78c6f-12b8-4c24-b481-6ec1928dffb6]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:13:15 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d6cd22-b924-4956-a239-626dd8c56fdd tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:13:15 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0eca2bb4-fe51-4445-8d85-c092b3ac8712 -p 172.16.0.220:3260 --logout {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:13:15 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0eca2bb4-fe51-4445-8d85-c092b3ac8712 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:13:15 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[b27c8eef-27db-44dd-b896-060e82b191e2]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:0eca2bb4-fe51-4445-8d85-c092b3ac8712, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:0eca2bb4-fe51-4445-8d85-c092b3ac8712, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:13:15 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d6cd22-b924-4956-a239-626dd8c56fdd tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:0eca2bb4-fe51-4445-8d85-c092b3ac8712, portal: 172.16.0.220,3260]
Apr 14 11:13:15 user nova-compute[71509]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:0eca2bb4-fe51-4445-8d85-c092b3ac8712, portal: 172.16.0.220,3260] successful.
Apr 14 11:13:15 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:13:15 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:13:15 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0eca2bb4-fe51-4445-8d85-c092b3ac8712 -p 172.16.0.220:3260 --op delete {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:13:15 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0eca2bb4-fe51-4445-8d85-c092b3ac8712 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:13:15 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3343a3b-cadb-46e5-a5a7-ea5641dafc74]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:13:15 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d6cd22-b924-4956-a239-626dd8c56fdd tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:13:15 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-78d6cd22-b924-4956-a239-626dd8c56fdd tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.494s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 11:13:15 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d6cd22-b924-4956-a239-626dd8c56fdd tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] <== disconnect_volume: return (496ms) None {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 11:13:15 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78d6cd22-b924-4956-a239-626dd8c56fdd tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 3f86738b-0091-4be9-bd1f-729e54374584] Disconnected iSCSI Volume {{(pid=71509) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 11:13:15 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-78d6cd22-b924-4956-a239-626dd8c56fdd tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 3f86738b-0091-4be9-bd1f-729e54374584] Deleting instance files /opt/stack/data/nova/instances/3f86738b-0091-4be9-bd1f-729e54374584_del
Apr 14 11:13:15 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-78d6cd22-b924-4956-a239-626dd8c56fdd tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 3f86738b-0091-4be9-bd1f-729e54374584] Deletion of /opt/stack/data/nova/instances/3f86738b-0091-4be9-bd1f-729e54374584_del complete
Apr 14 11:13:16 user nova-compute[71509]: INFO nova.compute.manager [None req-78d6cd22-b924-4956-a239-626dd8c56fdd tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 3f86738b-0091-4be9-bd1f-729e54374584] Took 1.39 seconds to destroy the instance on the hypervisor.
Apr 14 11:13:16 user nova-compute[71509]: DEBUG oslo.service.loopingcall [None req-78d6cd22-b924-4956-a239-626dd8c56fdd tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71509) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 11:13:16 user nova-compute[71509]: DEBUG nova.compute.manager [-] [instance: 3f86738b-0091-4be9-bd1f-729e54374584] Deallocating network for instance {{(pid=71509) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 11:13:16 user nova-compute[71509]: DEBUG nova.network.neutron [-] [instance: 3f86738b-0091-4be9-bd1f-729e54374584] deallocate_for_instance() {{(pid=71509) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 11:13:16 user nova-compute[71509]: DEBUG nova.network.neutron [-] [instance: 3f86738b-0091-4be9-bd1f-729e54374584] Updating instance_info_cache with network_info: [] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:13:16 user nova-compute[71509]: INFO nova.compute.manager [-] [instance: 3f86738b-0091-4be9-bd1f-729e54374584] Took 0.81 seconds to deallocate network for instance.
Apr 14 11:13:17 user nova-compute[71509]: DEBUG nova.compute.manager [req-f0fdaa2d-53cd-421b-a66c-437ad1dd3170 req-7b082392-05c8-4a33-96b2-f286c67eb162 service nova] [instance: 3f86738b-0091-4be9-bd1f-729e54374584] Received event network-vif-plugged-6d4702fa-9e35-4be4-b3b9-015af3cddba8 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:13:17 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-f0fdaa2d-53cd-421b-a66c-437ad1dd3170 req-7b082392-05c8-4a33-96b2-f286c67eb162 service nova] Acquiring lock "3f86738b-0091-4be9-bd1f-729e54374584-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:13:17 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-f0fdaa2d-53cd-421b-a66c-437ad1dd3170 req-7b082392-05c8-4a33-96b2-f286c67eb162 service nova] Lock "3f86738b-0091-4be9-bd1f-729e54374584-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:13:17 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-f0fdaa2d-53cd-421b-a66c-437ad1dd3170 req-7b082392-05c8-4a33-96b2-f286c67eb162 service nova] Lock "3f86738b-0091-4be9-bd1f-729e54374584-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:13:17 user nova-compute[71509]: DEBUG nova.compute.manager [req-f0fdaa2d-53cd-421b-a66c-437ad1dd3170 req-7b082392-05c8-4a33-96b2-f286c67eb162 service nova] [instance: 3f86738b-0091-4be9-bd1f-729e54374584] No waiting events found dispatching network-vif-plugged-6d4702fa-9e35-4be4-b3b9-015af3cddba8 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:13:17 user nova-compute[71509]: WARNING nova.compute.manager [req-f0fdaa2d-53cd-421b-a66c-437ad1dd3170 req-7b082392-05c8-4a33-96b2-f286c67eb162 service nova] [instance: 3f86738b-0091-4be9-bd1f-729e54374584] Received unexpected event network-vif-plugged-6d4702fa-9e35-4be4-b3b9-015af3cddba8 for instance with vm_state active and task_state deleting.
Apr 14 11:13:17 user nova-compute[71509]: DEBUG nova.compute.manager [req-f0fdaa2d-53cd-421b-a66c-437ad1dd3170 req-7b082392-05c8-4a33-96b2-f286c67eb162 service nova] [instance: 3f86738b-0091-4be9-bd1f-729e54374584] Received event network-vif-plugged-6d4702fa-9e35-4be4-b3b9-015af3cddba8 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:13:17 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-f0fdaa2d-53cd-421b-a66c-437ad1dd3170 req-7b082392-05c8-4a33-96b2-f286c67eb162 service nova] Acquiring lock "3f86738b-0091-4be9-bd1f-729e54374584-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:13:17 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-f0fdaa2d-53cd-421b-a66c-437ad1dd3170 req-7b082392-05c8-4a33-96b2-f286c67eb162 service nova] Lock "3f86738b-0091-4be9-bd1f-729e54374584-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:13:17 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-f0fdaa2d-53cd-421b-a66c-437ad1dd3170 req-7b082392-05c8-4a33-96b2-f286c67eb162 service nova] Lock "3f86738b-0091-4be9-bd1f-729e54374584-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:13:17 user nova-compute[71509]: DEBUG nova.compute.manager [req-f0fdaa2d-53cd-421b-a66c-437ad1dd3170 req-7b082392-05c8-4a33-96b2-f286c67eb162 service nova] [instance: 3f86738b-0091-4be9-bd1f-729e54374584] No waiting events found dispatching network-vif-plugged-6d4702fa-9e35-4be4-b3b9-015af3cddba8 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:13:17 user nova-compute[71509]: WARNING nova.compute.manager [req-f0fdaa2d-53cd-421b-a66c-437ad1dd3170 req-7b082392-05c8-4a33-96b2-f286c67eb162 service nova] [instance: 3f86738b-0091-4be9-bd1f-729e54374584] Received unexpected event network-vif-plugged-6d4702fa-9e35-4be4-b3b9-015af3cddba8 for instance with vm_state active and task_state deleting.
Apr 14 11:13:17 user nova-compute[71509]: DEBUG nova.compute.manager [req-f0fdaa2d-53cd-421b-a66c-437ad1dd3170 req-7b082392-05c8-4a33-96b2-f286c67eb162 service nova] [instance: 3f86738b-0091-4be9-bd1f-729e54374584] Received event network-vif-plugged-6d4702fa-9e35-4be4-b3b9-015af3cddba8 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:13:17 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-f0fdaa2d-53cd-421b-a66c-437ad1dd3170 req-7b082392-05c8-4a33-96b2-f286c67eb162 service nova] Acquiring lock "3f86738b-0091-4be9-bd1f-729e54374584-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:13:17 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-f0fdaa2d-53cd-421b-a66c-437ad1dd3170 req-7b082392-05c8-4a33-96b2-f286c67eb162 service nova] Lock "3f86738b-0091-4be9-bd1f-729e54374584-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:13:17 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-f0fdaa2d-53cd-421b-a66c-437ad1dd3170 req-7b082392-05c8-4a33-96b2-f286c67eb162 service nova] Lock "3f86738b-0091-4be9-bd1f-729e54374584-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:13:17 user nova-compute[71509]: DEBUG nova.compute.manager [req-f0fdaa2d-53cd-421b-a66c-437ad1dd3170 req-7b082392-05c8-4a33-96b2-f286c67eb162 service nova] [instance: 3f86738b-0091-4be9-bd1f-729e54374584] No waiting events found dispatching network-vif-plugged-6d4702fa-9e35-4be4-b3b9-015af3cddba8 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:13:17 user nova-compute[71509]: WARNING nova.compute.manager [req-f0fdaa2d-53cd-421b-a66c-437ad1dd3170 req-7b082392-05c8-4a33-96b2-f286c67eb162 service nova] [instance: 3f86738b-0091-4be9-bd1f-729e54374584] Received unexpected event network-vif-plugged-6d4702fa-9e35-4be4-b3b9-015af3cddba8 for instance with vm_state active and task_state deleting.
Apr 14 11:13:17 user nova-compute[71509]: DEBUG nova.compute.manager [req-f0fdaa2d-53cd-421b-a66c-437ad1dd3170 req-7b082392-05c8-4a33-96b2-f286c67eb162 service nova] [instance: 3f86738b-0091-4be9-bd1f-729e54374584] Received event network-vif-plugged-6d4702fa-9e35-4be4-b3b9-015af3cddba8 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:13:17 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-f0fdaa2d-53cd-421b-a66c-437ad1dd3170 req-7b082392-05c8-4a33-96b2-f286c67eb162 service nova] Acquiring lock "3f86738b-0091-4be9-bd1f-729e54374584-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:13:17 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-f0fdaa2d-53cd-421b-a66c-437ad1dd3170 req-7b082392-05c8-4a33-96b2-f286c67eb162 service nova] Lock "3f86738b-0091-4be9-bd1f-729e54374584-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:13:17 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-f0fdaa2d-53cd-421b-a66c-437ad1dd3170 req-7b082392-05c8-4a33-96b2-f286c67eb162 service nova] Lock "3f86738b-0091-4be9-bd1f-729e54374584-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:13:17 user nova-compute[71509]: DEBUG nova.compute.manager [req-f0fdaa2d-53cd-421b-a66c-437ad1dd3170 req-7b082392-05c8-4a33-96b2-f286c67eb162 service nova] [instance: 3f86738b-0091-4be9-bd1f-729e54374584] No waiting events found dispatching network-vif-plugged-6d4702fa-9e35-4be4-b3b9-015af3cddba8 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:13:17 user nova-compute[71509]: WARNING nova.compute.manager [req-f0fdaa2d-53cd-421b-a66c-437ad1dd3170 req-7b082392-05c8-4a33-96b2-f286c67eb162 service nova] [instance: 3f86738b-0091-4be9-bd1f-729e54374584] Received unexpected event network-vif-plugged-6d4702fa-9e35-4be4-b3b9-015af3cddba8 for instance with vm_state active and task_state deleting.
Apr 14 11:13:17 user nova-compute[71509]: DEBUG nova.compute.manager [req-f0fdaa2d-53cd-421b-a66c-437ad1dd3170 req-7b082392-05c8-4a33-96b2-f286c67eb162 service nova] [instance: 3f86738b-0091-4be9-bd1f-729e54374584] Received event network-vif-deleted-6d4702fa-9e35-4be4-b3b9-015af3cddba8 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:13:17 user nova-compute[71509]: INFO nova.compute.manager [None req-78d6cd22-b924-4956-a239-626dd8c56fdd tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 3f86738b-0091-4be9-bd1f-729e54374584] Took 0.83 seconds to detach 1 volumes for instance.
Apr 14 11:13:17 user nova-compute[71509]: DEBUG nova.compute.manager [None req-78d6cd22-b924-4956-a239-626dd8c56fdd tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 3f86738b-0091-4be9-bd1f-729e54374584] Deleting volume: 0eca2bb4-fe51-4445-8d85-c092b3ac8712 {{(pid=71509) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 14 11:13:17 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-78d6cd22-b924-4956-a239-626dd8c56fdd tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:13:17 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-78d6cd22-b924-4956-a239-626dd8c56fdd tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:13:17 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-78d6cd22-b924-4956-a239-626dd8c56fdd tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 11:13:17 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-78d6cd22-b924-4956-a239-626dd8c56fdd tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 11:13:17 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-78d6cd22-b924-4956-a239-626dd8c56fdd tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.130s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:13:18 user nova-compute[71509]: INFO nova.scheduler.client.report [None req-78d6cd22-b924-4956-a239-626dd8c56fdd tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Deleted allocations for instance 3f86738b-0091-4be9-bd1f-729e54374584
Apr 14 11:13:18 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-78d6cd22-b924-4956-a239-626dd8c56fdd tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "3f86738b-0091-4be9-bd1f-729e54374584" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.485s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:13:20 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:13:25 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:13:30 user nova-compute[71509]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681470795.396796, 3f86738b-0091-4be9-bd1f-729e54374584 => Stopped> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 11:13:30 user nova-compute[71509]: INFO nova.compute.manager [-] [instance: 3f86738b-0091-4be9-bd1f-729e54374584] VM Stopped (Lifecycle Event)
Apr 14 11:13:30 user nova-compute[71509]: DEBUG nova.compute.manager [None req-7ac0e648-3496-462b-af37-3f90757355fe None None] [instance: 3f86738b-0091-4be9-bd1f-729e54374584] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 11:13:30 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:13:30 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:13:30 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71509) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 11:13:30 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71509) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 11:13:30 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71509) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 11:13:30 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:13:35 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:13:40 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:13:45 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:13:45 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:13:45 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71509) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 11:13:45 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71509) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 11:13:45 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71509) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 11:13:45 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:13:50 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:13:51 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:13:51 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:13:51 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71509) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 11:13:53 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:13:53 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71509) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 14 11:13:54 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:13:54 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Cleaning up deleted instances {{(pid=71509) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 14 11:13:54 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] There are 0 instances to clean {{(pid=71509) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 14 11:13:55 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:13:55 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:13:55 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:13:56 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:13:58 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:14:00 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:14:02 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:14:02 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:14:02 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:14:05 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:14:08 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:14:08 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:14:08 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:14:08 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:14:08 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Auditing locally available compute resources for user (node: user) {{(pid=71509) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 11:14:08 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71509) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 11:14:08 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-8ddc0ce5-150b-404b-8581-cd24594a9c56 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "434ec83b-ca3c-446e-a63b-f130ceaf8e91" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:14:08 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-8ddc0ce5-150b-404b-8581-cd24594a9c56 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "434ec83b-ca3c-446e-a63b-f130ceaf8e91" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:14:08 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-8ddc0ce5-150b-404b-8581-cd24594a9c56 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "434ec83b-ca3c-446e-a63b-f130ceaf8e91-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:14:08 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-8ddc0ce5-150b-404b-8581-cd24594a9c56 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "434ec83b-ca3c-446e-a63b-f130ceaf8e91-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:14:08 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-8ddc0ce5-150b-404b-8581-cd24594a9c56 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "434ec83b-ca3c-446e-a63b-f130ceaf8e91-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:14:08 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 11:14:08 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 11:14:08 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Hypervisor/Node resource view: name=user free_ram=8773MB free_disk=25.960922241210938GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71509) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 11:14:08 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:14:08 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:14:08 user nova-compute[71509]: INFO nova.compute.manager [None req-8ddc0ce5-150b-404b-8581-cd24594a9c56 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 434ec83b-ca3c-446e-a63b-f130ceaf8e91] Terminating instance
Apr 14 11:14:08 user nova-compute[71509]: DEBUG nova.compute.manager [None req-8ddc0ce5-150b-404b-8581-cd24594a9c56 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 434ec83b-ca3c-446e-a63b-f130ceaf8e91] Start destroying the instance on the hypervisor. {{(pid=71509) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 11:14:09 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:14:09 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:14:09 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:14:09 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 434ec83b-ca3c-446e-a63b-f130ceaf8e91 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 11:14:09 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71509) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 11:14:09 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71509) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 11:14:09 user nova-compute[71509]: DEBUG nova.compute.manager [req-fbe8b563-9cb1-4e40-bc6e-4ea3c013ac1e req-a64601e2-8b08-4122-8b98-3d895032b3f1 service nova] [instance: 434ec83b-ca3c-446e-a63b-f130ceaf8e91] Received event network-vif-unplugged-dd3954c8-cff9-4d50-a4bb-63365524ac72 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:14:09 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-fbe8b563-9cb1-4e40-bc6e-4ea3c013ac1e req-a64601e2-8b08-4122-8b98-3d895032b3f1 service nova] Acquiring lock "434ec83b-ca3c-446e-a63b-f130ceaf8e91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:14:09 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-fbe8b563-9cb1-4e40-bc6e-4ea3c013ac1e req-a64601e2-8b08-4122-8b98-3d895032b3f1 service nova] Lock "434ec83b-ca3c-446e-a63b-f130ceaf8e91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:14:09 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-fbe8b563-9cb1-4e40-bc6e-4ea3c013ac1e req-a64601e2-8b08-4122-8b98-3d895032b3f1 service nova] Lock "434ec83b-ca3c-446e-a63b-f130ceaf8e91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:14:09 user nova-compute[71509]: DEBUG nova.compute.manager [req-fbe8b563-9cb1-4e40-bc6e-4ea3c013ac1e req-a64601e2-8b08-4122-8b98-3d895032b3f1 service nova] [instance: 434ec83b-ca3c-446e-a63b-f130ceaf8e91] No waiting events found dispatching network-vif-unplugged-dd3954c8-cff9-4d50-a4bb-63365524ac72 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:14:09 user nova-compute[71509]: DEBUG nova.compute.manager [req-fbe8b563-9cb1-4e40-bc6e-4ea3c013ac1e req-a64601e2-8b08-4122-8b98-3d895032b3f1 service nova] [instance: 434ec83b-ca3c-446e-a63b-f130ceaf8e91] Received event network-vif-unplugged-dd3954c8-cff9-4d50-a4bb-63365524ac72 for instance with task_state deleting. {{(pid=71509) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 11:14:09 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Refreshing inventories for resource provider 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 14 11:14:09 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Updating ProviderTree inventory for provider 52209f7e-594e-4cf4-9018-18636056cd6b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 14 11:14:09 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Updating inventory in ProviderTree for provider 52209f7e-594e-4cf4-9018-18636056cd6b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 14 11:14:09 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Refreshing aggregate associations for resource provider 52209f7e-594e-4cf4-9018-18636056cd6b, aggregates: None {{(pid=71509) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 14 11:14:09 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Refreshing trait associations for resource provider 52209f7e-594e-4cf4-9018-18636056cd6b, traits: COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE42,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_SATA {{(pid=71509) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 14 11:14:09 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:14:09 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 11:14:09 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 11:14:09 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Compute_service record updated for user:user {{(pid=71509) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 11:14:09 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.633s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:14:09 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: 434ec83b-ca3c-446e-a63b-f130ceaf8e91] Instance destroyed successfully.
Apr 14 11:14:09 user nova-compute[71509]: DEBUG nova.objects.instance [None req-8ddc0ce5-150b-404b-8581-cd24594a9c56 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lazy-loading 'resources' on Instance uuid 434ec83b-ca3c-446e-a63b-f130ceaf8e91 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 11:14:09 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-8ddc0ce5-150b-404b-8581-cd24594a9c56 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T11:09:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1989339962',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1989339962',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1989339962',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-04-14T11:09:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2e7089cb52574f1daf7f578222bb7a67',ramdisk_id='',reservation_id='r-nvd0exzj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-193101874',owner_user_name='tempest-TestVolumeBootPattern-193101874-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T11:09:42Z,user_data=None,user_id='c7644d02bc784e4fb74ebaaceb3affe1',uuid=434ec83b-ca3c-446e-a63b-f130ceaf8e91,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dd3954c8-cff9-4d50-a4bb-63365524ac72", "address": "fa:16:3e:63:f2:83", "network": {"id": "6d6b6b35-b5ef-4d7c-abce-cad21cc99e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-878222456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e7089cb52574f1daf7f578222bb7a67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd3954c8-cf", "ovs_interfaceid": "dd3954c8-cff9-4d50-a4bb-63365524ac72", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 11:14:09 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-8ddc0ce5-150b-404b-8581-cd24594a9c56 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Converting VIF {"id": "dd3954c8-cff9-4d50-a4bb-63365524ac72", "address": "fa:16:3e:63:f2:83", "network": {"id": "6d6b6b35-b5ef-4d7c-abce-cad21cc99e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-878222456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e7089cb52574f1daf7f578222bb7a67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd3954c8-cf", "ovs_interfaceid": "dd3954c8-cff9-4d50-a4bb-63365524ac72", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 11:14:09 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-8ddc0ce5-150b-404b-8581-cd24594a9c56 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:63:f2:83,bridge_name='br-int',has_traffic_filtering=True,id=dd3954c8-cff9-4d50-a4bb-63365524ac72,network=Network(6d6b6b35-b5ef-4d7c-abce-cad21cc99e32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd3954c8-cf') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 11:14:09 user nova-compute[71509]: DEBUG os_vif [None req-8ddc0ce5-150b-404b-8581-cd24594a9c56 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:63:f2:83,bridge_name='br-int',has_traffic_filtering=True,id=dd3954c8-cff9-4d50-a4bb-63365524ac72,network=Network(6d6b6b35-b5ef-4d7c-abce-cad21cc99e32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd3954c8-cf') {{(pid=71509) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 11:14:09 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:14:09 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdd3954c8-cf, bridge=br-int, if_exists=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:14:09 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:14:09 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:14:09 user nova-compute[71509]: INFO os_vif [None req-8ddc0ce5-150b-404b-8581-cd24594a9c56 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:63:f2:83,bridge_name='br-int',has_traffic_filtering=True,id=dd3954c8-cff9-4d50-a4bb-63365524ac72,network=Network(6d6b6b35-b5ef-4d7c-abce-cad21cc99e32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd3954c8-cf')
Apr 14 11:14:09 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ddc0ce5-150b-404b-8581-cd24594a9c56 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 434ec83b-ca3c-446e-a63b-f130ceaf8e91] calling os-brick to detach iSCSI Volume {{(pid=71509) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 11:14:09 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ddc0ce5-150b-404b-8581-cd24594a9c56 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0bf0749390>, {'target_iqn': 'iqn.2010-10.org.openstack:b6eae10c-5695-41f5-8511-7a5bbc598367', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TxpZNWGB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 11:14:09 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-8ddc0ce5-150b-404b-8581-cd24594a9c56 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 11:14:09 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-8ddc0ce5-150b-404b-8581-cd24594a9c56 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 11:14:09 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-8ddc0ce5-150b-404b-8581-cd24594a9c56 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 11:14:09 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:14:09 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:14:09 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7818656-0529-4719-9444-f0e9a95f8420]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b6eae10c-5695-41f5-8511-7a5bbc598367\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:14:09 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ddc0ce5-150b-404b-8581-cd24594a9c56 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 11:14:09 user nova-compute[71509]: No targets found.
Apr 14 11:14:09 user nova-compute[71509]: iSNS:
Apr 14 11:14:09 user nova-compute[71509]: No targets found.
Apr 14 11:14:09 user nova-compute[71509]: STATIC:
Apr 14 11:14:09 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:b6eae10c-5695-41f5-8511-7a5bbc598367
Apr 14 11:14:09 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 11:14:09 user nova-compute[71509]:                 Iface Name: default
Apr 14 11:14:09 user nova-compute[71509]: FIRMWARE:
Apr 14 11:14:09 user nova-compute[71509]: No targets found.
Apr 14 11:14:09 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 11:14:09 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ddc0ce5-150b-404b-8581-cd24594a9c56 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 11:14:09 user nova-compute[71509]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 11:14:09 user nova-compute[71509]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71509) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 11:14:09 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ddc0ce5-150b-404b-8581-cd24594a9c56 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b6eae10c-5695-41f5-8511-7a5bbc598367', 0)] {{(pid=71509) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 11:14:09 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:14:09 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:14:09 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[28e350ef-a6f0-48a3-9dd4-fcaa2c109f8c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b6eae10c-5695-41f5-8511-7a5bbc598367\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:14:09 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:14:09 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:14:09 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[5089644f-ca11-4bb7-a6c7-964e87a1ce42]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6eae10c-5695-41f5-8511-7a5bbc598367 (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:14:09 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ddc0ce5-150b-404b-8581-cd24594a9c56 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6eae10c-5695-41f5-8511-7a5bbc598367 (non-flash)
Apr 14 11:14:09 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 11:14:09 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ddc0ce5-150b-404b-8581-cd24594a9c56 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6eae10c-5695-41f5-8511-7a5bbc598367 (non-flash)
Apr 14 11:14:09 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 11:14:09 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ddc0ce5-150b-404b-8581-cd24594a9c56 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0bf05c2710>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b6eae10c-5695-41f5-8511-7a5bbc598367'): ({'sdc'}, set())}) {{(pid=71509) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 11:14:09 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-8ddc0ce5-150b-404b-8581-cd24594a9c56 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Removing single pathed devices sdc {{(pid=71509) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 11:14:09 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:14:09 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:14:09 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9bbe5ae-e7c2-44eb-9fda-16c468c193d0]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:14:09 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:14:09 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:14:09 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[30b7334b-d4c3-4c00-a87f-7df6c161485e]: (4, ('ok\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:14:09 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-8ddc0ce5-150b-404b-8581-cd24594a9c56 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Flushing IO for device /dev/sdc {{(pid=71509) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 11:14:09 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:14:09 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:14:09 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[0433e5bc-0ef8-46b8-8733-bd8feb175498]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:14:09 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-8ddc0ce5-150b-404b-8581-cd24594a9c56 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71509) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 11:14:09 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:14:09 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.053s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:14:09 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff58b5fb-1481-451d-bfe9-3e979629b5bd]: (4, ('1', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:14:09 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-8ddc0ce5-150b-404b-8581-cd24594a9c56 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71509) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 11:14:09 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-8ddc0ce5-150b-404b-8581-cd24594a9c56 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] SCSI volumes sdc have been removed. {{(pid=71509) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 11:14:09 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ddc0ce5-150b-404b-8581-cd24594a9c56 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b6eae10c-5695-41f5-8511-7a5bbc598367')] {{(pid=71509) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 11:14:09 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6eae10c-5695-41f5-8511-7a5bbc598367 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:14:09 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6eae10c-5695-41f5-8511-7a5bbc598367 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:14:09 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[981ad0aa-6f4f-4fe6-a59a-06f7db2a0081]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:14:09 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ddc0ce5-150b-404b-8581-cd24594a9c56 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:14:09 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6eae10c-5695-41f5-8511-7a5bbc598367 -p 172.16.0.220:3260 --logout {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:14:10 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6eae10c-5695-41f5-8511-7a5bbc598367 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:14:10 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[4928ff6f-8d76-42f1-8c30-dbb1ff5ef1d6]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:b6eae10c-5695-41f5-8511-7a5bbc598367, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:b6eae10c-5695-41f5-8511-7a5bbc598367, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:14:10 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ddc0ce5-150b-404b-8581-cd24594a9c56 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:b6eae10c-5695-41f5-8511-7a5bbc598367, portal: 172.16.0.220,3260]
Apr 14 11:14:10 user nova-compute[71509]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:b6eae10c-5695-41f5-8511-7a5bbc598367, portal: 172.16.0.220,3260] successful.
Apr 14 11:14:10 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:14:10 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6eae10c-5695-41f5-8511-7a5bbc598367 -p 172.16.0.220:3260 --op delete {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:14:10 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6eae10c-5695-41f5-8511-7a5bbc598367 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:14:10 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc000c61-d190-40cf-a358-bb969d5a14f7]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:14:10 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ddc0ce5-150b-404b-8581-cd24594a9c56 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:14:10 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-8ddc0ce5-150b-404b-8581-cd24594a9c56 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.298s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 11:14:10 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ddc0ce5-150b-404b-8581-cd24594a9c56 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] <== disconnect_volume: return (299ms) None {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 11:14:10 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ddc0ce5-150b-404b-8581-cd24594a9c56 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 434ec83b-ca3c-446e-a63b-f130ceaf8e91] Disconnected iSCSI Volume {{(pid=71509) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 11:14:10 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-8ddc0ce5-150b-404b-8581-cd24594a9c56 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 434ec83b-ca3c-446e-a63b-f130ceaf8e91] Deleting instance files /opt/stack/data/nova/instances/434ec83b-ca3c-446e-a63b-f130ceaf8e91_del
Apr 14 11:14:10 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-8ddc0ce5-150b-404b-8581-cd24594a9c56 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 434ec83b-ca3c-446e-a63b-f130ceaf8e91] Deletion of /opt/stack/data/nova/instances/434ec83b-ca3c-446e-a63b-f130ceaf8e91_del complete
Apr 14 11:14:10 user nova-compute[71509]: INFO nova.compute.manager [None req-8ddc0ce5-150b-404b-8581-cd24594a9c56 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 434ec83b-ca3c-446e-a63b-f130ceaf8e91] Took 1.17 seconds to destroy the instance on the hypervisor.
Apr 14 11:14:10 user nova-compute[71509]: DEBUG oslo.service.loopingcall [None req-8ddc0ce5-150b-404b-8581-cd24594a9c56 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71509) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 11:14:10 user nova-compute[71509]: DEBUG nova.compute.manager [-] [instance: 434ec83b-ca3c-446e-a63b-f130ceaf8e91] Deallocating network for instance {{(pid=71509) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 11:14:10 user nova-compute[71509]: DEBUG nova.network.neutron [-] [instance: 434ec83b-ca3c-446e-a63b-f130ceaf8e91] deallocate_for_instance() {{(pid=71509) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 11:14:10 user nova-compute[71509]: DEBUG nova.network.neutron [-] [instance: 434ec83b-ca3c-446e-a63b-f130ceaf8e91] Updating instance_info_cache with network_info: [] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:14:10 user nova-compute[71509]: INFO nova.compute.manager [-] [instance: 434ec83b-ca3c-446e-a63b-f130ceaf8e91] Took 0.50 seconds to deallocate network for instance.
Apr 14 11:14:11 user nova-compute[71509]: INFO nova.compute.manager [None req-8ddc0ce5-150b-404b-8581-cd24594a9c56 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 434ec83b-ca3c-446e-a63b-f130ceaf8e91] Took 0.77 seconds to detach 1 volumes for instance.
Apr 14 11:14:11 user nova-compute[71509]: DEBUG nova.compute.manager [None req-8ddc0ce5-150b-404b-8581-cd24594a9c56 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 434ec83b-ca3c-446e-a63b-f130ceaf8e91] Deleting volume: b6eae10c-5695-41f5-8511-7a5bbc598367 {{(pid=71509) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3202}}
Apr 14 11:14:11 user nova-compute[71509]: DEBUG nova.compute.manager [req-cdfb4ab9-e23d-48ce-8e8a-52133c15f121 req-b9f924e4-5d67-483e-86fb-c284a06f470b service nova] [instance: 434ec83b-ca3c-446e-a63b-f130ceaf8e91] Received event network-vif-plugged-dd3954c8-cff9-4d50-a4bb-63365524ac72 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:14:11 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-cdfb4ab9-e23d-48ce-8e8a-52133c15f121 req-b9f924e4-5d67-483e-86fb-c284a06f470b service nova] Acquiring lock "434ec83b-ca3c-446e-a63b-f130ceaf8e91-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:14:11 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-cdfb4ab9-e23d-48ce-8e8a-52133c15f121 req-b9f924e4-5d67-483e-86fb-c284a06f470b service nova] Lock "434ec83b-ca3c-446e-a63b-f130ceaf8e91-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:14:11 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-cdfb4ab9-e23d-48ce-8e8a-52133c15f121 req-b9f924e4-5d67-483e-86fb-c284a06f470b service nova] Lock "434ec83b-ca3c-446e-a63b-f130ceaf8e91-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:14:11 user nova-compute[71509]: DEBUG nova.compute.manager [req-cdfb4ab9-e23d-48ce-8e8a-52133c15f121 req-b9f924e4-5d67-483e-86fb-c284a06f470b service nova] [instance: 434ec83b-ca3c-446e-a63b-f130ceaf8e91] No waiting events found dispatching network-vif-plugged-dd3954c8-cff9-4d50-a4bb-63365524ac72 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:14:11 user nova-compute[71509]: WARNING nova.compute.manager [req-cdfb4ab9-e23d-48ce-8e8a-52133c15f121 req-b9f924e4-5d67-483e-86fb-c284a06f470b service nova] [instance: 434ec83b-ca3c-446e-a63b-f130ceaf8e91] Received unexpected event network-vif-plugged-dd3954c8-cff9-4d50-a4bb-63365524ac72 for instance with vm_state active and task_state deleting.
Apr 14 11:14:11 user nova-compute[71509]: DEBUG nova.compute.manager [req-cdfb4ab9-e23d-48ce-8e8a-52133c15f121 req-b9f924e4-5d67-483e-86fb-c284a06f470b service nova] [instance: 434ec83b-ca3c-446e-a63b-f130ceaf8e91] Received event network-vif-deleted-dd3954c8-cff9-4d50-a4bb-63365524ac72 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:14:11 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-8ddc0ce5-150b-404b-8581-cd24594a9c56 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:14:11 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-8ddc0ce5-150b-404b-8581-cd24594a9c56 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:14:11 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-8ddc0ce5-150b-404b-8581-cd24594a9c56 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 11:14:11 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-8ddc0ce5-150b-404b-8581-cd24594a9c56 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 11:14:11 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-8ddc0ce5-150b-404b-8581-cd24594a9c56 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.119s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:14:11 user nova-compute[71509]: INFO nova.scheduler.client.report [None req-8ddc0ce5-150b-404b-8581-cd24594a9c56 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Deleted allocations for instance 434ec83b-ca3c-446e-a63b-f130ceaf8e91
Apr 14 11:14:11 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-8ddc0ce5-150b-404b-8581-cd24594a9c56 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "434ec83b-ca3c-446e-a63b-f130ceaf8e91" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.817s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:14:12 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:14:12 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Starting heal instance info cache {{(pid=71509) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 11:14:12 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Rebuilding the list of instances to heal {{(pid=71509) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 11:14:12 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Didn't find any instances for network info cache update. {{(pid=71509) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 14 11:14:14 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:14:19 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:14:24 user nova-compute[71509]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681470849.7197032, 434ec83b-ca3c-446e-a63b-f130ceaf8e91 => Stopped> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 11:14:24 user nova-compute[71509]: INFO nova.compute.manager [-] [instance: 434ec83b-ca3c-446e-a63b-f130ceaf8e91] VM Stopped (Lifecycle Event)
Apr 14 11:14:24 user nova-compute[71509]: DEBUG nova.compute.manager [None req-7e5e3aa9-5907-4292-ac7b-6bcbeda0a1a0 None None] [instance: 434ec83b-ca3c-446e-a63b-f130ceaf8e91] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 11:14:24 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:14:29 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:14:34 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:14:39 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:14:39 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:14:39 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71509) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 11:14:39 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71509) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 11:14:39 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71509) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 11:14:39 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:14:44 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:14:49 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:14:49 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:14:49 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71509) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 11:14:49 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71509) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 11:14:49 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71509) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 11:14:49 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:14:51 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:14:51 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71509) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 11:14:53 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:14:54 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:14:57 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:14:57 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:14:57 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:14:59 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:14:59 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:15:02 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:15:04 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:15:04 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:15:05 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-72f40350-f1b2-42f3-b138-45872a644274 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "3c4d3f81-5c17-4116-819b-84cefb35336f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:15:05 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-72f40350-f1b2-42f3-b138-45872a644274 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "3c4d3f81-5c17-4116-819b-84cefb35336f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:15:06 user nova-compute[71509]: DEBUG nova.compute.manager [None req-72f40350-f1b2-42f3-b138-45872a644274 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 3c4d3f81-5c17-4116-819b-84cefb35336f] Starting instance... {{(pid=71509) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 11:15:06 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-72f40350-f1b2-42f3-b138-45872a644274 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:15:06 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-72f40350-f1b2-42f3-b138-45872a644274 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:15:06 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-72f40350-f1b2-42f3-b138-45872a644274 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71509) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 11:15:06 user nova-compute[71509]: INFO nova.compute.claims [None req-72f40350-f1b2-42f3-b138-45872a644274 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 3c4d3f81-5c17-4116-819b-84cefb35336f] Claim successful on node user
Apr 14 11:15:06 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-72f40350-f1b2-42f3-b138-45872a644274 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 11:15:06 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-72f40350-f1b2-42f3-b138-45872a644274 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 11:15:06 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-72f40350-f1b2-42f3-b138-45872a644274 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.188s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:15:06 user nova-compute[71509]: DEBUG nova.compute.manager [None req-72f40350-f1b2-42f3-b138-45872a644274 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 3c4d3f81-5c17-4116-819b-84cefb35336f] Start building networks asynchronously for instance. {{(pid=71509) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 11:15:06 user nova-compute[71509]: DEBUG nova.compute.manager [None req-72f40350-f1b2-42f3-b138-45872a644274 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 3c4d3f81-5c17-4116-819b-84cefb35336f] Allocating IP information in the background. {{(pid=71509) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 11:15:06 user nova-compute[71509]: DEBUG nova.network.neutron [None req-72f40350-f1b2-42f3-b138-45872a644274 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 3c4d3f81-5c17-4116-819b-84cefb35336f] allocate_for_instance() {{(pid=71509) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 11:15:06 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-72f40350-f1b2-42f3-b138-45872a644274 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 3c4d3f81-5c17-4116-819b-84cefb35336f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 11:15:06 user nova-compute[71509]: DEBUG nova.compute.manager [None req-72f40350-f1b2-42f3-b138-45872a644274 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 3c4d3f81-5c17-4116-819b-84cefb35336f] Start building block device mappings for instance. {{(pid=71509) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 11:15:06 user nova-compute[71509]: INFO nova.virt.block_device [None req-72f40350-f1b2-42f3-b138-45872a644274 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 3c4d3f81-5c17-4116-819b-84cefb35336f] Booting with volume 3dfb7018-b582-43c0-b9b5-f58822b9b5c6 at /dev/vda
Apr 14 11:15:06 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:15:06 user nova-compute[71509]: DEBUG nova.policy [None req-72f40350-f1b2-42f3-b138-45872a644274 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c7644d02bc784e4fb74ebaaceb3affe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e7089cb52574f1daf7f578222bb7a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71509) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 11:15:06 user nova-compute[71509]: DEBUG os_brick.utils [None req-72f40350-f1b2-42f3-b138-45872a644274 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 11:15:06 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:15:06 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:15:06 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[71f37aba-5b53-4db1-b2c1-f833d7365828]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50119df3c417\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:15:06 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:15:06 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:15:06 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[758ed556-4a34-4b74-8844-067c699bc0d0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:15:06 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:15:06 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:15:06 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[40d43f13-3a81-4dff-8311-f6ea2d45aa5b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:15:06 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e081606-67d6-4f5b-b5e6-cede28c9dc99]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:15:06 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-72f40350-f1b2-42f3-b138-45872a644274 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Running cmd (subprocess): nvme version {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:15:06 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-72f40350-f1b2-42f3-b138-45872a644274 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] 'nvme version' failed. Not Retrying. {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 11:15:06 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.nvmeof [None req-72f40350-f1b2-42f3-b138-45872a644274 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] nvme not present on system {{(pid=71509) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 11:15:06 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:15:06 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 11:15:06 user nova-compute[71509]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 11:15:06 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[57cb3521-0f6b-44ba-955b-ff5e6e4671e5]: (4, '') {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:15:06 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-72f40350-f1b2-42f3-b138-45872a644274 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71509) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 11:15:06 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-72f40350-f1b2-42f3-b138-45872a644274 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71509) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 11:15:06 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-72f40350-f1b2-42f3-b138-45872a644274 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] LIGHTOS: no hostnqn found. {{(pid=71509) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 11:15:06 user nova-compute[71509]: DEBUG os_brick.utils [None req-72f40350-f1b2-42f3-b138-45872a644274 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50119df3c417', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 11:15:06 user nova-compute[71509]: DEBUG nova.virt.block_device [None req-72f40350-f1b2-42f3-b138-45872a644274 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 3c4d3f81-5c17-4116-819b-84cefb35336f] Updating existing volume attachment record: 09e94c8c-206e-4845-b211-ddf0f012396a {{(pid=71509) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 11:15:07 user nova-compute[71509]: DEBUG nova.network.neutron [None req-72f40350-f1b2-42f3-b138-45872a644274 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 3c4d3f81-5c17-4116-819b-84cefb35336f] Successfully created port: f93da95e-422e-44f2-97c7-d99b7fd6df87 {{(pid=71509) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 11:15:07 user nova-compute[71509]: DEBUG nova.network.neutron [None req-72f40350-f1b2-42f3-b138-45872a644274 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 3c4d3f81-5c17-4116-819b-84cefb35336f] Successfully updated port: f93da95e-422e-44f2-97c7-d99b7fd6df87 {{(pid=71509) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 11:15:07 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-72f40350-f1b2-42f3-b138-45872a644274 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "refresh_cache-3c4d3f81-5c17-4116-819b-84cefb35336f" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 11:15:07 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-72f40350-f1b2-42f3-b138-45872a644274 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquired lock "refresh_cache-3c4d3f81-5c17-4116-819b-84cefb35336f" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 11:15:07 user nova-compute[71509]: DEBUG nova.network.neutron [None req-72f40350-f1b2-42f3-b138-45872a644274 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 3c4d3f81-5c17-4116-819b-84cefb35336f] Building network info cache for instance {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 11:15:07 user nova-compute[71509]: DEBUG nova.compute.manager [req-3129d68d-e705-4efb-b0a3-ff651906a2d8 req-921ff330-3fa7-4dc8-becd-3ff49ce9b9b5 service nova] [instance: 3c4d3f81-5c17-4116-819b-84cefb35336f] Received event network-changed-f93da95e-422e-44f2-97c7-d99b7fd6df87 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:15:07 user nova-compute[71509]: DEBUG nova.compute.manager [req-3129d68d-e705-4efb-b0a3-ff651906a2d8 req-921ff330-3fa7-4dc8-becd-3ff49ce9b9b5 service nova] [instance: 3c4d3f81-5c17-4116-819b-84cefb35336f] Refreshing instance network info cache due to event network-changed-f93da95e-422e-44f2-97c7-d99b7fd6df87. {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 11:15:07 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-3129d68d-e705-4efb-b0a3-ff651906a2d8 req-921ff330-3fa7-4dc8-becd-3ff49ce9b9b5 service nova] Acquiring lock "refresh_cache-3c4d3f81-5c17-4116-819b-84cefb35336f" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 11:15:07 user nova-compute[71509]: DEBUG nova.network.neutron [None req-72f40350-f1b2-42f3-b138-45872a644274 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 3c4d3f81-5c17-4116-819b-84cefb35336f] Instance cache missing network info. {{(pid=71509) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 11:15:08 user nova-compute[71509]: DEBUG nova.network.neutron [None req-72f40350-f1b2-42f3-b138-45872a644274 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 3c4d3f81-5c17-4116-819b-84cefb35336f] Updating instance_info_cache with network_info: [{"id": "f93da95e-422e-44f2-97c7-d99b7fd6df87", "address": "fa:16:3e:a5:6a:47", "network": {"id": "6d6b6b35-b5ef-4d7c-abce-cad21cc99e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-878222456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e7089cb52574f1daf7f578222bb7a67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf93da95e-42", "ovs_interfaceid": "f93da95e-422e-44f2-97c7-d99b7fd6df87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:15:08 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-72f40350-f1b2-42f3-b138-45872a644274 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Releasing lock "refresh_cache-3c4d3f81-5c17-4116-819b-84cefb35336f" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 11:15:08 user nova-compute[71509]: DEBUG nova.compute.manager [None req-72f40350-f1b2-42f3-b138-45872a644274 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 3c4d3f81-5c17-4116-819b-84cefb35336f] Instance network_info: |[{"id": "f93da95e-422e-44f2-97c7-d99b7fd6df87", "address": "fa:16:3e:a5:6a:47", "network": {"id": "6d6b6b35-b5ef-4d7c-abce-cad21cc99e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-878222456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e7089cb52574f1daf7f578222bb7a67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf93da95e-42", "ovs_interfaceid": "f93da95e-422e-44f2-97c7-d99b7fd6df87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71509) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 11:15:08 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-3129d68d-e705-4efb-b0a3-ff651906a2d8 req-921ff330-3fa7-4dc8-becd-3ff49ce9b9b5 service nova] Acquired lock "refresh_cache-3c4d3f81-5c17-4116-819b-84cefb35336f" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 11:15:08 user nova-compute[71509]: DEBUG nova.network.neutron [req-3129d68d-e705-4efb-b0a3-ff651906a2d8 req-921ff330-3fa7-4dc8-becd-3ff49ce9b9b5 service nova] [instance: 3c4d3f81-5c17-4116-819b-84cefb35336f] Refreshing network info cache for port f93da95e-422e-44f2-97c7-d99b7fd6df87 {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 11:15:08 user nova-compute[71509]: DEBUG nova.network.neutron [req-3129d68d-e705-4efb-b0a3-ff651906a2d8 req-921ff330-3fa7-4dc8-becd-3ff49ce9b9b5 service nova] [instance: 3c4d3f81-5c17-4116-819b-84cefb35336f] Updated VIF entry in instance network info cache for port f93da95e-422e-44f2-97c7-d99b7fd6df87. {{(pid=71509) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 11:15:08 user nova-compute[71509]: DEBUG nova.network.neutron [req-3129d68d-e705-4efb-b0a3-ff651906a2d8 req-921ff330-3fa7-4dc8-becd-3ff49ce9b9b5 service nova] [instance: 3c4d3f81-5c17-4116-819b-84cefb35336f] Updating instance_info_cache with network_info: [{"id": "f93da95e-422e-44f2-97c7-d99b7fd6df87", "address": "fa:16:3e:a5:6a:47", "network": {"id": "6d6b6b35-b5ef-4d7c-abce-cad21cc99e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-878222456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e7089cb52574f1daf7f578222bb7a67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf93da95e-42", "ovs_interfaceid": "f93da95e-422e-44f2-97c7-d99b7fd6df87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:15:08 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-3129d68d-e705-4efb-b0a3-ff651906a2d8 req-921ff330-3fa7-4dc8-becd-3ff49ce9b9b5 service nova] Releasing lock "refresh_cache-3c4d3f81-5c17-4116-819b-84cefb35336f" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 11:15:09 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:15:10 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:15:10 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:15:10 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:15:10 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:15:10 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Auditing locally available compute resources for user (node: user) {{(pid=71509) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 11:15:10 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 11:15:10 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 11:15:10 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Hypervisor/Node resource view: name=user free_ram=8870MB free_disk=25.95937728881836GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71509) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 11:15:10 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:15:10 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:15:10 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 3c4d3f81-5c17-4116-819b-84cefb35336f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 11:15:10 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71509) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 11:15:10 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71509) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 11:15:11 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 11:15:11 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 11:15:11 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Compute_service record updated for user:user {{(pid=71509) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 11:15:11 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.182s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:15:12 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:15:12 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Starting heal instance info cache {{(pid=71509) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 11:15:12 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Rebuilding the list of instances to heal {{(pid=71509) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 11:15:12 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] [instance: 3c4d3f81-5c17-4116-819b-84cefb35336f] Skipping network cache update for instance because it is Building. {{(pid=71509) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9805}}
Apr 14 11:15:12 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Didn't find any instances for network info cache update. {{(pid=71509) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 14 11:15:13 user nova-compute[71509]: DEBUG nova.compute.manager [None req-72f40350-f1b2-42f3-b138-45872a644274 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 3c4d3f81-5c17-4116-819b-84cefb35336f] Start spawning the instance on the hypervisor. {{(pid=71509) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 11:15:13 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-72f40350-f1b2-42f3-b138-45872a644274 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 3c4d3f81-5c17-4116-819b-84cefb35336f] Creating instance directory {{(pid=71509) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 11:15:13 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-72f40350-f1b2-42f3-b138-45872a644274 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 3c4d3f81-5c17-4116-819b-84cefb35336f] Creating image(s)
Apr 14 11:15:13 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-72f40350-f1b2-42f3-b138-45872a644274 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 3c4d3f81-5c17-4116-819b-84cefb35336f] Did not create local disks {{(pid=71509) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 11:15:13 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-72f40350-f1b2-42f3-b138-45872a644274 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 3c4d3f81-5c17-4116-819b-84cefb35336f] Ensure instance console log exists: /opt/stack/data/nova/instances/3c4d3f81-5c17-4116-819b-84cefb35336f/console.log {{(pid=71509) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 11:15:13 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-72f40350-f1b2-42f3-b138-45872a644274 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:15:13 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-72f40350-f1b2-42f3-b138-45872a644274 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:15:13 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-72f40350-f1b2-42f3-b138-45872a644274 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:15:13 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-72f40350-f1b2-42f3-b138-45872a644274 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 3c4d3f81-5c17-4116-819b-84cefb35336f] Start _get_guest_xml network_info=[{"id": "f93da95e-422e-44f2-97c7-d99b7fd6df87", "address": "fa:16:3e:a5:6a:47", "network": {"id": "6d6b6b35-b5ef-4d7c-abce-cad21cc99e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-878222456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e7089cb52574f1daf7f578222bb7a67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf93da95e-42", "ovs_interfaceid": "f93da95e-422e-44f2-97c7-d99b7fd6df87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'attachment_id': '09e94c8c-206e-4845-b211-ddf0f012396a', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3dfb7018-b582-43c0-b9b5-f58822b9b5c6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jHsTtaBE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3c4d3f81-5c17-4116-819b-84cefb35336f', 'attached_at': '', 'detached_at': '', 'volume_id': '3dfb7018-b582-43c0-b9b5-f58822b9b5c6', 'serial': '3dfb7018-b582-43c0-b9b5-f58822b9b5c6'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'volume_type': None} {{(pid=71509) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 11:15:13 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-72f40350-f1b2-42f3-b138-45872a644274 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 11:15:13 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-72f40350-f1b2-42f3-b138-45872a644274 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 11:15:13 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-72f40350-f1b2-42f3-b138-45872a644274 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71509) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 11:15:13 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-72f40350-f1b2-42f3-b138-45872a644274 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T10:40:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 11:15:13 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-72f40350-f1b2-42f3-b138-45872a644274 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Flavor limits 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 11:15:13 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-72f40350-f1b2-42f3-b138-45872a644274 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Image limits 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 11:15:13 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-72f40350-f1b2-42f3-b138-45872a644274 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Flavor pref 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 11:15:13 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-72f40350-f1b2-42f3-b138-45872a644274 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Image pref 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 11:15:13 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-72f40350-f1b2-42f3-b138-45872a644274 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 11:15:13 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-72f40350-f1b2-42f3-b138-45872a644274 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 11:15:13 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-72f40350-f1b2-42f3-b138-45872a644274 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71509) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 11:15:13 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-72f40350-f1b2-42f3-b138-45872a644274 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Got 1 possible topologies {{(pid=71509) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 11:15:13 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-72f40350-f1b2-42f3-b138-45872a644274 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 11:15:13 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-72f40350-f1b2-42f3-b138-45872a644274 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 11:15:13 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-72f40350-f1b2-42f3-b138-45872a644274 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 3c4d3f81-5c17-4116-819b-84cefb35336f] Calling os-brick to attach iSCSI Volume {{(pid=71509) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 11:15:13 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-72f40350-f1b2-42f3-b138-45872a644274 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0bf0749390>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3dfb7018-b582-43c0-b9b5-f58822b9b5c6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jHsTtaBE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 11:15:13 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-72f40350-f1b2-42f3-b138-45872a644274 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 11:15:13 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-72f40350-f1b2-42f3-b138-45872a644274 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 11:15:13 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-72f40350-f1b2-42f3-b138-45872a644274 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 11:15:13 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-72f40350-f1b2-42f3-b138-45872a644274 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 11:15:13 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-72f40350-f1b2-42f3-b138-45872a644274 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3dfb7018-b582-43c0-b9b5-f58822b9b5c6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 11:15:13 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-72f40350-f1b2-42f3-b138-45872a644274 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3dfb7018-b582-43c0-b9b5-f58822b9b5c6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 11:15:13 user nova-compute[71509]: INFO os_brick.initiator.connectors.iscsi [None req-72f40350-f1b2-42f3-b138-45872a644274 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 11:15:13 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3dfb7018-b582-43c0-b9b5-f58822b9b5c6 -p 172.16.0.220:3260 {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:15:13 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3dfb7018-b582-43c0-b9b5-f58822b9b5c6 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:15:13 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ff5df38-fe71-4be5-9ae5-a277984dbc64]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:15:13 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-72f40350-f1b2-42f3-b138-45872a644274 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 11:15:13 user nova-compute[71509]:  {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:15:13 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3dfb7018-b582-43c0-b9b5-f58822b9b5c6 -p 172.16.0.220:3260 --interface default --op new {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:15:13 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3dfb7018-b582-43c0-b9b5-f58822b9b5c6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:15:13 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7249586-9950-44fa-b394-9b59f9c21f7f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3dfb7018-b582-43c0-b9b5-f58822b9b5c6] added\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:15:13 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-72f40350-f1b2-42f3-b138-45872a644274 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3dfb7018-b582-43c0-b9b5-f58822b9b5c6] added
Apr 14 11:15:13 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:15:13 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3dfb7018-b582-43c0-b9b5-f58822b9b5c6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:15:13 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3dfb7018-b582-43c0-b9b5-f58822b9b5c6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:15:13 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fa48e42-6283-49c4-acd6-8da323bb5533]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:15:13 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-72f40350-f1b2-42f3-b138-45872a644274 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:15:13 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3dfb7018-b582-43c0-b9b5-f58822b9b5c6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:15:13 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3dfb7018-b582-43c0-b9b5-f58822b9b5c6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:15:13 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bd4bc46-31a5-46b6-8697-7aeb0d48993c]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:15:13 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-72f40350-f1b2-42f3-b138-45872a644274 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:15:13 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3dfb7018-b582-43c0-b9b5-f58822b9b5c6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jHsTtaBE {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:15:13 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3dfb7018-b582-43c0-b9b5-f58822b9b5c6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jHsTtaBE" returned: 0 in 0.017s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:15:13 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[144e48b1-aae2-4627-8a8f-8de24eb24294]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:15:13 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-72f40350-f1b2-42f3-b138-45872a644274 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jHsTtaBE'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:15:13 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3dfb7018-b582-43c0-b9b5-f58822b9b5c6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:15:13 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3dfb7018-b582-43c0-b9b5-f58822b9b5c6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:15:13 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[e19be235-2bff-4924-b0c2-9b8305784cfa]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:15:13 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-72f40350-f1b2-42f3-b138-45872a644274 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:15:13 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:15:13 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:15:13 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[b081b1e2-bbb8-42e6-91c6-e0c0ad6eff83]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:15:13 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-72f40350-f1b2-42f3-b138-45872a644274 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 14 11:15:13 user nova-compute[71509]:  {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 11:15:13 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-72f40350-f1b2-42f3-b138-45872a644274 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 14 11:15:13 user nova-compute[71509]:  {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 11:15:13 user nova-compute[71509]: WARNING os_brick.initiator.connectors.iscsi [None req-72f40350-f1b2-42f3-b138-45872a644274 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 14 11:15:13 user nova-compute[71509]: 
Apr 14 11:15:13 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3dfb7018-b582-43c0-b9b5-f58822b9b5c6 -p 172.16.0.220:3260 --login {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:15:13 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3dfb7018-b582-43c0-b9b5-f58822b9b5c6 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:15:13 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[40f8100b-1224-4ba5-a285-c4ee35aaca47]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3dfb7018-b582-43c0-b9b5-f58822b9b5c6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3dfb7018-b582-43c0-b9b5-f58822b9b5c6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:15:13 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-72f40350-f1b2-42f3-b138-45872a644274 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3dfb7018-b582-43c0-b9b5-f58822b9b5c6, portal: 172.16.0.220,3260]
Apr 14 11:15:13 user nova-compute[71509]: Login to [iface: default, target: iqn.2010-10.org.openstack:3dfb7018-b582-43c0-b9b5-f58822b9b5c6, portal: 172.16.0.220,3260] successful.
Apr 14 11:15:13 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:15:13 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3dfb7018-b582-43c0-b9b5-f58822b9b5c6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:15:13 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3dfb7018-b582-43c0-b9b5-f58822b9b5c6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:15:13 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[7197383e-9e3f-450f-83b9-9f85c52de5fd]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:15:13 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-72f40350-f1b2-42f3-b138-45872a644274 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:15:13 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:15:13 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:15:13 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eeddf25-99d4-4e81-a7d5-090b5daf945b]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dfb7018-b582-43c0-b9b5-f58822b9b5c6 (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:15:13 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-72f40350-f1b2-42f3-b138-45872a644274 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dfb7018-b582-43c0-b9b5-f58822b9b5c6 (non-flash)
Apr 14 11:15:13 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 11:15:13 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-72f40350-f1b2-42f3-b138-45872a644274 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dfb7018-b582-43c0-b9b5-f58822b9b5c6 (non-flash)
Apr 14 11:15:13 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 11:15:13 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-72f40350-f1b2-42f3-b138-45872a644274 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3dfb7018-b582-43c0-b9b5-f58822b9b5c6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.244s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 11:15:13 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-72f40350-f1b2-42f3-b138-45872a644274 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Connected to 172.16.0.220:3260 {{(pid=71509) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 11:15:13 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-72f40350-f1b2-42f3-b138-45872a644274 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] HCTL ('33', '-', '-', 0) found on session 52 with lun 0 {{(pid=71509) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 11:15:13 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-72f40350-f1b2-42f3-b138-45872a644274 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71509) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 11:15:13 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:15:13 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:15:13 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[37f04aa2-8888-4a36-ad10-29636cf1b1be]: (4, ('- - 0', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:15:13 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-72f40350-f1b2-42f3-b138-45872a644274 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71509) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 11:15:13 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-72f40350-f1b2-42f3-b138-45872a644274 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3dfb7018-b582-43c0-b9b5-f58822b9b5c6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jHsTtaBE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71509) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 11:15:14 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-72f40350-f1b2-42f3-b138-45872a644274 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.273s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 11:15:14 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-72f40350-f1b2-42f3-b138-45872a644274 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] <== connect_volume: return (1274ms) {'type': 'block', 'scsi_wwn': '23663383439623332', 'path': '/dev/sdb'} {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 11:15:14 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-72f40350-f1b2-42f3-b138-45872a644274 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 3c4d3f81-5c17-4116-819b-84cefb35336f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23663383439623332', 'path': '/dev/sdb'} {{(pid=71509) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 11:15:14 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-72f40350-f1b2-42f3-b138-45872a644274 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T11:15:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1896883992',display_name='tempest-TestVolumeBootPattern-server-1896883992',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1896883992',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBafeRTei9AGsMhDE/c+DnIhp7w6x54r1wV/PnusBRf64WHX2LZne4yrEE3WXFq7Jmo1e2MZSS8o0Igq9Iy9JMCogkqExXP7DS8p2/L3yNdO3UPcBKE6h/z0FEi5FWn3lg==',key_name='tempest-TestVolumeBootPattern-994193383',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e7089cb52574f1daf7f578222bb7a67',ramdisk_id='',reservation_id='r-8rpux0yc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-193101874',owner_user_name='tempest-TestVolumeBootPattern-193101874-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T11:15:06Z,user_data=None,user_id='c7644d02bc784e4fb74ebaaceb3affe1',uuid=3c4d3f81-5c17-4116-819b-84cefb35336f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f93da95e-422e-44f2-97c7-d99b7fd6df87", "address": "fa:16:3e:a5:6a:47", "network": {"id": "6d6b6b35-b5ef-4d7c-abce-cad21cc99e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-878222456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e7089cb52574f1daf7f578222bb7a67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf93da95e-42", "ovs_interfaceid": "f93da95e-422e-44f2-97c7-d99b7fd6df87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71509) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 11:15:14 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-72f40350-f1b2-42f3-b138-45872a644274 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Converting VIF {"id": "f93da95e-422e-44f2-97c7-d99b7fd6df87", "address": "fa:16:3e:a5:6a:47", "network": {"id": "6d6b6b35-b5ef-4d7c-abce-cad21cc99e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-878222456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e7089cb52574f1daf7f578222bb7a67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf93da95e-42", "ovs_interfaceid": "f93da95e-422e-44f2-97c7-d99b7fd6df87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 11:15:14 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-72f40350-f1b2-42f3-b138-45872a644274 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:6a:47,bridge_name='br-int',has_traffic_filtering=True,id=f93da95e-422e-44f2-97c7-d99b7fd6df87,network=Network(6d6b6b35-b5ef-4d7c-abce-cad21cc99e32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf93da95e-42') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 11:15:14 user nova-compute[71509]: DEBUG nova.objects.instance [None req-72f40350-f1b2-42f3-b138-45872a644274 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lazy-loading 'pci_devices' on Instance uuid 3c4d3f81-5c17-4116-819b-84cefb35336f {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 11:15:14 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-72f40350-f1b2-42f3-b138-45872a644274 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 3c4d3f81-5c17-4116-819b-84cefb35336f] End _get_guest_xml xml=<domain type="kvm">
Apr 14 11:15:14 user nova-compute[71509]:   <uuid>3c4d3f81-5c17-4116-819b-84cefb35336f</uuid>
Apr 14 11:15:14 user nova-compute[71509]:   <name>instance-0000002d</name>
Apr 14 11:15:14 user nova-compute[71509]:   <memory>131072</memory>
Apr 14 11:15:14 user nova-compute[71509]:   <vcpu>1</vcpu>
Apr 14 11:15:14 user nova-compute[71509]:   <metadata>
Apr 14 11:15:14 user nova-compute[71509]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 11:15:14 user nova-compute[71509]:       <nova:package version="0.0.0"/>
Apr 14 11:15:14 user nova-compute[71509]:       <nova:name>tempest-TestVolumeBootPattern-server-1896883992</nova:name>
Apr 14 11:15:14 user nova-compute[71509]:       <nova:creationTime>2023-04-14 11:15:13</nova:creationTime>
Apr 14 11:15:14 user nova-compute[71509]:       <nova:flavor name="m1.nano">
Apr 14 11:15:14 user nova-compute[71509]:         <nova:memory>128</nova:memory>
Apr 14 11:15:14 user nova-compute[71509]:         <nova:disk>1</nova:disk>
Apr 14 11:15:14 user nova-compute[71509]:         <nova:swap>0</nova:swap>
Apr 14 11:15:14 user nova-compute[71509]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 11:15:14 user nova-compute[71509]:         <nova:vcpus>1</nova:vcpus>
Apr 14 11:15:14 user nova-compute[71509]:       </nova:flavor>
Apr 14 11:15:14 user nova-compute[71509]:       <nova:owner>
Apr 14 11:15:14 user nova-compute[71509]:         <nova:user uuid="c7644d02bc784e4fb74ebaaceb3affe1">tempest-TestVolumeBootPattern-193101874-project-member</nova:user>
Apr 14 11:15:14 user nova-compute[71509]:         <nova:project uuid="2e7089cb52574f1daf7f578222bb7a67">tempest-TestVolumeBootPattern-193101874</nova:project>
Apr 14 11:15:14 user nova-compute[71509]:       </nova:owner>
Apr 14 11:15:14 user nova-compute[71509]:       <nova:ports>
Apr 14 11:15:14 user nova-compute[71509]:         <nova:port uuid="f93da95e-422e-44f2-97c7-d99b7fd6df87">
Apr 14 11:15:14 user nova-compute[71509]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Apr 14 11:15:14 user nova-compute[71509]:         </nova:port>
Apr 14 11:15:14 user nova-compute[71509]:       </nova:ports>
Apr 14 11:15:14 user nova-compute[71509]:     </nova:instance>
Apr 14 11:15:14 user nova-compute[71509]:   </metadata>
Apr 14 11:15:14 user nova-compute[71509]:   <sysinfo type="smbios">
Apr 14 11:15:14 user nova-compute[71509]:     <system>
Apr 14 11:15:14 user nova-compute[71509]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 11:15:14 user nova-compute[71509]:       <entry name="product">OpenStack Nova</entry>
Apr 14 11:15:14 user nova-compute[71509]:       <entry name="version">0.0.0</entry>
Apr 14 11:15:14 user nova-compute[71509]:       <entry name="serial">3c4d3f81-5c17-4116-819b-84cefb35336f</entry>
Apr 14 11:15:14 user nova-compute[71509]:       <entry name="uuid">3c4d3f81-5c17-4116-819b-84cefb35336f</entry>
Apr 14 11:15:14 user nova-compute[71509]:       <entry name="family">Virtual Machine</entry>
Apr 14 11:15:14 user nova-compute[71509]:     </system>
Apr 14 11:15:14 user nova-compute[71509]:   </sysinfo>
Apr 14 11:15:14 user nova-compute[71509]:   <os>
Apr 14 11:15:14 user nova-compute[71509]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 11:15:14 user nova-compute[71509]:     <boot dev="hd"/>
Apr 14 11:15:14 user nova-compute[71509]:     <smbios mode="sysinfo"/>
Apr 14 11:15:14 user nova-compute[71509]:   </os>
Apr 14 11:15:14 user nova-compute[71509]:   <features>
Apr 14 11:15:14 user nova-compute[71509]:     <acpi/>
Apr 14 11:15:14 user nova-compute[71509]:     <apic/>
Apr 14 11:15:14 user nova-compute[71509]:     <vmcoreinfo/>
Apr 14 11:15:14 user nova-compute[71509]:   </features>
Apr 14 11:15:14 user nova-compute[71509]:   <clock offset="utc">
Apr 14 11:15:14 user nova-compute[71509]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 11:15:14 user nova-compute[71509]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 11:15:14 user nova-compute[71509]:     <timer name="hpet" present="no"/>
Apr 14 11:15:14 user nova-compute[71509]:   </clock>
Apr 14 11:15:14 user nova-compute[71509]:   <cpu mode="custom" match="exact">
Apr 14 11:15:14 user nova-compute[71509]:     <model>Nehalem</model>
Apr 14 11:15:14 user nova-compute[71509]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 11:15:14 user nova-compute[71509]:   </cpu>
Apr 14 11:15:14 user nova-compute[71509]:   <devices>
Apr 14 11:15:14 user nova-compute[71509]:     <disk type="block" device="disk">
Apr 14 11:15:14 user nova-compute[71509]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 11:15:14 user nova-compute[71509]:       <source dev="/dev/sdb"/>
Apr 14 11:15:14 user nova-compute[71509]:       <target dev="vda" bus="virtio"/>
Apr 14 11:15:14 user nova-compute[71509]:       <serial>3dfb7018-b582-43c0-b9b5-f58822b9b5c6</serial>
Apr 14 11:15:14 user nova-compute[71509]:     </disk>
Apr 14 11:15:14 user nova-compute[71509]:     <interface type="ethernet">
Apr 14 11:15:14 user nova-compute[71509]:       <mac address="fa:16:3e:a5:6a:47"/>
Apr 14 11:15:14 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 11:15:14 user nova-compute[71509]:       <mtu size="1442"/>
Apr 14 11:15:14 user nova-compute[71509]:       <target dev="tapf93da95e-42"/>
Apr 14 11:15:14 user nova-compute[71509]:     </interface>
Apr 14 11:15:14 user nova-compute[71509]:     <serial type="pty">
Apr 14 11:15:14 user nova-compute[71509]:       <log file="/opt/stack/data/nova/instances/3c4d3f81-5c17-4116-819b-84cefb35336f/console.log" append="off"/>
Apr 14 11:15:14 user nova-compute[71509]:     </serial>
Apr 14 11:15:14 user nova-compute[71509]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 11:15:14 user nova-compute[71509]:     <video>
Apr 14 11:15:14 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 11:15:14 user nova-compute[71509]:     </video>
Apr 14 11:15:14 user nova-compute[71509]:     <rng model="virtio">
Apr 14 11:15:14 user nova-compute[71509]:       <backend model="random">/dev/urandom</backend>
Apr 14 11:15:14 user nova-compute[71509]:     </rng>
Apr 14 11:15:14 user nova-compute[71509]:     <controller type="usb" index="0" model="none"/>
Apr 14 11:15:14 user nova-compute[71509]:     <memballoon model="virtio">
Apr 14 11:15:14 user nova-compute[71509]:       <stats period="10"/>
Apr 14 11:15:14 user nova-compute[71509]:     </memballoon>
Apr 14 11:15:14 user nova-compute[71509]:   </devices>
Apr 14 11:15:14 user nova-compute[71509]: </domain>
Apr 14 11:15:14 user nova-compute[71509]:  {{(pid=71509) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 11:15:14 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-72f40350-f1b2-42f3-b138-45872a644274 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T11:15:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1896883992',display_name='tempest-TestVolumeBootPattern-server-1896883992',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1896883992',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBafeRTei9AGsMhDE/c+DnIhp7w6x54r1wV/PnusBRf64WHX2LZne4yrEE3WXFq7Jmo1e2MZSS8o0Igq9Iy9JMCogkqExXP7DS8p2/L3yNdO3UPcBKE6h/z0FEi5FWn3lg==',key_name='tempest-TestVolumeBootPattern-994193383',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e7089cb52574f1daf7f578222bb7a67',ramdisk_id='',reservation_id='r-8rpux0yc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-193101874',owner_user_name='tempest-TestVolumeBootPattern-193101874-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T11:15:06Z,user_data=None,user_id='c7644d02bc784e4fb74ebaaceb3affe1',uuid=3c4d3f81-5c17-4116-819b-84cefb35336f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f93da95e-422e-44f2-97c7-d99b7fd6df87", "address": "fa:16:3e:a5:6a:47", "network": {"id": "6d6b6b35-b5ef-4d7c-abce-cad21cc99e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-878222456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e7089cb52574f1daf7f578222bb7a67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf93da95e-42", "ovs_interfaceid": "f93da95e-422e-44f2-97c7-d99b7fd6df87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 11:15:14 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-72f40350-f1b2-42f3-b138-45872a644274 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Converting VIF {"id": "f93da95e-422e-44f2-97c7-d99b7fd6df87", "address": "fa:16:3e:a5:6a:47", "network": {"id": "6d6b6b35-b5ef-4d7c-abce-cad21cc99e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-878222456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e7089cb52574f1daf7f578222bb7a67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf93da95e-42", "ovs_interfaceid": "f93da95e-422e-44f2-97c7-d99b7fd6df87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 11:15:14 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-72f40350-f1b2-42f3-b138-45872a644274 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:6a:47,bridge_name='br-int',has_traffic_filtering=True,id=f93da95e-422e-44f2-97c7-d99b7fd6df87,network=Network(6d6b6b35-b5ef-4d7c-abce-cad21cc99e32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf93da95e-42') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 11:15:14 user nova-compute[71509]: DEBUG os_vif [None req-72f40350-f1b2-42f3-b138-45872a644274 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:6a:47,bridge_name='br-int',has_traffic_filtering=True,id=f93da95e-422e-44f2-97c7-d99b7fd6df87,network=Network(6d6b6b35-b5ef-4d7c-abce-cad21cc99e32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf93da95e-42') {{(pid=71509) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 11:15:14 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:15:14 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:15:14 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 11:15:14 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:15:14 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf93da95e-42, may_exist=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:15:14 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf93da95e-42, col_values=(('external_ids', {'iface-id': 'f93da95e-422e-44f2-97c7-d99b7fd6df87', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a5:6a:47', 'vm-uuid': '3c4d3f81-5c17-4116-819b-84cefb35336f'}),)) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:15:14 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:15:14 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:15:14 user nova-compute[71509]: INFO os_vif [None req-72f40350-f1b2-42f3-b138-45872a644274 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:6a:47,bridge_name='br-int',has_traffic_filtering=True,id=f93da95e-422e-44f2-97c7-d99b7fd6df87,network=Network(6d6b6b35-b5ef-4d7c-abce-cad21cc99e32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf93da95e-42')
Apr 14 11:15:14 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-72f40350-f1b2-42f3-b138-45872a644274 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] No BDM found with device name vda, not building metadata. {{(pid=71509) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 11:15:14 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-72f40350-f1b2-42f3-b138-45872a644274 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] No VIF found with MAC fa:16:3e:a5:6a:47, not building metadata {{(pid=71509) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 11:15:15 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:15:15 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:15:16 user nova-compute[71509]: DEBUG nova.compute.manager [req-5c73a21a-9aa8-4409-a089-e40905fe7866 req-a56a1695-7f3c-4659-95e7-79b92672eccc service nova] [instance: 3c4d3f81-5c17-4116-819b-84cefb35336f] Received event network-vif-plugged-f93da95e-422e-44f2-97c7-d99b7fd6df87 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:15:16 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-5c73a21a-9aa8-4409-a089-e40905fe7866 req-a56a1695-7f3c-4659-95e7-79b92672eccc service nova] Acquiring lock "3c4d3f81-5c17-4116-819b-84cefb35336f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:15:16 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-5c73a21a-9aa8-4409-a089-e40905fe7866 req-a56a1695-7f3c-4659-95e7-79b92672eccc service nova] Lock "3c4d3f81-5c17-4116-819b-84cefb35336f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:15:16 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-5c73a21a-9aa8-4409-a089-e40905fe7866 req-a56a1695-7f3c-4659-95e7-79b92672eccc service nova] Lock "3c4d3f81-5c17-4116-819b-84cefb35336f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:15:16 user nova-compute[71509]: DEBUG nova.compute.manager [req-5c73a21a-9aa8-4409-a089-e40905fe7866 req-a56a1695-7f3c-4659-95e7-79b92672eccc service nova] [instance: 3c4d3f81-5c17-4116-819b-84cefb35336f] No waiting events found dispatching network-vif-plugged-f93da95e-422e-44f2-97c7-d99b7fd6df87 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:15:16 user nova-compute[71509]: WARNING nova.compute.manager [req-5c73a21a-9aa8-4409-a089-e40905fe7866 req-a56a1695-7f3c-4659-95e7-79b92672eccc service nova] [instance: 3c4d3f81-5c17-4116-819b-84cefb35336f] Received unexpected event network-vif-plugged-f93da95e-422e-44f2-97c7-d99b7fd6df87 for instance with vm_state building and task_state spawning.
Apr 14 11:15:16 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:15:16 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:15:16 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:15:17 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681470917.9954903, 3c4d3f81-5c17-4116-819b-84cefb35336f => Resumed> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 11:15:17 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 3c4d3f81-5c17-4116-819b-84cefb35336f] VM Resumed (Lifecycle Event)
Apr 14 11:15:18 user nova-compute[71509]: DEBUG nova.compute.manager [None req-72f40350-f1b2-42f3-b138-45872a644274 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 3c4d3f81-5c17-4116-819b-84cefb35336f] Instance event wait completed in 0 seconds for  {{(pid=71509) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 11:15:18 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-72f40350-f1b2-42f3-b138-45872a644274 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 3c4d3f81-5c17-4116-819b-84cefb35336f] Guest created on hypervisor {{(pid=71509) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 11:15:18 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: 3c4d3f81-5c17-4116-819b-84cefb35336f] Instance spawned successfully.
Apr 14 11:15:18 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-72f40350-f1b2-42f3-b138-45872a644274 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 3c4d3f81-5c17-4116-819b-84cefb35336f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 11:15:18 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 3c4d3f81-5c17-4116-819b-84cefb35336f] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 11:15:18 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 3c4d3f81-5c17-4116-819b-84cefb35336f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 11:15:18 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-72f40350-f1b2-42f3-b138-45872a644274 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 3c4d3f81-5c17-4116-819b-84cefb35336f] Found default for hw_cdrom_bus of ide {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:15:18 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-72f40350-f1b2-42f3-b138-45872a644274 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 3c4d3f81-5c17-4116-819b-84cefb35336f] Found default for hw_disk_bus of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:15:18 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-72f40350-f1b2-42f3-b138-45872a644274 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 3c4d3f81-5c17-4116-819b-84cefb35336f] Found default for hw_input_bus of None {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:15:18 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-72f40350-f1b2-42f3-b138-45872a644274 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 3c4d3f81-5c17-4116-819b-84cefb35336f] Found default for hw_pointer_model of None {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:15:18 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-72f40350-f1b2-42f3-b138-45872a644274 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 3c4d3f81-5c17-4116-819b-84cefb35336f] Found default for hw_video_model of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:15:18 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-72f40350-f1b2-42f3-b138-45872a644274 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 3c4d3f81-5c17-4116-819b-84cefb35336f] Found default for hw_vif_model of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:15:18 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 3c4d3f81-5c17-4116-819b-84cefb35336f] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 11:15:18 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681470917.9992793, 3c4d3f81-5c17-4116-819b-84cefb35336f => Started> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 11:15:18 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 3c4d3f81-5c17-4116-819b-84cefb35336f] VM Started (Lifecycle Event)
Apr 14 11:15:18 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 3c4d3f81-5c17-4116-819b-84cefb35336f] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 11:15:18 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 3c4d3f81-5c17-4116-819b-84cefb35336f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 11:15:18 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 3c4d3f81-5c17-4116-819b-84cefb35336f] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 11:15:18 user nova-compute[71509]: INFO nova.compute.manager [None req-72f40350-f1b2-42f3-b138-45872a644274 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 3c4d3f81-5c17-4116-819b-84cefb35336f] Took 4.86 seconds to spawn the instance on the hypervisor.
Apr 14 11:15:18 user nova-compute[71509]: DEBUG nova.compute.manager [None req-72f40350-f1b2-42f3-b138-45872a644274 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 3c4d3f81-5c17-4116-819b-84cefb35336f] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 11:15:18 user nova-compute[71509]: DEBUG nova.compute.manager [req-91d0b2c0-8722-41a4-834f-ea74a937cadc req-14f49e1a-d76a-469a-84eb-ef54f71c9159 service nova] [instance: 3c4d3f81-5c17-4116-819b-84cefb35336f] Received event network-vif-plugged-f93da95e-422e-44f2-97c7-d99b7fd6df87 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:15:18 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-91d0b2c0-8722-41a4-834f-ea74a937cadc req-14f49e1a-d76a-469a-84eb-ef54f71c9159 service nova] Acquiring lock "3c4d3f81-5c17-4116-819b-84cefb35336f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:15:18 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-91d0b2c0-8722-41a4-834f-ea74a937cadc req-14f49e1a-d76a-469a-84eb-ef54f71c9159 service nova] Lock "3c4d3f81-5c17-4116-819b-84cefb35336f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:15:18 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-91d0b2c0-8722-41a4-834f-ea74a937cadc req-14f49e1a-d76a-469a-84eb-ef54f71c9159 service nova] Lock "3c4d3f81-5c17-4116-819b-84cefb35336f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:15:18 user nova-compute[71509]: DEBUG nova.compute.manager [req-91d0b2c0-8722-41a4-834f-ea74a937cadc req-14f49e1a-d76a-469a-84eb-ef54f71c9159 service nova] [instance: 3c4d3f81-5c17-4116-819b-84cefb35336f] No waiting events found dispatching network-vif-plugged-f93da95e-422e-44f2-97c7-d99b7fd6df87 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:15:18 user nova-compute[71509]: WARNING nova.compute.manager [req-91d0b2c0-8722-41a4-834f-ea74a937cadc req-14f49e1a-d76a-469a-84eb-ef54f71c9159 service nova] [instance: 3c4d3f81-5c17-4116-819b-84cefb35336f] Received unexpected event network-vif-plugged-f93da95e-422e-44f2-97c7-d99b7fd6df87 for instance with vm_state building and task_state spawning.
Apr 14 11:15:18 user nova-compute[71509]: INFO nova.compute.manager [None req-72f40350-f1b2-42f3-b138-45872a644274 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 3c4d3f81-5c17-4116-819b-84cefb35336f] Took 12.12 seconds to build instance.
Apr 14 11:15:18 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-72f40350-f1b2-42f3-b138-45872a644274 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "3c4d3f81-5c17-4116-819b-84cefb35336f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.222s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:15:18 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:15:19 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:15:24 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:15:24 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:15:24 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71509) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 11:15:24 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71509) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 11:15:24 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71509) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 11:15:24 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:15:29 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:15:29 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:15:29 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71509) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 11:15:29 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71509) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 11:15:29 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71509) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 11:15:29 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:15:33 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:15:34 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:15:38 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:15:39 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:15:44 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:15:44 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:15:44 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71509) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 11:15:44 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71509) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 11:15:44 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71509) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 11:15:44 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:15:48 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:15:49 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:15:51 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:15:51 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71509) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 11:15:54 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:15:54 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:15:54 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71509) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 11:15:54 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71509) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 11:15:54 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71509) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 11:15:54 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:15:55 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:15:57 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:15:59 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:15:59 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:15:59 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:16:03 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:16:04 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:16:04 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:16:04 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71509) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 11:16:04 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71509) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 11:16:04 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71509) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 11:16:04 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:16:06 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:16:08 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:16:09 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:16:10 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:16:10 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:16:10 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:16:10 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:16:10 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Auditing locally available compute resources for user (node: user) {{(pid=71509) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 11:16:10 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71509) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 11:16:10 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 11:16:10 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 11:16:10 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Hypervisor/Node resource view: name=user free_ram=8752MB free_disk=25.957992553710938GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71509) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 11:16:10 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:16:10 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:16:11 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 3c4d3f81-5c17-4116-819b-84cefb35336f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 11:16:11 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71509) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 11:16:11 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71509) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 11:16:11 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 11:16:11 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 11:16:11 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Compute_service record updated for user:user {{(pid=71509) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 11:16:11 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.178s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:16:12 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:16:12 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Starting heal instance info cache {{(pid=71509) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 11:16:12 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Rebuilding the list of instances to heal {{(pid=71509) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 11:16:12 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "refresh_cache-3c4d3f81-5c17-4116-819b-84cefb35336f" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 11:16:12 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquired lock "refresh_cache-3c4d3f81-5c17-4116-819b-84cefb35336f" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 11:16:12 user nova-compute[71509]: DEBUG nova.network.neutron [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] [instance: 3c4d3f81-5c17-4116-819b-84cefb35336f] Forcefully refreshing network info cache for instance {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 11:16:12 user nova-compute[71509]: DEBUG nova.objects.instance [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lazy-loading 'info_cache' on Instance uuid 3c4d3f81-5c17-4116-819b-84cefb35336f {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 11:16:12 user nova-compute[71509]: DEBUG nova.network.neutron [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] [instance: 3c4d3f81-5c17-4116-819b-84cefb35336f] Updating instance_info_cache with network_info: [{"id": "f93da95e-422e-44f2-97c7-d99b7fd6df87", "address": "fa:16:3e:a5:6a:47", "network": {"id": "6d6b6b35-b5ef-4d7c-abce-cad21cc99e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-878222456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e7089cb52574f1daf7f578222bb7a67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf93da95e-42", "ovs_interfaceid": "f93da95e-422e-44f2-97c7-d99b7fd6df87", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:16:12 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Releasing lock "refresh_cache-3c4d3f81-5c17-4116-819b-84cefb35336f" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 11:16:12 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] [instance: 3c4d3f81-5c17-4116-819b-84cefb35336f] Updated the network info_cache for instance {{(pid=71509) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 11:16:14 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:16:19 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:16:19 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:16:19 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=71509) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 11:16:19 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71509) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 11:16:19 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71509) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 11:16:19 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:16:24 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:16:24 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:16:24 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71509) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 11:16:24 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71509) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 11:16:24 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71509) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 11:16:24 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:16:29 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:16:34 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:16:39 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:16:39 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:16:39 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71509) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 11:16:39 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71509) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 11:16:39 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71509) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 11:16:39 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:16:43 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:16:44 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:16:49 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:16:53 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:16:53 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71509) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 11:16:54 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:16:54 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:16:54 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71509) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 11:16:54 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71509) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 11:16:54 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71509) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 11:16:54 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:16:57 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:16:57 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:16:57 user nova-compute[71509]: DEBUG nova.compute.manager [req-e5d0b93a-ffbd-44fb-ac27-24324e22f8e1 req-59ace5e6-231c-4ebe-8d6d-bd20ee08f5f1 service nova] [instance: 3c4d3f81-5c17-4116-819b-84cefb35336f] Received event network-changed-f93da95e-422e-44f2-97c7-d99b7fd6df87 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:16:57 user nova-compute[71509]: DEBUG nova.compute.manager [req-e5d0b93a-ffbd-44fb-ac27-24324e22f8e1 req-59ace5e6-231c-4ebe-8d6d-bd20ee08f5f1 service nova] [instance: 3c4d3f81-5c17-4116-819b-84cefb35336f] Refreshing instance network info cache due to event network-changed-f93da95e-422e-44f2-97c7-d99b7fd6df87. {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 11:16:57 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-e5d0b93a-ffbd-44fb-ac27-24324e22f8e1 req-59ace5e6-231c-4ebe-8d6d-bd20ee08f5f1 service nova] Acquiring lock "refresh_cache-3c4d3f81-5c17-4116-819b-84cefb35336f" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 11:16:57 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-e5d0b93a-ffbd-44fb-ac27-24324e22f8e1 req-59ace5e6-231c-4ebe-8d6d-bd20ee08f5f1 service nova] Acquired lock "refresh_cache-3c4d3f81-5c17-4116-819b-84cefb35336f" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 11:16:57 user nova-compute[71509]: DEBUG nova.network.neutron [req-e5d0b93a-ffbd-44fb-ac27-24324e22f8e1 req-59ace5e6-231c-4ebe-8d6d-bd20ee08f5f1 service nova] [instance: 3c4d3f81-5c17-4116-819b-84cefb35336f] Refreshing network info cache for port f93da95e-422e-44f2-97c7-d99b7fd6df87 {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 11:16:58 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:16:58 user nova-compute[71509]: DEBUG nova.network.neutron [req-e5d0b93a-ffbd-44fb-ac27-24324e22f8e1 req-59ace5e6-231c-4ebe-8d6d-bd20ee08f5f1 service nova] [instance: 3c4d3f81-5c17-4116-819b-84cefb35336f] Updated VIF entry in instance network info cache for port f93da95e-422e-44f2-97c7-d99b7fd6df87. {{(pid=71509) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 11:16:58 user nova-compute[71509]: DEBUG nova.network.neutron [req-e5d0b93a-ffbd-44fb-ac27-24324e22f8e1 req-59ace5e6-231c-4ebe-8d6d-bd20ee08f5f1 service nova] [instance: 3c4d3f81-5c17-4116-819b-84cefb35336f] Updating instance_info_cache with network_info: [{"id": "f93da95e-422e-44f2-97c7-d99b7fd6df87", "address": "fa:16:3e:a5:6a:47", "network": {"id": "6d6b6b35-b5ef-4d7c-abce-cad21cc99e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-878222456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e7089cb52574f1daf7f578222bb7a67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf93da95e-42", "ovs_interfaceid": "f93da95e-422e-44f2-97c7-d99b7fd6df87", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:16:58 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-e5d0b93a-ffbd-44fb-ac27-24324e22f8e1 req-59ace5e6-231c-4ebe-8d6d-bd20ee08f5f1 service nova] Releasing lock "refresh_cache-3c4d3f81-5c17-4116-819b-84cefb35336f" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 11:16:59 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-835ffb31-5f88-4c53-840c-142f9e830f59 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "3c4d3f81-5c17-4116-819b-84cefb35336f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:16:59 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-835ffb31-5f88-4c53-840c-142f9e830f59 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "3c4d3f81-5c17-4116-819b-84cefb35336f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:16:59 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-835ffb31-5f88-4c53-840c-142f9e830f59 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "3c4d3f81-5c17-4116-819b-84cefb35336f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:16:59 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-835ffb31-5f88-4c53-840c-142f9e830f59 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "3c4d3f81-5c17-4116-819b-84cefb35336f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:16:59 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-835ffb31-5f88-4c53-840c-142f9e830f59 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "3c4d3f81-5c17-4116-819b-84cefb35336f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:16:59 user nova-compute[71509]: INFO nova.compute.manager [None req-835ffb31-5f88-4c53-840c-142f9e830f59 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 3c4d3f81-5c17-4116-819b-84cefb35336f] Terminating instance
Apr 14 11:16:59 user nova-compute[71509]: DEBUG nova.compute.manager [None req-835ffb31-5f88-4c53-840c-142f9e830f59 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 3c4d3f81-5c17-4116-819b-84cefb35336f] Start destroying the instance on the hypervisor. {{(pid=71509) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 11:16:59 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:16:59 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:16:59 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:16:59 user nova-compute[71509]: DEBUG nova.compute.manager [req-22e2384e-dd7e-44c1-a6c9-efb93c87fa99 req-9fad8600-2f9e-40d0-b3ac-dad1463b71b2 service nova] [instance: 3c4d3f81-5c17-4116-819b-84cefb35336f] Received event network-vif-unplugged-f93da95e-422e-44f2-97c7-d99b7fd6df87 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:16:59 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-22e2384e-dd7e-44c1-a6c9-efb93c87fa99 req-9fad8600-2f9e-40d0-b3ac-dad1463b71b2 service nova] Acquiring lock "3c4d3f81-5c17-4116-819b-84cefb35336f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:16:59 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-22e2384e-dd7e-44c1-a6c9-efb93c87fa99 req-9fad8600-2f9e-40d0-b3ac-dad1463b71b2 service nova] Lock "3c4d3f81-5c17-4116-819b-84cefb35336f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:16:59 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-22e2384e-dd7e-44c1-a6c9-efb93c87fa99 req-9fad8600-2f9e-40d0-b3ac-dad1463b71b2 service nova] Lock "3c4d3f81-5c17-4116-819b-84cefb35336f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:16:59 user nova-compute[71509]: DEBUG nova.compute.manager [req-22e2384e-dd7e-44c1-a6c9-efb93c87fa99 req-9fad8600-2f9e-40d0-b3ac-dad1463b71b2 service nova] [instance: 3c4d3f81-5c17-4116-819b-84cefb35336f] No waiting events found dispatching network-vif-unplugged-f93da95e-422e-44f2-97c7-d99b7fd6df87 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:16:59 user nova-compute[71509]: DEBUG nova.compute.manager [req-22e2384e-dd7e-44c1-a6c9-efb93c87fa99 req-9fad8600-2f9e-40d0-b3ac-dad1463b71b2 service nova] [instance: 3c4d3f81-5c17-4116-819b-84cefb35336f] Received event network-vif-unplugged-f93da95e-422e-44f2-97c7-d99b7fd6df87 for instance with task_state deleting. {{(pid=71509) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 11:16:59 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:16:59 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:16:59 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:16:59 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: 3c4d3f81-5c17-4116-819b-84cefb35336f] Instance destroyed successfully.
Apr 14 11:16:59 user nova-compute[71509]: DEBUG nova.objects.instance [None req-835ffb31-5f88-4c53-840c-142f9e830f59 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lazy-loading 'resources' on Instance uuid 3c4d3f81-5c17-4116-819b-84cefb35336f {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 11:16:59 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-835ffb31-5f88-4c53-840c-142f9e830f59 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T11:15:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1896883992',display_name='tempest-TestVolumeBootPattern-server-1896883992',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1896883992',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBafeRTei9AGsMhDE/c+DnIhp7w6x54r1wV/PnusBRf64WHX2LZne4yrEE3WXFq7Jmo1e2MZSS8o0Igq9Iy9JMCogkqExXP7DS8p2/L3yNdO3UPcBKE6h/z0FEi5FWn3lg==',key_name='tempest-TestVolumeBootPattern-994193383',keypairs=<?>,launch_index=0,launched_at=2023-04-14T11:15:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2e7089cb52574f1daf7f578222bb7a67',ramdisk_id='',reservation_id='r-8rpux0yc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-193101874',owner_user_name='tempest-TestVolumeBootPattern-193101874-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T11:15:18Z,user_data=None,user_id='c7644d02bc784e4fb74ebaaceb3affe1',uuid=3c4d3f81-5c17-4116-819b-84cefb35336f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f93da95e-422e-44f2-97c7-d99b7fd6df87", "address": "fa:16:3e:a5:6a:47", "network": {"id": "6d6b6b35-b5ef-4d7c-abce-cad21cc99e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-878222456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e7089cb52574f1daf7f578222bb7a67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf93da95e-42", "ovs_interfaceid": "f93da95e-422e-44f2-97c7-d99b7fd6df87", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 11:16:59 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-835ffb31-5f88-4c53-840c-142f9e830f59 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Converting VIF {"id": "f93da95e-422e-44f2-97c7-d99b7fd6df87", "address": "fa:16:3e:a5:6a:47", "network": {"id": "6d6b6b35-b5ef-4d7c-abce-cad21cc99e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-878222456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e7089cb52574f1daf7f578222bb7a67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf93da95e-42", "ovs_interfaceid": "f93da95e-422e-44f2-97c7-d99b7fd6df87", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 11:16:59 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-835ffb31-5f88-4c53-840c-142f9e830f59 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a5:6a:47,bridge_name='br-int',has_traffic_filtering=True,id=f93da95e-422e-44f2-97c7-d99b7fd6df87,network=Network(6d6b6b35-b5ef-4d7c-abce-cad21cc99e32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf93da95e-42') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 11:16:59 user nova-compute[71509]: DEBUG os_vif [None req-835ffb31-5f88-4c53-840c-142f9e830f59 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a5:6a:47,bridge_name='br-int',has_traffic_filtering=True,id=f93da95e-422e-44f2-97c7-d99b7fd6df87,network=Network(6d6b6b35-b5ef-4d7c-abce-cad21cc99e32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf93da95e-42') {{(pid=71509) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 11:16:59 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:16:59 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf93da95e-42, bridge=br-int, if_exists=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:16:59 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:16:59 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:16:59 user nova-compute[71509]: INFO os_vif [None req-835ffb31-5f88-4c53-840c-142f9e830f59 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a5:6a:47,bridge_name='br-int',has_traffic_filtering=True,id=f93da95e-422e-44f2-97c7-d99b7fd6df87,network=Network(6d6b6b35-b5ef-4d7c-abce-cad21cc99e32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf93da95e-42')
Apr 14 11:16:59 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-835ffb31-5f88-4c53-840c-142f9e830f59 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 3c4d3f81-5c17-4116-819b-84cefb35336f] calling os-brick to detach iSCSI Volume {{(pid=71509) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 11:16:59 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-835ffb31-5f88-4c53-840c-142f9e830f59 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0bf0749390>, {'target_iqn': 'iqn.2010-10.org.openstack:3dfb7018-b582-43c0-b9b5-f58822b9b5c6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jHsTtaBE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 11:16:59 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-835ffb31-5f88-4c53-840c-142f9e830f59 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 11:16:59 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-835ffb31-5f88-4c53-840c-142f9e830f59 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 11:16:59 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-835ffb31-5f88-4c53-840c-142f9e830f59 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 11:16:59 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:17:00 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:17:00 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fd5f847-2da9-4d39-8fa6-88dbfe896ce1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3dfb7018-b582-43c0-b9b5-f58822b9b5c6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:17:00 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-835ffb31-5f88-4c53-840c-142f9e830f59 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 11:17:00 user nova-compute[71509]: No targets found.
Apr 14 11:17:00 user nova-compute[71509]: iSNS:
Apr 14 11:17:00 user nova-compute[71509]: No targets found.
Apr 14 11:17:00 user nova-compute[71509]: STATIC:
Apr 14 11:17:00 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:3dfb7018-b582-43c0-b9b5-f58822b9b5c6
Apr 14 11:17:00 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 11:17:00 user nova-compute[71509]:                 Iface Name: default
Apr 14 11:17:00 user nova-compute[71509]: FIRMWARE:
Apr 14 11:17:00 user nova-compute[71509]: No targets found.
Apr 14 11:17:00 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 11:17:00 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-835ffb31-5f88-4c53-840c-142f9e830f59 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 11:17:00 user nova-compute[71509]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 11:17:00 user nova-compute[71509]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71509) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 11:17:00 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-835ffb31-5f88-4c53-840c-142f9e830f59 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3dfb7018-b582-43c0-b9b5-f58822b9b5c6', 0)] {{(pid=71509) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 11:17:00 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:17:00 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:17:00 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1cd1e94-f149-462f-881c-6eb3e5cf9839]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3dfb7018-b582-43c0-b9b5-f58822b9b5c6\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:17:00 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:17:00 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:17:00 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c4d5bf3-7224-4e32-a05d-987e0ba51981]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dfb7018-b582-43c0-b9b5-f58822b9b5c6 (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:17:00 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-835ffb31-5f88-4c53-840c-142f9e830f59 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dfb7018-b582-43c0-b9b5-f58822b9b5c6 (non-flash)
Apr 14 11:17:00 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 11:17:00 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-835ffb31-5f88-4c53-840c-142f9e830f59 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dfb7018-b582-43c0-b9b5-f58822b9b5c6 (non-flash)
Apr 14 11:17:00 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 11:17:00 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-835ffb31-5f88-4c53-840c-142f9e830f59 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0c38168af0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3dfb7018-b582-43c0-b9b5-f58822b9b5c6'): ({'sdb'}, set())}) {{(pid=71509) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 11:17:00 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-835ffb31-5f88-4c53-840c-142f9e830f59 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Removing single pathed devices sdb {{(pid=71509) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 11:17:00 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:17:00 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:17:00 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[23668753-9890-4742-a3c1-0ab353525fb1]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:17:00 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:17:00 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:17:00 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b7b66f4-7e88-4c0e-9040-30fa418ad73d]: (4, ('ok\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:17:00 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-835ffb31-5f88-4c53-840c-142f9e830f59 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Flushing IO for device /dev/sdb {{(pid=71509) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 11:17:00 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:17:00 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:17:00 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[43b5ccf2-bab2-4f8c-9ed7-974dee4ecdd6]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:17:00 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-835ffb31-5f88-4c53-840c-142f9e830f59 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71509) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 11:17:00 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:17:00 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:17:00 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[23bbaf9d-d437-4bdd-ab1d-a981124f2780]: (4, ('1', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:17:00 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-835ffb31-5f88-4c53-840c-142f9e830f59 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71509) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 11:17:00 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-835ffb31-5f88-4c53-840c-142f9e830f59 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] SCSI volumes sdb have been removed. {{(pid=71509) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 11:17:00 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-835ffb31-5f88-4c53-840c-142f9e830f59 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3dfb7018-b582-43c0-b9b5-f58822b9b5c6')] {{(pid=71509) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 11:17:00 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3dfb7018-b582-43c0-b9b5-f58822b9b5c6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:17:00 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3dfb7018-b582-43c0-b9b5-f58822b9b5c6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:17:00 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ac00334-e8fd-4f6c-8927-5cfa99f35821]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:17:00 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-835ffb31-5f88-4c53-840c-142f9e830f59 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:17:00 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3dfb7018-b582-43c0-b9b5-f58822b9b5c6 -p 172.16.0.220:3260 --logout {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:17:00 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3dfb7018-b582-43c0-b9b5-f58822b9b5c6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:17:00 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c00c636-3006-4efc-a07f-8b4a87b12763]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:3dfb7018-b582-43c0-b9b5-f58822b9b5c6, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:3dfb7018-b582-43c0-b9b5-f58822b9b5c6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:17:00 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-835ffb31-5f88-4c53-840c-142f9e830f59 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:3dfb7018-b582-43c0-b9b5-f58822b9b5c6, portal: 172.16.0.220,3260]
Apr 14 11:17:00 user nova-compute[71509]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:3dfb7018-b582-43c0-b9b5-f58822b9b5c6, portal: 172.16.0.220,3260] successful.
Apr 14 11:17:00 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:17:00 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3dfb7018-b582-43c0-b9b5-f58822b9b5c6 -p 172.16.0.220:3260 --op delete {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:17:00 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3dfb7018-b582-43c0-b9b5-f58822b9b5c6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:17:00 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9c3f674-e74e-4d82-a4bd-21d64d1a88bd]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:17:00 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-835ffb31-5f88-4c53-840c-142f9e830f59 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:17:00 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-835ffb31-5f88-4c53-840c-142f9e830f59 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 11:17:00 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-835ffb31-5f88-4c53-840c-142f9e830f59 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] <== disconnect_volume: return (296ms) None {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 11:17:00 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-835ffb31-5f88-4c53-840c-142f9e830f59 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 3c4d3f81-5c17-4116-819b-84cefb35336f] Disconnected iSCSI Volume {{(pid=71509) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 11:17:00 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-835ffb31-5f88-4c53-840c-142f9e830f59 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 3c4d3f81-5c17-4116-819b-84cefb35336f] Deleting instance files /opt/stack/data/nova/instances/3c4d3f81-5c17-4116-819b-84cefb35336f_del
Apr 14 11:17:00 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-835ffb31-5f88-4c53-840c-142f9e830f59 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 3c4d3f81-5c17-4116-819b-84cefb35336f] Deletion of /opt/stack/data/nova/instances/3c4d3f81-5c17-4116-819b-84cefb35336f_del complete
Apr 14 11:17:00 user nova-compute[71509]: INFO nova.compute.manager [None req-835ffb31-5f88-4c53-840c-142f9e830f59 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 3c4d3f81-5c17-4116-819b-84cefb35336f] Took 1.16 seconds to destroy the instance on the hypervisor.
Apr 14 11:17:00 user nova-compute[71509]: DEBUG oslo.service.loopingcall [None req-835ffb31-5f88-4c53-840c-142f9e830f59 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71509) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 11:17:00 user nova-compute[71509]: DEBUG nova.compute.manager [-] [instance: 3c4d3f81-5c17-4116-819b-84cefb35336f] Deallocating network for instance {{(pid=71509) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 11:17:00 user nova-compute[71509]: DEBUG nova.network.neutron [-] [instance: 3c4d3f81-5c17-4116-819b-84cefb35336f] deallocate_for_instance() {{(pid=71509) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 11:17:01 user nova-compute[71509]: DEBUG nova.network.neutron [-] [instance: 3c4d3f81-5c17-4116-819b-84cefb35336f] Updating instance_info_cache with network_info: [] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:17:01 user nova-compute[71509]: INFO nova.compute.manager [-] [instance: 3c4d3f81-5c17-4116-819b-84cefb35336f] Took 0.78 seconds to deallocate network for instance.
Apr 14 11:17:01 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:17:01 user nova-compute[71509]: DEBUG nova.compute.manager [req-148e9b4d-d1a2-4476-a5ba-c9741fbdf8a1 req-ecc3912b-b81f-4b80-a8ba-0e207ee50e8d service nova] [instance: 3c4d3f81-5c17-4116-819b-84cefb35336f] Received event network-vif-plugged-f93da95e-422e-44f2-97c7-d99b7fd6df87 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:17:01 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-148e9b4d-d1a2-4476-a5ba-c9741fbdf8a1 req-ecc3912b-b81f-4b80-a8ba-0e207ee50e8d service nova] Acquiring lock "3c4d3f81-5c17-4116-819b-84cefb35336f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:17:01 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-148e9b4d-d1a2-4476-a5ba-c9741fbdf8a1 req-ecc3912b-b81f-4b80-a8ba-0e207ee50e8d service nova] Lock "3c4d3f81-5c17-4116-819b-84cefb35336f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:17:01 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-148e9b4d-d1a2-4476-a5ba-c9741fbdf8a1 req-ecc3912b-b81f-4b80-a8ba-0e207ee50e8d service nova] Lock "3c4d3f81-5c17-4116-819b-84cefb35336f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:17:01 user nova-compute[71509]: DEBUG nova.compute.manager [req-148e9b4d-d1a2-4476-a5ba-c9741fbdf8a1 req-ecc3912b-b81f-4b80-a8ba-0e207ee50e8d service nova] [instance: 3c4d3f81-5c17-4116-819b-84cefb35336f] No waiting events found dispatching network-vif-plugged-f93da95e-422e-44f2-97c7-d99b7fd6df87 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:17:01 user nova-compute[71509]: WARNING nova.compute.manager [req-148e9b4d-d1a2-4476-a5ba-c9741fbdf8a1 req-ecc3912b-b81f-4b80-a8ba-0e207ee50e8d service nova] [instance: 3c4d3f81-5c17-4116-819b-84cefb35336f] Received unexpected event network-vif-plugged-f93da95e-422e-44f2-97c7-d99b7fd6df87 for instance with vm_state active and task_state deleting.
Apr 14 11:17:01 user nova-compute[71509]: DEBUG nova.compute.manager [req-148e9b4d-d1a2-4476-a5ba-c9741fbdf8a1 req-ecc3912b-b81f-4b80-a8ba-0e207ee50e8d service nova] [instance: 3c4d3f81-5c17-4116-819b-84cefb35336f] Received event network-vif-deleted-f93da95e-422e-44f2-97c7-d99b7fd6df87 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:17:01 user nova-compute[71509]: INFO nova.compute.manager [None req-835ffb31-5f88-4c53-840c-142f9e830f59 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 3c4d3f81-5c17-4116-819b-84cefb35336f] Took 0.78 seconds to detach 1 volumes for instance.
Apr 14 11:17:01 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-835ffb31-5f88-4c53-840c-142f9e830f59 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:17:01 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-835ffb31-5f88-4c53-840c-142f9e830f59 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:17:02 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-835ffb31-5f88-4c53-840c-142f9e830f59 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 11:17:02 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-835ffb31-5f88-4c53-840c-142f9e830f59 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 11:17:02 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-835ffb31-5f88-4c53-840c-142f9e830f59 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.122s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:17:02 user nova-compute[71509]: INFO nova.scheduler.client.report [None req-835ffb31-5f88-4c53-840c-142f9e830f59 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Deleted allocations for instance 3c4d3f81-5c17-4116-819b-84cefb35336f
Apr 14 11:17:02 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-835ffb31-5f88-4c53-840c-142f9e830f59 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "3c4d3f81-5c17-4116-819b-84cefb35336f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.034s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:17:03 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:17:04 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:17:04 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:17:08 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:17:09 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:17:10 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:17:12 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:17:12 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Starting heal instance info cache {{(pid=71509) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 11:17:12 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Rebuilding the list of instances to heal {{(pid=71509) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 11:17:12 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Didn't find any instances for network info cache update. {{(pid=71509) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 14 11:17:12 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:17:12 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:17:12 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:17:12 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:17:12 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Auditing locally available compute resources for user (node: user) {{(pid=71509) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 11:17:12 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 11:17:12 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 11:17:12 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Hypervisor/Node resource view: name=user free_ram=8874MB free_disk=25.957122802734375GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71509) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 11:17:12 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:17:12 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:17:12 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71509) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 11:17:12 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71509) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 11:17:12 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 11:17:12 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 11:17:13 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Compute_service record updated for user:user {{(pid=71509) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 11:17:13 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.133s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:17:14 user nova-compute[71509]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681471019.93988, 3c4d3f81-5c17-4116-819b-84cefb35336f => Stopped> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 11:17:14 user nova-compute[71509]: INFO nova.compute.manager [-] [instance: 3c4d3f81-5c17-4116-819b-84cefb35336f] VM Stopped (Lifecycle Event)
Apr 14 11:17:14 user nova-compute[71509]: DEBUG nova.compute.manager [None req-9bf2bd81-6618-4227-a474-27f4b4d23e1a None None] [instance: 3c4d3f81-5c17-4116-819b-84cefb35336f] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 11:17:14 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:17:14 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:17:14 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71509) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 11:17:14 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71509) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 11:17:14 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71509) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 11:17:14 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:17:19 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:17:24 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:17:29 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:17:34 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:17:39 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:17:44 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:17:49 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:17:50 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-f5914fc6-1497-4d91-9c7d-191cf12aa3a1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "bfd4b9b2-a5fe-412f-b17b-2d45367ea438" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:17:50 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-f5914fc6-1497-4d91-9c7d-191cf12aa3a1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "bfd4b9b2-a5fe-412f-b17b-2d45367ea438" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:17:50 user nova-compute[71509]: DEBUG nova.compute.manager [None req-f5914fc6-1497-4d91-9c7d-191cf12aa3a1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: bfd4b9b2-a5fe-412f-b17b-2d45367ea438] Starting instance... {{(pid=71509) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 11:17:50 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-f5914fc6-1497-4d91-9c7d-191cf12aa3a1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:17:50 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-f5914fc6-1497-4d91-9c7d-191cf12aa3a1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:17:50 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-f5914fc6-1497-4d91-9c7d-191cf12aa3a1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71509) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 11:17:50 user nova-compute[71509]: INFO nova.compute.claims [None req-f5914fc6-1497-4d91-9c7d-191cf12aa3a1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: bfd4b9b2-a5fe-412f-b17b-2d45367ea438] Claim successful on node user
Apr 14 11:17:51 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-f5914fc6-1497-4d91-9c7d-191cf12aa3a1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 11:17:51 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-f5914fc6-1497-4d91-9c7d-191cf12aa3a1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 11:17:51 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-f5914fc6-1497-4d91-9c7d-191cf12aa3a1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.191s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:17:51 user nova-compute[71509]: DEBUG nova.compute.manager [None req-f5914fc6-1497-4d91-9c7d-191cf12aa3a1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: bfd4b9b2-a5fe-412f-b17b-2d45367ea438] Start building networks asynchronously for instance. {{(pid=71509) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 11:17:51 user nova-compute[71509]: DEBUG nova.compute.manager [None req-f5914fc6-1497-4d91-9c7d-191cf12aa3a1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: bfd4b9b2-a5fe-412f-b17b-2d45367ea438] Allocating IP information in the background. {{(pid=71509) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 11:17:51 user nova-compute[71509]: DEBUG nova.network.neutron [None req-f5914fc6-1497-4d91-9c7d-191cf12aa3a1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: bfd4b9b2-a5fe-412f-b17b-2d45367ea438] allocate_for_instance() {{(pid=71509) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 11:17:51 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-f5914fc6-1497-4d91-9c7d-191cf12aa3a1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: bfd4b9b2-a5fe-412f-b17b-2d45367ea438] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 11:17:51 user nova-compute[71509]: DEBUG nova.compute.manager [None req-f5914fc6-1497-4d91-9c7d-191cf12aa3a1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: bfd4b9b2-a5fe-412f-b17b-2d45367ea438] Start building block device mappings for instance. {{(pid=71509) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 11:17:51 user nova-compute[71509]: INFO nova.virt.block_device [None req-f5914fc6-1497-4d91-9c7d-191cf12aa3a1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: bfd4b9b2-a5fe-412f-b17b-2d45367ea438] Booting with volume 3dfb7018-b582-43c0-b9b5-f58822b9b5c6 at /dev/vda
Apr 14 11:17:51 user nova-compute[71509]: DEBUG nova.policy [None req-f5914fc6-1497-4d91-9c7d-191cf12aa3a1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c7644d02bc784e4fb74ebaaceb3affe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e7089cb52574f1daf7f578222bb7a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71509) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 11:17:51 user nova-compute[71509]: DEBUG os_brick.utils [None req-f5914fc6-1497-4d91-9c7d-191cf12aa3a1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 11:17:51 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:17:51 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:17:51 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[811a74a7-f73c-49a1-ad48-a02e8b3ef602]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50119df3c417\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:17:51 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:17:51 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:17:51 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2c0f47f-eefe-48a7-99d9-10c35234751c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:17:51 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:17:51 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:17:51 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd65f938-938b-4fd0-b5db-cf4c54119248]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:17:51 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fc8af03-d90a-47b2-b2d9-1ff8b4490d86]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:17:51 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-f5914fc6-1497-4d91-9c7d-191cf12aa3a1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Running cmd (subprocess): nvme version {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:17:51 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-f5914fc6-1497-4d91-9c7d-191cf12aa3a1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] 'nvme version' failed. Not Retrying. {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 11:17:51 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f5914fc6-1497-4d91-9c7d-191cf12aa3a1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] nvme not present on system {{(pid=71509) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 11:17:51 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:17:51 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 11:17:51 user nova-compute[71509]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 11:17:51 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[20bd95e3-8dd7-4bcf-a588-c6eab6d6fbd6]: (4, '') {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:17:51 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-f5914fc6-1497-4d91-9c7d-191cf12aa3a1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71509) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 11:17:51 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-f5914fc6-1497-4d91-9c7d-191cf12aa3a1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71509) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 11:17:51 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-f5914fc6-1497-4d91-9c7d-191cf12aa3a1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] LIGHTOS: no hostnqn found. {{(pid=71509) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 11:17:51 user nova-compute[71509]: DEBUG os_brick.utils [None req-f5914fc6-1497-4d91-9c7d-191cf12aa3a1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50119df3c417', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 11:17:51 user nova-compute[71509]: DEBUG nova.virt.block_device [None req-f5914fc6-1497-4d91-9c7d-191cf12aa3a1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: bfd4b9b2-a5fe-412f-b17b-2d45367ea438] Updating existing volume attachment record: c663e085-3864-4be3-ab85-ba9534ffda80 {{(pid=71509) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 11:17:51 user nova-compute[71509]: DEBUG nova.network.neutron [None req-f5914fc6-1497-4d91-9c7d-191cf12aa3a1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: bfd4b9b2-a5fe-412f-b17b-2d45367ea438] Successfully created port: 0c3004b4-2439-46a3-b5f9-67e77b319a70 {{(pid=71509) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 11:17:52 user nova-compute[71509]: DEBUG nova.network.neutron [None req-f5914fc6-1497-4d91-9c7d-191cf12aa3a1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: bfd4b9b2-a5fe-412f-b17b-2d45367ea438] Successfully updated port: 0c3004b4-2439-46a3-b5f9-67e77b319a70 {{(pid=71509) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 11:17:52 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-f5914fc6-1497-4d91-9c7d-191cf12aa3a1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "refresh_cache-bfd4b9b2-a5fe-412f-b17b-2d45367ea438" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 11:17:52 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-f5914fc6-1497-4d91-9c7d-191cf12aa3a1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquired lock "refresh_cache-bfd4b9b2-a5fe-412f-b17b-2d45367ea438" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 11:17:52 user nova-compute[71509]: DEBUG nova.network.neutron [None req-f5914fc6-1497-4d91-9c7d-191cf12aa3a1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: bfd4b9b2-a5fe-412f-b17b-2d45367ea438] Building network info cache for instance {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 11:17:52 user nova-compute[71509]: DEBUG nova.network.neutron [None req-f5914fc6-1497-4d91-9c7d-191cf12aa3a1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: bfd4b9b2-a5fe-412f-b17b-2d45367ea438] Instance cache missing network info. {{(pid=71509) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 11:17:52 user nova-compute[71509]: DEBUG nova.network.neutron [None req-f5914fc6-1497-4d91-9c7d-191cf12aa3a1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: bfd4b9b2-a5fe-412f-b17b-2d45367ea438] Updating instance_info_cache with network_info: [{"id": "0c3004b4-2439-46a3-b5f9-67e77b319a70", "address": "fa:16:3e:a2:68:21", "network": {"id": "6d6b6b35-b5ef-4d7c-abce-cad21cc99e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-878222456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e7089cb52574f1daf7f578222bb7a67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c3004b4-24", "ovs_interfaceid": "0c3004b4-2439-46a3-b5f9-67e77b319a70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:17:52 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-f5914fc6-1497-4d91-9c7d-191cf12aa3a1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Releasing lock "refresh_cache-bfd4b9b2-a5fe-412f-b17b-2d45367ea438" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 11:17:52 user nova-compute[71509]: DEBUG nova.compute.manager [None req-f5914fc6-1497-4d91-9c7d-191cf12aa3a1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: bfd4b9b2-a5fe-412f-b17b-2d45367ea438] Instance network_info: |[{"id": "0c3004b4-2439-46a3-b5f9-67e77b319a70", "address": "fa:16:3e:a2:68:21", "network": {"id": "6d6b6b35-b5ef-4d7c-abce-cad21cc99e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-878222456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e7089cb52574f1daf7f578222bb7a67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c3004b4-24", "ovs_interfaceid": "0c3004b4-2439-46a3-b5f9-67e77b319a70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71509) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 11:17:53 user nova-compute[71509]: DEBUG nova.compute.manager [req-3bfb7936-c2ba-4ca6-b12f-1926cd079943 req-fa6c468e-d2b0-4ad6-a12f-77da335066ea service nova] [instance: bfd4b9b2-a5fe-412f-b17b-2d45367ea438] Received event network-changed-0c3004b4-2439-46a3-b5f9-67e77b319a70 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:17:53 user nova-compute[71509]: DEBUG nova.compute.manager [req-3bfb7936-c2ba-4ca6-b12f-1926cd079943 req-fa6c468e-d2b0-4ad6-a12f-77da335066ea service nova] [instance: bfd4b9b2-a5fe-412f-b17b-2d45367ea438] Refreshing instance network info cache due to event network-changed-0c3004b4-2439-46a3-b5f9-67e77b319a70. {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 11:17:53 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-3bfb7936-c2ba-4ca6-b12f-1926cd079943 req-fa6c468e-d2b0-4ad6-a12f-77da335066ea service nova] Acquiring lock "refresh_cache-bfd4b9b2-a5fe-412f-b17b-2d45367ea438" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 11:17:53 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-3bfb7936-c2ba-4ca6-b12f-1926cd079943 req-fa6c468e-d2b0-4ad6-a12f-77da335066ea service nova] Acquired lock "refresh_cache-bfd4b9b2-a5fe-412f-b17b-2d45367ea438" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 11:17:53 user nova-compute[71509]: DEBUG nova.network.neutron [req-3bfb7936-c2ba-4ca6-b12f-1926cd079943 req-fa6c468e-d2b0-4ad6-a12f-77da335066ea service nova] [instance: bfd4b9b2-a5fe-412f-b17b-2d45367ea438] Refreshing network info cache for port 0c3004b4-2439-46a3-b5f9-67e77b319a70 {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 11:17:54 user nova-compute[71509]: DEBUG nova.network.neutron [req-3bfb7936-c2ba-4ca6-b12f-1926cd079943 req-fa6c468e-d2b0-4ad6-a12f-77da335066ea service nova] [instance: bfd4b9b2-a5fe-412f-b17b-2d45367ea438] Updated VIF entry in instance network info cache for port 0c3004b4-2439-46a3-b5f9-67e77b319a70. {{(pid=71509) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 11:17:54 user nova-compute[71509]: DEBUG nova.network.neutron [req-3bfb7936-c2ba-4ca6-b12f-1926cd079943 req-fa6c468e-d2b0-4ad6-a12f-77da335066ea service nova] [instance: bfd4b9b2-a5fe-412f-b17b-2d45367ea438] Updating instance_info_cache with network_info: [{"id": "0c3004b4-2439-46a3-b5f9-67e77b319a70", "address": "fa:16:3e:a2:68:21", "network": {"id": "6d6b6b35-b5ef-4d7c-abce-cad21cc99e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-878222456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e7089cb52574f1daf7f578222bb7a67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c3004b4-24", "ovs_interfaceid": "0c3004b4-2439-46a3-b5f9-67e77b319a70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:17:54 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-3bfb7936-c2ba-4ca6-b12f-1926cd079943 req-fa6c468e-d2b0-4ad6-a12f-77da335066ea service nova] Releasing lock "refresh_cache-bfd4b9b2-a5fe-412f-b17b-2d45367ea438" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 11:17:54 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:17:55 user nova-compute[71509]: DEBUG nova.compute.manager [None req-f5914fc6-1497-4d91-9c7d-191cf12aa3a1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: bfd4b9b2-a5fe-412f-b17b-2d45367ea438] Start spawning the instance on the hypervisor. {{(pid=71509) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 11:17:55 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-f5914fc6-1497-4d91-9c7d-191cf12aa3a1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: bfd4b9b2-a5fe-412f-b17b-2d45367ea438] Creating instance directory {{(pid=71509) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 11:17:55 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-f5914fc6-1497-4d91-9c7d-191cf12aa3a1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: bfd4b9b2-a5fe-412f-b17b-2d45367ea438] Creating image(s)
Apr 14 11:17:55 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-f5914fc6-1497-4d91-9c7d-191cf12aa3a1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: bfd4b9b2-a5fe-412f-b17b-2d45367ea438] Did not create local disks {{(pid=71509) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 11:17:55 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-f5914fc6-1497-4d91-9c7d-191cf12aa3a1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: bfd4b9b2-a5fe-412f-b17b-2d45367ea438] Ensure instance console log exists: /opt/stack/data/nova/instances/bfd4b9b2-a5fe-412f-b17b-2d45367ea438/console.log {{(pid=71509) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 11:17:55 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-f5914fc6-1497-4d91-9c7d-191cf12aa3a1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:17:55 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-f5914fc6-1497-4d91-9c7d-191cf12aa3a1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:17:55 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-f5914fc6-1497-4d91-9c7d-191cf12aa3a1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:17:55 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-f5914fc6-1497-4d91-9c7d-191cf12aa3a1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: bfd4b9b2-a5fe-412f-b17b-2d45367ea438] Start _get_guest_xml network_info=[{"id": "0c3004b4-2439-46a3-b5f9-67e77b319a70", "address": "fa:16:3e:a2:68:21", "network": {"id": "6d6b6b35-b5ef-4d7c-abce-cad21cc99e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-878222456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e7089cb52574f1daf7f578222bb7a67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c3004b4-24", "ovs_interfaceid": "0c3004b4-2439-46a3-b5f9-67e77b319a70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'attachment_id': 'c663e085-3864-4be3-ab85-ba9534ffda80', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3dfb7018-b582-43c0-b9b5-f58822b9b5c6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jHsTtaBE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'bfd4b9b2-a5fe-412f-b17b-2d45367ea438', 'attached_at': '', 'detached_at': '', 'volume_id': '3dfb7018-b582-43c0-b9b5-f58822b9b5c6', 'serial': '3dfb7018-b582-43c0-b9b5-f58822b9b5c6'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'volume_type': None} {{(pid=71509) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 11:17:55 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-f5914fc6-1497-4d91-9c7d-191cf12aa3a1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 11:17:55 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-f5914fc6-1497-4d91-9c7d-191cf12aa3a1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 11:17:55 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-f5914fc6-1497-4d91-9c7d-191cf12aa3a1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71509) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 11:17:55 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-f5914fc6-1497-4d91-9c7d-191cf12aa3a1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T10:40:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 11:17:55 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-f5914fc6-1497-4d91-9c7d-191cf12aa3a1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Flavor limits 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 11:17:55 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-f5914fc6-1497-4d91-9c7d-191cf12aa3a1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Image limits 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 11:17:55 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-f5914fc6-1497-4d91-9c7d-191cf12aa3a1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Flavor pref 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 11:17:55 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-f5914fc6-1497-4d91-9c7d-191cf12aa3a1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Image pref 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 11:17:55 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-f5914fc6-1497-4d91-9c7d-191cf12aa3a1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 11:17:55 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-f5914fc6-1497-4d91-9c7d-191cf12aa3a1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 11:17:55 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-f5914fc6-1497-4d91-9c7d-191cf12aa3a1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71509) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 11:17:55 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-f5914fc6-1497-4d91-9c7d-191cf12aa3a1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Got 1 possible topologies {{(pid=71509) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 11:17:55 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-f5914fc6-1497-4d91-9c7d-191cf12aa3a1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 11:17:55 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-f5914fc6-1497-4d91-9c7d-191cf12aa3a1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 11:17:56 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5914fc6-1497-4d91-9c7d-191cf12aa3a1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: bfd4b9b2-a5fe-412f-b17b-2d45367ea438] Calling os-brick to attach iSCSI Volume {{(pid=71509) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 11:17:56 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5914fc6-1497-4d91-9c7d-191cf12aa3a1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0bf0749390>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3dfb7018-b582-43c0-b9b5-f58822b9b5c6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jHsTtaBE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 11:17:56 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-f5914fc6-1497-4d91-9c7d-191cf12aa3a1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 11:17:56 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-f5914fc6-1497-4d91-9c7d-191cf12aa3a1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 11:17:56 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-f5914fc6-1497-4d91-9c7d-191cf12aa3a1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 11:17:56 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-f5914fc6-1497-4d91-9c7d-191cf12aa3a1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 11:17:56 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-f5914fc6-1497-4d91-9c7d-191cf12aa3a1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3dfb7018-b582-43c0-b9b5-f58822b9b5c6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 11:17:56 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-f5914fc6-1497-4d91-9c7d-191cf12aa3a1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3dfb7018-b582-43c0-b9b5-f58822b9b5c6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 11:17:56 user nova-compute[71509]: INFO os_brick.initiator.connectors.iscsi [None req-f5914fc6-1497-4d91-9c7d-191cf12aa3a1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 11:17:56 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:17:56 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71509) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 11:17:56 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3dfb7018-b582-43c0-b9b5-f58822b9b5c6 -p 172.16.0.220:3260 {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:17:56 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3dfb7018-b582-43c0-b9b5-f58822b9b5c6 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:17:56 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[15bb0d70-9015-4fae-8310-d742bcb05165]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:17:56 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5914fc6-1497-4d91-9c7d-191cf12aa3a1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 11:17:56 user nova-compute[71509]:  {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:17:56 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3dfb7018-b582-43c0-b9b5-f58822b9b5c6 -p 172.16.0.220:3260 --interface default --op new {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:17:56 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3dfb7018-b582-43c0-b9b5-f58822b9b5c6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:17:56 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d0b7ff5-1d77-4692-83cf-033a2af7fe4d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3dfb7018-b582-43c0-b9b5-f58822b9b5c6] added\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:17:56 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5914fc6-1497-4d91-9c7d-191cf12aa3a1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3dfb7018-b582-43c0-b9b5-f58822b9b5c6] added
Apr 14 11:17:56 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:17:56 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3dfb7018-b582-43c0-b9b5-f58822b9b5c6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:17:56 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3dfb7018-b582-43c0-b9b5-f58822b9b5c6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:17:56 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e3adfb5-0f88-45e9-b8ba-fa38b0b8d012]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:17:56 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5914fc6-1497-4d91-9c7d-191cf12aa3a1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:17:56 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3dfb7018-b582-43c0-b9b5-f58822b9b5c6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:17:56 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3dfb7018-b582-43c0-b9b5-f58822b9b5c6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:17:56 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[bad92f41-314a-48c4-a729-15f86e812dbf]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:17:56 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5914fc6-1497-4d91-9c7d-191cf12aa3a1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:17:56 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3dfb7018-b582-43c0-b9b5-f58822b9b5c6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jHsTtaBE {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:17:56 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3dfb7018-b582-43c0-b9b5-f58822b9b5c6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jHsTtaBE" returned: 0 in 0.017s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:17:56 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfaa45fb-5714-4aea-8a83-519e13eb3caf]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:17:56 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5914fc6-1497-4d91-9c7d-191cf12aa3a1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jHsTtaBE'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:17:56 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3dfb7018-b582-43c0-b9b5-f58822b9b5c6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:17:56 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3dfb7018-b582-43c0-b9b5-f58822b9b5c6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:17:56 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc67f2f1-0256-47a7-b1e5-e583df5f5d5d]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:17:56 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5914fc6-1497-4d91-9c7d-191cf12aa3a1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:17:56 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:17:56 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:17:56 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eb62af3-f14d-4732-bd84-5de3c196c384]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:17:56 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5914fc6-1497-4d91-9c7d-191cf12aa3a1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Apr 14 11:17:56 user nova-compute[71509]:  {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 11:17:56 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5914fc6-1497-4d91-9c7d-191cf12aa3a1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Apr 14 11:17:56 user nova-compute[71509]:  {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 11:17:56 user nova-compute[71509]: WARNING os_brick.initiator.connectors.iscsi [None req-f5914fc6-1497-4d91-9c7d-191cf12aa3a1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Apr 14 11:17:56 user nova-compute[71509]: 
Apr 14 11:17:56 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3dfb7018-b582-43c0-b9b5-f58822b9b5c6 -p 172.16.0.220:3260 --login {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:17:56 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3dfb7018-b582-43c0-b9b5-f58822b9b5c6 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:17:56 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[beb9ce6f-745a-4f0f-a20f-546b0bb35f68]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3dfb7018-b582-43c0-b9b5-f58822b9b5c6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3dfb7018-b582-43c0-b9b5-f58822b9b5c6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:17:56 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5914fc6-1497-4d91-9c7d-191cf12aa3a1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3dfb7018-b582-43c0-b9b5-f58822b9b5c6, portal: 172.16.0.220,3260]
Apr 14 11:17:56 user nova-compute[71509]: Login to [iface: default, target: iqn.2010-10.org.openstack:3dfb7018-b582-43c0-b9b5-f58822b9b5c6, portal: 172.16.0.220,3260] successful.
Apr 14 11:17:56 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:17:56 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3dfb7018-b582-43c0-b9b5-f58822b9b5c6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:17:56 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3dfb7018-b582-43c0-b9b5-f58822b9b5c6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:17:56 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[483e8bc5-8332-4e88-8b35-7034203ec0bf]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:17:56 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5914fc6-1497-4d91-9c7d-191cf12aa3a1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:17:56 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:17:56 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:17:56 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[49aa0abb-b025-4cf2-9cab-e2bacdccadd3]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dfb7018-b582-43c0-b9b5-f58822b9b5c6 (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:17:56 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5914fc6-1497-4d91-9c7d-191cf12aa3a1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dfb7018-b582-43c0-b9b5-f58822b9b5c6 (non-flash)
Apr 14 11:17:56 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 11:17:56 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5914fc6-1497-4d91-9c7d-191cf12aa3a1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dfb7018-b582-43c0-b9b5-f58822b9b5c6 (non-flash)
Apr 14 11:17:56 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 11:17:56 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-f5914fc6-1497-4d91-9c7d-191cf12aa3a1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3dfb7018-b582-43c0-b9b5-f58822b9b5c6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.245s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 11:17:56 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5914fc6-1497-4d91-9c7d-191cf12aa3a1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Connected to 172.16.0.220:3260 {{(pid=71509) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 11:17:56 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-f5914fc6-1497-4d91-9c7d-191cf12aa3a1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=71509) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 11:17:56 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-f5914fc6-1497-4d91-9c7d-191cf12aa3a1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=71509) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 11:17:56 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:17:56 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:17:56 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[b81d6273-a7cb-47f4-bd27-9ceda76edc34]: (4, ('- - 0', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:17:56 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-f5914fc6-1497-4d91-9c7d-191cf12aa3a1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: None {{(pid=71509) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 11:17:57 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-f5914fc6-1497-4d91-9c7d-191cf12aa3a1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=71509) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 11:17:57 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5914fc6-1497-4d91-9c7d-191cf12aa3a1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3dfb7018-b582-43c0-b9b5-f58822b9b5c6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jHsTtaBE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71509) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 11:17:57 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-f5914fc6-1497-4d91-9c7d-191cf12aa3a1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.275s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 11:17:57 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5914fc6-1497-4d91-9c7d-191cf12aa3a1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] <== connect_volume: return (1276ms) {'type': 'block', 'scsi_wwn': '23663383439623332', 'path': '/dev/sdb'} {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 11:17:57 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5914fc6-1497-4d91-9c7d-191cf12aa3a1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: bfd4b9b2-a5fe-412f-b17b-2d45367ea438] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23663383439623332', 'path': '/dev/sdb'} {{(pid=71509) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 11:17:57 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-f5914fc6-1497-4d91-9c7d-191cf12aa3a1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T11:17:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-354097238',display_name='tempest-TestVolumeBootPattern-server-354097238',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-354097238',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBafeRTei9AGsMhDE/c+DnIhp7w6x54r1wV/PnusBRf64WHX2LZne4yrEE3WXFq7Jmo1e2MZSS8o0Igq9Iy9JMCogkqExXP7DS8p2/L3yNdO3UPcBKE6h/z0FEi5FWn3lg==',key_name='tempest-TestVolumeBootPattern-994193383',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e7089cb52574f1daf7f578222bb7a67',ramdisk_id='',reservation_id='r-usjuj15y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-193101874',owner_user_name='tempest-TestVolumeBootPattern-193101874-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T11:17:51Z,user_data=None,user_id='c7644d02bc784e4fb74ebaaceb3affe1',uuid=bfd4b9b2-a5fe-412f-b17b-2d45367ea438,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0c3004b4-2439-46a3-b5f9-67e77b319a70", "address": "fa:16:3e:a2:68:21", "network": {"id": "6d6b6b35-b5ef-4d7c-abce-cad21cc99e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-878222456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e7089cb52574f1daf7f578222bb7a67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c3004b4-24", "ovs_interfaceid": "0c3004b4-2439-46a3-b5f9-67e77b319a70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71509) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 11:17:57 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-f5914fc6-1497-4d91-9c7d-191cf12aa3a1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Converting VIF {"id": "0c3004b4-2439-46a3-b5f9-67e77b319a70", "address": "fa:16:3e:a2:68:21", "network": {"id": "6d6b6b35-b5ef-4d7c-abce-cad21cc99e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-878222456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e7089cb52574f1daf7f578222bb7a67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c3004b4-24", "ovs_interfaceid": "0c3004b4-2439-46a3-b5f9-67e77b319a70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 11:17:57 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-f5914fc6-1497-4d91-9c7d-191cf12aa3a1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:68:21,bridge_name='br-int',has_traffic_filtering=True,id=0c3004b4-2439-46a3-b5f9-67e77b319a70,network=Network(6d6b6b35-b5ef-4d7c-abce-cad21cc99e32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c3004b4-24') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 11:17:57 user nova-compute[71509]: DEBUG nova.objects.instance [None req-f5914fc6-1497-4d91-9c7d-191cf12aa3a1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lazy-loading 'pci_devices' on Instance uuid bfd4b9b2-a5fe-412f-b17b-2d45367ea438 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 11:17:57 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-f5914fc6-1497-4d91-9c7d-191cf12aa3a1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: bfd4b9b2-a5fe-412f-b17b-2d45367ea438] End _get_guest_xml xml=<domain type="kvm">
Apr 14 11:17:57 user nova-compute[71509]:   <uuid>bfd4b9b2-a5fe-412f-b17b-2d45367ea438</uuid>
Apr 14 11:17:57 user nova-compute[71509]:   <name>instance-0000002e</name>
Apr 14 11:17:57 user nova-compute[71509]:   <memory>131072</memory>
Apr 14 11:17:57 user nova-compute[71509]:   <vcpu>1</vcpu>
Apr 14 11:17:57 user nova-compute[71509]:   <metadata>
Apr 14 11:17:57 user nova-compute[71509]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 11:17:57 user nova-compute[71509]:       <nova:package version="0.0.0"/>
Apr 14 11:17:57 user nova-compute[71509]:       <nova:name>tempest-TestVolumeBootPattern-server-354097238</nova:name>
Apr 14 11:17:57 user nova-compute[71509]:       <nova:creationTime>2023-04-14 11:17:55</nova:creationTime>
Apr 14 11:17:57 user nova-compute[71509]:       <nova:flavor name="m1.nano">
Apr 14 11:17:57 user nova-compute[71509]:         <nova:memory>128</nova:memory>
Apr 14 11:17:57 user nova-compute[71509]:         <nova:disk>1</nova:disk>
Apr 14 11:17:57 user nova-compute[71509]:         <nova:swap>0</nova:swap>
Apr 14 11:17:57 user nova-compute[71509]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 11:17:57 user nova-compute[71509]:         <nova:vcpus>1</nova:vcpus>
Apr 14 11:17:57 user nova-compute[71509]:       </nova:flavor>
Apr 14 11:17:57 user nova-compute[71509]:       <nova:owner>
Apr 14 11:17:57 user nova-compute[71509]:         <nova:user uuid="c7644d02bc784e4fb74ebaaceb3affe1">tempest-TestVolumeBootPattern-193101874-project-member</nova:user>
Apr 14 11:17:57 user nova-compute[71509]:         <nova:project uuid="2e7089cb52574f1daf7f578222bb7a67">tempest-TestVolumeBootPattern-193101874</nova:project>
Apr 14 11:17:57 user nova-compute[71509]:       </nova:owner>
Apr 14 11:17:57 user nova-compute[71509]:       <nova:ports>
Apr 14 11:17:57 user nova-compute[71509]:         <nova:port uuid="0c3004b4-2439-46a3-b5f9-67e77b319a70">
Apr 14 11:17:57 user nova-compute[71509]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Apr 14 11:17:57 user nova-compute[71509]:         </nova:port>
Apr 14 11:17:57 user nova-compute[71509]:       </nova:ports>
Apr 14 11:17:57 user nova-compute[71509]:     </nova:instance>
Apr 14 11:17:57 user nova-compute[71509]:   </metadata>
Apr 14 11:17:57 user nova-compute[71509]:   <sysinfo type="smbios">
Apr 14 11:17:57 user nova-compute[71509]:     <system>
Apr 14 11:17:57 user nova-compute[71509]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 11:17:57 user nova-compute[71509]:       <entry name="product">OpenStack Nova</entry>
Apr 14 11:17:57 user nova-compute[71509]:       <entry name="version">0.0.0</entry>
Apr 14 11:17:57 user nova-compute[71509]:       <entry name="serial">bfd4b9b2-a5fe-412f-b17b-2d45367ea438</entry>
Apr 14 11:17:57 user nova-compute[71509]:       <entry name="uuid">bfd4b9b2-a5fe-412f-b17b-2d45367ea438</entry>
Apr 14 11:17:57 user nova-compute[71509]:       <entry name="family">Virtual Machine</entry>
Apr 14 11:17:57 user nova-compute[71509]:     </system>
Apr 14 11:17:57 user nova-compute[71509]:   </sysinfo>
Apr 14 11:17:57 user nova-compute[71509]:   <os>
Apr 14 11:17:57 user nova-compute[71509]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 11:17:57 user nova-compute[71509]:     <boot dev="hd"/>
Apr 14 11:17:57 user nova-compute[71509]:     <smbios mode="sysinfo"/>
Apr 14 11:17:57 user nova-compute[71509]:   </os>
Apr 14 11:17:57 user nova-compute[71509]:   <features>
Apr 14 11:17:57 user nova-compute[71509]:     <acpi/>
Apr 14 11:17:57 user nova-compute[71509]:     <apic/>
Apr 14 11:17:57 user nova-compute[71509]:     <vmcoreinfo/>
Apr 14 11:17:57 user nova-compute[71509]:   </features>
Apr 14 11:17:57 user nova-compute[71509]:   <clock offset="utc">
Apr 14 11:17:57 user nova-compute[71509]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 11:17:57 user nova-compute[71509]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 11:17:57 user nova-compute[71509]:     <timer name="hpet" present="no"/>
Apr 14 11:17:57 user nova-compute[71509]:   </clock>
Apr 14 11:17:57 user nova-compute[71509]:   <cpu mode="custom" match="exact">
Apr 14 11:17:57 user nova-compute[71509]:     <model>Nehalem</model>
Apr 14 11:17:57 user nova-compute[71509]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 11:17:57 user nova-compute[71509]:   </cpu>
Apr 14 11:17:57 user nova-compute[71509]:   <devices>
Apr 14 11:17:57 user nova-compute[71509]:     <disk type="block" device="disk">
Apr 14 11:17:57 user nova-compute[71509]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 11:17:57 user nova-compute[71509]:       <source dev="/dev/sdb"/>
Apr 14 11:17:57 user nova-compute[71509]:       <target dev="vda" bus="virtio"/>
Apr 14 11:17:57 user nova-compute[71509]:       <serial>3dfb7018-b582-43c0-b9b5-f58822b9b5c6</serial>
Apr 14 11:17:57 user nova-compute[71509]:     </disk>
Apr 14 11:17:57 user nova-compute[71509]:     <interface type="ethernet">
Apr 14 11:17:57 user nova-compute[71509]:       <mac address="fa:16:3e:a2:68:21"/>
Apr 14 11:17:57 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 11:17:57 user nova-compute[71509]:       <mtu size="1442"/>
Apr 14 11:17:57 user nova-compute[71509]:       <target dev="tap0c3004b4-24"/>
Apr 14 11:17:57 user nova-compute[71509]:     </interface>
Apr 14 11:17:57 user nova-compute[71509]:     <serial type="pty">
Apr 14 11:17:57 user nova-compute[71509]:       <log file="/opt/stack/data/nova/instances/bfd4b9b2-a5fe-412f-b17b-2d45367ea438/console.log" append="off"/>
Apr 14 11:17:57 user nova-compute[71509]:     </serial>
Apr 14 11:17:57 user nova-compute[71509]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 11:17:57 user nova-compute[71509]:     <video>
Apr 14 11:17:57 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 11:17:57 user nova-compute[71509]:     </video>
Apr 14 11:17:57 user nova-compute[71509]:     <rng model="virtio">
Apr 14 11:17:57 user nova-compute[71509]:       <backend model="random">/dev/urandom</backend>
Apr 14 11:17:57 user nova-compute[71509]:     </rng>
Apr 14 11:17:57 user nova-compute[71509]:     <controller type="usb" index="0" model="none"/>
Apr 14 11:17:57 user nova-compute[71509]:     <memballoon model="virtio">
Apr 14 11:17:57 user nova-compute[71509]:       <stats period="10"/>
Apr 14 11:17:57 user nova-compute[71509]:     </memballoon>
Apr 14 11:17:57 user nova-compute[71509]:   </devices>
Apr 14 11:17:57 user nova-compute[71509]: </domain>
Apr 14 11:17:57 user nova-compute[71509]:  {{(pid=71509) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 11:17:57 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-f5914fc6-1497-4d91-9c7d-191cf12aa3a1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T11:17:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-354097238',display_name='tempest-TestVolumeBootPattern-server-354097238',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-354097238',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBafeRTei9AGsMhDE/c+DnIhp7w6x54r1wV/PnusBRf64WHX2LZne4yrEE3WXFq7Jmo1e2MZSS8o0Igq9Iy9JMCogkqExXP7DS8p2/L3yNdO3UPcBKE6h/z0FEi5FWn3lg==',key_name='tempest-TestVolumeBootPattern-994193383',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e7089cb52574f1daf7f578222bb7a67',ramdisk_id='',reservation_id='r-usjuj15y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-193101874',owner_user_name='tempest-TestVolumeBootPattern-193101874-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T11:17:51Z,user_data=None,user_id='c7644d02bc784e4fb74ebaaceb3affe1',uuid=bfd4b9b2-a5fe-412f-b17b-2d45367ea438,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0c3004b4-2439-46a3-b5f9-67e77b319a70", "address": "fa:16:3e:a2:68:21", "network": {"id": "6d6b6b35-b5ef-4d7c-abce-cad21cc99e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-878222456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e7089cb52574f1daf7f578222bb7a67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c3004b4-24", "ovs_interfaceid": "0c3004b4-2439-46a3-b5f9-67e77b319a70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 11:17:57 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-f5914fc6-1497-4d91-9c7d-191cf12aa3a1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Converting VIF {"id": "0c3004b4-2439-46a3-b5f9-67e77b319a70", "address": "fa:16:3e:a2:68:21", "network": {"id": "6d6b6b35-b5ef-4d7c-abce-cad21cc99e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-878222456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e7089cb52574f1daf7f578222bb7a67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c3004b4-24", "ovs_interfaceid": "0c3004b4-2439-46a3-b5f9-67e77b319a70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 11:17:57 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-f5914fc6-1497-4d91-9c7d-191cf12aa3a1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:68:21,bridge_name='br-int',has_traffic_filtering=True,id=0c3004b4-2439-46a3-b5f9-67e77b319a70,network=Network(6d6b6b35-b5ef-4d7c-abce-cad21cc99e32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c3004b4-24') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 11:17:57 user nova-compute[71509]: DEBUG os_vif [None req-f5914fc6-1497-4d91-9c7d-191cf12aa3a1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:68:21,bridge_name='br-int',has_traffic_filtering=True,id=0c3004b4-2439-46a3-b5f9-67e77b319a70,network=Network(6d6b6b35-b5ef-4d7c-abce-cad21cc99e32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c3004b4-24') {{(pid=71509) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 11:17:57 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:17:57 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:17:57 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 11:17:57 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:17:57 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0c3004b4-24, may_exist=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:17:57 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0c3004b4-24, col_values=(('external_ids', {'iface-id': '0c3004b4-2439-46a3-b5f9-67e77b319a70', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a2:68:21', 'vm-uuid': 'bfd4b9b2-a5fe-412f-b17b-2d45367ea438'}),)) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:17:57 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:17:57 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:17:57 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:17:57 user nova-compute[71509]: INFO os_vif [None req-f5914fc6-1497-4d91-9c7d-191cf12aa3a1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:68:21,bridge_name='br-int',has_traffic_filtering=True,id=0c3004b4-2439-46a3-b5f9-67e77b319a70,network=Network(6d6b6b35-b5ef-4d7c-abce-cad21cc99e32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c3004b4-24')
Apr 14 11:17:57 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-f5914fc6-1497-4d91-9c7d-191cf12aa3a1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] No BDM found with device name vda, not building metadata. {{(pid=71509) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 11:17:57 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-f5914fc6-1497-4d91-9c7d-191cf12aa3a1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] No VIF found with MAC fa:16:3e:a2:68:21, not building metadata {{(pid=71509) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 11:17:58 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:17:58 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:17:58 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:17:58 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:17:58 user nova-compute[71509]: DEBUG nova.compute.manager [req-917765d4-648f-4ab0-9f02-52df2d75f8ac req-92f29337-7231-475f-8eb6-8b5b63f3b510 service nova] [instance: bfd4b9b2-a5fe-412f-b17b-2d45367ea438] Received event network-vif-plugged-0c3004b4-2439-46a3-b5f9-67e77b319a70 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:17:58 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-917765d4-648f-4ab0-9f02-52df2d75f8ac req-92f29337-7231-475f-8eb6-8b5b63f3b510 service nova] Acquiring lock "bfd4b9b2-a5fe-412f-b17b-2d45367ea438-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:17:58 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-917765d4-648f-4ab0-9f02-52df2d75f8ac req-92f29337-7231-475f-8eb6-8b5b63f3b510 service nova] Lock "bfd4b9b2-a5fe-412f-b17b-2d45367ea438-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:17:58 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-917765d4-648f-4ab0-9f02-52df2d75f8ac req-92f29337-7231-475f-8eb6-8b5b63f3b510 service nova] Lock "bfd4b9b2-a5fe-412f-b17b-2d45367ea438-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:17:58 user nova-compute[71509]: DEBUG nova.compute.manager [req-917765d4-648f-4ab0-9f02-52df2d75f8ac req-92f29337-7231-475f-8eb6-8b5b63f3b510 service nova] [instance: bfd4b9b2-a5fe-412f-b17b-2d45367ea438] No waiting events found dispatching network-vif-plugged-0c3004b4-2439-46a3-b5f9-67e77b319a70 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:17:58 user nova-compute[71509]: WARNING nova.compute.manager [req-917765d4-648f-4ab0-9f02-52df2d75f8ac req-92f29337-7231-475f-8eb6-8b5b63f3b510 service nova] [instance: bfd4b9b2-a5fe-412f-b17b-2d45367ea438] Received unexpected event network-vif-plugged-0c3004b4-2439-46a3-b5f9-67e77b319a70 for instance with vm_state building and task_state spawning.
Apr 14 11:17:59 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:17:59 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:17:59 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:18:00 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:18:00 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:18:00 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681471080.8473468, bfd4b9b2-a5fe-412f-b17b-2d45367ea438 => Resumed> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 11:18:00 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: bfd4b9b2-a5fe-412f-b17b-2d45367ea438] VM Resumed (Lifecycle Event)
Apr 14 11:18:00 user nova-compute[71509]: DEBUG nova.compute.manager [None req-f5914fc6-1497-4d91-9c7d-191cf12aa3a1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: bfd4b9b2-a5fe-412f-b17b-2d45367ea438] Instance event wait completed in 0 seconds for  {{(pid=71509) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 11:18:00 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-f5914fc6-1497-4d91-9c7d-191cf12aa3a1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: bfd4b9b2-a5fe-412f-b17b-2d45367ea438] Guest created on hypervisor {{(pid=71509) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 11:18:00 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: bfd4b9b2-a5fe-412f-b17b-2d45367ea438] Instance spawned successfully.
Apr 14 11:18:00 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-f5914fc6-1497-4d91-9c7d-191cf12aa3a1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: bfd4b9b2-a5fe-412f-b17b-2d45367ea438] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 11:18:00 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: bfd4b9b2-a5fe-412f-b17b-2d45367ea438] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 11:18:00 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: bfd4b9b2-a5fe-412f-b17b-2d45367ea438] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 11:18:00 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-f5914fc6-1497-4d91-9c7d-191cf12aa3a1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: bfd4b9b2-a5fe-412f-b17b-2d45367ea438] Found default for hw_cdrom_bus of ide {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:18:00 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-f5914fc6-1497-4d91-9c7d-191cf12aa3a1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: bfd4b9b2-a5fe-412f-b17b-2d45367ea438] Found default for hw_disk_bus of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:18:00 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-f5914fc6-1497-4d91-9c7d-191cf12aa3a1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: bfd4b9b2-a5fe-412f-b17b-2d45367ea438] Found default for hw_input_bus of None {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:18:00 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-f5914fc6-1497-4d91-9c7d-191cf12aa3a1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: bfd4b9b2-a5fe-412f-b17b-2d45367ea438] Found default for hw_pointer_model of None {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:18:00 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-f5914fc6-1497-4d91-9c7d-191cf12aa3a1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: bfd4b9b2-a5fe-412f-b17b-2d45367ea438] Found default for hw_video_model of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:18:00 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-f5914fc6-1497-4d91-9c7d-191cf12aa3a1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: bfd4b9b2-a5fe-412f-b17b-2d45367ea438] Found default for hw_vif_model of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:18:00 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: bfd4b9b2-a5fe-412f-b17b-2d45367ea438] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 11:18:00 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681471080.848665, bfd4b9b2-a5fe-412f-b17b-2d45367ea438 => Started> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 11:18:00 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: bfd4b9b2-a5fe-412f-b17b-2d45367ea438] VM Started (Lifecycle Event)
Apr 14 11:18:00 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: bfd4b9b2-a5fe-412f-b17b-2d45367ea438] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 11:18:00 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: bfd4b9b2-a5fe-412f-b17b-2d45367ea438] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 11:18:00 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: bfd4b9b2-a5fe-412f-b17b-2d45367ea438] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 11:18:00 user nova-compute[71509]: DEBUG nova.compute.manager [req-b1a58399-0140-4f16-93c0-d3e2bc8acb4f req-f91c7578-c7d9-4af0-9831-ee8a3d8b728b service nova] [instance: bfd4b9b2-a5fe-412f-b17b-2d45367ea438] Received event network-vif-plugged-0c3004b4-2439-46a3-b5f9-67e77b319a70 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:18:00 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-b1a58399-0140-4f16-93c0-d3e2bc8acb4f req-f91c7578-c7d9-4af0-9831-ee8a3d8b728b service nova] Acquiring lock "bfd4b9b2-a5fe-412f-b17b-2d45367ea438-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:18:00 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-b1a58399-0140-4f16-93c0-d3e2bc8acb4f req-f91c7578-c7d9-4af0-9831-ee8a3d8b728b service nova] Lock "bfd4b9b2-a5fe-412f-b17b-2d45367ea438-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:18:00 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-b1a58399-0140-4f16-93c0-d3e2bc8acb4f req-f91c7578-c7d9-4af0-9831-ee8a3d8b728b service nova] Lock "bfd4b9b2-a5fe-412f-b17b-2d45367ea438-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:18:00 user nova-compute[71509]: DEBUG nova.compute.manager [req-b1a58399-0140-4f16-93c0-d3e2bc8acb4f req-f91c7578-c7d9-4af0-9831-ee8a3d8b728b service nova] [instance: bfd4b9b2-a5fe-412f-b17b-2d45367ea438] No waiting events found dispatching network-vif-plugged-0c3004b4-2439-46a3-b5f9-67e77b319a70 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:18:00 user nova-compute[71509]: WARNING nova.compute.manager [req-b1a58399-0140-4f16-93c0-d3e2bc8acb4f req-f91c7578-c7d9-4af0-9831-ee8a3d8b728b service nova] [instance: bfd4b9b2-a5fe-412f-b17b-2d45367ea438] Received unexpected event network-vif-plugged-0c3004b4-2439-46a3-b5f9-67e77b319a70 for instance with vm_state building and task_state spawning.
Apr 14 11:18:00 user nova-compute[71509]: INFO nova.compute.manager [None req-f5914fc6-1497-4d91-9c7d-191cf12aa3a1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: bfd4b9b2-a5fe-412f-b17b-2d45367ea438] Took 5.03 seconds to spawn the instance on the hypervisor.
Apr 14 11:18:00 user nova-compute[71509]: DEBUG nova.compute.manager [None req-f5914fc6-1497-4d91-9c7d-191cf12aa3a1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: bfd4b9b2-a5fe-412f-b17b-2d45367ea438] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 11:18:01 user nova-compute[71509]: INFO nova.compute.manager [None req-f5914fc6-1497-4d91-9c7d-191cf12aa3a1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: bfd4b9b2-a5fe-412f-b17b-2d45367ea438] Took 10.09 seconds to build instance.
Apr 14 11:18:01 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-f5914fc6-1497-4d91-9c7d-191cf12aa3a1 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "bfd4b9b2-a5fe-412f-b17b-2d45367ea438" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.191s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:18:01 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:18:02 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:18:03 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:18:04 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:18:07 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:18:10 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:18:12 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:18:12 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:18:12 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Starting heal instance info cache {{(pid=71509) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 11:18:12 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Rebuilding the list of instances to heal {{(pid=71509) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 11:18:12 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "refresh_cache-bfd4b9b2-a5fe-412f-b17b-2d45367ea438" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 11:18:12 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquired lock "refresh_cache-bfd4b9b2-a5fe-412f-b17b-2d45367ea438" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 11:18:12 user nova-compute[71509]: DEBUG nova.network.neutron [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] [instance: bfd4b9b2-a5fe-412f-b17b-2d45367ea438] Forcefully refreshing network info cache for instance {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 11:18:12 user nova-compute[71509]: DEBUG nova.objects.instance [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lazy-loading 'info_cache' on Instance uuid bfd4b9b2-a5fe-412f-b17b-2d45367ea438 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 11:18:12 user nova-compute[71509]: DEBUG nova.network.neutron [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] [instance: bfd4b9b2-a5fe-412f-b17b-2d45367ea438] Updating instance_info_cache with network_info: [{"id": "0c3004b4-2439-46a3-b5f9-67e77b319a70", "address": "fa:16:3e:a2:68:21", "network": {"id": "6d6b6b35-b5ef-4d7c-abce-cad21cc99e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-878222456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e7089cb52574f1daf7f578222bb7a67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c3004b4-24", "ovs_interfaceid": "0c3004b4-2439-46a3-b5f9-67e77b319a70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:18:13 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Releasing lock "refresh_cache-bfd4b9b2-a5fe-412f-b17b-2d45367ea438" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 11:18:13 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] [instance: bfd4b9b2-a5fe-412f-b17b-2d45367ea438] Updated the network info_cache for instance {{(pid=71509) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 11:18:13 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:18:13 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:18:13 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:18:13 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:18:13 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Auditing locally available compute resources for user (node: user) {{(pid=71509) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 11:18:13 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71509) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 11:18:13 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 11:18:13 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 11:18:13 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Hypervisor/Node resource view: name=user free_ram=8700MB free_disk=25.955432891845703GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71509) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 11:18:13 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:18:13 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:18:13 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance bfd4b9b2-a5fe-412f-b17b-2d45367ea438 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 11:18:13 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71509) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 11:18:13 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71509) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 11:18:13 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 11:18:13 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 11:18:13 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Compute_service record updated for user:user {{(pid=71509) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 11:18:13 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.167s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:18:13 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:18:17 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:18:18 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:18:22 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:18:27 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:18:27 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:18:27 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:18:27 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:18:27 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:18:27 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:18:27 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:18:27 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:18:27 user nova-compute[71509]: DEBUG nova.virt.libvirt.imagecache [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Verify base images {{(pid=71509) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Apr 14 11:18:27 user nova-compute[71509]: DEBUG nova.virt.libvirt.imagecache [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=71509) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Apr 14 11:18:27 user nova-compute[71509]: DEBUG nova.virt.libvirt.imagecache [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] bfd4b9b2-a5fe-412f-b17b-2d45367ea438 is a valid instance name {{(pid=71509) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Apr 14 11:18:27 user nova-compute[71509]: WARNING nova.virt.libvirt.imagecache [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Unknown base file: /opt/stack/data/nova/instances/_base/bceeabb407b636b03ab3d5a839a6c88119d61c6f
Apr 14 11:18:27 user nova-compute[71509]: WARNING nova.virt.libvirt.imagecache [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Unknown base file: /opt/stack/data/nova/instances/_base/e0f320e80a641e533196ffd150f539057568ffff
Apr 14 11:18:27 user nova-compute[71509]: WARNING nova.virt.libvirt.imagecache [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Unknown base file: /opt/stack/data/nova/instances/_base/9ce66efdb94e466916ac9172290bb13aa3df5cc5
Apr 14 11:18:27 user nova-compute[71509]: WARNING nova.virt.libvirt.imagecache [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Unknown base file: /opt/stack/data/nova/instances/_base/e27d1f06e91c1a232b224ca41eca5d0e7500b081
Apr 14 11:18:27 user nova-compute[71509]: WARNING nova.virt.libvirt.imagecache [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Unknown base file: /opt/stack/data/nova/instances/_base/c5f020440b64e6c7c652455c70efc38e975fe977
Apr 14 11:18:27 user nova-compute[71509]: WARNING nova.virt.libvirt.imagecache [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Unknown base file: /opt/stack/data/nova/instances/_base/8d6ec48071dda9a86c9aff1c8830099f36f2c011
Apr 14 11:18:27 user nova-compute[71509]: WARNING nova.virt.libvirt.imagecache [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Unknown base file: /opt/stack/data/nova/instances/_base/da9e2fc411325a89fa8ca14eb35fd7f347f4bb02
Apr 14 11:18:27 user nova-compute[71509]: WARNING nova.virt.libvirt.imagecache [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Unknown base file: /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18
Apr 14 11:18:27 user nova-compute[71509]: WARNING nova.virt.libvirt.imagecache [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Unknown base file: /opt/stack/data/nova/instances/_base/50f3c4c8cd802b0332b5db3ac538fcb7484dd83c
Apr 14 11:18:27 user nova-compute[71509]: WARNING nova.virt.libvirt.imagecache [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Unknown base file: /opt/stack/data/nova/instances/_base/6b8f42e2843f710ca610e9ecab77173b1a99345b
Apr 14 11:18:27 user nova-compute[71509]: INFO nova.virt.libvirt.imagecache [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Removable base files: /opt/stack/data/nova/instances/_base/bceeabb407b636b03ab3d5a839a6c88119d61c6f /opt/stack/data/nova/instances/_base/e0f320e80a641e533196ffd150f539057568ffff /opt/stack/data/nova/instances/_base/9ce66efdb94e466916ac9172290bb13aa3df5cc5 /opt/stack/data/nova/instances/_base/e27d1f06e91c1a232b224ca41eca5d0e7500b081 /opt/stack/data/nova/instances/_base/c5f020440b64e6c7c652455c70efc38e975fe977 /opt/stack/data/nova/instances/_base/8d6ec48071dda9a86c9aff1c8830099f36f2c011 /opt/stack/data/nova/instances/_base/da9e2fc411325a89fa8ca14eb35fd7f347f4bb02 /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18 /opt/stack/data/nova/instances/_base/50f3c4c8cd802b0332b5db3ac538fcb7484dd83c /opt/stack/data/nova/instances/_base/6b8f42e2843f710ca610e9ecab77173b1a99345b
Apr 14 11:18:27 user nova-compute[71509]: INFO nova.virt.libvirt.imagecache [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/bceeabb407b636b03ab3d5a839a6c88119d61c6f
Apr 14 11:18:27 user nova-compute[71509]: INFO nova.virt.libvirt.imagecache [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/e0f320e80a641e533196ffd150f539057568ffff
Apr 14 11:18:27 user nova-compute[71509]: INFO nova.virt.libvirt.imagecache [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/9ce66efdb94e466916ac9172290bb13aa3df5cc5
Apr 14 11:18:27 user nova-compute[71509]: INFO nova.virt.libvirt.imagecache [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/e27d1f06e91c1a232b224ca41eca5d0e7500b081
Apr 14 11:18:27 user nova-compute[71509]: INFO nova.virt.libvirt.imagecache [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/c5f020440b64e6c7c652455c70efc38e975fe977
Apr 14 11:18:27 user nova-compute[71509]: INFO nova.virt.libvirt.imagecache [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/8d6ec48071dda9a86c9aff1c8830099f36f2c011
Apr 14 11:18:27 user nova-compute[71509]: INFO nova.virt.libvirt.imagecache [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/da9e2fc411325a89fa8ca14eb35fd7f347f4bb02
Apr 14 11:18:27 user nova-compute[71509]: INFO nova.virt.libvirt.imagecache [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/5b5ac60144e2eda28cf0a38d9d8d60fe3e4fcb18
Apr 14 11:18:27 user nova-compute[71509]: INFO nova.virt.libvirt.imagecache [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/50f3c4c8cd802b0332b5db3ac538fcb7484dd83c
Apr 14 11:18:27 user nova-compute[71509]: INFO nova.virt.libvirt.imagecache [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/6b8f42e2843f710ca610e9ecab77173b1a99345b
Apr 14 11:18:27 user nova-compute[71509]: DEBUG nova.virt.libvirt.imagecache [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Verification complete {{(pid=71509) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Apr 14 11:18:27 user nova-compute[71509]: DEBUG nova.virt.libvirt.imagecache [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Verify swap images {{(pid=71509) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Apr 14 11:18:27 user nova-compute[71509]: DEBUG nova.virt.libvirt.imagecache [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Verify ephemeral images {{(pid=71509) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Apr 14 11:18:28 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:18:32 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:18:37 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:18:42 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:18:43 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:18:47 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:18:52 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:18:52 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:18:52 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71509) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 11:18:52 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71509) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 11:18:52 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71509) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 11:18:52 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:18:57 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:18:57 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:18:57 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71509) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 11:18:57 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71509) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 11:18:57 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71509) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 11:18:57 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:18:57 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:18:57 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71509) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 11:19:00 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:19:00 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:19:02 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:19:02 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:19:02 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:19:03 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:19:04 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:19:06 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:19:06 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71509) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 14 11:19:07 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:19:08 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:19:08 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Cleaning up deleted instances {{(pid=71509) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 14 11:19:08 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] There are 0 instances to clean {{(pid=71509) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 14 11:19:10 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:19:12 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:19:12 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:19:12 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71509) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 11:19:12 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71509) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 11:19:12 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71509) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 11:19:12 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:19:12 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:19:12 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Starting heal instance info cache {{(pid=71509) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 11:19:12 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Rebuilding the list of instances to heal {{(pid=71509) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 11:19:12 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "refresh_cache-bfd4b9b2-a5fe-412f-b17b-2d45367ea438" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 11:19:12 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquired lock "refresh_cache-bfd4b9b2-a5fe-412f-b17b-2d45367ea438" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 11:19:12 user nova-compute[71509]: DEBUG nova.network.neutron [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] [instance: bfd4b9b2-a5fe-412f-b17b-2d45367ea438] Forcefully refreshing network info cache for instance {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 11:19:12 user nova-compute[71509]: DEBUG nova.objects.instance [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lazy-loading 'info_cache' on Instance uuid bfd4b9b2-a5fe-412f-b17b-2d45367ea438 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 11:19:13 user nova-compute[71509]: DEBUG nova.network.neutron [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] [instance: bfd4b9b2-a5fe-412f-b17b-2d45367ea438] Updating instance_info_cache with network_info: [{"id": "0c3004b4-2439-46a3-b5f9-67e77b319a70", "address": "fa:16:3e:a2:68:21", "network": {"id": "6d6b6b35-b5ef-4d7c-abce-cad21cc99e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-878222456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e7089cb52574f1daf7f578222bb7a67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c3004b4-24", "ovs_interfaceid": "0c3004b4-2439-46a3-b5f9-67e77b319a70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:19:13 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Releasing lock "refresh_cache-bfd4b9b2-a5fe-412f-b17b-2d45367ea438" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 11:19:13 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] [instance: bfd4b9b2-a5fe-412f-b17b-2d45367ea438] Updated the network info_cache for instance {{(pid=71509) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 11:19:13 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:19:13 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:19:14 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:19:14 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:19:14 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:19:14 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:19:14 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Auditing locally available compute resources for user (node: user) {{(pid=71509) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 11:19:14 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71509) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 11:19:14 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 11:19:14 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 11:19:14 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Hypervisor/Node resource view: name=user free_ram=8762MB free_disk=25.954818725585938GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71509) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 11:19:14 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:19:14 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:19:15 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance bfd4b9b2-a5fe-412f-b17b-2d45367ea438 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 11:19:15 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71509) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 11:19:15 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71509) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 11:19:15 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Refreshing inventories for resource provider 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 14 11:19:15 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Updating ProviderTree inventory for provider 52209f7e-594e-4cf4-9018-18636056cd6b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 14 11:19:15 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Updating inventory in ProviderTree for provider 52209f7e-594e-4cf4-9018-18636056cd6b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 14 11:19:15 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Refreshing aggregate associations for resource provider 52209f7e-594e-4cf4-9018-18636056cd6b, aggregates: None {{(pid=71509) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 14 11:19:15 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Refreshing trait associations for resource provider 52209f7e-594e-4cf4-9018-18636056cd6b, traits: COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE42,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_SATA {{(pid=71509) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 14 11:19:15 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 11:19:15 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 11:19:15 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Compute_service record updated for user:user {{(pid=71509) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 11:19:15 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.388s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:19:17 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:19:22 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:19:27 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:19:27 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:19:27 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71509) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 11:19:27 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71509) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 11:19:27 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71509) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 11:19:27 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:19:30 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._sync_power_states {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:19:30 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Triggering sync for uuid bfd4b9b2-a5fe-412f-b17b-2d45367ea438 {{(pid=71509) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10202}}
Apr 14 11:19:30 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "bfd4b9b2-a5fe-412f-b17b-2d45367ea438" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:19:30 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "bfd4b9b2-a5fe-412f-b17b-2d45367ea438" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:19:30 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "bfd4b9b2-a5fe-412f-b17b-2d45367ea438" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.024s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:19:32 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:19:37 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:19:37 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:19:37 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=71509) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 11:19:37 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71509) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 11:19:37 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71509) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 11:19:37 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:19:41 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:19:42 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:19:42 user nova-compute[71509]: DEBUG nova.compute.manager [req-e8aa924e-c373-4b2a-8cbf-987ff38ca4ca req-24d092d6-0feb-4bc0-9acf-de27b01a8558 service nova] [instance: bfd4b9b2-a5fe-412f-b17b-2d45367ea438] Received event network-changed-0c3004b4-2439-46a3-b5f9-67e77b319a70 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:19:42 user nova-compute[71509]: DEBUG nova.compute.manager [req-e8aa924e-c373-4b2a-8cbf-987ff38ca4ca req-24d092d6-0feb-4bc0-9acf-de27b01a8558 service nova] [instance: bfd4b9b2-a5fe-412f-b17b-2d45367ea438] Refreshing instance network info cache due to event network-changed-0c3004b4-2439-46a3-b5f9-67e77b319a70. {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 11:19:42 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-e8aa924e-c373-4b2a-8cbf-987ff38ca4ca req-24d092d6-0feb-4bc0-9acf-de27b01a8558 service nova] Acquiring lock "refresh_cache-bfd4b9b2-a5fe-412f-b17b-2d45367ea438" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 11:19:42 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-e8aa924e-c373-4b2a-8cbf-987ff38ca4ca req-24d092d6-0feb-4bc0-9acf-de27b01a8558 service nova] Acquired lock "refresh_cache-bfd4b9b2-a5fe-412f-b17b-2d45367ea438" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 11:19:42 user nova-compute[71509]: DEBUG nova.network.neutron [req-e8aa924e-c373-4b2a-8cbf-987ff38ca4ca req-24d092d6-0feb-4bc0-9acf-de27b01a8558 service nova] [instance: bfd4b9b2-a5fe-412f-b17b-2d45367ea438] Refreshing network info cache for port 0c3004b4-2439-46a3-b5f9-67e77b319a70 {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 11:19:43 user nova-compute[71509]: DEBUG nova.network.neutron [req-e8aa924e-c373-4b2a-8cbf-987ff38ca4ca req-24d092d6-0feb-4bc0-9acf-de27b01a8558 service nova] [instance: bfd4b9b2-a5fe-412f-b17b-2d45367ea438] Updated VIF entry in instance network info cache for port 0c3004b4-2439-46a3-b5f9-67e77b319a70. {{(pid=71509) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 11:19:43 user nova-compute[71509]: DEBUG nova.network.neutron [req-e8aa924e-c373-4b2a-8cbf-987ff38ca4ca req-24d092d6-0feb-4bc0-9acf-de27b01a8558 service nova] [instance: bfd4b9b2-a5fe-412f-b17b-2d45367ea438] Updating instance_info_cache with network_info: [{"id": "0c3004b4-2439-46a3-b5f9-67e77b319a70", "address": "fa:16:3e:a2:68:21", "network": {"id": "6d6b6b35-b5ef-4d7c-abce-cad21cc99e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-878222456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e7089cb52574f1daf7f578222bb7a67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c3004b4-24", "ovs_interfaceid": "0c3004b4-2439-46a3-b5f9-67e77b319a70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:19:43 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-e8aa924e-c373-4b2a-8cbf-987ff38ca4ca req-24d092d6-0feb-4bc0-9acf-de27b01a8558 service nova] Releasing lock "refresh_cache-bfd4b9b2-a5fe-412f-b17b-2d45367ea438" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 11:19:43 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:19:47 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:19:48 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:19:51 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-343b2ce5-99ed-425c-84a3-d95a5343f83e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "774b8f7e-09d7-4e1e-8abd-371a280fb479" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:19:51 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-343b2ce5-99ed-425c-84a3-d95a5343f83e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "774b8f7e-09d7-4e1e-8abd-371a280fb479" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:19:51 user nova-compute[71509]: DEBUG nova.compute.manager [None req-343b2ce5-99ed-425c-84a3-d95a5343f83e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 774b8f7e-09d7-4e1e-8abd-371a280fb479] Starting instance... {{(pid=71509) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2404}}
Apr 14 11:19:51 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-343b2ce5-99ed-425c-84a3-d95a5343f83e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:19:51 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-343b2ce5-99ed-425c-84a3-d95a5343f83e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:19:51 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-343b2ce5-99ed-425c-84a3-d95a5343f83e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=71509) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Apr 14 11:19:51 user nova-compute[71509]: INFO nova.compute.claims [None req-343b2ce5-99ed-425c-84a3-d95a5343f83e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 774b8f7e-09d7-4e1e-8abd-371a280fb479] Claim successful on node user
Apr 14 11:19:51 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-343b2ce5-99ed-425c-84a3-d95a5343f83e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 11:19:51 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-343b2ce5-99ed-425c-84a3-d95a5343f83e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 11:19:51 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-343b2ce5-99ed-425c-84a3-d95a5343f83e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.204s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:19:51 user nova-compute[71509]: DEBUG nova.compute.manager [None req-343b2ce5-99ed-425c-84a3-d95a5343f83e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 774b8f7e-09d7-4e1e-8abd-371a280fb479] Start building networks asynchronously for instance. {{(pid=71509) _build_resources /opt/stack/nova/nova/compute/manager.py:2784}}
Apr 14 11:19:51 user nova-compute[71509]: DEBUG nova.compute.manager [None req-343b2ce5-99ed-425c-84a3-d95a5343f83e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 774b8f7e-09d7-4e1e-8abd-371a280fb479] Allocating IP information in the background. {{(pid=71509) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1957}}
Apr 14 11:19:51 user nova-compute[71509]: DEBUG nova.network.neutron [None req-343b2ce5-99ed-425c-84a3-d95a5343f83e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 774b8f7e-09d7-4e1e-8abd-371a280fb479] allocate_for_instance() {{(pid=71509) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1154}}
Apr 14 11:19:51 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-343b2ce5-99ed-425c-84a3-d95a5343f83e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 774b8f7e-09d7-4e1e-8abd-371a280fb479] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Apr 14 11:19:51 user nova-compute[71509]: DEBUG nova.compute.manager [None req-343b2ce5-99ed-425c-84a3-d95a5343f83e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 774b8f7e-09d7-4e1e-8abd-371a280fb479] Start building block device mappings for instance. {{(pid=71509) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Apr 14 11:19:51 user nova-compute[71509]: INFO nova.virt.block_device [None req-343b2ce5-99ed-425c-84a3-d95a5343f83e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 774b8f7e-09d7-4e1e-8abd-371a280fb479] Booting with volume 159b8c44-60ec-498e-8d1a-58a29ed9933b at /dev/vda
Apr 14 11:19:51 user nova-compute[71509]: DEBUG nova.policy [None req-343b2ce5-99ed-425c-84a3-d95a5343f83e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c7644d02bc784e4fb74ebaaceb3affe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e7089cb52574f1daf7f578222bb7a67', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=71509) authorize /opt/stack/nova/nova/policy.py:203}}
Apr 14 11:19:51 user nova-compute[71509]: DEBUG os_brick.utils [None req-343b2ce5-99ed-425c-84a3-d95a5343f83e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 11:19:51 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:19:51 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:19:51 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cecc213-dfeb-4762-9c3a-41beea9bdb68]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:50119df3c417\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:19:51 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:19:51 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:19:51 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[a102bc08-c64d-4f72-8e97-65505ae57526]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:19:51 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:19:51 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:19:51 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[e37d65ef-5611-40eb-9052-9b8be9e757b2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:19:51 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[60bc6d02-7011-46ff-ac17-aac63c080d8b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:19:51 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-343b2ce5-99ed-425c-84a3-d95a5343f83e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Running cmd (subprocess): nvme version {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:19:51 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [None req-343b2ce5-99ed-425c-84a3-d95a5343f83e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] 'nvme version' failed. Not Retrying. {{(pid=71509) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 11:19:51 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.nvmeof [None req-343b2ce5-99ed-425c-84a3-d95a5343f83e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] nvme not present on system {{(pid=71509) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Apr 14 11:19:51 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:19:51 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Apr 14 11:19:51 user nova-compute[71509]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Apr 14 11:19:51 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4feb20d-76cc-4a80-bff2-0f6aaf51634a]: (4, '') {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:19:51 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-343b2ce5-99ed-425c-84a3-d95a5343f83e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=71509) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Apr 14 11:19:51 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-343b2ce5-99ed-425c-84a3-d95a5343f83e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=71509) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Apr 14 11:19:51 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.lightos [None req-343b2ce5-99ed-425c-84a3-d95a5343f83e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] LIGHTOS: no hostnqn found. {{(pid=71509) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Apr 14 11:19:51 user nova-compute[71509]: DEBUG os_brick.utils [None req-343b2ce5-99ed-425c-84a3-d95a5343f83e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:50119df3c417', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 11:19:51 user nova-compute[71509]: DEBUG nova.virt.block_device [None req-343b2ce5-99ed-425c-84a3-d95a5343f83e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 774b8f7e-09d7-4e1e-8abd-371a280fb479] Updating existing volume attachment record: 7abe03a3-3530-4d60-a367-7212e10cc7ad {{(pid=71509) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Apr 14 11:19:52 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:19:52 user nova-compute[71509]: DEBUG nova.network.neutron [None req-343b2ce5-99ed-425c-84a3-d95a5343f83e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 774b8f7e-09d7-4e1e-8abd-371a280fb479] Successfully created port: 7a9e10e8-17b9-4d16-a55c-6073e39fc5ed {{(pid=71509) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:546}}
Apr 14 11:19:53 user nova-compute[71509]: DEBUG nova.network.neutron [None req-343b2ce5-99ed-425c-84a3-d95a5343f83e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 774b8f7e-09d7-4e1e-8abd-371a280fb479] Successfully updated port: 7a9e10e8-17b9-4d16-a55c-6073e39fc5ed {{(pid=71509) _update_port /opt/stack/nova/nova/network/neutron.py:584}}
Apr 14 11:19:53 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-343b2ce5-99ed-425c-84a3-d95a5343f83e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "refresh_cache-774b8f7e-09d7-4e1e-8abd-371a280fb479" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 11:19:53 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-343b2ce5-99ed-425c-84a3-d95a5343f83e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquired lock "refresh_cache-774b8f7e-09d7-4e1e-8abd-371a280fb479" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 11:19:53 user nova-compute[71509]: DEBUG nova.network.neutron [None req-343b2ce5-99ed-425c-84a3-d95a5343f83e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 774b8f7e-09d7-4e1e-8abd-371a280fb479] Building network info cache for instance {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2000}}
Apr 14 11:19:53 user nova-compute[71509]: DEBUG nova.network.neutron [None req-343b2ce5-99ed-425c-84a3-d95a5343f83e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 774b8f7e-09d7-4e1e-8abd-371a280fb479] Instance cache missing network info. {{(pid=71509) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}}
Apr 14 11:19:53 user nova-compute[71509]: DEBUG nova.compute.manager [req-6d99cf42-27b3-47cd-a6ec-ffb548e2df3c req-5f109995-4940-4086-b6d5-805e0a9b6032 service nova] [instance: 774b8f7e-09d7-4e1e-8abd-371a280fb479] Received event network-changed-7a9e10e8-17b9-4d16-a55c-6073e39fc5ed {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:19:53 user nova-compute[71509]: DEBUG nova.compute.manager [req-6d99cf42-27b3-47cd-a6ec-ffb548e2df3c req-5f109995-4940-4086-b6d5-805e0a9b6032 service nova] [instance: 774b8f7e-09d7-4e1e-8abd-371a280fb479] Refreshing instance network info cache due to event network-changed-7a9e10e8-17b9-4d16-a55c-6073e39fc5ed. {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 11:19:53 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-6d99cf42-27b3-47cd-a6ec-ffb548e2df3c req-5f109995-4940-4086-b6d5-805e0a9b6032 service nova] Acquiring lock "refresh_cache-774b8f7e-09d7-4e1e-8abd-371a280fb479" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 11:19:53 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:19:53 user nova-compute[71509]: DEBUG nova.network.neutron [None req-343b2ce5-99ed-425c-84a3-d95a5343f83e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 774b8f7e-09d7-4e1e-8abd-371a280fb479] Updating instance_info_cache with network_info: [{"id": "7a9e10e8-17b9-4d16-a55c-6073e39fc5ed", "address": "fa:16:3e:6c:fe:1b", "network": {"id": "6d6b6b35-b5ef-4d7c-abce-cad21cc99e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-878222456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e7089cb52574f1daf7f578222bb7a67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a9e10e8-17", "ovs_interfaceid": "7a9e10e8-17b9-4d16-a55c-6073e39fc5ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:19:53 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-343b2ce5-99ed-425c-84a3-d95a5343f83e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Releasing lock "refresh_cache-774b8f7e-09d7-4e1e-8abd-371a280fb479" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 11:19:53 user nova-compute[71509]: DEBUG nova.compute.manager [None req-343b2ce5-99ed-425c-84a3-d95a5343f83e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 774b8f7e-09d7-4e1e-8abd-371a280fb479] Instance network_info: |[{"id": "7a9e10e8-17b9-4d16-a55c-6073e39fc5ed", "address": "fa:16:3e:6c:fe:1b", "network": {"id": "6d6b6b35-b5ef-4d7c-abce-cad21cc99e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-878222456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e7089cb52574f1daf7f578222bb7a67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a9e10e8-17", "ovs_interfaceid": "7a9e10e8-17b9-4d16-a55c-6073e39fc5ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=71509) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Apr 14 11:19:53 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-6d99cf42-27b3-47cd-a6ec-ffb548e2df3c req-5f109995-4940-4086-b6d5-805e0a9b6032 service nova] Acquired lock "refresh_cache-774b8f7e-09d7-4e1e-8abd-371a280fb479" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 11:19:53 user nova-compute[71509]: DEBUG nova.network.neutron [req-6d99cf42-27b3-47cd-a6ec-ffb548e2df3c req-5f109995-4940-4086-b6d5-805e0a9b6032 service nova] [instance: 774b8f7e-09d7-4e1e-8abd-371a280fb479] Refreshing network info cache for port 7a9e10e8-17b9-4d16-a55c-6073e39fc5ed {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 11:19:54 user nova-compute[71509]: DEBUG nova.network.neutron [req-6d99cf42-27b3-47cd-a6ec-ffb548e2df3c req-5f109995-4940-4086-b6d5-805e0a9b6032 service nova] [instance: 774b8f7e-09d7-4e1e-8abd-371a280fb479] Updated VIF entry in instance network info cache for port 7a9e10e8-17b9-4d16-a55c-6073e39fc5ed. {{(pid=71509) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 11:19:54 user nova-compute[71509]: DEBUG nova.network.neutron [req-6d99cf42-27b3-47cd-a6ec-ffb548e2df3c req-5f109995-4940-4086-b6d5-805e0a9b6032 service nova] [instance: 774b8f7e-09d7-4e1e-8abd-371a280fb479] Updating instance_info_cache with network_info: [{"id": "7a9e10e8-17b9-4d16-a55c-6073e39fc5ed", "address": "fa:16:3e:6c:fe:1b", "network": {"id": "6d6b6b35-b5ef-4d7c-abce-cad21cc99e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-878222456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e7089cb52574f1daf7f578222bb7a67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a9e10e8-17", "ovs_interfaceid": "7a9e10e8-17b9-4d16-a55c-6073e39fc5ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:19:54 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-6d99cf42-27b3-47cd-a6ec-ffb548e2df3c req-5f109995-4940-4086-b6d5-805e0a9b6032 service nova] Releasing lock "refresh_cache-774b8f7e-09d7-4e1e-8abd-371a280fb479" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 11:19:56 user nova-compute[71509]: DEBUG nova.compute.manager [None req-343b2ce5-99ed-425c-84a3-d95a5343f83e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 774b8f7e-09d7-4e1e-8abd-371a280fb479] Start spawning the instance on the hypervisor. {{(pid=71509) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2604}}
Apr 14 11:19:56 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-343b2ce5-99ed-425c-84a3-d95a5343f83e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 774b8f7e-09d7-4e1e-8abd-371a280fb479] Creating instance directory {{(pid=71509) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4698}}
Apr 14 11:19:56 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-343b2ce5-99ed-425c-84a3-d95a5343f83e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 774b8f7e-09d7-4e1e-8abd-371a280fb479] Creating image(s)
Apr 14 11:19:56 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-343b2ce5-99ed-425c-84a3-d95a5343f83e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 774b8f7e-09d7-4e1e-8abd-371a280fb479] Did not create local disks {{(pid=71509) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4834}}
Apr 14 11:19:56 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-343b2ce5-99ed-425c-84a3-d95a5343f83e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 774b8f7e-09d7-4e1e-8abd-371a280fb479] Ensure instance console log exists: /opt/stack/data/nova/instances/774b8f7e-09d7-4e1e-8abd-371a280fb479/console.log {{(pid=71509) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4584}}
Apr 14 11:19:56 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-343b2ce5-99ed-425c-84a3-d95a5343f83e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:19:56 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-343b2ce5-99ed-425c-84a3-d95a5343f83e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:19:56 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-343b2ce5-99ed-425c-84a3-d95a5343f83e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:19:56 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-343b2ce5-99ed-425c-84a3-d95a5343f83e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 774b8f7e-09d7-4e1e-8abd-371a280fb479] Start _get_guest_xml network_info=[{"id": "7a9e10e8-17b9-4d16-a55c-6073e39fc5ed", "address": "fa:16:3e:6c:fe:1b", "network": {"id": "6d6b6b35-b5ef-4d7c-abce-cad21cc99e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-878222456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e7089cb52574f1daf7f578222bb7a67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a9e10e8-17", "ovs_interfaceid": "7a9e10e8-17b9-4d16-a55c-6073e39fc5ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'mount_device': '/dev/vda', 'boot_index': 0, 'device_type': 'disk', 'attachment_id': '7abe03a3-3530-4d60-a367-7212e10cc7ad', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:159b8c44-60ec-498e-8d1a-58a29ed9933b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MhcvaTbL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '774b8f7e-09d7-4e1e-8abd-371a280fb479', 'attached_at': '', 'detached_at': '', 'volume_id': '159b8c44-60ec-498e-8d1a-58a29ed9933b', 'serial': '159b8c44-60ec-498e-8d1a-58a29ed9933b'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'volume_type': None} {{(pid=71509) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7526}}
Apr 14 11:19:56 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-343b2ce5-99ed-425c-84a3-d95a5343f83e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 11:19:56 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-343b2ce5-99ed-425c-84a3-d95a5343f83e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 11:19:56 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-343b2ce5-99ed-425c-84a3-d95a5343f83e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=71509) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5371}}
Apr 14 11:19:56 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-343b2ce5-99ed-425c-84a3-d95a5343f83e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-04-14T10:40:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=128,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Apr 14 11:19:56 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-343b2ce5-99ed-425c-84a3-d95a5343f83e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Flavor limits 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Apr 14 11:19:56 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-343b2ce5-99ed-425c-84a3-d95a5343f83e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Image limits 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Apr 14 11:19:56 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-343b2ce5-99ed-425c-84a3-d95a5343f83e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Flavor pref 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Apr 14 11:19:56 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-343b2ce5-99ed-425c-84a3-d95a5343f83e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Image pref 0:0:0 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Apr 14 11:19:56 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-343b2ce5-99ed-425c-84a3-d95a5343f83e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=71509) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Apr 14 11:19:56 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-343b2ce5-99ed-425c-84a3-d95a5343f83e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Apr 14 11:19:56 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-343b2ce5-99ed-425c-84a3-d95a5343f83e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=71509) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Apr 14 11:19:56 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-343b2ce5-99ed-425c-84a3-d95a5343f83e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Got 1 possible topologies {{(pid=71509) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Apr 14 11:19:56 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-343b2ce5-99ed-425c-84a3-d95a5343f83e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Apr 14 11:19:56 user nova-compute[71509]: DEBUG nova.virt.hardware [None req-343b2ce5-99ed-425c-84a3-d95a5343f83e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=71509) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Apr 14 11:19:56 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-343b2ce5-99ed-425c-84a3-d95a5343f83e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 774b8f7e-09d7-4e1e-8abd-371a280fb479] Calling os-brick to attach iSCSI Volume {{(pid=71509) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Apr 14 11:19:56 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-343b2ce5-99ed-425c-84a3-d95a5343f83e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0bf0749390>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:159b8c44-60ec-498e-8d1a-58a29ed9933b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MhcvaTbL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 11:19:56 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-343b2ce5-99ed-425c-84a3-d95a5343f83e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 11:19:56 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-343b2ce5-99ed-425c-84a3-d95a5343f83e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 11:19:56 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-343b2ce5-99ed-425c-84a3-d95a5343f83e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 11:19:56 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-343b2ce5-99ed-425c-84a3-d95a5343f83e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 11:19:56 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-343b2ce5-99ed-425c-84a3-d95a5343f83e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:159b8c44-60ec-498e-8d1a-58a29ed9933b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 11:19:56 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-343b2ce5-99ed-425c-84a3-d95a5343f83e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:159b8c44-60ec-498e-8d1a-58a29ed9933b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 11:19:56 user nova-compute[71509]: INFO os_brick.initiator.connectors.iscsi [None req-343b2ce5-99ed-425c-84a3-d95a5343f83e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Apr 14 11:19:56 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:159b8c44-60ec-498e-8d1a-58a29ed9933b -p 172.16.0.220:3260 {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:19:56 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:159b8c44-60ec-498e-8d1a-58a29ed9933b -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:19:56 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[a143df92-f616-4115-8024-984e982c6fcb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:19:56 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-343b2ce5-99ed-425c-84a3-d95a5343f83e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Apr 14 11:19:56 user nova-compute[71509]:  {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:19:56 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:159b8c44-60ec-498e-8d1a-58a29ed9933b -p 172.16.0.220:3260 --interface default --op new {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:19:56 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:159b8c44-60ec-498e-8d1a-58a29ed9933b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:19:56 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0b120ec-8d56-496a-a508-e8a19b265ad7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:159b8c44-60ec-498e-8d1a-58a29ed9933b] added\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:19:56 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-343b2ce5-99ed-425c-84a3-d95a5343f83e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:159b8c44-60ec-498e-8d1a-58a29ed9933b] added
Apr 14 11:19:56 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:19:56 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:159b8c44-60ec-498e-8d1a-58a29ed9933b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:19:56 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:159b8c44-60ec-498e-8d1a-58a29ed9933b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:19:56 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a38f188-c915-4d7a-b517-0eaca10a57cf]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:19:56 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-343b2ce5-99ed-425c-84a3-d95a5343f83e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:19:56 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:159b8c44-60ec-498e-8d1a-58a29ed9933b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:19:56 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:159b8c44-60ec-498e-8d1a-58a29ed9933b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:19:56 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[042cfb58-2818-4c15-a63e-4af14363a5ec]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:19:56 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-343b2ce5-99ed-425c-84a3-d95a5343f83e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:19:56 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:159b8c44-60ec-498e-8d1a-58a29ed9933b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MhcvaTbL {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:19:56 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:159b8c44-60ec-498e-8d1a-58a29ed9933b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MhcvaTbL" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:19:56 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d79168e-376f-4a08-922b-b5e7cff43977]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:19:56 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-343b2ce5-99ed-425c-84a3-d95a5343f83e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MhcvaTbL'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:19:56 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:159b8c44-60ec-498e-8d1a-58a29ed9933b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:19:56 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:159b8c44-60ec-498e-8d1a-58a29ed9933b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:19:56 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e466134-f8f5-4e71-8ddd-4d2ff98f3649]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:19:56 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-343b2ce5-99ed-425c-84a3-d95a5343f83e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:19:56 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:19:56 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:19:56 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[68e1ec20-e966-44fe-91af-3c5e41458b09]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dfb7018-b582-43c0-b9b5-f58822b9b5c6 (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:19:56 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-343b2ce5-99ed-425c-84a3-d95a5343f83e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dfb7018-b582-43c0-b9b5-f58822b9b5c6 (non-flash)
Apr 14 11:19:56 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 11:19:56 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-343b2ce5-99ed-425c-84a3-d95a5343f83e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dfb7018-b582-43c0-b9b5-f58822b9b5c6 (non-flash)
Apr 14 11:19:56 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 11:19:56 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:159b8c44-60ec-498e-8d1a-58a29ed9933b -p 172.16.0.220:3260 --login {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:19:56 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:159b8c44-60ec-498e-8d1a-58a29ed9933b -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:19:56 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[475cfa79-4580-4883-8164-7fa73e6ce10a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:159b8c44-60ec-498e-8d1a-58a29ed9933b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:159b8c44-60ec-498e-8d1a-58a29ed9933b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:19:56 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-343b2ce5-99ed-425c-84a3-d95a5343f83e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:159b8c44-60ec-498e-8d1a-58a29ed9933b, portal: 172.16.0.220,3260]
Apr 14 11:19:56 user nova-compute[71509]: Login to [iface: default, target: iqn.2010-10.org.openstack:159b8c44-60ec-498e-8d1a-58a29ed9933b, portal: 172.16.0.220,3260] successful.
Apr 14 11:19:56 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:19:56 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:159b8c44-60ec-498e-8d1a-58a29ed9933b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:19:56 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:159b8c44-60ec-498e-8d1a-58a29ed9933b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:19:56 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[dec73a12-de11-49fb-96ec-256261509e05]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:19:56 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-343b2ce5-99ed-425c-84a3-d95a5343f83e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:19:56 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:19:56 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:19:56 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[359e23aa-bf45-459e-8da8-70d7a53818cd]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dfb7018-b582-43c0-b9b5-f58822b9b5c6 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:159b8c44-60ec-498e-8d1a-58a29ed9933b (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:19:56 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-343b2ce5-99ed-425c-84a3-d95a5343f83e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dfb7018-b582-43c0-b9b5-f58822b9b5c6 (non-flash)
Apr 14 11:19:56 user nova-compute[71509]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:159b8c44-60ec-498e-8d1a-58a29ed9933b (non-flash)
Apr 14 11:19:56 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 11:19:56 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-343b2ce5-99ed-425c-84a3-d95a5343f83e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dfb7018-b582-43c0-b9b5-f58822b9b5c6 (non-flash)
Apr 14 11:19:56 user nova-compute[71509]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:159b8c44-60ec-498e-8d1a-58a29ed9933b (non-flash)
Apr 14 11:19:56 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 11:19:56 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-343b2ce5-99ed-425c-84a3-d95a5343f83e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:159b8c44-60ec-498e-8d1a-58a29ed9933b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.251s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 11:19:56 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-343b2ce5-99ed-425c-84a3-d95a5343f83e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Connected to 172.16.0.220:3260 {{(pid=71509) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Apr 14 11:19:56 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-343b2ce5-99ed-425c-84a3-d95a5343f83e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] HCTL ('34', '-', '-', 0) found on session 54 with lun 0 {{(pid=71509) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Apr 14 11:19:56 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-343b2ce5-99ed-425c-84a3-d95a5343f83e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=71509) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Apr 14 11:19:56 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:19:56 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:19:56 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e0a419b-167a-40c9-8f6c-82b8b60537c8]: (4, ('- - 0', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:19:56 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-343b2ce5-99ed-425c-84a3-d95a5343f83e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Searching for a device in session 54 and hctl ['34', '*', '*', 0] yield: None {{(pid=71509) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 11:19:57 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:19:57 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:19:57 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71509) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 11:19:57 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-343b2ce5-99ed-425c-84a3-d95a5343f83e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Searching for a device in session 54 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=71509) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Apr 14 11:19:57 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-343b2ce5-99ed-425c-84a3-d95a5343f83e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:159b8c44-60ec-498e-8d1a-58a29ed9933b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MhcvaTbL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=71509) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Apr 14 11:19:57 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-343b2ce5-99ed-425c-84a3-d95a5343f83e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.280s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 11:19:57 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-343b2ce5-99ed-425c-84a3-d95a5343f83e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] <== connect_volume: return (1281ms) {'type': 'block', 'scsi_wwn': '23966626463303434', 'path': '/dev/sdc'} {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 11:19:57 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-343b2ce5-99ed-425c-84a3-d95a5343f83e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 774b8f7e-09d7-4e1e-8abd-371a280fb479] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23966626463303434', 'path': '/dev/sdc'} {{(pid=71509) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Apr 14 11:19:57 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-343b2ce5-99ed-425c-84a3-d95a5343f83e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T11:19:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1735930147',display_name='tempest-TestVolumeBootPattern-server-1735930147',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1735930147',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBafeRTei9AGsMhDE/c+DnIhp7w6x54r1wV/PnusBRf64WHX2LZne4yrEE3WXFq7Jmo1e2MZSS8o0Igq9Iy9JMCogkqExXP7DS8p2/L3yNdO3UPcBKE6h/z0FEi5FWn3lg==',key_name='tempest-TestVolumeBootPattern-994193383',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e7089cb52574f1daf7f578222bb7a67',ramdisk_id='',reservation_id='r-xw02yg4k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-193101874',owner_user_name='tempest-TestVolumeBootPattern-193101874-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T11:19:51Z,user_data=None,user_id='c7644d02bc784e4fb74ebaaceb3affe1',uuid=774b8f7e-09d7-4e1e-8abd-371a280fb479,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a9e10e8-17b9-4d16-a55c-6073e39fc5ed", "address": "fa:16:3e:6c:fe:1b", "network": {"id": "6d6b6b35-b5ef-4d7c-abce-cad21cc99e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-878222456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e7089cb52574f1daf7f578222bb7a67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a9e10e8-17", "ovs_interfaceid": "7a9e10e8-17b9-4d16-a55c-6073e39fc5ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=71509) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Apr 14 11:19:57 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-343b2ce5-99ed-425c-84a3-d95a5343f83e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Converting VIF {"id": "7a9e10e8-17b9-4d16-a55c-6073e39fc5ed", "address": "fa:16:3e:6c:fe:1b", "network": {"id": "6d6b6b35-b5ef-4d7c-abce-cad21cc99e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-878222456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e7089cb52574f1daf7f578222bb7a67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a9e10e8-17", "ovs_interfaceid": "7a9e10e8-17b9-4d16-a55c-6073e39fc5ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 11:19:57 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-343b2ce5-99ed-425c-84a3-d95a5343f83e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:fe:1b,bridge_name='br-int',has_traffic_filtering=True,id=7a9e10e8-17b9-4d16-a55c-6073e39fc5ed,network=Network(6d6b6b35-b5ef-4d7c-abce-cad21cc99e32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a9e10e8-17') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 11:19:57 user nova-compute[71509]: DEBUG nova.objects.instance [None req-343b2ce5-99ed-425c-84a3-d95a5343f83e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lazy-loading 'pci_devices' on Instance uuid 774b8f7e-09d7-4e1e-8abd-371a280fb479 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 11:19:57 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-343b2ce5-99ed-425c-84a3-d95a5343f83e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 774b8f7e-09d7-4e1e-8abd-371a280fb479] End _get_guest_xml xml=<domain type="kvm">
Apr 14 11:19:57 user nova-compute[71509]:   <uuid>774b8f7e-09d7-4e1e-8abd-371a280fb479</uuid>
Apr 14 11:19:57 user nova-compute[71509]:   <name>instance-0000002f</name>
Apr 14 11:19:57 user nova-compute[71509]:   <memory>131072</memory>
Apr 14 11:19:57 user nova-compute[71509]:   <vcpu>1</vcpu>
Apr 14 11:19:57 user nova-compute[71509]:   <metadata>
Apr 14 11:19:57 user nova-compute[71509]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Apr 14 11:19:57 user nova-compute[71509]:       <nova:package version="0.0.0"/>
Apr 14 11:19:57 user nova-compute[71509]:       <nova:name>tempest-TestVolumeBootPattern-server-1735930147</nova:name>
Apr 14 11:19:57 user nova-compute[71509]:       <nova:creationTime>2023-04-14 11:19:56</nova:creationTime>
Apr 14 11:19:57 user nova-compute[71509]:       <nova:flavor name="m1.nano">
Apr 14 11:19:57 user nova-compute[71509]:         <nova:memory>128</nova:memory>
Apr 14 11:19:57 user nova-compute[71509]:         <nova:disk>1</nova:disk>
Apr 14 11:19:57 user nova-compute[71509]:         <nova:swap>0</nova:swap>
Apr 14 11:19:57 user nova-compute[71509]:         <nova:ephemeral>0</nova:ephemeral>
Apr 14 11:19:57 user nova-compute[71509]:         <nova:vcpus>1</nova:vcpus>
Apr 14 11:19:57 user nova-compute[71509]:       </nova:flavor>
Apr 14 11:19:57 user nova-compute[71509]:       <nova:owner>
Apr 14 11:19:57 user nova-compute[71509]:         <nova:user uuid="c7644d02bc784e4fb74ebaaceb3affe1">tempest-TestVolumeBootPattern-193101874-project-member</nova:user>
Apr 14 11:19:57 user nova-compute[71509]:         <nova:project uuid="2e7089cb52574f1daf7f578222bb7a67">tempest-TestVolumeBootPattern-193101874</nova:project>
Apr 14 11:19:57 user nova-compute[71509]:       </nova:owner>
Apr 14 11:19:57 user nova-compute[71509]:       <nova:ports>
Apr 14 11:19:57 user nova-compute[71509]:         <nova:port uuid="7a9e10e8-17b9-4d16-a55c-6073e39fc5ed">
Apr 14 11:19:57 user nova-compute[71509]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Apr 14 11:19:57 user nova-compute[71509]:         </nova:port>
Apr 14 11:19:57 user nova-compute[71509]:       </nova:ports>
Apr 14 11:19:57 user nova-compute[71509]:     </nova:instance>
Apr 14 11:19:57 user nova-compute[71509]:   </metadata>
Apr 14 11:19:57 user nova-compute[71509]:   <sysinfo type="smbios">
Apr 14 11:19:57 user nova-compute[71509]:     <system>
Apr 14 11:19:57 user nova-compute[71509]:       <entry name="manufacturer">OpenStack Foundation</entry>
Apr 14 11:19:57 user nova-compute[71509]:       <entry name="product">OpenStack Nova</entry>
Apr 14 11:19:57 user nova-compute[71509]:       <entry name="version">0.0.0</entry>
Apr 14 11:19:57 user nova-compute[71509]:       <entry name="serial">774b8f7e-09d7-4e1e-8abd-371a280fb479</entry>
Apr 14 11:19:57 user nova-compute[71509]:       <entry name="uuid">774b8f7e-09d7-4e1e-8abd-371a280fb479</entry>
Apr 14 11:19:57 user nova-compute[71509]:       <entry name="family">Virtual Machine</entry>
Apr 14 11:19:57 user nova-compute[71509]:     </system>
Apr 14 11:19:57 user nova-compute[71509]:   </sysinfo>
Apr 14 11:19:57 user nova-compute[71509]:   <os>
Apr 14 11:19:57 user nova-compute[71509]:     <type arch="x86_64" machine="pc">hvm</type>
Apr 14 11:19:57 user nova-compute[71509]:     <boot dev="hd"/>
Apr 14 11:19:57 user nova-compute[71509]:     <smbios mode="sysinfo"/>
Apr 14 11:19:57 user nova-compute[71509]:   </os>
Apr 14 11:19:57 user nova-compute[71509]:   <features>
Apr 14 11:19:57 user nova-compute[71509]:     <acpi/>
Apr 14 11:19:57 user nova-compute[71509]:     <apic/>
Apr 14 11:19:57 user nova-compute[71509]:     <vmcoreinfo/>
Apr 14 11:19:57 user nova-compute[71509]:   </features>
Apr 14 11:19:57 user nova-compute[71509]:   <clock offset="utc">
Apr 14 11:19:57 user nova-compute[71509]:     <timer name="pit" tickpolicy="delay"/>
Apr 14 11:19:57 user nova-compute[71509]:     <timer name="rtc" tickpolicy="catchup"/>
Apr 14 11:19:57 user nova-compute[71509]:     <timer name="hpet" present="no"/>
Apr 14 11:19:57 user nova-compute[71509]:   </clock>
Apr 14 11:19:57 user nova-compute[71509]:   <cpu mode="custom" match="exact">
Apr 14 11:19:57 user nova-compute[71509]:     <model>Nehalem</model>
Apr 14 11:19:57 user nova-compute[71509]:     <topology sockets="1" cores="1" threads="1"/>
Apr 14 11:19:57 user nova-compute[71509]:   </cpu>
Apr 14 11:19:57 user nova-compute[71509]:   <devices>
Apr 14 11:19:57 user nova-compute[71509]:     <disk type="block" device="disk">
Apr 14 11:19:57 user nova-compute[71509]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Apr 14 11:19:57 user nova-compute[71509]:       <source dev="/dev/sdc"/>
Apr 14 11:19:57 user nova-compute[71509]:       <target dev="vda" bus="virtio"/>
Apr 14 11:19:57 user nova-compute[71509]:       <serial>159b8c44-60ec-498e-8d1a-58a29ed9933b</serial>
Apr 14 11:19:57 user nova-compute[71509]:     </disk>
Apr 14 11:19:57 user nova-compute[71509]:     <interface type="ethernet">
Apr 14 11:19:57 user nova-compute[71509]:       <mac address="fa:16:3e:6c:fe:1b"/>
Apr 14 11:19:57 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 11:19:57 user nova-compute[71509]:       <mtu size="1442"/>
Apr 14 11:19:57 user nova-compute[71509]:       <target dev="tap7a9e10e8-17"/>
Apr 14 11:19:57 user nova-compute[71509]:     </interface>
Apr 14 11:19:57 user nova-compute[71509]:     <serial type="pty">
Apr 14 11:19:57 user nova-compute[71509]:       <log file="/opt/stack/data/nova/instances/774b8f7e-09d7-4e1e-8abd-371a280fb479/console.log" append="off"/>
Apr 14 11:19:57 user nova-compute[71509]:     </serial>
Apr 14 11:19:57 user nova-compute[71509]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Apr 14 11:19:57 user nova-compute[71509]:     <video>
Apr 14 11:19:57 user nova-compute[71509]:       <model type="virtio"/>
Apr 14 11:19:57 user nova-compute[71509]:     </video>
Apr 14 11:19:57 user nova-compute[71509]:     <rng model="virtio">
Apr 14 11:19:57 user nova-compute[71509]:       <backend model="random">/dev/urandom</backend>
Apr 14 11:19:57 user nova-compute[71509]:     </rng>
Apr 14 11:19:57 user nova-compute[71509]:     <controller type="usb" index="0" model="none"/>
Apr 14 11:19:57 user nova-compute[71509]:     <memballoon model="virtio">
Apr 14 11:19:57 user nova-compute[71509]:       <stats period="10"/>
Apr 14 11:19:57 user nova-compute[71509]:     </memballoon>
Apr 14 11:19:57 user nova-compute[71509]:   </devices>
Apr 14 11:19:57 user nova-compute[71509]: </domain>
Apr 14 11:19:57 user nova-compute[71509]:  {{(pid=71509) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7532}}
Apr 14 11:19:57 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-343b2ce5-99ed-425c-84a3-d95a5343f83e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T11:19:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1735930147',display_name='tempest-TestVolumeBootPattern-server-1735930147',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1735930147',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBafeRTei9AGsMhDE/c+DnIhp7w6x54r1wV/PnusBRf64WHX2LZne4yrEE3WXFq7Jmo1e2MZSS8o0Igq9Iy9JMCogkqExXP7DS8p2/L3yNdO3UPcBKE6h/z0FEi5FWn3lg==',key_name='tempest-TestVolumeBootPattern-994193383',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e7089cb52574f1daf7f578222bb7a67',ramdisk_id='',reservation_id='r-xw02yg4k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-193101874',owner_user_name='tempest-TestVolumeBootPattern-193101874-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-04-14T11:19:51Z,user_data=None,user_id='c7644d02bc784e4fb74ebaaceb3affe1',uuid=774b8f7e-09d7-4e1e-8abd-371a280fb479,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a9e10e8-17b9-4d16-a55c-6073e39fc5ed", "address": "fa:16:3e:6c:fe:1b", "network": {"id": "6d6b6b35-b5ef-4d7c-abce-cad21cc99e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-878222456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e7089cb52574f1daf7f578222bb7a67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a9e10e8-17", "ovs_interfaceid": "7a9e10e8-17b9-4d16-a55c-6073e39fc5ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Apr 14 11:19:57 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-343b2ce5-99ed-425c-84a3-d95a5343f83e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Converting VIF {"id": "7a9e10e8-17b9-4d16-a55c-6073e39fc5ed", "address": "fa:16:3e:6c:fe:1b", "network": {"id": "6d6b6b35-b5ef-4d7c-abce-cad21cc99e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-878222456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e7089cb52574f1daf7f578222bb7a67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a9e10e8-17", "ovs_interfaceid": "7a9e10e8-17b9-4d16-a55c-6073e39fc5ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 11:19:57 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-343b2ce5-99ed-425c-84a3-d95a5343f83e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:fe:1b,bridge_name='br-int',has_traffic_filtering=True,id=7a9e10e8-17b9-4d16-a55c-6073e39fc5ed,network=Network(6d6b6b35-b5ef-4d7c-abce-cad21cc99e32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a9e10e8-17') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 11:19:57 user nova-compute[71509]: DEBUG os_vif [None req-343b2ce5-99ed-425c-84a3-d95a5343f83e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:fe:1b,bridge_name='br-int',has_traffic_filtering=True,id=7a9e10e8-17b9-4d16-a55c-6073e39fc5ed,network=Network(6d6b6b35-b5ef-4d7c-abce-cad21cc99e32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a9e10e8-17') {{(pid=71509) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Apr 14 11:19:57 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:19:57 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:19:57 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Apr 14 11:19:57 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:19:57 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7a9e10e8-17, may_exist=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:19:57 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7a9e10e8-17, col_values=(('external_ids', {'iface-id': '7a9e10e8-17b9-4d16-a55c-6073e39fc5ed', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6c:fe:1b', 'vm-uuid': '774b8f7e-09d7-4e1e-8abd-371a280fb479'}),)) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:19:57 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:19:57 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:19:57 user nova-compute[71509]: INFO os_vif [None req-343b2ce5-99ed-425c-84a3-d95a5343f83e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:fe:1b,bridge_name='br-int',has_traffic_filtering=True,id=7a9e10e8-17b9-4d16-a55c-6073e39fc5ed,network=Network(6d6b6b35-b5ef-4d7c-abce-cad21cc99e32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a9e10e8-17')
Apr 14 11:19:57 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-343b2ce5-99ed-425c-84a3-d95a5343f83e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] No BDM found with device name vda, not building metadata. {{(pid=71509) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Apr 14 11:19:57 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-343b2ce5-99ed-425c-84a3-d95a5343f83e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] No VIF found with MAC fa:16:3e:6c:fe:1b, not building metadata {{(pid=71509) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12041}}
Apr 14 11:19:58 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:19:58 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:19:58 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:19:58 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:19:58 user nova-compute[71509]: DEBUG nova.compute.manager [req-95b106fc-c30b-404e-9ab0-eebb3411c158 req-8d91095d-ac1f-4000-a846-b1931551d913 service nova] [instance: 774b8f7e-09d7-4e1e-8abd-371a280fb479] Received event network-vif-plugged-7a9e10e8-17b9-4d16-a55c-6073e39fc5ed {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:19:58 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-95b106fc-c30b-404e-9ab0-eebb3411c158 req-8d91095d-ac1f-4000-a846-b1931551d913 service nova] Acquiring lock "774b8f7e-09d7-4e1e-8abd-371a280fb479-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:19:58 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-95b106fc-c30b-404e-9ab0-eebb3411c158 req-8d91095d-ac1f-4000-a846-b1931551d913 service nova] Lock "774b8f7e-09d7-4e1e-8abd-371a280fb479-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:19:58 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-95b106fc-c30b-404e-9ab0-eebb3411c158 req-8d91095d-ac1f-4000-a846-b1931551d913 service nova] Lock "774b8f7e-09d7-4e1e-8abd-371a280fb479-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:19:58 user nova-compute[71509]: DEBUG nova.compute.manager [req-95b106fc-c30b-404e-9ab0-eebb3411c158 req-8d91095d-ac1f-4000-a846-b1931551d913 service nova] [instance: 774b8f7e-09d7-4e1e-8abd-371a280fb479] No waiting events found dispatching network-vif-plugged-7a9e10e8-17b9-4d16-a55c-6073e39fc5ed {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:19:58 user nova-compute[71509]: WARNING nova.compute.manager [req-95b106fc-c30b-404e-9ab0-eebb3411c158 req-8d91095d-ac1f-4000-a846-b1931551d913 service nova] [instance: 774b8f7e-09d7-4e1e-8abd-371a280fb479] Received unexpected event network-vif-plugged-7a9e10e8-17b9-4d16-a55c-6073e39fc5ed for instance with vm_state building and task_state spawning.
Apr 14 11:19:59 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:20:00 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681471200.9048562, 774b8f7e-09d7-4e1e-8abd-371a280fb479 => Resumed> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 11:20:00 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 774b8f7e-09d7-4e1e-8abd-371a280fb479] VM Resumed (Lifecycle Event)
Apr 14 11:20:00 user nova-compute[71509]: DEBUG nova.compute.manager [None req-343b2ce5-99ed-425c-84a3-d95a5343f83e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 774b8f7e-09d7-4e1e-8abd-371a280fb479] Instance event wait completed in 0 seconds for  {{(pid=71509) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Apr 14 11:20:00 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-343b2ce5-99ed-425c-84a3-d95a5343f83e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 774b8f7e-09d7-4e1e-8abd-371a280fb479] Guest created on hypervisor {{(pid=71509) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4392}}
Apr 14 11:20:00 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: 774b8f7e-09d7-4e1e-8abd-371a280fb479] Instance spawned successfully.
Apr 14 11:20:00 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-343b2ce5-99ed-425c-84a3-d95a5343f83e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 774b8f7e-09d7-4e1e-8abd-371a280fb479] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:889}}
Apr 14 11:20:00 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 774b8f7e-09d7-4e1e-8abd-371a280fb479] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 11:20:00 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 774b8f7e-09d7-4e1e-8abd-371a280fb479] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 11:20:00 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-343b2ce5-99ed-425c-84a3-d95a5343f83e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 774b8f7e-09d7-4e1e-8abd-371a280fb479] Found default for hw_cdrom_bus of ide {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:20:00 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-343b2ce5-99ed-425c-84a3-d95a5343f83e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 774b8f7e-09d7-4e1e-8abd-371a280fb479] Found default for hw_disk_bus of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:20:00 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-343b2ce5-99ed-425c-84a3-d95a5343f83e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 774b8f7e-09d7-4e1e-8abd-371a280fb479] Found default for hw_input_bus of None {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:20:00 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-343b2ce5-99ed-425c-84a3-d95a5343f83e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 774b8f7e-09d7-4e1e-8abd-371a280fb479] Found default for hw_pointer_model of None {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:20:00 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-343b2ce5-99ed-425c-84a3-d95a5343f83e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 774b8f7e-09d7-4e1e-8abd-371a280fb479] Found default for hw_video_model of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:20:00 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-343b2ce5-99ed-425c-84a3-d95a5343f83e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 774b8f7e-09d7-4e1e-8abd-371a280fb479] Found default for hw_vif_model of virtio {{(pid=71509) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:918}}
Apr 14 11:20:00 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 774b8f7e-09d7-4e1e-8abd-371a280fb479] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 11:20:00 user nova-compute[71509]: DEBUG nova.virt.driver [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] Emitting event <LifecycleEvent: 1681471200.9056466, 774b8f7e-09d7-4e1e-8abd-371a280fb479 => Started> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 11:20:00 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 774b8f7e-09d7-4e1e-8abd-371a280fb479] VM Started (Lifecycle Event)
Apr 14 11:20:00 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 774b8f7e-09d7-4e1e-8abd-371a280fb479] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 11:20:00 user nova-compute[71509]: DEBUG nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 774b8f7e-09d7-4e1e-8abd-371a280fb479] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=71509) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1396}}
Apr 14 11:20:01 user nova-compute[71509]: INFO nova.compute.manager [None req-343b2ce5-99ed-425c-84a3-d95a5343f83e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 774b8f7e-09d7-4e1e-8abd-371a280fb479] Took 4.81 seconds to spawn the instance on the hypervisor.
Apr 14 11:20:01 user nova-compute[71509]: DEBUG nova.compute.manager [None req-343b2ce5-99ed-425c-84a3-d95a5343f83e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 774b8f7e-09d7-4e1e-8abd-371a280fb479] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 11:20:01 user nova-compute[71509]: INFO nova.compute.manager [None req-59a6a9c6-91f5-44ef-8789-68d91373a32b None None] [instance: 774b8f7e-09d7-4e1e-8abd-371a280fb479] During sync_power_state the instance has a pending task (spawning). Skip.
Apr 14 11:20:01 user nova-compute[71509]: DEBUG nova.compute.manager [req-e47a2983-8136-4827-a7a7-ea40758a1494 req-9b3b2d17-9c98-400c-98e2-67aabf348883 service nova] [instance: 774b8f7e-09d7-4e1e-8abd-371a280fb479] Received event network-vif-plugged-7a9e10e8-17b9-4d16-a55c-6073e39fc5ed {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:20:01 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-e47a2983-8136-4827-a7a7-ea40758a1494 req-9b3b2d17-9c98-400c-98e2-67aabf348883 service nova] Acquiring lock "774b8f7e-09d7-4e1e-8abd-371a280fb479-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:20:01 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-e47a2983-8136-4827-a7a7-ea40758a1494 req-9b3b2d17-9c98-400c-98e2-67aabf348883 service nova] Lock "774b8f7e-09d7-4e1e-8abd-371a280fb479-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:20:01 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-e47a2983-8136-4827-a7a7-ea40758a1494 req-9b3b2d17-9c98-400c-98e2-67aabf348883 service nova] Lock "774b8f7e-09d7-4e1e-8abd-371a280fb479-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:20:01 user nova-compute[71509]: DEBUG nova.compute.manager [req-e47a2983-8136-4827-a7a7-ea40758a1494 req-9b3b2d17-9c98-400c-98e2-67aabf348883 service nova] [instance: 774b8f7e-09d7-4e1e-8abd-371a280fb479] No waiting events found dispatching network-vif-plugged-7a9e10e8-17b9-4d16-a55c-6073e39fc5ed {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:20:01 user nova-compute[71509]: WARNING nova.compute.manager [req-e47a2983-8136-4827-a7a7-ea40758a1494 req-9b3b2d17-9c98-400c-98e2-67aabf348883 service nova] [instance: 774b8f7e-09d7-4e1e-8abd-371a280fb479] Received unexpected event network-vif-plugged-7a9e10e8-17b9-4d16-a55c-6073e39fc5ed for instance with vm_state building and task_state spawning.
Apr 14 11:20:01 user nova-compute[71509]: INFO nova.compute.manager [None req-343b2ce5-99ed-425c-84a3-d95a5343f83e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 774b8f7e-09d7-4e1e-8abd-371a280fb479] Took 10.05 seconds to build instance.
Apr 14 11:20:01 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-343b2ce5-99ed-425c-84a3-d95a5343f83e tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "774b8f7e-09d7-4e1e-8abd-371a280fb479" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.139s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:20:01 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:20:02 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:20:02 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:20:03 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:20:03 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:20:04 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:20:06 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:20:07 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:20:12 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:20:12 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Starting heal instance info cache {{(pid=71509) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 11:20:12 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Rebuilding the list of instances to heal {{(pid=71509) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 11:20:12 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "refresh_cache-bfd4b9b2-a5fe-412f-b17b-2d45367ea438" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 11:20:12 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquired lock "refresh_cache-bfd4b9b2-a5fe-412f-b17b-2d45367ea438" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 11:20:12 user nova-compute[71509]: DEBUG nova.network.neutron [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] [instance: bfd4b9b2-a5fe-412f-b17b-2d45367ea438] Forcefully refreshing network info cache for instance {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 11:20:12 user nova-compute[71509]: DEBUG nova.objects.instance [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lazy-loading 'info_cache' on Instance uuid bfd4b9b2-a5fe-412f-b17b-2d45367ea438 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 11:20:12 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:20:12 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:20:12 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=71509) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 11:20:12 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71509) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 11:20:12 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71509) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 11:20:12 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:20:13 user nova-compute[71509]: DEBUG nova.network.neutron [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] [instance: bfd4b9b2-a5fe-412f-b17b-2d45367ea438] Updating instance_info_cache with network_info: [{"id": "0c3004b4-2439-46a3-b5f9-67e77b319a70", "address": "fa:16:3e:a2:68:21", "network": {"id": "6d6b6b35-b5ef-4d7c-abce-cad21cc99e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-878222456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e7089cb52574f1daf7f578222bb7a67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c3004b4-24", "ovs_interfaceid": "0c3004b4-2439-46a3-b5f9-67e77b319a70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:20:13 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Releasing lock "refresh_cache-bfd4b9b2-a5fe-412f-b17b-2d45367ea438" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 11:20:13 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] [instance: bfd4b9b2-a5fe-412f-b17b-2d45367ea438] Updated the network info_cache for instance {{(pid=71509) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 11:20:13 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:20:13 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:20:16 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:20:16 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:20:16 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:20:16 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:20:16 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Auditing locally available compute resources for user (node: user) {{(pid=71509) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 11:20:16 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71509) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 11:20:16 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71509) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 11:20:16 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 11:20:16 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 11:20:16 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Hypervisor/Node resource view: name=user free_ram=8622MB free_disk=25.952896118164062GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71509) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 11:20:16 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:20:16 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:20:17 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance bfd4b9b2-a5fe-412f-b17b-2d45367ea438 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 11:20:17 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 774b8f7e-09d7-4e1e-8abd-371a280fb479 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 11:20:17 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71509) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 11:20:17 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71509) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 11:20:17 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 11:20:17 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 11:20:17 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Compute_service record updated for user:user {{(pid=71509) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 11:20:17 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.207s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:20:17 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:20:18 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:20:22 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:20:23 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:20:27 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:20:28 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:20:32 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:20:37 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:20:42 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:20:47 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:20:48 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:20:52 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:20:57 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:21:00 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:21:00 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71509) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 11:21:02 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:21:02 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:21:03 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:21:04 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:21:04 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:21:07 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:21:07 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:21:12 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:21:12 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Starting heal instance info cache {{(pid=71509) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 11:21:12 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "refresh_cache-774b8f7e-09d7-4e1e-8abd-371a280fb479" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 11:21:12 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquired lock "refresh_cache-774b8f7e-09d7-4e1e-8abd-371a280fb479" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 11:21:12 user nova-compute[71509]: DEBUG nova.network.neutron [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] [instance: 774b8f7e-09d7-4e1e-8abd-371a280fb479] Forcefully refreshing network info cache for instance {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 11:21:12 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:21:12 user nova-compute[71509]: DEBUG nova.network.neutron [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] [instance: 774b8f7e-09d7-4e1e-8abd-371a280fb479] Updating instance_info_cache with network_info: [{"id": "7a9e10e8-17b9-4d16-a55c-6073e39fc5ed", "address": "fa:16:3e:6c:fe:1b", "network": {"id": "6d6b6b35-b5ef-4d7c-abce-cad21cc99e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-878222456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e7089cb52574f1daf7f578222bb7a67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a9e10e8-17", "ovs_interfaceid": "7a9e10e8-17b9-4d16-a55c-6073e39fc5ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:21:12 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Releasing lock "refresh_cache-774b8f7e-09d7-4e1e-8abd-371a280fb479" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 11:21:12 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] [instance: 774b8f7e-09d7-4e1e-8abd-371a280fb479] Updated the network info_cache for instance {{(pid=71509) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 11:21:13 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:21:15 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:21:17 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:21:17 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:21:17 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:21:17 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:21:17 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Auditing locally available compute resources for user (node: user) {{(pid=71509) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 11:21:17 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71509) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 11:21:17 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=71509) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 11:21:17 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:21:18 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 11:21:18 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 11:21:18 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Hypervisor/Node resource view: name=user free_ram=8682MB free_disk=25.95232391357422GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71509) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 11:21:18 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:21:18 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:21:18 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance bfd4b9b2-a5fe-412f-b17b-2d45367ea438 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 11:21:18 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance 774b8f7e-09d7-4e1e-8abd-371a280fb479 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 11:21:18 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=71509) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 11:21:18 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Final resource view: name=user phys_ram=16023MB used_ram=768MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=71509) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 11:21:18 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 11:21:18 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 11:21:18 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Compute_service record updated for user:user {{(pid=71509) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 11:21:18 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.175s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:21:22 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:21:23 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:21:28 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:21:33 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:21:33 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:21:33 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=71509) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Apr 14 11:21:33 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=71509) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 11:21:33 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=71509) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Apr 14 11:21:33 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:21:38 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:21:41 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:21:43 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:21:43 user nova-compute[71509]: DEBUG nova.compute.manager [req-5e432465-0e6c-4c53-9fed-99f7b5e75789 req-3b380267-e226-452a-bb0e-8ba3a9871d7f service nova] [instance: 774b8f7e-09d7-4e1e-8abd-371a280fb479] Received event network-changed-7a9e10e8-17b9-4d16-a55c-6073e39fc5ed {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:21:43 user nova-compute[71509]: DEBUG nova.compute.manager [req-5e432465-0e6c-4c53-9fed-99f7b5e75789 req-3b380267-e226-452a-bb0e-8ba3a9871d7f service nova] [instance: 774b8f7e-09d7-4e1e-8abd-371a280fb479] Refreshing instance network info cache due to event network-changed-7a9e10e8-17b9-4d16-a55c-6073e39fc5ed. {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 11:21:43 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-5e432465-0e6c-4c53-9fed-99f7b5e75789 req-3b380267-e226-452a-bb0e-8ba3a9871d7f service nova] Acquiring lock "refresh_cache-774b8f7e-09d7-4e1e-8abd-371a280fb479" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 11:21:43 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-5e432465-0e6c-4c53-9fed-99f7b5e75789 req-3b380267-e226-452a-bb0e-8ba3a9871d7f service nova] Acquired lock "refresh_cache-774b8f7e-09d7-4e1e-8abd-371a280fb479" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 11:21:43 user nova-compute[71509]: DEBUG nova.network.neutron [req-5e432465-0e6c-4c53-9fed-99f7b5e75789 req-3b380267-e226-452a-bb0e-8ba3a9871d7f service nova] [instance: 774b8f7e-09d7-4e1e-8abd-371a280fb479] Refreshing network info cache for port 7a9e10e8-17b9-4d16-a55c-6073e39fc5ed {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 11:21:43 user nova-compute[71509]: DEBUG nova.network.neutron [req-5e432465-0e6c-4c53-9fed-99f7b5e75789 req-3b380267-e226-452a-bb0e-8ba3a9871d7f service nova] [instance: 774b8f7e-09d7-4e1e-8abd-371a280fb479] Updated VIF entry in instance network info cache for port 7a9e10e8-17b9-4d16-a55c-6073e39fc5ed. {{(pid=71509) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 11:21:43 user nova-compute[71509]: DEBUG nova.network.neutron [req-5e432465-0e6c-4c53-9fed-99f7b5e75789 req-3b380267-e226-452a-bb0e-8ba3a9871d7f service nova] [instance: 774b8f7e-09d7-4e1e-8abd-371a280fb479] Updating instance_info_cache with network_info: [{"id": "7a9e10e8-17b9-4d16-a55c-6073e39fc5ed", "address": "fa:16:3e:6c:fe:1b", "network": {"id": "6d6b6b35-b5ef-4d7c-abce-cad21cc99e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-878222456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e7089cb52574f1daf7f578222bb7a67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a9e10e8-17", "ovs_interfaceid": "7a9e10e8-17b9-4d16-a55c-6073e39fc5ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:21:43 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-5e432465-0e6c-4c53-9fed-99f7b5e75789 req-3b380267-e226-452a-bb0e-8ba3a9871d7f service nova] Releasing lock "refresh_cache-774b8f7e-09d7-4e1e-8abd-371a280fb479" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 11:21:43 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:21:44 user nova-compute[71509]: DEBUG nova.compute.manager [req-f296732c-8c86-42c5-b2b9-66306b76f78f req-ed7bb96d-9a3e-4e94-8cbb-312ef454ebcf service nova] [instance: 774b8f7e-09d7-4e1e-8abd-371a280fb479] Received event network-changed-7a9e10e8-17b9-4d16-a55c-6073e39fc5ed {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:21:44 user nova-compute[71509]: DEBUG nova.compute.manager [req-f296732c-8c86-42c5-b2b9-66306b76f78f req-ed7bb96d-9a3e-4e94-8cbb-312ef454ebcf service nova] [instance: 774b8f7e-09d7-4e1e-8abd-371a280fb479] Refreshing instance network info cache due to event network-changed-7a9e10e8-17b9-4d16-a55c-6073e39fc5ed. {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 11:21:44 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-f296732c-8c86-42c5-b2b9-66306b76f78f req-ed7bb96d-9a3e-4e94-8cbb-312ef454ebcf service nova] Acquiring lock "refresh_cache-774b8f7e-09d7-4e1e-8abd-371a280fb479" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 11:21:44 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-f296732c-8c86-42c5-b2b9-66306b76f78f req-ed7bb96d-9a3e-4e94-8cbb-312ef454ebcf service nova] Acquired lock "refresh_cache-774b8f7e-09d7-4e1e-8abd-371a280fb479" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 11:21:44 user nova-compute[71509]: DEBUG nova.network.neutron [req-f296732c-8c86-42c5-b2b9-66306b76f78f req-ed7bb96d-9a3e-4e94-8cbb-312ef454ebcf service nova] [instance: 774b8f7e-09d7-4e1e-8abd-371a280fb479] Refreshing network info cache for port 7a9e10e8-17b9-4d16-a55c-6073e39fc5ed {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 11:21:44 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-26a0f807-ef45-4a2b-947f-1d62e00fdfe3 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "774b8f7e-09d7-4e1e-8abd-371a280fb479" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:21:44 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-26a0f807-ef45-4a2b-947f-1d62e00fdfe3 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "774b8f7e-09d7-4e1e-8abd-371a280fb479" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:21:44 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-26a0f807-ef45-4a2b-947f-1d62e00fdfe3 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "774b8f7e-09d7-4e1e-8abd-371a280fb479-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:21:44 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-26a0f807-ef45-4a2b-947f-1d62e00fdfe3 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "774b8f7e-09d7-4e1e-8abd-371a280fb479-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:21:44 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-26a0f807-ef45-4a2b-947f-1d62e00fdfe3 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "774b8f7e-09d7-4e1e-8abd-371a280fb479-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:21:44 user nova-compute[71509]: INFO nova.compute.manager [None req-26a0f807-ef45-4a2b-947f-1d62e00fdfe3 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 774b8f7e-09d7-4e1e-8abd-371a280fb479] Terminating instance
Apr 14 11:21:44 user nova-compute[71509]: DEBUG nova.compute.manager [None req-26a0f807-ef45-4a2b-947f-1d62e00fdfe3 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 774b8f7e-09d7-4e1e-8abd-371a280fb479] Start destroying the instance on the hypervisor. {{(pid=71509) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 11:21:44 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:21:44 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:21:44 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:21:44 user nova-compute[71509]: DEBUG nova.network.neutron [req-f296732c-8c86-42c5-b2b9-66306b76f78f req-ed7bb96d-9a3e-4e94-8cbb-312ef454ebcf service nova] [instance: 774b8f7e-09d7-4e1e-8abd-371a280fb479] Updated VIF entry in instance network info cache for port 7a9e10e8-17b9-4d16-a55c-6073e39fc5ed. {{(pid=71509) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 11:21:44 user nova-compute[71509]: DEBUG nova.network.neutron [req-f296732c-8c86-42c5-b2b9-66306b76f78f req-ed7bb96d-9a3e-4e94-8cbb-312ef454ebcf service nova] [instance: 774b8f7e-09d7-4e1e-8abd-371a280fb479] Updating instance_info_cache with network_info: [{"id": "7a9e10e8-17b9-4d16-a55c-6073e39fc5ed", "address": "fa:16:3e:6c:fe:1b", "network": {"id": "6d6b6b35-b5ef-4d7c-abce-cad21cc99e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-878222456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e7089cb52574f1daf7f578222bb7a67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a9e10e8-17", "ovs_interfaceid": "7a9e10e8-17b9-4d16-a55c-6073e39fc5ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:21:44 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-f296732c-8c86-42c5-b2b9-66306b76f78f req-ed7bb96d-9a3e-4e94-8cbb-312ef454ebcf service nova] Releasing lock "refresh_cache-774b8f7e-09d7-4e1e-8abd-371a280fb479" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 11:21:44 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: 774b8f7e-09d7-4e1e-8abd-371a280fb479] Instance destroyed successfully.
Apr 14 11:21:44 user nova-compute[71509]: DEBUG nova.objects.instance [None req-26a0f807-ef45-4a2b-947f-1d62e00fdfe3 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lazy-loading 'resources' on Instance uuid 774b8f7e-09d7-4e1e-8abd-371a280fb479 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 11:21:44 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-26a0f807-ef45-4a2b-947f-1d62e00fdfe3 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T11:19:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1735930147',display_name='tempest-TestVolumeBootPattern-server-1735930147',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1735930147',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBafeRTei9AGsMhDE/c+DnIhp7w6x54r1wV/PnusBRf64WHX2LZne4yrEE3WXFq7Jmo1e2MZSS8o0Igq9Iy9JMCogkqExXP7DS8p2/L3yNdO3UPcBKE6h/z0FEi5FWn3lg==',key_name='tempest-TestVolumeBootPattern-994193383',keypairs=<?>,launch_index=0,launched_at=2023-04-14T11:20:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2e7089cb52574f1daf7f578222bb7a67',ramdisk_id='',reservation_id='r-xw02yg4k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-193101874',owner_user_name='tempest-TestVolumeBootPattern-193101874-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T11:20:01Z,user_data=None,user_id='c7644d02bc784e4fb74ebaaceb3affe1',uuid=774b8f7e-09d7-4e1e-8abd-371a280fb479,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7a9e10e8-17b9-4d16-a55c-6073e39fc5ed", "address": "fa:16:3e:6c:fe:1b", "network": {"id": "6d6b6b35-b5ef-4d7c-abce-cad21cc99e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-878222456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e7089cb52574f1daf7f578222bb7a67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a9e10e8-17", "ovs_interfaceid": "7a9e10e8-17b9-4d16-a55c-6073e39fc5ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 11:21:44 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-26a0f807-ef45-4a2b-947f-1d62e00fdfe3 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Converting VIF {"id": "7a9e10e8-17b9-4d16-a55c-6073e39fc5ed", "address": "fa:16:3e:6c:fe:1b", "network": {"id": "6d6b6b35-b5ef-4d7c-abce-cad21cc99e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-878222456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e7089cb52574f1daf7f578222bb7a67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a9e10e8-17", "ovs_interfaceid": "7a9e10e8-17b9-4d16-a55c-6073e39fc5ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 11:21:44 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-26a0f807-ef45-4a2b-947f-1d62e00fdfe3 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6c:fe:1b,bridge_name='br-int',has_traffic_filtering=True,id=7a9e10e8-17b9-4d16-a55c-6073e39fc5ed,network=Network(6d6b6b35-b5ef-4d7c-abce-cad21cc99e32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a9e10e8-17') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 11:21:44 user nova-compute[71509]: DEBUG os_vif [None req-26a0f807-ef45-4a2b-947f-1d62e00fdfe3 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6c:fe:1b,bridge_name='br-int',has_traffic_filtering=True,id=7a9e10e8-17b9-4d16-a55c-6073e39fc5ed,network=Network(6d6b6b35-b5ef-4d7c-abce-cad21cc99e32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a9e10e8-17') {{(pid=71509) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 11:21:44 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:21:44 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7a9e10e8-17, bridge=br-int, if_exists=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:21:44 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:21:44 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:21:45 user nova-compute[71509]: INFO os_vif [None req-26a0f807-ef45-4a2b-947f-1d62e00fdfe3 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6c:fe:1b,bridge_name='br-int',has_traffic_filtering=True,id=7a9e10e8-17b9-4d16-a55c-6073e39fc5ed,network=Network(6d6b6b35-b5ef-4d7c-abce-cad21cc99e32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a9e10e8-17')
Apr 14 11:21:45 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26a0f807-ef45-4a2b-947f-1d62e00fdfe3 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 774b8f7e-09d7-4e1e-8abd-371a280fb479] calling os-brick to detach iSCSI Volume {{(pid=71509) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 11:21:45 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-26a0f807-ef45-4a2b-947f-1d62e00fdfe3 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0bf0749390>, {'target_iqn': 'iqn.2010-10.org.openstack:159b8c44-60ec-498e-8d1a-58a29ed9933b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MhcvaTbL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc': {}}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 11:21:45 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-26a0f807-ef45-4a2b-947f-1d62e00fdfe3 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 11:21:45 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-26a0f807-ef45-4a2b-947f-1d62e00fdfe3 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 11:21:45 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-26a0f807-ef45-4a2b-947f-1d62e00fdfe3 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 11:21:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:21:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:21:45 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb0a800e-46c6-4ab4-ba8b-cc417c8ca4ca]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:159b8c44-60ec-498e-8d1a-58a29ed9933b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3dfb7018-b582-43c0-b9b5-f58822b9b5c6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:21:45 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-26a0f807-ef45-4a2b-947f-1d62e00fdfe3 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 11:21:45 user nova-compute[71509]: No targets found.
Apr 14 11:21:45 user nova-compute[71509]: iSNS:
Apr 14 11:21:45 user nova-compute[71509]: No targets found.
Apr 14 11:21:45 user nova-compute[71509]: STATIC:
Apr 14 11:21:45 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:159b8c44-60ec-498e-8d1a-58a29ed9933b
Apr 14 11:21:45 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 11:21:45 user nova-compute[71509]:                 Iface Name: default
Apr 14 11:21:45 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:3dfb7018-b582-43c0-b9b5-f58822b9b5c6
Apr 14 11:21:45 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 11:21:45 user nova-compute[71509]:                 Iface Name: default
Apr 14 11:21:45 user nova-compute[71509]: FIRMWARE:
Apr 14 11:21:45 user nova-compute[71509]: No targets found.
Apr 14 11:21:45 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 11:21:45 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-26a0f807-ef45-4a2b-947f-1d62e00fdfe3 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 11:21:45 user nova-compute[71509]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 11:21:45 user nova-compute[71509]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71509) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 11:21:45 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-26a0f807-ef45-4a2b-947f-1d62e00fdfe3 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:159b8c44-60ec-498e-8d1a-58a29ed9933b', 0)] {{(pid=71509) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 11:21:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:21:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:21:45 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7ce96a0-548e-42ce-b9ab-f7af74a72e39]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:159b8c44-60ec-498e-8d1a-58a29ed9933b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3dfb7018-b582-43c0-b9b5-f58822b9b5c6\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:21:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:21:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:21:45 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fa80cab-9753-4437-a098-96346dca3a00]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dfb7018-b582-43c0-b9b5-f58822b9b5c6 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:159b8c44-60ec-498e-8d1a-58a29ed9933b (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:21:45 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-26a0f807-ef45-4a2b-947f-1d62e00fdfe3 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dfb7018-b582-43c0-b9b5-f58822b9b5c6 (non-flash)
Apr 14 11:21:45 user nova-compute[71509]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:159b8c44-60ec-498e-8d1a-58a29ed9933b (non-flash)
Apr 14 11:21:45 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 11:21:45 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-26a0f807-ef45-4a2b-947f-1d62e00fdfe3 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dfb7018-b582-43c0-b9b5-f58822b9b5c6 (non-flash)
Apr 14 11:21:45 user nova-compute[71509]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:159b8c44-60ec-498e-8d1a-58a29ed9933b (non-flash)
Apr 14 11:21:45 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 11:21:45 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-26a0f807-ef45-4a2b-947f-1d62e00fdfe3 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0bf027c700>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:159b8c44-60ec-498e-8d1a-58a29ed9933b'): ({'sdc'}, set())}) {{(pid=71509) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 11:21:45 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-26a0f807-ef45-4a2b-947f-1d62e00fdfe3 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Removing single pathed devices sdc {{(pid=71509) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 11:21:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:21:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:21:45 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[b171baa8-7738-4d8a-983c-85d251f7b24b]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:21:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:21:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:21:45 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[5091676d-2927-485a-bf89-3989ddeaad8d]: (4, ('ok\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:21:45 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-26a0f807-ef45-4a2b-947f-1d62e00fdfe3 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Flushing IO for device /dev/sdc {{(pid=71509) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 11:21:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:21:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.020s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:21:45 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[acbf77b4-8119-4401-8704-41b1027daf7a]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:21:45 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-26a0f807-ef45-4a2b-947f-1d62e00fdfe3 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=71509) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 11:21:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:21:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.056s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:21:45 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[e479ac3d-e01e-4479-b649-1b3ada2b2f2f]: (4, ('1', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:21:45 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-26a0f807-ef45-4a2b-947f-1d62e00fdfe3 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=71509) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 11:21:45 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-26a0f807-ef45-4a2b-947f-1d62e00fdfe3 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] SCSI volumes sdc have been removed. {{(pid=71509) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 11:21:45 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-26a0f807-ef45-4a2b-947f-1d62e00fdfe3 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:159b8c44-60ec-498e-8d1a-58a29ed9933b')] {{(pid=71509) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 11:21:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:159b8c44-60ec-498e-8d1a-58a29ed9933b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:21:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:159b8c44-60ec-498e-8d1a-58a29ed9933b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:21:45 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a2475e2-e565-447b-b1c1-d27eb63411c7]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:21:45 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-26a0f807-ef45-4a2b-947f-1d62e00fdfe3 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:21:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:159b8c44-60ec-498e-8d1a-58a29ed9933b -p 172.16.0.220:3260 --logout {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:21:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:159b8c44-60ec-498e-8d1a-58a29ed9933b -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:21:45 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[9206e103-555a-4efc-a978-09d2c7cc5950]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:159b8c44-60ec-498e-8d1a-58a29ed9933b, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:159b8c44-60ec-498e-8d1a-58a29ed9933b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:21:45 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-26a0f807-ef45-4a2b-947f-1d62e00fdfe3 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:159b8c44-60ec-498e-8d1a-58a29ed9933b, portal: 172.16.0.220,3260]
Apr 14 11:21:45 user nova-compute[71509]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:159b8c44-60ec-498e-8d1a-58a29ed9933b, portal: 172.16.0.220,3260] successful.
Apr 14 11:21:45 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:21:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:159b8c44-60ec-498e-8d1a-58a29ed9933b -p 172.16.0.220:3260 --op delete {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:21:45 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:159b8c44-60ec-498e-8d1a-58a29ed9933b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:21:45 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea6d370f-6231-49c7-8a20-259f1cc4afd1]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:21:45 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-26a0f807-ef45-4a2b-947f-1d62e00fdfe3 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:21:45 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-26a0f807-ef45-4a2b-947f-1d62e00fdfe3 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 11:21:45 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-26a0f807-ef45-4a2b-947f-1d62e00fdfe3 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] <== disconnect_volume: return (314ms) None {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 11:21:45 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26a0f807-ef45-4a2b-947f-1d62e00fdfe3 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 774b8f7e-09d7-4e1e-8abd-371a280fb479] Disconnected iSCSI Volume {{(pid=71509) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 11:21:45 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-26a0f807-ef45-4a2b-947f-1d62e00fdfe3 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 774b8f7e-09d7-4e1e-8abd-371a280fb479] Deleting instance files /opt/stack/data/nova/instances/774b8f7e-09d7-4e1e-8abd-371a280fb479_del
Apr 14 11:21:45 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-26a0f807-ef45-4a2b-947f-1d62e00fdfe3 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 774b8f7e-09d7-4e1e-8abd-371a280fb479] Deletion of /opt/stack/data/nova/instances/774b8f7e-09d7-4e1e-8abd-371a280fb479_del complete
Apr 14 11:21:45 user nova-compute[71509]: DEBUG nova.compute.manager [req-2315a74c-e2b2-4ab6-8210-7e5d81f0d442 req-03ad4c05-c61a-4b6f-b0df-dad71c20b241 service nova] [instance: 774b8f7e-09d7-4e1e-8abd-371a280fb479] Received event network-vif-unplugged-7a9e10e8-17b9-4d16-a55c-6073e39fc5ed {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:21:45 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-2315a74c-e2b2-4ab6-8210-7e5d81f0d442 req-03ad4c05-c61a-4b6f-b0df-dad71c20b241 service nova] Acquiring lock "774b8f7e-09d7-4e1e-8abd-371a280fb479-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:21:45 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-2315a74c-e2b2-4ab6-8210-7e5d81f0d442 req-03ad4c05-c61a-4b6f-b0df-dad71c20b241 service nova] Lock "774b8f7e-09d7-4e1e-8abd-371a280fb479-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:21:45 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-2315a74c-e2b2-4ab6-8210-7e5d81f0d442 req-03ad4c05-c61a-4b6f-b0df-dad71c20b241 service nova] Lock "774b8f7e-09d7-4e1e-8abd-371a280fb479-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:21:45 user nova-compute[71509]: DEBUG nova.compute.manager [req-2315a74c-e2b2-4ab6-8210-7e5d81f0d442 req-03ad4c05-c61a-4b6f-b0df-dad71c20b241 service nova] [instance: 774b8f7e-09d7-4e1e-8abd-371a280fb479] No waiting events found dispatching network-vif-unplugged-7a9e10e8-17b9-4d16-a55c-6073e39fc5ed {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:21:45 user nova-compute[71509]: DEBUG nova.compute.manager [req-2315a74c-e2b2-4ab6-8210-7e5d81f0d442 req-03ad4c05-c61a-4b6f-b0df-dad71c20b241 service nova] [instance: 774b8f7e-09d7-4e1e-8abd-371a280fb479] Received event network-vif-unplugged-7a9e10e8-17b9-4d16-a55c-6073e39fc5ed for instance with task_state deleting. {{(pid=71509) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 11:21:45 user nova-compute[71509]: DEBUG nova.compute.manager [req-2315a74c-e2b2-4ab6-8210-7e5d81f0d442 req-03ad4c05-c61a-4b6f-b0df-dad71c20b241 service nova] [instance: 774b8f7e-09d7-4e1e-8abd-371a280fb479] Received event network-vif-plugged-7a9e10e8-17b9-4d16-a55c-6073e39fc5ed {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:21:45 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-2315a74c-e2b2-4ab6-8210-7e5d81f0d442 req-03ad4c05-c61a-4b6f-b0df-dad71c20b241 service nova] Acquiring lock "774b8f7e-09d7-4e1e-8abd-371a280fb479-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:21:45 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-2315a74c-e2b2-4ab6-8210-7e5d81f0d442 req-03ad4c05-c61a-4b6f-b0df-dad71c20b241 service nova] Lock "774b8f7e-09d7-4e1e-8abd-371a280fb479-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:21:45 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-2315a74c-e2b2-4ab6-8210-7e5d81f0d442 req-03ad4c05-c61a-4b6f-b0df-dad71c20b241 service nova] Lock "774b8f7e-09d7-4e1e-8abd-371a280fb479-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:21:45 user nova-compute[71509]: DEBUG nova.compute.manager [req-2315a74c-e2b2-4ab6-8210-7e5d81f0d442 req-03ad4c05-c61a-4b6f-b0df-dad71c20b241 service nova] [instance: 774b8f7e-09d7-4e1e-8abd-371a280fb479] No waiting events found dispatching network-vif-plugged-7a9e10e8-17b9-4d16-a55c-6073e39fc5ed {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:21:45 user nova-compute[71509]: WARNING nova.compute.manager [req-2315a74c-e2b2-4ab6-8210-7e5d81f0d442 req-03ad4c05-c61a-4b6f-b0df-dad71c20b241 service nova] [instance: 774b8f7e-09d7-4e1e-8abd-371a280fb479] Received unexpected event network-vif-plugged-7a9e10e8-17b9-4d16-a55c-6073e39fc5ed for instance with vm_state active and task_state deleting.
Apr 14 11:21:45 user nova-compute[71509]: INFO nova.compute.manager [None req-26a0f807-ef45-4a2b-947f-1d62e00fdfe3 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 774b8f7e-09d7-4e1e-8abd-371a280fb479] Took 1.17 seconds to destroy the instance on the hypervisor.
Apr 14 11:21:45 user nova-compute[71509]: DEBUG oslo.service.loopingcall [None req-26a0f807-ef45-4a2b-947f-1d62e00fdfe3 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71509) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 11:21:45 user nova-compute[71509]: DEBUG nova.compute.manager [-] [instance: 774b8f7e-09d7-4e1e-8abd-371a280fb479] Deallocating network for instance {{(pid=71509) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 11:21:45 user nova-compute[71509]: DEBUG nova.network.neutron [-] [instance: 774b8f7e-09d7-4e1e-8abd-371a280fb479] deallocate_for_instance() {{(pid=71509) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 11:21:46 user nova-compute[71509]: DEBUG nova.network.neutron [-] [instance: 774b8f7e-09d7-4e1e-8abd-371a280fb479] Updating instance_info_cache with network_info: [] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:21:46 user nova-compute[71509]: INFO nova.compute.manager [-] [instance: 774b8f7e-09d7-4e1e-8abd-371a280fb479] Took 0.77 seconds to deallocate network for instance.
Apr 14 11:21:46 user nova-compute[71509]: DEBUG nova.compute.manager [req-bf7246da-5d45-49f7-a788-506de8bf532a req-8e840140-16df-498b-b237-c161519d0eef service nova] [instance: 774b8f7e-09d7-4e1e-8abd-371a280fb479] Received event network-vif-deleted-7a9e10e8-17b9-4d16-a55c-6073e39fc5ed {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:21:46 user nova-compute[71509]: INFO nova.compute.manager [None req-26a0f807-ef45-4a2b-947f-1d62e00fdfe3 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: 774b8f7e-09d7-4e1e-8abd-371a280fb479] Took 0.78 seconds to detach 1 volumes for instance.
Apr 14 11:21:47 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-26a0f807-ef45-4a2b-947f-1d62e00fdfe3 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:21:47 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-26a0f807-ef45-4a2b-947f-1d62e00fdfe3 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:21:47 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-26a0f807-ef45-4a2b-947f-1d62e00fdfe3 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 11:21:47 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-26a0f807-ef45-4a2b-947f-1d62e00fdfe3 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 11:21:47 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-26a0f807-ef45-4a2b-947f-1d62e00fdfe3 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.123s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:21:47 user nova-compute[71509]: INFO nova.scheduler.client.report [None req-26a0f807-ef45-4a2b-947f-1d62e00fdfe3 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Deleted allocations for instance 774b8f7e-09d7-4e1e-8abd-371a280fb479
Apr 14 11:21:47 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-26a0f807-ef45-4a2b-947f-1d62e00fdfe3 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "774b8f7e-09d7-4e1e-8abd-371a280fb479" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.020s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:21:48 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:21:49 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:21:54 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:21:59 user nova-compute[71509]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681471304.9654737, 774b8f7e-09d7-4e1e-8abd-371a280fb479 => Stopped> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 11:21:59 user nova-compute[71509]: INFO nova.compute.manager [-] [instance: 774b8f7e-09d7-4e1e-8abd-371a280fb479] VM Stopped (Lifecycle Event)
Apr 14 11:21:59 user nova-compute[71509]: DEBUG nova.compute.manager [None req-825df5bb-6a59-4486-af00-2a09fe3d9780 None None] [instance: 774b8f7e-09d7-4e1e-8abd-371a280fb479] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 11:21:59 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:22:01 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:22:01 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71509) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 11:22:04 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:22:04 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:22:05 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:22:05 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:22:06 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:22:09 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:22:10 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:22:13 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:22:13 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Starting heal instance info cache {{(pid=71509) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 11:22:13 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Rebuilding the list of instances to heal {{(pid=71509) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 11:22:13 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "refresh_cache-bfd4b9b2-a5fe-412f-b17b-2d45367ea438" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 11:22:13 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquired lock "refresh_cache-bfd4b9b2-a5fe-412f-b17b-2d45367ea438" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 11:22:13 user nova-compute[71509]: DEBUG nova.network.neutron [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] [instance: bfd4b9b2-a5fe-412f-b17b-2d45367ea438] Forcefully refreshing network info cache for instance {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1994}}
Apr 14 11:22:13 user nova-compute[71509]: DEBUG nova.objects.instance [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lazy-loading 'info_cache' on Instance uuid bfd4b9b2-a5fe-412f-b17b-2d45367ea438 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 11:22:14 user nova-compute[71509]: DEBUG nova.network.neutron [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] [instance: bfd4b9b2-a5fe-412f-b17b-2d45367ea438] Updating instance_info_cache with network_info: [{"id": "0c3004b4-2439-46a3-b5f9-67e77b319a70", "address": "fa:16:3e:a2:68:21", "network": {"id": "6d6b6b35-b5ef-4d7c-abce-cad21cc99e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-878222456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e7089cb52574f1daf7f578222bb7a67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c3004b4-24", "ovs_interfaceid": "0c3004b4-2439-46a3-b5f9-67e77b319a70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:22:14 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Releasing lock "refresh_cache-bfd4b9b2-a5fe-412f-b17b-2d45367ea438" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 11:22:14 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] [instance: bfd4b9b2-a5fe-412f-b17b-2d45367ea438] Updated the network info_cache for instance {{(pid=71509) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9863}}
Apr 14 11:22:15 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:22:15 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:22:18 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:22:18 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:22:18 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:22:18 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:22:18 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Auditing locally available compute resources for user (node: user) {{(pid=71509) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 11:22:18 user nova-compute[71509]: DEBUG nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=71509) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11189}}
Apr 14 11:22:18 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 11:22:18 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 11:22:18 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Hypervisor/Node resource view: name=user free_ram=8737MB free_disk=25.951427459716797GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71509) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 11:22:18 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:22:18 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:22:19 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Instance bfd4b9b2-a5fe-412f-b17b-2d45367ea438 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 128, 'VCPU': 1}}. {{(pid=71509) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1632}}
Apr 14 11:22:19 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=71509) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 11:22:19 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Final resource view: name=user phys_ram=16023MB used_ram=640MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=71509) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 11:22:19 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 11:22:19 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 11:22:19 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Compute_service record updated for user:user {{(pid=71509) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 11:22:19 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.160s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:22:20 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:22:25 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:22:30 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:22:35 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:22:38 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:22:40 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:22:41 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-cc3da336-ccf0-4a21-b86c-5f39576e2469 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "bfd4b9b2-a5fe-412f-b17b-2d45367ea438" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:22:41 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-cc3da336-ccf0-4a21-b86c-5f39576e2469 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "bfd4b9b2-a5fe-412f-b17b-2d45367ea438" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:22:41 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-cc3da336-ccf0-4a21-b86c-5f39576e2469 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "bfd4b9b2-a5fe-412f-b17b-2d45367ea438-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:22:41 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-cc3da336-ccf0-4a21-b86c-5f39576e2469 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "bfd4b9b2-a5fe-412f-b17b-2d45367ea438-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:22:41 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-cc3da336-ccf0-4a21-b86c-5f39576e2469 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "bfd4b9b2-a5fe-412f-b17b-2d45367ea438-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:22:41 user nova-compute[71509]: INFO nova.compute.manager [None req-cc3da336-ccf0-4a21-b86c-5f39576e2469 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: bfd4b9b2-a5fe-412f-b17b-2d45367ea438] Terminating instance
Apr 14 11:22:41 user nova-compute[71509]: DEBUG nova.compute.manager [None req-cc3da336-ccf0-4a21-b86c-5f39576e2469 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: bfd4b9b2-a5fe-412f-b17b-2d45367ea438] Start destroying the instance on the hypervisor. {{(pid=71509) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3105}}
Apr 14 11:22:41 user nova-compute[71509]: DEBUG nova.compute.manager [req-8142bd3c-89e6-46f6-8313-10111bc02a98 req-42ba8012-485f-4096-b56d-868377458744 service nova] [instance: bfd4b9b2-a5fe-412f-b17b-2d45367ea438] Received event network-changed-0c3004b4-2439-46a3-b5f9-67e77b319a70 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:22:41 user nova-compute[71509]: DEBUG nova.compute.manager [req-8142bd3c-89e6-46f6-8313-10111bc02a98 req-42ba8012-485f-4096-b56d-868377458744 service nova] [instance: bfd4b9b2-a5fe-412f-b17b-2d45367ea438] Refreshing instance network info cache due to event network-changed-0c3004b4-2439-46a3-b5f9-67e77b319a70. {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10987}}
Apr 14 11:22:41 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-8142bd3c-89e6-46f6-8313-10111bc02a98 req-42ba8012-485f-4096-b56d-868377458744 service nova] Acquiring lock "refresh_cache-bfd4b9b2-a5fe-412f-b17b-2d45367ea438" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Apr 14 11:22:41 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-8142bd3c-89e6-46f6-8313-10111bc02a98 req-42ba8012-485f-4096-b56d-868377458744 service nova] Acquired lock "refresh_cache-bfd4b9b2-a5fe-412f-b17b-2d45367ea438" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Apr 14 11:22:41 user nova-compute[71509]: DEBUG nova.network.neutron [req-8142bd3c-89e6-46f6-8313-10111bc02a98 req-42ba8012-485f-4096-b56d-868377458744 service nova] [instance: bfd4b9b2-a5fe-412f-b17b-2d45367ea438] Refreshing network info cache for port 0c3004b4-2439-46a3-b5f9-67e77b319a70 {{(pid=71509) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1997}}
Apr 14 11:22:41 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:22:41 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:22:41 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:22:42 user nova-compute[71509]: DEBUG nova.compute.manager [req-3285354e-3eb6-45a8-8945-c3069bbc9d9e req-f36dce00-b88f-47e2-9ffb-661d622a7f58 service nova] [instance: bfd4b9b2-a5fe-412f-b17b-2d45367ea438] Received event network-vif-unplugged-0c3004b4-2439-46a3-b5f9-67e77b319a70 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:22:42 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-3285354e-3eb6-45a8-8945-c3069bbc9d9e req-f36dce00-b88f-47e2-9ffb-661d622a7f58 service nova] Acquiring lock "bfd4b9b2-a5fe-412f-b17b-2d45367ea438-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:22:42 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-3285354e-3eb6-45a8-8945-c3069bbc9d9e req-f36dce00-b88f-47e2-9ffb-661d622a7f58 service nova] Lock "bfd4b9b2-a5fe-412f-b17b-2d45367ea438-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:22:42 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-3285354e-3eb6-45a8-8945-c3069bbc9d9e req-f36dce00-b88f-47e2-9ffb-661d622a7f58 service nova] Lock "bfd4b9b2-a5fe-412f-b17b-2d45367ea438-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:22:42 user nova-compute[71509]: DEBUG nova.compute.manager [req-3285354e-3eb6-45a8-8945-c3069bbc9d9e req-f36dce00-b88f-47e2-9ffb-661d622a7f58 service nova] [instance: bfd4b9b2-a5fe-412f-b17b-2d45367ea438] No waiting events found dispatching network-vif-unplugged-0c3004b4-2439-46a3-b5f9-67e77b319a70 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:22:42 user nova-compute[71509]: DEBUG nova.compute.manager [req-3285354e-3eb6-45a8-8945-c3069bbc9d9e req-f36dce00-b88f-47e2-9ffb-661d622a7f58 service nova] [instance: bfd4b9b2-a5fe-412f-b17b-2d45367ea438] Received event network-vif-unplugged-0c3004b4-2439-46a3-b5f9-67e77b319a70 for instance with task_state deleting. {{(pid=71509) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10760}}
Apr 14 11:22:42 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:22:42 user nova-compute[71509]: DEBUG nova.network.neutron [req-8142bd3c-89e6-46f6-8313-10111bc02a98 req-42ba8012-485f-4096-b56d-868377458744 service nova] [instance: bfd4b9b2-a5fe-412f-b17b-2d45367ea438] Updated VIF entry in instance network info cache for port 0c3004b4-2439-46a3-b5f9-67e77b319a70. {{(pid=71509) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3472}}
Apr 14 11:22:42 user nova-compute[71509]: DEBUG nova.network.neutron [req-8142bd3c-89e6-46f6-8313-10111bc02a98 req-42ba8012-485f-4096-b56d-868377458744 service nova] [instance: bfd4b9b2-a5fe-412f-b17b-2d45367ea438] Updating instance_info_cache with network_info: [{"id": "0c3004b4-2439-46a3-b5f9-67e77b319a70", "address": "fa:16:3e:a2:68:21", "network": {"id": "6d6b6b35-b5ef-4d7c-abce-cad21cc99e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-878222456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e7089cb52574f1daf7f578222bb7a67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c3004b4-24", "ovs_interfaceid": "0c3004b4-2439-46a3-b5f9-67e77b319a70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:22:42 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-8142bd3c-89e6-46f6-8313-10111bc02a98 req-42ba8012-485f-4096-b56d-868377458744 service nova] Releasing lock "refresh_cache-bfd4b9b2-a5fe-412f-b17b-2d45367ea438" {{(pid=71509) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Apr 14 11:22:42 user nova-compute[71509]: INFO nova.virt.libvirt.driver [-] [instance: bfd4b9b2-a5fe-412f-b17b-2d45367ea438] Instance destroyed successfully.
Apr 14 11:22:42 user nova-compute[71509]: DEBUG nova.objects.instance [None req-cc3da336-ccf0-4a21-b86c-5f39576e2469 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lazy-loading 'resources' on Instance uuid bfd4b9b2-a5fe-412f-b17b-2d45367ea438 {{(pid=71509) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}}
Apr 14 11:22:42 user nova-compute[71509]: DEBUG nova.virt.libvirt.vif [None req-cc3da336-ccf0-4a21-b86c-5f39576e2469 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,config_drive='',created_at=2023-04-14T11:17:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-354097238',display_name='tempest-TestVolumeBootPattern-server-354097238',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-354097238',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBafeRTei9AGsMhDE/c+DnIhp7w6x54r1wV/PnusBRf64WHX2LZne4yrEE3WXFq7Jmo1e2MZSS8o0Igq9Iy9JMCogkqExXP7DS8p2/L3yNdO3UPcBKE6h/z0FEi5FWn3lg==',key_name='tempest-TestVolumeBootPattern-994193383',keypairs=<?>,launch_index=0,launched_at=2023-04-14T11:18:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=128,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2e7089cb52574f1daf7f578222bb7a67',ramdisk_id='',reservation_id='r-usjuj15y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.5.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-193101874',owner_user_name='tempest-TestVolumeBootPattern-193101874-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-04-14T11:18:01Z,user_data=None,user_id='c7644d02bc784e4fb74ebaaceb3affe1',uuid=bfd4b9b2-a5fe-412f-b17b-2d45367ea438,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0c3004b4-2439-46a3-b5f9-67e77b319a70", "address": "fa:16:3e:a2:68:21", "network": {"id": "6d6b6b35-b5ef-4d7c-abce-cad21cc99e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-878222456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e7089cb52574f1daf7f578222bb7a67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c3004b4-24", "ovs_interfaceid": "0c3004b4-2439-46a3-b5f9-67e77b319a70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Apr 14 11:22:42 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-cc3da336-ccf0-4a21-b86c-5f39576e2469 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Converting VIF {"id": "0c3004b4-2439-46a3-b5f9-67e77b319a70", "address": "fa:16:3e:a2:68:21", "network": {"id": "6d6b6b35-b5ef-4d7c-abce-cad21cc99e32", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-878222456-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e7089cb52574f1daf7f578222bb7a67", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c3004b4-24", "ovs_interfaceid": "0c3004b4-2439-46a3-b5f9-67e77b319a70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Apr 14 11:22:42 user nova-compute[71509]: DEBUG nova.network.os_vif_util [None req-cc3da336-ccf0-4a21-b86c-5f39576e2469 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a2:68:21,bridge_name='br-int',has_traffic_filtering=True,id=0c3004b4-2439-46a3-b5f9-67e77b319a70,network=Network(6d6b6b35-b5ef-4d7c-abce-cad21cc99e32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c3004b4-24') {{(pid=71509) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Apr 14 11:22:42 user nova-compute[71509]: DEBUG os_vif [None req-cc3da336-ccf0-4a21-b86c-5f39576e2469 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a2:68:21,bridge_name='br-int',has_traffic_filtering=True,id=0c3004b4-2439-46a3-b5f9-67e77b319a70,network=Network(6d6b6b35-b5ef-4d7c-abce-cad21cc99e32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c3004b4-24') {{(pid=71509) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Apr 14 11:22:42 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:22:42 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0c3004b4-24, bridge=br-int, if_exists=True) {{(pid=71509) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Apr 14 11:22:42 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:22:42 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:22:42 user nova-compute[71509]: INFO os_vif [None req-cc3da336-ccf0-4a21-b86c-5f39576e2469 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a2:68:21,bridge_name='br-int',has_traffic_filtering=True,id=0c3004b4-2439-46a3-b5f9-67e77b319a70,network=Network(6d6b6b35-b5ef-4d7c-abce-cad21cc99e32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c3004b4-24')
Apr 14 11:22:42 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc3da336-ccf0-4a21-b86c-5f39576e2469 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: bfd4b9b2-a5fe-412f-b17b-2d45367ea438] calling os-brick to detach iSCSI Volume {{(pid=71509) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Apr 14 11:22:42 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc3da336-ccf0-4a21-b86c-5f39576e2469 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f0bf0749390>, {'target_iqn': 'iqn.2010-10.org.openstack:3dfb7018-b582-43c0-b9b5-f58822b9b5c6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jHsTtaBE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb': {}}" {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Apr 14 11:22:42 user nova-compute[71509]: WARNING os_brick.initiator.connectors.base [None req-cc3da336-ccf0-4a21-b86c-5f39576e2469 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Apr 14 11:22:42 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-cc3da336-ccf0-4a21-b86c-5f39576e2469 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Apr 14 11:22:42 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-cc3da336-ccf0-4a21-b86c-5f39576e2469 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Apr 14 11:22:42 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:22:42 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:22:42 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a92c069-1149-4211-b151-367d3db09fda]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3dfb7018-b582-43c0-b9b5-f58822b9b5c6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:22:42 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc3da336-ccf0-4a21-b86c-5f39576e2469 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Apr 14 11:22:42 user nova-compute[71509]: No targets found.
Apr 14 11:22:42 user nova-compute[71509]: iSNS:
Apr 14 11:22:42 user nova-compute[71509]: No targets found.
Apr 14 11:22:42 user nova-compute[71509]: STATIC:
Apr 14 11:22:42 user nova-compute[71509]: Target: iqn.2010-10.org.openstack:3dfb7018-b582-43c0-b9b5-f58822b9b5c6
Apr 14 11:22:42 user nova-compute[71509]:         Portal: 172.16.0.220:3260,-1
Apr 14 11:22:42 user nova-compute[71509]:                 Iface Name: default
Apr 14 11:22:42 user nova-compute[71509]: FIRMWARE:
Apr 14 11:22:42 user nova-compute[71509]: No targets found.
Apr 14 11:22:42 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 11:22:42 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc3da336-ccf0-4a21-b86c-5f39576e2469 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Apr 14 11:22:42 user nova-compute[71509]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Apr 14 11:22:42 user nova-compute[71509]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=71509) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Apr 14 11:22:42 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc3da336-ccf0-4a21-b86c-5f39576e2469 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3dfb7018-b582-43c0-b9b5-f58822b9b5c6', 0)] {{(pid=71509) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Apr 14 11:22:42 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:22:42 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:22:42 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[eec00053-5edb-408f-952d-a2656359e97b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3dfb7018-b582-43c0-b9b5-f58822b9b5c6\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:22:42 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:22:42 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:22:42 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd2be07f-4dad-4183-b1ef-85e9823ca3ca]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dfb7018-b582-43c0-b9b5-f58822b9b5c6 (non-flash)\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:22:42 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc3da336-ccf0-4a21-b86c-5f39576e2469 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dfb7018-b582-43c0-b9b5-f58822b9b5c6 (non-flash)
Apr 14 11:22:42 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Apr 14 11:22:42 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc3da336-ccf0-4a21-b86c-5f39576e2469 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dfb7018-b582-43c0-b9b5-f58822b9b5c6 (non-flash)
Apr 14 11:22:42 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Apr 14 11:22:42 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc3da336-ccf0-4a21-b86c-5f39576e2469 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f0bf025b1c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3dfb7018-b582-43c0-b9b5-f58822b9b5c6'): ({'sdb'}, set())}) {{(pid=71509) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Apr 14 11:22:42 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-cc3da336-ccf0-4a21-b86c-5f39576e2469 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Removing single pathed devices sdb {{(pid=71509) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Apr 14 11:22:42 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:22:42 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:22:42 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[5da9655c-cf7f-4e5a-a086-6bc6adb2b3db]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:22:42 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:22:42 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:22:42 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[5875215a-3334-4f5d-a529-a506317e69f0]: (4, ('ok\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:22:42 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-cc3da336-ccf0-4a21-b86c-5f39576e2469 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Flushing IO for device /dev/sdb {{(pid=71509) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Apr 14 11:22:42 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:22:42 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:22:42 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[4de264ff-f96a-40b0-87b5-d27860861ebd]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:22:42 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-cc3da336-ccf0-4a21-b86c-5f39576e2469 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=71509) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Apr 14 11:22:42 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:22:42 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:22:42 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c247f2f-a3a3-4d67-89e7-138715757c90]: (4, ('1', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:22:42 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-cc3da336-ccf0-4a21-b86c-5f39576e2469 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=71509) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Apr 14 11:22:42 user nova-compute[71509]: DEBUG os_brick.initiator.linuxscsi [None req-cc3da336-ccf0-4a21-b86c-5f39576e2469 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] SCSI volumes sdb have been removed. {{(pid=71509) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Apr 14 11:22:42 user nova-compute[71509]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23663383439623332', '/dev/disk/by-id/scsi-1SCST_BIO5547232d-6c849b324fe9fb75', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_5547232d') {{(pid=82281) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Apr 14 11:22:42 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[48aeb392-ca8a-4597-a46c-1f6b571fec28]: (4, None) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:22:42 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc3da336-ccf0-4a21-b86c-5f39576e2469 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3dfb7018-b582-43c0-b9b5-f58822b9b5c6')] {{(pid=71509) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Apr 14 11:22:42 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3dfb7018-b582-43c0-b9b5-f58822b9b5c6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:22:42 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3dfb7018-b582-43c0-b9b5-f58822b9b5c6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:22:42 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[16abf101-8b3f-48d2-9cec-f5ec3605d06a]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:22:42 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc3da336-ccf0-4a21-b86c-5f39576e2469 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:22:42 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3dfb7018-b582-43c0-b9b5-f58822b9b5c6 -p 172.16.0.220:3260 --logout {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:22:42 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3dfb7018-b582-43c0-b9b5-f58822b9b5c6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:22:42 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a0fbea8-dcae-4401-b1d5-0b593b7cf9b2]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:3dfb7018-b582-43c0-b9b5-f58822b9b5c6, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:3dfb7018-b582-43c0-b9b5-f58822b9b5c6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:22:42 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc3da336-ccf0-4a21-b86c-5f39576e2469 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:3dfb7018-b582-43c0-b9b5-f58822b9b5c6, portal: 172.16.0.220,3260]
Apr 14 11:22:42 user nova-compute[71509]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:3dfb7018-b582-43c0-b9b5-f58822b9b5c6, portal: 172.16.0.220,3260] successful.
Apr 14 11:22:42 user nova-compute[71509]:  stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:22:42 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3dfb7018-b582-43c0-b9b5-f58822b9b5c6 -p 172.16.0.220:3260 --op delete {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Apr 14 11:22:42 user nova-compute[71509]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3dfb7018-b582-43c0-b9b5-f58822b9b5c6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=82281) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Apr 14 11:22:42 user nova-compute[71509]: DEBUG oslo.privsep.daemon [-] privsep: reply[10afc134-275d-4b76-b7a8-b4433a89d5d2]: (4, ('', '')) {{(pid=82281) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Apr 14 11:22:42 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc3da336-ccf0-4a21-b86c-5f39576e2469 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=71509) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Apr 14 11:22:42 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.base [None req-cc3da336-ccf0-4a21-b86c-5f39576e2469 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.282s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Apr 14 11:22:42 user nova-compute[71509]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc3da336-ccf0-4a21-b86c-5f39576e2469 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] <== disconnect_volume: return (283ms) None {{(pid=71509) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Apr 14 11:22:42 user nova-compute[71509]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc3da336-ccf0-4a21-b86c-5f39576e2469 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: bfd4b9b2-a5fe-412f-b17b-2d45367ea438] Disconnected iSCSI Volume {{(pid=71509) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:78}}
Apr 14 11:22:42 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-cc3da336-ccf0-4a21-b86c-5f39576e2469 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: bfd4b9b2-a5fe-412f-b17b-2d45367ea438] Deleting instance files /opt/stack/data/nova/instances/bfd4b9b2-a5fe-412f-b17b-2d45367ea438_del
Apr 14 11:22:42 user nova-compute[71509]: INFO nova.virt.libvirt.driver [None req-cc3da336-ccf0-4a21-b86c-5f39576e2469 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: bfd4b9b2-a5fe-412f-b17b-2d45367ea438] Deletion of /opt/stack/data/nova/instances/bfd4b9b2-a5fe-412f-b17b-2d45367ea438_del complete
Apr 14 11:22:42 user nova-compute[71509]: INFO nova.compute.manager [None req-cc3da336-ccf0-4a21-b86c-5f39576e2469 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: bfd4b9b2-a5fe-412f-b17b-2d45367ea438] Took 1.11 seconds to destroy the instance on the hypervisor.
Apr 14 11:22:42 user nova-compute[71509]: DEBUG oslo.service.loopingcall [None req-cc3da336-ccf0-4a21-b86c-5f39576e2469 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=71509) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Apr 14 11:22:42 user nova-compute[71509]: DEBUG nova.compute.manager [-] [instance: bfd4b9b2-a5fe-412f-b17b-2d45367ea438] Deallocating network for instance {{(pid=71509) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2264}}
Apr 14 11:22:42 user nova-compute[71509]: DEBUG nova.network.neutron [-] [instance: bfd4b9b2-a5fe-412f-b17b-2d45367ea438] deallocate_for_instance() {{(pid=71509) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}}
Apr 14 11:22:43 user nova-compute[71509]: DEBUG nova.network.neutron [-] [instance: bfd4b9b2-a5fe-412f-b17b-2d45367ea438] Updating instance_info_cache with network_info: [] {{(pid=71509) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Apr 14 11:22:43 user nova-compute[71509]: INFO nova.compute.manager [-] [instance: bfd4b9b2-a5fe-412f-b17b-2d45367ea438] Took 0.44 seconds to deallocate network for instance.
Apr 14 11:22:43 user nova-compute[71509]: DEBUG nova.compute.manager [req-4b2f77b1-c4ac-420d-95d4-8d8e2668d374 req-237bb841-5f9f-48c5-8810-15f6f16db7a8 service nova] [instance: bfd4b9b2-a5fe-412f-b17b-2d45367ea438] Received event network-vif-deleted-0c3004b4-2439-46a3-b5f9-67e77b319a70 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:22:44 user nova-compute[71509]: INFO nova.compute.manager [None req-cc3da336-ccf0-4a21-b86c-5f39576e2469 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] [instance: bfd4b9b2-a5fe-412f-b17b-2d45367ea438] Took 0.75 seconds to detach 1 volumes for instance.
Apr 14 11:22:44 user nova-compute[71509]: DEBUG nova.compute.manager [req-0ba91f3a-005c-4b39-8de2-e8aef9b7e0bc req-17546989-2839-456d-b5b8-e8d62fab9451 service nova] [instance: bfd4b9b2-a5fe-412f-b17b-2d45367ea438] Received event network-vif-plugged-0c3004b4-2439-46a3-b5f9-67e77b319a70 {{(pid=71509) external_instance_event /opt/stack/nova/nova/compute/manager.py:10982}}
Apr 14 11:22:44 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-0ba91f3a-005c-4b39-8de2-e8aef9b7e0bc req-17546989-2839-456d-b5b8-e8d62fab9451 service nova] Acquiring lock "bfd4b9b2-a5fe-412f-b17b-2d45367ea438-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:22:44 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-0ba91f3a-005c-4b39-8de2-e8aef9b7e0bc req-17546989-2839-456d-b5b8-e8d62fab9451 service nova] Lock "bfd4b9b2-a5fe-412f-b17b-2d45367ea438-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:22:44 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [req-0ba91f3a-005c-4b39-8de2-e8aef9b7e0bc req-17546989-2839-456d-b5b8-e8d62fab9451 service nova] Lock "bfd4b9b2-a5fe-412f-b17b-2d45367ea438-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:22:44 user nova-compute[71509]: DEBUG nova.compute.manager [req-0ba91f3a-005c-4b39-8de2-e8aef9b7e0bc req-17546989-2839-456d-b5b8-e8d62fab9451 service nova] [instance: bfd4b9b2-a5fe-412f-b17b-2d45367ea438] No waiting events found dispatching network-vif-plugged-0c3004b4-2439-46a3-b5f9-67e77b319a70 {{(pid=71509) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Apr 14 11:22:44 user nova-compute[71509]: WARNING nova.compute.manager [req-0ba91f3a-005c-4b39-8de2-e8aef9b7e0bc req-17546989-2839-456d-b5b8-e8d62fab9451 service nova] [instance: bfd4b9b2-a5fe-412f-b17b-2d45367ea438] Received unexpected event network-vif-plugged-0c3004b4-2439-46a3-b5f9-67e77b319a70 for instance with vm_state active and task_state deleting.
Apr 14 11:22:44 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-cc3da336-ccf0-4a21-b86c-5f39576e2469 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:22:44 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-cc3da336-ccf0-4a21-b86c-5f39576e2469 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:22:44 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-cc3da336-ccf0-4a21-b86c-5f39576e2469 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 11:22:44 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-cc3da336-ccf0-4a21-b86c-5f39576e2469 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 11:22:44 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-cc3da336-ccf0-4a21-b86c-5f39576e2469 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.118s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:22:44 user nova-compute[71509]: INFO nova.scheduler.client.report [None req-cc3da336-ccf0-4a21-b86c-5f39576e2469 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Deleted allocations for instance bfd4b9b2-a5fe-412f-b17b-2d45367ea438
Apr 14 11:22:44 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-cc3da336-ccf0-4a21-b86c-5f39576e2469 tempest-TestVolumeBootPattern-193101874 tempest-TestVolumeBootPattern-193101874-project-member] Lock "bfd4b9b2-a5fe-412f-b17b-2d45367ea438" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.604s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:22:47 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:22:52 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:22:57 user nova-compute[71509]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1681471362.6022437, bfd4b9b2-a5fe-412f-b17b-2d45367ea438 => Stopped> {{(pid=71509) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Apr 14 11:22:57 user nova-compute[71509]: INFO nova.compute.manager [-] [instance: bfd4b9b2-a5fe-412f-b17b-2d45367ea438] VM Stopped (Lifecycle Event)
Apr 14 11:22:57 user nova-compute[71509]: DEBUG nova.compute.manager [None req-ff2ce240-258a-4c2c-88e4-22f3a81cff00 None None] [instance: bfd4b9b2-a5fe-412f-b17b-2d45367ea438] Checking state {{(pid=71509) _get_power_state /opt/stack/nova/nova/compute/manager.py:1762}}
Apr 14 11:22:57 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:23:01 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:23:01 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71509) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 11:23:02 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:23:06 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:23:06 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:23:06 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:23:07 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:23:07 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:23:10 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:23:12 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:23:13 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:23:13 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Starting heal instance info cache {{(pid=71509) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 11:23:13 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Rebuilding the list of instances to heal {{(pid=71509) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 11:23:13 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Didn't find any instances for network info cache update. {{(pid=71509) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 14 11:23:17 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:23:17 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:23:18 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:23:18 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:23:18 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:23:18 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:23:18 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Auditing locally available compute resources for user (node: user) {{(pid=71509) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 11:23:18 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 11:23:18 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 11:23:18 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Hypervisor/Node resource view: name=user free_ram=8853MB free_disk=25.950523376464844GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71509) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 11:23:18 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:23:18 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:23:18 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71509) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 11:23:18 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71509) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 11:23:18 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 11:23:18 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 11:23:19 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Compute_service record updated for user:user {{(pid=71509) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 11:23:19 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.140s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:23:21 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:23:22 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:23:27 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:23:32 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:23:33 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:23:37 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:23:39 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:23:42 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:23:42 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:23:47 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:23:52 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:23:57 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:24:01 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:24:01 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71509) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 11:24:02 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:24:03 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:24:07 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:24:07 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:24:07 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:24:07 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Cleaning up deleted instances with incomplete migration  {{(pid=71509) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11117}}
Apr 14 11:24:07 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:24:08 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:24:08 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:24:10 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:24:12 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:24:14 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:24:14 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Starting heal instance info cache {{(pid=71509) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 11:24:14 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Rebuilding the list of instances to heal {{(pid=71509) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 11:24:14 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Didn't find any instances for network info cache update. {{(pid=71509) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 14 11:24:16 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:24:16 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Cleaning up deleted instances {{(pid=71509) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11079}}
Apr 14 11:24:16 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] There are 0 instances to clean {{(pid=71509) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11088}}
Apr 14 11:24:17 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:24:18 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:24:19 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager.update_available_resource {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:24:19 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:24:19 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:24:19 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:24:19 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Auditing locally available compute resources for user (node: user) {{(pid=71509) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:861}}
Apr 14 11:24:19 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 11:24:19 user nova-compute[71509]: WARNING nova.virt.libvirt.driver [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Apr 14 11:24:19 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Hypervisor/Node resource view: name=user free_ram=8882MB free_disk=25.940082550048828GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=71509) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1034}}
Apr 14 11:24:19 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Apr 14 11:24:19 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Apr 14 11:24:20 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=71509) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1057}}
Apr 14 11:24:20 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Final resource view: name=user phys_ram=16023MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=71509) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1066}}
Apr 14 11:24:20 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Refreshing inventories for resource provider 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Apr 14 11:24:20 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Updating ProviderTree inventory for provider 52209f7e-594e-4cf4-9018-18636056cd6b from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Apr 14 11:24:20 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Updating inventory in ProviderTree for provider 52209f7e-594e-4cf4-9018-18636056cd6b with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Apr 14 11:24:20 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Refreshing aggregate associations for resource provider 52209f7e-594e-4cf4-9018-18636056cd6b, aggregates: None {{(pid=71509) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Apr 14 11:24:20 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Refreshing trait associations for resource provider 52209f7e-594e-4cf4-9018-18636056cd6b, traits: COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_VIRTIO,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE42,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NODE,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_SATA {{(pid=71509) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Apr 14 11:24:20 user nova-compute[71509]: DEBUG nova.compute.provider_tree [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Inventory has not changed in ProviderTree for provider: 52209f7e-594e-4cf4-9018-18636056cd6b {{(pid=71509) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Apr 14 11:24:20 user nova-compute[71509]: DEBUG nova.scheduler.client.report [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Inventory has not changed for provider 52209f7e-594e-4cf4-9018-18636056cd6b based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16023, 'reserved': 512, 'min_unit': 1, 'max_unit': 16023, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=71509) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Apr 14 11:24:20 user nova-compute[71509]: DEBUG nova.compute.resource_tracker [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Compute_service record updated for user:user {{(pid=71509) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:995}}
Apr 14 11:24:20 user nova-compute[71509]: DEBUG oslo_concurrency.lockutils [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.389s {{(pid=71509) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Apr 14 11:24:22 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:24:27 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:24:32 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:24:37 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:24:39 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:24:42 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:24:47 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:24:52 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:24:57 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:25:02 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:25:02 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=71509) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10411}}
Apr 14 11:25:02 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:25:07 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:25:07 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:25:08 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:25:09 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:25:09 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:25:11 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:25:12 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Apr 14 11:25:16 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Apr 14 11:25:16 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Starting heal instance info cache {{(pid=71509) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9792}}
Apr 14 11:25:16 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Rebuilding the list of instances to heal {{(pid=71509) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9796}}
Apr 14 11:25:16 user nova-compute[71509]: DEBUG nova.compute.manager [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Didn't find any instances for network info cache update. {{(pid=71509) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9878}}
Apr 14 11:25:17 user nova-compute[71509]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=71509) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Apr 14 11:25:19 user nova-compute[71509]: DEBUG oslo_service.periodic_task [None req-1ccf8a29-cf0f-4111-a4d6-32b7f4ec5997 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=71509) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}